MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.04-31-gc768c36d6e08) initialized Starting run at 06:46:40 UTC on 2022-04-27. Successfully read inputs file ... Castro git describe: 22.04-32-g3e7bcd3b6 AMReX git describe: 22.04-31-gc768c36d6 Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 4.289006454 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.017404781 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.360268985 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.008169315 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.274280295 Castro::do_new_sources() time = 0.00952521 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7167439674 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.373862577 [STEP 1] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007347342 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.266387485 Castro::do_new_sources() time = 0.009045035 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7565784727 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.359637724 [STEP 2] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00631046 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.262577479 Castro::do_new_sources() time = 0.00867584 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7674798293 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.353099781 [STEP 3] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006684029 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.173743076 Castro::do_new_sources() time = 0.009280807 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.069293096 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.253713392 [STEP 4] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006530416 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.180596336 Castro::do_new_sources() time = 0.009678408 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.058493987 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.255942908 [STEP 5] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.017194687 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006835148 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.170033245 Castro::do_new_sources() time = 0.008938187 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.137727034 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.237711174 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004127816 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.155493084 Castro::do_new_sources() time = 0.007442638 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.279478413 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.212074009 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004426648 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.155411195 Castro::do_new_sources() time = 0.005242095 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.31817924 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.206648156 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004104599 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1549738 Castro::do_new_sources() time = 0.005662117 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.311878205 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.207015264 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004163795 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.155814932 Castro::do_new_sources() time = 0.005105027 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.31140658 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.20704193 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.013410087 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.212552549 seconds Ending run at 06:46:43 UTC on 2022-04-27. Run time = 3.329792566 Run time without initialization = 2.911818241 Average number of zones advanced per microsecond: 0.900 Average number of zones advanced per microsecond per rank: 0.056 TinyProfiler total time across processes [min...avg...max]: 3.329 ... 3.329 ... 3.33 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.5037 1.7777 1.9453 58.42% Amr::writePlotFile() 2 0.5537 0.5608 0.5624 16.89% Castro::do_advance_ctu() 10 0.03511 0.2103 0.493 14.81% FabArray::ParallelCopy_finish() 251 0.0534 0.08483 0.1514 4.55% FabArray::setVal() 164 0.0657 0.08504 0.09314 2.80% Castro::reset_internal_energy() 63 0.05295 0.05926 0.06734 2.02% Castro::estTimeStep() 21 0.01829 0.03539 0.06162 1.85% VisMF::Write(FabArray) 11 0.04072 0.04723 0.06043 1.81% FabArray::ParallelCopy_nowait() 251 0.03286 0.04068 0.05191 1.56% StateData::FillBoundary(geom) 20 0.0187 0.03281 0.04845 1.46% FillPatchIterator::Initialize 251 0.03413 0.03868 0.04328 1.30% Castro::computeTemp() 63 0.03296 0.03673 0.0411 1.23% Castro::do_old_sources() 10 0.0001511 0.008568 0.04031 1.21% Castro::post_timestep() 10 0.007879 0.01756 0.03562 1.07% Castro::normalize_species() 62 0.02354 0.02742 0.03155 0.95% Castro::expand_state() 10 0.0181 0.0227 0.02902 0.87% Castro::initialize_do_advance() 10 0.01565 0.02553 0.02828 0.85% Castro::finalize_do_advance() 10 0.002471 0.02163 0.02826 0.85% Castro::do_new_sources() 10 0.0001005 0.005755 0.02557 0.77% Castro::construct_new_gravity_source() 10 0.01889 0.02143 0.02311 0.69% Castro::hybrid_to_linear_momentum() 62 0.01487 0.01864 0.02262 0.68% Castro::initialize_advance() 10 0.01119 0.01667 0.02198 0.66% Amr::checkPoint() 3 0.008198 0.01482 0.02008 0.60% MultiFab::Saxpy() 20 0.0122 0.01397 0.01601 0.48% MultiFab::contains_nan() 20 0.00996 0.01266 0.01593 0.48% Gravity::get_new_grav_vector() 11 0.006637 0.009054 0.0127 0.38% FabArray::setDomainBndry() 251 0.007584 0.009823 0.01214 0.36% Castro::derive() 187 0.008488 0.01023 0.01176 0.35% Castro::construct_old_gravity_source() 10 0.005745 0.007829 0.0104 0.31% Gravity::add_pointmass_to_gravity() 21 0.00772 0.008658 0.009411 0.28% Amr::defBaseLevel() 1 0.004576 0.006555 0.007287 0.22% Castro::fill_hybrid_hydro_source() 30 0.004912 0.006206 0.007084 0.21% Gravity::get_old_grav_vector() 10 0.004435 0.005764 0.006828 0.21% Castro::volWgtSum() 176 0.005084 0.005527 0.005875 0.18% Castro::enforce_min_density() 62 0.004136 0.004816 0.005599 0.17% Castro::swap_state_time_levels() 10 0.004009 0.004418 0.004985 0.15% StateData::define() 4 0.003288 0.004481 0.004911 0.15% Castro::post_init() 1 0.0006293 0.001741 0.004853 0.15% Castro::initData() 1 0.001786 0.002385 0.00264 0.08% main() 1 0.0008097 0.0009856 0.001522 0.05% Castro::subcycle_advance_ctu() 10 4.882e-05 0.0001227 0.001052 0.03% Castro::locSquaredSum() 11 0.0004037 0.0004762 0.0005735 0.02% Amr::InitAmr() 1 0.0002402 0.0003883 0.0005621 0.02% Amr::coarseTimeStep() 10 0.0002743 0.0003513 0.0004885 0.01% DistributionMapping::LeastUsedCPUs() 1 9.802e-06 0.0002112 0.0003927 0.01% Castro::clean_state() 62 0.000204 0.0002782 0.0003592 0.01% StateDataPhysBCFunct::() 251 0.0001686 0.0002435 0.0003061 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002201 0.0002482 0.0002934 0.01% StateData::checkPoint() 12 2.151e-05 4.414e-05 0.0002923 0.01% FillPatchSingleLevel 251 0.0001547 0.0001872 0.0002133 0.01% FabArray::ParallelCopy() 251 0.0001403 0.0001757 0.0002129 0.01% Castro::computeNewDt() 9 7.52e-06 1.968e-05 0.0001819 0.01% Castro::enforce_consistent_e() 1 6.624e-05 9.759e-05 0.000166 0.00% AmrLevel::checkPoint() 3 4.658e-05 7.179e-05 0.0001634 0.00% Castro::construct_new_source() 70 6.938e-05 0.0001203 0.0001479 0.00% Castro::finalize_advance() 10 0.0001006 0.0001186 0.0001423 0.00% Amr::timeStep() 10 5.514e-05 6.83e-05 0.0001281 0.00% Castro::construct_old_source() 70 7.247e-05 9.672e-05 0.0001207 0.00% Castro::construct_new_gravity() 10 3.519e-05 6.611e-05 0.0001049 0.00% Castro::construct_old_gravity() 10 4.888e-05 8.157e-05 0.0001033 0.00% FabArrayBase::CPC::define() 2 4.008e-05 5.255e-05 9.175e-05 0.00% Amr::writeSmallPlotFile() 1 3.386e-05 7.054e-05 8.77e-05 0.00% Castro::apply_source_to_state() 20 4.156e-05 6.728e-05 7.632e-05 0.00% Castro::check_for_nan() 20 3.053e-05 5.196e-05 7.18e-05 0.00% Castro::advance() 10 4.41e-05 5.131e-05 7.037e-05 0.00% FabArrayBase::getCPC() 20 3.478e-05 5.11e-05 6.986e-05 0.00% Castro::enforce_speed_limit() 62 3.933e-05 4.937e-05 6.16e-05 0.00% Castro::construct_new_hybrid_source() 10 1.669e-05 3.23e-05 4.937e-05 0.00% Amr::FinalizeInit() 1 4.425e-06 9.119e-06 4.791e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.67e-05 2.588e-05 4.017e-05 0.00% Gravity::swapTimeLevels() 10 1.565e-05 2.452e-05 3.909e-05 0.00% Castro::create_source_corrector() 10 1.164e-05 2.173e-05 3.393e-05 0.00% Castro::construct_old_hybrid_source() 10 1.724e-05 2.44e-05 3.19e-05 0.00% Castro::construct_new_rotation_source() 10 9.348e-06 1.367e-05 2.526e-05 0.00% Amr::initSubcycle() 1 8.661e-06 1.332e-05 1.638e-05 0.00% Castro::gwstrain() 11 5.634e-06 8.172e-06 1.453e-05 0.00% Castro::construct_old_rotation_source() 10 6.457e-06 9.047e-06 1.2e-05 0.00% Castro::FluxRegFineAdd() 10 7.853e-06 9.377e-06 1.069e-05 0.00% Castro::retry_advance_ctu() 10 5.899e-06 8.585e-06 1.03e-05 0.00% Amr::InitializeInit() 1 2.221e-06 3.539e-06 8.367e-06 0.00% Gravity::set_mass_offset() 10 5.348e-06 7.081e-06 8.334e-06 0.00% Castro::computeInitialDt() 2 3.124e-06 4.46e-06 7.291e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.427e-06 6.111e-06 7.14e-06 0.00% AmrLevel::checkPointPost() 3 4.24e-06 5.368e-06 6.807e-06 0.00% AmrLevel::checkPointPre() 3 2.582e-06 3.754e-06 5.224e-06 0.00% Castro::post_regrid() 1 3.207e-06 3.819e-06 4.689e-06 0.00% Amr::init() 1 2.53e-06 3.175e-06 4.385e-06 0.00% Amr::initialInit() 1 1.796e-06 2.595e-06 3.662e-06 0.00% DistributionMapping::Distribute() 1 1.486e-06 2.161e-06 2.51e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.329 3.329 3.33 100.00% Amr::coarseTimeStep() 10 2.698 2.698 2.698 81.02% Amr::timeStep() 10 2.657 2.657 2.657 79.80% Castro::advance() 10 2.581 2.6 2.607 78.28% Castro::subcycle_advance_ctu() 10 2.485 2.509 2.529 75.96% Castro::do_advance_ctu() 10 2.483 2.509 2.529 75.96% Castro::construct_ctu_hydro_source() 10 1.504 1.778 1.945 58.42% Amr::writePlotFile() 2 0.5731 0.5731 0.5731 17.21% Amr::init() 1 0.4172 0.4174 0.4176 12.54% FillPatchIterator::Initialize 251 0.1818 0.2075 0.2497 7.50% Castro::initialize_do_advance() 10 0.2047 0.2153 0.2268 6.81% FillPatchSingleLevel 251 0.1313 0.159 0.2075 6.23% FabArray::ParallelCopy() 251 0.09236 0.1258 0.1885 5.66% Castro::clean_state() 62 0.1278 0.1455 0.1667 5.01% Castro::expand_state() 10 0.1339 0.1453 0.1584 4.76% FabArray::ParallelCopy_finish() 251 0.0534 0.08483 0.1514 4.55% Castro::computeTemp() 63 0.0859 0.09598 0.1084 3.26% Castro::initialize_advance() 10 0.06745 0.09036 0.1015 3.05% FabArray::setVal() 164 0.0657 0.08504 0.09314 2.80% Castro::do_new_sources() 10 0.0612 0.07417 0.09213 2.77% Castro::do_old_sources() 10 0.04014 0.05539 0.08099 2.43% Castro::post_timestep() 10 0.05052 0.05718 0.07648 2.30% Castro::reset_internal_energy() 63 0.05295 0.05926 0.06734 2.02% Castro::estTimeStep() 21 0.01829 0.03539 0.06162 1.85% VisMF::Write(FabArray) 11 0.04072 0.04723 0.06043 1.81% FabArray::ParallelCopy_nowait() 251 0.03295 0.04078 0.05202 1.56% Amr::checkPoint() 3 0.04971 0.04984 0.04986 1.50% StateDataPhysBCFunct::() 251 0.0189 0.03305 0.04874 1.46% StateData::FillBoundary(geom) 20 0.0187 0.03281 0.04845 1.46% AmrLevel::checkPoint() 3 0.02977 0.03501 0.0415 1.25% StateData::checkPoint() 12 0.02971 0.03494 0.04134 1.24% Amr::initialInit() 1 0.0379 0.038 0.03817 1.15% Castro::normalize_species() 62 0.02354 0.02742 0.03155 0.95% Castro::volWgtSum() 176 0.0209 0.02516 0.02837 0.85% Castro::finalize_do_advance() 10 0.002471 0.02163 0.02826 0.85% Castro::construct_new_source() 70 0.02218 0.02568 0.0277 0.83% Amr::InitializeInit() 1 0.01693 0.02439 0.02691 0.81% Amr::defBaseLevel() 1 0.01693 0.02439 0.02691 0.81% Castro::derive() 187 0.01666 0.02042 0.02338 0.70% Castro::construct_new_gravity_source() 10 0.01889 0.02143 0.02311 0.69% Castro::hybrid_to_linear_momentum() 62 0.01487 0.01864 0.02262 0.68% Amr::FinalizeInit() 1 0.01107 0.0136 0.02121 0.64% Gravity::get_new_grav_vector() 11 0.0113 0.01487 0.01987 0.60% Castro::construct_new_gravity() 10 0.01127 0.01408 0.01937 0.58% Castro::apply_source_to_state() 20 0.01227 0.01404 0.01608 0.48% MultiFab::Saxpy() 20 0.0122 0.01397 0.01601 0.48% Castro::check_for_nan() 20 0.01 0.01271 0.01599 0.48% MultiFab::contains_nan() 20 0.00996 0.01266 0.01593 0.48% Castro::construct_old_gravity() 10 0.009932 0.01164 0.01384 0.42% Castro::construct_old_source() 70 0.007624 0.01008 0.01311 0.39% Gravity::get_old_grav_vector() 10 0.009253 0.01089 0.01301 0.39% Castro::computeInitialDt() 2 0.002199 0.004729 0.01234 0.37% FabArray::setDomainBndry() 251 0.007584 0.009823 0.01214 0.36% Castro::initData() 1 0.007124 0.009876 0.01086 0.33% Castro::construct_old_gravity_source() 10 0.005745 0.007829 0.0104 0.31% Gravity::add_pointmass_to_gravity() 21 0.00772 0.008658 0.009411 0.28% Castro::computeNewDt() 9 0.008159 0.008287 0.008351 0.25% Castro::post_init() 1 0.007135 0.007405 0.008274 0.25% Castro::fill_hybrid_hydro_source() 30 0.004912 0.006206 0.007084 0.21% Castro::enforce_min_density() 62 0.004136 0.004816 0.005599 0.17% Castro::swap_state_time_levels() 10 0.004009 0.004418 0.004985 0.15% AmrLevel::AmrLevel(dm) 1 0.003315 0.004507 0.004942 0.15% StateData::define() 4 0.003288 0.004481 0.004911 0.15% Castro::construct_new_hybrid_source() 10 0.003162 0.004117 0.004783 0.14% Castro::post_regrid() 1 0.00168 0.002551 0.00284 0.09% Castro::construct_old_hybrid_source() 10 0.001785 0.002146 0.002579 0.08% Castro::locSquaredSum() 11 0.00104 0.001266 0.001465 0.04% Amr::InitAmr() 1 0.0002493 0.0004017 0.0005768 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.731e-05 0.0002195 0.0004014 0.01% DistributionMapping::LeastUsedCPUs() 1 9.802e-06 0.0002112 0.0003927 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002201 0.0002482 0.0002934 0.01% Castro::enforce_consistent_e() 1 6.624e-05 9.759e-05 0.000166 0.00% Castro::finalize_advance() 10 0.0001093 0.0001279 0.0001518 0.00% FabArrayBase::getCPC() 20 8.542e-05 0.0001036 0.0001384 0.00% FabArrayBase::CPC::define() 2 4.008e-05 5.255e-05 9.175e-05 0.00% Amr::writeSmallPlotFile() 1 3.386e-05 7.054e-05 8.77e-05 0.00% Castro::enforce_speed_limit() 62 3.933e-05 4.937e-05 6.16e-05 0.00% Gravity::swapTimeLevels() 10 1.565e-05 2.452e-05 3.909e-05 0.00% Castro::create_source_corrector() 10 1.164e-05 2.173e-05 3.393e-05 0.00% Castro::construct_new_rotation_source() 10 9.348e-06 1.367e-05 2.526e-05 0.00% Amr::initSubcycle() 1 8.661e-06 1.332e-05 1.638e-05 0.00% Castro::gwstrain() 11 5.634e-06 8.172e-06 1.453e-05 0.00% Castro::construct_old_rotation_source() 10 6.457e-06 9.047e-06 1.2e-05 0.00% Castro::FluxRegFineAdd() 10 7.853e-06 9.377e-06 1.069e-05 0.00% Castro::retry_advance_ctu() 10 5.899e-06 8.585e-06 1.03e-05 0.00% Gravity::set_mass_offset() 10 5.348e-06 7.081e-06 8.334e-06 0.00% AmrLevel::checkPointPost() 3 4.24e-06 5.368e-06 6.807e-06 0.00% AmrLevel::checkPointPre() 3 2.582e-06 3.754e-06 5.224e-06 0.00% DistributionMapping::Distribute() 1 1.486e-06 2.161e-06 2.51e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.04-31-gc768c36d6e08) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.04-31-gc768c36d6e08) initialized Starting run at 06:46:44 UTC on 2022-04-27. Successfully read inputs file ... Castro git describe: 22.04-32-g3e7bcd3b6 AMReX git describe: 22.04-31-gc768c36d6 Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 32.50096632 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.037485985 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007315794 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.277927772 Castro::do_new_sources() time = 0.009644591 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7061332243 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.381441435 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007397172 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.267206629 Castro::do_new_sources() time = 0.008911545 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7463455683 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.360745227 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005706768 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.260139896 Castro::do_new_sources() time = 0.008609065 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7604281988 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.354434384 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005443843 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.245069101 Castro::do_new_sources() time = 0.009206843 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.8042326079 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.332250562 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006555447 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.177717372 Castro::do_new_sources() time = 0.009468074 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.051908252 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.255673694 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.024763463 seconds Ending run at 06:46:45 UTC on 2022-04-27. Run time = 1.750140502 Run time without initialization = 1.712210644 Average number of zones advanced per microsecond: 0.766 Average number of zones advanced per microsecond per rank: 0.048 TinyProfiler total time across processes [min...avg...max]: 1.749 ... 1.75 ... 1.75 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.7689 1.0677 1.2429 71.01% Castro::do_advance_ctu() 5 0.02044 0.1903 0.4923 28.13% FabArray::ParallelCopy_finish() 116 0.03134 0.05676 0.1182 6.75% FabArray::setVal() 80 0.03718 0.04565 0.05115 2.92% Castro::do_old_sources() 5 8.318e-05 0.01303 0.04405 2.52% Castro::reset_internal_energy() 30 0.02634 0.03137 0.03867 2.21% Castro::estTimeStep() 10 0.009907 0.01689 0.03639 2.08% StateData::FillBoundary(geom) 10 0.01015 0.02268 0.03574 2.04% FabArray::ParallelCopy_nowait() 116 0.01731 0.02355 0.03347 1.91% FillPatchIterator::Initialize 116 0.01709 0.02383 0.02754 1.57% Castro::computeTemp() 30 0.0163 0.01951 0.02428 1.39% Castro::post_timestep() 5 0.003053 0.01163 0.02312 1.32% Amr::writePlotFile() 1 0.01712 0.01896 0.01943 1.11% Castro::normalize_species() 30 0.01183 0.015 0.01924 1.10% Castro::expand_state() 5 0.009255 0.01422 0.01907 1.09% VisMF::Read() 3 0.01642 0.01832 0.01865 1.07% Castro::do_new_sources() 5 6.856e-05 0.005655 0.01822 1.04% Castro::finalize_do_advance() 5 0.008683 0.01386 0.01728 0.99% Castro::initialize_do_advance() 5 0.0117 0.01491 0.01693 0.97% Castro::construct_new_gravity_source() 5 0.01199 0.01397 0.0159 0.91% Castro::hybrid_to_linear_momentum() 30 0.008135 0.01129 0.01547 0.88% Castro::initialize_advance() 5 0.007913 0.0113 0.01376 0.79% Amr::restart() 1 0.01307 0.01352 0.01366 0.78% MultiFab::contains_nan() 10 0.005502 0.008107 0.01108 0.63% MultiFab::Saxpy() 10 0.006583 0.008245 0.009269 0.53% VisMF::Write(FabArray) 1 0.006042 0.006516 0.008357 0.48% Castro::derive() 86 0.005036 0.00658 0.0083 0.47% FabArray::setDomainBndry() 116 0.002869 0.005249 0.007215 0.41% Gravity::get_new_grav_vector() 5 0.003379 0.004987 0.006924 0.40% Castro::construct_old_gravity_source() 5 0.002486 0.004553 0.005973 0.34% Gravity::add_pointmass_to_gravity() 10 0.004099 0.004839 0.005798 0.33% Castro::post_restart() 1 5.824e-05 0.0007298 0.004649 0.27% Castro::swap_state_time_levels() 5 0.004208 0.004468 0.00458 0.26% Castro::fill_hybrid_hydro_source() 15 0.0027 0.003706 0.004356 0.25% StateData::restartDoit() 4 0.002766 0.003844 0.004013 0.23% Gravity::get_old_grav_vector() 5 0.002403 0.00312 0.003983 0.23% Castro::enforce_min_density() 30 0.00221 0.002671 0.003402 0.19% Castro::volWgtSum() 80 0.002391 0.002726 0.003031 0.17% main() 1 0.001507 0.001948 0.002252 0.13% Castro::finalize_advance() 5 0.0007427 0.001354 0.001439 0.08% Castro::subcycle_advance_ctu() 5 3.527e-05 7.81e-05 0.0006049 0.03% Amr::InitAmr() 1 0.0002556 0.0003989 0.0004684 0.03% Castro::locSquaredSum() 6 0.0002233 0.0003013 0.0003722 0.02% Amr::coarseTimeStep() 5 0.000185 0.0002353 0.0003062 0.02% AmrLevel::restart() 1 0.0001381 0.0002335 0.0002627 0.02% Castro::clean_state() 30 0.0001126 0.0001576 0.0002036 0.01% StateDataPhysBCFunct::() 116 9.705e-05 0.000128 0.0001983 0.01% FillPatchSingleLevel 116 7.484e-05 0.0001031 0.0001425 0.01% FabArray::ParallelCopy() 116 6.129e-05 9.23e-05 0.0001396 0.01% FabArrayBase::CPC::define() 2 3.028e-05 5.947e-05 0.0001047 0.01% Castro::construct_new_source() 35 3.609e-05 7.476e-05 0.0001016 0.01% Castro::computeNewDt() 5 4.648e-06 1.109e-05 9.184e-05 0.01% Castro::construct_new_gravity() 5 2.108e-05 4.516e-05 8.998e-05 0.01% Castro::construct_old_source() 35 3.347e-05 4.728e-05 7.873e-05 0.00% Castro::construct_old_gravity() 5 3.255e-05 4.22e-05 5.433e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.061e-05 2.791e-05 5.426e-05 0.00% Amr::timeStep() 5 3.066e-05 3.615e-05 5.326e-05 0.00% Castro::check_for_nan() 10 1.764e-05 3.084e-05 5.205e-05 0.00% Castro::enforce_speed_limit() 30 2.906e-05 3.474e-05 4.556e-05 0.00% Castro::advance() 5 2.209e-05 3.114e-05 4.011e-05 0.00% Amr::writeSmallPlotFile() 1 3.143e-05 3.524e-05 3.92e-05 0.00% FabArrayBase::getCPC() 10 1.966e-05 2.675e-05 3.909e-05 0.00% Castro::construct_new_hybrid_source() 5 8.159e-06 2.288e-05 3.404e-05 0.00% Castro::apply_source_to_state() 10 1.951e-05 2.759e-05 3.373e-05 0.00% Castro::create_source_corrector() 5 1.017e-05 1.531e-05 2.64e-05 0.00% Gravity::swapTimeLevels() 5 7.078e-06 1.233e-05 2.144e-05 0.00% Castro::construct_old_hybrid_source() 5 7.379e-06 1.139e-05 1.742e-05 0.00% Castro::gwstrain() 5 3.377e-06 6.065e-06 1.548e-05 0.00% Amr::initSubcycle() 1 8.85e-06 1.379e-05 1.515e-05 0.00% Castro::construct_new_rotation_source() 5 4.725e-06 7.533e-06 1.109e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.799e-06 7.147e-06 8.317e-06 0.00% Castro::construct_old_rotation_source() 5 3.16e-06 5.033e-06 7.73e-06 0.00% Gravity::set_mass_offset() 6 4.197e-06 5.291e-06 6.874e-06 0.00% Castro::retry_advance_ctu() 5 3.951e-06 5.324e-06 6.541e-06 0.00% Castro::FluxRegFineAdd() 5 3.238e-06 4.065e-06 5.281e-06 0.00% DistributionMapping::Distribute() 1 2.04e-06 2.423e-06 3.11e-06 0.00% AmrLevel::AmrLevel() 1 1.066e-06 1.763e-06 2.985e-06 0.00% Amr::init() 1 1.102e-06 1.397e-06 1.907e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.749 1.75 1.75 100.00% Amr::coarseTimeStep() 5 1.685 1.685 1.685 96.26% Amr::timeStep() 5 1.679 1.679 1.679 95.94% Castro::advance() 5 1.636 1.642 1.646 94.03% Castro::subcycle_advance_ctu() 5 1.578 1.584 1.595 91.14% Castro::do_advance_ctu() 5 1.578 1.584 1.595 91.14% Castro::construct_ctu_hydro_source() 5 0.7689 1.068 1.243 71.01% FillPatchIterator::Initialize 116 0.1051 0.1325 0.1683 9.62% Castro::initialize_do_advance() 5 0.1219 0.1321 0.1487 8.50% FillPatchSingleLevel 116 0.07384 0.1034 0.1483 8.47% FabArray::ParallelCopy() 116 0.05263 0.08049 0.138 7.88% FabArray::ParallelCopy_finish() 116 0.03134 0.05676 0.1182 6.75% Castro::clean_state() 30 0.06537 0.08004 0.1 5.71% Castro::expand_state() 5 0.08446 0.09089 0.0997 5.70% Castro::do_old_sources() 5 0.0222 0.03877 0.06633 3.79% Castro::initialize_advance() 5 0.0449 0.05646 0.06545 3.74% Castro::computeTemp() 30 0.04266 0.05088 0.06224 3.56% Castro::do_new_sources() 5 0.03321 0.04685 0.0577 3.30% FabArray::setVal() 80 0.03718 0.04565 0.05115 2.92% Castro::post_timestep() 5 0.03334 0.03684 0.04261 2.43% Castro::reset_internal_energy() 30 0.02634 0.03137 0.03867 2.21% Amr::init() 1 0.03726 0.03734 0.03752 2.14% Amr::restart() 1 0.03726 0.03734 0.03751 2.14% Castro::estTimeStep() 10 0.009907 0.01689 0.03639 2.08% StateDataPhysBCFunct::() 116 0.01026 0.02281 0.03594 2.05% StateData::FillBoundary(geom) 10 0.01015 0.02268 0.03574 2.04% FabArray::ParallelCopy_nowait() 116 0.01736 0.02364 0.03356 1.92% Amr::writePlotFile() 1 0.02547 0.02547 0.02548 1.46% AmrLevel::restart() 1 0.01945 0.02255 0.02302 1.32% StateData::restartDoit() 4 0.01925 0.02228 0.02275 1.30% Castro::normalize_species() 30 0.01183 0.015 0.01924 1.10% Castro::volWgtSum() 80 0.01134 0.01537 0.01876 1.07% VisMF::Read() 3 0.01642 0.01832 0.01865 1.07% Castro::construct_new_source() 35 0.01374 0.01666 0.01848 1.06% Castro::finalize_do_advance() 5 0.008683 0.01386 0.01728 0.99% Castro::derive() 86 0.009611 0.01326 0.01635 0.93% Castro::construct_new_gravity_source() 5 0.01199 0.01397 0.0159 0.91% Castro::hybrid_to_linear_momentum() 30 0.008135 0.01129 0.01547 0.88% Castro::construct_new_gravity() 5 0.006118 0.008726 0.01194 0.68% Gravity::get_new_grav_vector() 5 0.005753 0.008258 0.01127 0.64% Castro::check_for_nan() 10 0.005519 0.008138 0.01111 0.63% MultiFab::contains_nan() 10 0.005502 0.008107 0.01108 0.63% Castro::apply_source_to_state() 10 0.00661 0.008272 0.009302 0.53% MultiFab::Saxpy() 10 0.006583 0.008245 0.009269 0.53% VisMF::Write(FabArray) 1 0.006042 0.006516 0.008357 0.48% Castro::construct_old_gravity() 5 0.005905 0.006514 0.007455 0.43% Castro::construct_old_source() 35 0.003414 0.005736 0.007293 0.42% FabArray::setDomainBndry() 116 0.002869 0.005249 0.007215 0.41% Gravity::get_old_grav_vector() 5 0.005517 0.006103 0.006951 0.40% Castro::construct_old_gravity_source() 5 0.002486 0.004553 0.005973 0.34% Gravity::add_pointmass_to_gravity() 10 0.004099 0.004839 0.005798 0.33% Castro::computeNewDt() 5 0.005282 0.00537 0.005426 0.31% Castro::post_restart() 1 0.0004233 0.001073 0.004863 0.28% Castro::swap_state_time_levels() 5 0.004208 0.004468 0.00458 0.26% Castro::fill_hybrid_hydro_source() 15 0.0027 0.003706 0.004356 0.25% Castro::enforce_min_density() 30 0.00221 0.002671 0.003402 0.19% Castro::construct_new_hybrid_source() 5 0.001703 0.00261 0.003085 0.18% Castro::finalize_advance() 5 0.000746 0.001358 0.001443 0.08% Castro::construct_old_hybrid_source() 5 0.0008917 0.00113 0.001313 0.07% Castro::locSquaredSum() 6 0.0006967 0.0009102 0.0009969 0.06% Amr::InitAmr() 1 0.0002652 0.0004127 0.0004835 0.03% FabArrayBase::getCPC() 10 4.995e-05 8.622e-05 0.0001427 0.01% FabArrayBase::CPC::define() 2 3.028e-05 5.947e-05 0.0001047 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 2.016e-05 3.748e-05 6.462e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.061e-05 2.791e-05 5.426e-05 0.00% Castro::enforce_speed_limit() 30 2.906e-05 3.474e-05 4.556e-05 0.00% Amr::writeSmallPlotFile() 1 3.143e-05 3.524e-05 3.92e-05 0.00% Castro::create_source_corrector() 5 1.017e-05 1.531e-05 2.64e-05 0.00% Gravity::swapTimeLevels() 5 7.078e-06 1.233e-05 2.144e-05 0.00% Castro::gwstrain() 5 3.377e-06 6.065e-06 1.548e-05 0.00% Amr::initSubcycle() 1 8.85e-06 1.379e-05 1.515e-05 0.00% Castro::construct_new_rotation_source() 5 4.725e-06 7.533e-06 1.109e-05 0.00% Castro::construct_old_rotation_source() 5 3.16e-06 5.033e-06 7.73e-06 0.00% Gravity::set_mass_offset() 6 4.197e-06 5.291e-06 6.874e-06 0.00% Castro::retry_advance_ctu() 5 3.951e-06 5.324e-06 6.541e-06 0.00% Castro::FluxRegFineAdd() 5 3.238e-06 4.065e-06 5.281e-06 0.00% DistributionMapping::Distribute() 1 2.04e-06 2.423e-06 3.11e-06 0.00% AmrLevel::AmrLevel() 1 1.066e-06 1.763e-06 2.985e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.04-31-gc768c36d6e08) finalized