MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.03-8-g6bbcbbb78299) initialized Starting run at 07:31:38 UTC on 2022-03-07. Successfully read inputs file ... Castro git describe: 22.02-4-g0d942c92d AMReX git describe: 22.03-8-g6bbcbbb78 Microphysics git describe: 22.03-2-ge2419c42 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 4.289006454 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.017164811 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.200265135 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.008666156 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.280730862 Castro::do_new_sources() time = 0.009315169 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7027012973 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.38171779 [STEP 1] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007249234 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.264585634 Castro::do_new_sources() time = 0.008668005 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7668094751 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.353448328 [STEP 2] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006418665 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.259856478 Castro::do_new_sources() time = 0.008298963 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7736462349 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.349958107 [STEP 3] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005808715 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.23876349 Castro::do_new_sources() time = 0.009697474 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.8269445659 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.325788765 [STEP 4] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006258973 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.172130888 Castro::do_new_sources() time = 0.008662659 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.090867012 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.248044092 [STEP 5] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.015999598 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006067771 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.166061692 Castro::do_new_sources() time = 0.00893421 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.151351083 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.234635354 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004366574 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.164648206 Castro::do_new_sources() time = 0.005663759 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.23703457 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.219045705 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00409996 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.153873148 Castro::do_new_sources() time = 0.005549571 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.315264146 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.206272094 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004186246 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.153972781 Castro::do_new_sources() time = 0.005352528 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.315958964 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.206016482 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004065515 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.153237508 Castro::do_new_sources() time = 0.005435006 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.321644202 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.205223057 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.013570029 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.185598165 seconds Ending run at 07:31:41 UTC on 2022-03-07. Run time = 3.205186633 Run time without initialization = 2.947200219 Average number of zones advanced per microsecond: 0.889 Average number of zones advanced per microsecond per rank: 0.056 TinyProfiler total time across processes [min...avg...max]: 3.204 ... 3.205 ... 3.205 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.5211 1.8483 2.0339 63.45% MultiFab::min() 10 0.0004581 0.1751 0.521 16.25% Amr::writePlotFile() 2 0.3673 0.3741 0.3753 11.71% FabArray::ParallelCopy_finish() 251 0.05918 0.08469 0.1467 4.58% FabArray::setVal() 164 0.06347 0.08271 0.09279 2.89% Castro::do_old_sources() 10 0.0001674 0.01676 0.07871 2.46% Castro::reset_internal_energy() 63 0.05427 0.0602 0.06631 2.07% VisMF::Write(FabArray) 11 0.04098 0.04598 0.05942 1.85% FabArray::ParallelCopy_nowait() 251 0.02835 0.04166 0.05615 1.75% Castro::estTimeStep() 21 0.01811 0.03098 0.05295 1.65% StateData::FillBoundary(geom) 20 0.02529 0.03445 0.04673 1.46% Castro::computeTemp() 63 0.03325 0.03715 0.04174 1.30% FillPatchIterator::Initialize 251 0.03269 0.03767 0.04052 1.26% Castro::post_timestep() 10 0.007577 0.01587 0.03726 1.16% Castro::do_advance_ctu() 10 0.02055 0.02795 0.03337 1.04% Castro::expand_state() 10 0.01624 0.0242 0.03265 1.02% Castro::do_new_sources() 10 0.0001362 0.007387 0.03143 0.98% Castro::initialize_do_advance() 10 0.01023 0.02573 0.03053 0.95% Castro::normalize_species() 62 0.01924 0.02228 0.02538 0.79% Castro::finalize_do_advance() 10 0.001323 0.01982 0.02457 0.77% Castro::construct_new_gravity_source() 10 0.01832 0.02166 0.02393 0.75% Castro::hybrid_to_linear_momentum() 62 0.0161 0.01933 0.02248 0.70% Castro::initialize_advance() 10 0.01273 0.01688 0.02138 0.67% Amr::checkPoint() 3 0.007316 0.01449 0.0187 0.58% MultiFab::Saxpy() 20 0.012 0.01384 0.01627 0.51% MultiFab::contains_nan() 20 0.009987 0.01325 0.01599 0.50% FabArray::setDomainBndry() 251 0.006088 0.009612 0.01313 0.41% Gravity::get_new_grav_vector() 11 0.007659 0.009427 0.01198 0.37% Castro::derive() 187 0.007845 0.0099 0.0114 0.36% Castro::construct_old_gravity_source() 10 0.004934 0.007784 0.01012 0.32% Gravity::add_pointmass_to_gravity() 21 0.007503 0.008927 0.009991 0.31% Castro::fill_hybrid_hydro_source() 30 0.004721 0.006297 0.007309 0.23% Amr::defBaseLevel() 1 0.005051 0.006467 0.006959 0.22% Gravity::get_old_grav_vector() 10 0.0038 0.005464 0.006684 0.21% Castro::volWgtSum() 176 0.005216 0.005611 0.005991 0.19% Castro::enforce_min_density() 62 0.004149 0.004767 0.005598 0.17% Castro::post_init() 1 0.0007733 0.001463 0.005218 0.16% Castro::swap_state_time_levels() 10 0.004038 0.004489 0.005098 0.16% StateData::define() 4 0.003569 0.004557 0.004723 0.15% Castro::initData() 1 0.002005 0.002515 0.002668 0.08% main() 1 0.0006476 0.001032 0.001459 0.05% Castro::subcycle_advance_ctu() 10 4.861e-05 0.0001111 0.0008124 0.03% Amr::InitAmr() 1 0.0002751 0.000422 0.0005971 0.02% Castro::locSquaredSum() 11 0.0004038 0.0004794 0.000563 0.02% Amr::coarseTimeStep() 10 0.0002798 0.0003612 0.0004729 0.01% DistributionMapping::LeastUsedCPUs() 1 1.188e-05 0.000194 0.0003576 0.01% Castro::clean_state() 62 0.0002224 0.0002735 0.0003388 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002221 0.000259 0.0003098 0.01% StateData::checkPoint() 12 2.136e-05 4.508e-05 0.0003051 0.01% StateDataPhysBCFunct::() 251 0.0001831 0.0002338 0.0002993 0.01% FillPatchSingleLevel 251 0.0001505 0.0001844 0.000223 0.01% FabArray::ParallelCopy() 251 0.0001495 0.000181 0.0002183 0.01% Castro::enforce_consistent_e() 1 7.213e-05 0.0001067 0.0001714 0.01% Castro::construct_new_source() 70 7.761e-05 0.0001282 0.000165 0.01% Castro::finalize_advance() 10 0.0001033 0.0001216 0.0001604 0.01% Castro::computeNewDt() 9 7.68e-06 1.787e-05 0.0001481 0.00% AmrLevel::checkPoint() 3 5.353e-05 7.069e-05 0.0001421 0.00% Castro::construct_old_source() 70 6.195e-05 8.5e-05 0.0001164 0.00% Castro::construct_new_gravity() 10 3.333e-05 6.674e-05 0.0001088 0.00% Castro::construct_old_gravity() 10 5.75e-05 7.792e-05 0.0001015 0.00% FabArrayBase::CPC::define() 2 2.85e-05 5.425e-05 9.679e-05 0.00% Amr::timeStep() 10 5.436e-05 6.732e-05 9.212e-05 0.00% Amr::writeSmallPlotFile() 1 3.092e-05 6.242e-05 8.373e-05 0.00% Castro::check_for_nan() 20 3.795e-05 5.675e-05 8.129e-05 0.00% Castro::apply_source_to_state() 20 4.865e-05 6.28e-05 7.553e-05 0.00% Castro::enforce_speed_limit() 62 3.531e-05 5.422e-05 6.553e-05 0.00% Castro::advance() 10 4.352e-05 5.168e-05 6.285e-05 0.00% FabArrayBase::getCPC() 20 3.881e-05 4.863e-05 6.1e-05 0.00% Amr::FinalizeInit() 1 4.805e-06 9.715e-06 5.489e-05 0.00% Gravity::swapTimeLevels() 10 1.721e-05 2.662e-05 4.813e-05 0.00% Castro::construct_new_hybrid_source() 10 1.54e-05 3.155e-05 4.3e-05 0.00% Castro::create_source_corrector() 10 1.447e-05 2.271e-05 3.525e-05 0.00% Castro::construct_old_hybrid_source() 10 1.435e-05 1.981e-05 3.14e-05 0.00% Amr::initSubcycle() 1 1.013e-05 1.472e-05 2.626e-05 0.00% Castro::construct_new_rotation_source() 10 8.986e-06 1.217e-05 1.737e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.064e-05 1.267e-05 1.534e-05 0.00% Castro::FluxRegFineAdd() 10 7.232e-06 9.612e-06 1.374e-05 0.00% Castro::construct_old_rotation_source() 10 5.191e-06 8.713e-06 1.363e-05 0.00% Castro::retry_advance_ctu() 10 5.125e-06 9.297e-06 1.132e-05 0.00% Castro::gwstrain() 11 6.677e-06 8.15e-06 1.129e-05 0.00% Amr::InitializeInit() 1 2.892e-06 4.139e-06 1.021e-05 0.00% Gravity::set_mass_offset() 10 6.119e-06 7.271e-06 8.703e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.263e-06 6.449e-06 8.584e-06 0.00% AmrLevel::checkPointPost() 3 4.542e-06 5.48e-06 7.053e-06 0.00% Castro::computeInitialDt() 2 3.333e-06 4.699e-06 6.439e-06 0.00% AmrLevel::checkPointPre() 3 2.675e-06 4.094e-06 5.899e-06 0.00% Castro::post_regrid() 1 3.175e-06 4.029e-06 5.33e-06 0.00% Amr::initialInit() 1 1.534e-06 2.643e-06 4.339e-06 0.00% Amr::init() 1 2.68e-06 3.385e-06 3.994e-06 0.00% DistributionMapping::Distribute() 1 1.871e-06 2.247e-06 2.522e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.204 3.205 3.205 100.00% Amr::coarseTimeStep() 10 2.76 2.76 2.76 86.11% Amr::timeStep() 10 2.721 2.721 2.721 84.89% Castro::advance() 10 2.648 2.666 2.671 83.33% Castro::subcycle_advance_ctu() 10 2.566 2.578 2.598 81.05% Castro::do_advance_ctu() 10 2.566 2.577 2.598 81.05% Castro::construct_ctu_hydro_source() 10 1.521 1.848 2.034 63.45% MultiFab::min() 10 0.0004581 0.1751 0.521 16.25% Amr::writePlotFile() 2 0.3862 0.3862 0.3862 12.05% Amr::init() 1 0.2572 0.2574 0.2576 8.04% FillPatchIterator::Initialize 251 0.1865 0.2088 0.244 7.61% Castro::initialize_do_advance() 10 0.2072 0.2203 0.2347 7.32% FillPatchSingleLevel 251 0.1432 0.1615 0.2043 6.37% FabArray::ParallelCopy() 251 0.09738 0.1266 0.1753 5.47% Castro::expand_state() 10 0.14 0.1511 0.1609 5.02% Castro::clean_state() 62 0.1278 0.1423 0.1585 4.95% FabArray::ParallelCopy_finish() 251 0.05918 0.08469 0.1467 4.58% Castro::do_old_sources() 10 0.04353 0.06227 0.1214 3.79% Castro::computeTemp() 63 0.08753 0.09735 0.1081 3.37% Castro::initialize_advance() 10 0.06824 0.0885 0.1021 3.19% FabArray::setVal() 164 0.06347 0.08271 0.09279 2.89% Castro::do_new_sources() 10 0.05756 0.07458 0.09132 2.85% Castro::post_timestep() 10 0.0498 0.05455 0.07319 2.28% Castro::reset_internal_energy() 63 0.05427 0.0602 0.06631 2.07% VisMF::Write(FabArray) 11 0.04098 0.04598 0.05942 1.85% FabArray::ParallelCopy_nowait() 251 0.02843 0.04176 0.05627 1.76% Castro::estTimeStep() 21 0.01811 0.03098 0.05295 1.65% Amr::checkPoint() 3 0.04838 0.04851 0.04853 1.51% StateDataPhysBCFunct::() 251 0.02549 0.03469 0.04699 1.47% StateData::FillBoundary(geom) 20 0.02529 0.03445 0.04673 1.46% AmrLevel::checkPoint() 3 0.02981 0.03401 0.04105 1.28% StateData::checkPoint() 12 0.02976 0.03394 0.04091 1.28% Amr::initialInit() 1 0.03816 0.03825 0.03841 1.20% Castro::construct_new_source() 70 0.02152 0.02606 0.02881 0.90% Castro::volWgtSum() 176 0.02119 0.02514 0.02814 0.88% Amr::InitializeInit() 1 0.01769 0.02534 0.02682 0.84% Amr::defBaseLevel() 1 0.01768 0.02534 0.02682 0.84% Castro::normalize_species() 62 0.01924 0.02228 0.02538 0.79% Castro::finalize_do_advance() 10 0.001323 0.01982 0.02457 0.77% Castro::construct_new_gravity_source() 10 0.01832 0.02166 0.02393 0.75% Castro::derive() 187 0.01663 0.02037 0.02304 0.72% Castro::hybrid_to_linear_momentum() 62 0.0161 0.01933 0.02248 0.70% Amr::FinalizeInit() 1 0.01141 0.01291 0.02072 0.65% Gravity::get_new_grav_vector() 11 0.01272 0.01554 0.01904 0.59% Castro::construct_new_gravity() 10 0.01185 0.0145 0.01827 0.57% Castro::apply_source_to_state() 20 0.01206 0.01391 0.01635 0.51% MultiFab::Saxpy() 20 0.012 0.01384 0.01627 0.51% Castro::check_for_nan() 20 0.01002 0.0133 0.01608 0.50% MultiFab::contains_nan() 20 0.009987 0.01325 0.01599 0.50% Castro::construct_old_gravity() 10 0.008498 0.01144 0.01348 0.42% FabArray::setDomainBndry() 251 0.006088 0.009612 0.01313 0.41% Castro::construct_old_source() 70 0.006654 0.009965 0.01268 0.40% Gravity::get_old_grav_vector() 10 0.00794 0.01072 0.01261 0.39% Castro::computeInitialDt() 2 0.002524 0.004012 0.01183 0.37% Castro::initData() 1 0.007286 0.01032 0.01107 0.35% Castro::construct_old_gravity_source() 10 0.004934 0.007784 0.01012 0.32% Gravity::add_pointmass_to_gravity() 21 0.007503 0.008927 0.009991 0.31% Castro::post_init() 1 0.007537 0.007699 0.008592 0.27% Castro::computeNewDt() 9 0.007625 0.00773 0.007796 0.24% Castro::fill_hybrid_hydro_source() 30 0.004721 0.006297 0.007309 0.23% Castro::enforce_min_density() 62 0.004149 0.004767 0.005598 0.17% Castro::swap_state_time_levels() 10 0.004038 0.004489 0.005098 0.16% Castro::construct_new_hybrid_source() 10 0.003115 0.004261 0.004968 0.15% AmrLevel::AmrLevel(dm) 1 0.00358 0.00457 0.004737 0.15% StateData::define() 4 0.003569 0.004557 0.004723 0.15% Castro::post_regrid() 1 0.001687 0.002582 0.002741 0.09% Castro::construct_old_hybrid_source() 10 0.001642 0.002088 0.002583 0.08% Castro::locSquaredSum() 11 0.001056 0.001312 0.001662 0.05% Amr::InitAmr() 1 0.0002856 0.0004367 0.0006119 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 2.004e-05 0.0002027 0.0003684 0.01% DistributionMapping::LeastUsedCPUs() 1 1.188e-05 0.000194 0.0003576 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002221 0.000259 0.0003098 0.01% Castro::enforce_consistent_e() 1 7.213e-05 0.0001067 0.0001714 0.01% Castro::finalize_advance() 10 0.000113 0.0001313 0.0001699 0.01% FabArrayBase::getCPC() 20 6.731e-05 0.0001029 0.0001529 0.00% FabArrayBase::CPC::define() 2 2.85e-05 5.425e-05 9.679e-05 0.00% Amr::writeSmallPlotFile() 1 3.092e-05 6.242e-05 8.373e-05 0.00% Castro::enforce_speed_limit() 62 3.531e-05 5.422e-05 6.553e-05 0.00% Gravity::swapTimeLevels() 10 1.721e-05 2.662e-05 4.813e-05 0.00% Castro::create_source_corrector() 10 1.447e-05 2.271e-05 3.525e-05 0.00% Amr::initSubcycle() 1 1.013e-05 1.472e-05 2.626e-05 0.00% Castro::construct_new_rotation_source() 10 8.986e-06 1.217e-05 1.737e-05 0.00% Castro::FluxRegFineAdd() 10 7.232e-06 9.612e-06 1.374e-05 0.00% Castro::construct_old_rotation_source() 10 5.191e-06 8.713e-06 1.363e-05 0.00% Castro::retry_advance_ctu() 10 5.125e-06 9.297e-06 1.132e-05 0.00% Castro::gwstrain() 11 6.677e-06 8.15e-06 1.129e-05 0.00% Gravity::set_mass_offset() 10 6.119e-06 7.271e-06 8.703e-06 0.00% AmrLevel::checkPointPost() 3 4.542e-06 5.48e-06 7.053e-06 0.00% AmrLevel::checkPointPre() 3 2.675e-06 4.094e-06 5.899e-06 0.00% DistributionMapping::Distribute() 1 1.871e-06 2.247e-06 2.522e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.03-8-g6bbcbbb78299) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.03-8-g6bbcbbb78299) initialized Starting run at 07:31:41 UTC on 2022-03-07. Successfully read inputs file ... Castro git describe: 22.02-4-g0d942c92d AMReX git describe: 22.03-8-g6bbcbbb78 Microphysics git describe: 22.03-2-ge2419c42 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 30.92530512 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.037267878 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007978508 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.272719101 Castro::do_new_sources() time = 0.009083124 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7216207826 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.371806297 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005903168 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.264742704 Castro::do_new_sources() time = 0.008711432 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7547219461 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.35627027 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00651779 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.257367736 Castro::do_new_sources() time = 0.008462185 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7685080987 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.349415796 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00528012 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.197561154 Castro::do_new_sources() time = 0.009089582 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.946809752 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.283399733 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00615535 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.166821761 Castro::do_new_sources() time = 0.009274415 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.114707811 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.276596733 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.037919469 seconds Ending run at 07:31:43 UTC on 2022-03-07. Run time = 1.715993329 Run time without initialization = 1.678308082 Average number of zones advanced per microsecond: 0.781 Average number of zones advanced per microsecond per rank: 0.049 TinyProfiler total time across processes [min...avg...max]: 1.715 ... 1.716 ... 1.716 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.8408 1.0335 1.1723 68.32% MultiFab::min() 5 0.0002302 0.1348 0.3288 19.16% FabArray::ParallelCopy_finish() 116 0.02071 0.05822 0.09816 5.72% Castro::post_timestep() 5 0.03885 0.04542 0.05331 3.11% FabArray::setVal() 80 0.0357 0.04613 0.05282 3.08% Castro::do_old_sources() 5 8.457e-05 0.01173 0.04703 2.74% StateData::FillBoundary(geom) 10 0.01152 0.02223 0.03793 2.21% Castro::reset_internal_energy() 30 0.02441 0.03039 0.03712 2.16% Castro::estTimeStep() 10 0.009849 0.01854 0.03345 1.95% FabArray::ParallelCopy_nowait() 116 0.01514 0.02294 0.03239 1.89% Amr::writePlotFile() 1 0.02962 0.03201 0.03236 1.89% FillPatchIterator::Initialize 116 0.01659 0.02264 0.0284 1.66% Castro::computeTemp() 30 0.01515 0.01889 0.02319 1.35% Castro::do_advance_ctu() 5 0.0115 0.01724 0.02152 1.25% Castro::expand_state() 5 0.008607 0.01475 0.02042 1.19% VisMF::Read() 3 0.01638 0.01819 0.01895 1.10% Castro::do_new_sources() 5 9.284e-05 0.004925 0.0182 1.06% Castro::initialize_do_advance() 5 0.01072 0.01412 0.01657 0.97% Castro::normalize_species() 30 0.009561 0.01184 0.01565 0.91% Castro::hybrid_to_linear_momentum() 30 0.007949 0.01146 0.0154 0.90% Castro::construct_new_gravity_source() 5 0.01221 0.01373 0.01524 0.89% Castro::initialize_advance() 5 0.007584 0.01162 0.01493 0.87% Amr::restart() 1 0.01285 0.01319 0.01347 0.78% Castro::finalize_do_advance() 5 0.008 0.01132 0.01283 0.75% MultiFab::contains_nan() 10 0.006109 0.008371 0.0121 0.71% MultiFab::Saxpy() 10 0.006445 0.00812 0.009897 0.58% VisMF::Write(FabArray) 1 0.006345 0.006689 0.009086 0.53% Castro::derive() 86 0.004925 0.006156 0.007867 0.46% Gravity::get_new_grav_vector() 5 0.003423 0.00504 0.00736 0.43% FabArray::setDomainBndry() 116 0.002708 0.005334 0.007194 0.42% Castro::construct_old_gravity_source() 5 0.00295 0.004544 0.006771 0.39% Gravity::add_pointmass_to_gravity() 10 0.003944 0.004838 0.005917 0.34% Castro::swap_state_time_levels() 5 0.004141 0.004497 0.004707 0.27% Castro::post_restart() 1 6.581e-05 0.001324 0.004548 0.27% Castro::fill_hybrid_hydro_source() 15 0.002581 0.003714 0.004422 0.26% Gravity::get_old_grav_vector() 5 0.002809 0.003193 0.003952 0.23% StateData::restartDoit() 4 0.002793 0.003616 0.003895 0.23% Castro::enforce_min_density() 30 0.001981 0.002638 0.003326 0.19% Castro::volWgtSum() 80 0.002458 0.00273 0.003086 0.18% main() 1 0.001313 0.0018 0.002085 0.12% Castro::finalize_advance() 5 0.0006287 0.0009392 0.001066 0.06% Castro::subcycle_advance_ctu() 5 3.018e-05 7.654e-05 0.0006499 0.04% Amr::InitAmr() 1 0.0002356 0.0003719 0.0004555 0.03% Castro::locSquaredSum() 6 0.0002147 0.0002818 0.0003745 0.02% Amr::coarseTimeStep() 5 0.0002159 0.0002593 0.0003536 0.02% AmrLevel::restart() 1 0.0001311 0.0002186 0.00026 0.02% Castro::clean_state() 30 0.0001211 0.0001752 0.0002353 0.01% StateDataPhysBCFunct::() 116 9.074e-05 0.0001261 0.0001824 0.01% Castro::computeNewDt() 5 4.255e-06 1.681e-05 0.0001824 0.01% FillPatchSingleLevel 116 7.812e-05 0.0001059 0.0001372 0.01% FabArrayBase::CPC::define() 2 3.031e-05 5.63e-05 0.0001308 0.01% FabArray::ParallelCopy() 116 6.555e-05 9.102e-05 0.0001285 0.01% Castro::construct_new_source() 35 5.449e-05 8.372e-05 0.0001177 0.01% Amr::timeStep() 5 2.88e-05 3.822e-05 0.0001158 0.01% Castro::construct_new_gravity() 5 2.144e-05 4.662e-05 9.373e-05 0.01% Castro::construct_old_source() 35 3.694e-05 5.279e-05 8.157e-05 0.00% Castro::construct_old_gravity() 5 3.46e-05 4.654e-05 7.031e-05 0.00% Castro::check_for_nan() 10 2.262e-05 3.409e-05 6.163e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.041e-05 2.909e-05 5.843e-05 0.00% Castro::enforce_speed_limit() 30 2.834e-05 3.729e-05 4.993e-05 0.00% Castro::advance() 5 2.366e-05 3.053e-05 4.626e-05 0.00% Castro::apply_source_to_state() 10 2.07e-05 3.027e-05 4.539e-05 0.00% Amr::writeSmallPlotFile() 1 3.345e-05 3.756e-05 4.115e-05 0.00% Castro::construct_new_hybrid_source() 5 1.01e-05 2.523e-05 4.048e-05 0.00% FabArrayBase::getCPC() 10 1.818e-05 2.516e-05 3.326e-05 0.00% Castro::create_source_corrector() 5 9.971e-06 1.663e-05 2.299e-05 0.00% Castro::construct_old_hybrid_source() 5 7.102e-06 1.125e-05 2.171e-05 0.00% Gravity::swapTimeLevels() 5 6.147e-06 1.414e-05 2.098e-05 0.00% Castro::construct_new_rotation_source() 5 4.8e-06 7.928e-06 1.659e-05 0.00% Amr::initSubcycle() 1 8.029e-06 1.3e-05 1.527e-05 0.00% Castro::construct_old_rotation_source() 5 2.687e-06 5.101e-06 8.361e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.099e-06 6.705e-06 8.003e-06 0.00% Castro::gwstrain() 5 3.866e-06 4.99e-06 7.633e-06 0.00% Castro::FluxRegFineAdd() 5 3.156e-06 4.399e-06 6.229e-06 0.00% Gravity::set_mass_offset() 6 3.694e-06 5.118e-06 6.152e-06 0.00% Castro::retry_advance_ctu() 5 3.639e-06 4.937e-06 5.568e-06 0.00% DistributionMapping::Distribute() 1 1.441e-06 2.186e-06 2.663e-06 0.00% AmrLevel::AmrLevel() 1 1.169e-06 1.621e-06 2.185e-06 0.00% Amr::init() 1 9.82e-07 1.333e-06 1.791e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.715 1.716 1.716 100.00% Amr::coarseTimeStep() 5 1.638 1.638 1.638 95.44% Amr::timeStep() 5 1.632 1.632 1.632 95.10% Castro::advance() 5 1.559 1.563 1.564 91.15% Castro::subcycle_advance_ctu() 5 1.496 1.505 1.518 88.45% Castro::do_advance_ctu() 5 1.496 1.505 1.518 88.45% Castro::construct_ctu_hydro_source() 5 0.8408 1.033 1.172 68.32% MultiFab::min() 5 0.0002302 0.1348 0.3288 19.16% FillPatchIterator::Initialize 116 0.1122 0.1318 0.1577 9.19% Castro::initialize_do_advance() 5 0.1215 0.1291 0.1403 8.17% FillPatchSingleLevel 116 0.07813 0.1038 0.1331 7.76% FabArray::ParallelCopy() 116 0.04254 0.08133 0.1205 7.02% FabArray::ParallelCopy_finish() 116 0.02071 0.05822 0.09816 5.72% Castro::expand_state() 5 0.08194 0.09056 0.09793 5.71% Castro::clean_state() 30 0.05933 0.07542 0.0948 5.52% Castro::post_timestep() 5 0.06773 0.06933 0.07291 4.25% Castro::do_old_sources() 5 0.01958 0.03672 0.06974 4.06% Castro::initialize_advance() 5 0.04053 0.05662 0.06678 3.89% Castro::computeTemp() 30 0.03956 0.04928 0.06024 3.51% Castro::do_new_sources() 5 0.03526 0.04528 0.05674 3.31% FabArray::setVal() 80 0.0357 0.04613 0.05282 3.08% Amr::writePlotFile() 1 0.0387 0.0387 0.0387 2.26% StateDataPhysBCFunct::() 116 0.01163 0.02235 0.03808 2.22% StateData::FillBoundary(geom) 10 0.01152 0.02223 0.03793 2.21% Amr::init() 1 0.03706 0.03714 0.03732 2.17% Amr::restart() 1 0.03706 0.03714 0.03731 2.17% Castro::reset_internal_energy() 30 0.02441 0.03039 0.03712 2.16% Castro::estTimeStep() 10 0.009849 0.01854 0.03345 1.95% FabArray::ParallelCopy_nowait() 116 0.01519 0.02302 0.03249 1.89% AmrLevel::restart() 1 0.01952 0.02217 0.02323 1.35% StateData::restartDoit() 4 0.01931 0.02191 0.02297 1.34% VisMF::Read() 3 0.01638 0.01819 0.01895 1.10% Castro::construct_new_source() 35 0.0139 0.01643 0.01813 1.06% Castro::volWgtSum() 80 0.01146 0.01475 0.01812 1.06% Castro::derive() 86 0.009536 0.01259 0.01566 0.91% Castro::normalize_species() 30 0.009561 0.01184 0.01565 0.91% Castro::hybrid_to_linear_momentum() 30 0.007949 0.01146 0.0154 0.90% Castro::construct_new_gravity_source() 5 0.01221 0.01373 0.01524 0.89% Castro::finalize_do_advance() 5 0.008 0.01132 0.01283 0.75% Castro::construct_new_gravity() 5 0.006144 0.008818 0.0126 0.73% Castro::check_for_nan() 10 0.006132 0.008405 0.01215 0.71% MultiFab::contains_nan() 10 0.006109 0.008371 0.0121 0.71% Gravity::get_new_grav_vector() 5 0.005832 0.00834 0.01186 0.69% Castro::apply_source_to_state() 10 0.006468 0.00815 0.009937 0.58% MultiFab::Saxpy() 10 0.006445 0.00812 0.009897 0.58% VisMF::Write(FabArray) 1 0.006345 0.006689 0.009086 0.53% Castro::construct_old_source() 35 0.003969 0.005744 0.008402 0.49% Castro::construct_old_gravity() 5 0.005702 0.006573 0.00755 0.44% FabArray::setDomainBndry() 116 0.002708 0.005334 0.007194 0.42% Gravity::get_old_grav_vector() 5 0.005294 0.006151 0.00709 0.41% Castro::construct_old_gravity_source() 5 0.00295 0.004544 0.006771 0.39% Gravity::add_pointmass_to_gravity() 10 0.003944 0.004838 0.005917 0.34% Castro::computeNewDt() 5 0.005411 0.005474 0.005522 0.32% Castro::post_restart() 1 0.0004177 0.001612 0.00477 0.28% Castro::swap_state_time_levels() 5 0.004141 0.004497 0.004707 0.27% Castro::fill_hybrid_hydro_source() 15 0.002581 0.003714 0.004422 0.26% Castro::enforce_min_density() 30 0.001981 0.002638 0.003326 0.19% Castro::construct_new_hybrid_source() 5 0.001637 0.002609 0.003227 0.19% Castro::construct_old_hybrid_source() 5 0.000904 0.001142 0.001543 0.09% Castro::finalize_advance() 5 0.0006333 0.0009436 0.00107 0.06% Castro::locSquaredSum() 6 0.0006617 0.0008486 0.0009952 0.06% Amr::InitAmr() 1 0.0002446 0.0003849 0.0004708 0.03% FabArrayBase::getCPC() 10 5.366e-05 8.146e-05 0.0001641 0.01% FabArrayBase::CPC::define() 2 3.031e-05 5.63e-05 0.0001308 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.908e-05 3.798e-05 6.731e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.041e-05 2.909e-05 5.843e-05 0.00% Castro::enforce_speed_limit() 30 2.834e-05 3.729e-05 4.993e-05 0.00% Amr::writeSmallPlotFile() 1 3.345e-05 3.756e-05 4.115e-05 0.00% Castro::create_source_corrector() 5 9.971e-06 1.663e-05 2.299e-05 0.00% Gravity::swapTimeLevels() 5 6.147e-06 1.414e-05 2.098e-05 0.00% Castro::construct_new_rotation_source() 5 4.8e-06 7.928e-06 1.659e-05 0.00% Amr::initSubcycle() 1 8.029e-06 1.3e-05 1.527e-05 0.00% Castro::construct_old_rotation_source() 5 2.687e-06 5.101e-06 8.361e-06 0.00% Castro::gwstrain() 5 3.866e-06 4.99e-06 7.633e-06 0.00% Castro::FluxRegFineAdd() 5 3.156e-06 4.399e-06 6.229e-06 0.00% Gravity::set_mass_offset() 6 3.694e-06 5.118e-06 6.152e-06 0.00% Castro::retry_advance_ctu() 5 3.639e-06 4.937e-06 5.568e-06 0.00% DistributionMapping::Distribute() 1 1.441e-06 2.186e-06 2.663e-06 0.00% AmrLevel::AmrLevel() 1 1.169e-06 1.621e-06 2.185e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.03-8-g6bbcbbb78299) finalized