MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.05-3-gdf9b6944a6d5) initialized Starting run at 06:47:09 UTC on 2022-05-03. Successfully read inputs file ... Castro git describe: 22.05-2-g1289ecab7 AMReX git describe: 22.05-3-gdf9b6944a Microphysics git describe: 22.05 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 68.62410327 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.014429781 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.152205174 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007117712 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.277557437 Castro::do_new_sources() time = 0.009101448 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7186628572 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.372566978 [STEP 1] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006587946 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.274822235 Castro::do_new_sources() time = 0.008566026 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7391227027 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.367070155 [STEP 2] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006196153 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.235146383 Castro::do_new_sources() time = 0.008760831 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.8485760618 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.317570391 [STEP 3] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006232319 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.173406732 Castro::do_new_sources() time = 0.00937903 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.092972686 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.247976695 [STEP 4] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007635308 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.203098516 Castro::do_new_sources() time = 0.009258311 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.9708967348 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.277615841 [STEP 5] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.017674201 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006887551 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.171787871 Castro::do_new_sources() time = 0.009397343 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.103501145 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.245096725 [STEP 6] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003987288 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.159536071 Castro::do_new_sources() time = 0.007189646 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.250031275 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.218006488 [STEP 7] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003883626 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.16041364 Castro::do_new_sources() time = 0.005845659 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.278676782 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.212267107 [STEP 8] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004995981 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.19603677 Castro::do_new_sources() time = 0.005270809 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.057003638 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.255172812 [STEP 9] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.0038861 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.159560477 Castro::do_new_sources() time = 0.005111595 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.286804128 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.210802007 [STEP 10] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.01419754 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 1.012679595 seconds Ending run at 06:47:13 UTC on 2022-05-03. Run time = 3.980809605 Run time without initialization = 3.771127707 Average number of zones advanced per microsecond: 0.695 Average number of zones advanced per microsecond per rank: 0.043 TinyProfiler total time across processes [min...avg...max]: 3.98 ... 3.98 ... 3.981 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.5217 1.7751 2.0247 50.86% Amr::writePlotFile() 2 1.146 1.153 1.154 28.99% Castro::do_advance_ctu() 10 0.03267 0.2798 0.5413 13.60% FabArray::ParallelCopy_finish() 119 0.05626 0.08888 0.1572 3.95% FabArray::setVal() 164 0.07257 0.08604 0.09364 2.35% Castro::reset_internal_energy(Fab) 504 0.05301 0.05789 0.06419 1.61% VisMF::Write(FabArray) 11 0.04334 0.04813 0.05937 1.49% Castro::do_old_sources() 10 0.0001605 0.00962 0.05208 1.31% FabArray::ParallelCopy_nowait() 119 0.02833 0.03792 0.05182 1.30% Castro::estTimeStep() 21 0.01865 0.03415 0.05062 1.27% StateData::FillBoundary(geom) 20 0.01656 0.03083 0.04633 1.16% FillPatchIterator::Initialize 119 0.02812 0.03636 0.04089 1.03% Castro::computeTemp() 63 0.03294 0.03624 0.04017 1.01% Castro::post_timestep() 10 0.002391 0.0112 0.03291 0.83% Castro::finalize_do_advance() 10 0.001533 0.02313 0.03068 0.77% Castro::normalize_species() 62 0.02405 0.02685 0.03062 0.77% Castro::initialize_do_advance() 10 0.01856 0.02543 0.02822 0.71% Castro::expand_state() 10 0.0151 0.02148 0.02551 0.64% Castro::initialize_advance() 10 0.01607 0.01879 0.023 0.58% Castro::construct_new_gravity_source() 10 0.01851 0.02153 0.02271 0.57% Castro::hybrid_to_linear_momentum() 62 0.01539 0.01829 0.0218 0.55% Amr::checkPoint() 3 0.007526 0.01222 0.01684 0.42% MultiFab::contains_nan() 20 0.009563 0.01205 0.01639 0.41% MultiFab::Saxpy() 20 0.01199 0.0141 0.01634 0.41% FabArray::setDomainBndry() 119 0.004973 0.008889 0.01358 0.34% Castro::do_new_sources() 10 0.0001405 0.003655 0.01307 0.33% Gravity::get_new_grav_vector() 11 0.005928 0.008617 0.01081 0.27% Gravity::add_pointmass_to_gravity() 21 0.007701 0.008653 0.009482 0.24% Castro::construct_old_gravity_source() 10 0.004867 0.007148 0.009414 0.24% Castro::derive() 55 0.006124 0.007525 0.008561 0.22% Castro::sum_integrated_quantities() 11 0.003694 0.005667 0.008397 0.21% Gravity::get_old_grav_vector() 10 0.003895 0.005874 0.008061 0.20% Castro::volWgtSum() 176 0.00672 0.007171 0.007661 0.19% Castro::fill_hybrid_hydro_source() 30 0.004852 0.006143 0.007243 0.18% Castro::initMFs() 1 0.003885 0.005583 0.007079 0.18% StateData::define() 4 0.003717 0.00463 0.005331 0.13% Castro::enforce_min_density() 62 0.003833 0.004625 0.005293 0.13% Castro::swap_state_time_levels() 10 0.002652 0.004399 0.004877 0.12% Amr::InitAmr() 1 0.0002957 0.0005757 0.003129 0.08% Castro::initData() 1 0.001696 0.002452 0.002944 0.07% DistributionMapping::LeastUsedCPUs() 1 1.377e-05 0.002584 0.002898 0.07% Castro::post_init() 1 4.332e-05 0.0009462 0.002742 0.07% main() 1 0.000823 0.001222 0.001846 0.05% Castro::buildMetrics() 1 0.0008816 0.001143 0.001311 0.03% Castro::subcycle_advance_ctu() 10 5.058e-05 0.0001435 0.001266 0.03% Amr::coarseTimeStep() 10 0.0002976 0.0003729 0.0005639 0.01% Castro::locSquaredSum() 11 0.0004185 0.000474 0.0005531 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002962 0.0003493 0.0004355 0.01% Castro::clean_state() 62 0.000254 0.0002864 0.000314 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002176 0.0002367 0.0002569 0.01% StateDataPhysBCFunct::() 119 0.0001625 0.0001993 0.0002468 0.01% StateData::checkPoint() 12 2.45e-05 4.27e-05 0.0002302 0.01% Castro::computeNewDt() 9 1.039e-05 2.765e-05 0.0002153 0.01% Castro::Castro() 1 8.723e-05 0.0001211 0.0001827 0.00% Castro::enforce_consistent_e() 1 5.975e-05 0.0001001 0.0001625 0.00% Amr::timeStep() 10 5.448e-05 6.737e-05 0.0001611 0.00% Castro::finalize_advance() 10 0.0001086 0.000126 0.0001587 0.00% Castro::construct_new_source() 70 8.198e-05 0.0001167 0.000146 0.00% FabArray::ParallelCopy() 119 0.0001061 0.0001185 0.000137 0.00% FillPatchSingleLevel 119 0.0001032 0.0001199 0.0001363 0.00% AmrLevel::checkPoint() 3 5.125e-05 6.901e-05 0.0001186 0.00% Castro::construct_old_source() 70 5.761e-05 8.245e-05 0.0001153 0.00% Castro::construct_old_gravity() 10 5.868e-05 7.707e-05 0.0001091 0.00% Amr::writeSmallPlotFile() 1 3.86e-05 6.963e-05 9.522e-05 0.00% Castro::construct_new_gravity() 10 3.866e-05 6.339e-05 9.259e-05 0.00% Castro::advance() 10 4.53e-05 5.637e-05 8.255e-05 0.00% Castro::apply_source_to_state() 20 4.207e-05 5.833e-05 7.04e-05 0.00% FabArrayBase::CPC::define() 2 3.037e-05 4.598e-05 6.802e-05 0.00% FabArrayBase::getCPC() 20 3.513e-05 4.77e-05 6.202e-05 0.00% Castro::check_for_nan() 20 3.147e-05 4.028e-05 5.811e-05 0.00% Amr::defBaseLevel() 1 3.1e-05 4.135e-05 5.304e-05 0.00% Castro::enforce_speed_limit() 62 4.165e-05 4.542e-05 5.258e-05 0.00% Castro::construct_new_hybrid_source() 10 1.842e-05 3.393e-05 4.925e-05 0.00% Amr::FinalizeInit() 1 4.523e-06 8.407e-06 4.44e-05 0.00% Castro::construct_old_hybrid_source() 10 1.534e-05 2.004e-05 3.005e-05 0.00% Gravity::swapTimeLevels() 10 1.547e-05 2.147e-05 2.768e-05 0.00% Castro::create_source_corrector() 10 1.105e-05 1.68e-05 2.456e-05 0.00% Castro::construct_new_rotation_source() 10 1.01e-05 1.27e-05 1.817e-05 0.00% Amr::initSubcycle() 1 8.944e-06 1.369e-05 1.756e-05 0.00% AmrLevel::checkPointPost() 3 4.787e-06 6.655e-06 1.548e-05 0.00% AmrLevel::AmrLevel(dm) 1 9.975e-06 1.231e-05 1.53e-05 0.00% Castro::construct_old_rotation_source() 10 4.293e-06 7.534e-06 1.319e-05 0.00% Castro::gwstrain() 11 8.047e-06 1.016e-05 1.295e-05 0.00% Gravity::set_mass_offset() 10 8.901e-06 1.102e-05 1.26e-05 0.00% Castro::FluxRegCrseInit 10 7.793e-06 1.007e-05 1.138e-05 0.00% Castro::retry_advance_ctu() 10 7.373e-06 9.221e-06 1.137e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.303e-06 6.417e-06 8.473e-06 0.00% Amr::InitializeInit() 1 2.998e-06 4.338e-06 8.154e-06 0.00% AmrLevel::checkPointPre() 3 3.288e-06 5.087e-06 7.686e-06 0.00% Castro::computeInitialDt() 2 3.351e-06 4.869e-06 6.325e-06 0.00% Castro::FluxRegFineAdd() 10 3.693e-06 4.412e-06 6.204e-06 0.00% Castro::post_regrid() 1 2.512e-06 4.255e-06 5.113e-06 0.00% Amr::init() 1 2.721e-06 3.473e-06 3.995e-06 0.00% Amr::initialInit() 1 1.294e-06 2.242e-06 3.059e-06 0.00% DistributionMapping::Distribute() 1 1.539e-06 1.962e-06 2.575e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.98 3.98 3.981 100.00% Amr::coarseTimeStep() 10 2.756 2.757 2.757 69.24% Amr::timeStep() 10 2.715 2.715 2.715 68.21% Castro::advance() 10 2.642 2.664 2.672 67.11% Castro::subcycle_advance_ctu() 10 2.55 2.569 2.579 64.79% Castro::do_advance_ctu() 10 2.549 2.569 2.579 64.79% Castro::construct_ctu_hydro_source() 10 1.522 1.775 2.025 50.86% Amr::writePlotFile() 2 1.165 1.165 1.165 29.27% FillPatchIterator::Initialize 119 0.1665 0.2034 0.2434 6.12% Castro::initialize_do_advance() 10 0.1945 0.2086 0.2291 5.76% FillPatchSingleLevel 119 0.122 0.1582 0.2103 5.28% Amr::init() 1 0.2064 0.2089 0.2093 5.26% FabArray::ParallelCopy() 119 0.08996 0.127 0.1935 4.86% Castro::clean_state() 62 0.1289 0.1428 0.1602 4.02% FabArray::ParallelCopy_finish() 119 0.05626 0.08888 0.1572 3.95% Castro::expand_state() 10 0.1265 0.1396 0.1531 3.85% Castro::computeTemp() 63 0.08632 0.09447 0.1047 2.63% Castro::initialize_advance() 10 0.08086 0.09483 0.104 2.61% Castro::do_old_sources() 10 0.03818 0.05456 0.09664 2.43% FabArray::setVal() 164 0.07257 0.08604 0.09364 2.35% Castro::do_new_sources() 10 0.05865 0.07174 0.08621 2.17% Castro::post_timestep() 10 0.04356 0.05113 0.07275 1.83% Castro::reset_internal_energy(MultiFab) 63 0.05334 0.05823 0.06455 1.62% Castro::reset_internal_energy(Fab) 504 0.05301 0.05789 0.06419 1.61% VisMF::Write(FabArray) 11 0.04334 0.04813 0.05937 1.49% FabArray::ParallelCopy_nowait() 119 0.02841 0.03802 0.05193 1.30% Castro::estTimeStep() 21 0.01865 0.03415 0.05062 1.27% Amr::checkPoint() 3 0.04795 0.04805 0.04806 1.21% StateDataPhysBCFunct::() 119 0.01675 0.03103 0.04653 1.17% StateData::FillBoundary(geom) 20 0.01656 0.03083 0.04633 1.16% Amr::initialInit() 1 0.03817 0.04067 0.04098 1.03% AmrLevel::checkPoint() 3 0.03121 0.03582 0.04041 1.02% StateData::checkPoint() 12 0.03115 0.03575 0.04029 1.01% Castro::finalize_do_advance() 10 0.001533 0.02313 0.03068 0.77% Castro::normalize_species() 62 0.02405 0.02685 0.03062 0.77% Amr::InitializeInit() 1 0.01788 0.02653 0.02996 0.75% Amr::defBaseLevel() 1 0.01787 0.02652 0.02996 0.75% Castro::construct_new_source() 70 0.02177 0.02583 0.02734 0.69% Castro::sum_integrated_quantities() 11 0.02613 0.02618 0.0262 0.66% Castro::construct_new_gravity_source() 10 0.01851 0.02153 0.02271 0.57% Castro::hybrid_to_linear_momentum() 62 0.01539 0.01829 0.0218 0.55% Amr::FinalizeInit() 1 0.01077 0.01414 0.02094 0.53% Gravity::get_new_grav_vector() 11 0.01069 0.0144 0.01758 0.44% Castro::construct_new_gravity() 10 0.009475 0.01351 0.01692 0.42% Castro::check_for_nan() 20 0.009598 0.01209 0.01645 0.41% Castro::apply_source_to_state() 20 0.01203 0.01416 0.01641 0.41% MultiFab::contains_nan() 20 0.009563 0.01205 0.01639 0.41% MultiFab::Saxpy() 20 0.01199 0.0141 0.01634 0.41% Castro::derive() 55 0.01137 0.0141 0.0159 0.40% Castro::construct_old_gravity() 10 0.008721 0.01173 0.01478 0.37% Gravity::get_old_grav_vector() 10 0.008072 0.01096 0.01386 0.35% FabArray::setDomainBndry() 119 0.004973 0.008889 0.01358 0.34% Castro::computeInitialDt() 2 0.002358 0.005725 0.01252 0.31% Castro::construct_old_source() 70 0.006652 0.009263 0.01213 0.30% Castro::Castro() 1 0.006491 0.009847 0.01199 0.30% Castro::initData() 1 0.006854 0.009402 0.01041 0.26% Gravity::add_pointmass_to_gravity() 21 0.007701 0.008653 0.009482 0.24% Castro::construct_old_gravity_source() 10 0.004867 0.007148 0.009414 0.24% Castro::post_init() 1 0.006332 0.006882 0.00782 0.20% Castro::volWgtSum() 176 0.00672 0.007171 0.007661 0.19% Castro::computeNewDt() 9 0.007438 0.007562 0.007623 0.19% Castro::fill_hybrid_hydro_source() 30 0.004852 0.006143 0.007243 0.18% Castro::initMFs() 1 0.003885 0.005583 0.007079 0.18% AmrLevel::AmrLevel(dm) 1 0.003732 0.004643 0.005344 0.13% StateData::define() 4 0.003717 0.00463 0.005331 0.13% Castro::enforce_min_density() 62 0.003833 0.004625 0.005293 0.13% Castro::swap_state_time_levels() 10 0.002652 0.004399 0.004877 0.12% Castro::construct_new_hybrid_source() 10 0.003162 0.004172 0.004779 0.12% Castro::post_regrid() 1 0.001693 0.002629 0.003179 0.08% Amr::InitAmr() 1 0.0003065 0.0005894 0.003139 0.08% DistributionMapping::SFCProcessorMapDoIt() 1 2.307e-05 0.002593 0.002908 0.07% DistributionMapping::LeastUsedCPUs() 1 1.377e-05 0.002584 0.002898 0.07% Castro::construct_old_hybrid_source() 10 0.001639 0.002025 0.0026 0.07% Castro::locSquaredSum() 11 0.001053 0.001245 0.00167 0.04% Castro::buildMetrics() 1 0.0009566 0.001277 0.001481 0.04% Castro::linear_to_hybrid_momentum() 1 0.0002176 0.0002367 0.0002569 0.01% Castro::finalize_advance() 10 0.0001234 0.0001405 0.0001707 0.00% Castro::enforce_consistent_e() 1 5.975e-05 0.0001001 0.0001625 0.00% FabArrayBase::getCPC() 20 7.254e-05 9.368e-05 0.0001123 0.00% Amr::writeSmallPlotFile() 1 3.86e-05 6.963e-05 9.522e-05 0.00% FabArrayBase::CPC::define() 2 3.037e-05 4.598e-05 6.802e-05 0.00% Castro::enforce_speed_limit() 62 4.165e-05 4.542e-05 5.258e-05 0.00% Gravity::swapTimeLevels() 10 1.547e-05 2.147e-05 2.768e-05 0.00% Castro::create_source_corrector() 10 1.105e-05 1.68e-05 2.456e-05 0.00% Castro::construct_new_rotation_source() 10 1.01e-05 1.27e-05 1.817e-05 0.00% Amr::initSubcycle() 1 8.944e-06 1.369e-05 1.756e-05 0.00% AmrLevel::checkPointPost() 3 4.787e-06 6.655e-06 1.548e-05 0.00% Castro::construct_old_rotation_source() 10 4.293e-06 7.534e-06 1.319e-05 0.00% Castro::gwstrain() 11 8.047e-06 1.016e-05 1.295e-05 0.00% Gravity::set_mass_offset() 10 8.901e-06 1.102e-05 1.26e-05 0.00% Castro::FluxRegCrseInit 10 7.793e-06 1.007e-05 1.138e-05 0.00% Castro::retry_advance_ctu() 10 7.373e-06 9.221e-06 1.137e-05 0.00% AmrLevel::checkPointPre() 3 3.288e-06 5.087e-06 7.686e-06 0.00% Castro::FluxRegFineAdd() 10 3.693e-06 4.412e-06 6.204e-06 0.00% DistributionMapping::Distribute() 1 1.539e-06 1.962e-06 2.575e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.05-3-gdf9b6944a6d5) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.05-3-gdf9b6944a6d5) initialized Starting run at 06:47:13 UTC on 2022-05-03. Successfully read inputs file ... Castro git describe: 22.05-2-g1289ecab7 AMReX git describe: 22.05-3-gdf9b6944a Microphysics git describe: 22.05 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 28.96097794 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.038041201 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.008000394 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.288507959 Castro::do_new_sources() time = 0.009613448 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.6870682981 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.389596852 [STEP 6] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007001758 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.273596116 Castro::do_new_sources() time = 0.009083583 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7345733632 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.401677163 [STEP 7] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006081687 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.263217739 Castro::do_new_sources() time = 0.00964538 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.763235055 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.351912617 [STEP 8] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006168309 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.181026392 Castro::do_new_sources() time = 0.009955943 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.043143675 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.258388004 [STEP 9] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007119512 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.168319176 Castro::do_new_sources() time = 0.009714537 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.091138261 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.24657829 [STEP 10] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.138490164 seconds Ending run at 06:47:15 UTC on 2022-05-03. Run time = 1.828358274 Run time without initialization = 1.789882479 Average number of zones advanced per microsecond: 0.732 Average number of zones advanced per microsecond per rank: 0.046 TinyProfiler total time across processes [min...avg...max]: 1.827 ... 1.828 ... 1.828 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.7744 1.0272 1.1847 64.79% Castro::do_advance_ctu() 5 0.01674 0.1761 0.4343 23.75% Amr::writePlotFile() 1 0.1291 0.1311 0.1332 7.29% FabArray::ParallelCopy_finish() 56 0.02785 0.05302 0.1107 6.05% FabArray::setVal() 80 0.03911 0.04871 0.05453 2.98% Castro::sum_integrated_quantities() 5 0.03568 0.03743 0.04001 2.19% Castro::do_old_sources() 5 7.205e-05 0.009494 0.03619 1.98% Castro::reset_internal_energy(Fab) 240 0.0252 0.03003 0.03517 1.92% StateData::FillBoundary(geom) 10 0.008137 0.02018 0.031 1.70% FabArray::ParallelCopy_nowait() 56 0.01424 0.02221 0.0304 1.66% Castro::estTimeStep() 10 0.008839 0.01747 0.03002 1.64% FillPatchIterator::Initialize 56 0.01683 0.02224 0.0249 1.36% Castro::computeTemp() 30 0.01558 0.01885 0.02202 1.20% VisMF::Read() 3 0.01699 0.01861 0.01923 1.05% Castro::normalize_species() 30 0.01188 0.01446 0.01771 0.97% Castro::finalize_do_advance() 5 0.008572 0.01402 0.01745 0.95% Castro::expand_state() 5 0.008683 0.01372 0.01736 0.95% Castro::construct_new_gravity_source() 5 0.01394 0.01496 0.01629 0.89% Castro::initialize_do_advance() 5 0.0115 0.01378 0.01595 0.87% Castro::do_new_sources() 5 5.63e-05 0.003393 0.01515 0.83% Castro::hybrid_to_linear_momentum() 30 0.008276 0.01093 0.01381 0.76% Castro::initialize_advance() 5 0.008406 0.01159 0.01364 0.75% Castro::post_timestep() 5 0.002218 0.006308 0.01326 0.73% MultiFab::contains_nan() 10 0.006245 0.008339 0.01184 0.65% MultiFab::Saxpy() 10 0.007287 0.008961 0.01096 0.60% VisMF::Write(FabArray) 1 0.006088 0.008196 0.01022 0.56% Amr::restart() 1 0.008208 0.008286 0.008438 0.46% FabArray::setDomainBndry() 56 0.00299 0.005187 0.006922 0.38% Gravity::get_new_grav_vector() 5 0.003754 0.004839 0.006619 0.36% Castro::derive() 26 0.0042 0.00524 0.006245 0.34% Castro::construct_old_gravity_source() 5 0.003084 0.004711 0.006198 0.34% Gravity::add_pointmass_to_gravity() 10 0.004031 0.004882 0.006052 0.33% Castro::initMFs() 1 0.004463 0.004779 0.005 0.27% Castro::swap_state_time_levels() 5 0.004198 0.004475 0.004724 0.26% Castro::post_restart() 1 6.885e-05 0.001298 0.00449 0.25% Castro::fill_hybrid_hydro_source() 15 0.002774 0.003778 0.004453 0.24% StateData::restartDoit() 4 0.002874 0.003722 0.00407 0.22% Castro::volWgtSum() 80 0.003205 0.003588 0.003899 0.21% Gravity::get_old_grav_vector() 5 0.002564 0.003304 0.003828 0.21% Castro::enforce_min_density() 30 0.002179 0.002631 0.003161 0.17% main() 1 0.001449 0.002102 0.002456 0.13% Castro::finalize_advance() 5 0.0007346 0.001093 0.001525 0.08% Castro::subcycle_advance_ctu() 5 1.922e-05 7.696e-05 0.000665 0.04% Castro::buildMetrics() 1 0.0001733 0.0003789 0.00048 0.03% Amr::InitAmr() 1 0.0002542 0.0003772 0.0004713 0.03% Castro::locSquaredSum() 6 0.0002284 0.0002894 0.0003356 0.02% Amr::coarseTimeStep() 5 0.0001665 0.0002263 0.0003141 0.02% AmrLevel::restart() 1 0.0001331 0.0002236 0.0002682 0.01% Castro::reset_internal_energy(MultiFab) 30 0.0001047 0.000169 0.0002497 0.01% Castro::clean_state() 30 9.023e-05 0.0001602 0.0002407 0.01% StateDataPhysBCFunct::() 56 5.962e-05 0.0001065 0.0001413 0.01% Castro::computeNewDt() 5 4.356e-06 1.241e-05 0.0001033 0.01% FillPatchSingleLevel 56 4.078e-05 7.202e-05 9.463e-05 0.01% Castro::construct_new_source() 35 4.34e-05 7.087e-05 9.049e-05 0.00% FabArrayBase::CPC::define() 2 2.941e-05 5.482e-05 8.982e-05 0.00% Castro::construct_old_source() 35 2.256e-05 4.747e-05 8.785e-05 0.00% Castro::construct_new_gravity() 5 1.554e-05 4.416e-05 8.232e-05 0.00% Castro::construct_old_gravity() 5 1.998e-05 4.312e-05 8.215e-05 0.00% FabArray::ParallelCopy() 56 3.681e-05 6.306e-05 7.77e-05 0.00% Amr::timeStep() 5 2.662e-05 3.517e-05 5.736e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.026e-05 2.858e-05 5.397e-05 0.00% Castro::check_for_nan() 10 1.173e-05 2.737e-05 5.319e-05 0.00% Castro::advance() 5 1.941e-05 3.008e-05 4.166e-05 0.00% Castro::apply_source_to_state() 10 1.364e-05 2.797e-05 3.972e-05 0.00% Amr::writeSmallPlotFile() 1 2.66e-05 3.641e-05 3.853e-05 0.00% FabArrayBase::getCPC() 10 1.55e-05 2.45e-05 3.619e-05 0.00% Castro::construct_new_hybrid_source() 5 1.031e-05 2.268e-05 3.188e-05 0.00% Gravity::swapTimeLevels() 5 6.433e-06 1.381e-05 2.673e-05 0.00% Castro::enforce_speed_limit() 30 1.006e-05 1.598e-05 2.452e-05 0.00% Amr::initSubcycle() 1 8.628e-06 1.364e-05 1.902e-05 0.00% Castro::create_source_corrector() 5 5.963e-06 1.163e-05 1.804e-05 0.00% Castro::construct_old_hybrid_source() 5 5.837e-06 1.126e-05 1.6e-05 0.00% Castro::gwstrain() 5 3.715e-06 6.2e-06 1.367e-05 0.00% Castro::construct_new_rotation_source() 5 4.903e-06 7.357e-06 1.132e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.464e-06 7.078e-06 1.007e-05 0.00% Castro::construct_old_rotation_source() 5 3.386e-06 5.057e-06 8.213e-06 0.00% Castro::retry_advance_ctu() 5 3.785e-06 5.8e-06 7.557e-06 0.00% Castro::FluxRegCrseInit 5 3.688e-06 5.328e-06 7.387e-06 0.00% Gravity::set_mass_offset() 6 3.463e-06 6.006e-06 7.303e-06 0.00% Amr::init() 1 1.076e-06 1.766e-06 5.52e-06 0.00% Castro::FluxRegFineAdd() 5 1.661e-06 2.476e-06 3.669e-06 0.00% DistributionMapping::Distribute() 1 1.617e-06 2.227e-06 2.85e-06 0.00% AmrLevel::AmrLevel() 1 1.401e-06 2.035e-06 2.68e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.827 1.828 1.828 100.00% Amr::coarseTimeStep() 5 1.648 1.648 1.648 90.15% Amr::timeStep() 5 1.643 1.643 1.643 89.87% Castro::advance() 5 1.571 1.577 1.58 86.43% Castro::subcycle_advance_ctu() 5 1.512 1.517 1.527 83.50% Castro::do_advance_ctu() 5 1.512 1.517 1.527 83.50% Castro::construct_ctu_hydro_source() 5 0.7744 1.027 1.185 64.79% FillPatchIterator::Initialize 56 0.1017 0.1232 0.1571 8.59% Amr::writePlotFile() 1 0.1393 0.1393 0.1393 7.62% Castro::initialize_do_advance() 5 0.1141 0.1249 0.139 7.60% FillPatchSingleLevel 56 0.07592 0.09572 0.1373 7.51% FabArray::ParallelCopy() 56 0.04751 0.07537 0.1291 7.06% FabArray::ParallelCopy_finish() 56 0.02785 0.05302 0.1107 6.05% Castro::expand_state() 5 0.08017 0.08638 0.0948 5.19% Castro::clean_state() 30 0.06332 0.07724 0.09209 5.04% Castro::post_timestep() 5 0.06277 0.0659 0.07169 3.92% Castro::initialize_advance() 5 0.04495 0.05882 0.06656 3.64% Castro::do_old_sources() 5 0.02246 0.03557 0.06218 3.40% Castro::computeTemp() 30 0.04089 0.04904 0.05714 3.13% Castro::do_new_sources() 5 0.038 0.04614 0.056 3.06% FabArray::setVal() 80 0.03911 0.04871 0.05453 2.98% Castro::sum_integrated_quantities() 5 0.05009 0.05011 0.05017 2.74% Amr::init() 1 0.03781 0.03792 0.03807 2.08% Amr::restart() 1 0.03781 0.03792 0.03807 2.08% Castro::reset_internal_energy(MultiFab) 30 0.0253 0.03019 0.03542 1.94% Castro::reset_internal_energy(Fab) 240 0.0252 0.03003 0.03517 1.92% StateDataPhysBCFunct::() 56 0.008197 0.02028 0.03113 1.70% StateData::FillBoundary(geom) 10 0.008137 0.02018 0.031 1.70% FabArray::ParallelCopy_nowait() 56 0.01437 0.02229 0.03048 1.67% Castro::estTimeStep() 10 0.008839 0.01747 0.03002 1.64% AmrLevel::restart() 1 0.02015 0.02271 0.02364 1.29% StateData::restartDoit() 4 0.01995 0.02244 0.02338 1.28% VisMF::Read() 3 0.01699 0.01861 0.01923 1.05% Castro::construct_new_source() 35 0.01599 0.01768 0.01886 1.03% Castro::normalize_species() 30 0.01188 0.01446 0.01771 0.97% Castro::finalize_do_advance() 5 0.008572 0.01402 0.01745 0.95% Castro::construct_new_gravity_source() 5 0.01394 0.01496 0.01629 0.89% Castro::hybrid_to_linear_momentum() 30 0.008276 0.01093 0.01381 0.76% Castro::construct_new_gravity() 5 0.006707 0.008622 0.01233 0.67% Castro::check_for_nan() 10 0.006266 0.008367 0.0119 0.65% MultiFab::contains_nan() 10 0.006245 0.008339 0.01184 0.65% Gravity::get_new_grav_vector() 5 0.006325 0.008139 0.01149 0.63% Castro::derive() 26 0.00736 0.009659 0.01115 0.61% Castro::apply_source_to_state() 10 0.007309 0.008988 0.011 0.60% MultiFab::Saxpy() 10 0.007287 0.008961 0.01096 0.60% VisMF::Write(FabArray) 1 0.006088 0.008196 0.01022 0.56% Castro::construct_old_gravity() 5 0.005975 0.006733 0.007947 0.43% Castro::construct_old_source() 35 0.004024 0.005929 0.007712 0.42% Gravity::get_old_grav_vector() 5 0.005566 0.006296 0.007418 0.41% FabArray::setDomainBndry() 56 0.00299 0.005187 0.006922 0.38% Castro::construct_old_gravity_source() 5 0.003084 0.004711 0.006198 0.34% Gravity::add_pointmass_to_gravity() 10 0.004031 0.004882 0.006052 0.33% Castro::initMFs() 1 0.004463 0.004779 0.005 0.27% Castro::computeNewDt() 5 0.004858 0.004931 0.004982 0.27% Castro::swap_state_time_levels() 5 0.004198 0.004475 0.004724 0.26% Castro::post_restart() 1 0.0004466 0.001601 0.004703 0.26% Castro::fill_hybrid_hydro_source() 15 0.002774 0.003778 0.004453 0.24% Castro::volWgtSum() 80 0.003205 0.003588 0.003899 0.21% Castro::enforce_min_density() 30 0.002179 0.002631 0.003161 0.17% Castro::construct_new_hybrid_source() 5 0.00186 0.002646 0.003144 0.17% Castro::finalize_advance() 5 0.0007429 0.001101 0.001533 0.08% Castro::construct_old_hybrid_source() 5 0.0009138 0.001166 0.001419 0.08% Castro::locSquaredSum() 6 0.0006893 0.0008635 0.0009664 0.05% Castro::buildMetrics() 1 0.0002317 0.0005428 0.0008194 0.04% Amr::InitAmr() 1 0.0002639 0.0003908 0.0004903 0.03% FabArrayBase::getCPC() 10 4.888e-05 7.931e-05 0.0001245 0.01% FabArrayBase::CPC::define() 2 2.941e-05 5.482e-05 8.982e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 1.969e-05 3.789e-05 6.432e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.026e-05 2.858e-05 5.397e-05 0.00% Amr::writeSmallPlotFile() 1 2.66e-05 3.641e-05 3.853e-05 0.00% Gravity::swapTimeLevels() 5 6.433e-06 1.381e-05 2.673e-05 0.00% Castro::enforce_speed_limit() 30 1.006e-05 1.598e-05 2.452e-05 0.00% Amr::initSubcycle() 1 8.628e-06 1.364e-05 1.902e-05 0.00% Castro::create_source_corrector() 5 5.963e-06 1.163e-05 1.804e-05 0.00% Castro::gwstrain() 5 3.715e-06 6.2e-06 1.367e-05 0.00% Castro::construct_new_rotation_source() 5 4.903e-06 7.357e-06 1.132e-05 0.00% Castro::construct_old_rotation_source() 5 3.386e-06 5.057e-06 8.213e-06 0.00% Castro::retry_advance_ctu() 5 3.785e-06 5.8e-06 7.557e-06 0.00% Castro::FluxRegCrseInit 5 3.688e-06 5.328e-06 7.387e-06 0.00% Gravity::set_mass_offset() 6 3.463e-06 6.006e-06 7.303e-06 0.00% Castro::FluxRegFineAdd() 5 1.661e-06 2.476e-06 3.669e-06 0.00% DistributionMapping::Distribute() 1 1.617e-06 2.227e-06 2.85e-06 0.00% AmrLevel::AmrLevel() 1 1.401e-06 2.035e-06 2.68e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.05-3-gdf9b6944a6d5) finalized