MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.02-14-gaa0dc39f50f7) initialized Starting run at 07:33:24 UTC on 2022-02-23. Successfully read inputs file ... Castro git describe: 22.02-4-g0d942c92d AMReX git describe: 22.02-14-gaa0dc39f5 Microphysics git describe: 22.02-4-ga894d649 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 4.289006454 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.016842343 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.020325252 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.008991133 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.273566154 Castro::do_new_sources() time = 0.009516256 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.723987459 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.370160256 [STEP 1] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006687062 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.261052335 Castro::do_new_sources() time = 0.008818382 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7668687966 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.353616737 [STEP 2] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00625756 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.254887677 Castro::do_new_sources() time = 0.00838715 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7864607333 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.344300863 [STEP 3] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006873069 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.179242689 Castro::do_new_sources() time = 0.009389873 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.025932801 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.264756498 [STEP 4] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006585842 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.166712894 Castro::do_new_sources() time = 0.009340758 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.12331784 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.241543001 [STEP 5] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.016681958 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00664981 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.166552498 Castro::do_new_sources() time = 0.008793271 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.13166133 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.2387598 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004507781 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.162141312 Castro::do_new_sources() time = 0.008130811 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.234489856 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.219379945 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004113858 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.162129976 Castro::do_new_sources() time = 0.0058662 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.256940904 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.215505059 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004201597 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.162431331 Castro::do_new_sources() time = 0.005466131 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.255716882 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.215698765 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004308475 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.161657448 Castro::do_new_sources() time = 0.005408559 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.262164427 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.214720173 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.014098061 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.158709657 seconds Ending run at 07:33:27 UTC on 2022-02-23. Run time = 2.955932695 Run time without initialization = 2.869783104 Average number of zones advanced per microsecond: 0.913 Average number of zones advanced per microsecond per rank: 0.057 TinyProfiler total time across processes [min...avg...max]: 2.955 ... 2.956 ... 2.956 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.5295 1.8123 1.9609 66.34% MultiFab::min() 10 0.0004358 0.151 0.4564 15.44% Amr::writePlotFile() 2 0.1608 0.1673 0.1685 5.70% FabArray::ParallelCopy_finish() 251 0.04748 0.08564 0.1267 4.29% FabArray::setVal() 164 0.07793 0.08652 0.09523 3.22% Castro::reset_internal_energy() 63 0.05485 0.06074 0.06841 2.31% Castro::do_old_sources() 10 0.0001923 0.01149 0.06222 2.10% VisMF::Write(FabArray) 11 0.0417 0.04694 0.05926 2.00% Castro::estTimeStep() 21 0.02025 0.0357 0.05628 1.90% FabArray::ParallelCopy_nowait() 251 0.03259 0.04265 0.05249 1.78% StateData::FillBoundary(geom) 20 0.0215 0.03276 0.05234 1.77% FillPatchIterator::Initialize 251 0.03304 0.0385 0.04465 1.51% Castro::computeTemp() 63 0.03375 0.03741 0.04218 1.43% Castro::do_advance_ctu() 10 0.02324 0.02948 0.03438 1.16% Castro::post_timestep() 10 0.007794 0.01618 0.02998 1.01% Castro::expand_state() 10 0.0184 0.02375 0.02995 1.01% Castro::initialize_do_advance() 10 0.0156 0.02549 0.02891 0.98% Castro::normalize_species() 62 0.01969 0.02245 0.02612 0.88% Castro::construct_new_gravity_source() 10 0.02045 0.02265 0.02449 0.83% Castro::do_new_sources() 10 0.0001408 0.006194 0.02433 0.82% Castro::hybrid_to_linear_momentum() 62 0.01633 0.01954 0.02367 0.80% Castro::finalize_do_advance() 10 0.001623 0.01929 0.02307 0.78% Castro::initialize_advance() 10 0.01348 0.01684 0.01931 0.65% Amr::checkPoint() 3 0.008062 0.01432 0.01867 0.63% MultiFab::contains_nan() 20 0.01003 0.01316 0.01731 0.59% MultiFab::Saxpy() 20 0.01319 0.01472 0.01711 0.58% FabArray::setDomainBndry() 251 0.006581 0.01026 0.01434 0.49% Castro::post_init() 1 0.008778 0.009707 0.013 0.44% Castro::derive() 187 0.008654 0.01013 0.01207 0.41% Castro::construct_old_gravity_source() 10 0.006283 0.008084 0.01162 0.39% Gravity::get_new_grav_vector() 11 0.007307 0.00948 0.01113 0.38% Gravity::add_pointmass_to_gravity() 21 0.007781 0.008834 0.01019 0.34% Amr::defBaseLevel() 1 0.004765 0.00653 0.008328 0.28% Castro::fill_hybrid_hydro_source() 30 0.005049 0.006394 0.007996 0.27% Gravity::get_old_grav_vector() 10 0.004341 0.005933 0.007114 0.24% Castro::volWgtSum() 176 0.005322 0.005652 0.005979 0.20% Castro::enforce_min_density() 62 0.004386 0.00492 0.005814 0.20% StateData::define() 4 0.003448 0.004501 0.00507 0.17% Castro::swap_state_time_levels() 10 0.004059 0.004381 0.004781 0.16% Castro::initData() 1 0.002071 0.002562 0.003034 0.10% main() 1 0.0007766 0.001052 0.001458 0.05% Castro::subcycle_advance_ctu() 10 5.302e-05 0.0001303 0.001121 0.04% Castro::locSquaredSum() 11 0.0004413 0.0005072 0.0006094 0.02% Amr::coarseTimeStep() 10 0.0002967 0.000397 0.0005581 0.02% Amr::InitAmr() 1 0.0002686 0.0004167 0.0005513 0.02% Castro::clean_state() 62 0.0002216 0.0002836 0.000349 0.01% DistributionMapping::LeastUsedCPUs() 1 1.034e-05 0.0001532 0.0003414 0.01% StateData::checkPoint() 12 2.328e-05 4.743e-05 0.0003076 0.01% StateDataPhysBCFunct::() 251 0.0001993 0.0002403 0.0002996 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002178 0.0002465 0.0002688 0.01% FillPatchSingleLevel 251 0.0001567 0.0001904 0.0002335 0.01% Castro::computeNewDt() 9 7.86e-06 2.264e-05 0.000218 0.01% FabArray::ParallelCopy() 251 0.0001543 0.000184 0.0002157 0.01% Castro::enforce_consistent_e() 1 6.414e-05 9.629e-05 0.0001869 0.01% Amr::timeStep() 10 5.347e-05 6.89e-05 0.000156 0.01% Castro::construct_new_source() 70 8.264e-05 0.0001219 0.0001471 0.00% AmrLevel::checkPoint() 3 5.421e-05 7.276e-05 0.0001405 0.00% Castro::finalize_advance() 10 9.659e-05 0.0001195 0.0001404 0.00% Castro::construct_old_source() 70 7.06e-05 9.429e-05 0.0001377 0.00% Castro::construct_new_gravity() 10 4.182e-05 7.097e-05 0.0001301 0.00% Castro::construct_old_gravity() 10 6.835e-05 8.505e-05 0.000115 0.00% FabArrayBase::CPC::define() 2 3.496e-05 5.953e-05 9.989e-05 0.00% Castro::check_for_nan() 20 3.737e-05 5.4e-05 8.73e-05 0.00% Castro::apply_source_to_state() 20 5.71e-05 7.023e-05 8.374e-05 0.00% Castro::advance() 10 4.351e-05 5.266e-05 7.619e-05 0.00% Amr::writeSmallPlotFile() 1 2.64e-05 6.095e-05 7.564e-05 0.00% FabArrayBase::getCPC() 20 4.631e-05 5.278e-05 6.421e-05 0.00% Castro::enforce_speed_limit() 62 4.492e-05 5.457e-05 6.304e-05 0.00% Amr::FinalizeInit() 1 4.427e-06 9.078e-06 4.944e-05 0.00% Castro::construct_new_hybrid_source() 10 1.599e-05 3.178e-05 4.298e-05 0.00% Castro::create_source_corrector() 10 1.46e-05 2.3e-05 3.403e-05 0.00% Castro::construct_old_hybrid_source() 10 1.647e-05 2.275e-05 3.08e-05 0.00% Gravity::swapTimeLevels() 10 1.978e-05 2.395e-05 2.798e-05 0.00% Castro::construct_new_rotation_source() 10 8.696e-06 1.348e-05 2.04e-05 0.00% Amr::initSubcycle() 1 1.014e-05 1.428e-05 1.719e-05 0.00% AmrLevel::AmrLevel(dm) 1 9.471e-06 1.213e-05 1.708e-05 0.00% Castro::construct_old_rotation_source() 10 5.574e-06 9.106e-06 1.309e-05 0.00% Castro::gwstrain() 11 7.532e-06 8.856e-06 1.099e-05 0.00% Castro::FluxRegFineAdd() 10 7.945e-06 9.163e-06 1.076e-05 0.00% Amr::InitializeInit() 1 2.598e-06 4.467e-06 1.066e-05 0.00% Castro::retry_advance_ctu() 10 6.572e-06 8.478e-06 1.034e-05 0.00% Gravity::set_mass_offset() 10 5.546e-06 7.248e-06 9.84e-06 0.00% Amr::initialInit() 1 1.486e-06 2.823e-06 9.476e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.382e-06 6.642e-06 7.872e-06 0.00% AmrLevel::checkPointPost() 3 4.233e-06 5.766e-06 7.178e-06 0.00% Castro::computeInitialDt() 2 2.609e-06 4.635e-06 7.065e-06 0.00% AmrLevel::checkPointPre() 3 3.003e-06 4.454e-06 6.684e-06 0.00% Castro::post_regrid() 1 2.665e-06 3.709e-06 4.502e-06 0.00% Amr::init() 1 2.755e-06 3.333e-06 4.043e-06 0.00% DistributionMapping::Distribute() 1 1.709e-06 2.233e-06 2.675e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 2.955 2.956 2.956 100.00% Amr::coarseTimeStep() 10 2.71 2.71 2.71 91.67% Amr::timeStep() 10 2.668 2.669 2.669 90.28% Castro::advance() 10 2.595 2.613 2.617 88.53% Castro::subcycle_advance_ctu() 10 2.493 2.521 2.533 85.71% Castro::do_advance_ctu() 10 2.491 2.521 2.533 85.70% Castro::construct_ctu_hydro_source() 10 1.53 1.812 1.961 66.34% MultiFab::min() 10 0.0004358 0.151 0.4564 15.44% FillPatchIterator::Initialize 251 0.1787 0.2105 0.2397 8.11% Castro::initialize_do_advance() 10 0.2015 0.2178 0.2397 8.11% FillPatchSingleLevel 251 0.128 0.1618 0.196 6.63% Amr::writePlotFile() 2 0.1793 0.1793 0.1793 6.07% FabArray::ParallelCopy() 251 0.08745 0.1286 0.172 5.82% Castro::clean_state() 62 0.1286 0.1436 0.1625 5.50% Castro::expand_state() 10 0.133 0.1486 0.1617 5.47% FabArray::ParallelCopy_finish() 251 0.04748 0.08564 0.1267 4.29% Castro::computeTemp() 63 0.08868 0.09815 0.1099 3.72% Castro::do_old_sources() 10 0.04018 0.05816 0.1057 3.58% Castro::initialize_advance() 10 0.07953 0.09189 0.1034 3.50% FabArray::setVal() 164 0.07793 0.08652 0.09523 3.22% Castro::do_new_sources() 10 0.0649 0.07604 0.09264 3.13% Amr::init() 1 0.08541 0.08556 0.08574 2.90% Castro::post_timestep() 10 0.05156 0.0553 0.07313 2.47% Castro::reset_internal_energy() 63 0.05485 0.06074 0.06841 2.31% VisMF::Write(FabArray) 11 0.0417 0.04694 0.05926 2.00% Castro::estTimeStep() 21 0.02025 0.0357 0.05628 1.90% FabArray::ParallelCopy_nowait() 251 0.03268 0.04277 0.05265 1.78% StateDataPhysBCFunct::() 251 0.02171 0.033 0.0526 1.78% StateData::FillBoundary(geom) 20 0.0215 0.03276 0.05234 1.77% Amr::checkPoint() 3 0.04928 0.04944 0.04946 1.67% Amr::initialInit() 1 0.04656 0.04668 0.04685 1.59% AmrLevel::checkPoint() 3 0.03077 0.03511 0.04121 1.39% StateData::checkPoint() 12 0.03071 0.03504 0.04107 1.39% Castro::construct_new_source() 70 0.02372 0.02711 0.02953 1.00% Amr::FinalizeInit() 1 0.01979 0.02197 0.02951 1.00% Castro::volWgtSum() 176 0.02237 0.02532 0.02849 0.96% Amr::InitializeInit() 1 0.01734 0.02471 0.02676 0.91% Amr::defBaseLevel() 1 0.01734 0.0247 0.02676 0.91% Castro::normalize_species() 62 0.01969 0.02245 0.02612 0.88% Castro::construct_new_gravity_source() 10 0.02045 0.02265 0.02449 0.83% Castro::hybrid_to_linear_momentum() 62 0.01633 0.01954 0.02367 0.80% Castro::derive() 187 0.01767 0.0205 0.02338 0.79% Castro::finalize_do_advance() 10 0.001623 0.01929 0.02307 0.78% Gravity::get_new_grav_vector() 11 0.01213 0.01554 0.01883 0.64% Castro::construct_new_gravity() 10 0.01172 0.01454 0.01781 0.60% Castro::check_for_nan() 20 0.01006 0.01322 0.01739 0.59% MultiFab::contains_nan() 20 0.01003 0.01316 0.01731 0.59% Castro::apply_source_to_state() 20 0.01325 0.01479 0.0172 0.58% MultiFab::Saxpy() 20 0.01319 0.01472 0.01711 0.58% Castro::post_init() 1 0.01543 0.01585 0.01663 0.56% Castro::construct_old_source() 70 0.00836 0.01031 0.0147 0.50% FabArray::setDomainBndry() 251 0.006581 0.01026 0.01434 0.49% Castro::construct_old_gravity() 10 0.009526 0.01199 0.01339 0.45% Gravity::get_old_grav_vector() 10 0.008951 0.01122 0.01262 0.43% Castro::computeInitialDt() 2 0.002421 0.004588 0.01213 0.41% Castro::construct_old_gravity_source() 10 0.006283 0.008084 0.01162 0.39% Castro::initData() 1 0.007397 0.009958 0.01077 0.36% Gravity::add_pointmass_to_gravity() 21 0.007781 0.008834 0.01019 0.34% Castro::computeNewDt() 9 0.008467 0.008584 0.008666 0.29% Castro::fill_hybrid_hydro_source() 30 0.005049 0.006394 0.007996 0.27% Castro::enforce_min_density() 62 0.004386 0.00492 0.005814 0.20% Castro::construct_new_hybrid_source() 10 0.003184 0.004326 0.005129 0.17% AmrLevel::AmrLevel(dm) 1 0.003457 0.004513 0.005083 0.17% StateData::define() 4 0.003448 0.004501 0.00507 0.17% Castro::swap_state_time_levels() 10 0.004059 0.004381 0.004781 0.16% Castro::post_regrid() 1 0.001872 0.002652 0.003067 0.10% Castro::construct_old_hybrid_source() 10 0.001766 0.002123 0.002933 0.10% Castro::locSquaredSum() 11 0.001098 0.001344 0.00163 0.06% Amr::InitAmr() 1 0.0002792 0.000431 0.000566 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.843e-05 0.0001621 0.0003505 0.01% DistributionMapping::LeastUsedCPUs() 1 1.034e-05 0.0001532 0.0003414 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002178 0.0002465 0.0002688 0.01% Castro::enforce_consistent_e() 1 6.414e-05 9.629e-05 0.0001869 0.01% FabArrayBase::getCPC() 20 8.272e-05 0.0001123 0.0001584 0.01% Castro::finalize_advance() 10 0.0001045 0.0001286 0.0001494 0.01% FabArrayBase::CPC::define() 2 3.496e-05 5.953e-05 9.989e-05 0.00% Amr::writeSmallPlotFile() 1 2.64e-05 6.095e-05 7.564e-05 0.00% Castro::enforce_speed_limit() 62 4.492e-05 5.457e-05 6.304e-05 0.00% Castro::create_source_corrector() 10 1.46e-05 2.3e-05 3.403e-05 0.00% Gravity::swapTimeLevels() 10 1.978e-05 2.395e-05 2.798e-05 0.00% Castro::construct_new_rotation_source() 10 8.696e-06 1.348e-05 2.04e-05 0.00% Amr::initSubcycle() 1 1.014e-05 1.428e-05 1.719e-05 0.00% Castro::construct_old_rotation_source() 10 5.574e-06 9.106e-06 1.309e-05 0.00% Castro::gwstrain() 11 7.532e-06 8.856e-06 1.099e-05 0.00% Castro::FluxRegFineAdd() 10 7.945e-06 9.163e-06 1.076e-05 0.00% Castro::retry_advance_ctu() 10 6.572e-06 8.478e-06 1.034e-05 0.00% Gravity::set_mass_offset() 10 5.546e-06 7.248e-06 9.84e-06 0.00% AmrLevel::checkPointPost() 3 4.233e-06 5.766e-06 7.178e-06 0.00% AmrLevel::checkPointPre() 3 3.003e-06 4.454e-06 6.684e-06 0.00% DistributionMapping::Distribute() 1 1.709e-06 2.233e-06 2.675e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.02-14-gaa0dc39f50f7) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.02-14-gaa0dc39f50f7) initialized Starting run at 07:33:27 UTC on 2022-02-23. Successfully read inputs file ... Castro git describe: 22.02-4-g0d942c92d AMReX git describe: 22.02-14-gaa0dc39f5 Microphysics git describe: 22.02-4-ga894d649 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 26.83378658 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.036464539 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007815286 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.276972398 Castro::do_new_sources() time = 0.009516077 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7151811015 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.375524996 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006570433 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.259125882 Castro::do_new_sources() time = 0.008673088 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7634586193 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.352836368 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006011541 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.256707732 Castro::do_new_sources() time = 0.00848755 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7728157485 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.348137586 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00541681 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.219927134 Castro::do_new_sources() time = 0.009183707 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.8743401641 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.305926673 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006192046 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.17932769 Castro::do_new_sources() time = 0.009417286 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.05544755 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.254281307 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.056186411 seconds Ending run at 07:33:29 UTC on 2022-02-23. Run time = 1.732448777 Run time without initialization = 1.695537154 Average number of zones advanced per microsecond: 0.773 Average number of zones advanced per microsecond per rank: 0.048 TinyProfiler total time across processes [min...avg...max]: 1.732 ... 1.732 ... 1.732 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.8204 1.0587 1.2085 69.76% MultiFab::min() 5 0.0002156 0.146 0.387 22.34% FabArray::ParallelCopy_finish() 116 0.03155 0.05722 0.1063 6.14% FabArray::setVal() 80 0.03848 0.04605 0.0543 3.13% Amr::writePlotFile() 1 0.04755 0.04943 0.05059 2.92% Castro::do_old_sources() 5 8.733e-05 0.0122 0.04621 2.67% Castro::reset_internal_energy() 30 0.02559 0.03113 0.03839 2.22% FabArray::ParallelCopy_nowait() 116 0.01739 0.02303 0.03443 1.99% StateData::FillBoundary(geom) 10 0.01114 0.02185 0.03164 1.83% Castro::estTimeStep() 10 0.009702 0.01619 0.02776 1.60% FillPatchIterator::Initialize 116 0.01671 0.02294 0.02699 1.56% Castro::computeTemp() 30 0.0163 0.01915 0.02365 1.37% Castro::expand_state() 5 0.009115 0.01456 0.02052 1.18% Castro::do_new_sources() 5 8.068e-05 0.005948 0.02015 1.16% VisMF::Read() 3 0.0152 0.01789 0.01992 1.15% Castro::do_advance_ctu() 5 0.0124 0.01658 0.01924 1.11% Castro::post_timestep() 5 0.002332 0.009588 0.01829 1.06% Castro::initialize_do_advance() 5 0.01139 0.01453 0.01708 0.99% Castro::normalize_species() 30 0.009481 0.01192 0.01562 0.90% Castro::construct_new_gravity_source() 5 0.01212 0.01413 0.01544 0.89% Castro::hybrid_to_linear_momentum() 30 0.008462 0.01143 0.01489 0.86% Castro::initialize_advance() 5 0.008224 0.01147 0.01444 0.83% Castro::finalize_do_advance() 5 0.008602 0.01138 0.01376 0.79% Amr::restart() 1 0.009445 0.01221 0.01291 0.75% MultiFab::contains_nan() 10 0.006595 0.008414 0.01106 0.64% MultiFab::Saxpy() 10 0.006155 0.008012 0.009671 0.56% VisMF::Write(FabArray) 1 0.006365 0.00753 0.009412 0.54% Castro::derive() 86 0.004718 0.006449 0.008048 0.46% Gravity::get_new_grav_vector() 5 0.003522 0.005157 0.007267 0.42% FabArray::setDomainBndry() 116 0.002836 0.005036 0.006449 0.37% Castro::construct_old_gravity_source() 5 0.003256 0.004523 0.006084 0.35% Castro::post_restart() 1 4.981e-05 0.001374 0.005909 0.34% Gravity::add_pointmass_to_gravity() 10 0.003999 0.004834 0.00581 0.34% Castro::fill_hybrid_hydro_source() 15 0.002505 0.003697 0.004704 0.27% Castro::swap_state_time_levels() 5 0.004183 0.00443 0.004682 0.27% StateData::restartDoit() 4 0.00271 0.003629 0.004041 0.23% Castro::enforce_min_density() 30 0.002268 0.002738 0.003716 0.21% Gravity::get_old_grav_vector() 5 0.002493 0.003013 0.003573 0.21% Castro::volWgtSum() 80 0.002449 0.00274 0.003119 0.18% DistributionMapping::LeastUsedCPUs() 1 9.306e-06 0.0004544 0.00214 0.12% main() 1 0.001414 0.001692 0.001877 0.11% Castro::finalize_advance() 5 0.0005381 0.0007272 0.0009401 0.05% Amr::InitAmr() 1 0.0002608 0.0003943 0.0005318 0.03% Castro::subcycle_advance_ctu() 5 2.766e-05 6.406e-05 0.0004633 0.03% Castro::locSquaredSum() 6 0.000239 0.0003078 0.0004075 0.02% Amr::coarseTimeStep() 5 0.0001818 0.0002214 0.0002916 0.02% AmrLevel::restart() 1 0.000133 0.0002099 0.000238 0.01% Castro::clean_state() 30 8.22e-05 0.0001666 0.0002375 0.01% StateDataPhysBCFunct::() 116 7.435e-05 0.0001333 0.0002045 0.01% FillPatchSingleLevel 116 6.872e-05 0.0001036 0.0001499 0.01% FabArray::ParallelCopy() 116 6.54e-05 9.284e-05 0.0001314 0.01% Castro::construct_new_source() 35 3.326e-05 7.453e-05 9.373e-05 0.01% FabArrayBase::CPC::define() 2 3.036e-05 5.66e-05 8.912e-05 0.01% Castro::computeNewDt() 5 4.912e-06 1.124e-05 8.412e-05 0.00% Castro::construct_new_gravity() 5 1.544e-05 4.485e-05 8.325e-05 0.00% Castro::construct_old_source() 35 2.544e-05 4.902e-05 7.412e-05 0.00% Castro::construct_old_gravity() 5 1.865e-05 4.324e-05 6.046e-05 0.00% Castro::check_for_nan() 10 1.278e-05 3.328e-05 5.672e-05 0.00% Castro::enforce_speed_limit() 30 2.183e-05 3.72e-05 5.047e-05 0.00% Amr::timeStep() 5 2.96e-05 3.595e-05 5.005e-05 0.00% Amr::writeSmallPlotFile() 1 2.836e-05 3.557e-05 4.438e-05 0.00% Castro::apply_source_to_state() 10 1.449e-05 2.937e-05 4.014e-05 0.00% FabArrayBase::getCPC() 10 2.072e-05 2.702e-05 3.451e-05 0.00% Castro::construct_new_hybrid_source() 5 7.979e-06 2.555e-05 3.409e-05 0.00% Castro::advance() 5 2.387e-05 2.853e-05 3.343e-05 0.00% Castro::create_source_corrector() 5 7.091e-06 1.684e-05 2.44e-05 0.00% Gravity::swapTimeLevels() 5 9.428e-06 1.413e-05 2.127e-05 0.00% Castro::construct_old_hybrid_source() 5 7.048e-06 1.161e-05 1.897e-05 0.00% Amr::initSubcycle() 1 8.582e-06 1.369e-05 1.593e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.306e-06 7.879e-06 1.359e-05 0.00% Castro::construct_new_rotation_source() 5 4.15e-06 8.078e-06 1.179e-05 0.00% Castro::construct_old_rotation_source() 5 3.038e-06 5.133e-06 7.813e-06 0.00% Castro::gwstrain() 5 3.465e-06 5.868e-06 7.73e-06 0.00% Gravity::set_mass_offset() 6 3.468e-06 4.678e-06 6.169e-06 0.00% Castro::retry_advance_ctu() 5 3.47e-06 4.695e-06 5.888e-06 0.00% Castro::FluxRegFineAdd() 5 2.963e-06 4.02e-06 5.755e-06 0.00% AmrLevel::AmrLevel() 1 9.57e-07 1.915e-06 4.301e-06 0.00% DistributionMapping::Distribute() 1 1.887e-06 2.526e-06 3.859e-06 0.00% Amr::init() 1 1.039e-06 1.517e-06 1.862e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.732 1.732 1.732 100.00% Amr::coarseTimeStep() 5 1.637 1.637 1.637 94.48% Amr::timeStep() 5 1.631 1.631 1.631 94.16% Castro::advance() 5 1.594 1.597 1.599 92.32% Castro::subcycle_advance_ctu() 5 1.53 1.54 1.548 89.35% Castro::do_advance_ctu() 5 1.53 1.54 1.548 89.34% Castro::construct_ctu_hydro_source() 5 0.8204 1.059 1.209 69.76% MultiFab::min() 5 0.0002156 0.146 0.387 22.34% FillPatchIterator::Initialize 116 0.103 0.1305 0.1607 9.27% Castro::initialize_do_advance() 5 0.1175 0.1308 0.1502 8.67% FillPatchSingleLevel 116 0.07264 0.1025 0.1409 8.13% FabArray::ParallelCopy() 116 0.05634 0.08043 0.129 7.45% FabArray::ParallelCopy_finish() 116 0.03155 0.05722 0.1063 6.14% Castro::expand_state() 5 0.07982 0.09155 0.1035 5.97% Castro::clean_state() 30 0.06319 0.07658 0.09588 5.53% Castro::do_old_sources() 5 0.02223 0.037 0.07075 4.08% Castro::initialize_advance() 5 0.04586 0.0566 0.06676 3.85% Castro::computeTemp() 30 0.042 0.05028 0.06136 3.54% Castro::do_new_sources() 5 0.03795 0.04691 0.05739 3.31% Amr::writePlotFile() 1 0.05696 0.05696 0.05696 3.29% FabArray::setVal() 80 0.03848 0.04605 0.0543 3.13% Castro::reset_internal_energy() 30 0.02559 0.03113 0.03839 2.22% Castro::post_timestep() 5 0.03182 0.03425 0.03722 2.15% Amr::init() 1 0.03621 0.03633 0.03649 2.11% Amr::restart() 1 0.0362 0.03633 0.03649 2.11% FabArray::ParallelCopy_nowait() 116 0.01751 0.02311 0.03452 1.99% StateDataPhysBCFunct::() 116 0.01122 0.02199 0.03176 1.83% StateData::FillBoundary(geom) 10 0.01114 0.02185 0.03164 1.83% Castro::estTimeStep() 10 0.009702 0.01619 0.02776 1.60% AmrLevel::restart() 1 0.01829 0.0223 0.02497 1.44% StateData::restartDoit() 4 0.01805 0.02162 0.02268 1.31% VisMF::Read() 3 0.0152 0.01789 0.01992 1.15% Castro::construct_new_source() 35 0.01376 0.01684 0.01844 1.06% Castro::volWgtSum() 80 0.01121 0.01525 0.01827 1.05% Castro::derive() 86 0.009304 0.01307 0.01584 0.91% Castro::normalize_species() 30 0.009481 0.01192 0.01562 0.90% Castro::construct_new_gravity_source() 5 0.01212 0.01413 0.01544 0.89% Castro::hybrid_to_linear_momentum() 30 0.008462 0.01143 0.01489 0.86% Castro::finalize_do_advance() 5 0.008602 0.01138 0.01376 0.79% Castro::construct_new_gravity() 5 0.006273 0.009036 0.01265 0.73% Gravity::get_new_grav_vector() 5 0.005985 0.008557 0.01194 0.69% Castro::check_for_nan() 10 0.006619 0.008447 0.01112 0.64% MultiFab::contains_nan() 10 0.006595 0.008414 0.01106 0.64% Castro::apply_source_to_state() 10 0.006177 0.008041 0.009702 0.56% MultiFab::Saxpy() 10 0.006155 0.008012 0.009671 0.56% VisMF::Write(FabArray) 1 0.006365 0.00753 0.009412 0.54% Castro::construct_old_gravity() 5 0.005399 0.006303 0.00764 0.44% Castro::construct_old_source() 35 0.004244 0.005686 0.007584 0.44% Gravity::get_old_grav_vector() 5 0.004979 0.005895 0.007188 0.41% FabArray::setDomainBndry() 116 0.002836 0.005036 0.006449 0.37% Castro::post_restart() 1 0.0003515 0.001662 0.00614 0.35% Castro::construct_old_gravity_source() 5 0.003256 0.004523 0.006084 0.35% Gravity::add_pointmass_to_gravity() 10 0.003999 0.004834 0.00581 0.34% Castro::computeNewDt() 5 0.005303 0.005391 0.005435 0.31% Castro::fill_hybrid_hydro_source() 15 0.002505 0.003697 0.004704 0.27% Castro::swap_state_time_levels() 5 0.004183 0.00443 0.004682 0.27% Castro::enforce_min_density() 30 0.002268 0.002738 0.003716 0.21% Castro::construct_new_hybrid_source() 5 0.001602 0.002625 0.003223 0.19% DistributionMapping::SFCProcessorMapDoIt() 1 1.84e-05 0.0004648 0.002155 0.12% DistributionMapping::LeastUsedCPUs() 1 9.306e-06 0.0004544 0.00214 0.12% Castro::construct_old_hybrid_source() 5 0.0009172 0.001109 0.001533 0.09% Castro::locSquaredSum() 6 0.0007286 0.0008675 0.001022 0.06% Castro::finalize_advance() 5 0.0005411 0.0007312 0.000944 0.05% Amr::InitAmr() 1 0.0002704 0.000408 0.0005477 0.03% FabArrayBase::getCPC() 10 5.797e-05 8.361e-05 0.0001177 0.01% FabArrayBase::CPC::define() 2 3.036e-05 5.66e-05 8.912e-05 0.01% Castro::enforce_speed_limit() 30 2.183e-05 3.72e-05 5.047e-05 0.00% Amr::writeSmallPlotFile() 1 2.836e-05 3.557e-05 4.438e-05 0.00% Castro::create_source_corrector() 5 7.091e-06 1.684e-05 2.44e-05 0.00% Gravity::swapTimeLevels() 5 9.428e-06 1.413e-05 2.127e-05 0.00% Amr::initSubcycle() 1 8.582e-06 1.369e-05 1.593e-05 0.00% Castro::construct_new_rotation_source() 5 4.15e-06 8.078e-06 1.179e-05 0.00% Castro::construct_old_rotation_source() 5 3.038e-06 5.133e-06 7.813e-06 0.00% Castro::gwstrain() 5 3.465e-06 5.868e-06 7.73e-06 0.00% Gravity::set_mass_offset() 6 3.468e-06 4.678e-06 6.169e-06 0.00% Castro::retry_advance_ctu() 5 3.47e-06 4.695e-06 5.888e-06 0.00% Castro::FluxRegFineAdd() 5 2.963e-06 4.02e-06 5.755e-06 0.00% AmrLevel::AmrLevel() 1 9.57e-07 1.915e-06 4.301e-06 0.00% DistributionMapping::Distribute() 1 1.887e-06 2.526e-06 3.859e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.02-14-gaa0dc39f50f7) finalized