MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.03-17-g7b4d10daf9c4) initialized Starting run at 06:45:35 UTC on 2022-03-21. Successfully read inputs file ... Castro git describe: 22.02-13-ga12efaab3 AMReX git describe: 22.03-17-g7b4d10daf Microphysics git describe: 22.03-8-g75721f58 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 4.289006454 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.016953809 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.091719105 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.008824743 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.274606733 Castro::do_new_sources() time = 0.009471138 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7174719817 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.373322118 [STEP 1] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007387771 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.265129812 Castro::do_new_sources() time = 0.009231559 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7592116682 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.358241953 [STEP 2] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006621447 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.261416468 Castro::do_new_sources() time = 0.008257021 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7707910668 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.352249447 [STEP 3] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005176846 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.249891279 Castro::do_new_sources() time = 0.010152298 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7925549682 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.342588249 [STEP 4] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006315406 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.176790395 Castro::do_new_sources() time = 0.010411337 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.04866103 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.259965578 [STEP 5] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.016274258 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00683713 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.170297392 Castro::do_new_sources() time = 0.010355436 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.096509024 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.248001149 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005432691 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.163352194 Castro::do_new_sources() time = 0.005764076 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.202913166 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.22550252 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00425644 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.153644427 Castro::do_new_sources() time = 0.005457757 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.317927051 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.206127128 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004215463 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.153501725 Castro::do_new_sources() time = 0.005562179 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.318148936 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.205675862 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004097069 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.155453626 Castro::do_new_sources() time = 0.005472299 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.303889172 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.207830857 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.01410962 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.126720412 seconds Ending run at 06:45:38 UTC on 2022-03-21. Run time = 3.087056536 Run time without initialization = 2.938461515 Average number of zones advanced per microsecond: 0.892 Average number of zones advanced per microsecond per rank: 0.056 TinyProfiler total time across processes [min...avg...max]: 3.086 ... 3.087 ... 3.087 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.4893 1.8067 2.0467 66.30% MultiFab::min() 10 0.0004682 0.2366 0.5788 18.75% Amr::writePlotFile() 2 0.1996 0.2068 0.2077 6.73% FabArray::ParallelCopy_finish() 251 0.05051 0.09619 0.1582 5.13% FabArray::setVal() 164 0.07135 0.08209 0.09197 2.98% Castro::reset_internal_energy() 63 0.0535 0.06095 0.06898 2.23% Castro::estTimeStep() 21 0.01984 0.04414 0.06556 2.12% Castro::do_old_sources() 10 0.0001822 0.01074 0.06461 2.09% VisMF::Write(FabArray) 11 0.0426 0.0456 0.06028 1.95% StateData::FillBoundary(geom) 20 0.02227 0.0347 0.05437 1.76% FabArray::ParallelCopy_nowait() 251 0.02837 0.04194 0.05253 1.70% FillPatchIterator::Initialize 251 0.0317 0.03791 0.04471 1.45% Castro::post_timestep() 10 0.008084 0.02136 0.04345 1.41% Castro::computeTemp() 63 0.03302 0.03759 0.0428 1.39% Castro::do_new_sources() 10 0.0001348 0.005612 0.0332 1.08% Castro::do_advance_ctu() 10 0.02116 0.02812 0.03244 1.05% Castro::finalize_do_advance() 10 0.002379 0.02334 0.03137 1.02% Castro::expand_state() 10 0.01591 0.02396 0.03084 1.00% Castro::initialize_do_advance() 10 0.01746 0.02631 0.02914 0.94% Castro::normalize_species() 62 0.01966 0.02257 0.02652 0.86% Castro::construct_new_gravity_source() 10 0.01909 0.02259 0.02471 0.80% Castro::hybrid_to_linear_momentum() 62 0.01576 0.01974 0.02389 0.77% Castro::initialize_advance() 10 0.01267 0.01625 0.02041 0.66% Amr::checkPoint() 3 0.00736 0.01521 0.0174 0.56% MultiFab::contains_nan() 20 0.009944 0.01334 0.01723 0.56% MultiFab::Saxpy() 20 0.01131 0.01369 0.01604 0.52% FabArray::setDomainBndry() 251 0.005956 0.009718 0.01397 0.45% Gravity::get_new_grav_vector() 11 0.00667 0.008786 0.0129 0.42% Castro::derive() 187 0.008237 0.009994 0.01235 0.40% Gravity::add_pointmass_to_gravity() 21 0.007466 0.008876 0.01025 0.33% Castro::construct_old_gravity_source() 10 0.005467 0.008023 0.009977 0.32% Amr::defBaseLevel() 1 0.004424 0.00663 0.008398 0.27% Castro::fill_hybrid_hydro_source() 30 0.004848 0.006337 0.007397 0.24% Gravity::get_old_grav_vector() 10 0.004321 0.005596 0.006538 0.21% Castro::volWgtSum() 176 0.005221 0.005607 0.006002 0.19% Castro::enforce_min_density() 62 0.004129 0.004822 0.005682 0.18% StateData::define() 4 0.003397 0.004523 0.005264 0.17% Castro::swap_state_time_levels() 10 0.004046 0.004409 0.004793 0.16% Castro::post_init() 1 0.0007201 0.001732 0.00461 0.15% Castro::initData() 1 0.001695 0.002402 0.002937 0.10% main() 1 0.0007942 0.001067 0.001526 0.05% Castro::subcycle_advance_ctu() 10 5.061e-05 0.0001182 0.0009223 0.03% Castro::locSquaredSum() 11 0.0004064 0.0005102 0.0006384 0.02% Amr::InitAmr() 1 0.0002533 0.0003941 0.0006268 0.02% Amr::coarseTimeStep() 10 0.0002545 0.0003565 0.0004877 0.02% DistributionMapping::LeastUsedCPUs() 1 1.283e-05 0.0002961 0.0004521 0.01% Castro::clean_state() 62 0.0001994 0.0002668 0.0003314 0.01% StateDataPhysBCFunct::() 251 0.0001926 0.0002395 0.0003121 0.01% StateData::checkPoint() 12 2.07e-05 4.675e-05 0.000282 0.01% Castro::linear_to_hybrid_momentum() 1 0.000217 0.0002318 0.0002631 0.01% FillPatchSingleLevel 251 0.0001586 0.0001935 0.0002352 0.01% FabArray::ParallelCopy() 251 0.0001626 0.0001843 0.0002135 0.01% Castro::computeNewDt() 9 7.953e-06 1.965e-05 0.000176 0.01% Castro::finalize_advance() 10 0.0001066 0.0001244 0.0001467 0.00% Castro::construct_new_source() 70 7.49e-05 0.0001141 0.0001429 0.00% Castro::enforce_consistent_e() 1 6.891e-05 9.281e-05 0.000136 0.00% AmrLevel::checkPoint() 3 4.88e-05 7.133e-05 0.0001308 0.00% Castro::construct_old_gravity() 10 5.067e-05 8.044e-05 0.0001168 0.00% Castro::construct_new_gravity() 10 4.166e-05 6.435e-05 0.0001156 0.00% Amr::timeStep() 10 5.568e-05 6.944e-05 0.0001126 0.00% FabArrayBase::CPC::define() 2 3.145e-05 5.58e-05 0.0001114 0.00% Castro::construct_old_source() 70 6.533e-05 8.394e-05 0.0001015 0.00% Castro::advance() 10 4.791e-05 6.113e-05 9.126e-05 0.00% Castro::check_for_nan() 20 3.672e-05 5.473e-05 8.269e-05 0.00% Castro::enforce_speed_limit() 62 4.135e-05 5.155e-05 7.324e-05 0.00% Amr::writeSmallPlotFile() 1 2.536e-05 5.377e-05 7.108e-05 0.00% Castro::apply_source_to_state() 20 4.456e-05 5.863e-05 7.026e-05 0.00% FabArrayBase::getCPC() 20 3.422e-05 4.856e-05 6.42e-05 0.00% Amr::FinalizeInit() 1 4.639e-06 9.088e-06 4.799e-05 0.00% Castro::construct_new_hybrid_source() 10 1.527e-05 2.853e-05 4.06e-05 0.00% Castro::create_source_corrector() 10 1.267e-05 2.229e-05 3.026e-05 0.00% Castro::retry_advance_ctu() 10 6.757e-06 1.068e-05 2.834e-05 0.00% Gravity::swapTimeLevels() 10 1.698e-05 2.129e-05 2.642e-05 0.00% Castro::construct_old_hybrid_source() 10 1.447e-05 1.9e-05 2.625e-05 0.00% Castro::construct_new_rotation_source() 10 9.818e-06 1.302e-05 2.099e-05 0.00% Gravity::set_mass_offset() 10 5.175e-06 8.398e-06 1.99e-05 0.00% Amr::InitializeInit() 1 2.569e-06 4.362e-06 1.805e-05 0.00% Castro::gwstrain() 11 6.771e-06 8.899e-06 1.751e-05 0.00% Amr::initSubcycle() 1 8.117e-06 1.322e-05 1.675e-05 0.00% AmrLevel::AmrLevel(dm) 1 9.743e-06 1.28e-05 1.649e-05 0.00% Castro::FluxRegFineAdd() 10 7.036e-06 9.294e-06 1.192e-05 0.00% Castro::construct_old_rotation_source() 10 6.233e-06 8.501e-06 1.154e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.028e-06 6.805e-06 8.509e-06 0.00% AmrLevel::checkPointPost() 3 4.323e-06 5.186e-06 7.704e-06 0.00% Castro::computeInitialDt() 2 3.557e-06 4.691e-06 6.528e-06 0.00% AmrLevel::checkPointPre() 3 2.681e-06 4.371e-06 5.533e-06 0.00% Castro::post_regrid() 1 2.688e-06 4.09e-06 5.424e-06 0.00% Amr::init() 1 3.161e-06 3.836e-06 4.595e-06 0.00% Amr::initialInit() 1 1.766e-06 2.46e-06 3.265e-06 0.00% DistributionMapping::Distribute() 1 1.472e-06 2.202e-06 3.028e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.086 3.087 3.087 100.00% Amr::coarseTimeStep() 10 2.81 2.81 2.81 91.03% Amr::timeStep() 10 2.769 2.769 2.769 89.71% Castro::advance() 10 2.687 2.709 2.717 88.00% Castro::subcycle_advance_ctu() 10 2.606 2.619 2.631 85.23% Castro::do_advance_ctu() 10 2.605 2.619 2.631 85.22% Castro::construct_ctu_hydro_source() 10 1.489 1.807 2.047 66.30% MultiFab::min() 10 0.0004682 0.2366 0.5788 18.75% FillPatchIterator::Initialize 251 0.1891 0.2212 0.2592 8.40% Castro::initialize_do_advance() 10 0.2005 0.2226 0.2403 7.78% Amr::writePlotFile() 2 0.2187 0.2187 0.2187 7.08% FillPatchSingleLevel 251 0.1444 0.1736 0.2153 6.97% FabArray::ParallelCopy() 251 0.09441 0.1384 0.1926 6.24% Castro::clean_state() 62 0.1253 0.1443 0.1665 5.39% Castro::expand_state() 10 0.1388 0.1521 0.1631 5.28% FabArray::ParallelCopy_finish() 251 0.05051 0.09619 0.1582 5.13% Amr::init() 1 0.1478 0.148 0.1482 4.80% Castro::computeTemp() 63 0.08673 0.09854 0.1118 3.62% Castro::do_old_sources() 10 0.03845 0.0563 0.1087 3.52% Castro::initialize_advance() 10 0.07275 0.0891 0.1033 3.34% Castro::do_new_sources() 10 0.05958 0.07385 0.09801 3.17% FabArray::setVal() 164 0.07135 0.08209 0.09197 2.98% Castro::post_timestep() 10 0.05261 0.06071 0.08181 2.65% Castro::reset_internal_energy() 63 0.0535 0.06095 0.06898 2.23% Castro::estTimeStep() 21 0.01984 0.04414 0.06556 2.12% VisMF::Write(FabArray) 11 0.0426 0.0456 0.06028 1.95% StateDataPhysBCFunct::() 251 0.02247 0.03494 0.05465 1.77% StateData::FillBoundary(geom) 20 0.02227 0.0347 0.05437 1.76% FabArray::ParallelCopy_nowait() 251 0.02848 0.04204 0.05264 1.71% Amr::checkPoint() 3 0.04894 0.04906 0.04908 1.59% AmrLevel::checkPoint() 3 0.03166 0.03384 0.04157 1.35% StateData::checkPoint() 12 0.03161 0.03377 0.04144 1.34% Amr::initialInit() 1 0.03756 0.03773 0.03789 1.23% Castro::finalize_do_advance() 10 0.002379 0.02334 0.03137 1.02% Castro::volWgtSum() 176 0.02165 0.02504 0.02955 0.96% Castro::construct_new_source() 70 0.02221 0.02698 0.02946 0.95% Amr::InitializeInit() 1 0.01704 0.02392 0.02688 0.87% Amr::defBaseLevel() 1 0.01703 0.02392 0.02688 0.87% Castro::normalize_species() 62 0.01966 0.02257 0.02652 0.86% Castro::construct_new_gravity_source() 10 0.01909 0.02259 0.02471 0.80% Castro::derive() 187 0.017 0.02023 0.02438 0.79% Castro::hybrid_to_linear_momentum() 62 0.01576 0.01974 0.02389 0.77% Gravity::get_new_grav_vector() 11 0.01136 0.01489 0.02148 0.70% Castro::construct_new_gravity() 10 0.0109 0.01414 0.02107 0.68% Amr::FinalizeInit() 1 0.01076 0.01381 0.02085 0.68% Castro::check_for_nan() 20 0.009981 0.01339 0.01732 0.56% MultiFab::contains_nan() 20 0.009944 0.01334 0.01723 0.56% Castro::apply_source_to_state() 20 0.01136 0.01374 0.01611 0.52% MultiFab::Saxpy() 20 0.01131 0.01369 0.01604 0.52% FabArray::setDomainBndry() 251 0.005956 0.009718 0.01397 0.45% Castro::construct_old_gravity() 10 0.009205 0.01167 0.01303 0.42% Castro::construct_old_source() 70 0.007394 0.01024 0.01258 0.41% Castro::computeInitialDt() 2 0.00218 0.005226 0.01226 0.40% Gravity::get_old_grav_vector() 10 0.008632 0.01093 0.01222 0.40% Castro::initData() 1 0.007044 0.009358 0.01051 0.34% Gravity::add_pointmass_to_gravity() 21 0.007466 0.008876 0.01025 0.33% Castro::construct_old_gravity_source() 10 0.005467 0.008023 0.009977 0.32% Castro::computeNewDt() 9 0.008778 0.008893 0.00898 0.29% Castro::post_init() 1 0.006982 0.007242 0.007998 0.26% Castro::fill_hybrid_hydro_source() 30 0.004848 0.006337 0.007397 0.24% Castro::enforce_min_density() 62 0.004129 0.004822 0.005682 0.18% AmrLevel::AmrLevel(dm) 1 0.003407 0.004536 0.005276 0.17% StateData::define() 4 0.003397 0.004523 0.005264 0.17% Castro::construct_new_hybrid_source() 10 0.003025 0.004261 0.004967 0.16% Castro::swap_state_time_levels() 10 0.004046 0.004409 0.004793 0.16% Castro::post_regrid() 1 0.00167 0.002427 0.002683 0.09% Castro::construct_old_hybrid_source() 10 0.001845 0.002124 0.002493 0.08% Castro::locSquaredSum() 11 0.001026 0.001301 0.001687 0.05% Amr::InitAmr() 1 0.0002624 0.0004073 0.0006435 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 2.202e-05 0.0003051 0.0004621 0.01% DistributionMapping::LeastUsedCPUs() 1 1.283e-05 0.0002961 0.0004521 0.01% Castro::linear_to_hybrid_momentum() 1 0.000217 0.0002318 0.0002631 0.01% FabArrayBase::getCPC() 20 7.588e-05 0.0001044 0.0001623 0.01% Castro::finalize_advance() 10 0.0001154 0.0001337 0.0001586 0.01% Castro::enforce_consistent_e() 1 6.891e-05 9.281e-05 0.000136 0.00% FabArrayBase::CPC::define() 2 3.145e-05 5.58e-05 0.0001114 0.00% Castro::enforce_speed_limit() 62 4.135e-05 5.155e-05 7.324e-05 0.00% Amr::writeSmallPlotFile() 1 2.536e-05 5.377e-05 7.108e-05 0.00% Castro::create_source_corrector() 10 1.267e-05 2.229e-05 3.026e-05 0.00% Castro::retry_advance_ctu() 10 6.757e-06 1.068e-05 2.834e-05 0.00% Gravity::swapTimeLevels() 10 1.698e-05 2.129e-05 2.642e-05 0.00% Castro::construct_new_rotation_source() 10 9.818e-06 1.302e-05 2.099e-05 0.00% Gravity::set_mass_offset() 10 5.175e-06 8.398e-06 1.99e-05 0.00% Castro::gwstrain() 11 6.771e-06 8.899e-06 1.751e-05 0.00% Amr::initSubcycle() 1 8.117e-06 1.322e-05 1.675e-05 0.00% Castro::FluxRegFineAdd() 10 7.036e-06 9.294e-06 1.192e-05 0.00% Castro::construct_old_rotation_source() 10 6.233e-06 8.501e-06 1.154e-05 0.00% AmrLevel::checkPointPost() 3 4.323e-06 5.186e-06 7.704e-06 0.00% AmrLevel::checkPointPre() 3 2.681e-06 4.371e-06 5.533e-06 0.00% DistributionMapping::Distribute() 1 1.472e-06 2.202e-06 3.028e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.03-17-g7b4d10daf9c4) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.03-17-g7b4d10daf9c4) initialized Starting run at 06:45:39 UTC on 2022-03-21. Successfully read inputs file ... Castro git describe: 22.02-13-ga12efaab3 AMReX git describe: 22.03-17-g7b4d10daf Microphysics git describe: 22.03-8-g75721f58 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 29.61764293 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.037659255 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.008841105 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.279845897 Castro::do_new_sources() time = 0.009514696 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7080778205 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.379213123 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006367339 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.268932721 Castro::do_new_sources() time = 0.008789647 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7461488198 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.361279312 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005760282 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.261263606 Castro::do_new_sources() time = 0.008441312 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7674648155 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.351070461 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005570237 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.213932549 Castro::do_new_sources() time = 0.00898811 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.9008632695 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.297793637 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00723839 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.165993129 Castro::do_new_sources() time = 0.009929222 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.096470273 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.245231748 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.083026452 seconds Ending run at 06:45:40 UTC on 2022-03-21. Run time = 1.758664717 Run time without initialization = 1.720556568 Average number of zones advanced per microsecond: 0.762 Average number of zones advanced per microsecond per rank: 0.048 TinyProfiler total time across processes [min...avg...max]: 1.758 ... 1.759 ... 1.759 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.7174 1.0286 1.1981 68.12% MultiFab::min() 5 0.00021 0.1672 0.4884 27.77% FabArray::ParallelCopy_finish() 116 0.02793 0.05648 0.1266 7.20% Amr::writePlotFile() 1 0.07468 0.07674 0.07725 4.39% FabArray::setVal() 80 0.03457 0.0465 0.05184 2.95% Castro::reset_internal_energy() 30 0.02413 0.03173 0.03947 2.24% Castro::do_old_sources() 5 7.745e-05 0.007606 0.03822 2.17% StateData::FillBoundary(geom) 10 0.007624 0.02303 0.03767 2.14% Castro::estTimeStep() 10 0.009824 0.01903 0.03407 1.94% FabArray::ParallelCopy_nowait() 116 0.01798 0.02374 0.03322 1.89% FillPatchIterator::Initialize 116 0.01762 0.02284 0.02598 1.48% Castro::post_timestep() 5 0.003796 0.01208 0.02407 1.37% Castro::computeTemp() 30 0.01537 0.01951 0.02333 1.33% Castro::do_advance_ctu() 5 0.01111 0.01695 0.0208 1.18% Castro::expand_state() 5 0.00794 0.01472 0.0202 1.15% VisMF::Read() 3 0.01666 0.01866 0.01914 1.09% Castro::finalize_do_advance() 5 0.0081 0.0148 0.01852 1.05% Castro::do_new_sources() 5 7.873e-05 0.003716 0.01754 1.00% Castro::initialize_do_advance() 5 0.0106 0.01434 0.01669 0.95% Castro::construct_new_gravity_source() 5 0.01225 0.01413 0.01567 0.89% Castro::hybrid_to_linear_momentum() 30 0.008077 0.01161 0.01533 0.87% Castro::normalize_species() 30 0.009974 0.01214 0.01474 0.84% Castro::initialize_advance() 5 0.0075 0.01147 0.01429 0.81% Amr::restart() 1 0.01294 0.0133 0.01343 0.76% MultiFab::contains_nan() 10 0.006271 0.008477 0.01124 0.64% MultiFab::Saxpy() 10 0.006552 0.00845 0.01049 0.60% VisMF::Write(FabArray) 1 0.006483 0.006991 0.009051 0.51% Castro::derive() 86 0.004855 0.006321 0.007899 0.45% Castro::construct_old_gravity_source() 5 0.00292 0.005039 0.007131 0.41% FabArray::setDomainBndry() 116 0.002657 0.005128 0.00708 0.40% Gravity::get_new_grav_vector() 5 0.003233 0.004986 0.007079 0.40% Gravity::add_pointmass_to_gravity() 10 0.003933 0.004946 0.005929 0.34% Castro::post_restart() 1 6.954e-05 0.0008268 0.004658 0.26% Castro::swap_state_time_levels() 5 0.004169 0.004416 0.004551 0.26% Castro::fill_hybrid_hydro_source() 15 0.002575 0.003836 0.004539 0.26% StateData::restartDoit() 4 0.002756 0.003798 0.004064 0.23% Gravity::get_old_grav_vector() 5 0.002252 0.003311 0.004036 0.23% Castro::enforce_min_density() 30 0.002132 0.002725 0.003321 0.19% Castro::volWgtSum() 80 0.002466 0.002736 0.003061 0.17% main() 1 0.001599 0.002063 0.0023 0.13% Castro::finalize_advance() 5 0.00079 0.001149 0.001669 0.09% Castro::subcycle_advance_ctu() 5 2.391e-05 7.169e-05 0.0005953 0.03% Amr::InitAmr() 1 0.0002692 0.0004055 0.0004705 0.03% Castro::locSquaredSum() 6 0.0002179 0.0003041 0.0003948 0.02% Amr::coarseTimeStep() 5 0.0001807 0.0002355 0.0003083 0.02% AmrLevel::restart() 1 0.0001421 0.0002373 0.0002672 0.02% Castro::clean_state() 30 0.000104 0.0001641 0.0002509 0.01% Castro::construct_new_source() 35 4.55e-05 8.013e-05 0.0001775 0.01% StateDataPhysBCFunct::() 116 8.778e-05 0.0001233 0.0001553 0.01% FillPatchSingleLevel 116 6.931e-05 0.0001046 0.0001326 0.01% FabArray::ParallelCopy() 116 5.867e-05 8.856e-05 0.0001151 0.01% DistributionMapping::LeastUsedCPUs() 1 8.779e-06 7.196e-05 0.0001099 0.01% Castro::construct_new_gravity() 5 2.08e-05 4.401e-05 9.75e-05 0.01% Castro::computeNewDt() 5 4.291e-06 1.138e-05 9.34e-05 0.01% FabArrayBase::CPC::define() 2 3.772e-05 5.662e-05 8.372e-05 0.00% Castro::construct_old_source() 35 3.239e-05 5.121e-05 6.837e-05 0.00% Castro::construct_old_gravity() 5 3.223e-05 4.631e-05 6.549e-05 0.00% Amr::timeStep() 5 2.813e-05 3.526e-05 5.389e-05 0.00% Castro::check_for_nan() 10 1.836e-05 3.113e-05 5.243e-05 0.00% Castro::enforce_speed_limit() 30 2.83e-05 3.577e-05 4.599e-05 0.00% Castro::construct_new_hybrid_source() 5 9.273e-06 2.566e-05 4.247e-05 0.00% Amr::writeSmallPlotFile() 1 2.619e-05 3.558e-05 4.019e-05 0.00% Castro::advance() 5 2.19e-05 2.859e-05 3.638e-05 0.00% Castro::apply_source_to_state() 10 1.965e-05 2.75e-05 3.621e-05 0.00% FabArrayBase::getCPC() 10 2.233e-05 2.705e-05 3.596e-05 0.00% Gravity::swapTimeLevels() 5 8.4e-06 1.455e-05 2.552e-05 0.00% Castro::create_source_corrector() 5 1.053e-05 1.566e-05 2.268e-05 0.00% Amr::initSubcycle() 1 9.084e-06 1.383e-05 1.629e-05 0.00% Castro::construct_old_hybrid_source() 5 5.785e-06 1.079e-05 1.561e-05 0.00% Castro::construct_new_rotation_source() 5 3.246e-06 7.36e-06 1.334e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 6.225e-06 7.779e-06 1.157e-05 0.00% Castro::construct_old_rotation_source() 5 2.383e-06 5.336e-06 1.049e-05 0.00% Castro::gwstrain() 5 3.036e-06 5.392e-06 8.22e-06 0.00% Castro::retry_advance_ctu() 5 3.884e-06 5.393e-06 7.2e-06 0.00% Gravity::set_mass_offset() 6 3.81e-06 4.961e-06 6.349e-06 0.00% Amr::init() 1 1.085e-06 1.641e-06 5.968e-06 0.00% Castro::FluxRegFineAdd() 5 3.384e-06 4.548e-06 5.793e-06 0.00% DistributionMapping::Distribute() 1 1.765e-06 2.449e-06 2.819e-06 0.00% AmrLevel::AmrLevel() 1 1.259e-06 1.784e-06 2.378e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.758 1.759 1.759 100.00% Amr::coarseTimeStep() 5 1.635 1.635 1.635 92.95% Amr::timeStep() 5 1.629 1.629 1.629 92.64% Castro::advance() 5 1.586 1.593 1.596 90.77% Castro::subcycle_advance_ctu() 5 1.529 1.534 1.546 87.89% Castro::do_advance_ctu() 5 1.529 1.534 1.546 87.89% Castro::construct_ctu_hydro_source() 5 0.7174 1.029 1.198 68.12% MultiFab::min() 5 0.00021 0.1672 0.4884 27.77% FillPatchIterator::Initialize 116 0.1019 0.1316 0.1743 9.91% FillPatchSingleLevel 116 0.07077 0.1037 0.154 8.76% FabArray::ParallelCopy() 116 0.04972 0.0804 0.1462 8.31% Castro::initialize_do_advance() 5 0.1186 0.1295 0.1448 8.23% FabArray::ParallelCopy_finish() 116 0.02793 0.05648 0.1266 7.20% Castro::expand_state() 5 0.08183 0.08993 0.09865 5.61% Castro::clean_state() 30 0.05982 0.07792 0.09497 5.40% Amr::writePlotFile() 1 0.08373 0.08373 0.08373 4.76% Castro::do_old_sources() 5 0.01913 0.03396 0.06747 3.84% Castro::initialize_advance() 5 0.03999 0.05724 0.06611 3.76% Castro::computeTemp() 30 0.0395 0.05124 0.06244 3.55% Castro::do_new_sources() 5 0.03524 0.04474 0.05778 3.29% FabArray::setVal() 80 0.03457 0.0465 0.05184 2.95% Castro::post_timestep() 5 0.03279 0.03646 0.04329 2.46% Castro::reset_internal_energy() 30 0.02413 0.03173 0.03947 2.24% StateDataPhysBCFunct::() 116 0.007731 0.02316 0.0378 2.15% Amr::init() 1 0.03744 0.03752 0.03769 2.14% Amr::restart() 1 0.03744 0.03752 0.03769 2.14% StateData::FillBoundary(geom) 10 0.007624 0.02303 0.03767 2.14% Castro::estTimeStep() 10 0.009824 0.01903 0.03407 1.94% FabArray::ParallelCopy_nowait() 116 0.01805 0.02382 0.0333 1.89% AmrLevel::restart() 1 0.01977 0.02289 0.0235 1.34% StateData::restartDoit() 4 0.01951 0.02257 0.02317 1.32% VisMF::Read() 3 0.01666 0.01866 0.01914 1.09% Castro::finalize_do_advance() 5 0.0081 0.0148 0.01852 1.05% Castro::construct_new_source() 35 0.01398 0.01685 0.01833 1.04% Castro::volWgtSum() 80 0.01154 0.01491 0.01781 1.01% Castro::construct_new_gravity_source() 5 0.01225 0.01413 0.01567 0.89% Castro::derive() 86 0.009666 0.01275 0.01542 0.88% Castro::hybrid_to_linear_momentum() 30 0.008077 0.01161 0.01533 0.87% Castro::normalize_species() 30 0.009974 0.01214 0.01474 0.84% Castro::construct_new_gravity() 5 0.005954 0.008755 0.01237 0.70% Gravity::get_new_grav_vector() 5 0.005622 0.008249 0.01151 0.65% Castro::check_for_nan() 10 0.00629 0.008508 0.01128 0.64% MultiFab::contains_nan() 10 0.006271 0.008477 0.01124 0.64% Castro::apply_source_to_state() 10 0.006577 0.008477 0.01053 0.60% MultiFab::Saxpy() 10 0.006552 0.00845 0.01049 0.60% VisMF::Write(FabArray) 1 0.006483 0.006991 0.009051 0.51% Castro::construct_old_source() 35 0.00389 0.00633 0.008581 0.49% Castro::construct_old_gravity() 5 0.005425 0.006876 0.007947 0.45% Gravity::get_old_grav_vector() 5 0.0051 0.006445 0.007401 0.42% Castro::construct_old_gravity_source() 5 0.00292 0.005039 0.007131 0.41% FabArray::setDomainBndry() 116 0.002657 0.005128 0.00708 0.40% Gravity::add_pointmass_to_gravity() 10 0.003933 0.004946 0.005929 0.34% Castro::computeNewDt() 5 0.005219 0.005301 0.00535 0.30% Castro::post_restart() 1 0.0004215 0.001153 0.004878 0.28% Castro::swap_state_time_levels() 5 0.004169 0.004416 0.004551 0.26% Castro::fill_hybrid_hydro_source() 15 0.002575 0.003836 0.004539 0.26% Castro::enforce_min_density() 30 0.002132 0.002725 0.003321 0.19% Castro::construct_new_hybrid_source() 5 0.001687 0.002638 0.003215 0.18% Castro::finalize_advance() 5 0.0007944 0.001154 0.001675 0.10% Castro::construct_old_hybrid_source() 5 0.0008413 0.001235 0.001634 0.09% Castro::locSquaredSum() 6 0.0007244 0.0008874 0.001009 0.06% Amr::InitAmr() 1 0.0002795 0.0004193 0.0004848 0.03% DistributionMapping::SFCProcessorMapDoIt() 1 1.747e-05 8.219e-05 0.000121 0.01% FabArrayBase::getCPC() 10 6.382e-05 8.367e-05 0.0001147 0.01% DistributionMapping::LeastUsedCPUs() 1 8.779e-06 7.196e-05 0.0001099 0.01% FabArrayBase::CPC::define() 2 3.772e-05 5.662e-05 8.372e-05 0.00% Castro::enforce_speed_limit() 30 2.83e-05 3.577e-05 4.599e-05 0.00% Amr::writeSmallPlotFile() 1 2.619e-05 3.558e-05 4.019e-05 0.00% Gravity::swapTimeLevels() 5 8.4e-06 1.455e-05 2.552e-05 0.00% Castro::create_source_corrector() 5 1.053e-05 1.566e-05 2.268e-05 0.00% Amr::initSubcycle() 1 9.084e-06 1.383e-05 1.629e-05 0.00% Castro::construct_new_rotation_source() 5 3.246e-06 7.36e-06 1.334e-05 0.00% Castro::construct_old_rotation_source() 5 2.383e-06 5.336e-06 1.049e-05 0.00% Castro::gwstrain() 5 3.036e-06 5.392e-06 8.22e-06 0.00% Castro::retry_advance_ctu() 5 3.884e-06 5.393e-06 7.2e-06 0.00% Gravity::set_mass_offset() 6 3.81e-06 4.961e-06 6.349e-06 0.00% Castro::FluxRegFineAdd() 5 3.384e-06 4.548e-06 5.793e-06 0.00% DistributionMapping::Distribute() 1 1.765e-06 2.449e-06 2.819e-06 0.00% AmrLevel::AmrLevel() 1 1.259e-06 1.784e-06 2.378e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.03-17-g7b4d10daf9c4) finalized