MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.01-12-g1404c4a9acc6) initialized Starting run at 07:41:03 UTC on 2022-01-07. Successfully read inputs file ... Castro git describe: 21.12-23-g727e39bb6 AMReX git describe: 22.01-12-g1404c4a9a Microphysics git describe: 22.01-14-geeef682d reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 4.289006454 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.017702471 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.178533804 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.008012533188 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2696042061 Castro::do_new_sources() time = 0.009081840515 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7268585287 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.370170888 [STEP 1] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006903171539 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2638716698 Castro::do_new_sources() time = 0.008717298508 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7591943909 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.359039786 [STEP 2] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006455898285 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2595508099 Castro::do_new_sources() time = 0.008721828461 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7691786335 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.353672006 [STEP 3] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005219459534 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.18466115 Castro::do_new_sources() time = 0.008503675461 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.9910072365 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.275036704 [STEP 4] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005463600159 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1700563431 Castro::do_new_sources() time = 0.01052451134 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.105055692 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.283518041 [STEP 5] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.049787437 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004332065582 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1545243263 Castro::do_new_sources() time = 0.007386684418 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.286646665 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.212928866 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004255533218 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1525685787 Castro::do_new_sources() time = 0.005518913269 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.322696887 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.206493373 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004375696182 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1569070816 Castro::do_new_sources() time = 0.005532026291 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.298445104 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.210118392 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004365682602 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1519863605 Castro::do_new_sources() time = 0.005610227585 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.320236725 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.206781625 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004363775253 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1531562805 Castro::do_new_sources() time = 0.005566120148 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.317957873 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.207087918 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.015621918 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.216505386 seconds Ending run at 07:41:06 UTC on 2022-01-07. Run time = 3.174576283 Run time without initialization = 2.935967207 Average number of zones advanced per microsecond: 0.893 Average number of zones advanced per microsecond per rank: 0.056 TinyProfiler total time across processes [min...avg...max]: 3.174 ... 3.174 ... 3.175 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.5545 1.7675 1.9407 61.13% MultiFab::min() 10 0.000451 0.1623 0.3937 12.40% Amr::writePlotFile() 2 0.375 0.3821 0.3832 12.07% FabArray::ParallelCopy_finish() 251 0.06712 0.08996 0.1325 4.17% Castro::do_old_sources() 10 0.0005381 0.01664 0.0869 2.74% FabArray::setVal() 160 0.07232 0.07915 0.0864 2.72% Castro::post_timestep() 10 0.00767 0.01906 0.07811 2.46% Castro::reset_internal_energy() 63 0.05292 0.05754 0.06609 2.08% VisMF::Write(FabArray) 11 0.04142 0.04854 0.06219 1.96% Amr::checkPoint() 3 0.009598 0.04937 0.05755 1.81% FabArray::ParallelCopy_nowait() 251 0.02802 0.04084 0.0538 1.69% Castro::estTimeStep() 21 0.01792 0.04022 0.05229 1.65% StateData::FillBoundary(geom) 20 0.02426 0.03409 0.05075 1.60% FillPatchIterator::Initialize 251 0.03695 0.04048 0.04585 1.44% Castro::computeTemp() 63 0.03332 0.036 0.04128 1.30% Castro::do_new_sources() 10 0.0004824 0.007485 0.03742 1.18% Castro::do_advance_ctu() 10 0.02111 0.02649 0.03072 0.97% Castro::finalize_do_advance() 10 0.002405 0.02519 0.03042 0.96% Castro::initialize_do_advance() 10 0.01057 0.02549 0.02958 0.93% Castro::normalize_species() 62 0.02045 0.0224 0.02561 0.81% Castro::expand_state() 10 0.01482 0.02206 0.02517 0.79% Castro::construct_new_gravity_source() 10 0.01798 0.0206 0.02396 0.75% Castro::hybrid_to_linear_momentum() 62 0.01513 0.01844 0.02337 0.74% Castro::initialize_advance() 10 0.01227 0.01633 0.01992 0.63% MultiFab::contains_nan() 20 0.009499 0.01164 0.01555 0.49% Castro::derive() 187 0.01067 0.01243 0.01481 0.47% MultiFab::Saxpy() 20 0.01005 0.01242 0.01409 0.44% FabArray::setDomainBndry() 251 0.005676 0.009854 0.01289 0.41% Gravity::get_new_grav_vector() 11 0.006782 0.008552 0.01184 0.37% Gravity::add_pointmass_to_gravity() 21 0.007798 0.008525 0.01002 0.32% Castro::construct_old_gravity_source() 10 0.004695 0.006329 0.009094 0.29% Amr::defBaseLevel() 1 0.00495 0.006907 0.007585 0.24% Castro::volWgtSum() 176 0.006156 0.006453 0.006728 0.21% Castro::fill_hybrid_hydro_source() 30 0.004468 0.005617 0.006277 0.20% Gravity::get_old_grav_vector() 10 0.004113 0.004846 0.005712 0.18% Castro::swap_state_time_levels() 10 0.004183 0.004485 0.005327 0.17% Castro::enforce_min_density() 62 0.003908 0.004578 0.005184 0.16% StateData::define() 4 0.003495 0.004553 0.004916 0.15% Castro::post_init() 1 0.0004084 0.001564 0.004606 0.15% Castro::initData() 1 0.002135 0.002602 0.002796 0.09% FabArray::ParallelCopy() 251 0.002522 0.002594 0.002651 0.08% FillPatchSingleLevel 251 0.002496 0.002543 0.002614 0.08% main() 1 0.001008 0.001362 0.001795 0.06% Castro::clean_state() 62 0.00132 0.001366 0.001489 0.05% Castro::subcycle_advance_ctu() 10 0.0001257 0.0002148 0.001287 0.04% StateDataPhysBCFunct::() 251 0.001017 0.001057 0.001122 0.04% Amr::coarseTimeStep() 10 0.0005183 0.000612 0.0008037 0.03% Castro::locSquaredSum() 11 0.0004556 0.0004991 0.0005644 0.02% Castro::construct_new_source() 70 0.000404 0.0004605 0.0005255 0.02% Castro::construct_old_source() 70 0.0003637 0.0004092 0.0004517 0.01% Amr::InitAmr() 1 0.0001807 0.000248 0.0004303 0.01% StateData::checkPoint() 12 7.975e-05 0.0001053 0.0003426 0.01% Castro::linear_to_hybrid_momentum() 1 0.000238 0.0002751 0.0002955 0.01% DistributionMapping::LeastUsedCPUs() 1 9.917e-06 0.0002061 0.0002932 0.01% Castro::enforce_speed_limit() 62 0.0002177 0.0002334 0.0002543 0.01% Castro::finalize_advance() 10 0.000173 0.0001994 0.0002472 0.01% Castro::advance() 10 0.0001692 0.0001902 0.0002134 0.01% Castro::construct_new_gravity() 10 0.0001183 0.000152 0.0002034 0.01% Castro::apply_source_to_state() 20 0.0001517 0.0001741 0.0001977 0.01% Castro::check_for_nan() 20 0.0001456 0.0001623 0.0001903 0.01% Castro::construct_old_gravity() 10 0.0001435 0.0001736 0.000189 0.01% Amr::timeStep() 10 0.0001335 0.0001466 0.0001863 0.01% Castro::construct_new_hybrid_source() 10 0.000132 0.0001539 0.0001859 0.01% Castro::computeNewDt() 9 5.887e-05 6.8e-05 0.0001832 0.01% Castro::enforce_consistent_e() 1 7.292e-05 0.0001078 0.0001829 0.01% AmrLevel::checkPoint() 3 9.079e-05 0.0001141 0.0001779 0.01% FabArrayBase::getCPC() 20 9.879e-05 0.0001146 0.0001417 0.00% Castro::construct_old_hybrid_source() 10 0.0001022 0.0001114 0.0001228 0.00% FabArrayBase::CPC::define() 2 3.446e-05 6.031e-05 0.000106 0.00% Castro::construct_old_rotation_source() 10 6.275e-05 6.824e-05 8.225e-05 0.00% Castro::construct_new_rotation_source() 10 6.275e-05 6.748e-05 7.104e-05 0.00% Amr::FinalizeInit() 1 1.412e-05 2.04e-05 6.467e-05 0.00% Castro::create_source_corrector() 10 4.25e-05 5.009e-05 6.433e-05 0.00% Gravity::swapTimeLevels() 10 3.312e-05 4.48e-05 5.729e-05 0.00% Castro::FluxRegFineAdd() 10 3.079e-05 3.499e-05 5.154e-05 0.00% Castro::retry_advance_ctu() 10 3.196e-05 3.522e-05 5.042e-05 0.00% Castro::gwstrain() 11 3.467e-05 3.854e-05 4.904e-05 0.00% AmrLevel::AmrLevel(dm) 1 2.167e-05 2.589e-05 4.55e-05 0.00% Gravity::set_mass_offset() 10 3.713e-05 3.76e-05 3.838e-05 0.00% Amr::initialInit() 1 9.792e-06 1.234e-05 3.833e-05 0.00% Amr::writeSmallPlotFile() 1 1.687e-05 2.557e-05 3.442e-05 0.00% Castro::computeInitialDt() 2 1.25e-05 1.438e-05 1.671e-05 0.00% Amr::init() 1 1.296e-05 1.435e-05 1.642e-05 0.00% AmrLevel::checkPointPost() 3 1.192e-05 1.389e-05 1.617e-05 0.00% AmrLevel::checkPointPre() 3 1.021e-05 1.274e-05 1.504e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 1.192e-05 1.365e-05 1.5e-05 0.00% Amr::initSubcycle() 1 7.25e-06 9.336e-06 1.258e-05 0.00% Amr::InitializeInit() 1 6.833e-06 9.734e-06 1.25e-05 0.00% Castro::post_regrid() 1 7.75e-06 8.661e-06 9.958e-06 0.00% DistributionMapping::Distribute() 1 2.917e-06 4.675e-06 5.5e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.174 3.174 3.175 100.00% Amr::coarseTimeStep() 10 2.718 2.718 2.718 85.61% Amr::timeStep() 10 2.641 2.643 2.675 84.28% Castro::advance() 10 2.55 2.573 2.578 81.21% Castro::subcycle_advance_ctu() 10 2.477 2.485 2.494 78.57% Castro::do_advance_ctu() 10 2.476 2.485 2.494 78.57% Castro::construct_ctu_hydro_source() 10 1.554 1.767 1.941 61.13% Amr::writePlotFile() 2 0.3953 0.3953 0.3953 12.45% MultiFab::min() 10 0.000451 0.1623 0.3937 12.40% FillPatchIterator::Initialize 251 0.1831 0.2216 0.2527 7.96% Amr::init() 1 0.238 0.2382 0.2383 7.51% Castro::initialize_do_advance() 10 0.1921 0.2149 0.2374 7.48% FillPatchSingleLevel 251 0.1404 0.1713 0.2016 6.35% FabArray::ParallelCopy() 251 0.1027 0.1336 0.168 5.29% Castro::expand_state() 10 0.1331 0.1474 0.1621 5.11% Castro::clean_state() 62 0.1267 0.1389 0.159 5.01% FabArray::ParallelCopy_finish() 251 0.06712 0.08996 0.1325 4.17% Castro::do_old_sources() 10 0.03598 0.05812 0.1282 4.04% Castro::post_timestep() 10 0.06236 0.06974 0.1254 3.95% Castro::computeTemp() 63 0.08624 0.09354 0.1074 3.38% Castro::initialize_advance() 10 0.07242 0.08707 0.09944 3.13% Castro::do_new_sources() 10 0.05981 0.07179 0.09638 3.04% Amr::checkPoint() 3 0.05207 0.08496 0.08716 2.75% FabArray::setVal() 160 0.07232 0.07915 0.0864 2.72% Castro::reset_internal_energy() 63 0.05292 0.05754 0.06609 2.08% VisMF::Write(FabArray) 11 0.04142 0.04854 0.06219 1.96% FabArray::ParallelCopy_nowait() 251 0.02818 0.04101 0.05402 1.70% Castro::estTimeStep() 21 0.01792 0.04022 0.05229 1.65% StateDataPhysBCFunct::() 251 0.02527 0.03514 0.05185 1.63% StateData::FillBoundary(geom) 20 0.02426 0.03409 0.05075 1.60% AmrLevel::checkPoint() 3 0.02957 0.03556 0.04244 1.34% StateData::checkPoint() 12 0.02947 0.03545 0.04227 1.33% Castro::volWgtSum() 176 0.03428 0.03774 0.04172 1.31% Amr::initialInit() 1 0.03972 0.0398 0.03989 1.26% Castro::derive() 187 0.02965 0.03261 0.03647 1.15% Castro::finalize_do_advance() 10 0.002405 0.02519 0.03042 0.96% Castro::construct_new_source() 70 0.02145 0.02508 0.02899 0.91% Amr::InitializeInit() 1 0.01818 0.02504 0.02746 0.87% Amr::defBaseLevel() 1 0.01817 0.02503 0.02745 0.86% Castro::normalize_species() 62 0.02045 0.0224 0.02561 0.81% Castro::construct_new_gravity_source() 10 0.01798 0.0206 0.02396 0.75% Castro::hybrid_to_linear_momentum() 62 0.01513 0.01844 0.02337 0.74% Amr::FinalizeInit() 1 0.01232 0.01476 0.02169 0.68% Gravity::get_new_grav_vector() 11 0.01217 0.01428 0.01937 0.61% Castro::construct_new_gravity() 10 0.01124 0.01344 0.0188 0.59% Castro::check_for_nan() 20 0.009647 0.0118 0.01574 0.50% MultiFab::contains_nan() 20 0.009499 0.01164 0.01555 0.49% Castro::apply_source_to_state() 20 0.01021 0.01259 0.01428 0.45% MultiFab::Saxpy() 20 0.01005 0.01242 0.01409 0.44% FabArray::setDomainBndry() 251 0.005676 0.009854 0.01289 0.41% Castro::construct_old_gravity() 10 0.009603 0.01069 0.0124 0.39% Castro::construct_old_source() 70 0.006795 0.008733 0.01196 0.38% Castro::computeInitialDt() 2 0.002293 0.004725 0.01166 0.37% Gravity::get_old_grav_vector() 10 0.008839 0.009899 0.01154 0.36% Castro::initData() 1 0.007568 0.01022 0.01122 0.35% Gravity::add_pointmass_to_gravity() 21 0.007798 0.008525 0.01002 0.32% Castro::post_init() 1 0.00843 0.008721 0.009506 0.30% Castro::construct_old_gravity_source() 10 0.004695 0.006329 0.009094 0.29% Castro::computeNewDt() 9 0.007779 0.007948 0.008022 0.25% Castro::fill_hybrid_hydro_source() 30 0.004468 0.005617 0.006277 0.20% Castro::swap_state_time_levels() 10 0.004183 0.004485 0.005327 0.17% Castro::enforce_min_density() 62 0.003908 0.004578 0.005184 0.16% AmrLevel::AmrLevel(dm) 1 0.003517 0.004579 0.004943 0.16% StateData::define() 4 0.003495 0.004553 0.004916 0.15% Castro::construct_new_hybrid_source() 10 0.002979 0.003956 0.004495 0.14% Castro::post_regrid() 1 0.001674 0.002457 0.00275 0.09% Castro::construct_old_hybrid_source() 10 0.001655 0.001927 0.00235 0.07% Castro::locSquaredSum() 11 0.001621 0.001818 0.002059 0.06% Amr::InitAmr() 1 0.0001889 0.0002573 0.0004403 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 2.917e-05 0.0002244 0.0003123 0.01% Castro::finalize_advance() 10 0.0002082 0.0002344 0.0002988 0.01% Castro::linear_to_hybrid_momentum() 1 0.000238 0.0002751 0.0002955 0.01% DistributionMapping::LeastUsedCPUs() 1 9.917e-06 0.0002061 0.0002932 0.01% Castro::enforce_speed_limit() 62 0.0002177 0.0002334 0.0002543 0.01% FabArrayBase::getCPC() 20 0.0001413 0.0001749 0.0002318 0.01% Castro::enforce_consistent_e() 1 7.292e-05 0.0001078 0.0001829 0.01% FabArrayBase::CPC::define() 2 3.446e-05 6.031e-05 0.000106 0.00% Castro::construct_old_rotation_source() 10 6.275e-05 6.824e-05 8.225e-05 0.00% Castro::construct_new_rotation_source() 10 6.275e-05 6.748e-05 7.104e-05 0.00% Castro::create_source_corrector() 10 4.25e-05 5.009e-05 6.433e-05 0.00% Gravity::swapTimeLevels() 10 3.312e-05 4.48e-05 5.729e-05 0.00% Castro::FluxRegFineAdd() 10 3.079e-05 3.499e-05 5.154e-05 0.00% Castro::retry_advance_ctu() 10 3.196e-05 3.522e-05 5.042e-05 0.00% Castro::gwstrain() 11 3.467e-05 3.854e-05 4.904e-05 0.00% Gravity::set_mass_offset() 10 3.713e-05 3.76e-05 3.838e-05 0.00% Amr::writeSmallPlotFile() 1 1.687e-05 2.557e-05 3.442e-05 0.00% AmrLevel::checkPointPost() 3 1.192e-05 1.389e-05 1.617e-05 0.00% AmrLevel::checkPointPre() 3 1.021e-05 1.274e-05 1.504e-05 0.00% Amr::initSubcycle() 1 7.25e-06 9.336e-06 1.258e-05 0.00% DistributionMapping::Distribute() 1 2.917e-06 4.675e-06 5.5e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.01-12-g1404c4a9acc6) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.01-12-g1404c4a9acc6) initialized Starting run at 07:41:07 UTC on 2022-01-07. Successfully read inputs file ... Castro git describe: 21.12-23-g727e39bb6 AMReX git describe: 22.01-12-g1404c4a9a Microphysics git describe: 22.01-14-geeef682d reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 30.34622192 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.037467495 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007532119751 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2670652866 Castro::do_new_sources() time = 0.008997440338 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.733577497 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.367099455 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00678896904 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2610023022 Castro::do_new_sources() time = 0.008570432663 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.771730622 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.35166537 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004849433899 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2510349751 Castro::do_new_sources() time = 0.008547306061 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7918353085 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.339439429 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005812168121 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1745655537 Castro::do_new_sources() time = 0.009421110153 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.08601142 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.248700977 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006523609161 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1704108715 Castro::do_new_sources() time = 0.01439476013 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.073033454 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.252662208 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.164406686 seconds Ending run at 07:41:09 UTC on 2022-01-07. Run time = 1.765767336 Run time without initialization = 1.727964401 Average number of zones advanced per microsecond: 0.759 Average number of zones advanced per microsecond per rank: 0.047 TinyProfiler total time across processes [min...avg...max]: 1.765 ... 1.766 ... 1.766 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.8407 1.0216 1.1438 64.78% MultiFab::min() 5 0.000205 0.1068 0.2933 16.61% Amr::writePlotFile() 1 0.156 0.1582 0.1589 9.00% FabArray::ParallelCopy_finish() 116 0.02272 0.05004 0.07696 4.36% Castro::do_old_sources() 5 0.0002828 0.01106 0.05403 3.06% FabArray::setVal() 76 0.02825 0.0462 0.05342 3.03% StateData::FillBoundary(geom) 10 0.01033 0.02079 0.03584 2.03% Castro::reset_internal_energy() 30 0.02494 0.02967 0.03483 1.97% Castro::estTimeStep() 10 0.009385 0.02055 0.03073 1.74% FabArray::ParallelCopy_nowait() 116 0.01345 0.02326 0.02998 1.70% Castro::do_new_sources() 5 0.0002659 0.006459 0.02955 1.67% FillPatchIterator::Initialize 116 0.01891 0.02371 0.02749 1.56% Castro::do_advance_ctu() 5 0.009597 0.0177 0.02225 1.26% Castro::computeTemp() 30 0.0156 0.01842 0.02128 1.20% VisMF::Read() 3 0.01468 0.01717 0.01922 1.09% Castro::construct_new_gravity_source() 5 0.01199 0.0141 0.01914 1.08% Castro::expand_state() 5 0.007548 0.01393 0.01894 1.07% Castro::post_timestep() 5 0.004183 0.008374 0.01561 0.88% Castro::initialize_do_advance() 5 0.01222 0.01375 0.01496 0.85% Castro::finalize_do_advance() 5 0.007921 0.0131 0.01493 0.85% Amr::restart() 1 0.009346 0.01377 0.01453 0.82% Castro::normalize_species() 30 0.01005 0.01188 0.01428 0.81% Castro::hybrid_to_linear_momentum() 30 0.009755 0.01154 0.01351 0.76% Castro::initialize_advance() 5 0.002977 0.01092 0.01332 0.75% MultiFab::contains_nan() 10 0.006225 0.008199 0.01176 0.67% MultiFab::Saxpy() 10 0.006562 0.00802 0.01 0.57% VisMF::Write(FabArray) 1 0.006916 0.007618 0.009813 0.56% FabArray::setDomainBndry() 116 0.002655 0.005628 0.008372 0.47% Gravity::get_new_grav_vector() 5 0.002724 0.005332 0.007995 0.45% Castro::derive() 86 0.004402 0.005795 0.006937 0.39% Castro::post_restart() 1 8.375e-05 0.00131 0.005826 0.33% Gravity::add_pointmass_to_gravity() 10 0.004097 0.004775 0.005492 0.31% Castro::construct_old_gravity_source() 5 0.002834 0.0043 0.005368 0.30% Castro::swap_state_time_levels() 5 0.004255 0.004475 0.004894 0.28% StateData::restartDoit() 4 0.002932 0.00396 0.004339 0.25% Castro::fill_hybrid_hydro_source() 15 0.002585 0.003565 0.004334 0.25% Gravity::get_old_grav_vector() 5 0.002193 0.003443 0.004287 0.24% DistributionMapping::LeastUsedCPUs() 1 9.208e-06 0.0004236 0.003696 0.21% Castro::volWgtSum() 80 0.002796 0.003088 0.003233 0.18% Castro::enforce_min_density() 30 0.002152 0.00265 0.003165 0.18% main() 1 0.001938 0.002345 0.002518 0.14% Castro::finalize_advance() 5 0.001088 0.001178 0.001299 0.07% FabArray::ParallelCopy() 116 0.001164 0.001205 0.001252 0.07% FillPatchSingleLevel 116 0.001145 0.001197 0.001219 0.07% Castro::clean_state() 30 0.0006565 0.0007173 0.0008002 0.05% StateDataPhysBCFunct::() 116 0.0004967 0.0005236 0.0006449 0.04% Amr::coarseTimeStep() 5 0.0003064 0.0003564 0.0004655 0.03% Castro::subcycle_advance_ctu() 5 7.238e-05 0.0001022 0.000425 0.02% Castro::locSquaredSum() 6 0.0002402 0.0002849 0.0003615 0.02% Castro::construct_new_source() 35 0.000204 0.0002576 0.0002878 0.02% Amr::InitAmr() 1 0.0001759 0.0002405 0.000273 0.02% Castro::construct_old_source() 35 0.0002025 0.0002221 0.0002613 0.01% AmrLevel::restart() 1 0.0001379 0.0002254 0.000259 0.01% Castro::construct_new_gravity() 5 6.058e-05 9.361e-05 0.0001644 0.01% Castro::construct_old_gravity() 5 7.775e-05 0.0001076 0.0001448 0.01% Castro::enforce_speed_limit() 30 0.0001113 0.0001248 0.0001383 0.01% Castro::advance() 5 9.142e-05 0.0001001 0.0001229 0.01% Castro::check_for_nan() 10 7.446e-05 9.251e-05 0.0001228 0.01% Castro::construct_new_hybrid_source() 5 6.592e-05 9.348e-05 0.0001178 0.01% Castro::apply_source_to_state() 10 7.958e-05 9.165e-05 0.0001108 0.01% FabArrayBase::CPC::define() 2 3.433e-05 5.887e-05 0.0001031 0.01% Castro::computeNewDt() 5 2.946e-05 3.6e-05 0.0001002 0.01% Amr::timeStep() 5 6.562e-05 7.957e-05 9.75e-05 0.01% FabArrayBase::getCPC() 10 5.588e-05 6.487e-05 8.562e-05 0.00% Castro::construct_old_hybrid_source() 5 5.179e-05 6.164e-05 8.512e-05 0.00% Amr::writeSmallPlotFile() 1 1.825e-05 2.458e-05 7.95e-05 0.00% Castro::create_source_corrector() 5 2.296e-05 3.308e-05 5.729e-05 0.00% Castro::construct_new_rotation_source() 5 3.262e-05 3.527e-05 4.029e-05 0.00% Castro::construct_old_rotation_source() 5 3.204e-05 3.504e-05 3.925e-05 0.00% Gravity::swapTimeLevels() 5 2.012e-05 2.58e-05 3.217e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 1.263e-05 1.478e-05 2.671e-05 0.00% Gravity::set_mass_offset() 6 1.825e-05 1.999e-05 2.233e-05 0.00% Castro::gwstrain() 5 1.471e-05 1.703e-05 2.046e-05 0.00% Castro::retry_advance_ctu() 5 1.425e-05 1.696e-05 1.871e-05 0.00% Castro::FluxRegFineAdd() 5 1.529e-05 1.697e-05 1.842e-05 0.00% Amr::initSubcycle() 1 5.916e-06 8.813e-06 1.158e-05 0.00% DistributionMapping::Distribute() 1 4.25e-06 5.722e-06 9.5e-06 0.00% Amr::init() 1 5.25e-06 6.242e-06 7e-06 0.00% AmrLevel::AmrLevel() 1 2.667e-06 4.557e-06 6.584e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.765 1.766 1.766 100.00% Amr::coarseTimeStep() 5 1.56 1.56 1.56 88.33% Amr::timeStep() 5 1.555 1.555 1.555 88.04% Castro::advance() 5 1.514 1.519 1.521 86.13% Castro::subcycle_advance_ctu() 5 1.454 1.462 1.481 83.88% Castro::do_advance_ctu() 5 1.453 1.462 1.481 83.85% Castro::construct_ctu_hydro_source() 5 0.8407 1.022 1.144 64.78% MultiFab::min() 5 0.000205 0.1068 0.2933 16.61% Amr::writePlotFile() 1 0.1658 0.1658 0.1658 9.39% FillPatchIterator::Initialize 116 0.1143 0.1265 0.1523 8.63% Castro::initialize_do_advance() 5 0.1161 0.1249 0.1315 7.45% FillPatchSingleLevel 116 0.08078 0.09715 0.1228 6.96% FabArray::ParallelCopy() 116 0.04663 0.07464 0.1055 5.97% Castro::expand_state() 5 0.07962 0.08777 0.09469 5.36% Castro::clean_state() 30 0.06443 0.07499 0.08745 4.95% Castro::do_old_sources() 5 0.01956 0.03641 0.07792 4.41% FabArray::ParallelCopy_finish() 116 0.02272 0.05004 0.07696 4.36% Castro::initialize_advance() 5 0.03136 0.05575 0.06526 3.70% Castro::do_new_sources() 5 0.03908 0.0471 0.06418 3.63% Castro::computeTemp() 30 0.04055 0.04809 0.0561 3.18% FabArray::setVal() 76 0.02825 0.0462 0.05342 3.03% Castro::post_timestep() 5 0.03366 0.03546 0.04059 2.30% Amr::init() 1 0.03739 0.03742 0.03751 2.12% Amr::restart() 1 0.03738 0.03741 0.0375 2.12% StateDataPhysBCFunct::() 116 0.01082 0.02131 0.03637 2.06% StateData::FillBoundary(geom) 10 0.01033 0.02079 0.03584 2.03% Castro::reset_internal_energy() 30 0.02494 0.02967 0.03483 1.97% Castro::estTimeStep() 10 0.009385 0.02055 0.03073 1.74% FabArray::ParallelCopy_nowait() 116 0.01355 0.02339 0.03015 1.71% AmrLevel::restart() 1 0.01789 0.0219 0.02613 1.48% StateData::restartDoit() 4 0.01768 0.02123 0.02222 1.26% Castro::construct_new_source() 35 0.01413 0.01695 0.02127 1.20% Castro::volWgtSum() 80 0.01498 0.01754 0.01943 1.10% VisMF::Read() 3 0.01468 0.01717 0.01922 1.09% Castro::construct_new_gravity_source() 5 0.01199 0.0141 0.01914 1.08% Castro::derive() 86 0.01283 0.01543 0.01729 0.98% Castro::finalize_do_advance() 5 0.007921 0.0131 0.01493 0.85% Castro::normalize_species() 30 0.01005 0.01188 0.01428 0.81% Castro::hybrid_to_linear_momentum() 30 0.009755 0.01154 0.01351 0.76% Castro::construct_new_gravity() 5 0.005622 0.009122 0.0132 0.75% Gravity::get_new_grav_vector() 5 0.005157 0.008531 0.01231 0.70% Castro::check_for_nan() 10 0.00631 0.008291 0.01188 0.67% MultiFab::contains_nan() 10 0.006225 0.008199 0.01176 0.67% Castro::apply_source_to_state() 10 0.006647 0.008111 0.01009 0.57% MultiFab::Saxpy() 10 0.006562 0.00802 0.01 0.57% VisMF::Write(FabArray) 1 0.006916 0.007618 0.009813 0.56% FabArray::setDomainBndry() 116 0.002655 0.005628 0.008372 0.47% Castro::construct_old_gravity() 5 0.004849 0.007008 0.008359 0.47% Gravity::get_old_grav_vector() 5 0.004389 0.006479 0.00775 0.44% Castro::construct_old_source() 35 0.004091 0.005718 0.007043 0.40% Castro::post_restart() 1 0.0005302 0.00174 0.006223 0.35% Gravity::add_pointmass_to_gravity() 10 0.004097 0.004775 0.005492 0.31% Castro::construct_old_gravity_source() 5 0.002834 0.0043 0.005368 0.30% Castro::computeNewDt() 5 0.004712 0.004836 0.004898 0.28% Castro::swap_state_time_levels() 5 0.004255 0.004475 0.004894 0.28% Castro::fill_hybrid_hydro_source() 15 0.002585 0.003565 0.004334 0.25% DistributionMapping::SFCProcessorMapDoIt() 1 3.238e-05 0.0004441 0.00373 0.21% DistributionMapping::LeastUsedCPUs() 1 9.208e-06 0.0004236 0.003696 0.21% Castro::enforce_min_density() 30 0.002152 0.00265 0.003165 0.18% Castro::construct_new_hybrid_source() 5 0.001684 0.002559 0.003102 0.18% Castro::locSquaredSum() 6 0.001101 0.001267 0.001552 0.09% Castro::construct_old_hybrid_source() 5 0.000871 0.001161 0.001413 0.08% Castro::finalize_advance() 5 0.001105 0.001195 0.001316 0.07% Amr::InitAmr() 1 0.0001837 0.0002493 0.000279 0.02% FabArrayBase::getCPC() 10 9.671e-05 0.0001237 0.000174 0.01% Castro::enforce_speed_limit() 30 0.0001113 0.0001248 0.0001383 0.01% FabArrayBase::CPC::define() 2 3.433e-05 5.887e-05 0.0001031 0.01% Amr::writeSmallPlotFile() 1 1.825e-05 2.458e-05 7.95e-05 0.00% Castro::create_source_corrector() 5 2.296e-05 3.308e-05 5.729e-05 0.00% Castro::construct_new_rotation_source() 5 3.262e-05 3.527e-05 4.029e-05 0.00% Castro::construct_old_rotation_source() 5 3.204e-05 3.504e-05 3.925e-05 0.00% Gravity::swapTimeLevels() 5 2.012e-05 2.58e-05 3.217e-05 0.00% Gravity::set_mass_offset() 6 1.825e-05 1.999e-05 2.233e-05 0.00% Castro::gwstrain() 5 1.471e-05 1.703e-05 2.046e-05 0.00% Castro::retry_advance_ctu() 5 1.425e-05 1.696e-05 1.871e-05 0.00% Castro::FluxRegFineAdd() 5 1.529e-05 1.697e-05 1.842e-05 0.00% Amr::initSubcycle() 1 5.916e-06 8.813e-06 1.158e-05 0.00% DistributionMapping::Distribute() 1 4.25e-06 5.722e-06 9.5e-06 0.00% AmrLevel::AmrLevel() 1 2.667e-06 4.557e-06 6.584e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.01-12-g1404c4a9acc6) finalized