MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.05-3-gdf9b6944a6d5) initialized Starting run at 17:13:26 UTC on 2022-05-03. Successfully read inputs file ... Castro git describe: 22.05-12-gee604e355 AMReX git describe: 22.05-3-gdf9b6944a Microphysics git describe: 22.05 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 68.62410327 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.017188955 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.082312678 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764 [1m[32m Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007157951 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.274760474 Castro::do_new_sources() time = 0.009282687 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.7196682149 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.371645052 [STEP 1] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552 [1m[32m Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007356961 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.27341049 Castro::do_new_sources() time = 0.008842216 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.7434323319 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.364601092 [STEP 2] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043 [1m[32m Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006416502 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.263487105 Castro::do_new_sources() time = 0.008118545 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.7682485622 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.352171135 [STEP 3] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951 [1m[32m Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005339589 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.218638307 Castro::do_new_sources() time = 0.009073955 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.8968379804 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.301034616 [STEP 4] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549 [1m[32m Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005973036 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.204160076 Castro::do_new_sources() time = 0.008695933 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.9843685604 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.274227784 [STEP 5] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.015940832 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576 [1m[32m Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007776143 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.196716136 Castro::do_new_sources() time = 0.009049606 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.9811960469 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.273976361 [STEP 6] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405 [1m[32m Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003529193 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.15946753 Castro::do_new_sources() time = 0.005781972 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.270690203 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.213544663 [STEP 7] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575 [1m[32m Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003876857 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.161346588 Castro::do_new_sources() time = 0.005713418 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.282418542 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.211348004 [STEP 8] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004 [1m[32m Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004069423 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.159330556 Castro::do_new_sources() time = 0.005068168 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.293150769 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.209564667 [STEP 9] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254 [1m[32m Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004017483 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.159458438 Castro::do_new_sources() time = 0.005101168 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.291726002 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.209849848 [STEP 10] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.014488759 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.190657601 seconds Ending run at 17:13:30 UTC on 2022-05-03. Run time = 3.14549331 Run time without initialization = 3.004867061 Average number of zones advanced per microsecond: 0.872 Average number of zones advanced per microsecond per rank: 0.055 TinyProfiler total time across processes [min...avg...max]: 3.145 ... 3.145 ... 3.146 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.6442 1.8789 2.0896 66.43% Castro::do_advance_ctu() 10 0.03224 0.2367 0.4762 15.14% Amr::writePlotFile() 2 0.2535 0.2606 0.2626 8.35% FabArray::ParallelCopy_finish() 119 0.05274 0.0867 0.117 3.72% FabArray::setVal() 164 0.05912 0.0798 0.08793 2.80% Castro::do_old_sources() 10 0.0001425 0.01426 0.07521 2.39% Castro::reset_internal_energy(Fab) 504 0.0521 0.05834 0.06618 2.10% VisMF::Write(FabArray) 11 0.04016 0.04727 0.06038 1.92% FabArray::ParallelCopy_nowait() 119 0.02943 0.03794 0.05206 1.66% Castro::estTimeStep() 21 0.01923 0.03301 0.05112 1.63% StateData::FillBoundary(geom) 20 0.01595 0.03213 0.0459 1.46% FillPatchIterator::Initialize 119 0.0291 0.03623 0.04168 1.32% Castro::computeTemp() 63 0.0332 0.0366 0.04091 1.30% Castro::do_new_sources() 10 0.000133 0.007061 0.03772 1.20% Castro::normalize_species() 62 0.02371 0.02727 0.03159 1.00% Castro::post_timestep() 10 0.004269 0.01143 0.03086 0.98% Castro::finalize_do_advance() 10 0.001968 0.02325 0.0289 0.92% Castro::initialize_do_advance() 10 0.01593 0.02482 0.02782 0.88% Castro::expand_state() 10 0.01408 0.02239 0.02781 0.88% Castro::construct_new_gravity_source() 10 0.01684 0.02085 0.0229 0.73% Castro::hybrid_to_linear_momentum() 62 0.01363 0.0187 0.02224 0.71% Castro::initialize_advance() 10 0.004966 0.01633 0.0209 0.66% Amr::checkPoint() 3 0.008342 0.01475 0.01991 0.63% MultiFab::contains_nan() 20 0.009067 0.01196 0.01547 0.49% MultiFab::Saxpy() 20 0.009651 0.0133 0.01517 0.48% FabArray::setDomainBndry() 119 0.004801 0.009289 0.01359 0.43% Gravity::get_new_grav_vector() 11 0.005076 0.008643 0.01123 0.36% Gravity::add_pointmass_to_gravity() 21 0.007281 0.008704 0.01008 0.32% Castro::sum_integrated_quantities() 11 0.002991 0.005738 0.009962 0.32% Castro::construct_old_gravity_source() 10 0.004683 0.007376 0.009615 0.31% Castro::derive() 55 0.005122 0.007377 0.009217 0.29% Castro::volWgtSum() 176 0.006463 0.0072 0.007889 0.25% Castro::fill_hybrid_hydro_source() 30 0.004451 0.005949 0.006899 0.22% Castro::initMFs() 1 0.003482 0.005375 0.006879 0.22% Gravity::get_old_grav_vector() 10 0.003487 0.00544 0.005986 0.19% StateData::define() 4 0.003329 0.004582 0.005297 0.17% Castro::enforce_min_density() 62 0.003542 0.004517 0.005249 0.17% Castro::swap_state_time_levels() 10 0.001734 0.004281 0.004864 0.15% Castro::initData() 1 0.001706 0.002401 0.002962 0.09% Castro::post_init() 1 4.629e-05 0.001012 0.002717 0.09% main() 1 0.000684 0.001017 0.001452 0.05% Castro::buildMetrics() 1 0.0008182 0.001104 0.00128 0.04% Castro::subcycle_advance_ctu() 10 4.847e-05 0.0001298 0.001107 0.04% Amr::InitAmr() 1 0.0002479 0.0004087 0.0006146 0.02% Castro::locSquaredSum() 11 0.0004091 0.0004732 0.0005536 0.02% Amr::coarseTimeStep() 10 0.0002892 0.0003621 0.0005214 0.02% DistributionMapping::LeastUsedCPUs() 1 1.129e-05 0.0002555 0.0004623 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002987 0.0003468 0.0004469 0.01% Castro::Castro() 1 6.831e-05 0.0001547 0.000354 0.01% Castro::clean_state() 62 0.0002335 0.0002911 0.0003361 0.01% StateData::checkPoint() 12 1.836e-05 4.39e-05 0.000303 0.01% StateDataPhysBCFunct::() 119 0.0001541 0.0002158 0.0002817 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002156 0.000235 0.0002667 0.01% Castro::computeNewDt() 9 9.405e-06 2.801e-05 0.0002134 0.01% FillPatchSingleLevel 119 9.053e-05 0.0001249 0.0001644 0.01% Castro::enforce_consistent_e() 1 6.381e-05 8.97e-05 0.0001643 0.01% Amr::timeStep() 10 5.242e-05 6.564e-05 0.0001532 0.00% FabArray::ParallelCopy() 119 9.825e-05 0.0001223 0.0001473 0.00% Castro::finalize_advance() 10 9.505e-05 0.0001201 0.0001443 0.00% Castro::construct_new_source() 70 8.926e-05 0.0001206 0.0001424 0.00% AmrLevel::checkPoint() 3 4.695e-05 6.664e-05 0.0001404 0.00% Castro::construct_old_gravity() 10 5.254e-05 7.982e-05 0.0001237 0.00% Castro::construct_old_source() 70 6.046e-05 8.678e-05 0.0001211 0.00% Castro::construct_new_gravity() 10 4.065e-05 5.987e-05 0.0001109 0.00% FabArrayBase::CPC::define() 2 3.045e-05 5.052e-05 8.442e-05 0.00% Castro::advance() 10 4.549e-05 5.42e-05 8.252e-05 0.00% Amr::writeSmallPlotFile() 1 2.656e-05 5.354e-05 7.741e-05 0.00% Castro::apply_source_to_state() 20 4.546e-05 5.549e-05 7.194e-05 0.00% FabArrayBase::getCPC() 20 3.952e-05 4.765e-05 6.081e-05 0.00% Castro::check_for_nan() 20 2.896e-05 4.053e-05 5.708e-05 0.00% Amr::defBaseLevel() 1 2.987e-05 4.07e-05 5.66e-05 0.00% Castro::enforce_speed_limit() 62 3.517e-05 4.663e-05 5.599e-05 0.00% Amr::FinalizeInit() 1 4.812e-06 9.132e-06 4.694e-05 0.00% Gravity::swapTimeLevels() 10 1.517e-05 2.456e-05 4.309e-05 0.00% Castro::construct_new_hybrid_source() 10 1.54e-05 3.089e-05 4.096e-05 0.00% Castro::create_source_corrector() 10 1.133e-05 1.743e-05 2.678e-05 0.00% Castro::construct_old_hybrid_source() 10 1.284e-05 1.875e-05 2.564e-05 0.00% Castro::construct_new_rotation_source() 10 8.505e-06 1.38e-05 2.45e-05 0.00% AmrLevel::AmrLevel(dm) 1 7.47e-06 1.246e-05 1.814e-05 0.00% Castro::gwstrain() 11 9.021e-06 1.131e-05 1.797e-05 0.00% Amr::initSubcycle() 1 8.064e-06 1.385e-05 1.712e-05 0.00% Castro::construct_old_rotation_source() 10 5.523e-06 8.473e-06 1.392e-05 0.00% Gravity::set_mass_offset() 10 6.268e-06 9.908e-06 1.344e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.89e-06 6.505e-06 1.149e-05 0.00% Castro::FluxRegCrseInit 10 7.258e-06 9.603e-06 1.119e-05 0.00% Castro::retry_advance_ctu() 10 6.015e-06 9.539e-06 1.081e-05 0.00% Amr::initialInit() 1 1.894e-06 3.295e-06 9.469e-06 0.00% Amr::InitializeInit() 1 2.74e-06 3.796e-06 9.267e-06 0.00% AmrLevel::checkPointPost() 3 4.482e-06 6.104e-06 7.196e-06 0.00% Castro::computeInitialDt() 2 3.732e-06 4.694e-06 6.627e-06 0.00% AmrLevel::checkPointPre() 3 2.434e-06 4.095e-06 5.839e-06 0.00% Castro::FluxRegFineAdd() 10 3.926e-06 4.291e-06 4.722e-06 0.00% Amr::init() 1 2.724e-06 3.463e-06 4.559e-06 0.00% Castro::post_regrid() 1 2.581e-06 3.56e-06 4.211e-06 0.00% DistributionMapping::Distribute() 1 1.451e-06 2.12e-06 2.564e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.145 3.145 3.146 100.00% Amr::coarseTimeStep() 10 2.813 2.813 2.813 89.42% Amr::timeStep() 10 2.773 2.773 2.773 88.15% Castro::advance() 10 2.7 2.722 2.728 86.71% Castro::subcycle_advance_ctu() 10 2.602 2.634 2.661 84.58% Castro::do_advance_ctu() 10 2.6 2.634 2.661 84.58% Castro::construct_ctu_hydro_source() 10 1.644 1.879 2.09 66.43% Amr::writePlotFile() 2 0.2732 0.2732 0.2732 8.69% FillPatchIterator::Initialize 119 0.1821 0.2029 0.236 7.50% Castro::initialize_do_advance() 10 0.194 0.2135 0.2278 7.24% FillPatchSingleLevel 119 0.1326 0.1573 0.1907 6.06% Castro::clean_state() 62 0.1268 0.1444 0.1651 5.25% FabArray::ParallelCopy() 119 0.08702 0.1249 0.1626 5.17% Castro::expand_state() 10 0.1279 0.1443 0.1601 5.09% Amr::init() 1 0.1398 0.1401 0.1403 4.46% FabArray::ParallelCopy_finish() 119 0.05274 0.0867 0.117 3.72% Castro::do_old_sources() 10 0.03792 0.05804 0.111 3.53% Castro::computeTemp() 63 0.0863 0.09529 0.1075 3.42% Castro::initialize_advance() 10 0.05751 0.08759 0.09874 3.14% Castro::do_new_sources() 10 0.06502 0.07324 0.09034 2.87% FabArray::setVal() 164 0.05912 0.0798 0.08793 2.80% Castro::post_timestep() 10 0.04525 0.05095 0.07235 2.30% Castro::reset_internal_energy(MultiFab) 63 0.0524 0.05868 0.06662 2.12% Castro::reset_internal_energy(Fab) 504 0.0521 0.05834 0.06618 2.10% VisMF::Write(FabArray) 11 0.04016 0.04727 0.06038 1.92% FabArray::ParallelCopy_nowait() 119 0.02955 0.03804 0.05215 1.66% Castro::estTimeStep() 21 0.01923 0.03301 0.05112 1.63% Amr::checkPoint() 3 0.04944 0.04955 0.04956 1.58% StateDataPhysBCFunct::() 119 0.01611 0.03235 0.04613 1.47% StateData::FillBoundary(geom) 20 0.01595 0.03213 0.0459 1.46% AmrLevel::checkPoint() 3 0.02962 0.03478 0.04108 1.31% StateData::checkPoint() 12 0.02957 0.03472 0.04094 1.30% Amr::initialInit() 1 0.03855 0.03871 0.03891 1.24% Castro::normalize_species() 62 0.02371 0.02727 0.03159 1.00% Castro::finalize_do_advance() 10 0.001968 0.02325 0.0289 0.92% Amr::InitializeInit() 1 0.01739 0.02415 0.02755 0.88% Amr::defBaseLevel() 1 0.01739 0.02415 0.02754 0.88% Castro::construct_new_source() 70 0.01988 0.02505 0.02741 0.87% Castro::sum_integrated_quantities() 11 0.02603 0.02605 0.02609 0.83% Castro::construct_new_gravity_source() 10 0.01684 0.02085 0.0229 0.73% Castro::hybrid_to_linear_momentum() 62 0.01363 0.0187 0.02224 0.71% Amr::FinalizeInit() 1 0.01108 0.01455 0.02151 0.68% Gravity::get_new_grav_vector() 11 0.009364 0.01449 0.0187 0.59% Castro::construct_new_gravity() 10 0.00994 0.01378 0.01799 0.57% Castro::derive() 55 0.009477 0.01382 0.01638 0.52% Castro::check_for_nan() 20 0.009097 0.012 0.01552 0.49% MultiFab::contains_nan() 20 0.009067 0.01196 0.01547 0.49% Castro::apply_source_to_state() 20 0.009701 0.01336 0.01523 0.48% MultiFab::Saxpy() 20 0.009651 0.0133 0.01517 0.48% FabArray::setDomainBndry() 119 0.004801 0.009289 0.01359 0.43% Castro::computeInitialDt() 2 0.002401 0.005865 0.01282 0.41% Castro::construct_old_gravity() 10 0.008297 0.01138 0.0125 0.40% Castro::Castro() 1 0.00612 0.009772 0.01226 0.39% Castro::construct_old_source() 70 0.006327 0.009407 0.01199 0.38% Gravity::get_old_grav_vector() 10 0.007742 0.01067 0.01177 0.37% Castro::initData() 1 0.007355 0.009478 0.01078 0.34% Gravity::add_pointmass_to_gravity() 21 0.007281 0.008704 0.01008 0.32% Castro::construct_old_gravity_source() 10 0.004683 0.007376 0.009615 0.31% Castro::post_init() 1 0.006596 0.007208 0.008088 0.26% Castro::volWgtSum() 176 0.006463 0.0072 0.007889 0.25% Castro::computeNewDt() 9 0.007659 0.007803 0.007871 0.25% Castro::fill_hybrid_hydro_source() 30 0.004451 0.005949 0.006899 0.22% Castro::initMFs() 1 0.003482 0.005375 0.006879 0.22% AmrLevel::AmrLevel(dm) 1 0.003341 0.004595 0.005315 0.17% StateData::define() 4 0.003329 0.004582 0.005297 0.17% Castro::enforce_min_density() 62 0.003542 0.004517 0.005249 0.17% Castro::swap_state_time_levels() 10 0.001734 0.004281 0.004864 0.15% Castro::construct_new_hybrid_source() 10 0.002896 0.004063 0.00469 0.15% Castro::post_regrid() 1 0.001698 0.002579 0.003188 0.10% Castro::construct_old_hybrid_source() 10 0.001562 0.001935 0.002273 0.07% Castro::buildMetrics() 1 0.0008993 0.001234 0.001452 0.05% Castro::locSquaredSum() 11 0.001003 0.001187 0.001354 0.04% Amr::InitAmr() 1 0.0002569 0.0004226 0.0006314 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 2.014e-05 0.0002642 0.0004706 0.01% DistributionMapping::LeastUsedCPUs() 1 1.129e-05 0.0002555 0.0004623 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002156 0.000235 0.0002667 0.01% Castro::enforce_consistent_e() 1 6.381e-05 8.97e-05 0.0001643 0.01% Castro::finalize_advance() 10 0.0001082 0.000134 0.0001573 0.01% FabArrayBase::getCPC() 20 7.801e-05 9.817e-05 0.0001295 0.00% FabArrayBase::CPC::define() 2 3.045e-05 5.052e-05 8.442e-05 0.00% Amr::writeSmallPlotFile() 1 2.656e-05 5.354e-05 7.741e-05 0.00% Castro::enforce_speed_limit() 62 3.517e-05 4.663e-05 5.599e-05 0.00% Gravity::swapTimeLevels() 10 1.517e-05 2.456e-05 4.309e-05 0.00% Castro::create_source_corrector() 10 1.133e-05 1.743e-05 2.678e-05 0.00% Castro::construct_new_rotation_source() 10 8.505e-06 1.38e-05 2.45e-05 0.00% Castro::gwstrain() 11 9.021e-06 1.131e-05 1.797e-05 0.00% Amr::initSubcycle() 1 8.064e-06 1.385e-05 1.712e-05 0.00% Castro::construct_old_rotation_source() 10 5.523e-06 8.473e-06 1.392e-05 0.00% Gravity::set_mass_offset() 10 6.268e-06 9.908e-06 1.344e-05 0.00% Castro::FluxRegCrseInit 10 7.258e-06 9.603e-06 1.119e-05 0.00% Castro::retry_advance_ctu() 10 6.015e-06 9.539e-06 1.081e-05 0.00% AmrLevel::checkPointPost() 3 4.482e-06 6.104e-06 7.196e-06 0.00% AmrLevel::checkPointPre() 3 2.434e-06 4.095e-06 5.839e-06 0.00% Castro::FluxRegFineAdd() 10 3.926e-06 4.291e-06 4.722e-06 0.00% DistributionMapping::Distribute() 1 1.451e-06 2.12e-06 2.564e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.05-3-gdf9b6944a6d5) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.05-3-gdf9b6944a6d5) initialized Starting run at 17:13:30 UTC on 2022-05-03. Successfully read inputs file ... Castro git describe: 22.05-12-gee604e355 AMReX git describe: 22.05-3-gdf9b6944a Microphysics git describe: 22.05 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 29.12212198 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.0375196 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576 [1m[32m Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.009023 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.285225547 Castro::do_new_sources() time = 0.009586828 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.6971218773 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.38436993 [STEP 6] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405 [1m[32m Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006688262 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.274814945 Castro::do_new_sources() time = 0.008903758 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.7310984654 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.367989464 [STEP 7] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575 [1m[32m Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006030159 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.26757038 Castro::do_new_sources() time = 0.00857452 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.749304163 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.358083579 [STEP 8] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004 [1m[32m Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005728257 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.205944757 Castro::do_new_sources() time = 0.009134769 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.9144318856 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.292362539 [STEP 9] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254 [1m[32m Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254[0m Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006581308 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.169399632 Castro::do_new_sources() time = 0.009374651 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.098332165 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.244206226 [STEP 10] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.084654073 seconds Ending run at 17:13:32 UTC on 2022-05-03. Run time = 1.77245533 Run time without initialization = 1.73448721 Average number of zones advanced per microsecond: 0.756 Average number of zones advanced per microsecond per rank: 0.047 TinyProfiler total time across processes [min...avg...max]: 1.772 ... 1.772 ... 1.773 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.7273 1.0904 1.2208 68.88% Castro::do_advance_ctu() 5 0.01753 0.1414 0.5117 28.87% FabArray::ParallelCopy_finish() 56 0.0292 0.05371 0.1142 6.44% Amr::writePlotFile() 1 0.07639 0.07853 0.07906 4.46% FabArray::setVal() 80 0.03561 0.04736 0.05413 3.05% Castro::do_old_sources() 5 8.495e-05 0.01118 0.04191 2.36% Castro::reset_internal_energy(Fab) 240 0.02515 0.03067 0.03738 2.11% Castro::estTimeStep() 10 0.01013 0.01695 0.03534 1.99% StateData::FillBoundary(geom) 10 0.00832 0.02217 0.03513 1.98% FabArray::ParallelCopy_nowait() 56 0.01777 0.02232 0.02778 1.57% FillPatchIterator::Initialize 56 0.01678 0.02194 0.02692 1.52% Castro::do_new_sources() 5 7.363e-05 0.006237 0.02529 1.43% Castro::computeTemp() 30 0.01569 0.01926 0.0235 1.33% Castro::expand_state() 5 0.008394 0.01379 0.02027 1.14% Castro::normalize_species() 30 0.01194 0.01498 0.01971 1.11% VisMF::Read() 3 0.01658 0.01853 0.01892 1.07% Castro::initialize_do_advance() 5 0.01184 0.01392 0.01652 0.93% Castro::hybrid_to_linear_momentum() 30 0.008018 0.01119 0.01544 0.87% Castro::construct_new_gravity_source() 5 0.01242 0.0139 0.01529 0.86% Castro::finalize_do_advance() 5 0.008686 0.01229 0.01478 0.83% Castro::initialize_advance() 5 0.007809 0.01162 0.01459 0.82% Castro::post_timestep() 5 0.001827 0.006202 0.01154 0.65% MultiFab::contains_nan() 10 0.006083 0.007863 0.01063 0.60% MultiFab::Saxpy() 10 0.007318 0.008583 0.00954 0.54% VisMF::Write(FabArray) 1 0.006197 0.006726 0.008868 0.50% Amr::restart() 1 0.008046 0.008091 0.008247 0.47% FabArray::setDomainBndry() 56 0.00272 0.005385 0.007321 0.41% Castro::construct_old_gravity_source() 5 0.00297 0.004979 0.007289 0.41% Gravity::get_new_grav_vector() 5 0.003309 0.005026 0.007262 0.41% Castro::derive() 26 0.004141 0.005257 0.006789 0.38% Castro::sum_integrated_quantities() 5 0.001216 0.003886 0.006642 0.37% Gravity::add_pointmass_to_gravity() 10 0.004058 0.00494 0.005728 0.32% Castro::initMFs() 1 0.004551 0.004866 0.005045 0.28% Castro::fill_hybrid_hydro_source() 15 0.002579 0.003807 0.004714 0.27% Castro::post_restart() 1 5.059e-05 0.0006943 0.004546 0.26% Castro::swap_state_time_levels() 5 0.004143 0.004376 0.004472 0.25% StateData::restartDoit() 4 0.002856 0.003859 0.004045 0.23% Gravity::get_old_grav_vector() 5 0.002415 0.00332 0.004044 0.23% Castro::volWgtSum() 80 0.003112 0.003594 0.004004 0.23% Castro::enforce_min_density() 30 0.002178 0.002645 0.003345 0.19% main() 1 0.001545 0.001932 0.002285 0.13% Castro::finalize_advance() 5 0.0006152 0.0008985 0.001307 0.07% Castro::buildMetrics() 1 0.0001918 0.0004287 0.0006792 0.04% Castro::subcycle_advance_ctu() 5 2.664e-05 7.265e-05 0.0006059 0.03% Amr::InitAmr() 1 0.0002599 0.0003971 0.0004524 0.03% Castro::locSquaredSum() 6 0.0002338 0.0003036 0.0003762 0.02% Amr::coarseTimeStep() 5 0.0001867 0.000246 0.0003254 0.02% AmrLevel::restart() 1 0.0001496 0.0002373 0.0002739 0.02% Castro::reset_internal_energy(MultiFab) 30 0.0001122 0.0001701 0.0002226 0.01% Castro::clean_state() 30 9.503e-05 0.0001578 0.0002086 0.01% StateDataPhysBCFunct::() 56 6.741e-05 0.0001106 0.000143 0.01% Castro::computeNewDt() 5 4.52e-06 1.512e-05 0.0001375 0.01% FillPatchSingleLevel 56 4.828e-05 7.573e-05 0.0001105 0.01% FabArrayBase::CPC::define() 2 3.964e-05 5.907e-05 0.0001081 0.01% Castro::construct_new_source() 35 3.664e-05 7.166e-05 9.64e-05 0.01% Castro::construct_old_source() 35 3.644e-05 5.272e-05 8.381e-05 0.00% Castro::construct_new_gravity() 5 1.793e-05 4.398e-05 8.26e-05 0.00% FabArray::ParallelCopy() 56 4.757e-05 6.549e-05 8.076e-05 0.00% Castro::construct_old_gravity() 5 2.486e-05 4.6e-05 7.213e-05 0.00% Amr::timeStep() 5 2.662e-05 3.675e-05 7.141e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 9.065e-06 2.897e-05 6.543e-05 0.00% Castro::apply_source_to_state() 10 1.817e-05 3.071e-05 4.333e-05 0.00% Castro::check_for_nan() 10 1.457e-05 2.848e-05 4.106e-05 0.00% FabArrayBase::getCPC() 10 1.85e-05 2.828e-05 4.084e-05 0.00% Amr::writeSmallPlotFile() 1 2.602e-05 3.645e-05 3.885e-05 0.00% Castro::advance() 5 2.368e-05 3.015e-05 3.841e-05 0.00% Castro::construct_new_hybrid_source() 5 9.644e-06 2.458e-05 3.464e-05 0.00% Gravity::swapTimeLevels() 5 7.28e-06 1.355e-05 2.261e-05 0.00% Castro::enforce_speed_limit() 30 1.151e-05 1.597e-05 2.198e-05 0.00% Castro::construct_old_hybrid_source() 5 6.699e-06 1.149e-05 1.942e-05 0.00% Castro::create_source_corrector() 5 5.64e-06 1.182e-05 1.835e-05 0.00% Amr::initSubcycle() 1 8.559e-06 1.375e-05 1.504e-05 0.00% Castro::construct_new_rotation_source() 5 4.251e-06 7.507e-06 1.117e-05 0.00% Castro::construct_old_rotation_source() 5 3.083e-06 5.705e-06 1.014e-05 0.00% Gravity::set_mass_offset() 6 4.409e-06 6.108e-06 8.455e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 6.498e-06 7.124e-06 8.442e-06 0.00% Castro::gwstrain() 5 4.108e-06 6.2e-06 8.43e-06 0.00% Castro::FluxRegCrseInit 5 3.605e-06 5.529e-06 7.44e-06 0.00% Castro::retry_advance_ctu() 5 3.875e-06 6.106e-06 6.982e-06 0.00% Castro::FluxRegFineAdd() 5 1.969e-06 2.56e-06 3.148e-06 0.00% DistributionMapping::Distribute() 1 1.921e-06 2.414e-06 2.773e-06 0.00% AmrLevel::AmrLevel() 1 1.317e-06 1.717e-06 2.239e-06 0.00% Amr::init() 1 1.005e-06 1.373e-06 1.726e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.772 1.772 1.772 100.00% Amr::coarseTimeStep() 5 1.647 1.647 1.647 92.93% Amr::timeStep() 5 1.641 1.641 1.641 92.59% Castro::advance() 5 1.605 1.609 1.611 90.88% Castro::subcycle_advance_ctu() 5 1.544 1.55 1.562 88.14% Castro::do_advance_ctu() 5 1.543 1.55 1.562 88.14% Castro::construct_ctu_hydro_source() 5 0.7273 1.09 1.221 68.88% FillPatchIterator::Initialize 56 0.1044 0.1259 0.1623 9.16% FillPatchSingleLevel 56 0.07347 0.09853 0.1423 8.03% Castro::initialize_do_advance() 5 0.1177 0.1257 0.1405 7.92% FabArray::ParallelCopy() 56 0.05186 0.07618 0.1338 7.55% FabArray::ParallelCopy_finish() 56 0.0292 0.05371 0.1142 6.44% Castro::clean_state() 30 0.06328 0.07909 0.09921 5.60% Castro::expand_state() 5 0.07635 0.08636 0.09372 5.29% Amr::writePlotFile() 1 0.08525 0.08525 0.08525 4.81% Castro::do_old_sources() 5 0.02332 0.03777 0.06768 3.82% Castro::initialize_advance() 5 0.0425 0.05815 0.06672 3.76% Castro::computeTemp() 30 0.04098 0.0501 0.06089 3.44% Castro::do_new_sources() 5 0.03418 0.04752 0.05964 3.36% FabArray::setVal() 80 0.03561 0.04736 0.05413 3.05% Castro::reset_internal_energy(MultiFab) 30 0.02529 0.03084 0.03759 2.12% Amr::init() 1 0.03732 0.03738 0.03754 2.12% Amr::restart() 1 0.03732 0.03737 0.03754 2.12% Castro::reset_internal_energy(Fab) 240 0.02515 0.03067 0.03738 2.11% Castro::post_timestep() 5 0.03019 0.03241 0.03602 2.03% Castro::estTimeStep() 10 0.01013 0.01695 0.03534 1.99% StateDataPhysBCFunct::() 56 0.008428 0.02228 0.03527 1.99% StateData::FillBoundary(geom) 10 0.00832 0.02217 0.03513 1.98% FabArray::ParallelCopy_nowait() 56 0.01786 0.0224 0.0279 1.57% AmrLevel::restart() 1 0.01971 0.02278 0.02329 1.31% StateData::restartDoit() 4 0.01949 0.0225 0.02301 1.30% Castro::normalize_species() 30 0.01194 0.01498 0.01971 1.11% VisMF::Read() 3 0.01658 0.01853 0.01892 1.07% Castro::construct_new_source() 35 0.01417 0.01662 0.01847 1.04% Castro::sum_integrated_quantities() 5 0.0165 0.01652 0.01654 0.93% Castro::hybrid_to_linear_momentum() 30 0.008018 0.01119 0.01544 0.87% Castro::construct_new_gravity_source() 5 0.01242 0.0139 0.01529 0.86% Castro::finalize_do_advance() 5 0.008686 0.01229 0.01478 0.83% Castro::construct_new_gravity() 5 0.006209 0.008802 0.01255 0.71% Castro::derive() 26 0.007315 0.00961 0.01197 0.68% Gravity::get_new_grav_vector() 5 0.005914 0.008341 0.01182 0.67% Castro::check_for_nan() 10 0.006104 0.007891 0.01067 0.60% MultiFab::contains_nan() 10 0.006083 0.007863 0.01063 0.60% Castro::apply_source_to_state() 10 0.007342 0.008614 0.009559 0.54% MultiFab::Saxpy() 10 0.007318 0.008583 0.00954 0.54% Castro::construct_old_source() 35 0.003961 0.006244 0.009149 0.52% VisMF::Write(FabArray) 1 0.006197 0.006726 0.008868 0.50% Castro::construct_old_gravity() 5 0.005739 0.006924 0.00817 0.46% Gravity::get_old_grav_vector() 5 0.005451 0.006496 0.007694 0.43% FabArray::setDomainBndry() 56 0.00272 0.005385 0.007321 0.41% Castro::construct_old_gravity_source() 5 0.00297 0.004979 0.007289 0.41% Castro::computeNewDt() 5 0.005695 0.005771 0.005828 0.33% Gravity::add_pointmass_to_gravity() 10 0.004058 0.00494 0.005728 0.32% Castro::initMFs() 1 0.004551 0.004866 0.005045 0.28% Castro::post_restart() 1 0.0003749 0.00102 0.004754 0.27% Castro::fill_hybrid_hydro_source() 15 0.002579 0.003807 0.004714 0.27% Castro::swap_state_time_levels() 5 0.004143 0.004376 0.004472 0.25% Castro::volWgtSum() 80 0.003112 0.003594 0.004004 0.23% Castro::enforce_min_density() 30 0.002178 0.002645 0.003345 0.19% Castro::construct_new_hybrid_source() 5 0.001648 0.002636 0.003233 0.18% Castro::construct_old_hybrid_source() 5 0.0009094 0.001207 0.001767 0.10% Castro::finalize_advance() 5 0.0006239 0.0009066 0.001318 0.07% Castro::locSquaredSum() 6 0.0007176 0.0008835 0.0009851 0.06% Castro::buildMetrics() 1 0.000261 0.000619 0.000939 0.05% Amr::InitAmr() 1 0.0002685 0.0004109 0.0004659 0.03% FabArrayBase::getCPC() 10 5.916e-05 8.735e-05 0.0001399 0.01% FabArrayBase::CPC::define() 2 3.964e-05 5.907e-05 0.0001081 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.823e-05 3.851e-05 7.508e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 9.065e-06 2.897e-05 6.543e-05 0.00% Amr::writeSmallPlotFile() 1 2.602e-05 3.645e-05 3.885e-05 0.00% Gravity::swapTimeLevels() 5 7.28e-06 1.355e-05 2.261e-05 0.00% Castro::enforce_speed_limit() 30 1.151e-05 1.597e-05 2.198e-05 0.00% Castro::create_source_corrector() 5 5.64e-06 1.182e-05 1.835e-05 0.00% Amr::initSubcycle() 1 8.559e-06 1.375e-05 1.504e-05 0.00% Castro::construct_new_rotation_source() 5 4.251e-06 7.507e-06 1.117e-05 0.00% Castro::construct_old_rotation_source() 5 3.083e-06 5.705e-06 1.014e-05 0.00% Gravity::set_mass_offset() 6 4.409e-06 6.108e-06 8.455e-06 0.00% Castro::gwstrain() 5 4.108e-06 6.2e-06 8.43e-06 0.00% Castro::FluxRegCrseInit 5 3.605e-06 5.529e-06 7.44e-06 0.00% Castro::retry_advance_ctu() 5 3.875e-06 6.106e-06 6.982e-06 0.00% Castro::FluxRegFineAdd() 5 1.969e-06 2.56e-06 3.148e-06 0.00% DistributionMapping::Distribute() 1 1.921e-06 2.414e-06 2.773e-06 0.00% AmrLevel::AmrLevel() 1 1.317e-06 1.717e-06 2.239e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.05-3-gdf9b6944a6d5) finalized