MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.05-3-gdf9b6944a6d5) initialized Starting run at 14:10:23 UTC on 2022-05-03. Successfully read inputs file ... Castro git describe: 22.05-5-gdd79b4ecf AMReX git describe: 22.05-3-gdf9b6944a Microphysics git describe: 22.05 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 68.62410327 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.014369189 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.191107256 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007663972 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.276510686 Castro::do_new_sources() time = 0.009228817 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7140914472 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.37465626 [STEP 1] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006016724 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.270456976 Castro::do_new_sources() time = 0.008644726 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7395994261 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.365815997 [STEP 2] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005233174 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.268029249 Castro::do_new_sources() time = 0.008991792 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7452836142 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.36249772 [STEP 3] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004827562 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.177809569 Castro::do_new_sources() time = 0.009592855 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.022080903 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.265021585 [STEP 4] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006921002 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.17024235 Castro::do_new_sources() time = 0.009781038 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.101670943 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.247742846 [STEP 5] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.017203051 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006800956 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.170455502 Castro::do_new_sources() time = 0.008843459 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.119633308 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.241320513 [STEP 6] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005271671 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.16412445 Castro::do_new_sources() time = 0.007078857 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.212252881 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.223851316 [STEP 7] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004323437 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.188692534 Castro::do_new_sources() time = 0.005451459 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.100935132 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.245355212 [STEP 8] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003850858 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.159507368 Castro::do_new_sources() time = 0.005555006 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.26655358 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.213784454 [STEP 9] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004059845 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1676519 Castro::do_new_sources() time = 0.007323758 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.187981957 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.22741624 [STEP 10] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.014592563 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.768503198 seconds Ending run at 14:10:27 UTC on 2022-05-03. Run time = 3.814567096 Run time without initialization = 3.569918945 Average number of zones advanced per microsecond: 0.734 Average number of zones advanced per microsecond per rank: 0.046 TinyProfiler total time across processes [min...avg...max]: 3.814 ... 3.814 ... 3.815 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.5209 1.8079 2.0370 53.40% Amr::writePlotFile() 2 0.9398 0.9468 0.948 24.85% Castro::do_advance_ctu() 10 0.02531 0.2556 0.5394 14.14% FabArray::ParallelCopy_finish() 119 0.05809 0.0958 0.1519 3.98% FabArray::setVal() 164 0.07733 0.08801 0.09873 2.59% Castro::do_old_sources() 10 0.0001455 0.01607 0.07106 1.86% Castro::reset_internal_energy(Fab) 504 0.05363 0.05865 0.06622 1.74% VisMF::Write(FabArray) 11 0.04384 0.04793 0.06046 1.58% Castro::estTimeStep() 21 0.02625 0.042 0.05538 1.45% FabArray::ParallelCopy_nowait() 119 0.02614 0.03719 0.05154 1.35% StateData::FillBoundary(geom) 20 0.01911 0.03233 0.04377 1.15% Castro::computeTemp() 63 0.03326 0.03696 0.04184 1.10% FillPatchIterator::Initialize 119 0.03062 0.03572 0.04052 1.06% Castro::post_timestep() 10 0.004783 0.01329 0.03276 0.86% Castro::normalize_species() 62 0.02467 0.02739 0.03169 0.83% Castro::expand_state() 10 0.01741 0.02244 0.02998 0.79% Castro::do_new_sources() 10 0.0001377 0.00782 0.02861 0.75% Castro::initialize_do_advance() 10 0.01882 0.02558 0.028 0.73% Castro::finalize_do_advance() 10 0.00178 0.02129 0.02769 0.73% Castro::construct_new_gravity_source() 10 0.0204 0.02277 0.02484 0.65% Castro::initialize_advance() 10 0.01355 0.01814 0.02218 0.58% Castro::hybrid_to_linear_momentum() 62 0.01605 0.01892 0.02136 0.56% MultiFab::contains_nan() 20 0.01027 0.01274 0.01733 0.45% Amr::checkPoint() 3 0.007187 0.01305 0.0162 0.42% MultiFab::Saxpy() 20 0.01177 0.01396 0.01599 0.42% FabArray::setDomainBndry() 119 0.005355 0.008891 0.01381 0.36% Gravity::get_new_grav_vector() 11 0.0076 0.009513 0.01174 0.31% Gravity::add_pointmass_to_gravity() 21 0.007598 0.008695 0.009974 0.26% Castro::construct_old_gravity_source() 10 0.005607 0.007286 0.009628 0.25% Castro::derive() 55 0.006539 0.007671 0.009172 0.24% Castro::sum_integrated_quantities() 11 0.003715 0.006274 0.008121 0.21% Castro::volWgtSum() 176 0.006785 0.007269 0.00787 0.21% Castro::fill_hybrid_hydro_source() 30 0.005037 0.006234 0.007486 0.20% Gravity::get_old_grav_vector() 10 0.004082 0.005654 0.006713 0.18% Castro::initMFs() 1 0.003465 0.005097 0.005602 0.15% Castro::enforce_min_density() 62 0.004245 0.004707 0.005388 0.14% Castro::swap_state_time_levels() 10 0.004024 0.004326 0.004766 0.12% StateData::define() 4 0.003182 0.004321 0.004712 0.12% Castro::initData() 1 0.001745 0.002381 0.002687 0.07% Castro::post_init() 1 4.64e-05 0.0006481 0.002456 0.06% main() 1 0.0007797 0.00103 0.001673 0.04% Castro::subcycle_advance_ctu() 10 5.917e-05 0.0001462 0.00126 0.03% Castro::buildMetrics() 1 0.0007896 0.001079 0.001192 0.03% Castro::locSquaredSum() 11 0.0004184 0.0004892 0.0005829 0.02% Amr::coarseTimeStep() 10 0.0003218 0.0004046 0.0005131 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0003242 0.0003693 0.0004536 0.01% Amr::InitAmr() 1 0.000263 0.0003944 0.0004461 0.01% Castro::clean_state() 62 0.0002492 0.000313 0.0003522 0.01% StateDataPhysBCFunct::() 119 0.0001871 0.0002267 0.0002877 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002152 0.0002485 0.0002845 0.01% Castro::Castro() 1 7.28e-05 0.0001617 0.0002505 0.01% DistributionMapping::LeastUsedCPUs() 1 8.734e-06 6.261e-05 0.00023 0.01% StateData::checkPoint() 12 2.216e-05 4.317e-05 0.0002297 0.01% Castro::enforce_consistent_e() 1 6.726e-05 0.0001028 0.0002242 0.01% Castro::construct_new_source() 70 8.436e-05 0.0001367 0.0001749 0.00% Castro::computeNewDt() 9 1.201e-05 2.338e-05 0.0001695 0.00% FillPatchSingleLevel 119 0.0001048 0.0001288 0.0001637 0.00% FabArray::ParallelCopy() 119 0.0001041 0.000132 0.0001625 0.00% Castro::finalize_advance() 10 0.0001065 0.0001212 0.0001486 0.00% Amr::timeStep() 10 5.402e-05 6.558e-05 0.0001394 0.00% Castro::construct_old_source() 70 6.947e-05 9.135e-05 0.0001306 0.00% Castro::construct_old_gravity() 10 6.225e-05 8.655e-05 0.0001231 0.00% Castro::construct_new_gravity() 10 4.212e-05 7.187e-05 0.0001198 0.00% Amr::writeSmallPlotFile() 1 2.976e-05 5.894e-05 0.0001178 0.00% AmrLevel::checkPoint() 3 4.77e-05 7.058e-05 0.0001149 0.00% Castro::advance() 10 4.166e-05 5.663e-05 8.23e-05 0.00% Castro::check_for_nan() 20 2.734e-05 4.603e-05 7.745e-05 0.00% FabArrayBase::CPC::define() 2 2.757e-05 5.214e-05 7.543e-05 0.00% Castro::apply_source_to_state() 20 4.794e-05 6.216e-05 7.352e-05 0.00% Castro::enforce_speed_limit() 62 4.394e-05 5.104e-05 6.34e-05 0.00% FabArrayBase::getCPC() 20 3.799e-05 4.83e-05 5.958e-05 0.00% Castro::construct_new_hybrid_source() 10 2.017e-05 3.485e-05 5.387e-05 0.00% Amr::defBaseLevel() 1 2.9e-05 3.796e-05 4.509e-05 0.00% Amr::FinalizeInit() 1 3.898e-06 8.478e-06 4.002e-05 0.00% Gravity::swapTimeLevels() 10 1.695e-05 2.627e-05 3.426e-05 0.00% Castro::create_source_corrector() 10 1.307e-05 1.975e-05 3.196e-05 0.00% Castro::construct_old_hybrid_source() 10 1.231e-05 2.212e-05 3.184e-05 0.00% Castro::retry_advance_ctu() 10 6.223e-06 1.062e-05 2.985e-05 0.00% Castro::construct_new_rotation_source() 10 7.94e-06 1.404e-05 1.961e-05 0.00% Amr::initSubcycle() 1 8.487e-06 1.295e-05 1.521e-05 0.00% AmrLevel::AmrLevel(dm) 1 8.165e-06 1.15e-05 1.377e-05 0.00% Amr::init() 1 2.788e-06 4.388e-06 1.295e-05 0.00% Gravity::set_mass_offset() 10 8.834e-06 1.067e-05 1.246e-05 0.00% Castro::FluxRegCrseInit 10 8.354e-06 9.598e-06 1.225e-05 0.00% Castro::construct_old_rotation_source() 10 6.798e-06 8.591e-06 1.183e-05 0.00% Castro::gwstrain() 11 7.52e-06 9.812e-06 1.152e-05 0.00% AmrLevel::checkPointPost() 3 4.456e-06 6.398e-06 9.637e-06 0.00% AmrLevel::checkPointPre() 3 3.342e-06 4.489e-06 8.731e-06 0.00% Amr::InitializeInit() 1 2.81e-06 4.015e-06 7.967e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.475e-06 6.031e-06 6.741e-06 0.00% Castro::computeInitialDt() 2 3.402e-06 4.615e-06 6.604e-06 0.00% Castro::FluxRegFineAdd() 10 3.874e-06 4.356e-06 5.645e-06 0.00% Castro::post_regrid() 1 2.993e-06 3.642e-06 4.45e-06 0.00% Amr::initialInit() 1 1.556e-06 2.609e-06 3.865e-06 0.00% DistributionMapping::Distribute() 1 1.165e-06 1.942e-06 2.361e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.814 3.814 3.815 100.00% Amr::coarseTimeStep() 10 2.8 2.8 2.8 73.39% Amr::timeStep() 10 2.758 2.758 2.758 72.31% Castro::advance() 10 2.684 2.704 2.71 71.04% Castro::subcycle_advance_ctu() 10 2.591 2.608 2.621 68.70% Castro::do_advance_ctu() 10 2.59 2.607 2.621 68.70% Castro::construct_ctu_hydro_source() 10 1.521 1.808 2.037 53.40% Amr::writePlotFile() 2 0.96 0.96 0.96 25.17% FillPatchIterator::Initialize 119 0.1658 0.2105 0.2523 6.61% Amr::init() 1 0.244 0.2441 0.2443 6.40% Castro::initialize_do_advance() 10 0.2 0.2175 0.2393 6.27% FillPatchSingleLevel 119 0.1266 0.1659 0.2147 5.63% FabArray::ParallelCopy() 119 0.09485 0.1332 0.1905 4.99% Castro::clean_state() 62 0.1326 0.1457 0.1651 4.33% Castro::expand_state() 10 0.1263 0.1475 0.1608 4.22% FabArray::ParallelCopy_finish() 119 0.05809 0.0958 0.1519 3.98% Castro::do_old_sources() 10 0.04071 0.06097 0.1172 3.07% Castro::initialize_advance() 10 0.08268 0.09583 0.1098 2.88% Castro::computeTemp() 63 0.08721 0.09599 0.1085 2.84% Castro::do_new_sources() 10 0.06576 0.07777 0.09974 2.61% FabArray::setVal() 164 0.07733 0.08801 0.09873 2.59% Castro::post_timestep() 10 0.04809 0.05454 0.07415 1.94% Castro::reset_internal_energy(MultiFab) 63 0.05395 0.05902 0.06664 1.75% Castro::reset_internal_energy(Fab) 504 0.05363 0.05865 0.06622 1.74% VisMF::Write(FabArray) 11 0.04384 0.04793 0.06046 1.58% Castro::estTimeStep() 21 0.02625 0.042 0.05538 1.45% FabArray::ParallelCopy_nowait() 119 0.02622 0.03729 0.05163 1.35% Amr::checkPoint() 3 0.04782 0.0479 0.04792 1.26% StateDataPhysBCFunct::() 119 0.01931 0.03256 0.04403 1.15% StateData::FillBoundary(geom) 20 0.01911 0.03233 0.04377 1.15% AmrLevel::checkPoint() 3 0.0317 0.03485 0.04062 1.06% StateData::checkPoint() 12 0.03165 0.03477 0.0405 1.06% Amr::initialInit() 1 0.03686 0.03692 0.03709 0.97% Castro::normalize_species() 62 0.02467 0.02739 0.03169 0.83% Castro::construct_new_source() 70 0.02368 0.02721 0.02982 0.78% Castro::finalize_do_advance() 10 0.00178 0.02129 0.02769 0.73% Castro::sum_integrated_quantities() 11 0.02724 0.02726 0.02731 0.72% Amr::InitializeInit() 1 0.01659 0.02393 0.02646 0.69% Amr::defBaseLevel() 1 0.01658 0.02392 0.02645 0.69% Castro::construct_new_gravity_source() 10 0.0204 0.02277 0.02484 0.65% Castro::hybrid_to_linear_momentum() 62 0.01605 0.01892 0.02136 0.56% Amr::FinalizeInit() 1 0.01044 0.01299 0.02044 0.54% Gravity::get_new_grav_vector() 11 0.01235 0.01541 0.01938 0.51% Castro::construct_new_gravity() 10 0.01226 0.0146 0.01891 0.50% Castro::check_for_nan() 20 0.01029 0.01278 0.01739 0.46% MultiFab::contains_nan() 20 0.01027 0.01274 0.01733 0.45% Castro::derive() 55 0.01275 0.0145 0.01695 0.44% Castro::apply_source_to_state() 20 0.01183 0.01403 0.01606 0.42% MultiFab::Saxpy() 20 0.01177 0.01396 0.01599 0.42% FabArray::setDomainBndry() 119 0.005355 0.008891 0.01381 0.36% Castro::construct_old_gravity() 10 0.009269 0.01143 0.01289 0.34% Castro::computeInitialDt() 2 0.002195 0.004742 0.01219 0.32% Gravity::get_old_grav_vector() 10 0.008672 0.01068 0.01204 0.32% Castro::construct_old_source() 70 0.007465 0.009386 0.01182 0.31% Castro::initData() 1 0.007269 0.009933 0.01114 0.29% Castro::Castro() 1 0.005882 0.009549 0.0109 0.29% Gravity::add_pointmass_to_gravity() 21 0.007598 0.008695 0.009974 0.26% Castro::construct_old_gravity_source() 10 0.005607 0.007286 0.009628 0.25% Castro::computeNewDt() 9 0.007877 0.007957 0.008024 0.21% Castro::volWgtSum() 176 0.006785 0.007269 0.00787 0.21% Castro::post_init() 1 0.006464 0.006783 0.007679 0.20% Castro::fill_hybrid_hydro_source() 30 0.005037 0.006234 0.007486 0.20% Castro::initMFs() 1 0.003465 0.005097 0.005602 0.15% Castro::enforce_min_density() 62 0.004245 0.004707 0.005388 0.14% Castro::construct_new_hybrid_source() 10 0.00319 0.004292 0.005085 0.13% Castro::swap_state_time_levels() 10 0.004024 0.004326 0.004766 0.12% AmrLevel::AmrLevel(dm) 1 0.003191 0.004333 0.004723 0.12% StateData::define() 4 0.003182 0.004321 0.004712 0.12% Castro::post_regrid() 1 0.001659 0.002555 0.002872 0.08% Castro::construct_old_hybrid_source() 10 0.001721 0.001999 0.002483 0.07% Castro::locSquaredSum() 11 0.001048 0.001277 0.001453 0.04% Castro::buildMetrics() 1 0.0008591 0.001218 0.001354 0.04% Amr::InitAmr() 1 0.000272 0.0004074 0.0004599 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002152 0.0002485 0.0002845 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.579e-05 7.059e-05 0.0002382 0.01% DistributionMapping::LeastUsedCPUs() 1 8.734e-06 6.261e-05 0.00023 0.01% Castro::enforce_consistent_e() 1 6.726e-05 0.0001028 0.0002242 0.01% Castro::finalize_advance() 10 0.0001198 0.0001351 0.0001619 0.00% FabArrayBase::getCPC() 20 6.752e-05 0.0001004 0.000127 0.00% Amr::writeSmallPlotFile() 1 2.976e-05 5.894e-05 0.0001178 0.00% FabArrayBase::CPC::define() 2 2.757e-05 5.214e-05 7.543e-05 0.00% Castro::enforce_speed_limit() 62 4.394e-05 5.104e-05 6.34e-05 0.00% Gravity::swapTimeLevels() 10 1.695e-05 2.627e-05 3.426e-05 0.00% Castro::create_source_corrector() 10 1.307e-05 1.975e-05 3.196e-05 0.00% Castro::retry_advance_ctu() 10 6.223e-06 1.062e-05 2.985e-05 0.00% Castro::construct_new_rotation_source() 10 7.94e-06 1.404e-05 1.961e-05 0.00% Amr::initSubcycle() 1 8.487e-06 1.295e-05 1.521e-05 0.00% Gravity::set_mass_offset() 10 8.834e-06 1.067e-05 1.246e-05 0.00% Castro::FluxRegCrseInit 10 8.354e-06 9.598e-06 1.225e-05 0.00% Castro::construct_old_rotation_source() 10 6.798e-06 8.591e-06 1.183e-05 0.00% Castro::gwstrain() 11 7.52e-06 9.812e-06 1.152e-05 0.00% AmrLevel::checkPointPost() 3 4.456e-06 6.398e-06 9.637e-06 0.00% AmrLevel::checkPointPre() 3 3.342e-06 4.489e-06 8.731e-06 0.00% Castro::FluxRegFineAdd() 10 3.874e-06 4.356e-06 5.645e-06 0.00% DistributionMapping::Distribute() 1 1.165e-06 1.942e-06 2.361e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.05-3-gdf9b6944a6d5) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.05-3-gdf9b6944a6d5) initialized Starting run at 14:10:27 UTC on 2022-05-03. Successfully read inputs file ... Castro git describe: 22.05-5-gdd79b4ecf AMReX git describe: 22.05-3-gdf9b6944a Microphysics git describe: 22.05 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 30.04018693 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.037564589 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007523743 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.282260751 Castro::do_new_sources() time = 0.009280433 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7000430907 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.382856049 [STEP 6] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007094145 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.27579674 Castro::do_new_sources() time = 0.008955635 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7285768234 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.368735959 [STEP 7] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006074525 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.267381707 Castro::do_new_sources() time = 0.00853081 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7434993455 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.360824414 [STEP 8] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005884404 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.209819474 Castro::do_new_sources() time = 0.008985603 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.8958404678 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.298696372 [STEP 9] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006056724 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.20787183 Castro::do_new_sources() time = 0.009460547 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.9413577372 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.284750554 [STEP 10] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.080378164 seconds Ending run at 14:10:29 UTC on 2022-05-03. Run time = 1.816723244 Run time without initialization = 1.778765417 Average number of zones advanced per microsecond: 0.737 Average number of zones advanced per microsecond per rank: 0.046 TinyProfiler total time across processes [min...avg...max]: 1.816 ... 1.817 ... 1.817 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.7849 1.0756 1.2645 69.60% Castro::do_advance_ctu() 5 0.01517 0.1996 0.4918 27.07% FabArray::ParallelCopy_finish() 56 0.02758 0.06227 0.1177 6.48% Amr::writePlotFile() 1 0.07272 0.07447 0.075 4.13% FabArray::setVal() 80 0.03705 0.04654 0.05446 3.00% Castro::do_old_sources() 5 8.509e-05 0.0127 0.05131 2.82% Castro::reset_internal_energy(Fab) 240 0.02434 0.02998 0.03707 2.04% Castro::estTimeStep() 10 0.009901 0.01845 0.03449 1.90% StateData::FillBoundary(geom) 10 0.009771 0.02069 0.03286 1.81% FabArray::ParallelCopy_nowait() 56 0.01559 0.02099 0.0301 1.66% FillPatchIterator::Initialize 56 0.01687 0.02196 0.02674 1.47% Castro::do_new_sources() 5 8.043e-05 0.005359 0.02507 1.38% Castro::computeTemp() 30 0.01591 0.01898 0.02399 1.32% Castro::expand_state() 5 0.009059 0.01475 0.02389 1.31% Castro::normalize_species() 30 0.01168 0.01456 0.01913 1.05% VisMF::Read() 3 0.01675 0.01849 0.01912 1.05% Castro::initialize_do_advance() 5 0.01162 0.01384 0.01687 0.93% Castro::construct_new_gravity_source() 5 0.01256 0.0138 0.01527 0.84% Castro::initialize_advance() 5 0.008369 0.01162 0.01505 0.83% Castro::finalize_do_advance() 5 0.008049 0.01211 0.01455 0.80% Castro::hybrid_to_linear_momentum() 30 0.008264 0.01083 0.01452 0.80% Castro::post_timestep() 5 0.001498 0.006467 0.01195 0.66% MultiFab::contains_nan() 10 0.005906 0.008018 0.01159 0.64% MultiFab::Saxpy() 10 0.006335 0.008159 0.01024 0.56% Amr::restart() 1 0.008056 0.008134 0.008264 0.45% VisMF::Write(FabArray) 1 0.005969 0.006507 0.008252 0.45% Gravity::get_new_grav_vector() 5 0.003388 0.005278 0.007722 0.43% FabArray::setDomainBndry() 56 0.003147 0.004982 0.007175 0.39% Castro::sum_integrated_quantities() 5 0.001332 0.004239 0.006865 0.38% Castro::derive() 26 0.004348 0.005207 0.00674 0.37% Castro::construct_old_gravity_source() 5 0.002948 0.004497 0.006109 0.34% Gravity::add_pointmass_to_gravity() 10 0.003914 0.004881 0.005972 0.33% Castro::initMFs() 1 0.004441 0.004691 0.004849 0.27% Castro::swap_state_time_levels() 5 0.004145 0.004466 0.004693 0.26% Castro::fill_hybrid_hydro_source() 15 0.002559 0.0037 0.004477 0.25% Castro::post_restart() 1 6.266e-05 0.001238 0.004471 0.25% Gravity::get_old_grav_vector() 5 0.002207 0.003196 0.004207 0.23% Castro::volWgtSum() 80 0.003125 0.003594 0.004013 0.22% StateData::restartDoit() 4 0.002765 0.003623 0.003934 0.22% Castro::enforce_min_density() 30 0.002244 0.002597 0.003219 0.18% main() 1 0.001403 0.001681 0.001921 0.11% Castro::finalize_advance() 5 0.0001823 0.0008473 0.001094 0.06% Castro::subcycle_advance_ctu() 5 2.51e-05 7.876e-05 0.000707 0.04% Castro::buildMetrics() 1 0.0002082 0.0004109 0.0005165 0.03% Amr::InitAmr() 1 0.0002396 0.0003745 0.000464 0.03% Castro::locSquaredSum() 6 0.0002218 0.0003014 0.0003945 0.02% Amr::coarseTimeStep() 5 0.0001734 0.000225 0.0003019 0.02% AmrLevel::restart() 1 0.0001293 0.0002147 0.0002599 0.01% Castro::reset_internal_energy(MultiFab) 30 0.0001197 0.000176 0.0002316 0.01% Castro::clean_state() 30 0.0001253 0.0001681 0.0002121 0.01% StateDataPhysBCFunct::() 56 7.698e-05 0.0001138 0.0001577 0.01% Castro::construct_new_source() 35 4.434e-05 7.737e-05 0.0001056 0.01% FillPatchSingleLevel 56 5.213e-05 7.743e-05 0.000105 0.01% Castro::computeNewDt() 5 4.449e-06 1.193e-05 0.000104 0.01% Castro::construct_new_gravity() 5 2.373e-05 4.792e-05 9.789e-05 0.01% FabArray::ParallelCopy() 56 5.207e-05 6.683e-05 9.224e-05 0.01% Castro::construct_old_gravity() 5 3.109e-05 5.049e-05 7.396e-05 0.00% FabArrayBase::CPC::define() 2 3.605e-05 5.075e-05 6.881e-05 0.00% Castro::construct_old_source() 35 3.224e-05 4.94e-05 6.459e-05 0.00% Amr::timeStep() 5 2.741e-05 3.476e-05 6.342e-05 0.00% Castro::check_for_nan() 10 1.692e-05 3.169e-05 4.847e-05 0.00% Castro::construct_new_hybrid_source() 5 7.214e-06 2.367e-05 4.805e-05 0.00% Castro::advance() 5 2.509e-05 3.026e-05 4.665e-05 0.00% Castro::apply_source_to_state() 10 2.025e-05 3.194e-05 4.615e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 9.272e-06 2.196e-05 4.381e-05 0.00% Amr::writeSmallPlotFile() 1 2.595e-05 3.491e-05 4.105e-05 0.00% FabArrayBase::getCPC() 10 1.828e-05 2.776e-05 3.824e-05 0.00% Castro::enforce_speed_limit() 30 1.221e-05 1.68e-05 2.142e-05 0.00% Gravity::swapTimeLevels() 5 8.897e-06 1.44e-05 2.051e-05 0.00% Castro::create_source_corrector() 5 7.106e-06 1.201e-05 1.87e-05 0.00% Castro::construct_old_hybrid_source() 5 6.974e-06 1.078e-05 1.548e-05 0.00% Amr::initSubcycle() 1 8.275e-06 1.307e-05 1.484e-05 0.00% Castro::construct_new_rotation_source() 5 5.146e-06 7.474e-06 1.173e-05 0.00% Gravity::set_mass_offset() 6 4.146e-06 5.995e-06 8.787e-06 0.00% Castro::construct_old_rotation_source() 5 3.11e-06 5.697e-06 8.227e-06 0.00% Castro::gwstrain() 5 4.218e-06 5.667e-06 7.876e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.65e-06 6.989e-06 7.554e-06 0.00% Castro::FluxRegCrseInit 5 3.733e-06 5.125e-06 7.26e-06 0.00% Castro::retry_advance_ctu() 5 4.648e-06 5.86e-06 7.116e-06 0.00% Amr::init() 1 1.126e-06 1.677e-06 5.885e-06 0.00% Castro::FluxRegFineAdd() 5 1.613e-06 2.519e-06 3.31e-06 0.00% AmrLevel::AmrLevel() 1 1.148e-06 1.705e-06 2.617e-06 0.00% DistributionMapping::Distribute() 1 1.472e-06 2.143e-06 2.517e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.816 1.817 1.817 100.00% Amr::coarseTimeStep() 5 1.696 1.696 1.696 93.36% Amr::timeStep() 5 1.69 1.69 1.69 93.04% Castro::advance() 5 1.653 1.657 1.66 91.37% Castro::subcycle_advance_ctu() 5 1.59 1.6 1.61 88.60% Castro::do_advance_ctu() 5 1.59 1.6 1.61 88.60% Castro::construct_ctu_hydro_source() 5 0.7849 1.076 1.265 69.60% FillPatchIterator::Initialize 56 0.09721 0.1312 0.1724 9.49% Castro::initialize_do_advance() 5 0.1186 0.1298 0.1542 8.49% FillPatchSingleLevel 56 0.06812 0.1043 0.1499 8.25% FabArray::ParallelCopy() 56 0.04571 0.08341 0.1385 7.62% FabArray::ParallelCopy_finish() 56 0.02758 0.06227 0.1177 6.48% Castro::expand_state() 5 0.08071 0.09102 0.1062 5.84% Castro::clean_state() 30 0.06281 0.07731 0.09811 5.40% Amr::writePlotFile() 1 0.08097 0.08097 0.08097 4.46% Castro::do_old_sources() 5 0.01987 0.03798 0.07528 4.14% Castro::initialize_advance() 5 0.0445 0.05696 0.06737 3.71% Castro::computeTemp() 30 0.04041 0.04913 0.06125 3.37% Castro::do_new_sources() 5 0.03629 0.04651 0.06015 3.31% FabArray::setVal() 80 0.03705 0.04654 0.05446 3.00% Amr::init() 1 0.03733 0.03742 0.03758 2.07% Amr::restart() 1 0.03733 0.03741 0.03758 2.07% Castro::reset_internal_energy(MultiFab) 30 0.0245 0.03015 0.03726 2.05% Castro::reset_internal_energy(Fab) 240 0.02434 0.02998 0.03707 2.04% Castro::post_timestep() 5 0.03022 0.03272 0.03685 2.03% Castro::estTimeStep() 10 0.009901 0.01845 0.03449 1.90% StateDataPhysBCFunct::() 56 0.009848 0.0208 0.03297 1.81% StateData::FillBoundary(geom) 10 0.009771 0.02069 0.03286 1.81% FabArray::ParallelCopy_nowait() 56 0.01568 0.02107 0.03017 1.66% AmrLevel::restart() 1 0.01983 0.02247 0.02338 1.29% StateData::restartDoit() 4 0.01963 0.02222 0.02313 1.27% Castro::normalize_species() 30 0.01168 0.01456 0.01913 1.05% VisMF::Read() 3 0.01675 0.01849 0.01912 1.05% Castro::construct_new_source() 35 0.01437 0.01648 0.01811 1.00% Castro::sum_integrated_quantities() 5 0.01679 0.01681 0.01685 0.93% Castro::construct_new_gravity_source() 5 0.01256 0.0138 0.01527 0.84% Castro::finalize_do_advance() 5 0.008049 0.01211 0.01455 0.80% Castro::hybrid_to_linear_momentum() 30 0.008264 0.01083 0.01452 0.80% Castro::construct_new_gravity() 5 0.00624 0.009088 0.01316 0.72% Gravity::get_new_grav_vector() 5 0.005944 0.008583 0.01228 0.68% Castro::derive() 26 0.007444 0.009541 0.01213 0.67% Castro::check_for_nan() 10 0.005928 0.00805 0.01164 0.64% MultiFab::contains_nan() 10 0.005906 0.008018 0.01159 0.64% Castro::apply_source_to_state() 10 0.00637 0.008191 0.01028 0.57% MultiFab::Saxpy() 10 0.006335 0.008159 0.01024 0.56% Castro::construct_old_gravity() 5 0.005064 0.006636 0.008443 0.46% VisMF::Write(FabArray) 1 0.005969 0.006507 0.008252 0.45% Gravity::get_old_grav_vector() 5 0.00476 0.006209 0.007996 0.44% Castro::construct_old_source() 35 0.003943 0.005687 0.007597 0.42% FabArray::setDomainBndry() 56 0.003147 0.004982 0.007175 0.39% Castro::construct_old_gravity_source() 5 0.002948 0.004497 0.006109 0.34% Gravity::add_pointmass_to_gravity() 10 0.003914 0.004881 0.005972 0.33% Castro::computeNewDt() 5 0.005435 0.005529 0.005583 0.31% Castro::initMFs() 1 0.004441 0.004691 0.004849 0.27% Castro::swap_state_time_levels() 5 0.004145 0.004466 0.004693 0.26% Castro::post_restart() 1 0.000414 0.001559 0.004687 0.26% Castro::fill_hybrid_hydro_source() 15 0.002559 0.0037 0.004477 0.25% Castro::volWgtSum() 80 0.003125 0.003594 0.004013 0.22% Castro::enforce_min_density() 30 0.002244 0.002597 0.003219 0.18% Castro::construct_new_hybrid_source() 5 0.001636 0.002599 0.003145 0.17% Castro::construct_old_hybrid_source() 5 0.0008213 0.001135 0.001417 0.08% Castro::finalize_advance() 5 0.000189 0.0008549 0.001101 0.06% Castro::locSquaredSum() 6 0.0006818 0.0008743 0.001013 0.06% Castro::buildMetrics() 1 0.0002672 0.0005598 0.0007924 0.04% Amr::InitAmr() 1 0.0002484 0.0003876 0.0004784 0.03% FabArrayBase::getCPC() 10 5.46e-05 7.85e-05 0.0001014 0.01% FabArrayBase::CPC::define() 2 3.605e-05 5.075e-05 6.881e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 1.785e-05 3.109e-05 5.276e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 9.272e-06 2.196e-05 4.381e-05 0.00% Amr::writeSmallPlotFile() 1 2.595e-05 3.491e-05 4.105e-05 0.00% Castro::enforce_speed_limit() 30 1.221e-05 1.68e-05 2.142e-05 0.00% Gravity::swapTimeLevels() 5 8.897e-06 1.44e-05 2.051e-05 0.00% Castro::create_source_corrector() 5 7.106e-06 1.201e-05 1.87e-05 0.00% Amr::initSubcycle() 1 8.275e-06 1.307e-05 1.484e-05 0.00% Castro::construct_new_rotation_source() 5 5.146e-06 7.474e-06 1.173e-05 0.00% Gravity::set_mass_offset() 6 4.146e-06 5.995e-06 8.787e-06 0.00% Castro::construct_old_rotation_source() 5 3.11e-06 5.697e-06 8.227e-06 0.00% Castro::gwstrain() 5 4.218e-06 5.667e-06 7.876e-06 0.00% Castro::FluxRegCrseInit 5 3.733e-06 5.125e-06 7.26e-06 0.00% Castro::retry_advance_ctu() 5 4.648e-06 5.86e-06 7.116e-06 0.00% Castro::FluxRegFineAdd() 5 1.613e-06 2.519e-06 3.31e-06 0.00% AmrLevel::AmrLevel() 1 1.148e-06 1.705e-06 2.617e-06 0.00% DistributionMapping::Distribute() 1 1.472e-06 2.143e-06 2.517e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.05-3-gdf9b6944a6d5) finalized