MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.05-3-gdf9b6944a6d5) initialized Starting run at 00:33:20 UTC on 2022-05-03. Successfully read inputs file ... Castro git describe: 22.05-3-g7c11e57ab AMReX git describe: 22.05-3-gdf9b6944a Microphysics git describe: 22.05 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 68.62410327 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.064508469 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.264866968 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006423516 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.262338327 Castro::do_new_sources() time = 0.008464746 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7536854668 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.354646914 [STEP 1] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005881459 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.247832454 Castro::do_new_sources() time = 0.00851266 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.8180878275 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.329204153 [STEP 2] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005768916 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.199476267 Castro::do_new_sources() time = 0.007916117 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.9965998042 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.270871787 [STEP 3] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00601851 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.198758064 Castro::do_new_sources() time = 0.00893873 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.000652644 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.269776733 [STEP 4] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007595913 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.163322497 Castro::do_new_sources() time = 0.008026286 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.164630896 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.233569915 [STEP 5] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.016338235 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005798326 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.197580244 Castro::do_new_sources() time = 0.009167235 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.007874915 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.2692078 [STEP 6] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005746383 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.162461724 Castro::do_new_sources() time = 0.00672181 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.204708185 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.225284064 [STEP 7] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003850109 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.160630073 Castro::do_new_sources() time = 0.00510048 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.287496619 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.210613501 [STEP 8] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00399578 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.160104831 Castro::do_new_sources() time = 0.005091584 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.283965743 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.211096413 [STEP 9] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003867488 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.161107143 Castro::do_new_sources() time = 0.005196082 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.281275438 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.211636504 [STEP 10] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.014664335 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.151495736 seconds Ending run at 00:33:23 UTC on 2022-05-03. Run time = 3.140880496 Run time without initialization = 2.770475229 Average number of zones advanced per microsecond: 0.946 Average number of zones advanced per microsecond per rank: 0.059 TinyProfiler total time across processes [min...avg...max]: 3.14 ... 3.14 ... 3.141 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.5117 1.7257 1.9155 60.99% Castro::do_advance_ctu() 10 0.02738 0.2282 0.4565 14.54% Amr::writePlotFile() 2 0.3975 0.4045 0.4068 12.95% FabArray::ParallelCopy_finish() 119 0.05618 0.08484 0.127 4.04% FabArray::setVal() 164 0.03221 0.08003 0.08967 2.85% Amr::checkPoint() 3 0.05555 0.06286 0.07051 2.24% Castro::do_old_sources() 10 0.0001577 0.01672 0.07025 2.24% VisMF::Write(FabArray) 11 0.03668 0.04655 0.06049 1.93% Castro::reset_internal_energy(Fab) 504 0.05164 0.05522 0.06005 1.91% FabArray::ParallelCopy_nowait() 119 0.01965 0.0343 0.04456 1.42% Castro::estTimeStep() 21 0.01953 0.03091 0.04368 1.39% Castro::computeTemp() 63 0.03245 0.0345 0.03751 1.19% Castro::do_new_sources() 10 0.0001288 0.006639 0.0374 1.19% FillPatchIterator::Initialize 119 0.02736 0.03385 0.03718 1.18% StateData::FillBoundary(geom) 20 0.01779 0.02627 0.0334 1.06% Castro::post_timestep() 10 0.005474 0.01179 0.03198 1.02% Castro::finalize_do_advance() 10 0.001972 0.02198 0.02849 0.91% Castro::normalize_species() 62 0.02361 0.02531 0.02783 0.89% Castro::initialize_do_advance() 10 0.015 0.02303 0.02514 0.80% Castro::expand_state() 10 0.0143 0.01959 0.02433 0.77% Castro::construct_new_gravity_source() 10 0.01316 0.02019 0.02246 0.71% Castro::initialize_advance() 10 0.004577 0.01721 0.02115 0.67% Castro::hybrid_to_linear_momentum() 62 0.01305 0.01735 0.01981 0.63% MultiFab::Saxpy() 20 0.009132 0.0134 0.0155 0.49% MultiFab::contains_nan() 20 0.006459 0.01091 0.0149 0.47% FabArray::setDomainBndry() 119 0.004844 0.007978 0.01187 0.38% Gravity::get_new_grav_vector() 11 0.003471 0.007611 0.009288 0.30% Gravity::add_pointmass_to_gravity() 21 0.006846 0.008079 0.009175 0.29% Castro::sum_integrated_quantities() 11 0.004148 0.005613 0.009043 0.29% Castro::construct_old_gravity_source() 10 0.004292 0.006572 0.008288 0.26% Castro::derive() 55 0.005041 0.006502 0.007814 0.25% Castro::volWgtSum() 176 0.006667 0.007126 0.007734 0.25% Castro::initMFs() 1 0.003539 0.005322 0.007028 0.22% Castro::fill_hybrid_hydro_source() 30 0.004344 0.005767 0.006837 0.22% Gravity::get_old_grav_vector() 10 0.003037 0.005197 0.006683 0.21% Castro::swap_state_time_levels() 10 0.001824 0.003925 0.005701 0.18% StateData::define() 4 0.003304 0.004368 0.005235 0.17% Castro::enforce_min_density() 62 0.003622 0.004457 0.004835 0.15% Castro::initData() 1 0.001713 0.002338 0.002958 0.09% Castro::post_init() 1 4.046e-05 0.001189 0.002528 0.08% main() 1 0.0007658 0.001031 0.001559 0.05% Castro::buildMetrics() 1 0.0008276 0.001082 0.001332 0.04% Castro::subcycle_advance_ctu() 10 5.429e-05 0.0001293 0.00106 0.03% Amr::InitAmr() 1 0.0002466 0.0003718 0.000554 0.02% Castro::locSquaredSum() 11 0.0004034 0.0004537 0.0005033 0.02% Amr::coarseTimeStep() 10 0.0002942 0.0003566 0.0004567 0.01% Amr::writeSmallPlotFile() 1 4.158e-05 8.23e-05 0.0004383 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002923 0.0003427 0.0004282 0.01% DistributionMapping::LeastUsedCPUs() 1 1.072e-05 0.0002354 0.0003881 0.01% Castro::clean_state() 62 0.0002459 0.0002943 0.0003448 0.01% StateData::checkPoint() 12 2.28e-05 4.922e-05 0.0002963 0.01% StateDataPhysBCFunct::() 119 0.0001657 0.0002079 0.0002822 0.01% Castro::linear_to_hybrid_momentum() 1 0.0001228 0.0002186 0.0002546 0.01% Castro::Castro() 1 7.539e-05 0.0001293 0.0001858 0.01% Castro::construct_new_source() 70 9.016e-05 0.0001282 0.0001655 0.01% Castro::computeNewDt() 9 1.068e-05 2.176e-05 0.0001613 0.01% FabArray::ParallelCopy() 119 9.831e-05 0.0001176 0.0001452 0.00% Castro::finalize_advance() 10 9.091e-05 0.0001183 0.0001441 0.00% AmrLevel::checkPoint() 3 4.669e-05 6.905e-05 0.0001405 0.00% FillPatchSingleLevel 119 9.943e-05 0.0001165 0.0001379 0.00% Castro::construct_old_source() 70 6.524e-05 8.76e-05 0.0001328 0.00% Castro::enforce_consistent_e() 1 4.045e-05 7.988e-05 0.0001285 0.00% Amr::timeStep() 10 5.091e-05 6.099e-05 0.0001156 0.00% Castro::construct_old_gravity() 10 5.736e-05 8e-05 9.6e-05 0.00% Castro::construct_new_gravity() 10 3.921e-05 5.979e-05 9.568e-05 0.00% Castro::apply_source_to_state() 20 5.006e-05 6.491e-05 8.262e-05 0.00% Castro::advance() 10 4.416e-05 5.391e-05 6.454e-05 0.00% FabArrayBase::getCPC() 20 3.895e-05 4.856e-05 6.287e-05 0.00% FabArrayBase::CPC::define() 2 3.066e-05 4.171e-05 6.264e-05 0.00% Castro::enforce_speed_limit() 62 4.627e-05 5.22e-05 6.07e-05 0.00% Castro::check_for_nan() 20 2.988e-05 3.823e-05 5.727e-05 0.00% Castro::construct_old_hybrid_source() 10 1.332e-05 2.125e-05 5.653e-05 0.00% Castro::construct_new_hybrid_source() 10 1.806e-05 3.261e-05 5.456e-05 0.00% Amr::defBaseLevel() 1 3.322e-05 4.092e-05 4.801e-05 0.00% Amr::FinalizeInit() 1 3.981e-06 8.139e-06 4.656e-05 0.00% Gravity::swapTimeLevels() 10 1.723e-05 2.861e-05 3.981e-05 0.00% Castro::retry_advance_ctu() 10 6.872e-06 1.06e-05 3.047e-05 0.00% Castro::create_source_corrector() 10 1.297e-05 1.771e-05 2.545e-05 0.00% Amr::initSubcycle() 1 8.346e-06 1.333e-05 2.459e-05 0.00% Castro::construct_new_rotation_source() 10 8.298e-06 1.343e-05 2.03e-05 0.00% AmrLevel::AmrLevel(dm) 1 9.322e-06 1.14e-05 1.445e-05 0.00% Gravity::set_mass_offset() 10 7.636e-06 9.76e-06 1.257e-05 0.00% Castro::construct_old_rotation_source() 10 4.901e-06 8.101e-06 1.208e-05 0.00% Castro::FluxRegCrseInit 10 8.194e-06 9.535e-06 1.174e-05 0.00% Castro::gwstrain() 11 7.003e-06 9.356e-06 1.131e-05 0.00% AmrLevel::checkPointPost() 3 4.384e-06 6.438e-06 1.003e-05 0.00% Amr::InitializeInit() 1 2.34e-06 3.639e-06 8.862e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.542e-06 6.318e-06 8.638e-06 0.00% AmrLevel::checkPointPre() 3 2.933e-06 5.473e-06 8.149e-06 0.00% Castro::computeInitialDt() 2 2.941e-06 4.223e-06 6.677e-06 0.00% Castro::post_regrid() 1 2.007e-06 3.725e-06 5.217e-06 0.00% Castro::FluxRegFineAdd() 10 3.192e-06 4.107e-06 4.78e-06 0.00% Amr::init() 1 2.8e-06 3.224e-06 3.853e-06 0.00% Amr::initialInit() 1 1.339e-06 2.187e-06 3.015e-06 0.00% DistributionMapping::Distribute() 1 1.367e-06 1.974e-06 2.362e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.14 3.14 3.141 100.00% Amr::coarseTimeStep() 10 2.617 2.617 2.617 83.33% Amr::timeStep() 10 2.577 2.577 2.577 82.05% Castro::advance() 10 2.508 2.529 2.535 80.72% Castro::subcycle_advance_ctu() 10 2.412 2.439 2.484 79.09% Castro::do_advance_ctu() 10 2.411 2.439 2.484 79.09% Castro::construct_ctu_hydro_source() 10 1.512 1.726 1.916 60.99% Amr::writePlotFile() 2 0.4166 0.4166 0.4166 13.26% Amr::init() 1 0.3697 0.3699 0.37 11.78% Castro::initialize_do_advance() 10 0.1798 0.1973 0.2227 7.09% FillPatchIterator::Initialize 119 0.1576 0.1878 0.2129 6.78% FillPatchSingleLevel 119 0.1116 0.1459 0.17 5.41% Castro::expand_state() 10 0.1144 0.1334 0.1641 5.22% Castro::clean_state() 62 0.1239 0.1359 0.1476 4.70% FabArray::ParallelCopy() 119 0.08601 0.1193 0.1469 4.68% FabArray::ParallelCopy_finish() 119 0.05618 0.08484 0.127 4.04% Castro::do_old_sources() 10 0.03701 0.05911 0.1013 3.22% Castro::initialize_advance() 10 0.04207 0.08934 0.1009 3.21% Castro::computeTemp() 63 0.08451 0.09006 0.0979 3.12% Amr::checkPoint() 3 0.09732 0.09743 0.09745 3.10% FabArray::setVal() 164 0.03221 0.08003 0.08967 2.85% Castro::do_new_sources() 10 0.05793 0.0703 0.08128 2.59% Castro::post_timestep() 10 0.04163 0.0482 0.06834 2.18% VisMF::Write(FabArray) 11 0.03668 0.04655 0.06049 1.93% Castro::reset_internal_energy(MultiFab) 63 0.05207 0.05556 0.06039 1.92% Castro::reset_internal_energy(Fab) 504 0.05164 0.05522 0.06005 1.91% FabArray::ParallelCopy_nowait() 119 0.01976 0.03439 0.04465 1.42% Castro::estTimeStep() 21 0.01953 0.03091 0.04368 1.39% AmrLevel::checkPoint() 3 0.02694 0.03456 0.04175 1.33% StateData::checkPoint() 12 0.02689 0.03449 0.04161 1.32% Amr::initialInit() 1 0.03861 0.03875 0.0389 1.24% StateDataPhysBCFunct::() 119 0.01797 0.02647 0.03362 1.07% StateData::FillBoundary(geom) 20 0.01779 0.02627 0.0334 1.06% Castro::finalize_do_advance() 10 0.001972 0.02198 0.02849 0.91% Castro::normalize_species() 62 0.02361 0.02531 0.02783 0.89% Amr::InitializeInit() 1 0.01434 0.02228 0.027 0.86% Amr::defBaseLevel() 1 0.01434 0.02228 0.027 0.86% Castro::construct_new_source() 70 0.01624 0.02429 0.02642 0.84% Amr::FinalizeInit() 1 0.0116 0.01647 0.02451 0.78% Castro::sum_integrated_quantities() 11 0.02416 0.02419 0.02423 0.77% Castro::construct_new_gravity_source() 10 0.01316 0.02019 0.02246 0.71% Castro::hybrid_to_linear_momentum() 62 0.01305 0.01735 0.01981 0.63% Castro::apply_source_to_state() 20 0.009211 0.01346 0.01557 0.50% MultiFab::Saxpy() 20 0.009132 0.0134 0.0155 0.49% Gravity::get_new_grav_vector() 11 0.007581 0.01284 0.0154 0.49% Castro::computeInitialDt() 2 0.002351 0.00721 0.01524 0.49% Castro::check_for_nan() 20 0.006489 0.01095 0.01494 0.48% MultiFab::contains_nan() 20 0.006459 0.01091 0.0149 0.47% Castro::construct_new_gravity() 10 0.006933 0.01206 0.01461 0.47% Castro::derive() 55 0.009097 0.01213 0.01369 0.44% Castro::construct_old_gravity() 10 0.007295 0.01052 0.01265 0.40% Gravity::get_old_grav_vector() 10 0.006882 0.009812 0.01193 0.38% FabArray::setDomainBndry() 119 0.004844 0.007978 0.01187 0.38% Castro::Castro() 1 0.005141 0.008967 0.01176 0.37% Castro::construct_old_source() 70 0.005868 0.008539 0.01058 0.34% Castro::initData() 1 0.005491 0.008648 0.009953 0.32% Gravity::add_pointmass_to_gravity() 21 0.006846 0.008079 0.009175 0.29% Castro::post_init() 1 0.007106 0.007891 0.008657 0.28% Castro::construct_old_gravity_source() 10 0.004292 0.006572 0.008288 0.26% Castro::computeNewDt() 9 0.007622 0.007722 0.007777 0.25% Castro::volWgtSum() 176 0.006667 0.007126 0.007734 0.25% Castro::initMFs() 1 0.003539 0.005322 0.007028 0.22% Castro::fill_hybrid_hydro_source() 30 0.004344 0.005767 0.006837 0.22% Castro::swap_state_time_levels() 10 0.001824 0.003925 0.005701 0.18% AmrLevel::AmrLevel(dm) 1 0.003314 0.004379 0.005247 0.17% StateData::define() 4 0.003304 0.004368 0.005235 0.17% Castro::enforce_min_density() 62 0.003622 0.004457 0.004835 0.15% Castro::construct_new_hybrid_source() 10 0.002894 0.00395 0.00469 0.15% Castro::post_regrid() 1 0.001666 0.002434 0.003216 0.10% Castro::construct_old_hybrid_source() 10 0.001489 0.001871 0.002285 0.07% Castro::buildMetrics() 1 0.0008967 0.0012 0.001498 0.05% Castro::locSquaredSum() 11 0.00105 0.001146 0.001244 0.04% Amr::InitAmr() 1 0.000256 0.0003852 0.0005785 0.02% Amr::writeSmallPlotFile() 1 4.158e-05 8.23e-05 0.0004383 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.86e-05 0.0002437 0.0003968 0.01% DistributionMapping::LeastUsedCPUs() 1 1.072e-05 0.0002354 0.0003881 0.01% Castro::linear_to_hybrid_momentum() 1 0.0001228 0.0002186 0.0002546 0.01% Castro::finalize_advance() 10 0.0001034 0.0001319 0.0001582 0.01% Castro::enforce_consistent_e() 1 4.045e-05 7.988e-05 0.0001285 0.00% FabArrayBase::getCPC() 20 7.379e-05 9.027e-05 0.0001114 0.00% FabArrayBase::CPC::define() 2 3.066e-05 4.171e-05 6.264e-05 0.00% Castro::enforce_speed_limit() 62 4.627e-05 5.22e-05 6.07e-05 0.00% Gravity::swapTimeLevels() 10 1.723e-05 2.861e-05 3.981e-05 0.00% Castro::retry_advance_ctu() 10 6.872e-06 1.06e-05 3.047e-05 0.00% Castro::create_source_corrector() 10 1.297e-05 1.771e-05 2.545e-05 0.00% Amr::initSubcycle() 1 8.346e-06 1.333e-05 2.459e-05 0.00% Castro::construct_new_rotation_source() 10 8.298e-06 1.343e-05 2.03e-05 0.00% Gravity::set_mass_offset() 10 7.636e-06 9.76e-06 1.257e-05 0.00% Castro::construct_old_rotation_source() 10 4.901e-06 8.101e-06 1.208e-05 0.00% Castro::FluxRegCrseInit 10 8.194e-06 9.535e-06 1.174e-05 0.00% Castro::gwstrain() 11 7.003e-06 9.356e-06 1.131e-05 0.00% AmrLevel::checkPointPost() 3 4.384e-06 6.438e-06 1.003e-05 0.00% AmrLevel::checkPointPre() 3 2.933e-06 5.473e-06 8.149e-06 0.00% Castro::FluxRegFineAdd() 10 3.192e-06 4.107e-06 4.78e-06 0.00% DistributionMapping::Distribute() 1 1.367e-06 1.974e-06 2.362e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.05-3-gdf9b6944a6d5) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.05-3-gdf9b6944a6d5) initialized Starting run at 00:33:23 UTC on 2022-05-03. Successfully read inputs file ... Castro git describe: 22.05-3-g7c11e57ab AMReX git describe: 22.05-3-gdf9b6944a Microphysics git describe: 22.05 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 29.51550365 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.038103214 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006980962 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.28908169 Castro::do_new_sources() time = 0.009637544 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.6875419803 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.389818312 [STEP 6] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00692188 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.276843307 Castro::do_new_sources() time = 0.00890301 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7215014801 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.371480541 [STEP 7] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00634632 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.270665903 Castro::do_new_sources() time = 0.008742896 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7381332994 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.362861047 [STEP 8] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005514125 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.195064283 Castro::do_new_sources() time = 0.009782061 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.9537544359 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.28232384 [STEP 9] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005838391 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.172793672 Castro::do_new_sources() time = 0.009448903 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.081689809 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.24873919 [STEP 10] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.059202354 seconds Ending run at 00:33:25 UTC on 2022-05-03. Run time = 1.756133723 Run time without initialization = 1.717626375 Average number of zones advanced per microsecond: 0.763 Average number of zones advanced per microsecond per rank: 0.048 TinyProfiler total time across processes [min...avg...max]: 1.755 ... 1.756 ... 1.756 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.8752 1.0802 1.2057 68.65% Castro::do_advance_ctu() 5 0.01796 0.1524 0.3757 21.39% FabArray::ParallelCopy_finish() 56 0.03154 0.05751 0.0865 4.93% Amr::writePlotFile() 1 0.05122 0.05345 0.05391 3.07% FabArray::setVal() 80 0.03645 0.04647 0.05331 3.04% Castro::do_old_sources() 5 8.48e-05 0.01227 0.04346 2.47% Castro::reset_internal_energy(Fab) 240 0.0234 0.03091 0.03781 2.15% StateData::FillBoundary(geom) 10 0.01069 0.02101 0.03199 1.82% Castro::estTimeStep() 10 0.01013 0.01782 0.03183 1.81% FabArray::ParallelCopy_nowait() 56 0.01437 0.02225 0.03008 1.71% FillPatchIterator::Initialize 56 0.01784 0.02259 0.0262 1.49% Castro::computeTemp() 30 0.01523 0.01952 0.02418 1.38% Castro::normalize_species() 30 0.01148 0.01499 0.01955 1.11% VisMF::Read() 3 0.01699 0.01871 0.01933 1.10% Castro::expand_state() 5 0.008511 0.01413 0.01891 1.08% Castro::finalize_do_advance() 5 0.008173 0.01445 0.01824 1.04% Castro::initialize_do_advance() 5 0.01104 0.0144 0.01716 0.98% Castro::do_new_sources() 5 9.519e-05 0.005393 0.01692 0.96% Castro::construct_new_gravity_source() 5 0.01221 0.01432 0.01622 0.92% Castro::post_timestep() 5 0.001596 0.007358 0.01575 0.90% Castro::initialize_advance() 5 0.007731 0.01148 0.01434 0.82% Castro::hybrid_to_linear_momentum() 30 0.007568 0.0111 0.01424 0.81% MultiFab::contains_nan() 10 0.005975 0.007876 0.01052 0.60% MultiFab::Saxpy() 10 0.006666 0.008156 0.009738 0.55% VisMF::Write(FabArray) 1 0.005958 0.006415 0.008646 0.49% Amr::restart() 1 0.008149 0.008216 0.008388 0.48% Castro::sum_integrated_quantities() 5 0.001676 0.004219 0.007566 0.43% FabArray::setDomainBndry() 56 0.002728 0.005274 0.007159 0.41% Gravity::get_new_grav_vector() 5 0.003158 0.004709 0.006772 0.39% Castro::derive() 26 0.00399 0.005363 0.006661 0.38% Castro::construct_old_gravity_source() 5 0.002836 0.004687 0.006461 0.37% Gravity::add_pointmass_to_gravity() 10 0.003865 0.004706 0.005643 0.32% Castro::initMFs() 1 0.004492 0.004722 0.004908 0.28% Castro::swap_state_time_levels() 5 0.004193 0.004496 0.004768 0.27% Castro::fill_hybrid_hydro_source() 15 0.002341 0.003693 0.004553 0.26% Castro::post_restart() 1 5.691e-05 0.00129 0.004489 0.26% StateData::restartDoit() 4 0.00291 0.003773 0.004092 0.23% Castro::volWgtSum() 80 0.003147 0.003689 0.003919 0.22% Gravity::get_old_grav_vector() 5 0.0027 0.003052 0.003481 0.20% Castro::enforce_min_density() 30 0.002038 0.002685 0.003254 0.19% main() 1 0.00174 0.002231 0.002522 0.14% Castro::finalize_advance() 5 0.0001881 0.001035 0.001521 0.09% Castro::subcycle_advance_ctu() 5 2.776e-05 8.189e-05 0.0007932 0.05% Castro::buildMetrics() 1 0.0002159 0.0003994 0.0005988 0.03% Amr::InitAmr() 1 0.0002384 0.0003768 0.0004572 0.03% Castro::locSquaredSum() 6 0.0002134 0.0003024 0.0003821 0.02% Amr::coarseTimeStep() 5 0.0002045 0.0002531 0.000318 0.02% AmrLevel::restart() 1 0.0001307 0.0002172 0.0002641 0.02% Castro::reset_internal_energy(MultiFab) 30 0.0001162 0.0001796 0.0002378 0.01% Castro::clean_state() 30 0.0001127 0.0001702 0.0002126 0.01% StateDataPhysBCFunct::() 56 6.274e-05 0.0001143 0.0001626 0.01% Castro::computeNewDt() 5 4.426e-06 1.386e-05 0.0001269 0.01% FillPatchSingleLevel 56 4.485e-05 7.639e-05 0.0001039 0.01% Castro::construct_new_source() 35 4.692e-05 7.642e-05 9.905e-05 0.01% FabArray::ParallelCopy() 56 4.452e-05 7.159e-05 9.603e-05 0.01% Castro::construct_new_gravity() 5 2.436e-05 4.577e-05 8.924e-05 0.01% Amr::timeStep() 5 2.752e-05 3.676e-05 8.515e-05 0.00% FabArrayBase::CPC::define() 2 3.362e-05 5.406e-05 8.104e-05 0.00% Castro::construct_old_source() 35 2.965e-05 4.787e-05 6.849e-05 0.00% Castro::construct_old_gravity() 5 3.294e-05 5.074e-05 6.26e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 8.787e-06 2.381e-05 5.023e-05 0.00% Castro::advance() 5 2.423e-05 3.018e-05 4.96e-05 0.00% Castro::check_for_nan() 10 1.613e-05 2.887e-05 4.943e-05 0.00% Castro::construct_new_hybrid_source() 5 9.793e-06 2.41e-05 3.985e-05 0.00% Amr::writeSmallPlotFile() 1 3.122e-05 3.429e-05 3.754e-05 0.00% FabArrayBase::getCPC() 10 1.818e-05 2.823e-05 3.622e-05 0.00% Castro::apply_source_to_state() 10 2.284e-05 2.972e-05 3.612e-05 0.00% Castro::enforce_speed_limit() 30 1.262e-05 1.688e-05 2.709e-05 0.00% Gravity::swapTimeLevels() 5 6.935e-06 1.587e-05 2.36e-05 0.00% Castro::create_source_corrector() 5 7.889e-06 1.263e-05 1.801e-05 0.00% Amr::initSubcycle() 1 8.184e-06 1.298e-05 1.484e-05 0.00% Castro::construct_old_hybrid_source() 5 6.933e-06 1.075e-05 1.329e-05 0.00% Castro::construct_new_rotation_source() 5 5.084e-06 7.722e-06 1.105e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.994e-06 7.062e-06 8.261e-06 0.00% Gravity::set_mass_offset() 6 3.517e-06 5.929e-06 8.172e-06 0.00% Castro::gwstrain() 5 3.924e-06 5.637e-06 7.526e-06 0.00% Castro::construct_old_rotation_source() 5 3.147e-06 5.579e-06 7.464e-06 0.00% Castro::retry_advance_ctu() 5 4.381e-06 5.598e-06 7.285e-06 0.00% Castro::FluxRegCrseInit 5 3.463e-06 5.033e-06 5.992e-06 0.00% Amr::init() 1 9.1e-07 1.614e-06 5.749e-06 0.00% Castro::FluxRegFineAdd() 5 1.938e-06 2.5e-06 3.572e-06 0.00% DistributionMapping::Distribute() 1 2.034e-06 2.341e-06 2.916e-06 0.00% AmrLevel::AmrLevel() 1 1.445e-06 1.735e-06 2.15e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.755 1.756 1.756 100.00% Amr::coarseTimeStep() 5 1.655 1.655 1.655 94.26% Amr::timeStep() 5 1.649 1.65 1.65 93.93% Castro::advance() 5 1.609 1.615 1.619 92.18% Castro::subcycle_advance_ctu() 5 1.548 1.556 1.567 89.22% Castro::do_advance_ctu() 5 1.548 1.556 1.567 89.22% Castro::construct_ctu_hydro_source() 5 0.8752 1.08 1.206 68.65% Castro::initialize_do_advance() 5 0.1151 0.13 0.1534 8.73% FillPatchIterator::Initialize 56 0.1112 0.129 0.1528 8.70% FillPatchSingleLevel 56 0.08215 0.1011 0.127 7.23% FabArray::ParallelCopy() 56 0.05236 0.07992 0.1103 6.28% Castro::expand_state() 5 0.07465 0.0899 0.106 6.04% Castro::clean_state() 30 0.05996 0.07957 0.09881 5.63% FabArray::ParallelCopy_finish() 56 0.03154 0.05751 0.0865 4.93% Castro::initialize_advance() 5 0.04209 0.058 0.06771 3.86% Castro::do_old_sources() 5 0.02352 0.03764 0.06566 3.74% Castro::computeTemp() 30 0.03875 0.0506 0.06153 3.50% Amr::writePlotFile() 1 0.05986 0.05987 0.05987 3.41% Castro::do_new_sources() 5 0.03825 0.04696 0.05779 3.29% FabArray::setVal() 80 0.03645 0.04647 0.05331 3.04% Castro::post_timestep() 5 0.0306 0.03447 0.04101 2.34% Amr::init() 1 0.03786 0.03796 0.03814 2.17% Amr::restart() 1 0.03786 0.03795 0.03814 2.17% Castro::reset_internal_energy(MultiFab) 30 0.02352 0.03109 0.03805 2.17% Castro::reset_internal_energy(Fab) 240 0.0234 0.03091 0.03781 2.15% StateDataPhysBCFunct::() 56 0.01075 0.02112 0.03213 1.83% StateData::FillBoundary(geom) 10 0.01069 0.02101 0.03199 1.82% Castro::estTimeStep() 10 0.01013 0.01782 0.03183 1.81% FabArray::ParallelCopy_nowait() 56 0.01442 0.02233 0.03016 1.72% AmrLevel::restart() 1 0.02023 0.02285 0.02377 1.35% StateData::restartDoit() 4 0.02003 0.0226 0.0235 1.34% Castro::normalize_species() 30 0.01148 0.01499 0.01955 1.11% VisMF::Read() 3 0.01699 0.01871 0.01933 1.10% Castro::construct_new_source() 35 0.01384 0.01702 0.01901 1.08% Castro::finalize_do_advance() 5 0.008173 0.01445 0.01824 1.04% Castro::sum_integrated_quantities() 5 0.01726 0.01727 0.01732 0.99% Castro::construct_new_gravity_source() 5 0.01221 0.01432 0.01622 0.92% Castro::hybrid_to_linear_momentum() 30 0.007568 0.0111 0.01424 0.81% Castro::derive() 26 0.007044 0.009931 0.01224 0.70% Castro::construct_new_gravity() 5 0.005837 0.008327 0.01188 0.68% Gravity::get_new_grav_vector() 5 0.005509 0.007843 0.01108 0.63% Castro::check_for_nan() 10 0.005995 0.007904 0.01056 0.60% MultiFab::contains_nan() 10 0.005975 0.007876 0.01052 0.60% Castro::apply_source_to_state() 10 0.006695 0.008186 0.009771 0.56% MultiFab::Saxpy() 10 0.006666 0.008156 0.009738 0.55% VisMF::Write(FabArray) 1 0.005958 0.006415 0.008646 0.49% Castro::construct_old_source() 35 0.003795 0.005858 0.007912 0.45% Castro::construct_old_gravity() 5 0.005622 0.006476 0.007363 0.42% FabArray::setDomainBndry() 56 0.002728 0.005274 0.007159 0.41% Gravity::get_old_grav_vector() 5 0.005228 0.006049 0.006938 0.40% Castro::construct_old_gravity_source() 5 0.002836 0.004687 0.006461 0.37% Castro::computeNewDt() 5 0.005539 0.005599 0.005644 0.32% Gravity::add_pointmass_to_gravity() 10 0.003865 0.004706 0.005643 0.32% Castro::initMFs() 1 0.004492 0.004722 0.004908 0.28% Castro::swap_state_time_levels() 5 0.004193 0.004496 0.004768 0.27% Castro::post_restart() 1 0.0004189 0.001597 0.004709 0.27% Castro::fill_hybrid_hydro_source() 15 0.002341 0.003693 0.004553 0.26% Castro::volWgtSum() 80 0.003147 0.003689 0.003919 0.22% Castro::enforce_min_density() 30 0.002038 0.002685 0.003254 0.19% Castro::construct_new_hybrid_source() 5 0.001577 0.00261 0.003186 0.18% Castro::finalize_advance() 5 0.0001943 0.001043 0.00153 0.09% Castro::construct_old_hybrid_source() 5 0.0007821 0.001118 0.001412 0.08% Castro::locSquaredSum() 6 0.0006958 0.0008769 0.001019 0.06% Castro::buildMetrics() 1 0.0002761 0.0005628 0.0008421 0.05% Amr::InitAmr() 1 0.000247 0.0003898 0.0004706 0.03% FabArrayBase::getCPC() 10 5.18e-05 8.229e-05 0.0001092 0.01% FabArrayBase::CPC::define() 2 3.362e-05 5.406e-05 8.104e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 1.794e-05 3.321e-05 5.977e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 8.787e-06 2.381e-05 5.023e-05 0.00% Amr::writeSmallPlotFile() 1 3.122e-05 3.429e-05 3.754e-05 0.00% Castro::enforce_speed_limit() 30 1.262e-05 1.688e-05 2.709e-05 0.00% Gravity::swapTimeLevels() 5 6.935e-06 1.587e-05 2.36e-05 0.00% Castro::create_source_corrector() 5 7.889e-06 1.263e-05 1.801e-05 0.00% Amr::initSubcycle() 1 8.184e-06 1.298e-05 1.484e-05 0.00% Castro::construct_new_rotation_source() 5 5.084e-06 7.722e-06 1.105e-05 0.00% Gravity::set_mass_offset() 6 3.517e-06 5.929e-06 8.172e-06 0.00% Castro::gwstrain() 5 3.924e-06 5.637e-06 7.526e-06 0.00% Castro::construct_old_rotation_source() 5 3.147e-06 5.579e-06 7.464e-06 0.00% Castro::retry_advance_ctu() 5 4.381e-06 5.598e-06 7.285e-06 0.00% Castro::FluxRegCrseInit 5 3.463e-06 5.033e-06 5.992e-06 0.00% Castro::FluxRegFineAdd() 5 1.938e-06 2.5e-06 3.572e-06 0.00% DistributionMapping::Distribute() 1 2.034e-06 2.341e-06 2.916e-06 0.00% AmrLevel::AmrLevel() 1 1.445e-06 1.735e-06 2.15e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.05-3-gdf9b6944a6d5) finalized