MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.10-10-gd39abbc396d0) initialized Starting run at 07:04:21 UTC on 2023-10-09. Successfully read inputs file ... Castro git describe: 23.10-20-gb68e0ef43 AMReX git describe: 23.10-10-gd39abbc39 Microphysics git describe: 23.10-6-g657406dc reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,8,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 68.62410327 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 TIME= 0 CENTER OF MASS X-LOC = -3.507302194e-17 TIME= 0 CENTER OF MASS X-VEL = 1.87056117e-16 TIME= 0 CENTER OF MASS Y-LOC = -8.160323104e-15 TIME= 0 CENTER OF MASS Y-VEL = -2.805841755e-16 TIME= 0 CENTER OF MASS Z-LOC = 2.273900922e-15 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 1 TIME= 0 MAXIMUM DENSITY = 0.9718858833 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.018654833 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.175789143 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,8,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE at time 0 with dt = 0.0003340435764 [1m[32m Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.002160712 on level 0 Castro::do_old_sources() time = 0.024676011 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.287572138 on level 0 Castro::construct_new_gravity() time = 0.002124023 on level 0 Castro::do_new_sources() time = 0.01018152 on level 0 ...estimated hydro-limited timestep at level 0: 0.003354140473 ...hydro-limited CFL timestep constrained at (i,j,k) = (8,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.6977123613 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 TIME= 0.0003340435764 CENTER OF MASS X-LOC = 3.74112234e-16 TIME= 0.0003340435764 CENTER OF MASS X-VEL = -5.61168351e-16 TIME= 0.0003340435764 CENTER OF MASS Y-LOC = -2.034235272e-15 TIME= 0.0003340435764 CENTER OF MASS Y-VEL = -5.892267685e-15 TIME= 0.0003340435764 CENTER OF MASS Z-LOC = 1.921880308e-10 TIME= 0.0003340435764 CENTER OF MASS Z-VEL = -1.069965054e-12 TIME= 0.0003340435764 MAXIMUM TEMPERATURE = 1 TIME= 0.0003340435764 MAXIMUM DENSITY = 0.9714984616 [STEP 1] Coarse TimeStep time: 0.384023815 [STEP 1] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 ...hydro-limited CFL timestep constrained at (i,j,k) = (8,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE at time 0.0003340435764 with dt = 0.0003507457552 [1m[32m Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.001614595 on level 0 Castro::do_old_sources() time = 0.025429978 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.285349517 on level 0 Castro::construct_new_gravity() time = 0.00278395 on level 0 Castro::do_new_sources() time = 0.010055951 on level 0 ...estimated hydro-limited timestep at level 0: 0.003373674841 ...hydro-limited CFL timestep constrained at (i,j,k) = (8,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.7180254799 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 TIME= 0.0006847893316 CENTER OF MASS X-LOC = -5.962413729e-16 TIME= 0.0006847893316 CENTER OF MASS X-VEL = -2.057617287e-15 TIME= 0.0006847893316 CENTER OF MASS Y-LOC = 2.338201462e-17 TIME= 0.0006847893316 CENTER OF MASS Y-VEL = 1.543212965e-14 TIME= 0.0006847893316 CENTER OF MASS Z-LOC = 1.922627422e-10 TIME= 0.0006847893316 CENTER OF MASS Z-VEL = -3.311406408e-12 TIME= 0.0006847893316 MAXIMUM TEMPERATURE = 1 TIME= 0.0006847893316 MAXIMUM DENSITY = 0.9710949434 [STEP 2] Coarse TimeStep time: 0.373086933 [STEP 2] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 ...hydro-limited CFL timestep constrained at (i,j,k) = (8,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE at time 0.0006847893316 with dt = 0.000368283043 [1m[32m Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.0018593 on level 0 Castro::do_old_sources() time = 0.023736227 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.276789876 on level 0 Castro::construct_new_gravity() time = 0.003606867 on level 0 Castro::do_new_sources() time = 0.009430908 on level 0 ...estimated hydro-limited timestep at level 0: 0.00339481947 ...hydro-limited CFL timestep constrained at (i,j,k) = (9,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.7427061078 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 TIME= 0.001053072375 CENTER OF MASS X-LOC = -1.169100731e-16 TIME= 0.001053072375 CENTER OF MASS X-VEL = -2.805841755e-15 TIME= 0.001053072375 CENTER OF MASS Y-LOC = 1.26262879e-15 TIME= 0.001053072375 CENTER OF MASS Y-VEL = 5.798739627e-15 TIME= 0.001053072375 CENTER OF MASS Z-LOC = 1.924413866e-10 TIME= 0.001053072375 CENTER OF MASS Z-VEL = -5.655717666e-12 TIME= 0.001053072375 MAXIMUM TEMPERATURE = 1 TIME= 0.001053072375 MAXIMUM DENSITY = 0.9706649077 [STEP 3] Coarse TimeStep time: 0.361203044 [STEP 3] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 ...hydro-limited CFL timestep constrained at (i,j,k) = (9,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE at time 0.001053072375 with dt = 0.0003866971951 [1m[32m Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.001319765 on level 0 Castro::do_old_sources() time = 0.016967501 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.186429673 on level 0 Castro::construct_new_gravity() time = 0.001942875 on level 0 Castro::do_new_sources() time = 0.009619841 on level 0 ...estimated hydro-limited timestep at level 0: 0.002981054165 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.044972729 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 TIME= 0.00143976957 CENTER OF MASS X-LOC = -3.74112234e-16 TIME= 0.00143976957 CENTER OF MASS X-VEL = 1.496448936e-15 TIME= 0.00143976957 CENTER OF MASS Y-LOC = 8.417525264e-16 TIME= 0.00143976957 CENTER OF MASS Y-VEL = 9.165749732e-15 TIME= 0.00143976957 CENTER OF MASS Z-LOC = 1.927710262e-10 TIME= 0.00143976957 CENTER OF MASS Z-VEL = -8.112840762e-12 TIME= 0.00143976957 MAXIMUM TEMPERATURE = 1 TIME= 0.00143976957 MAXIMUM DENSITY = 0.9701948916 [STEP 4] Coarse TimeStep time: 0.256458073 [STEP 4] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE at time 0.00143976957 with dt = 0.0004060320549 [1m[32m Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.001701407 on level 0 Castro::do_old_sources() time = 0.017892315 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.174170491 on level 0 Castro::construct_new_gravity() time = 0.001635043 on level 0 Castro::do_new_sources() time = 0.009319871 on level 0 ...estimated hydro-limited timestep at level 0: 0.002422517818 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.099913218 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 TIME= 0.001845801625 CENTER OF MASS X-LOC = 7.599154753e-16 TIME= 0.001845801625 CENTER OF MASS X-VEL = 1.496448936e-15 TIME= 0.001845801625 CENTER OF MASS Y-LOC = 1.660123038e-15 TIME= 0.001845801625 CENTER OF MASS Y-VEL = 1.318745625e-14 TIME= 0.001845801625 CENTER OF MASS Z-LOC = 1.932321839e-10 TIME= 0.001845801625 CENTER OF MASS Z-VEL = -1.069255261e-11 TIME= 0.001845801625 MAXIMUM TEMPERATURE = 1 TIME= 0.001845801625 MAXIMUM DENSITY = 0.9696839384 [STEP 5] Coarse TimeStep time: 0.243689814 [STEP 5] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.017043999 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE at time 0.001845801625 with dt = 0.0004263336576 [1m[32m Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.00160923 on level 0 Castro::do_old_sources() time = 0.022244531 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.184131884 on level 0 Castro::construct_new_gravity() time = 0.003054539 on level 0 Castro::do_new_sources() time = 0.010111297 on level 0 ...estimated hydro-limited timestep at level 0: 0.002054026253 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.045503237 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 TIME= 0.002272135282 CENTER OF MASS X-LOC = -2.104381316e-16 TIME= 0.002272135282 CENTER OF MASS X-VEL = 7.48224468e-16 TIME= 0.002272135282 CENTER OF MASS Y-LOC = 1.169100731e-16 TIME= 0.002272135282 CENTER OF MASS Y-VEL = 1.150395119e-14 TIME= 0.002272135282 CENTER OF MASS Z-LOC = 1.935970602e-10 TIME= 0.002272135282 CENTER OF MASS Z-VEL = -1.340158253e-11 TIME= 0.002272135282 MAXIMUM TEMPERATURE = 1 TIME= 0.002272135282 MAXIMUM DENSITY = 0.9691277593 [STEP 6] Coarse TimeStep time: 0.256064987 [STEP 6] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE at time 0.002272135282 with dt = 0.0004476503405 [1m[32m Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.000864816 on level 0 Castro::do_old_sources() time = 0.012297756 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.165127174 on level 0 Castro::construct_new_gravity() time = 0.001912737 on level 0 Castro::do_new_sources() time = 0.008393471 on level 0 ...estimated hydro-limited timestep at level 0: 0.001791126456 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.200854104 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 TIME= 0.002719785623 CENTER OF MASS X-LOC = 1.987471243e-16 TIME= 0.002719785623 CENTER OF MASS X-VEL = -3.179953989e-15 TIME= 0.002719785623 CENTER OF MASS Y-LOC = -4.676402925e-17 TIME= 0.002719785623 CENTER OF MASS Y-VEL = 6.359907978e-15 TIME= 0.002719785623 CENTER OF MASS Z-LOC = 1.939871541e-10 TIME= 0.002719785623 CENTER OF MASS Z-VEL = -1.624689381e-11 TIME= 0.002719785623 MAXIMUM TEMPERATURE = 1 TIME= 0.002719785623 MAXIMUM DENSITY = 0.9685217096 [STEP 7] Coarse TimeStep time: 0.22314669 [STEP 7] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE at time 0.002719785623 with dt = 0.0004700328575 [1m[32m Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.000939735 on level 0 Castro::do_old_sources() time = 0.010556948 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.165420245 on level 0 Castro::construct_new_gravity() time = 0.000975716 on level 0 Castro::do_new_sources() time = 0.005756141 on level 0 ...estimated hydro-limited timestep at level 0: 0.001590548666 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.248150021 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 TIME= 0.00318981848 CENTER OF MASS X-LOC = 5.962413729e-16 TIME= 0.00318981848 CENTER OF MASS X-VEL = 1.683505053e-15 TIME= 0.00318981848 CENTER OF MASS Y-LOC = -7.014604387e-16 TIME= 0.00318981848 CENTER OF MASS Y-VEL = 2.805841755e-16 TIME= 0.00318981848 CENTER OF MASS Z-LOC = 1.943035945e-10 TIME= 0.00318981848 CENTER OF MASS Z-VEL = -1.923590355e-11 TIME= 0.00318981848 MAXIMUM TEMPERATURE = 1 TIME= 0.00318981848 MAXIMUM DENSITY = 0.9678594341 [STEP 8] Coarse TimeStep time: 0.215038254 [STEP 8] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE at time 0.00318981848 with dt = 0.0004935345004 [1m[32m Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.00084154 on level 0 Castro::do_old_sources() time = 0.011523796 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.165531943 on level 0 Castro::construct_new_gravity() time = 0.00096442 on level 0 Castro::do_new_sources() time = 0.005275108 on level 0 ...estimated hydro-limited timestep at level 0: 0.001432337647 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.249701595 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 TIME= 0.003683352981 CENTER OF MASS X-LOC = -1.169100731e-16 TIME= 0.003683352981 CENTER OF MASS X-VEL = -9.352805849e-16 TIME= 0.003683352981 CENTER OF MASS Y-LOC = 9.352805849e-17 TIME= 0.003683352981 CENTER OF MASS Y-VEL = -4.208762632e-15 TIME= 0.003683352981 CENTER OF MASS Z-LOC = 1.946030539e-10 TIME= 0.003683352981 CENTER OF MASS Z-VEL = -2.237341503e-11 TIME= 0.003683352981 MAXIMUM TEMPERATURE = 1 TIME= 0.003683352981 MAXIMUM DENSITY = 0.967134105 [STEP 9] Coarse TimeStep time: 0.214591086 [STEP 9] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE at time 0.003683352981 with dt = 0.0005182112254 [1m[32m Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.000796817 on level 0 Castro::do_old_sources() time = 0.012030381 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.164782436 on level 0 Castro::construct_new_gravity() time = 0.000960287 on level 0 Castro::do_new_sources() time = 0.005233104 on level 0 ...estimated hydro-limited timestep at level 0: 0.001305227986 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,32) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.249418285 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 TIME= 0.004201564206 CENTER OF MASS X-LOC = 9.352805849e-17 TIME= 0.004201564206 CENTER OF MASS X-VEL = -7.295188563e-15 TIME= 0.004201564206 CENTER OF MASS Y-LOC = -1.823797141e-15 TIME= 0.004201564206 CENTER OF MASS Y-VEL = -1.000750226e-14 TIME= 0.004201564206 CENTER OF MASS Z-LOC = 1.949102994e-10 TIME= 0.004201564206 CENTER OF MASS Z-VEL = -2.566449373e-11 TIME= 0.004201564206 MAXIMUM TEMPERATURE = 1 TIME= 0.004201564206 MAXIMUM DENSITY = 0.9663390728 [STEP 10] Coarse TimeStep time: 0.21446917 [STEP 10] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.01457165 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.135405439 seconds Ending run at 07:04:24 UTC on 2023-10-09. Run time = 3.149213802 Run time without initialization = 2.91170089 Average number of zones advanced per microsecond: 0.900 Average number of zones advanced per microsecond per rank: 0.056 TinyProfiler total time across processes [min...avg...max]: 3.148 ... 3.149 ... 3.149 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.5548 1.7719 1.9775 62.79% check_for_negative_density() 10 0.03118 0.2408 0.4695 14.91% Amr::writePlotFile() 2 0.2888 0.2954 0.2974 9.44% FabArray::ParallelCopy_finish() 119 0.04382 0.08545 0.1302 4.14% FabArray::setVal() 164 0.07427 0.08486 0.09135 2.90% amrex::Copy() 355 0.05954 0.06694 0.07489 2.38% Castro::reset_internal_energy(Fab) 504 0.05354 0.05914 0.06581 2.09% VisMF::Write(FabArray) 11 0.04283 0.04786 0.06329 2.01% Castro::estTimeStep() 21 0.02091 0.03763 0.06029 1.91% StateData::FillBoundary(geom) 20 0.01948 0.0328 0.05097 1.62% FabArray::ParallelCopy_nowait() 119 0.02902 0.03657 0.04604 1.46% FillPatchIterator::Initialize 119 0.03471 0.04014 0.0456 1.45% Castro::computeTemp() 63 0.03267 0.0361 0.04085 1.30% Castro::finalize_do_advance() 10 0.0196 0.02556 0.03321 1.05% Castro::initialize_do_advance() 10 0.02695 0.02953 0.03306 1.05% Castro::normalize_species() 62 0.02375 0.02665 0.02982 0.95% Castro::construct_old_gravity() 10 0.0003387 0.009143 0.02906 0.92% Castro::construct_new_gravity_source() 10 0.02126 0.02394 0.02683 0.85% Castro::initialize_advance() 10 0.01454 0.01796 0.02232 0.71% Castro::hybrid_to_linear_momentum() 62 0.01654 0.01875 0.02168 0.69% Amr::checkPoint() 3 0.009382 0.01767 0.02155 0.68% Castro::do_old_sources() 10 0.000488 0.005344 0.01827 0.58% Castro::post_timestep() 10 0.004129 0.01094 0.01826 0.58% Castro::do_new_sources() 10 0.000215 0.005148 0.01788 0.57% FabArray::Saxpy() 20 0.01149 0.01447 0.01678 0.53% FabArray::setDomainBndry() 119 0.007488 0.01057 0.01349 0.43% MultiFab::contains_nan() 20 0.01023 0.01141 0.01342 0.43% Castro::fill_hybrid_hydro_source() 30 0.004982 0.006341 0.0106 0.34% Castro::sum_integrated_quantities() 11 0.005517 0.008412 0.01054 0.33% Castro::construct_old_gravity_source() 10 0.005814 0.00798 0.01007 0.32% Gravity::add_pointmass_to_gravity() 21 0.007584 0.008481 0.009462 0.30% Castro::initMFs() 1 0.004173 0.00622 0.008234 0.26% Castro::volWgtSum() 176 0.006677 0.007322 0.008127 0.26% StateData::define() 4 0.003838 0.005371 0.006482 0.21% AmrLevel::derive() 55 0.003694 0.004595 0.00615 0.20% Castro::enforce_min_density() 62 0.004739 0.005263 0.006107 0.19% Castro::swap_state_time_levels() 10 0.004319 0.005079 0.005832 0.19% Gravity::get_new_grav_vector() 11 0.002998 0.004128 0.005349 0.17% Castro::construct_new_gravity() 10 0.0001369 0.001639 0.004946 0.16% Castro::initData() 1 0.001736 0.002425 0.002662 0.08% Castro::post_init() 1 5.121e-05 0.0006143 0.002494 0.08% Gravity::get_old_grav_vector() 10 0.001376 0.001949 0.002379 0.08% main() 1 0.0008982 0.001708 0.002046 0.06% Castro::buildMetrics() 1 0.0009548 0.001342 0.001652 0.05% AmrLevel::FillPatch() 119 0.0007954 0.001059 0.001298 0.04% Castro::locWgtSum() 33 0.0008947 0.00102 0.001183 0.04% Castro::subcycle_advance_ctu() 10 8.356e-05 0.0001584 0.0009971 0.03% Amr::coarseTimeStep() 10 0.0006907 0.0008973 0.0009322 0.03% Amr::InitAmr() 1 0.0002708 0.0004368 0.0006083 0.02% Castro::locSquaredSum() 11 0.0004121 0.0004826 0.0005937 0.02% Castro::construct_old_source() 70 6.573e-05 0.0001186 0.0004626 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002593 0.0003392 0.0004307 0.01% DistributionMapping::LeastUsedCPUs() 1 9.961e-06 0.0001884 0.0004 0.01% Castro::clean_state() 62 0.0002002 0.0002821 0.0003614 0.01% Castro::do_advance_ctu() 10 0.0001577 0.000235 0.0003076 0.01% Castro::linear_to_hybrid_momentum() 1 0.0001539 0.0002299 0.000295 0.01% Castro::computeNewDt() 9 1.139e-05 3.315e-05 0.0002839 0.01% StateData::checkPoint() 12 2.244e-05 4.505e-05 0.0002801 0.01% FillPatchIterator::FillFromLevel0() 119 0.0001273 0.0001719 0.0002049 0.01% Castro::Castro() 1 7.15e-05 0.0001364 0.000196 0.01% Castro::enforce_consistent_e() 1 6.071e-05 8.79e-05 0.0001878 0.01% StateDataPhysBCFunct::() 119 0.000105 0.0001523 0.0001866 0.01% Castro::finalize_advance() 10 0.0001178 0.0001406 0.0001799 0.01% FillPatchSingleLevel 119 0.0001004 0.0001275 0.0001569 0.00% FabArray::ParallelCopy() 119 0.0001004 0.0001302 0.0001566 0.00% Amr::timeStep() 10 6.057e-05 8.013e-05 0.000148 0.00% Castro::construct_new_source() 70 8.548e-05 0.0001205 0.0001477 0.00% AmrLevel::checkPoint() 3 4.107e-05 6.269e-05 0.0001412 0.00% Amr::writeSmallPlotFile() 1 2.762e-05 5.353e-05 9.821e-05 0.00% Castro::advance() 10 4.425e-05 6.223e-05 9.523e-05 0.00% Castro::apply_source_to_state() 20 4.018e-05 6.205e-05 8.756e-05 0.00% FabArrayBase::getCPC() 20 3.104e-05 5.083e-05 7.563e-05 0.00% Castro::enforce_speed_limit() 62 3.937e-05 5.042e-05 6.768e-05 0.00% Amr::FinalizeInit() 1 4.17e-06 1.077e-05 6.641e-05 0.00% Amr::defBaseLevel() 1 2.258e-05 4.128e-05 6.167e-05 0.00% FabArrayBase::CPC::define() 2 3.018e-05 4.423e-05 5.554e-05 0.00% Castro::expand_state() 10 2.199e-05 3.023e-05 4.891e-05 0.00% Castro::derive() 55 3.122e-05 3.883e-05 4.711e-05 0.00% Castro::construct_new_hybrid_source() 10 1.693e-05 2.992e-05 4.252e-05 0.00% Castro::construct_old_hybrid_source() 10 1.61e-05 2.355e-05 4.238e-05 0.00% Castro::check_for_nan() 20 2.38e-05 3.334e-05 3.915e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.024e-05 1.857e-05 2.943e-05 0.00% Gravity::swapTimeLevels() 10 1.405e-05 2.164e-05 2.813e-05 0.00% Amr::initialInit() 1 1.889e-06 4.05e-06 2.782e-05 0.00% Castro::construct_new_rotation_source() 10 8.401e-06 1.411e-05 2.47e-05 0.00% Amr::initSubcycle() 1 8.985e-06 1.382e-05 1.764e-05 0.00% Castro::create_source_corrector() 10 9.631e-06 1.324e-05 1.59e-05 0.00% Castro::retry_advance_ctu() 10 8.232e-06 1.171e-05 1.504e-05 0.00% Gravity::set_mass_offset() 10 7.378e-06 1.094e-05 1.375e-05 0.00% Castro::FluxRegCrseInit 10 8.615e-06 1.118e-05 1.302e-05 0.00% Castro::construct_old_rotation_source() 10 5.608e-06 8.938e-06 1.279e-05 0.00% Castro::gwstrain() 11 6.893e-06 8.394e-06 1.124e-05 0.00% Castro::computeInitialDt() 2 4.559e-06 6.63e-06 9.615e-06 0.00% Castro::FluxRegFineAdd() 10 3.066e-06 4.237e-06 8.14e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.823e-06 6.234e-06 7.912e-06 0.00% AmrLevel::checkPointPre() 3 3.42e-06 5.096e-06 7.715e-06 0.00% AmrLevel::checkPointPost() 3 4.295e-06 5.505e-06 7.241e-06 0.00% Amr::InitializeInit() 1 2.228e-06 3.024e-06 5.907e-06 0.00% Castro::post_regrid() 1 2.571e-06 3.749e-06 5.26e-06 0.00% Amr::init() 1 2.99e-06 3.569e-06 4.347e-06 0.00% DistributionMapping::Distribute() 1 1.351e-06 1.85e-06 2.36e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.148 3.149 3.149 100.00% Amr::coarseTimeStep() 10 2.774 2.774 2.774 88.09% Amr::timeStep() 10 2.732 2.732 2.732 86.74% Castro::advance() 10 2.67 2.677 2.684 85.23% Castro::subcycle_advance_ctu() 10 2.569 2.582 2.596 82.42% Castro::do_advance_ctu() 10 2.569 2.582 2.595 82.41% Castro::construct_ctu_hydro_source() 10 2.024 2.036 2.047 64.99% check_for_negative_density() 10 0.03118 0.2408 0.4695 14.91% Amr::writePlotFile() 2 0.3115 0.3115 0.3115 9.89% AmrLevel::FillPatch() 119 0.2201 0.249 0.2762 8.77% Castro::initialize_do_advance() 10 0.2155 0.2277 0.2414 7.66% FillPatchIterator::Initialize 119 0.1758 0.2094 0.239 7.59% Amr::init() 1 0.2367 0.2369 0.2371 7.53% FillPatchIterator::FillFromLevel0() 119 0.1206 0.1587 0.19 6.03% FillPatchSingleLevel 119 0.1205 0.1586 0.1899 6.03% FabArray::ParallelCopy() 119 0.07922 0.1255 0.1691 5.37% Castro::clean_state() 62 0.1313 0.1449 0.1623 5.15% Castro::expand_state() 10 0.1385 0.1479 0.1571 4.99% Castro::do_old_sources() 10 0.1319 0.1445 0.1566 4.97% FabArray::ParallelCopy_finish() 119 0.04382 0.08545 0.1302 4.14% Castro::computeTemp() 63 0.08666 0.09558 0.1071 3.40% Castro::initialize_advance() 10 0.08445 0.09365 0.1034 3.28% FabArray::setVal() 164 0.07427 0.08486 0.09135 2.90% Castro::do_new_sources() 10 0.06815 0.07514 0.08219 2.61% amrex::Copy() 355 0.05954 0.06694 0.07489 2.38% Castro::finalize_do_advance() 10 0.03411 0.04903 0.07101 2.25% Castro::reset_internal_energy(MultiFab) 63 0.05385 0.05948 0.06621 2.10% Castro::reset_internal_energy(Fab) 504 0.05354 0.05914 0.06581 2.09% VisMF::Write(FabArray) 11 0.04283 0.04786 0.06329 2.01% Castro::post_timestep() 10 0.04732 0.05504 0.06108 1.94% Castro::estTimeStep() 21 0.02091 0.03763 0.06029 1.91% Amr::checkPoint() 3 0.05228 0.05238 0.05242 1.66% StateDataPhysBCFunct::() 119 0.01961 0.03295 0.05115 1.62% StateData::FillBoundary(geom) 20 0.01948 0.0328 0.05097 1.62% FabArray::ParallelCopy_nowait() 119 0.03254 0.0399 0.04932 1.57% AmrLevel::checkPoint() 3 0.03085 0.0347 0.04288 1.36% StateData::checkPoint() 12 0.03081 0.03464 0.04274 1.36% Amr::initialInit() 1 0.04033 0.04044 0.04065 1.29% Castro::construct_old_gravity() 10 0.00907 0.01884 0.03786 1.20% Castro::construct_new_source() 70 0.02504 0.02807 0.03177 1.01% Castro::sum_integrated_quantities() 11 0.03056 0.03059 0.03075 0.98% Castro::normalize_species() 62 0.02375 0.02665 0.02982 0.95% Amr::InitializeInit() 1 0.01769 0.02571 0.02867 0.91% Amr::defBaseLevel() 1 0.01769 0.0257 0.02867 0.91% Castro::construct_new_gravity_source() 10 0.02126 0.02394 0.02683 0.85% Amr::FinalizeInit() 1 0.01167 0.01473 0.02295 0.73% Castro::hybrid_to_linear_momentum() 62 0.01654 0.01875 0.02168 0.69% Castro::construct_new_gravity() 10 0.01118 0.01548 0.01973 0.63% Castro::derive() 55 0.01224 0.01463 0.01735 0.55% Gravity::get_new_grav_vector() 11 0.01109 0.01481 0.01734 0.55% AmrLevel::derive() 55 0.01221 0.01459 0.01731 0.55% Castro::construct_old_source() 70 0.007606 0.01051 0.01724 0.55% Castro::apply_source_to_state() 20 0.01154 0.01453 0.01687 0.54% FabArray::Saxpy() 20 0.01149 0.01447 0.01678 0.53% Castro::computeInitialDt() 2 0.002525 0.005569 0.01379 0.44% FabArray::setDomainBndry() 119 0.007488 0.01057 0.01349 0.43% Castro::check_for_nan() 20 0.01027 0.01144 0.01345 0.43% MultiFab::contains_nan() 20 0.01023 0.01141 0.01342 0.43% Castro::Castro() 1 0.006508 0.01067 0.01305 0.41% Castro::fill_hybrid_hydro_source() 30 0.004982 0.006341 0.0106 0.34% Castro::initData() 1 0.0069 0.009409 0.01049 0.33% Gravity::get_old_grav_vector() 10 0.008162 0.009204 0.01048 0.33% Castro::construct_old_gravity_source() 10 0.005814 0.00798 0.01007 0.32% Gravity::add_pointmass_to_gravity() 21 0.007584 0.008481 0.009462 0.30% Castro::computeNewDt() 9 0.008603 0.008634 0.008953 0.28% Castro::post_init() 1 0.007414 0.007784 0.008666 0.28% Castro::initMFs() 1 0.004173 0.00622 0.008234 0.26% Castro::volWgtSum() 176 0.006677 0.007322 0.008127 0.26% Castro::construct_old_hybrid_source() 10 0.001709 0.002401 0.007208 0.23% AmrLevel::AmrLevel(dm) 1 0.003848 0.005389 0.006498 0.21% StateData::define() 4 0.003838 0.005371 0.006482 0.21% Castro::enforce_min_density() 62 0.004739 0.005263 0.006107 0.19% Castro::swap_state_time_levels() 10 0.004319 0.005079 0.005832 0.19% Castro::construct_new_hybrid_source() 10 0.003266 0.003994 0.004774 0.15% Castro::post_regrid() 1 0.00175 0.002634 0.003003 0.10% Castro::buildMetrics() 1 0.001022 0.001472 0.001828 0.06% Castro::locSquaredSum() 11 0.001069 0.001287 0.001465 0.05% Castro::finalize_advance() 10 0.0009789 0.001099 0.001251 0.04% Castro::locWgtSum() 33 0.0008947 0.00102 0.001183 0.04% Amr::InitAmr() 1 0.0002803 0.0004507 0.000624 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.747e-05 0.0001965 0.0004096 0.01% DistributionMapping::LeastUsedCPUs() 1 9.961e-06 0.0001884 0.0004 0.01% Castro::linear_to_hybrid_momentum() 1 0.0001539 0.0002299 0.000295 0.01% Castro::enforce_consistent_e() 1 6.071e-05 8.79e-05 0.0001878 0.01% FabArrayBase::getCPC() 20 6.812e-05 9.506e-05 0.0001247 0.00% Amr::writeSmallPlotFile() 1 2.762e-05 5.353e-05 9.821e-05 0.00% Castro::enforce_speed_limit() 62 3.937e-05 5.042e-05 6.768e-05 0.00% FabArrayBase::CPC::define() 2 3.018e-05 4.423e-05 5.554e-05 0.00% Gravity::swapTimeLevels() 10 1.405e-05 2.164e-05 2.813e-05 0.00% Castro::construct_new_rotation_source() 10 8.401e-06 1.411e-05 2.47e-05 0.00% Amr::initSubcycle() 1 8.985e-06 1.382e-05 1.764e-05 0.00% Castro::create_source_corrector() 10 9.631e-06 1.324e-05 1.59e-05 0.00% Castro::retry_advance_ctu() 10 8.232e-06 1.171e-05 1.504e-05 0.00% Gravity::set_mass_offset() 10 7.378e-06 1.094e-05 1.375e-05 0.00% Castro::FluxRegCrseInit 10 8.615e-06 1.118e-05 1.302e-05 0.00% Castro::construct_old_rotation_source() 10 5.608e-06 8.938e-06 1.279e-05 0.00% Castro::gwstrain() 11 6.893e-06 8.394e-06 1.124e-05 0.00% Castro::FluxRegFineAdd() 10 3.066e-06 4.237e-06 8.14e-06 0.00% AmrLevel::checkPointPre() 3 3.42e-06 5.096e-06 7.715e-06 0.00% AmrLevel::checkPointPost() 3 4.295e-06 5.505e-06 7.241e-06 0.00% DistributionMapping::Distribute() 1 1.351e-06 1.85e-06 2.36e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 39 B 49 B 109 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-10-gd39abbc396d0) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.10-10-gd39abbc396d0) initialized Starting run at 07:04:24 UTC on 2023-10-09. Successfully read inputs file ... Castro git describe: 23.10-20-gb68e0ef43 AMReX git describe: 23.10-10-gd39abbc39 Microphysics git describe: 23.10-6-g657406dc reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 29.97136205 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.041017424 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE at time 0.001845801625 with dt = 0.0004263336576 [1m[32m Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.001802082 on level 0 Castro::do_old_sources() time = 0.026725526 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.296399905 on level 0 Castro::construct_new_gravity() time = 0.002039255 on level 0 Castro::do_new_sources() time = 0.010931539 on level 0 ...estimated hydro-limited timestep at level 0: 0.002054026253 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.67778957 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 TIME= 0.002272135282 CENTER OF MASS X-LOC = -2.104381316e-16 TIME= 0.002272135282 CENTER OF MASS X-VEL = 7.48224468e-16 TIME= 0.002272135282 CENTER OF MASS Y-LOC = 1.169100731e-16 TIME= 0.002272135282 CENTER OF MASS Y-VEL = 1.150395119e-14 TIME= 0.002272135282 CENTER OF MASS Z-LOC = 1.935970602e-10 TIME= 0.002272135282 CENTER OF MASS Z-VEL = -1.340158253e-11 TIME= 0.002272135282 MAXIMUM TEMPERATURE = 1 TIME= 0.002272135282 MAXIMUM DENSITY = 0.9691277593 [STEP 6] Coarse TimeStep time: 0.485488889 [STEP 6] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE at time 0.002272135282 with dt = 0.0004476503405 [1m[32m Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.001838615 on level 0 Castro::do_old_sources() time = 0.022127638 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.283028417 on level 0 Castro::construct_new_gravity() time = 0.002355852 on level 0 Castro::do_new_sources() time = 0.010670246 on level 0 ...estimated hydro-limited timestep at level 0: 0.001791126456 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.7286179541 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 TIME= 0.002719785623 CENTER OF MASS X-LOC = 1.987471243e-16 TIME= 0.002719785623 CENTER OF MASS X-VEL = -3.179953989e-15 TIME= 0.002719785623 CENTER OF MASS Y-LOC = -4.676402925e-17 TIME= 0.002719785623 CENTER OF MASS Y-VEL = 6.359907978e-15 TIME= 0.002719785623 CENTER OF MASS Z-LOC = 1.939871541e-10 TIME= 0.002719785623 CENTER OF MASS Z-VEL = -1.624689381e-11 TIME= 0.002719785623 MAXIMUM TEMPERATURE = 1 TIME= 0.002719785623 MAXIMUM DENSITY = 0.9685217096 [STEP 7] Coarse TimeStep time: 0.369692315 [STEP 7] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE at time 0.002719785623 with dt = 0.0004700328575 [1m[32m Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.001325771 on level 0 Castro::do_old_sources() time = 0.022072998 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.281967359 on level 0 Castro::construct_new_gravity() time = 0.003076067 on level 0 Castro::do_new_sources() time = 0.009810865 on level 0 ...estimated hydro-limited timestep at level 0: 0.001590548666 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.7433284553 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 TIME= 0.00318981848 CENTER OF MASS X-LOC = 5.962413729e-16 TIME= 0.00318981848 CENTER OF MASS X-VEL = 1.683505053e-15 TIME= 0.00318981848 CENTER OF MASS Y-LOC = -7.014604387e-16 TIME= 0.00318981848 CENTER OF MASS Y-VEL = 2.805841755e-16 TIME= 0.00318981848 CENTER OF MASS Z-LOC = 1.943035945e-10 TIME= 0.00318981848 CENTER OF MASS Z-VEL = -1.923590355e-11 TIME= 0.00318981848 MAXIMUM TEMPERATURE = 1 TIME= 0.00318981848 MAXIMUM DENSITY = 0.9678594341 [STEP 8] Coarse TimeStep time: 0.362438415 [STEP 8] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE at time 0.00318981848 with dt = 0.0004935345004 [1m[32m Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.001608559 on level 0 Castro::do_old_sources() time = 0.021468712 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.210103274 on level 0 Castro::construct_new_gravity() time = 0.001592874 on level 0 Castro::do_new_sources() time = 0.009166531 on level 0 ...estimated hydro-limited timestep at level 0: 0.001432337647 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 0.9413575784 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 TIME= 0.003683352981 CENTER OF MASS X-LOC = -1.169100731e-16 TIME= 0.003683352981 CENTER OF MASS X-VEL = -9.352805849e-16 TIME= 0.003683352981 CENTER OF MASS Y-LOC = 9.352805849e-17 TIME= 0.003683352981 CENTER OF MASS Y-VEL = -4.208762632e-15 TIME= 0.003683352981 CENTER OF MASS Z-LOC = 1.946030539e-10 TIME= 0.003683352981 CENTER OF MASS Z-VEL = -2.237341503e-11 TIME= 0.003683352981 MAXIMUM TEMPERATURE = 1 TIME= 0.003683352981 MAXIMUM DENSITY = 0.967134105 [STEP 9] Coarse TimeStep time: 0.285493041 [STEP 9] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,31) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE at time 0.003683352981 with dt = 0.0005182112254 [1m[32m Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254[0m Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.001251498 on level 0 Castro::do_old_sources() time = 0.017681281 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.183351526 on level 0 Castro::construct_new_gravity() time = 0.001697164 on level 0 Castro::do_new_sources() time = 0.009580627 on level 0 ...estimated hydro-limited timestep at level 0: 0.001305227986 ...hydro-limited CFL timestep constrained at (i,j,k) = (31,31,32) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.060423582 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 TIME= 0.004201564206 CENTER OF MASS X-LOC = 9.352805849e-17 TIME= 0.004201564206 CENTER OF MASS X-VEL = -7.295188563e-15 TIME= 0.004201564206 CENTER OF MASS Y-LOC = -1.823797141e-15 TIME= 0.004201564206 CENTER OF MASS Y-VEL = -1.000750226e-14 TIME= 0.004201564206 CENTER OF MASS Z-LOC = 1.949102994e-10 TIME= 0.004201564206 CENTER OF MASS Z-VEL = -2.566449373e-11 TIME= 0.004201564206 MAXIMUM TEMPERATURE = 1 TIME= 0.004201564206 MAXIMUM DENSITY = 0.9663390728 [STEP 10] Coarse TimeStep time: 0.253749139 [STEP 10] FAB kilobyte spread across MPI nodes: [50025 ... 50025] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.222438291 seconds Ending run at 07:04:26 UTC on 2023-10-09. Run time = 2.024986249 Run time without initialization = 1.983519519 Average number of zones advanced per microsecond: 0.661 Average number of zones advanced per microsecond per rank: 0.041 TinyProfiler total time across processes [min...avg...max]: 2.024 ... 2.025 ... 2.025 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.7631 0.9904 1.1992 59.22% check_for_negative_density() 5 0.01755 0.2341 0.4649 22.96% Amr::writePlotFile() 1 0.2128 0.215 0.2159 10.66% FabArray::ParallelCopy_finish() 56 0.02433 0.06121 0.1023 5.05% Castro::sum_integrated_quantities() 5 0.09109 0.09392 0.09692 4.79% FabArray::setVal() 80 0.0339 0.04479 0.05186 2.56% amrex::Copy() 169 0.02498 0.03779 0.04646 2.29% Castro::construct_old_gravity() 5 0.0001408 0.008269 0.04072 2.01% StateData::FillBoundary(geom) 10 0.01223 0.02164 0.04062 2.01% Castro::reset_internal_energy(Fab) 240 0.02527 0.03145 0.03922 1.94% Castro::estTimeStep() 10 0.01096 0.0191 0.03542 1.75% FillPatchIterator::Initialize 56 0.02063 0.02504 0.02956 1.46% FabArray::ParallelCopy_nowait() 56 0.01271 0.01878 0.02605 1.29% Castro::computeTemp() 30 0.01524 0.01902 0.02375 1.17% VisMF::Read() 3 0.01701 0.01892 0.01988 0.98% Castro::do_old_sources() 5 0.0001669 0.003352 0.0186 0.92% Castro::initialize_do_advance() 5 0.01264 0.01565 0.01859 0.92% Castro::finalize_do_advance() 5 0.008646 0.01444 0.01857 0.92% Castro::normalize_species() 30 0.01142 0.01424 0.01789 0.88% Castro::construct_new_gravity_source() 5 0.01211 0.01488 0.01789 0.88% Castro::do_new_sources() 5 9.159e-05 0.003727 0.01536 0.76% Castro::hybrid_to_linear_momentum() 30 0.008391 0.01118 0.01522 0.75% Castro::initialize_advance() 5 0.008122 0.01205 0.01517 0.75% Castro::post_timestep() 5 0.0008708 0.007533 0.0151 0.75% Amr::restart() 1 0.009049 0.00912 0.009318 0.46% FabArray::Saxpy() 10 0.005713 0.007666 0.009242 0.46% MultiFab::contains_nan() 10 0.005944 0.007011 0.009227 0.46% VisMF::Write(FabArray) 1 0.006123 0.006729 0.009181 0.45% FabArray::setDomainBndry() 56 0.003291 0.005651 0.007417 0.37% Castro::construct_old_gravity_source() 5 0.00211 0.004864 0.007387 0.36% Castro::initMFs() 1 0.004744 0.005522 0.005949 0.29% Gravity::add_pointmass_to_gravity() 10 0.003667 0.004564 0.005878 0.29% Castro::post_restart() 1 6.683e-05 0.001719 0.005708 0.28% Castro::swap_state_time_levels() 5 0.004273 0.005014 0.005353 0.26% Castro::fill_hybrid_hydro_source() 15 0.002632 0.003639 0.004842 0.24% StateData::restartDoit() 4 0.003149 0.004274 0.004593 0.23% AmrLevel::derive() 26 0.002428 0.003155 0.004191 0.21% Castro::volWgtSum() 80 0.003165 0.003652 0.004013 0.20% Castro::enforce_min_density() 30 0.002268 0.002827 0.003817 0.19% Castro::construct_new_gravity() 5 7.271e-05 0.001026 0.003554 0.18% main() 1 0.001744 0.002525 0.00301 0.15% Gravity::get_new_grav_vector() 5 0.001176 0.002082 0.002908 0.14% Castro::finalize_advance() 5 0.0007625 0.00115 0.001833 0.09% Gravity::get_old_grav_vector() 5 0.0009082 0.001186 0.001378 0.07% AmrLevel::FillPatch() 56 0.0006824 0.0008394 0.001066 0.05% Castro::locWgtSum() 15 0.0003815 0.0004967 0.0006489 0.03% Castro::buildMetrics() 1 0.0001752 0.0003617 0.0005769 0.03% Amr::InitAmr() 1 0.0002735 0.0004447 0.0005342 0.03% Amr::coarseTimeStep() 5 0.0004008 0.000487 0.0004992 0.02% Castro::subcycle_advance_ctu() 5 4.007e-05 7.827e-05 0.0004645 0.02% Castro::locSquaredSum() 6 0.0002191 0.0002933 0.0003747 0.02% AmrLevel::restart() 1 0.0001194 0.0002229 0.0002753 0.01% Castro::reset_internal_energy(MultiFab) 30 0.0001339 0.0001865 0.0002715 0.01% Castro::clean_state() 30 9.03e-05 0.0001539 0.0002512 0.01% Castro::do_advance_ctu() 5 8.176e-05 0.0001403 0.0002195 0.01% Amr::writeSmallPlotFile() 1 3.219e-05 8.591e-05 0.0001872 0.01% StateDataPhysBCFunct::() 56 5.525e-05 9.365e-05 0.0001218 0.01% Castro::computeNewDt() 5 5.322e-06 1.467e-05 0.0001217 0.01% FillPatchSingleLevel 56 5.431e-05 7.597e-05 0.0001124 0.01% Castro::construct_new_source() 35 3.66e-05 7.333e-05 0.0001057 0.01% FillPatchIterator::FillFromLevel0() 56 6.228e-05 8.695e-05 0.0001056 0.01% Castro::construct_old_source() 35 2.865e-05 5.135e-05 8.567e-05 0.00% FabArray::ParallelCopy() 56 5.003e-05 6.669e-05 8.144e-05 0.00% Amr::timeStep() 5 3.182e-05 4.092e-05 6.838e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 9.307e-06 3.686e-05 6.708e-05 0.00% FabArrayBase::CPC::define() 2 2.973e-05 4.155e-05 5.397e-05 0.00% Castro::advance() 5 2.427e-05 3.202e-05 4.384e-05 0.00% Castro::apply_source_to_state() 10 1.636e-05 2.719e-05 4.018e-05 0.00% Castro::enforce_speed_limit() 30 1.818e-05 3.102e-05 4.009e-05 0.00% Castro::derive() 26 1.332e-05 2.393e-05 3.561e-05 0.00% Amr::initSubcycle() 1 8.9e-06 1.891e-05 3.319e-05 0.00% Castro::construct_new_hybrid_source() 5 1.224e-05 2.251e-05 3.193e-05 0.00% Castro::check_for_nan() 10 1.396e-05 2.185e-05 2.863e-05 0.00% FabArrayBase::getCPC() 10 1.774e-05 2.198e-05 2.712e-05 0.00% Castro::expand_state() 5 1.159e-05 1.705e-05 2.197e-05 0.00% Gravity::swapTimeLevels() 5 5.845e-06 1.217e-05 2.138e-05 0.00% Castro::construct_old_hybrid_source() 5 5.501e-06 1.177e-05 1.788e-05 0.00% Castro::create_source_corrector() 5 5.615e-06 1.044e-05 1.494e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.415e-06 7.292e-06 9.343e-06 0.00% Castro::construct_new_rotation_source() 5 4.117e-06 6.813e-06 9.278e-06 0.00% Gravity::set_mass_offset() 6 3.247e-06 5.46e-06 8.305e-06 0.00% Castro::retry_advance_ctu() 5 4.338e-06 6.243e-06 8.09e-06 0.00% Castro::gwstrain() 5 2.941e-06 5.923e-06 7.943e-06 0.00% Castro::construct_old_rotation_source() 5 2.173e-06 4.798e-06 7.838e-06 0.00% DistributionMapping::Distribute() 1 1.491e-06 2.531e-06 7.219e-06 0.00% Castro::FluxRegCrseInit 5 2.859e-06 4.648e-06 6.668e-06 0.00% Castro::FluxRegFineAdd() 5 1.481e-06 2.289e-06 2.978e-06 0.00% Amr::init() 1 9.93e-07 1.314e-06 1.772e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 2.024 2.025 2.025 100.00% Amr::coarseTimeStep() 5 1.757 1.757 1.757 86.78% Amr::timeStep() 5 1.751 1.751 1.751 86.46% Castro::advance() 5 1.62 1.627 1.63 80.51% Castro::subcycle_advance_ctu() 5 1.559 1.567 1.577 77.88% Castro::do_advance_ctu() 5 1.559 1.567 1.577 77.88% Castro::construct_ctu_hydro_source() 5 1.227 1.238 1.253 61.86% check_for_negative_density() 5 0.01755 0.2341 0.4649 22.96% Amr::writePlotFile() 1 0.2234 0.2234 0.2234 11.03% AmrLevel::FillPatch() 56 0.1304 0.1593 0.1953 9.65% FillPatchIterator::Initialize 56 0.1063 0.1345 0.1726 8.52% Castro::initialize_do_advance() 5 0.1284 0.1384 0.1527 7.54% FillPatchIterator::FillFromLevel0() 56 0.07104 0.1039 0.1417 7.00% FillPatchSingleLevel 56 0.07094 0.1038 0.1416 6.99% Castro::post_timestep() 5 0.1205 0.1244 0.1304 6.44% FabArray::ParallelCopy() 56 0.04271 0.08196 0.123 6.07% Castro::sum_integrated_quantities() 5 0.1068 0.1068 0.1069 5.28% Castro::expand_state() 5 0.08384 0.09328 0.1042 5.15% FabArray::ParallelCopy_finish() 56 0.02433 0.06121 0.1023 5.05% Castro::do_old_sources() 5 0.07643 0.08895 0.1023 5.05% Castro::clean_state() 30 0.06284 0.07909 0.0994 4.91% Castro::initialize_advance() 5 0.04189 0.05756 0.06745 3.33% Castro::computeTemp() 30 0.04064 0.05065 0.06309 3.12% FabArray::setVal() 80 0.0339 0.04479 0.05186 2.56% Castro::do_new_sources() 5 0.03319 0.04494 0.0499 2.46% amrex::Copy() 169 0.02498 0.03779 0.04646 2.29% Castro::construct_old_gravity() 5 0.00476 0.01403 0.04625 2.28% Amr::init() 1 0.04075 0.04085 0.04107 2.03% Amr::restart() 1 0.04075 0.04085 0.04107 2.03% StateDataPhysBCFunct::() 56 0.01229 0.02173 0.04072 2.01% StateData::FillBoundary(geom) 10 0.01223 0.02164 0.04062 2.01% Castro::finalize_do_advance() 5 0.01814 0.02769 0.03959 1.96% Castro::reset_internal_energy(MultiFab) 30 0.0254 0.03163 0.03949 1.95% Castro::reset_internal_energy(Fab) 240 0.02527 0.03145 0.03922 1.94% Castro::estTimeStep() 10 0.01096 0.0191 0.03542 1.75% FabArray::ParallelCopy_nowait() 56 0.01374 0.02068 0.02864 1.41% AmrLevel::restart() 1 0.02062 0.02357 0.02488 1.23% StateData::restartDoit() 4 0.02042 0.0233 0.0246 1.21% Castro::construct_new_source() 35 0.01399 0.01747 0.02142 1.06% VisMF::Read() 3 0.01701 0.01892 0.01988 0.98% Castro::normalize_species() 30 0.01142 0.01424 0.01789 0.88% Castro::construct_new_gravity_source() 5 0.01211 0.01488 0.01789 0.88% Castro::hybrid_to_linear_momentum() 30 0.008391 0.01118 0.01522 0.75% Castro::derive() 26 0.007043 0.00946 0.01187 0.59% AmrLevel::derive() 26 0.007029 0.009436 0.01184 0.58% Castro::construct_new_gravity() 5 0.005391 0.008853 0.01118 0.55% Gravity::get_new_grav_vector() 5 0.005091 0.007419 0.0098 0.48% Castro::apply_source_to_state() 10 0.005738 0.007694 0.009267 0.46% Castro::check_for_nan() 10 0.005965 0.007033 0.009251 0.46% FabArray::Saxpy() 10 0.005713 0.007666 0.009242 0.46% MultiFab::contains_nan() 10 0.005944 0.007011 0.009227 0.46% VisMF::Write(FabArray) 1 0.006123 0.006729 0.009181 0.45% Castro::construct_old_source() 35 0.002902 0.00608 0.008855 0.44% FabArray::setDomainBndry() 56 0.003291 0.005651 0.007417 0.37% Castro::construct_old_gravity_source() 5 0.00211 0.004864 0.007387 0.36% Gravity::get_old_grav_vector() 5 0.004275 0.005457 0.00718 0.35% Castro::post_restart() 1 0.0004664 0.002126 0.006011 0.30% Castro::computeNewDt() 5 0.005843 0.005867 0.006004 0.30% Castro::initMFs() 1 0.004744 0.005522 0.005949 0.29% Gravity::add_pointmass_to_gravity() 10 0.003667 0.004564 0.005878 0.29% Castro::swap_state_time_levels() 5 0.004273 0.005014 0.005353 0.26% Castro::fill_hybrid_hydro_source() 15 0.002632 0.003639 0.004842 0.24% Castro::volWgtSum() 80 0.003165 0.003652 0.004013 0.20% Castro::enforce_min_density() 30 0.002268 0.002827 0.003817 0.19% Castro::construct_new_hybrid_source() 5 0.001592 0.002513 0.003435 0.17% Castro::finalize_advance() 5 0.001306 0.001668 0.002269 0.11% Castro::construct_old_hybrid_source() 5 0.0007583 0.00116 0.001689 0.08% Castro::locSquaredSum() 6 0.0007647 0.001003 0.00112 0.06% Castro::buildMetrics() 1 0.000229 0.0005081 0.0007381 0.04% Castro::locWgtSum() 15 0.0003815 0.0004967 0.0006489 0.03% Amr::InitAmr() 1 0.0002824 0.0004636 0.0005587 0.03% Amr::writeSmallPlotFile() 1 3.219e-05 8.591e-05 0.0001872 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.756e-05 4.669e-05 8.364e-05 0.00% FabArrayBase::getCPC() 10 5.119e-05 6.353e-05 7.854e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 9.307e-06 3.686e-05 6.708e-05 0.00% FabArrayBase::CPC::define() 2 2.973e-05 4.155e-05 5.397e-05 0.00% Castro::enforce_speed_limit() 30 1.818e-05 3.102e-05 4.009e-05 0.00% Amr::initSubcycle() 1 8.9e-06 1.891e-05 3.319e-05 0.00% Gravity::swapTimeLevels() 5 5.845e-06 1.217e-05 2.138e-05 0.00% Castro::create_source_corrector() 5 5.615e-06 1.044e-05 1.494e-05 0.00% Castro::construct_new_rotation_source() 5 4.117e-06 6.813e-06 9.278e-06 0.00% Gravity::set_mass_offset() 6 3.247e-06 5.46e-06 8.305e-06 0.00% Castro::retry_advance_ctu() 5 4.338e-06 6.243e-06 8.09e-06 0.00% Castro::gwstrain() 5 2.941e-06 5.923e-06 7.943e-06 0.00% Castro::construct_old_rotation_source() 5 2.173e-06 4.798e-06 7.838e-06 0.00% DistributionMapping::Distribute() 1 1.491e-06 2.531e-06 7.219e-06 0.00% Castro::FluxRegCrseInit 5 2.859e-06 4.648e-06 6.668e-06 0.00% Castro::FluxRegFineAdd() 5 1.481e-06 2.289e-06 2.978e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 51 B 70 B 76 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-10-gd39abbc396d0) finalized