MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.10-8-gfd2dfa282a30) initialized Starting run at 23:20:33 UTC on 2023-10-07. Successfully read inputs file ... Castro git describe: 23.10-15-ged646cc52 AMReX git describe: 23.10-8-gfd2dfa282 Microphysics git describe: 23.10-6-g657406dc reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.712e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.712e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.13197227 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001021804 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010298841 Gravity::multilevel_solve_for_new_phi() time = 0.10121417 Gravity::fill_multipole_BCs() time = 0.010340726 ... norm of composite residual at level 0 1.200586557e-11 TIME= 0 MASS = 2.550016282e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 1.160568787e+26 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 1.038459372e+35 TIME= 0 RHO*e = 1.326010803e+50 TIME= 0 RHO*K = 3.107408891e+49 TIME= 0 RHO*E = 1.636751692e+50 TIME= 0 RHO*PHI = -5.436616417e+50 TIME= 0 TOTAL ENERGY= -1.081556517e+50 TIME= 0 CENTER OF MASS X-LOC = 316428765.5 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -2.427317912e-07 TIME= 0 CENTER OF MASS Y-VEL = 4.551221085e-08 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4478306.394 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry_plt00000 Write plotfile time = 0.050332066 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.003946281 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.00596859 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111907026e+47 ener added: 3.959937774e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174263034e+41 ymom added: 6.499547884e+28 zmom added: 0 eint added: 0 ener added: 6.975102805e+47 Castro::do_old_sources() time = 0.063251794 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.5395407152 at index 0, 63, 0 Invalid density = -0.3054428341 at index 1, 63, 0 Invalid density = -0.19925533 at index 2, 63, 0 Invalid density = -0.02236888165 at index 3, 63, 0 Invalid density = -0.002752400461 at index 4, 63, 0 Invalid density = -0.0001805963159 at index 5, 63, 0 Invalid density = -0.5395407152 at index 0, 192, 0 Invalid density = -0.3054428341 at index 1, 192, 0 Invalid density = -0.19925533 at index 2, 192, 0 Invalid density = -0.02236888165 at index 3, 192, 0 Invalid density = -0.002752400461 at index 4, 192, 0 Invalid density = -0.0001805963159 at index 5, 192, 0 Invalid density = -490.7651063 at index 0, 64, 0 Invalid density = -415.3409079 at index 1, 64, 0 Invalid density = -323.5619581 at index 2, 64, 0 Invalid density = -206.9258486 at index 3, 64, 0 Invalid density = -120.8429986 at index 4, 64, 0 Invalid density = -9.703018344 at index 5, 64, 0 Invalid density = -0.2191048395 at index 6, 64, 0 Invalid density = -120.0389055 at index 4, 65, 0 Invalid density = -730.1620808 at index 5, 65, 0 Invalid density = -573.3100766 at index 6, 65, 0 Invalid density = -201.1266686 at index 7, 65, 0 Invalid density = -3.19243603 at index 8, 65, 0 Invalid density = 8.15187881e-06 at index 12, 65, 0 Invalid density = -851.3248962 at index 8, 66, 0 Invalid density = -307.6497321 at index 9, 66, 0 Invalid density = -1.400397078 at index 10, 66, 0 Invalid density = -1026.871606 at index 10, 67, 0 Invalid density = -31.02042094 at index 11, 67, 0 Invalid density = -434.7113415 at index 11, 68, 0 Invalid density = -453.4744922 at index 12, 68, 0 Invalid density = -707.3053561 at index 13, 69, 0 Invalid density = -773.8982107 at index 14, 70, 0 Invalid density = -621.669917 at index 15, 71, 0 Invalid density = -317.430671 at index 16, 72, 0 Invalid density = -594.3696703 at index 17, 74, 0 Invalid density = -123.1178809 at index 18, 75, 0 Invalid density = -216.0861231 at index 18, 76, 0 Invalid density = -50.38944737 at index 19, 77, 0 Invalid density = -150.351964 at index 19, 78, 0 Invalid density = -14.368147 at index 20, 80, 0 Invalid density = -14.47182143 at index 20, 81, 0 Invalid density = -0.08629568901 at index 21, 83, 0 Invalid density = -14.47182143 at index 20, 174, 0 Invalid density = -14.368147 at index 20, 175, 0 Invalid density = -150.351964 at index 19, 177, 0 Invalid density = -50.38944737 at index 19, 178, 0 Invalid density = -216.0861231 at index 18, 179, 0 Invalid density = -123.1178809 at index 18, 180, 0 Invalid density = -594.3696703 at index 17, 181, 0 Invalid density = -317.430671 at index 16, 183, 0 Invalid density = -621.669917 at index 15, 184, 0 Invalid density = -773.8982107 at index 14, 185, 0 Invalid density = -707.3053561 at index 13, 186, 0 Invalid density = -434.7113415 at index 11, 187, 0 Invalid density = -453.4744922 at index 12, 187, 0 Invalid density = -1026.871606 at index 10, 188, 0 Invalid density = -31.02042094 at index 11, 188, 0 Invalid density = -851.3248962 at index 8, 189, 0 Invalid density = -307.6497321 at index 9, 189, 0 Invalid density = -1.400397078 at index 10, 189, 0 Invalid density = -120.0389055 at index 4, 190, 0 Invalid density = -730.1620808 at index 5, 190, 0 Invalid density = -573.3100766 at index 6, 190, 0 Invalid density = -201.1266686 at index 7, 190, 0 Invalid density = -3.19243603 at index 8, 190, 0 Invalid density = 8.15187881e-06 at index 12, 190, 0 Invalid density = -490.7651063 at index 0, 191, 0 Invalid density = -415.3409079 at index 1, 191, 0 Invalid density = -323.5619581 at index 2, 191, 0 Invalid density = -206.9258486 at index 3, 191, 0 Invalid density = -120.8429986 at index 4, 191, 0 Invalid density = -9.703018344 at index 5, 191, 0 Invalid density = -0.2191048395 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Castro::construct_old_gravity() time = 0.010411949 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.025131374e+47 ener added: 6.152689817e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.871315169e+40 ymom added: 3.249773942e+28 zmom added: 0 eint added: 0 ener added: 3.487551402e+47 Castro::do_old_sources() time = 0.062467327 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.07835032792 at index 21, 82, 0 Invalid density = -0.07835032792 at index 21, 173, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Castro::construct_old_gravity() time = 0.009283748 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.935657584e+40 ymom added: 1.624886971e+28 zmom added: 0 eint added: 0 ener added: 1.743775701e+47 Castro::do_old_sources() time = 0.0599698 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1169776482 at index 20, 78, 0 Invalid density = -0.1169776482 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Castro::construct_old_gravity() time = 0.00977695 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467828792e+40 ymom added: 8.124434855e+27 zmom added: 0 eint added: 0 ener added: 8.718878506e+46 Castro::do_old_sources() time = 0.058522963 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.311843104 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01404511 Gravity::solve_for_phi() time = 0.08731374 on level 0 Castro::construct_new_gravity() time = 0.089425214 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.633726433e+44 ener added: 4.200095053e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.781456149e+35 ymom added: -3.716668059e+28 zmom added: 0 eint added: 0 ener added: 6.707077301e+43 Castro::do_new_sources() time = 0.060114268 on level 0  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Castro::construct_old_gravity() time = 0.006330006 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.986164758e+46 ener added: 8.164771748e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467864421e+40 ymom added: -6.620810699e+28 zmom added: 0 eint added: 0 ener added: 8.777790186e+46 Castro::do_old_sources() time = 0.061443701 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.987687252e+46 ener added: 1.467802441e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.322848129 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014463954 Gravity::solve_for_phi() time = 0.085598684 on level 0 Castro::construct_new_gravity() time = 0.08766029 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.311269273e+44 ener added: 4.829580519e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.794153606e+35 ymom added: 1.9214471e+27 zmom added: 0 eint added: 0 ener added: 5.9130095e+43 Castro::do_new_sources() time = 0.060086379 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.647099329e+28 ener added: 1.647099329e+28  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Castro::construct_old_gravity() time = 0.002493263 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985660459e+46 ener added: 5.417432265e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467900304e+40 ymom added: -6.236342066e+28 zmom added: 0 eint added: 0 ener added: 8.837263267e+46 Castro::do_old_sources() time = 0.061620392 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98655678e+46 ener added: 2.043813395e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.312397908 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015328865 Gravity::solve_for_phi() time = 0.084125575 on level 0 Castro::construct_new_gravity() time = 0.08627994 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.960587678e+43 ener added: 1.199428869e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.808775155e+35 ymom added: 2.171930745e+28 zmom added: 0 eint added: 0 ener added: 5.176523825e+43 Castro::do_new_sources() time = 0.058512887 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.282458256e+28 ener added: 4.282458256e+28  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Castro::construct_old_gravity() time = 0.002616722 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985014669e+46 ener added: 1.210572334e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46793648e+40 ymom added: -1.892701819e+28 zmom added: 0 eint added: 0 ener added: 8.898034896e+46 Castro::do_old_sources() time = 0.058026272 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993815443e+46 ener added: 2.182992304e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.309522017 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014697 Gravity::solve_for_phi() time = 0.083465029 on level 0 Castro::construct_new_gravity() time = 0.085619987 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.298689835e+43 ener added: 1.521209573e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.819537316e+35 ymom added: 1.411840004e+27 zmom added: 0 eint added: 0 ener added: 2.879778801e+43 Castro::do_new_sources() time = 0.058534549 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.833010846e+29 ener added: 2.833010846e+29  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Castro::construct_old_gravity() time = 0.002323959 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984517584e+46 ener added: 1.721915409e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467972871e+40 ymom added: -1.610462975e+28 zmom added: 0 eint added: 0 ener added: 8.959861724e+46 Castro::do_old_sources() time = 0.057952923 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.002061565e+46 ener added: 2.269607717e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.435645437 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014617641 Gravity::solve_for_phi() time = 0.083747094 on level 0 Castro::construct_new_gravity() time = 0.085885912 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.84124488e+43 ener added: 1.632025719e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.835255571e+35 ymom added: -1.924342973e+28 zmom added: 0 eint added: 0 ener added: -4.922795947e+42 Castro::do_new_sources() time = 0.058565823 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.235496646e+28 ener added: 8.235496646e+28  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Castro::construct_old_gravity() time = 0.002616163 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984186149e+46 ener added: 2.05673867e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468009576e+40 ymom added: -5.459221881e+28 zmom added: 0 eint added: 0 ener added: 9.022238316e+46 Castro::do_old_sources() time = 0.058026774 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.995854396e+46 ener added: 2.473652101e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.310190916 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014752114 Gravity::solve_for_phi() time = 0.08509294 on level 0 Castro::construct_new_gravity() time = 0.087340733 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.147540925e+44 ener added: 1.692926421e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.855690428e+35 ymom added: -4.066311719e+25 zmom added: 0 eint added: 0 ener added: -3.50328948e+43 Castro::do_new_sources() time = 0.05859344 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.014613187e+30 ener added: 1.014613187e+30  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Castro::construct_old_gravity() time = 0.002606946 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983795854e+46 ener added: 2.440948647e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46804669e+40 ymom added: -5.467064788e+28 zmom added: 0 eint added: 0 ener added: 9.085310501e+46 Castro::do_old_sources() time = 0.062762509 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.995583686e+46 ener added: 2.782028791e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.310573238 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014980958 Gravity::solve_for_phi() time = 0.083917845 on level 0 Castro::construct_new_gravity() time = 0.085998044 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.495374916e+43 ener added: 1.711457408e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.920720005e+35 ymom added: 1.125351739e+26 zmom added: 0 eint added: 0 ener added: -4.131669176e+42 Castro::do_new_sources() time = 0.059029452 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.872742298e+29 ener added: 3.872742298e+29  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.223584094e+28 ener added: 2.223584094e+28 Castro::construct_old_gravity() time = 0.002499224 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983610247e+46 ener added: 2.622576128e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468085104e+40 ymom added: -5.444397429e+28 zmom added: 0 eint added: 0 ener added: 9.149641967e+46 Castro::do_old_sources() time = 0.057931917 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98890102e+46 ener added: 3.154341291e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.310710561 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015109218 Gravity::solve_for_phi() time = 0.084917946 on level 0 Castro::construct_new_gravity() time = 0.087068265 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.843901354e+43 ener added: 1.740234758e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.981877863e+35 ymom added: -5.407418938e+27 zmom added: 0 eint added: 0 ener added: 2.211890347e+43 Castro::do_new_sources() time = 0.059403503 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.456634271e+29 ener added: 6.456634271e+29  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.00464258091 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.767126873e+29 ener added: 2.767126873e+29 TIME= 0.25 MASS = 2.550016282e+33 TIME= 0.25 XMOM = -4.354972054e+38 TIME= 0.25 YMOM = -3.559077613e+29 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = 3.302989197e+41 TIME= 0.25 RHO*e = 1.325990505e+50 TIME= 0.25 RHO*K = 3.179205242e+49 TIME= 0.25 RHO*E = 1.643911029e+50 TIME= 0.25 RHO*PHI = -5.450906497e+50 TIME= 0.25 TOTAL ENERGY= -1.081542219e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316413810.3 TIME= 0.25 CENTER OF MASS X-VEL = -170782.1274 TIME= 0.25 CENTER OF MASS Y-LOC = 0.6422537556 TIME= 0.25 CENTER OF MASS Y-VEL = -0.0001395707799 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 56767011.77 TIME= 0.25 MAXIMUM DENSITY = 4462836.066 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 7.117282766 [STEP 1] FAB kilobyte spread across MPI nodes: [6234 ... 6234] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry_plt00001 Write plotfile time = 0.046159354 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.013043783 seconds Ending run at 23:20:43 UTC on 2023-10-07. Run time = 9.482371433 Run time without initialization = 7.17725682 Average number of zones advanced per microsecond: 0.005 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 9.482 ... 9.482 ... 9.482 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 11 2.7931 2.8225 2.9536 31.15% Amr::InitAmr() 1 1.577 1.577 1.577 16.63% Castro::computeTemp() 63 0.6828 0.7402 0.8182 8.63% amrex::Copy() 559 0.547 0.5504 0.566 5.97% Castro::normalize_species() 62 0.4455 0.4475 0.459 4.84% FabArray::ParallelCopy_finish() 734 0.0222 0.3077 0.4464 4.71% Castro::reset_internal_energy(Fab) 126 0.4243 0.4284 0.4408 4.65% MultiFab::AddProduct() 2633 0.4183 0.4203 0.4283 4.52% MultiFab::Subtract() 125 0.2707 0.273 0.2847 3.00% Castro::initMFs() 1 0.2315 0.2373 0.2513 2.65% check_for_negative_density() 11 0.07504 0.2079 0.2442 2.58% FabArray::setVal() 3457 0.2263 0.2281 0.2321 2.45% MLPoisson::Fsmooth() 3120 0.1589 0.1714 0.2066 2.18% Castro::reset_internal_energy(MultiFab) 63 0.01779 0.05411 0.182 1.92% FabArray::sum() 2633 0.1371 0.1376 0.1403 1.48% Gravity::fill_multipole_BCs() 10 0.1012 0.1189 0.1371 1.45% Castro::initData() 1 0.003327 0.02214 0.126 1.33% FabArray::ParallelCopy_nowait() 734 0.06597 0.07223 0.0802 0.85% FillBoundary_finish() 3244 0.04307 0.05673 0.06906 0.73% Castro::enforce_min_density() 62 0.01362 0.02238 0.06279 0.66% FillBoundary_nowait() 3244 0.03714 0.04951 0.06268 0.66% MLPoisson::Fapply() 505 0.04807 0.05029 0.0577 0.61% MLCellLinOp::applyBC() 3634 0.02348 0.03115 0.05263 0.56% AmrLevel::derive() 18 0.04036 0.04066 0.04108 0.43% FabArray::Saxpy() 97 0.03569 0.03598 0.03851 0.41% Castro::do_new_sources() 8 0.0001744 0.006111 0.03577 0.38% VisMF::Write(FabArray) 4 0.01283 0.01899 0.03498 0.37% Castro::construct_new_gravity_source() 8 0.03128 0.03178 0.03242 0.34% FabArray::Xpay() 484 0.02606 0.02715 0.03092 0.33% Castro::do_old_sources() 11 0.0002845 0.00487 0.0285 0.30% Castro::construct_old_gravity_source() 11 0.02461 0.02496 0.02634 0.28% MultiFab::contains_nan() 19 0.023 0.02321 0.02339 0.25% MLMG::addInterpCorrection() 390 0.0173 0.01842 0.02195 0.23% Amr::writePlotFile() 2 0.006107 0.01637 0.01783 0.19% amrex::average_down 390 0.0125 0.01349 0.01634 0.17% Amr::writeSmallPlotFile() 2 0.003718 0.009338 0.01453 0.15% StateData::FillBoundary(geom) 62 0 0.007571 0.01436 0.15% Castro::wd_update() 2 0.004238 0.01046 0.01387 0.15% MLCGSolver::bicgstab 4 0 0.0007003 0.0112 0.12% Castro::evaluate_source_change() 144 0.01019 0.01037 0.01088 0.11% MLCellLinOp::defineAuxData() 10 0.007746 0.008124 0.00923 0.10% FabArray::FillBoundary() 3244 0.007185 0.007488 0.009168 0.10% FabArray::mult() 40 0.008534 0.008611 0.00871 0.09% amrex::Add() 69 0.007287 0.007388 0.008041 0.08% Castro::volWgtSum() 46 0.00728 0.007375 0.007493 0.08% Castro::construct_new_source() 48 0.007233 0.007279 0.007353 0.08% Castro::construct_old_gravity() 11 0.0002206 0.001679 0.007148 0.08% FabArray::norminf() 124 0.005337 0.005561 0.006893 0.07% MLCellLinOp::smooth() 1560 0.005963 0.006171 0.006781 0.07% MultiFab::max() 2 0.000186 0.005065 0.006653 0.07% FabArrayBase::getFB() 3244 0.005115 0.005271 0.006567 0.07% FillPatchIterator::Initialize 82 0.005412 0.00554 0.005627 0.06% Castro::construct_old_source() 66 0.005412 0.005462 0.005532 0.06% MLMG::prepareForSolve() 9 0.0052 0.005307 0.005508 0.06% MLMG::ResNormInf() 74 0.002992 0.003773 0.005441 0.06% Castro::volInBoundary() 14 0.003396 0.003647 0.00542 0.06% FabArray::setDomainBndry() 82 0.0002405 0.002722 0.00504 0.05% Gravity::get_old_grav_vector() 11 0.003532 0.003667 0.004399 0.05% Gravity::actual_solve_with_mlmg() 10 0.003557 0.003677 0.004129 0.04% MLLinOp::makeSubCommunicator() 10 0.0002971 0.002038 0.004007 0.04% FabArrayBase::getCPC() 1022 0.003702 0.003788 0.003962 0.04% Gravity::get_new_grav_vector() 9 0.00297 0.003115 0.003894 0.04% FabArrayBase::CPC::define() 305 0.001348 0.001998 0.003625 0.04% MLCellLinOp::compGrad() 9 0.002853 0.002903 0.003191 0.03% amrex::Dot() 72 0 0.0001941 0.003106 0.03% MLCellLinOp::apply() 505 0.001074 0.001195 0.002719 0.03% MLMG::solve() 9 0.0004232 0.001416 0.002549 0.03% Castro::initialize_do_advance() 11 0.002386 0.002416 0.00245 0.03% MLCGSolver::ParallelAllReduce 95 0 0.0001461 0.002338 0.02% Castro::sum_integrated_quantities() 2 0.001631 0.002128 0.002256 0.02% FabArray::ParallelCopy() 734 0.001895 0.001969 0.002124 0.02% FabArray::LinComb() 36 0 0.0001166 0.001865 0.02% BndryData::define() 10 0.001641 0.00166 0.001676 0.02% MLPoisson::normalize() 40 0 9.833e-05 0.001573 0.02% MLCellLinOp::correctionResidual() 394 0.0009664 0.001004 0.00124 0.01% AmrLevel::FillPatch() 82 0.001132 0.001152 0.001213 0.01% main() 1 0.0009217 0.001109 0.001202 0.01% MLLinOp::defineGrids() 10 0.0009566 0.001031 0.001175 0.01% Castro::locWgtSum() 6 0.001122 0.001125 0.001141 0.01% MLCellLinOp::prepareForSolve() 10 0.0008892 0.0009599 0.001118 0.01% TagBoxArray::collate() 2 5.623e-05 0.0003518 0.001077 0.01% MLMG::mgVcycle() 65 0.000856 0.0008861 0.0009724 0.01% StateData::define() 5 0.00088 0.0009012 0.0009661 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 320 0.0006894 0.0008119 0.0009258 0.01% MLCellLinOp::defineBC() 10 0.0008221 0.0008451 0.0009113 0.01% Castro::enforce_consistent_e() 1 0.0003695 0.000424 0.0008773 0.01% FabArrayBase::FB::FB() 38 0.0002094 0.0004404 0.0008225 0.01% Gravity::solve_for_phi() 8 0.0003697 0.0004654 0.0008189 0.01% MLMG:computeResOfCorrection() 390 0.0007272 0.0007547 0.0007954 0.01% Castro::save_data_for_retry() 3 0.0007447 0.0007732 0.0007873 0.01% AmrMesh::MakeNewGrids() 2 0.0004994 0.0005676 0.0007343 0.01% Castro::subcycle_advance_ctu() 1 9.047e-05 0.0001309 0.0006398 0.01% Castro::buildMetrics() 1 0.0005661 0.0005854 0.0006012 0.01% MLMG::actualBottomSolve() 65 7.036e-05 0.0001039 0.0005825 0.01% Castro::problem_post_timestep() 2 1.101e-05 4.63e-05 0.0005635 0.01% Castro::apply_tagging_restrictions() 2 0.0004201 0.0004838 0.0005349 0.01% Castro::construct_new_gravity() 8 0.0001326 0.0001864 0.0005303 0.01% Castro::Castro() 1 0.0004688 0.0004879 0.0005203 0.01% Gravity::applyMetricTerms() 2 0.00049 0.000498 0.0005082 0.01% StateDataPhysBCFunct::() 82 0.0003362 0.000403 0.0004536 0.00% MLCellLinOp::setLevelBC() 10 0.0002849 0.0003524 0.00045 0.00% Castro::swap_state_time_levels() 8 0.0004195 0.0004326 0.0004482 0.00% FillPatchIterator::FillFromLevel0() 82 0.0003915 0.0004043 0.000428 0.00% Castro::volProductSum() 2 0.0003943 0.0003993 0.0004058 0.00% MLMG::mgVcycle_down::2 65 0.0003321 0.0003647 0.0004028 0.00% Castro::clean_state() 62 0.0003302 0.0003476 0.0003953 0.00% MLMG::mgVcycle_down::3 65 0.0003172 0.0003367 0.0003922 0.00% MLMG::mgVcycle_down::5 65 0.0003191 0.0003274 0.0003806 0.00% MLMG::mgVcycle_down::0 65 0.0003569 0.0003635 0.0003781 0.00% MLMG::mgVcycle_down::4 65 0.0003097 0.0003214 0.0003743 0.00% MLMG::mgVcycle_down::1 65 0.0003561 0.0003642 0.0003735 0.00% Castro::do_advance_ctu() 11 0.0002562 0.0002687 0.0002959 0.00% FillPatchSingleLevel 82 0.0002625 0.0002706 0.0002876 0.00% makeSFC 50 0.0002074 0.0002275 0.0002741 0.00% MLMG::mgVcycle_up::1 65 0.0002466 0.000256 0.0002692 0.00% MLMG::mgVcycle_up::5 65 0.0002147 0.0002226 0.0002631 0.00% MLMG::mgVcycle_up::0 65 0.0002521 0.0002564 0.0002626 0.00% MLMG::mgVcycle_up::2 65 0.0002119 0.0002335 0.000259 0.00% MLMG::mgVcycle_up::3 65 0.0002105 0.000218 0.0002532 0.00% MLMG::mgVcycle_up::4 65 0.0002125 0.0002186 0.0002499 0.00% MLCellLinOp::solutionResidual() 75 0.0002216 0.0002277 0.0002323 0.00% MLMG::oneIter() 65 0.0001976 0.0002048 0.0002144 0.00% MLLinOp::makeAgglomeratedDMap 10 0.0001785 0.0001882 0.0002078 0.00% Amr::FinalizeInit() 1 8.885e-06 3.337e-05 0.0001919 0.00% Gravity::update_max_rhs() 2 0.0001631 0.0001696 0.0001768 0.00% Castro::retry_advance_ctu() 11 4.583e-05 5.668e-05 0.0001744 0.00% OwnerMask() 2 0.0001355 0.0001547 0.0001696 0.00% MLMG::compResidual() 1 0.0001569 0.0001599 0.0001644 0.00% Amr::defBaseLevel() 1 0.0001014 0.0001134 0.0001469 0.00% Gravity::solve_phi_with_mlmg() 10 0.0001211 0.0001277 0.0001415 0.00% Amr::grid_places() 2 7.908e-05 0.0001087 0.0001393 0.00% MLMG::mgVcycle_bottom 65 0.0001253 0.0001293 0.0001362 0.00% TagBoxArray::mapPRD 2 0.0001108 0.0001193 0.0001317 0.00% MLMG::computeResidual() 65 0.0001256 0.0001279 0.0001312 0.00% Amr::coarseTimeStep() 1 0.0001041 0.0001243 0.0001278 0.00% Gravity::test_composite_phi() 1 9.296e-05 9.915e-05 0.0001277 0.00% Castro::initialize_advance() 1 0.0001005 0.0001069 0.0001259 0.00% DistributionMapping::Distribute() 50 0.0001123 0.0001177 0.0001246 0.00% Castro::apply_problem_tags() 2 9.156e-05 9.532e-05 0.0001036 0.00% Castro::enforce_speed_limit() 62 8.706e-05 9.107e-05 9.644e-05 0.00% MultiFab::Swap() 5 6.853e-05 7.149e-05 8.87e-05 0.00% Castro::finalize_do_advance() 8 6.417e-05 6.939e-05 8.199e-05 0.00% knapsack() 1 5.992e-05 6.696e-05 7.968e-05 0.00% MLPoisson::define() 10 6.875e-05 7.242e-05 7.948e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.077e-05 6.616e-05 7.74e-05 0.00% Castro::react_state() 19 5.432e-05 5.807e-05 7.379e-05 0.00% Castro::check_for_nan() 19 5.381e-05 5.681e-05 6.291e-05 0.00% Amr::initSubcycle() 1 5.689e-05 6.092e-05 6.267e-05 0.00% Castro::apply_source_to_state() 19 5.154e-05 5.398e-05 5.762e-05 0.00% Castro::create_source_corrector() 8 3.507e-05 3.914e-05 4.893e-05 0.00% MLLinOp::define() 10 4.057e-05 4.293e-05 4.552e-05 0.00% Castro::derive() 18 4.213e-05 4.291e-05 4.47e-05 0.00% MLPoisson::prepareForSolve() 10 3.743e-05 3.88e-05 4.162e-05 0.00% Castro::expand_state() 11 3.009e-05 3.282e-05 3.847e-05 0.00% Gravity::swapTimeLevels() 8 3.292e-05 3.467e-05 3.826e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.41e-05 3.522e-05 3.796e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.713e-05 2.806e-05 3.243e-05 0.00% Amr::regrid() 1 1.193e-05 1.663e-05 3.158e-05 0.00% MLMG::computeMLResidual() 9 2.2e-05 2.46e-05 3.017e-05 0.00% Gravity::actual_multilevel_solve() 1 2.759e-05 2.804e-05 2.882e-05 0.00% MLMG::getGradSolution() 9 2.092e-05 2.176e-05 2.375e-05 0.00% Castro::post_regrid() 2 1.113e-05 1.307e-05 2.307e-05 0.00% Castro::finalize_advance() 1 1.747e-05 1.914e-05 2.285e-05 0.00% Gravity::set_mass_offset() 2 4.303e-06 1.204e-05 2.233e-05 0.00% MLMG::MLResNormInf() 9 1.721e-05 1.825e-05 2.081e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.651e-05 1.796e-05 1.957e-05 0.00% Castro::construct_old_rotation_source() 11 1.744e-05 1.803e-05 1.875e-05 0.00% Castro::estTimeStep() 10 1.108e-05 1.233e-05 1.757e-05 0.00% MLMG::MLRhsNormInf() 9 1.645e-05 1.685e-05 1.723e-05 0.00% Amr::timeStep() 1 1.223e-05 1.324e-05 1.695e-05 0.00% Castro::computeInitialDt() 2 7.595e-06 1.116e-05 1.529e-05 0.00% Castro::post_init() 1 1.28e-05 1.335e-05 1.447e-05 0.00% Amr::InitializeInit() 1 6.982e-06 8.731e-06 1.424e-05 0.00% Castro::errorEst() 2 6.409e-06 7.708e-06 1.374e-05 0.00% Castro::advance() 1 7.493e-06 9.306e-06 1.254e-05 0.00% Castro::construct_new_rotation_source() 8 1.059e-05 1.115e-05 1.193e-05 0.00% Amr::bldFineLevels() 1 7.195e-06 8.706e-06 1.049e-05 0.00% Amr::init() 1 6.753e-06 7.48e-06 1.045e-05 0.00% Castro::post_timestep() 1 5.707e-06 6.677e-06 1.016e-05 0.00% Amr::initialInit() 1 3.236e-06 4.926e-06 8.99e-06 0.00% BoxList::parallelComplementIn() 4 7.266e-06 7.561e-06 8.377e-06 0.00% BoxList::complementIn 4 6.282e-06 6.504e-06 7.15e-06 0.00% Castro::gwstrain() 2 4.202e-06 4.768e-06 7.028e-06 0.00% Castro::FluxRegCrseInit 1 1.628e-06 1.931e-06 2.618e-06 0.00% Castro::FluxRegFineAdd() 1 1.418e-06 1.529e-06 1.626e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 9.482 9.482 9.482 100.00% Amr::coarseTimeStep() 1 7.177 7.177 7.177 75.68% Amr::timeStep() 1 7.117 7.117 7.117 75.06% Castro::advance() 1 7.052 7.055 7.059 74.44% Castro::subcycle_advance_ctu() 1 6.999 7.005 7.01 73.93% Castro::do_advance_ctu() 11 6.976 6.981 6.987 73.68% Castro::construct_ctu_hydro_source() 11 3.379 3.395 3.416 36.02% Castro::clean_state() 62 2.914 2.99 3.09 32.59% Castro::computeTemp() 63 1.893 1.968 2.11 22.25% Amr::InitAmr() 1 1.577 1.577 1.577 16.63% Castro::reset_internal_energy(MultiFab) 63 1.187 1.228 1.351 14.24% Gravity::solve_phi_with_mlmg() 10 0.7539 0.7719 0.7911 8.34% Castro::initialize_do_advance() 11 0.7411 0.7563 0.7741 8.16% Castro::evaluate_source_change() 144 0.7177 0.7209 0.7344 7.74% Amr::init() 1 0.7276 0.7276 0.7276 7.67% Castro::construct_new_gravity() 8 0.659 0.6763 0.6951 7.33% Gravity::solve_for_phi() 8 0.6412 0.659 0.6781 7.15% Amr::initialInit() 1 0.6725 0.6725 0.6727 7.09% Castro::enforce_min_density() 62 0.6154 0.6286 0.6646 7.01% Castro::do_old_sources() 11 0.6409 0.6508 0.6586 6.95% Gravity::actual_solve_with_mlmg() 10 0.6492 0.6512 0.6535 6.89% MLMG::solve() 9 0.6226 0.6247 0.6254 6.60% amrex::Copy() 559 0.547 0.5504 0.566 5.97% MLMG::oneIter() 65 0.5551 0.5563 0.557 5.87% MLMG::mgVcycle() 65 0.5476 0.5487 0.5494 5.79% FabArray::ParallelCopy() 734 0.1137 0.3984 0.536 5.65% Castro::do_new_sources() 8 0.4374 0.4567 0.4724 4.98% Castro::normalize_species() 62 0.4455 0.4475 0.459 4.84% FabArray::ParallelCopy_finish() 734 0.0222 0.3077 0.4464 4.71% Amr::InitializeInit() 1 0.3145 0.3669 0.4452 4.69% Amr::defBaseLevel() 1 0.3145 0.3669 0.4452 4.69% Castro::reset_internal_energy(Fab) 126 0.4243 0.4284 0.4408 4.65% MultiFab::AddProduct() 2633 0.4183 0.4203 0.4283 4.52% MLCellLinOp::smooth() 1560 0.273 0.2962 0.3584 3.78% Amr::FinalizeInit() 1 0.2273 0.3056 0.358 3.78% AmrLevel::FillPatch() 82 0.1888 0.2642 0.3144 3.32% MultiFab::Subtract() 125 0.2707 0.273 0.2847 3.00% Castro::Castro() 1 0.2356 0.2415 0.2569 2.71% Castro::initMFs() 1 0.2316 0.2374 0.2514 2.65% check_for_negative_density() 11 0.07504 0.2079 0.2442 2.58% FillPatchIterator::Initialize 82 0.118 0.1931 0.2436 2.57% FillPatchIterator::FillFromLevel0() 82 0.1076 0.1848 0.236 2.49% FillPatchSingleLevel 82 0.1072 0.1844 0.2356 2.48% FabArray::setVal() 3457 0.2263 0.2281 0.2321 2.45% MLMG::mgVcycle_up::1 65 0.04556 0.129 0.2126 2.24% Castro::initData() 1 0.07697 0.1243 0.2079 2.19% MLPoisson::Fsmooth() 3120 0.1589 0.1714 0.2066 2.18% MLMG::addInterpCorrection() 390 0.03193 0.1558 0.1894 2.00% MLCellLinOp::applyBC() 3634 0.1302 0.1506 0.1874 1.98% Amr::bldFineLevels() 1 0.04533 0.124 0.1758 1.85% MLMG::mgVcycle_up::2 65 0.005626 0.05951 0.1424 1.50% FabArray::sum() 2633 0.1371 0.1376 0.1403 1.48% Castro::post_init() 1 0.1336 0.1385 0.1401 1.48% Gravity::fill_multipole_BCs() 10 0.1023 0.12 0.1382 1.46% FabArray::FillBoundary() 3244 0.1033 0.1194 0.1355 1.43% MLMG::mgVcycle_down::0 65 0.1309 0.1334 0.1346 1.42% Amr::grid_places() 2 0.00232 0.08065 0.133 1.40% AmrMesh::MakeNewGrids() 2 0.002203 0.08054 0.1329 1.40% TagBoxArray::mapPRD 2 0.0006695 0.07887 0.1315 1.39% Castro::expand_state() 11 0.09796 0.1079 0.1221 1.29% MLCellLinOp::apply() 505 0.07761 0.08263 0.1021 1.08% Gravity::multilevel_solve_for_new_phi() 1 0.1012 0.1012 0.1012 1.07% Gravity::actual_multilevel_solve() 1 0.1011 0.1011 0.1012 1.07% MLMG::mgVcycle_up::0 65 0.09654 0.09772 0.09855 1.04% Amr::writePlotFile() 2 0.097 0.09711 0.09712 1.02% FabArray::ParallelCopy_nowait() 734 0.08198 0.08869 0.09708 1.02% MLMG::mgVcycle_up::3 65 0.005594 0.01237 0.09552 1.01% Castro::post_regrid() 2 0.08485 0.08641 0.0913 0.96% MLCellLinOp::correctionResidual() 394 0.0568 0.06254 0.07551 0.80% MLMG:computeResOfCorrection() 390 0.05754 0.06316 0.07416 0.78% Castro::derive() 18 0.0687 0.06924 0.07067 0.75% AmrLevel::derive() 18 0.06865 0.0692 0.07063 0.74% FillBoundary_finish() 3244 0.04307 0.05673 0.06906 0.73% FillBoundary_nowait() 3244 0.0425 0.05522 0.06865 0.72% Castro::post_timestep() 1 0.05817 0.0626 0.06554 0.69% MLMG::mgVcycle_down::1 65 0.05602 0.05797 0.06133 0.65% Castro::construct_new_source() 48 0.05715 0.05779 0.05869 0.62% MLPoisson::Fapply() 505 0.04807 0.05029 0.0577 0.61% Castro::construct_old_gravity() 11 0.025 0.04693 0.05563 0.59% Gravity::get_old_grav_vector() 11 0.02143 0.04525 0.05534 0.58% Castro::initialize_advance() 1 0.0482 0.04916 0.0523 0.55% MLCellLinOp::solutionResidual() 75 0.04543 0.04767 0.0506 0.53% Amr::regrid() 1 0.04353 0.04432 0.04629 0.49% Castro::construct_old_source() 66 0.04286 0.04328 0.04465 0.47% MLMG::mgVcycle_bottom 65 0.0001976 0.002863 0.0428 0.45% MLMG::actualBottomSolve() 65 7.036e-05 0.002734 0.04266 0.45% MLCGSolver::bicgstab 4 0 0.002615 0.04184 0.44% Castro::create_source_corrector() 8 0.01512 0.03205 0.04145 0.44% MLMG::computeResidual() 65 0.03781 0.03923 0.04048 0.43% FabArray::Saxpy() 97 0.03569 0.03598 0.03851 0.41% MLMG::mgVcycle_down::2 65 0.006545 0.02011 0.03503 0.37% VisMF::Write(FabArray) 4 0.01283 0.01899 0.03498 0.37% Castro::construct_new_gravity_source() 8 0.03128 0.03178 0.03242 0.34% FabArray::Xpay() 484 0.02606 0.02715 0.03092 0.33% MLMG::mgVcycle_down::3 65 0.006214 0.009219 0.02968 0.31% amrex::average_down 390 0.01672 0.01975 0.02745 0.29% Castro::construct_old_gravity_source() 11 0.02461 0.02496 0.02634 0.28% Castro::check_for_nan() 19 0.02306 0.02327 0.02345 0.25% MultiFab::contains_nan() 19 0.023 0.02321 0.02339 0.25% Castro::retry_advance_ctu() 11 0.02236 0.02255 0.02289 0.24% Castro::sum_integrated_quantities() 2 0.02074 0.02117 0.0212 0.22% MLPoisson::define() 10 0.01536 0.01762 0.02053 0.22% Gravity::get_new_grav_vector() 9 0.01774 0.01833 0.01917 0.20% MLMG::mgVcycle_down::4 65 0.006185 0.00696 0.01761 0.19% Amr::writeSmallPlotFile() 2 0.01739 0.01739 0.01739 0.18% Castro::problem_post_timestep() 2 0.009671 0.01416 0.01727 0.18% Castro::wd_update() 2 0.009658 0.01411 0.01726 0.18% Castro::react_state() 19 0.01519 0.01535 0.01569 0.17% Castro::apply_source_to_state() 19 0.01482 0.0149 0.0153 0.16% StateDataPhysBCFunct::() 82 0.0003362 0.007973 0.0148 0.16% StateData::FillBoundary(geom) 62 0 0.007571 0.01436 0.15% Gravity::test_composite_phi() 1 0.01382 0.01385 0.01387 0.15% MLMG::mgVcycle_up::4 65 0.005657 0.0062 0.01384 0.15% MLCellLinOp::defineAuxData() 10 0.01004 0.01079 0.01298 0.14% MLMG::prepareForSolve() 9 0.01032 0.01079 0.01184 0.12% MLMG::mgVcycle_down::5 65 0.006176 0.006583 0.01174 0.12% Castro::save_data_for_retry() 3 0.01106 0.01112 0.01127 0.12% MLMG::mgVcycle_up::5 65 0.005678 0.005992 0.01012 0.11% MLMG::ResNormInf() 74 0.00767 0.008455 0.01009 0.11% MLMG::computeMLResidual() 9 0.005251 0.00789 0.009847 0.10% FabArray::mult() 40 0.008534 0.008611 0.00871 0.09% amrex::Add() 69 0.007287 0.007388 0.008041 0.08% Gravity::update_max_rhs() 2 0.001429 0.006325 0.0079 0.08% FabArrayBase::getCPC() 1022 0.005121 0.005786 0.007586 0.08% Castro::volWgtSum() 46 0.00728 0.007375 0.007493 0.08% FabArrayBase::getFB() 3244 0.005354 0.005712 0.007389 0.08% FabArray::norminf() 124 0.005337 0.005561 0.006893 0.07% MultiFab::max() 2 0.000186 0.005065 0.006653 0.07% MLLinOp::define() 10 0.001873 0.003645 0.005814 0.06% MLLinOp::defineGrids() 10 0.001831 0.003602 0.00577 0.06% Castro::volInBoundary() 14 0.003396 0.003647 0.00542 0.06% FabArray::setDomainBndry() 82 0.0002405 0.002722 0.00504 0.05% MLMG::getGradSolution() 9 0.003647 0.003749 0.004062 0.04% MLCellLinOp::compGrad() 9 0.003624 0.003727 0.00404 0.04% MLCGSolver::ParallelAllReduce 95 0 0.0002519 0.00403 0.04% MLLinOp::makeSubCommunicator() 10 0.0002971 0.002038 0.004007 0.04% FabArrayBase::CPC::define() 305 0.001348 0.001998 0.003625 0.04% MLCellLinOp::defineBC() 10 0.00302 0.003114 0.003218 0.03% amrex::Dot() 72 0 0.0001941 0.003106 0.03% BndryData::define() 10 0.002156 0.002269 0.00237 0.02% FabArray::LinComb() 36 0 0.0001166 0.001865 0.02% MLPoisson::normalize() 40 0 9.833e-05 0.001573 0.02% MLMG::compResidual() 1 0.0009374 0.001077 0.001252 0.01% Gravity::swapTimeLevels() 8 0.001157 0.001178 0.001224 0.01% MLPoisson::prepareForSolve() 10 0.0009303 0.0009987 0.001157 0.01% Castro::locWgtSum() 6 0.001122 0.001125 0.001141 0.01% MLCellLinOp::prepareForSolve() 10 0.0008892 0.0009599 0.001118 0.01% TagBoxArray::collate() 2 5.623e-05 0.0003518 0.001077 0.01% AmrLevel::AmrLevel(dm) 1 0.0009146 0.0009365 0.001001 0.01% StateData::define() 5 0.00088 0.0009012 0.0009661 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 320 0.0006894 0.0008119 0.0009258 0.01% Castro::enforce_consistent_e() 1 0.0003695 0.000424 0.0008773 0.01% FabArrayBase::FB::FB() 38 0.0002094 0.0004404 0.0008225 0.01% Castro::buildMetrics() 1 0.000626 0.0006468 0.0006624 0.01% Castro::errorEst() 2 0.0005191 0.0005869 0.0006425 0.01% MLMG::MLResNormInf() 9 0.0005973 0.0006107 0.0006382 0.01% MLMG::MLRhsNormInf() 9 0.000574 0.0005859 0.000604 0.01% MLLinOp::makeAgglomeratedDMap 10 0.0005069 0.0005335 0.0005891 0.01% Castro::apply_tagging_restrictions() 2 0.0004201 0.0004838 0.0005349 0.01% Gravity::applyMetricTerms() 2 0.00049 0.000498 0.0005082 0.01% MLCellLinOp::setLevelBC() 10 0.0002849 0.0003524 0.00045 0.00% Castro::swap_state_time_levels() 8 0.0004195 0.0004326 0.0004482 0.00% Castro::volProductSum() 2 0.0003943 0.0003993 0.0004058 0.00% makeSFC 50 0.0003263 0.0003452 0.0003954 0.00% Castro::finalize_advance() 1 0.0002549 0.0002622 0.0002816 0.00% OwnerMask() 2 0.0001355 0.0001547 0.0001696 0.00% DistributionMapping::KnapSackDoIt() 1 9.481e-05 0.000113 0.0001312 0.00% DistributionMapping::Distribute() 50 0.0001123 0.0001177 0.0001246 0.00% Castro::apply_problem_tags() 2 9.156e-05 9.532e-05 0.0001036 0.00% Castro::enforce_speed_limit() 62 8.706e-05 9.107e-05 9.644e-05 0.00% Castro::finalize_do_advance() 8 7.245e-05 7.842e-05 9.121e-05 0.00% MultiFab::Swap() 5 6.853e-05 7.149e-05 8.87e-05 0.00% knapsack() 1 5.992e-05 6.696e-05 7.968e-05 0.00% Amr::initSubcycle() 1 5.689e-05 6.092e-05 6.267e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.713e-05 2.806e-05 3.243e-05 0.00% Gravity::set_mass_offset() 2 4.303e-06 1.204e-05 2.233e-05 0.00% Castro::computeInitialDt() 2 1.066e-05 1.446e-05 1.882e-05 0.00% Castro::construct_old_rotation_source() 11 1.744e-05 1.803e-05 1.875e-05 0.00% Castro::estTimeStep() 10 1.108e-05 1.233e-05 1.757e-05 0.00% BoxList::parallelComplementIn() 4 1.358e-05 1.406e-05 1.553e-05 0.00% Castro::construct_new_rotation_source() 8 1.059e-05 1.115e-05 1.193e-05 0.00% BoxList::complementIn 4 6.282e-06 6.504e-06 7.15e-06 0.00% Castro::gwstrain() 2 4.202e-06 4.768e-06 7.028e-06 0.00% Castro::FluxRegCrseInit 1 1.628e-06 1.931e-06 2.618e-06 0.00% Castro::FluxRegFineAdd() 1 1.418e-06 1.529e-06 1.626e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 19 B 21 B 33 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-8-gfd2dfa282a30) finalized