MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.04-10-g1a5d8917fd49) initialized Starting run at 07:22:22 UTC on 2022-04-08. Successfully read inputs file ... Castro git describe: 22.04-2-gb74783602 AMReX git describe: 22.04-10-g1a5d8917f Microphysics git describe: 22.04-1-gef526ccd reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 castro.use_stopping_criterion = 1 castro.dtnuc_mode = 1 Warning: the following integrator.* parameters are ignored integrator.do_constant_volume_burn = 1 integrator.retry_burn = 1 Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.145528173 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000986064 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010750533 Gravity::fill_multipole_BCs() time = 0.010563557 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -2.5098073e-31 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.273077662 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.00793212 seconds [Level 0 step 1] ADVANCE with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.062284649 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.283190946 Advance was unsuccessful with reason: negative density (density = -9.081732e+02 at index (14,70); started at 4.477055e+03); proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.061295267 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.231318345 Advance was unsuccessful with reason: negative density (density = -1.592544e+00 at index (20,79); started at 2.790161e+00); proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.058534081 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.228260555 Advance was unsuccessful with reason: negative density (density = -1.060745e-01 at index (20,78); started at 2.068339e-01); proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.055584749 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.225293104 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014107619 Gravity::solve_for_phi() time = 0.079731856 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.058460736 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.055226094 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.224098203 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.013650672 Gravity::solve_for_phi() time = 0.079404653 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.059073499 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.055118224 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.229326203 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.013848008 Gravity::solve_for_phi() time = 0.079527795 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.059240663 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.055115189 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.229838184 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.997068055e+46 ener added: 2.415044041e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014437994 Gravity::solve_for_phi() time = 0.080364111 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.543114243e+44 ener added: 4.768138875e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.765646947e+35 ymom added: 1.797592414e+26 zmom added: 0 eint added: 0 ener added: 5.380039006e+43 Castro::do_new_sources() time = 0.058360085 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.055388105 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.235445906 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.317346246e+44 ener added: 3.120883219e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.013848451 Gravity::solve_for_phi() time = 0.079651236 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.957879842e+46 ener added: 4.564181618e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.001437306e+36 ymom added: 1.471489396e+25 zmom added: 0 eint added: 0 ener added: 6.980886509e+46 Castro::do_new_sources() time = 0.058881791 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.055474179 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.229240761 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.012688492e+46 ener added: 2.110657671e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014633166 Gravity::solve_for_phi() time = 0.080360648 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.326633224e+44 ener added: 1.174460404e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.711471844e+35 ymom added: 1.66063198e+26 zmom added: 0 eint added: 0 ener added: 2.826321793e+43 Castro::do_new_sources() time = 0.05833819 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.055111459 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.234232685 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.090986835e+44 ener added: 2.655092076e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01388037 Gravity::solve_for_phi() time = 0.079667366 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.968859957e+46 ener added: 1.10301368e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.004822123e+36 ymom added: -8.771795742e+24 zmom added: 0 eint added: 0 ener added: 6.987657644e+46 Castro::do_new_sources() time = 0.059058408 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.055241666 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.23024383 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.025000527e+46 ener added: 2.183068315e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014977224 Gravity::solve_for_phi() time = 0.083661641 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.651474965e+44 ener added: 1.477761377e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.60533052e+35 ymom added: 1.690843319e+26 zmom added: 0 eint added: 0 ener added: -1.190247427e+43 Castro::do_new_sources() time = 0.05855655 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.055092048 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.236189961 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.213015184e+44 ener added: 2.894439872e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014770473 Gravity::solve_for_phi() time = 0.081885984 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.97482432e+46 ener added: 1.388215779e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.00305216e+36 ymom added: 1.271497176e+24 zmom added: 0 eint added: 0 ener added: 6.99302976e+46 Castro::do_new_sources() time = 0.059229697 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.055519142 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.230714199 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.046400343e+46 ener added: 2.16073557e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014903992 Gravity::solve_for_phi() time = 0.080551268 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.248919276e+44 ener added: 1.60656791e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.450686215e+35 ymom added: 1.697312961e+26 zmom added: 0 eint added: 0 ener added: -6.185767806e+43 Castro::do_new_sources() time = 0.058563718 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.055162003 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.234901262 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.824816589e+44 ener added: 2.945461224e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014620732 Gravity::solve_for_phi() time = 0.080424841 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.977981871e+46 ener added: 1.507699921e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.996348783e+36 ymom added: 3.069538214e+24 zmom added: 0 eint added: 0 ener added: 6.997250022e+46 Castro::do_new_sources() time = 0.059057237 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.055018574 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.230361565 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.067953295e+46 ener added: 2.185941597e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015085288 Gravity::solve_for_phi() time = 0.080625429 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.036038551e+44 ener added: 1.710131682e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.236317743e+35 ymom added: 1.665059198e+26 zmom added: 0 eint added: 0 ener added: -1.282743578e+44 Castro::do_new_sources() time = 0.058628782 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.055341381 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.235620326 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.23178587e+44 ener added: 2.927676839e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014578685 Gravity::solve_for_phi() time = 0.080148843 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.979285299e+46 ener added: 1.614875382e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.983606539e+36 ymom added: -1.663453594e+24 zmom added: 0 eint added: 0 ener added: 6.999733101e+46 Castro::do_new_sources() time = 0.058966095 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.055012295 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.230711831 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.076022112e+46 ener added: 2.369765675e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015066018 Gravity::solve_for_phi() time = 0.080760487 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.768256697e+44 ener added: 1.742935385e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.789276502e+34 ymom added: 1.761383669e+26 zmom added: 0 eint added: 0 ener added: -1.824543748e+44 Castro::do_new_sources() time = 0.058882388 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.055436991 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.235370789 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.399341724e+44 ener added: 3.055404896e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014883981 Gravity::solve_for_phi() time = 0.081451308 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.981378524e+46 ener added: 1.65468052e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.966651828e+36 ymom added: 1.133367956e+23 zmom added: 0 eint added: 0 ener added: 7.003642946e+46 Castro::do_new_sources() time = 0.059219621 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.055231793 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.23094741 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.085134477e+46 ener added: 2.616682453e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015388082 Gravity::solve_for_phi() time = 0.08119066 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.966387031e+44 ener added: 1.764409733e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.086349894e+34 ymom added: 1.71437251e+26 zmom added: 0 eint added: 0 ener added: -1.814844154e+44 Castro::do_new_sources() time = 0.058969269 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.055546151 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.235169127 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.20798565e+44 ener added: 3.358777738e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015070634 Gravity::solve_for_phi() time = 0.080746264 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988653412e+46 ener added: 1.671056473e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.948364053e+36 ymom added: 7.142579305e+23 zmom added: 0 eint added: 0 ener added: 7.013022432e+46 Castro::do_new_sources() time = 0.05920187 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.003070703207 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.548275694e+29 ener added: 1.548275694e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -2.890848341e+38 TIME= 0.25 YMOM = 8.975065285e+27 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.505143013e+38 TIME= 0.25 RHO*e = 1.331449006e+50 TIME= 0.25 RHO*K = 3.171006988e+49 TIME= 0.25 RHO*E = 1.648549705e+50 TIME= 0.25 RHO*PHI = -5.460195609e+50 TIME= 0.25 TOTAL ENERGY= -1.0815481e+50 TIME= 0.25 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0.25 CENTER OF MASS X-VEL = -113366.7542 TIME= 0.25 CENTER OF MASS Y-LOC = -4.196397805e-29 TIME= 0.25 CENTER OF MASS Y-VEL = 3.519638182e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 [STEP 1] Coarse TimeStep time: 10.76551758 [STEP 1] FAB kilobyte spread across MPI nodes: [7068 ... 7068] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.046538069 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.006702699 seconds Ending run at 07:22:35 UTC on 2022-04-08. Run time = 13.31530022 Run time without initialization = 10.82085335 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 13.32 ... 13.32 ... 13.32 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 4.5557 4.6071 4.6738 35.10% Amr::InitAmr() 1 1.37 1.37 1.371 10.29% Castro::computeTemp() 80 0.8578 0.9635 1.121 8.42% Castro::reset_internal_energy() 80 0.876 0.9121 1.017 7.64% FabArray::ParallelCopy_finish() 1583 0.1253 0.4437 0.6407 4.81% MultiFab::AddProduct() 3439 0.5752 0.577 0.5781 4.34% Castro::normalize_species() 79 0.467 0.4693 0.4737 3.56% MultiFab::Subtract() 159 0.3554 0.36 0.4108 3.09% Amr::defBaseLevel() 1 0.3547 0.3678 0.3912 2.94% MLPoisson::Fsmooth() 6144 0.2708 0.2922 0.3555 2.67% FabArray::setVal() 5021 0.3342 0.3372 0.3421 2.57% Gravity::fill_multipole_BCs() 19 0.1974 0.2442 0.2685 2.02% FabArray::ParallelCopy_nowait() 1583 0.221 0.2372 0.256 1.92% VisMF::Write(FabArray) 4 0.101 0.2212 0.2526 1.90% Castro::enforce_min_density() 79 0.183 0.1891 0.2128 1.60% MultiFab::sum() 3439 0.1919 0.1925 0.1929 1.45% Amr::writePlotFile() 2 0.01803 0.04536 0.1653 1.24% MultiFab::min() 23 0.00203 0.08658 0.1394 1.05% FillBoundary_nowait() 6388 0.07812 0.1056 0.1355 1.02% Castro::initData() 1 0.003434 0.02335 0.1328 1.00% MLPoisson::Fapply() 994 0.0955 0.1003 0.1183 0.89% FillBoundary_finish() 6388 0.07852 0.09316 0.1141 0.86% Castro::do_advance_ctu() 20 0.1108 0.1112 0.1118 0.84% Castro::derive() 156 0.09528 0.09621 0.09841 0.74% MLCellLinOp::applyBC() 7156 0.0463 0.06099 0.09313 0.70% Castro::do_old_sources() 20 0.000279 0.01446 0.07276 0.55% Castro::construct_new_gravity_source() 17 0.06995 0.07091 0.07177 0.54% MultiFab::Saxpy() 91 0.0671 0.06735 0.06755 0.51% Castro::expand_state() 20 0.06549 0.06569 0.06635 0.50% Castro::do_new_sources() 17 0.0002239 0.01046 0.06077 0.46% MultiFab::Xpay() 923 0.05032 0.05234 0.05791 0.43% MultiFab::contains_nan() 37 0.04585 0.04612 0.04673 0.35% Castro::construct_old_gravity_source() 20 0.04577 0.04602 0.04647 0.35% MLMG::addInterpCorrection() 768 0.02942 0.03162 0.03856 0.29% amrex::average_down 768 0.02504 0.02692 0.03295 0.25% StateData::FillBoundary(geom) 143 0 0.01705 0.0329 0.25% MLCGSolver::bicgstab 8 0 0.001496 0.02393 0.18% Castro::retry_advance_ctu() 11 0.01916 0.01953 0.02035 0.15% Gravity::get_old_grav_vector() 20 0.01887 0.01894 0.01911 0.14% Castro::create_source_corrector() 17 0.01785 0.01797 0.01811 0.14% Gravity::get_new_grav_vector() 18 0.01704 0.01736 0.0178 0.13% MLCellLinOp::defineAuxData() 19 0.01492 0.01558 0.01731 0.13% FillPatchIterator::Initialize 301 0.01643 0.01658 0.0169 0.13% MLMG::ResNormInf() 146 0.01256 0.01419 0.0159 0.12% Castro::construct_new_source() 102 0.01554 0.01562 0.01583 0.12% FabArray::FillBoundary() 6388 0.01313 0.01354 0.01568 0.12% MLMG::oneIter() 128 0.01462 0.01466 0.01473 0.11% Castro::evaluate_source_change() 196 0.01229 0.01273 0.01296 0.10% Amr::writeSmallPlotFile() 2 0.007752 0.01202 0.01258 0.09% MLCellLinOp::smooth() 3072 0.01123 0.01166 0.01249 0.09% FabArray::setDomainBndry() 301 0.0007925 0.006565 0.01207 0.09% FabArrayBase::getFB() 6388 0.00961 0.01001 0.01186 0.09% Castro::wd_update() 2 0.004256 0.007878 0.01069 0.08% Castro::volWgtSum() 66 0.009954 0.01002 0.01009 0.08% Castro::construct_old_source() 120 0.009852 0.009941 0.01002 0.08% MultiFab::LinComb() 203 0 0.0005945 0.009512 0.07% MLLinOp::makeSubCommunicator() 19 0.0003086 0.00409 0.007962 0.06% Gravity::actual_solve_with_mlmg() 19 0.006761 0.007022 0.007718 0.06% FabArray::mult() 59 0.007065 0.007175 0.007416 0.06% FabArrayBase::getCPC() 2005 0.006882 0.007046 0.00733 0.06% MLMG::prepareForSolve() 18 0.006602 0.006749 0.007165 0.05% MLCGSolver::ParallelAllReduce 189 0 0.0004103 0.006564 0.05% MLCellLinOp::compGrad() 18 0.005609 0.005701 0.006131 0.05% FabArrayBase::CPC::define() 576 0.002145 0.003339 0.006068 0.05% MultiFab::Dot() 142 0 0.0003725 0.00596 0.04% CGSolver::sxay() 203 0 0.0003549 0.005678 0.04% MLMG::solve() 18 0.0007052 0.002665 0.005364 0.04% MultiFab::max() 8 0.0009348 0.003336 0.005255 0.04% MLCellLinOp::apply() 994 0.002062 0.002316 0.005038 0.04% Castro::initialize_do_advance() 20 0.004244 0.004388 0.004567 0.03% FabArray::ParallelCopy() 1583 0.003743 0.003866 0.004112 0.03% Castro::volInBoundary() 14 0.003488 0.003573 0.003873 0.03% BndryData::define() 19 0.003116 0.003155 0.003193 0.02% Gravity::solve_for_phi() 17 0.002424 0.002626 0.003192 0.02% MLPoisson::normalize() 79 0 0.0001889 0.003022 0.02% Castro::construct_new_gravity() 17 0.002199 0.002241 0.002425 0.02% MLCellLinOp::correctionResidual() 776 0.001837 0.001918 0.002264 0.02% MLLinOp::defineGrids() 19 0.001843 0.001984 0.002221 0.02% MLCellLinOp::prepareForSolve() 19 0.001713 0.001841 0.002103 0.02% MultiFab::Copy() 18 0.001998 0.002012 0.002025 0.02% Castro::locWgtSum() 12 0.001784 0.001813 0.00184 0.01% MLMG::mgVcycle() 128 0.001561 0.001632 0.001789 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001258 0.001518 0.001787 0.01% MLCellLinOp::defineBC() 19 0.001645 0.00167 0.001784 0.01% MLMG:computeResOfCorrection() 768 0.001411 0.001476 0.001591 0.01% StateData::define() 6 0.001141 0.001174 0.001328 0.01% StateDataPhysBCFunct::() 301 0.001092 0.001216 0.001313 0.01% FabArrayBase::FB::FB() 75 0.0002736 0.0006827 0.001309 0.01% MLMG::actualBottomSolve() 128 0.0001435 0.0002138 0.001215 0.01% main() 1 0.0009474 0.00111 0.001199 0.01% MLMG::MLRhsNormInf() 18 0.001116 0.001134 0.001151 0.01% Castro::subcycle_advance_ctu() 1 0.0002882 0.0003946 0.0008994 0.01% Castro::problem_post_timestep() 2 0.0002675 0.0005321 0.0008853 0.01% FillPatchSingleLevel 301 0.000835 0.0008569 0.0008777 0.01% Castro::swap_state_time_levels() 8 0.0004455 0.0006559 0.000834 0.01% MLCellLinOp::setLevelBC() 19 0.0005452 0.0006688 0.0008293 0.01% Castro::volProductSum() 4 0.0007752 0.0007806 0.0007888 0.01% MLMG::mgVcycle_down::2 128 0.0006664 0.0007146 0.0007653 0.01% Castro::post_init() 1 0.0004158 0.0005652 0.0007588 0.01% MLMG::mgVcycle_down::0 128 0.0006956 0.0007165 0.0007419 0.01% MLMG::mgVcycle_down::3 128 0.0005957 0.0006441 0.0007407 0.01% MLMG::mgVcycle_down::4 128 0.0005868 0.0006126 0.0007278 0.01% MLMG::mgVcycle_down::1 128 0.0006732 0.0007012 0.0007193 0.01% MLMG::mgVcycle_down::5 128 0.0005829 0.0006015 0.00069 0.01% TagBoxArray::collate() 2 0.0001148 0.00041 0.0006815 0.01% Gravity::applyMetricTerms() 2 0.00049 0.0005101 0.0006738 0.01% AmrMesh::MakeNewGrids() 2 0.000507 0.0005473 0.0005973 0.00% MLMG::mgVcycle_up::1 128 0.0004906 0.000516 0.0005455 0.00% Gravity::test_composite_phi() 1 0.0003938 0.0004402 0.0005294 0.00% MLMG::mgVcycle_up::0 128 0.0004915 0.0005064 0.0005249 0.00% MLMG::mgVcycle_up::2 128 0.0004121 0.0004581 0.000515 0.00% makeSFC 95 0.0003908 0.0004216 0.0005131 0.00% Gravity::update_max_rhs() 2 0.0004039 0.0004202 0.0005107 0.00% MLMG::mgVcycle_up::5 128 0.0004353 0.0004507 0.0005072 0.00% MLMG::mgVcycle_up::3 128 0.0004146 0.0004377 0.0005047 0.00% MLMG::mgVcycle_up::4 128 0.0004171 0.0004297 0.0004763 0.00% Castro::clean_state() 79 0.0004057 0.0004316 0.0004523 0.00% MLCellLinOp::solutionResidual() 147 0.000424 0.0004316 0.0004489 0.00% Castro::enforce_consistent_e() 1 0.0003628 0.0003811 0.0004486 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003655 0.0003795 0.000413 0.00% Castro::post_timestep() 1 0.0002592 0.0003501 0.0003961 0.00% MLMG::computeResidual() 128 0.0002636 0.0002699 0.0002778 0.00% MLMG::mgVcycle_bottom 128 0.0002244 0.0002336 0.0002744 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002379 0.0002483 0.0002677 0.00% MLMG::compResidual() 1 0.0002452 0.0002553 0.0002607 0.00% DistributionMapping::Distribute() 95 0.0002243 0.0002323 0.0002556 0.00% OwnerMask() 2 0.0001374 0.0001702 0.0002469 0.00% Amr::grid_places() 2 9.064e-05 0.0001502 0.0002036 0.00% MLLinOp::define() 19 0.0001538 0.0001848 0.0002014 0.00% Castro::apply_tagging_restrictions() 2 0.0001356 0.0001545 0.000181 0.00% Castro::apply_problem_tags() 2 0.0001626 0.0001676 0.0001801 0.00% Castro::finalize_do_advance() 17 0.0001364 0.0001506 0.000169 0.00% DistributionMapping::LeastUsedCPUs() 1 1.959e-05 0.0001405 0.00016 0.00% Gravity::actual_multilevel_solve() 1 0.0001333 0.0001376 0.0001509 0.00% Amr::coarseTimeStep() 1 0.0001093 0.0001349 0.0001416 0.00% TagBoxArray::mapPRD 2 0.0001158 0.0001265 0.0001406 0.00% Castro::initialize_advance() 1 9.965e-05 0.0001077 0.0001393 0.00% MLPoisson::define() 19 0.0001154 0.0001218 0.0001392 0.00% Castro::check_for_nan() 37 0.0001043 0.0001134 0.0001292 0.00% Castro::enforce_speed_limit() 79 0.0001046 0.00011 0.0001169 0.00% Castro::construct_old_gravity() 20 9.031e-05 9.811e-05 0.0001064 0.00% MultiFab::Swap() 5 7.108e-05 7.427e-05 9.587e-05 0.00% Castro::apply_source_to_state() 37 8.405e-05 8.849e-05 9.268e-05 0.00% MLPoisson::prepareForSolve() 19 8.001e-05 8.229e-05 9.049e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 4.884e-05 5.249e-05 8.217e-05 0.00% Amr::initSubcycle() 1 5.645e-05 5.997e-05 8.03e-05 0.00% knapsack() 1 6.005e-05 6.235e-05 7.432e-05 0.00% Amr::regrid() 1 1.278e-05 2.654e-05 6.292e-05 0.00% Amr::FinalizeInit() 1 8.627e-06 2.495e-05 5.24e-05 0.00% MLMG::computeMLResidual() 18 4.384e-05 4.64e-05 4.998e-05 0.00% MLMG::buildFineMask() 18 4.247e-05 4.457e-05 4.75e-05 0.00% MLMG::getGradSolution() 18 4.066e-05 4.225e-05 4.442e-05 0.00% Gravity::swapTimeLevels() 8 3.315e-05 3.627e-05 4.354e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.061e-05 3.221e-05 4.041e-05 0.00% MLMG::MLResNormInf() 18 3.408e-05 3.519e-05 3.683e-05 0.00% Castro::construct_old_rotation_source() 20 2.899e-05 3.018e-05 3.561e-05 0.00% Castro::estTimeStep() 19 2.666e-05 2.934e-05 3.325e-05 0.00% Castro::finalize_advance() 1 1.956e-05 2.252e-05 3.023e-05 0.00% Castro::construct_new_rotation_source() 17 2.155e-05 2.312e-05 2.473e-05 0.00% Amr::timeStep() 1 1.258e-05 1.486e-05 2.269e-05 0.00% Gravity::set_mass_offset() 2 4.375e-06 1.641e-05 2.235e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.698e-05 1.846e-05 2.174e-05 0.00% Amr::InitializeInit() 1 6.192e-06 8.254e-06 2.011e-05 0.00% Castro::post_regrid() 2 1.106e-05 1.253e-05 1.369e-05 0.00% Amr::bldFineLevels() 1 7.578e-06 9.268e-06 1.301e-05 0.00% Castro::computeInitialDt() 2 7.487e-06 8.866e-06 1.298e-05 0.00% Amr::initialInit() 1 2.939e-06 6.498e-06 1.268e-05 0.00% Amr::init() 1 7.813e-06 9.112e-06 1.182e-05 0.00% BoxList::complementIn 4 6.349e-06 6.771e-06 9.857e-06 0.00% BoxList::parallelComplementIn() 4 7.138e-06 7.637e-06 8.417e-06 0.00% Castro::advance() 1 6.324e-06 7.127e-06 8.258e-06 0.00% Castro::errorEst() 2 5.875e-06 6.264e-06 6.844e-06 0.00% Castro::gwstrain() 2 4.362e-06 4.902e-06 6.08e-06 0.00% Castro::FluxRegFineAdd() 1 1.499e-06 1.758e-06 1.89e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 13.32 13.32 13.32 100.00% Amr::coarseTimeStep() 1 10.82 10.82 10.82 81.26% Amr::timeStep() 1 10.77 10.77 10.77 80.85% Castro::advance() 1 10.67 10.67 10.67 80.14% Castro::subcycle_advance_ctu() 1 10.62 10.62 10.62 79.77% Castro::do_advance_ctu() 20 10.58 10.58 10.58 79.49% Castro::construct_ctu_hydro_source() 20 4.556 4.607 4.674 35.10% Castro::clean_state() 79 3.652 3.74 3.888 29.20% Castro::computeTemp() 80 2.407 2.509 2.67 20.05% Castro::reset_internal_energy() 80 1.506 1.546 1.649 12.39% Gravity::solve_phi_with_mlmg() 19 1.4 1.45 1.475 11.08% Castro::construct_new_gravity() 17 1.33 1.379 1.405 10.55% Amr::InitAmr() 1 1.37 1.37 1.371 10.29% Gravity::solve_for_phi() 17 1.295 1.344 1.37 10.29% Castro::initialize_do_advance() 20 1.251 1.263 1.271 9.54% Gravity::actual_solve_with_mlmg() 19 1.201 1.204 1.209 9.08% MLMG::solve() 18 1.151 1.154 1.156 8.68% Amr::init() 1 1.123 1.123 1.123 8.44% Castro::do_old_sources() 20 1.03 1.076 1.12 8.41% MLMG::oneIter() 128 1.027 1.029 1.031 7.74% MLMG::mgVcycle() 128 1.012 1.014 1.016 7.63% Castro::do_new_sources() 17 0.9368 0.9709 1 7.51% Castro::evaluate_source_change() 196 0.9704 0.9732 0.9753 7.32% FabArray::ParallelCopy() 1583 0.3739 0.6909 0.8862 6.66% Amr::initialInit() 1 0.8397 0.8397 0.8397 6.31% Castro::enforce_min_density() 79 0.8049 0.8148 0.8376 6.29% MLCellLinOp::smooth() 3072 0.4886 0.533 0.6443 4.84% FabArray::ParallelCopy_finish() 1583 0.1253 0.4437 0.6407 4.81% Amr::InitializeInit() 1 0.439 0.4989 0.5831 4.38% Amr::defBaseLevel() 1 0.439 0.4989 0.583 4.38% MultiFab::AddProduct() 3439 0.5752 0.577 0.5781 4.34% Castro::normalize_species() 79 0.467 0.4693 0.4737 3.56% FillPatchIterator::Initialize 301 0.3118 0.3722 0.4574 3.44% FillPatchSingleLevel 301 0.2832 0.349 0.4361 3.28% MultiFab::Subtract() 159 0.3554 0.36 0.4108 3.09% MLMG::mgVcycle_up::1 128 0.08615 0.2323 0.4056 3.05% Amr::FinalizeInit() 1 0.2566 0.3408 0.4008 3.01% MLMG::addInterpCorrection() 768 0.1401 0.2877 0.3593 2.70% MLPoisson::Fsmooth() 6144 0.2708 0.2922 0.3555 2.67% FabArray::setVal() 5021 0.3342 0.3372 0.3421 2.57% MLCellLinOp::applyBC() 7156 0.2573 0.284 0.3325 2.50% Amr::writePlotFile() 2 0.3221 0.3221 0.3222 2.42% MLMG::mgVcycle_up::2 128 0.009723 0.1134 0.2727 2.05% Gravity::fill_multipole_BCs() 19 0.1974 0.2442 0.2685 2.02% FabArray::ParallelCopy_nowait() 1583 0.2266 0.2433 0.263 1.98% FabArray::FillBoundary() 6388 0.199 0.223 0.2527 1.90% VisMF::Write(FabArray) 4 0.101 0.2212 0.2526 1.90% MLMG::mgVcycle_down::0 128 0.2381 0.2391 0.2413 1.81% Castro::initData() 1 0.07739 0.1255 0.2102 1.58% Castro::expand_state() 20 0.1751 0.1811 0.1974 1.48% MultiFab::sum() 3439 0.1919 0.1925 0.1929 1.45% Amr::bldFineLevels() 1 0.04526 0.1305 0.1904 1.43% MLMG::mgVcycle_up::3 128 0.009622 0.02273 0.1848 1.39% MLCellLinOp::apply() 994 0.147 0.1556 0.175 1.31% MLMG::mgVcycle_up::0 128 0.1731 0.1743 0.175 1.31% Castro::post_init() 1 0.1645 0.1669 0.1688 1.27% amrex::average_down 768 0.03314 0.04717 0.167 1.25% MLMG:computeResOfCorrection() 768 0.1108 0.1198 0.1471 1.10% FillBoundary_nowait() 6388 0.08802 0.1163 0.1467 1.10% Amr::grid_places() 2 0.00234 0.0866 0.1465 1.10% AmrMesh::MakeNewGrids() 2 0.002189 0.08645 0.1464 1.10% MLMG::mgVcycle_down::5 128 0.01171 0.02092 0.1456 1.09% MLCellLinOp::correctionResidual() 776 0.1094 0.1186 0.1455 1.09% TagBoxArray::mapPRD 2 0.0006894 0.085 0.1452 1.09% Castro::derive() 156 0.1392 0.1403 0.1427 1.07% MultiFab::min() 23 0.00203 0.08658 0.1394 1.05% Castro::construct_new_source() 102 0.1233 0.1244 0.1253 0.94% MLPoisson::Fapply() 994 0.0955 0.1003 0.1183 0.89% FillBoundary_finish() 6388 0.07852 0.09316 0.1141 0.86% MLMG::mgVcycle_down::1 128 0.1066 0.1087 0.1112 0.83% MLMG::mgVcycle_up::5 128 0.009791 0.01583 0.1032 0.78% Castro::post_timestep() 1 0.0943 0.09599 0.0981 0.74% Gravity::multilevel_solve_for_new_phi() 1 0.09463 0.09466 0.09469 0.71% Gravity::actual_multilevel_solve() 1 0.09458 0.09461 0.09464 0.71% MLCellLinOp::solutionResidual() 147 0.0858 0.09022 0.09319 0.70% Castro::post_regrid() 2 0.08535 0.08726 0.08966 0.67% Castro::create_source_corrector() 17 0.04709 0.06487 0.08583 0.64% MLMG::mgVcycle_bottom 128 0.0003695 0.005661 0.08491 0.64% MLMG::actualBottomSolve() 128 0.0001435 0.005428 0.08464 0.64% MLCGSolver::bicgstab 8 0 0.005182 0.08291 0.62% Castro::construct_old_source() 120 0.07793 0.07836 0.07887 0.59% MLMG::computeResidual() 128 0.07449 0.07537 0.07831 0.59% Castro::problem_post_timestep() 2 0.07229 0.07418 0.07683 0.58% Castro::construct_new_gravity_source() 17 0.06995 0.07091 0.07177 0.54% MultiFab::Saxpy() 91 0.0671 0.06735 0.06755 0.51% MLMG::mgVcycle_down::2 128 0.01247 0.03797 0.06539 0.49% MultiFab::Xpay() 923 0.05032 0.05234 0.05791 0.43% Castro::construct_old_gravity() 20 0.0386 0.05 0.05676 0.43% Gravity::get_old_grav_vector() 20 0.03851 0.0499 0.05666 0.43% MLMG::mgVcycle_down::3 128 0.0118 0.01757 0.0566 0.43% Castro::volWgtSum() 66 0.05261 0.05292 0.05322 0.40% Castro::initialize_advance() 1 0.04933 0.05059 0.05213 0.39% Amr::regrid() 1 0.04364 0.04481 0.048 0.36% Castro::check_for_nan() 37 0.04595 0.04624 0.04684 0.35% MultiFab::contains_nan() 37 0.04585 0.04612 0.04673 0.35% Castro::construct_old_gravity_source() 20 0.04577 0.04602 0.04647 0.35% MLPoisson::define() 19 0.02911 0.0336 0.03951 0.30% Castro::retry_advance_ctu() 11 0.03551 0.03596 0.03694 0.28% Gravity::get_new_grav_vector() 18 0.03422 0.03504 0.03589 0.27% Castro::wd_update() 2 0.03044 0.03239 0.03506 0.26% StateDataPhysBCFunct::() 301 0.001092 0.01827 0.03417 0.26% MLMG::mgVcycle_down::4 128 0.01171 0.01323 0.03361 0.25% StateData::FillBoundary(geom) 143 0 0.01705 0.0329 0.25% Castro::apply_source_to_state() 37 0.02733 0.02749 0.02758 0.21% MLMG::mgVcycle_up::4 128 0.009735 0.01081 0.02489 0.19% MLCellLinOp::defineAuxData() 19 0.01884 0.02032 0.02361 0.18% Castro::volInBoundary() 14 0.01986 0.02039 0.02219 0.17% MLMG::prepareForSolve() 18 0.01668 0.0174 0.01947 0.15% MLMG::computeMLResidual() 18 0.01105 0.01447 0.01763 0.13% Amr::writeSmallPlotFile() 2 0.01619 0.01619 0.0162 0.12% MLMG::ResNormInf() 146 0.01256 0.01419 0.0159 0.12% CGSolver::sxay() 203 0 0.0009494 0.01519 0.11% Gravity::test_composite_phi() 1 0.01394 0.01397 0.01399 0.11% FabArrayBase::getCPC() 2005 0.009116 0.01039 0.0134 0.10% FabArrayBase::getFB() 6388 0.009902 0.01069 0.01236 0.09% FabArray::setDomainBndry() 301 0.0007925 0.006565 0.01207 0.09% MLLinOp::define() 19 0.003413 0.007292 0.01144 0.09% MLLinOp::defineGrids() 19 0.003225 0.007107 0.01128 0.08% MLCGSolver::ParallelAllReduce 189 0 0.0006133 0.009813 0.07% MultiFab::LinComb() 203 0 0.0005945 0.009512 0.07% MLMG::getGradSolution() 18 0.007344 0.007501 0.00807 0.06% MLCellLinOp::compGrad() 18 0.007301 0.007459 0.008027 0.06% MLLinOp::makeSubCommunicator() 19 0.0003086 0.00409 0.007962 0.06% FabArray::mult() 59 0.007065 0.007175 0.007416 0.06% Gravity::update_max_rhs() 2 0.001837 0.004275 0.006189 0.05% FabArrayBase::CPC::define() 576 0.002145 0.003339 0.006068 0.05% MLCellLinOp::defineBC() 19 0.005736 0.00587 0.006044 0.05% MultiFab::Dot() 142 0 0.0003725 0.00596 0.04% MultiFab::max() 8 0.0009348 0.003336 0.005255 0.04% Castro::locWgtSum() 12 0.005032 0.005081 0.005129 0.04% BndryData::define() 19 0.003997 0.0042 0.004384 0.03% MLPoisson::normalize() 79 0 0.0001889 0.003022 0.02% Castro::volProductSum() 4 0.002934 0.002952 0.00297 0.02% MLPoisson::prepareForSolve() 19 0.001803 0.001923 0.002185 0.02% MLCellLinOp::prepareForSolve() 19 0.001713 0.001841 0.002103 0.02% MultiFab::Copy() 18 0.001998 0.002012 0.002025 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001258 0.001518 0.001787 0.01% AmrLevel::AmrLevel(dm) 1 0.001171 0.001206 0.001369 0.01% StateData::define() 6 0.001141 0.001174 0.001328 0.01% FabArrayBase::FB::FB() 75 0.0002736 0.0006827 0.001309 0.01% Gravity::swapTimeLevels() 8 0.001128 0.001178 0.001275 0.01% MLMG::MLResNormInf() 18 0.001168 0.001181 0.001201 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009851 0.001033 0.001171 0.01% MLMG::compResidual() 1 0.0009221 0.001047 0.001157 0.01% MLMG::MLRhsNormInf() 18 0.001116 0.001134 0.001151 0.01% Castro::swap_state_time_levels() 8 0.0004455 0.0006559 0.000834 0.01% MLCellLinOp::setLevelBC() 19 0.0005452 0.0006688 0.0008293 0.01% makeSFC 95 0.0006195 0.0006539 0.0007625 0.01% TagBoxArray::collate() 2 0.0001148 0.00041 0.0006815 0.01% Gravity::applyMetricTerms() 2 0.00049 0.0005101 0.0006738 0.01% Castro::enforce_consistent_e() 1 0.0003628 0.0003811 0.0004486 0.00% Castro::errorEst() 2 0.0003064 0.0003284 0.0003541 0.00% DistributionMapping::Distribute() 95 0.0002243 0.0002323 0.0002556 0.00% OwnerMask() 2 0.0001374 0.0001702 0.0002469 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001157 0.0002213 0.000239 0.00% Castro::apply_tagging_restrictions() 2 0.0001356 0.0001545 0.000181 0.00% Castro::apply_problem_tags() 2 0.0001626 0.0001676 0.0001801 0.00% Castro::finalize_do_advance() 17 0.0001364 0.0001506 0.000169 0.00% DistributionMapping::LeastUsedCPUs() 1 1.959e-05 0.0001405 0.00016 0.00% Castro::enforce_speed_limit() 79 0.0001046 0.00011 0.0001169 0.00% MultiFab::Swap() 5 7.108e-05 7.427e-05 9.587e-05 0.00% Amr::initSubcycle() 1 5.645e-05 5.997e-05 8.03e-05 0.00% knapsack() 1 6.005e-05 6.235e-05 7.432e-05 0.00% MLMG::buildFineMask() 18 4.247e-05 4.457e-05 4.75e-05 0.00% Castro::construct_old_rotation_source() 20 2.899e-05 3.018e-05 3.561e-05 0.00% Castro::estTimeStep() 19 2.666e-05 2.934e-05 3.325e-05 0.00% Castro::finalize_advance() 1 2.145e-05 2.428e-05 3.21e-05 0.00% Castro::construct_new_rotation_source() 17 2.155e-05 2.312e-05 2.473e-05 0.00% Gravity::set_mass_offset() 2 4.375e-06 1.641e-05 2.235e-05 0.00% BoxList::parallelComplementIn() 4 1.349e-05 1.441e-05 1.727e-05 0.00% Castro::computeInitialDt() 2 1.085e-05 1.273e-05 1.704e-05 0.00% BoxList::complementIn 4 6.349e-06 6.771e-06 9.857e-06 0.00% Castro::gwstrain() 2 4.362e-06 4.902e-06 6.08e-06 0.00% Castro::FluxRegFineAdd() 1 1.499e-06 1.758e-06 1.89e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 2) :: [0.0e0, 0.0e0] [TOP]::castro.dtnuc_mode(nvals = 1) :: [1] [TOP]::integrator.do_constant_volume_burn(nvals = 1) :: [1] [TOP]::integrator.retry_burn(nvals = 1) :: [1] [TOP]::mg.v(nvals = 1) :: [0] AMReX (22.04-10-g1a5d8917fd49) finalized