MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.02-16-g3199edf61525) initialized Starting run at 19:55:07 UTC on 2022-02-28. Successfully read inputs file ... Castro git describe: 22.02-4-g0d942c92d AMReX git describe: 22.02-16-g3199edf61 Microphysics git describe: 22.02-12-g9d68ea47 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 castro.use_stopping_criterion = 1 castro.dtnuc_mode = 1 Warning: the following integrator.* parameters are ignored integrator.do_constant_volume_burn = 1 Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.144239692 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000898103 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.01050675 Gravity::fill_multipole_BCs() time = 0.010621002 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -2.5098073e-31 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.047719596 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.006570691 seconds [Level 0 step 1] ADVANCE with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.070769295 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.273814955 Advance was unsuccessful with reason: negative density (density = -9.081732e+02 at index (14,70); started at 4.477055e+03); proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.070200524 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.272542258 Advance was unsuccessful with reason: negative density (density = -1.592544e+00 at index (20,79); started at 2.790161e+00); proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.066712193 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.27181287 Advance was unsuccessful with reason: negative density (density = -1.060745e-01 at index (20,78); started at 2.068339e-01); proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.064485724 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.272244227 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015160151 Gravity::solve_for_phi() time = 0.082428407 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.070786551 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.064491142 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.272041497 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014556505 Gravity::solve_for_phi() time = 0.081956321 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.069825133 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.064559362 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.291134816 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.019000161 Gravity::solve_for_phi() time = 0.087481562 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.071258525 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.064163942 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.271978421 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.997068055e+46 ener added: 2.415044041e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014700853 Gravity::solve_for_phi() time = 0.08109979 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.543114243e+44 ener added: 4.768138875e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.765646947e+35 ymom added: 1.797592414e+26 zmom added: 0 eint added: 0 ener added: 5.380039006e+43 Castro::do_new_sources() time = 0.069578587 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.065113291 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.28364664 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.317346246e+44 ener added: 3.120883219e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015137303 Gravity::solve_for_phi() time = 0.082556158 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.957879842e+46 ener added: 4.564181618e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.001437306e+36 ymom added: 1.471489396e+25 zmom added: 0 eint added: 0 ener added: 6.980886509e+46 Castro::do_new_sources() time = 0.071276462 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.064485115 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.278564357 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.012688492e+46 ener added: 2.110657671e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01535951 Gravity::solve_for_phi() time = 0.082796615 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.326633224e+44 ener added: 1.174460404e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.711471844e+35 ymom added: 1.66063198e+26 zmom added: 0 eint added: 0 ener added: 2.826321793e+43 Castro::do_new_sources() time = 0.070425762 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.064986527 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.283589742 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.090986835e+44 ener added: 2.655092076e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015238653 Gravity::solve_for_phi() time = 0.082580952 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.968859957e+46 ener added: 1.10301368e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.004822123e+36 ymom added: -8.771795742e+24 zmom added: 0 eint added: 0 ener added: 6.987657644e+46 Castro::do_new_sources() time = 0.071265811 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.064263762 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.279142627 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.025000527e+46 ener added: 2.183068315e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015060956 Gravity::solve_for_phi() time = 0.082642845 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.651474965e+44 ener added: 1.477761377e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.60533052e+35 ymom added: 1.690843319e+26 zmom added: 0 eint added: 0 ener added: -1.190247427e+43 Castro::do_new_sources() time = 0.070932755 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.06465902 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.283782342 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.213015184e+44 ener added: 2.894439872e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015302923 Gravity::solve_for_phi() time = 0.082527521 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.97482432e+46 ener added: 1.388215779e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.00305216e+36 ymom added: 1.271497176e+24 zmom added: 0 eint added: 0 ener added: 6.99302976e+46 Castro::do_new_sources() time = 0.071348579 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.064144238 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.279247708 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.046400343e+46 ener added: 2.16073557e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015732252 Gravity::solve_for_phi() time = 0.084694501 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.248919276e+44 ener added: 1.60656791e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.450686215e+35 ymom added: 1.697312961e+26 zmom added: 0 eint added: 0 ener added: -6.185767806e+43 Castro::do_new_sources() time = 0.070532742 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.064421611 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.283222004 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.824816589e+44 ener added: 2.945461224e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014862839 Gravity::solve_for_phi() time = 0.081243091 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.977981871e+46 ener added: 1.507699921e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.996348783e+36 ymom added: 3.069538214e+24 zmom added: 0 eint added: 0 ener added: 6.997250022e+46 Castro::do_new_sources() time = 0.070079664 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.064634613 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.279339747 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.067953295e+46 ener added: 2.185941597e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014954686 Gravity::solve_for_phi() time = 0.081096103 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.036038551e+44 ener added: 1.710131682e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.236317743e+35 ymom added: 1.665059198e+26 zmom added: 0 eint added: 0 ener added: -1.282743578e+44 Castro::do_new_sources() time = 0.070071957 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.064473021 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.278243927 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.23178587e+44 ener added: 2.927676839e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.019185938 Gravity::solve_for_phi() time = 0.085421587 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.979285299e+46 ener added: 1.614875382e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.983606539e+36 ymom added: -1.663453594e+24 zmom added: 0 eint added: 0 ener added: 6.999733101e+46 Castro::do_new_sources() time = 0.070266487 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.066397622 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.272305607 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.076022112e+46 ener added: 2.369765675e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015521127 Gravity::solve_for_phi() time = 0.083200156 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.768256697e+44 ener added: 1.742935385e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.789276502e+34 ymom added: 1.761383669e+26 zmom added: 0 eint added: 0 ener added: -1.824543748e+44 Castro::do_new_sources() time = 0.069617005 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.065902574 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.280811345 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.399341724e+44 ener added: 3.055404896e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014652063 Gravity::solve_for_phi() time = 0.081003123 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.981378524e+46 ener added: 1.65468052e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.966651828e+36 ymom added: 1.133367956e+23 zmom added: 0 eint added: 0 ener added: 7.003642946e+46 Castro::do_new_sources() time = 0.070185684 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.066276403 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.275469744 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.085134477e+46 ener added: 2.616682453e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015607911 Gravity::solve_for_phi() time = 0.083434157 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.966387031e+44 ener added: 1.764409733e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.086349894e+34 ymom added: 1.71437251e+26 zmom added: 0 eint added: 0 ener added: -1.814844154e+44 Castro::do_new_sources() time = 0.070597121 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.064418398 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.277078553 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.20798565e+44 ener added: 3.358777738e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015062317 Gravity::solve_for_phi() time = 0.081147371 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988653412e+46 ener added: 1.671056473e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.948364053e+36 ymom added: 7.142579305e+23 zmom added: 0 eint added: 0 ener added: 7.013022432e+46 Castro::do_new_sources() time = 0.069736184 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002695807376 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.548275694e+29 ener added: 1.548275694e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -2.890848341e+38 TIME= 0.25 YMOM = 8.975065285e+27 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.505143013e+38 TIME= 0.25 RHO*e = 1.331449006e+50 TIME= 0.25 RHO*K = 3.171006988e+49 TIME= 0.25 RHO*E = 1.648549705e+50 TIME= 0.25 RHO*PHI = -5.460195609e+50 TIME= 0.25 TOTAL ENERGY= -1.0815481e+50 TIME= 0.25 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0.25 CENTER OF MASS X-VEL = -113366.7542 TIME= 0.25 CENTER OF MASS Y-LOC = -4.196397805e-29 TIME= 0.25 CENTER OF MASS Y-VEL = 3.519638182e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 [STEP 1] Coarse TimeStep time: 12.24954266 [STEP 1] FAB kilobyte spread across MPI nodes: [8620 ... 8620] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.046935765 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.006608016 seconds Ending run at 19:55:22 UTC on 2022-02-28. Run time = 14.55634432 Run time without initialization = 12.30517256 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.56 ... 14.56 ... 14.56 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3864 5.4655 5.5562 38.17% Amr::InitAmr() 1 1.356 1.356 1.356 9.32% Castro::computeTemp() 80 0.8582 0.9725 1.119 7.69% Castro::reset_internal_energy() 80 0.8814 0.9234 1.029 7.07% MultiFab::AddProduct() 3920 0.6424 0.6486 0.6579 4.52% FabArray::ParallelCopy_finish() 1583 0.143 0.4533 0.6428 4.42% FabArray::setVal() 5502 0.4568 0.4645 0.4718 3.24% Castro::normalize_species() 79 0.4541 0.458 0.464 3.19% Amr::defBaseLevel() 1 0.3537 0.3697 0.4292 2.95% MLPoisson::Fsmooth() 6144 0.2688 0.2911 0.3545 2.44% MultiFab::Subtract() 159 0.3366 0.3392 0.3425 2.35% FabArray::ParallelCopy_nowait() 1583 0.2974 0.321 0.3415 2.35% Gravity::fill_multipole_BCs() 19 0.2096 0.256 0.285 1.96% Castro::enforce_min_density() 79 0.1887 0.1974 0.223 1.53% MultiFab::sum() 3920 0.2174 0.2194 0.2219 1.52% MultiFab::Saxpy() 91 0.1977 0.1988 0.1999 1.37% MultiFab::min() 23 0.001949 0.09715 0.1972 1.35% Castro::do_advance_ctu() 20 0.1548 0.1562 0.1584 1.09% FillBoundary_nowait() 6388 0.07947 0.1076 0.1372 0.94% Castro::initData() 1 0.003452 0.02318 0.1324 0.91% FillBoundary_finish() 6388 0.07919 0.09653 0.1228 0.84% MLPoisson::Fapply() 994 0.09711 0.1027 0.1123 0.77% Castro::derive() 156 0.09627 0.09725 0.0992 0.68% MLCellLinOp::applyBC() 7156 0.04593 0.06149 0.09497 0.65% Castro::construct_new_gravity_source() 17 0.08061 0.08172 0.08299 0.57% Castro::do_old_sources() 20 0.0002918 0.01508 0.07587 0.52% Castro::expand_state() 20 0.06792 0.0686 0.06981 0.48% Castro::do_new_sources() 17 0.0002412 0.01254 0.06838 0.47% Castro::construct_old_gravity_source() 20 0.06346 0.06409 0.06514 0.45% MultiFab::Xpay() 923 0.05134 0.05362 0.05937 0.41% Castro::create_source_corrector() 17 0.05221 0.05267 0.05355 0.37% MultiFab::contains_nan() 37 0.04624 0.04689 0.04741 0.33% StateData::FillBoundary(geom) 143 0 0.02238 0.04321 0.30% MLMG::addInterpCorrection() 768 0.02942 0.03182 0.03864 0.27% amrex::average_down 768 0.02567 0.0278 0.0337 0.23% Amr::writePlotFile() 2 0.01776 0.02667 0.02761 0.19% VisMF::Write(FabArray) 4 0.01302 0.01413 0.02649 0.18% Castro::retry_advance_ctu() 11 0.02408 0.02446 0.0249 0.17% MLCGSolver::bicgstab 8 0 0.00151 0.02415 0.17% FillPatchIterator::Initialize 301 0.02015 0.02056 0.02095 0.14% Gravity::get_old_grav_vector() 20 0.01913 0.01931 0.01944 0.13% Castro::construct_new_source() 102 0.01725 0.01743 0.01847 0.13% Gravity::get_new_grav_vector() 18 0.01727 0.01753 0.01793 0.12% MLCellLinOp::defineAuxData() 19 0.01525 0.01597 0.01762 0.12% MLMG::ResNormInf() 146 0.0118 0.01566 0.01715 0.12% FabArray::setDomainBndry() 301 0.0008068 0.008999 0.01693 0.12% FabArray::FillBoundary() 6388 0.01321 0.01371 0.01599 0.11% Castro::evaluate_source_change() 196 0.01376 0.01401 0.01497 0.10% MLMG::oneIter() 128 0.01453 0.01463 0.01476 0.10% TagBoxArray::collate() 2 7.616e-05 0.002293 0.01237 0.09% FabArrayBase::getFB() 6388 0.009831 0.01029 0.01232 0.08% MLCellLinOp::smooth() 3072 0.0109 0.01133 0.01213 0.08% Castro::construct_old_source() 120 0.01154 0.01168 0.01189 0.08% Amr::writeSmallPlotFile() 2 0.006898 0.01064 0.01103 0.08% MultiFab::LinComb() 203 0 0.0006453 0.01032 0.07% Castro::wd_update() 2 0.00427 0.007832 0.01011 0.07% Castro::volWgtSum() 66 0.009877 0.009952 0.01001 0.07% FabArray::mult() 59 0.007422 0.007528 0.007894 0.05% MLLinOp::makeSubCommunicator() 19 0.0003469 0.004016 0.007862 0.05% Gravity::actual_solve_with_mlmg() 19 0.00688 0.007129 0.007807 0.05% FabArrayBase::getCPC() 2005 0.006869 0.007097 0.007404 0.05% MLMG::prepareForSolve() 18 0.006677 0.006881 0.007324 0.05% MLCGSolver::ParallelAllReduce 189 0 0.0004217 0.006748 0.05% FabArrayBase::CPC::define() 576 0.002173 0.00339 0.006193 0.04% MultiFab::Dot() 142 0 0.0003819 0.00611 0.04% CGSolver::sxay() 203 0 0.0003625 0.0058 0.04% MLCellLinOp::compGrad() 18 0.005584 0.005626 0.005671 0.04% MLMG::solve() 18 0.0007676 0.002718 0.005193 0.04% MLCellLinOp::apply() 994 0.002002 0.00226 0.005005 0.03% Castro::initialize_do_advance() 20 0.004267 0.004376 0.004551 0.03% FabArray::ParallelCopy() 1583 0.003728 0.003894 0.004163 0.03% Castro::volInBoundary() 14 0.003501 0.003589 0.003924 0.03% BndryData::define() 19 0.003169 0.003217 0.003422 0.02% MultiFab::max() 8 0.0006152 0.001659 0.003116 0.02% Gravity::solve_for_phi() 17 0.002472 0.002623 0.003041 0.02% MLPoisson::normalize() 79 0 0.0001895 0.003032 0.02% Castro::construct_new_gravity() 17 0.00228 0.002321 0.002541 0.02% MLCellLinOp::correctionResidual() 776 0.001838 0.001916 0.002226 0.02% MLLinOp::defineGrids() 19 0.001806 0.001928 0.002187 0.02% MLCellLinOp::prepareForSolve() 19 0.001757 0.001888 0.002182 0.01% MultiFab::Copy() 18 0.002043 0.002075 0.002117 0.01% Castro::locWgtSum() 12 0.001811 0.00183 0.001846 0.01% StateData::define() 6 0.001415 0.001496 0.001834 0.01% MLCellLinOp::defineBC() 19 0.001642 0.001706 0.001819 0.01% MLMG::mgVcycle() 128 0.001576 0.001665 0.0018 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001301 0.001558 0.001783 0.01% MLMG:computeResOfCorrection() 768 0.001434 0.001507 0.001601 0.01% StateDataPhysBCFunct::() 301 0.001131 0.001306 0.001511 0.01% FabArrayBase::FB::FB() 75 0.0002709 0.0007146 0.001337 0.01% MLMG::actualBottomSolve() 128 0.0001442 0.0002191 0.001255 0.01% AmrMesh::MakeNewGrids() 2 0.0004893 0.0005555 0.001212 0.01% main() 1 0.0009508 0.001089 0.001188 0.01% Castro::post_init() 1 0.0004447 0.0008865 0.001184 0.01% MLMG::MLRhsNormInf() 18 0.001126 0.001146 0.001172 0.01% Castro::problem_post_timestep() 2 0.0003744 0.0008045 0.001124 0.01% Castro::swap_state_time_levels() 8 0.0005496 0.001004 0.001042 0.01% MLMG::mgVcycle_up::2 128 0.0004209 0.0005078 0.0009843 0.01% FillPatchSingleLevel 301 0.0008451 0.0008729 0.0009083 0.01% MLCellLinOp::setLevelBC() 19 0.0005531 0.0006852 0.0008305 0.01% Castro::subcycle_advance_ctu() 1 0.0002955 0.0003809 0.0008219 0.01% MLMG::mgVcycle_down::0 128 0.0007278 0.0007433 0.0007899 0.01% Castro::volProductSum() 4 0.0007637 0.0007759 0.0007873 0.01% MLMG::mgVcycle_down::2 128 0.0006606 0.000723 0.0007833 0.01% MLMG::mgVcycle_down::1 128 0.0007045 0.0007179 0.0007552 0.01% MLMG::mgVcycle_down::3 128 0.0005945 0.0006472 0.0007538 0.01% MLMG::mgVcycle_down::4 128 0.0005857 0.0006123 0.000715 0.00% MLMG::mgVcycle_down::5 128 0.0005807 0.0005996 0.000688 0.00% Gravity::test_composite_phi() 1 0.000406 0.0005061 0.0006161 0.00% Gravity::applyMetricTerms() 2 0.0004802 0.0004966 0.0005958 0.00% MLMG::mgVcycle_up::1 128 0.0005023 0.0005301 0.0005651 0.00% MLMG::mgVcycle_up::0 128 0.000505 0.0005178 0.0005511 0.00% MLMG::mgVcycle_up::3 128 0.0004265 0.0004512 0.0005163 0.00% Castro::clean_state() 79 0.0004314 0.000461 0.0005118 0.00% MLMG::mgVcycle_up::5 128 0.0004347 0.0004579 0.0004994 0.00% makeSFC 95 0.000398 0.0004333 0.0004978 0.00% MLMG::mgVcycle_up::4 128 0.0004244 0.0004378 0.0004868 0.00% Castro::post_timestep() 1 0.0002336 0.0003924 0.0004616 0.00% Gravity::update_max_rhs() 2 0.0003956 0.000407 0.0004491 0.00% Castro::enforce_consistent_e() 1 0.0003665 0.0003829 0.000448 0.00% MLCellLinOp::solutionResidual() 147 0.0004235 0.0004353 0.0004462 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003729 0.0003935 0.0004385 0.00% Castro::initialize_advance() 1 0.0002123 0.0002852 0.000303 0.00% MLMG::computeResidual() 128 0.0002669 0.0002747 0.0002931 0.00% MLMG::mgVcycle_bottom 128 0.0002261 0.0002348 0.0002838 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002434 0.0002562 0.0002821 0.00% DistributionMapping::LeastUsedCPUs() 1 1.885e-05 0.0002364 0.0002743 0.00% MLMG::compResidual() 1 0.0002502 0.0002554 0.0002607 0.00% DistributionMapping::Distribute() 95 0.0002238 0.0002322 0.0002404 0.00% MLLinOp::define() 19 0.0001521 0.0001832 0.0002145 0.00% OwnerMask() 2 0.0001362 0.0001676 0.0002131 0.00% Castro::apply_tagging_restrictions() 2 0.000137 0.0001608 0.0001855 0.00% Castro::finalize_do_advance() 17 0.0001482 0.0001592 0.0001757 0.00% Castro::apply_problem_tags() 2 0.000161 0.0001686 0.0001755 0.00% Amr::grid_places() 2 9.342e-05 0.0001329 0.000162 0.00% Gravity::actual_multilevel_solve() 1 0.0001394 0.0001419 0.0001525 0.00% MLPoisson::define() 19 0.0001125 0.0001223 0.0001477 0.00% Castro::check_for_nan() 37 0.0001203 0.0001298 0.0001465 0.00% Amr::coarseTimeStep() 1 0.0001036 0.0001336 0.0001376 0.00% TagBoxArray::mapPRD 2 0.0001117 0.0001226 0.0001368 0.00% Castro::apply_source_to_state() 37 0.0001064 0.000111 0.0001204 0.00% Castro::enforce_speed_limit() 79 0.0001013 0.0001067 0.0001153 0.00% Castro::construct_old_gravity() 20 9.475e-05 0.0001001 0.0001075 0.00% Amr::initSubcycle() 1 5.616e-05 6.248e-05 9.573e-05 0.00% MLPoisson::prepareForSolve() 19 7.146e-05 7.824e-05 9.43e-05 0.00% MultiFab::Swap() 5 7.188e-05 7.494e-05 8.67e-05 0.00% knapsack() 1 6.034e-05 6.475e-05 8.348e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.104e-05 5.409e-05 8.136e-05 0.00% Amr::FinalizeInit() 1 8.896e-06 1.939e-05 6.267e-05 0.00% MLMG::computeMLResidual() 18 4.183e-05 4.562e-05 5.215e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.285e-05 3.579e-05 5.097e-05 0.00% MLMG::buildFineMask() 18 4.307e-05 4.562e-05 5.055e-05 0.00% MLMG::getGradSolution() 18 4.223e-05 4.407e-05 4.984e-05 0.00% Gravity::swapTimeLevels() 8 3.658e-05 3.856e-05 4.299e-05 0.00% MLMG::MLResNormInf() 18 3.371e-05 3.556e-05 3.714e-05 0.00% Castro::estTimeStep() 19 2.671e-05 3.012e-05 3.618e-05 0.00% Amr::regrid() 1 1.19e-05 1.741e-05 3.527e-05 0.00% Castro::construct_old_rotation_source() 20 3.111e-05 3.214e-05 3.374e-05 0.00% Castro::finalize_advance() 1 2.035e-05 2.266e-05 2.685e-05 0.00% Castro::construct_new_rotation_source() 17 2.28e-05 2.408e-05 2.661e-05 0.00% Castro::post_regrid() 2 1.1e-05 1.497e-05 2.653e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.703e-05 1.877e-05 2.556e-05 0.00% Gravity::set_mass_offset() 2 4.168e-06 1.175e-05 2.16e-05 0.00% Amr::init() 1 7.823e-06 9.82e-06 2.133e-05 0.00% Castro::computeInitialDt() 2 7.299e-06 9.961e-06 2.085e-05 0.00% Amr::timeStep() 1 1.234e-05 1.34e-05 1.815e-05 0.00% Amr::InitializeInit() 1 6.567e-06 8.138e-06 1.312e-05 0.00% Castro::errorEst() 2 5.912e-06 6.551e-06 1.053e-05 0.00% Amr::bldFineLevels() 1 7.137e-06 8.091e-06 8.832e-06 0.00% Amr::initialInit() 1 3.12e-06 4.165e-06 7.952e-06 0.00% BoxList::parallelComplementIn() 4 7.086e-06 7.521e-06 7.824e-06 0.00% Castro::advance() 1 5.9e-06 6.662e-06 7.61e-06 0.00% BoxList::complementIn 4 6.298e-06 6.561e-06 6.879e-06 0.00% Castro::gwstrain() 2 4.366e-06 4.766e-06 6.257e-06 0.00% Castro::FluxRegFineAdd() 1 1.629e-06 1.841e-06 2.111e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.56 14.56 14.56 100.00% Amr::coarseTimeStep() 1 12.3 12.3 12.3 84.53% Amr::timeStep() 1 12.25 12.25 12.25 84.15% Castro::advance() 1 12.15 12.15 12.16 83.50% Castro::subcycle_advance_ctu() 1 12.1 12.1 12.1 83.15% Castro::do_advance_ctu() 20 12.05 12.06 12.06 82.84% Castro::construct_ctu_hydro_source() 20 5.386 5.466 5.556 38.17% Castro::clean_state() 79 3.644 3.738 3.866 26.56% Castro::computeTemp() 80 2.406 2.52 2.711 18.62% Castro::reset_internal_energy() 80 1.501 1.548 1.657 11.38% Gravity::solve_phi_with_mlmg() 19 1.432 1.479 1.513 10.39% Castro::construct_new_gravity() 17 1.363 1.41 1.443 9.91% Gravity::solve_for_phi() 17 1.327 1.374 1.407 9.67% Amr::InitAmr() 1 1.356 1.356 1.356 9.32% Castro::do_old_sources() 20 1.208 1.263 1.305 8.96% Castro::initialize_do_advance() 20 1.25 1.264 1.276 8.77% Gravity::actual_solve_with_mlmg() 19 1.219 1.222 1.226 8.42% Castro::do_new_sources() 17 1.136 1.167 1.198 8.23% MLMG::solve() 18 1.169 1.172 1.173 8.06% Castro::evaluate_source_change() 196 1.101 1.11 1.125 7.73% MLMG::oneIter() 128 1.041 1.043 1.045 7.18% MLMG::mgVcycle() 128 1.027 1.028 1.03 7.07% FabArray::ParallelCopy() 1583 0.4724 0.7845 0.9713 6.67% Amr::init() 1 0.8941 0.8943 0.8943 6.14% Amr::initialInit() 1 0.8375 0.8377 0.8378 5.76% Castro::enforce_min_density() 79 0.8007 0.8129 0.8338 5.73% MultiFab::AddProduct() 3920 0.6424 0.6486 0.6579 4.52% MLCellLinOp::smooth() 3072 0.4933 0.5374 0.6552 4.50% FabArray::ParallelCopy_finish() 1583 0.143 0.4533 0.6428 4.42% Amr::InitializeInit() 1 0.4402 0.5034 0.5833 4.01% Amr::defBaseLevel() 1 0.4402 0.5034 0.5833 4.01% FillPatchIterator::Initialize 301 0.4264 0.4794 0.5558 3.82% FillPatchSingleLevel 301 0.3888 0.4498 0.5289 3.63% FabArray::setVal() 5502 0.4568 0.4645 0.4718 3.24% Castro::normalize_species() 79 0.4541 0.458 0.464 3.19% MLMG::mgVcycle_up::1 128 0.08686 0.2354 0.4127 2.84% Amr::FinalizeInit() 1 0.2545 0.3343 0.3975 2.73% MLMG::addInterpCorrection() 768 0.142 0.2922 0.3658 2.51% MLPoisson::Fsmooth() 6144 0.2688 0.2911 0.3545 2.44% FabArray::ParallelCopy_nowait() 1583 0.303 0.3273 0.3486 2.40% MLCellLinOp::applyBC() 7156 0.2618 0.2904 0.3455 2.37% MultiFab::Subtract() 159 0.3366 0.3392 0.3425 2.35% Gravity::fill_multipole_BCs() 19 0.2096 0.256 0.285 1.96% MLMG::mgVcycle_up::2 128 0.009795 0.1155 0.2779 1.91% FabArray::FillBoundary() 6388 0.2071 0.2289 0.2652 1.82% MLMG::mgVcycle_down::0 128 0.2399 0.2421 0.2457 1.69% MultiFab::sum() 3920 0.2174 0.2194 0.2219 1.52% Castro::initData() 1 0.07905 0.1264 0.2208 1.52% Castro::construct_new_source() 102 0.2101 0.2114 0.2133 1.47% MultiFab::Saxpy() 91 0.1977 0.1988 0.1999 1.37% Castro::expand_state() 20 0.179 0.1858 0.1991 1.37% MultiFab::min() 23 0.001949 0.09715 0.1972 1.35% Amr::bldFineLevels() 1 0.04581 0.1249 0.1884 1.29% MLMG::mgVcycle_up::3 128 0.009759 0.02312 0.1878 1.29% MLCellLinOp::apply() 994 0.1492 0.1586 0.1759 1.21% MLMG::mgVcycle_up::0 128 0.1744 0.1747 0.175 1.20% amrex::average_down 768 0.03386 0.04845 0.1699 1.17% Castro::post_init() 1 0.1655 0.1665 0.168 1.15% Castro::create_source_corrector() 17 0.133 0.1415 0.1548 1.06% FillBoundary_nowait() 6388 0.08963 0.1186 0.1487 1.02% MLMG::mgVcycle_down::5 128 0.01183 0.02119 0.1478 1.02% MLMG:computeResOfCorrection() 768 0.1131 0.1226 0.1457 1.00% Amr::grid_places() 2 0.002093 0.08198 0.1452 1.00% AmrMesh::MakeNewGrids() 2 0.001937 0.08184 0.145 1.00% MLCellLinOp::correctionResidual() 776 0.1116 0.1213 0.1441 0.99% Castro::derive() 156 0.1407 0.1419 0.144 0.99% TagBoxArray::mapPRD 2 0.0006499 0.0785 0.1439 0.99% Castro::construct_old_source() 120 0.1406 0.1418 0.1434 0.99% FillBoundary_finish() 6388 0.07919 0.09653 0.1228 0.84% MLMG::mgVcycle_down::1 128 0.1088 0.1117 0.115 0.79% MLPoisson::Fapply() 994 0.09711 0.1027 0.1123 0.77% MLMG::mgVcycle_up::5 128 0.009836 0.01611 0.1059 0.73% Castro::post_timestep() 1 0.09433 0.09611 0.09796 0.67% Amr::writePlotFile() 2 0.09691 0.09699 0.097 0.67% MLCellLinOp::solutionResidual() 147 0.08746 0.09174 0.09662 0.66% Gravity::multilevel_solve_for_new_phi() 1 0.09469 0.09472 0.09475 0.65% Gravity::actual_multilevel_solve() 1 0.09464 0.09467 0.0947 0.65% MLMG::mgVcycle_bottom 128 0.0003724 0.005805 0.08716 0.60% MLMG::actualBottomSolve() 128 0.0001442 0.00557 0.08687 0.60% Castro::post_regrid() 2 0.08431 0.08576 0.08679 0.60% Castro::construct_old_gravity() 20 0.03938 0.06733 0.08586 0.59% Gravity::get_old_grav_vector() 20 0.03927 0.06723 0.08576 0.59% MLCGSolver::bicgstab 8 0 0.005318 0.08508 0.58% Castro::construct_new_gravity_source() 17 0.08061 0.08172 0.08299 0.57% Castro::apply_source_to_state() 37 0.08072 0.08123 0.08183 0.56% MLMG::computeResidual() 128 0.07604 0.07691 0.08024 0.55% Castro::problem_post_timestep() 2 0.07338 0.07521 0.07709 0.53% MLMG::mgVcycle_down::2 128 0.01256 0.03869 0.06728 0.46% Castro::construct_old_gravity_source() 20 0.06346 0.06409 0.06514 0.45% MultiFab::Xpay() 923 0.05134 0.05362 0.05937 0.41% MLMG::mgVcycle_down::3 128 0.01191 0.01778 0.05713 0.39% Castro::volWgtSum() 66 0.05301 0.0534 0.0538 0.37% Castro::initialize_advance() 1 0.05067 0.05139 0.05285 0.36% Castro::check_for_nan() 37 0.04636 0.04702 0.04754 0.33% MultiFab::contains_nan() 37 0.04624 0.04689 0.04741 0.33% Castro::retry_advance_ctu() 11 0.04387 0.0447 0.04541 0.31% Amr::regrid() 1 0.04296 0.04376 0.04458 0.31% StateDataPhysBCFunct::() 301 0.001131 0.02369 0.04455 0.31% StateData::FillBoundary(geom) 143 0 0.02238 0.04321 0.30% MLPoisson::define() 19 0.02943 0.03401 0.0394 0.27% Gravity::get_new_grav_vector() 18 0.03501 0.03574 0.03654 0.25% Castro::wd_update() 2 0.03082 0.03265 0.03455 0.24% MLMG::mgVcycle_down::4 128 0.01185 0.01343 0.03385 0.23% VisMF::Write(FabArray) 4 0.01302 0.01413 0.02649 0.18% MLMG::mgVcycle_up::4 128 0.009846 0.01094 0.0251 0.17% MLCellLinOp::defineAuxData() 19 0.01919 0.02072 0.02398 0.16% Castro::volInBoundary() 14 0.02023 0.02069 0.0224 0.15% MLMG::prepareForSolve() 18 0.01712 0.01797 0.02019 0.14% MLMG::computeMLResidual() 18 0.01074 0.01444 0.01827 0.13% MLMG::ResNormInf() 146 0.0118 0.01566 0.01715 0.12% FabArray::setDomainBndry() 301 0.0008068 0.008999 0.01693 0.12% CGSolver::sxay() 203 0 0.001008 0.01612 0.11% Amr::writeSmallPlotFile() 2 0.01466 0.01466 0.01466 0.10% Gravity::test_composite_phi() 1 0.01407 0.01409 0.01411 0.10% FabArrayBase::getCPC() 2005 0.009042 0.01049 0.0136 0.09% FabArrayBase::getFB() 6388 0.01016 0.01101 0.01282 0.09% TagBoxArray::collate() 2 7.616e-05 0.002293 0.01237 0.09% MLLinOp::define() 19 0.003408 0.007186 0.01135 0.08% MLLinOp::defineGrids() 19 0.003196 0.007003 0.01119 0.08% MultiFab::LinComb() 203 0 0.0006453 0.01032 0.07% MLCGSolver::ParallelAllReduce 189 0 0.0006318 0.01011 0.07% FabArray::mult() 59 0.007422 0.007528 0.007894 0.05% MLLinOp::makeSubCommunicator() 19 0.0003469 0.004016 0.007862 0.05% MLMG::getGradSolution() 18 0.007293 0.007412 0.007605 0.05% MLCellLinOp::compGrad() 18 0.00725 0.007368 0.007562 0.05% FabArrayBase::CPC::define() 576 0.002173 0.00339 0.006193 0.04% MLCellLinOp::defineBC() 19 0.005734 0.00598 0.006185 0.04% MultiFab::Dot() 142 0 0.0003819 0.00611 0.04% Castro::locWgtSum() 12 0.005046 0.005105 0.005183 0.04% BndryData::define() 19 0.004063 0.004274 0.004412 0.03% Gravity::update_max_rhs() 2 0.00152 0.002582 0.004033 0.03% MultiFab::max() 8 0.0006152 0.001659 0.003116 0.02% MLPoisson::normalize() 79 0 0.0001895 0.003032 0.02% Castro::volProductSum() 4 0.002916 0.002953 0.002986 0.02% MLPoisson::prepareForSolve() 19 0.00184 0.001966 0.002255 0.02% MLCellLinOp::prepareForSolve() 19 0.001757 0.001888 0.002182 0.01% MultiFab::Copy() 18 0.002043 0.002075 0.002117 0.01% AmrLevel::AmrLevel(dm) 1 0.001448 0.001532 0.001881 0.01% StateData::define() 6 0.001415 0.001496 0.001834 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001301 0.001558 0.001783 0.01% FabArrayBase::FB::FB() 75 0.0002709 0.0007146 0.001337 0.01% MLMG::MLResNormInf() 18 0.001183 0.001204 0.001268 0.01% Gravity::swapTimeLevels() 8 0.001154 0.001195 0.00124 0.01% MLMG::compResidual() 1 0.0009559 0.001072 0.001199 0.01% MLMG::MLRhsNormInf() 18 0.001126 0.001146 0.001172 0.01% MLLinOp::makeAgglomeratedDMap 19 0.001003 0.001059 0.001138 0.01% Castro::swap_state_time_levels() 8 0.0005496 0.001004 0.001042 0.01% MLCellLinOp::setLevelBC() 19 0.0005531 0.0006852 0.0008305 0.01% makeSFC 95 0.0006251 0.0006655 0.0007327 0.01% Gravity::applyMetricTerms() 2 0.0004802 0.0004966 0.0005958 0.00% Castro::enforce_consistent_e() 1 0.0003665 0.0003829 0.000448 0.00% Castro::errorEst() 2 0.0003127 0.0003359 0.00036 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001252 0.00032 0.0003564 0.00% DistributionMapping::LeastUsedCPUs() 1 1.885e-05 0.0002364 0.0002743 0.00% DistributionMapping::Distribute() 95 0.0002238 0.0002322 0.0002404 0.00% OwnerMask() 2 0.0001362 0.0001676 0.0002131 0.00% Castro::apply_tagging_restrictions() 2 0.000137 0.0001608 0.0001855 0.00% Castro::finalize_do_advance() 17 0.0001482 0.0001592 0.0001757 0.00% Castro::apply_problem_tags() 2 0.000161 0.0001686 0.0001755 0.00% Castro::enforce_speed_limit() 79 0.0001013 0.0001067 0.0001153 0.00% Amr::initSubcycle() 1 5.616e-05 6.248e-05 9.573e-05 0.00% MultiFab::Swap() 5 7.188e-05 7.494e-05 8.67e-05 0.00% knapsack() 1 6.034e-05 6.475e-05 8.348e-05 0.00% MLMG::buildFineMask() 18 4.307e-05 4.562e-05 5.055e-05 0.00% Castro::estTimeStep() 19 2.671e-05 3.012e-05 3.618e-05 0.00% Castro::construct_old_rotation_source() 20 3.111e-05 3.214e-05 3.374e-05 0.00% Castro::finalize_advance() 1 2.212e-05 2.45e-05 2.861e-05 0.00% Castro::construct_new_rotation_source() 17 2.28e-05 2.408e-05 2.661e-05 0.00% Castro::computeInitialDt() 2 1.053e-05 1.368e-05 2.409e-05 0.00% Gravity::set_mass_offset() 2 4.168e-06 1.175e-05 2.16e-05 0.00% BoxList::parallelComplementIn() 4 1.344e-05 1.408e-05 1.451e-05 0.00% BoxList::complementIn 4 6.298e-06 6.561e-06 6.879e-06 0.00% Castro::gwstrain() 2 4.366e-06 4.766e-06 6.257e-06 0.00% Castro::FluxRegFineAdd() 1 1.629e-06 1.841e-06 2.111e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 2) :: [0.0e0, 0.0e0] [TOP]::castro.dtnuc_mode(nvals = 1) :: [1] [TOP]::integrator.do_constant_volume_burn(nvals = 1) :: [1] [TOP]::mg.v(nvals = 1) :: [0] AMReX (22.02-16-g3199edf61525) finalized