MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.03-24-g1ac5d7919b44) initialized Starting run at 22:49:28 UTC on 2022-03-22. Successfully read inputs file ... Castro git describe: 22.02-14-g23fc313a7 AMReX git describe: 22.03-24-g1ac5d7919 Microphysics git describe: 22.03-16-gbfcc395c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 castro.use_stopping_criterion = 1 castro.dtnuc_mode = 1 Warning: the following integrator.* parameters are ignored integrator.do_constant_volume_burn = 1 Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.170407333 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000928318 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010531383 Gravity::fill_multipole_BCs() time = 0.010567897 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -2.5098073e-31 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.047836253 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.00671916 seconds [Level 0 step 1] ADVANCE with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.071238867 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.279742438 Advance was unsuccessful with reason: negative density (density = -9.081732e+02 at index (14,70); started at 4.477055e+03); proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.07000882 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.267980262 Advance was unsuccessful with reason: negative density (density = -1.592544e+00 at index (20,79); started at 2.790161e+00); proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.064049469 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.26029153 Advance was unsuccessful with reason: negative density (density = -1.060745e-01 at index (20,78); started at 2.068339e-01); proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.063806234 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.261187713 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.013773936 Gravity::solve_for_phi() time = 0.078434505 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.06910467 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.063317582 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.260180755 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.013488281 Gravity::solve_for_phi() time = 0.078703571 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.068908667 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.063876538 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.269589667 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.013472707 Gravity::solve_for_phi() time = 0.078244577 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.069088789 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.065516784 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.273689939 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.997068055e+46 ener added: 2.415044041e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016207399 Gravity::solve_for_phi() time = 0.081284461 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.543114243e+44 ener added: 4.768138875e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.765646947e+35 ymom added: 1.797592414e+26 zmom added: 0 eint added: 0 ener added: 5.380039006e+43 Castro::do_new_sources() time = 0.068928328 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.063873452 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.271254516 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.317346246e+44 ener added: 3.120883219e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.013931408 Gravity::solve_for_phi() time = 0.078690918 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.957879842e+46 ener added: 4.564181618e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.001437306e+36 ymom added: 1.471489396e+25 zmom added: 0 eint added: 0 ener added: 6.980886509e+46 Castro::do_new_sources() time = 0.069131425 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.063484692 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.268135399 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.012688492e+46 ener added: 2.110657671e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016002116 Gravity::solve_for_phi() time = 0.081653692 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.326633224e+44 ener added: 1.174460404e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.711471844e+35 ymom added: 1.66063198e+26 zmom added: 0 eint added: 0 ener added: 2.826321793e+43 Castro::do_new_sources() time = 0.068432917 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.063141801 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.272307784 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.090986835e+44 ener added: 2.655092076e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.013869429 Gravity::solve_for_phi() time = 0.082110696 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.968859957e+46 ener added: 1.10301368e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.004822123e+36 ymom added: -8.771795742e+24 zmom added: 0 eint added: 0 ener added: 6.987657644e+46 Castro::do_new_sources() time = 0.068918219 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.063526747 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.267738516 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.025000527e+46 ener added: 2.183068315e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014531736 Gravity::solve_for_phi() time = 0.079666842 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.651474965e+44 ener added: 1.477761377e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.60533052e+35 ymom added: 1.690843319e+26 zmom added: 0 eint added: 0 ener added: -1.190247427e+43 Castro::do_new_sources() time = 0.068594246 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.063240074 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.276002921 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.213015184e+44 ener added: 2.894439872e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015189616 Gravity::solve_for_phi() time = 0.080086761 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.97482432e+46 ener added: 1.388215779e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.00305216e+36 ymom added: 1.271497176e+24 zmom added: 0 eint added: 0 ener added: 6.99302976e+46 Castro::do_new_sources() time = 0.068737867 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.063302614 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.27049233 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.046400343e+46 ener added: 2.16073557e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014699249 Gravity::solve_for_phi() time = 0.080105063 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.248919276e+44 ener added: 1.60656791e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.450686215e+35 ymom added: 1.697312961e+26 zmom added: 0 eint added: 0 ener added: -6.185767806e+43 Castro::do_new_sources() time = 0.068414622 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.064479654 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.271257059 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.824816589e+44 ener added: 2.945461224e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014873928 Gravity::solve_for_phi() time = 0.080404965 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.977981871e+46 ener added: 1.507699921e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.996348783e+36 ymom added: 3.069538214e+24 zmom added: 0 eint added: 0 ener added: 6.997250022e+46 Castro::do_new_sources() time = 0.069234374 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.063515841 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.267186892 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.067953295e+46 ener added: 2.185941597e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015149886 Gravity::solve_for_phi() time = 0.080035172 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.036038551e+44 ener added: 1.710131682e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.236317743e+35 ymom added: 1.665059198e+26 zmom added: 0 eint added: 0 ener added: -1.282743578e+44 Castro::do_new_sources() time = 0.068826516 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.063794467 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.272059135 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.23178587e+44 ener added: 2.927676839e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014396617 Gravity::solve_for_phi() time = 0.079346331 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.979285299e+46 ener added: 1.614875382e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.983606539e+36 ymom added: -1.663453594e+24 zmom added: 0 eint added: 0 ener added: 6.999733101e+46 Castro::do_new_sources() time = 0.069177018 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.063807997 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.271747432 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.076022112e+46 ener added: 2.369765675e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015501424 Gravity::solve_for_phi() time = 0.08027568 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.768256697e+44 ener added: 1.742935385e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.789276502e+34 ymom added: 1.761383669e+26 zmom added: 0 eint added: 0 ener added: -1.824543748e+44 Castro::do_new_sources() time = 0.068836936 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.06373904 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.271658624 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.399341724e+44 ener added: 3.055404896e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014756859 Gravity::solve_for_phi() time = 0.07966759 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.981378524e+46 ener added: 1.65468052e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.966651828e+36 ymom added: 1.133367956e+23 zmom added: 0 eint added: 0 ener added: 7.003642946e+46 Castro::do_new_sources() time = 0.06937134 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.066567046 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.273360291 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.085134477e+46 ener added: 2.616682453e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015846021 Gravity::solve_for_phi() time = 0.080696215 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.966387031e+44 ener added: 1.764409733e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.086349894e+34 ymom added: 1.71437251e+26 zmom added: 0 eint added: 0 ener added: -1.814844154e+44 Castro::do_new_sources() time = 0.071981148 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.066056795 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.280454844 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.20798565e+44 ener added: 3.358777738e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015383175 Gravity::solve_for_phi() time = 0.080155542 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988653412e+46 ener added: 1.671056473e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.948364053e+36 ymom added: 7.142579305e+23 zmom added: 0 eint added: 0 ener added: 7.013022432e+46 Castro::do_new_sources() time = 0.069231028 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002754375798 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.548275694e+29 ener added: 1.548275694e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -2.890848341e+38 TIME= 0.25 YMOM = 8.975065285e+27 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.505143013e+38 TIME= 0.25 RHO*e = 1.331449006e+50 TIME= 0.25 RHO*K = 3.171006988e+49 TIME= 0.25 RHO*E = 1.648549705e+50 TIME= 0.25 RHO*PHI = -5.460195609e+50 TIME= 0.25 TOTAL ENERGY= -1.0815481e+50 TIME= 0.25 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0.25 CENTER OF MASS X-VEL = -113366.7542 TIME= 0.25 CENTER OF MASS Y-LOC = -4.196397805e-29 TIME= 0.25 CENTER OF MASS Y-VEL = 3.519638182e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 [STEP 1] Coarse TimeStep time: 11.99092234 [STEP 1] FAB kilobyte spread across MPI nodes: [8620 ... 8620] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.047376468 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.006575295 seconds Ending run at 22:49:42 UTC on 2022-03-22. Run time = 14.3222576 Run time without initialization = 12.04697111 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.32 ... 14.32 ... 14.32 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.2812 5.3384 5.3996 37.70% Amr::InitAmr() 1 1.341 1.341 1.342 9.37% Castro::computeTemp() 80 0.856 0.9593 1.123 7.84% Castro::reset_internal_energy() 80 0.8818 0.927 1.063 7.42% FabArray::ParallelCopy_finish() 1583 0.1397 0.4796 0.6598 4.61% MultiFab::AddProduct() 3920 0.6139 0.6151 0.6169 4.31% Castro::normalize_species() 79 0.4509 0.4544 0.4928 3.44% FabArray::setVal() 5502 0.4457 0.4495 0.4592 3.21% Amr::defBaseLevel() 1 0.3555 0.3727 0.4083 2.85% MLPoisson::Fsmooth() 6144 0.2656 0.2861 0.3476 2.43% MultiFab::Subtract() 159 0.3404 0.3421 0.3464 2.42% FabArray::ParallelCopy_nowait() 1583 0.2943 0.3137 0.3379 2.36% Gravity::fill_multipole_BCs() 19 0.1961 0.2465 0.2703 1.89% Castro::enforce_min_density() 79 0.1904 0.1982 0.216 1.51% MultiFab::sum() 3920 0.2081 0.2096 0.2103 1.47% MultiFab::Saxpy() 91 0.1934 0.1939 0.1947 1.36% MultiFab::min() 23 0.002162 0.09876 0.1701 1.19% Castro::do_advance_ctu() 20 0.1552 0.1556 0.1561 1.09% FillBoundary_nowait() 6388 0.07824 0.106 0.136 0.95% Castro::initData() 1 0.003364 0.023 0.1316 0.92% FillBoundary_finish() 6388 0.07612 0.09251 0.1199 0.84% MLPoisson::Fapply() 994 0.09326 0.09706 0.1067 0.75% Castro::derive() 156 0.09617 0.09726 0.09945 0.69% MLCellLinOp::applyBC() 7156 0.04513 0.05982 0.09134 0.64% Castro::construct_new_gravity_source() 17 0.07937 0.08013 0.08097 0.57% Castro::do_old_sources() 20 0.000297 0.01668 0.07478 0.52% Castro::expand_state() 20 0.06832 0.06849 0.06892 0.48% Castro::do_new_sources() 17 0.000246 0.01339 0.06519 0.46% Castro::construct_old_gravity_source() 20 0.06163 0.06207 0.06254 0.44% MultiFab::Xpay() 923 0.05003 0.05193 0.05733 0.40% Castro::create_source_corrector() 17 0.05241 0.05265 0.05306 0.37% MultiFab::contains_nan() 37 0.04519 0.04541 0.04596 0.32% StateData::FillBoundary(geom) 143 0 0.02203 0.04339 0.30% MLMG::addInterpCorrection() 768 0.02902 0.0313 0.03801 0.27% amrex::average_down 768 0.0253 0.02725 0.03321 0.23% Amr::writePlotFile() 2 0.01793 0.02625 0.02726 0.19% VisMF::Write(FabArray) 4 0.01407 0.01516 0.02675 0.19% Castro::retry_advance_ctu() 11 0.02445 0.02474 0.02504 0.17% MLCGSolver::bicgstab 8 0 0.001486 0.02377 0.17% FillPatchIterator::Initialize 301 0.02017 0.02044 0.0207 0.14% Gravity::get_old_grav_vector() 20 0.01906 0.01922 0.0197 0.14% Castro::construct_new_source() 102 0.0169 0.01711 0.018 0.13% Gravity::get_new_grav_vector() 18 0.01732 0.01763 0.01789 0.12% MLCellLinOp::defineAuxData() 19 0.01502 0.01588 0.01769 0.12% FabArray::setDomainBndry() 301 0.0008029 0.008799 0.01654 0.12% FabArray::FillBoundary() 6388 0.01324 0.01377 0.01581 0.11% Castro::evaluate_source_change() 196 0.01358 0.01386 0.01461 0.10% MLMG::oneIter() 128 0.0143 0.01434 0.0144 0.10% MLMG::ResNormInf() 146 0.01026 0.01176 0.01307 0.09% MLCellLinOp::smooth() 3072 0.01105 0.01147 0.01236 0.09% Castro::construct_old_source() 120 0.01132 0.01146 0.01199 0.08% FabArrayBase::getFB() 6388 0.009645 0.01 0.01192 0.08% Amr::writeSmallPlotFile() 2 0.006941 0.01066 0.01109 0.08% Castro::wd_update() 2 0.004395 0.007725 0.0105 0.07% Castro::volWgtSum() 66 0.009669 0.009782 0.009894 0.07% MultiFab::LinComb() 203 0 0.0005904 0.009447 0.07% MLLinOp::makeSubCommunicator() 19 0.0003254 0.004001 0.007811 0.05% Gravity::actual_solve_with_mlmg() 19 0.006732 0.006996 0.007668 0.05% MLMG::prepareForSolve() 18 0.006696 0.00689 0.007518 0.05% FabArray::mult() 59 0.006965 0.007082 0.007389 0.05% FabArrayBase::getCPC() 2005 0.006751 0.006922 0.007252 0.05% MLCGSolver::ParallelAllReduce 189 0 0.0004069 0.00651 0.05% FabArrayBase::CPC::define() 576 0.002144 0.003366 0.00601 0.04% MultiFab::Dot() 142 0 0.000365 0.00584 0.04% CGSolver::sxay() 203 0 0.00036 0.00576 0.04% MLCellLinOp::compGrad() 18 0.005567 0.005599 0.005637 0.04% MLCellLinOp::apply() 994 0.002052 0.002287 0.004937 0.03% MLMG::solve() 18 0.0007887 0.001828 0.00477 0.03% Castro::initialize_do_advance() 20 0.004304 0.004431 0.004601 0.03% FabArray::ParallelCopy() 1583 0.00371 0.003835 0.004134 0.03% Castro::volInBoundary() 14 0.003512 0.003592 0.003935 0.03% BndryData::define() 19 0.003167 0.003198 0.003432 0.02% Gravity::solve_for_phi() 17 0.002491 0.00267 0.003272 0.02% MultiFab::max() 8 0.0004953 0.001619 0.003203 0.02% MLPoisson::normalize() 79 0 0.0001807 0.002891 0.02% Castro::construct_new_gravity() 17 0.00227 0.002319 0.00248 0.02% MLCellLinOp::correctionResidual() 776 0.001844 0.001936 0.00231 0.02% MultiFab::Copy() 18 0.002058 0.00207 0.002083 0.01% MLCellLinOp::prepareForSolve() 19 0.001712 0.001842 0.002075 0.01% MLLinOp::defineGrids() 19 0.001742 0.001852 0.002054 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001335 0.001524 0.001815 0.01% Castro::locWgtSum() 12 0.001752 0.001781 0.001801 0.01% StateData::define() 6 0.0014 0.001473 0.001782 0.01% MLCellLinOp::defineBC() 19 0.001636 0.001679 0.00178 0.01% MLMG::mgVcycle() 128 0.00153 0.001631 0.00178 0.01% MLMG:computeResOfCorrection() 768 0.001411 0.001472 0.001586 0.01% Castro::problem_post_timestep() 2 0.0004174 0.0009239 0.001451 0.01% StateDataPhysBCFunct::() 301 0.001194 0.001309 0.001386 0.01% FabArrayBase::FB::FB() 75 0.0002723 0.0006806 0.001293 0.01% main() 1 0.001049 0.001172 0.001259 0.01% MLMG::actualBottomSolve() 128 0.0001444 0.0002163 0.001209 0.01% Castro::post_init() 1 0.0003598 0.0008478 0.001191 0.01% MLMG::MLRhsNormInf() 18 0.00111 0.001123 0.001137 0.01% Castro::swap_state_time_levels() 8 0.0005291 0.001017 0.001071 0.01% TagBoxArray::collate() 2 7.185e-05 0.000513 0.0009065 0.01% FillPatchSingleLevel 301 0.0008526 0.0008703 0.0008989 0.01% MLCellLinOp::setLevelBC() 19 0.000574 0.0006843 0.0008266 0.01% Castro::volProductSum() 4 0.0007656 0.0007772 0.0008118 0.01% MLMG::mgVcycle_down::2 128 0.000653 0.0007092 0.0008033 0.01% MLMG::mgVcycle_down::0 128 0.0006956 0.0007068 0.000749 0.01% MLMG::mgVcycle_down::1 128 0.0006721 0.0006839 0.0007381 0.01% Castro::subcycle_advance_ctu() 1 0.0003017 0.0003728 0.0007282 0.01% MLMG::mgVcycle_down::3 128 0.0005805 0.0006348 0.0007282 0.01% MLMG::mgVcycle_down::4 128 0.0005768 0.0006009 0.0007062 0.00% MLMG::mgVcycle_down::5 128 0.0005713 0.0005904 0.000666 0.00% Gravity::test_composite_phi() 1 0.0004271 0.0004883 0.0006107 0.00% MLMG::mgVcycle_up::1 128 0.0004989 0.0005121 0.0005667 0.00% MLMG::mgVcycle_up::0 128 0.000483 0.0004952 0.0005491 0.00% AmrMesh::MakeNewGrids() 2 0.0004733 0.0005041 0.0005447 0.00% makeSFC 95 0.0003851 0.0004321 0.0005404 0.00% MLMG::mgVcycle_up::2 128 0.0004102 0.000459 0.0005348 0.00% MLMG::mgVcycle_up::3 128 0.0004165 0.0004353 0.0005006 0.00% Castro::post_timestep() 1 0.0002337 0.0004354 0.0004972 0.00% Gravity::applyMetricTerms() 2 0.0004668 0.0004803 0.0004923 0.00% Castro::clean_state() 79 0.0004315 0.0004508 0.0004874 0.00% MLMG::mgVcycle_up::5 128 0.0004226 0.0004411 0.0004863 0.00% MLMG::mgVcycle_up::4 128 0.0004125 0.0004258 0.000479 0.00% MLCellLinOp::solutionResidual() 147 0.0004198 0.0004351 0.0004554 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003695 0.0003879 0.0004488 0.00% Castro::enforce_consistent_e() 1 0.000365 0.0003781 0.0004326 0.00% Gravity::update_max_rhs() 2 0.000388 0.0004031 0.0004289 0.00% DistributionMapping::Distribute() 95 0.000222 0.000242 0.0003636 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002416 0.0002579 0.0003292 0.00% Castro::initialize_advance() 1 0.0002151 0.0002725 0.0002956 0.00% MLMG::computeResidual() 128 0.0002598 0.0002675 0.0002865 0.00% MLMG::mgVcycle_bottom 128 0.0002217 0.0002317 0.0002751 0.00% DistributionMapping::LeastUsedCPUs() 1 1.958e-05 0.0002335 0.0002716 0.00% MLMG::compResidual() 1 0.0002492 0.0002546 0.0002599 0.00% OwnerMask() 2 0.0001357 0.0001706 0.00023 0.00% MLLinOp::define() 19 0.0001514 0.0001819 0.0002002 0.00% Castro::apply_tagging_restrictions() 2 0.0001373 0.000156 0.0001838 0.00% Castro::finalize_do_advance() 17 0.0001382 0.0001534 0.0001817 0.00% Castro::apply_problem_tags() 2 0.0001618 0.0001695 0.0001806 0.00% Amr::grid_places() 2 8.571e-05 0.0001147 0.0001631 0.00% MLPoisson::define() 19 0.0001131 0.000124 0.0001483 0.00% Castro::check_for_nan() 37 0.0001189 0.0001275 0.0001466 0.00% Gravity::actual_multilevel_solve() 1 0.0001361 0.0001405 0.0001436 0.00% TagBoxArray::mapPRD 2 0.0001139 0.0001231 0.0001385 0.00% Amr::coarseTimeStep() 1 0.000102 0.0001205 0.0001289 0.00% Castro::apply_source_to_state() 37 0.000106 0.0001135 0.0001239 0.00% Castro::enforce_speed_limit() 79 0.0001055 0.0001093 0.0001148 0.00% Castro::construct_old_gravity() 20 9.414e-05 9.976e-05 0.0001088 0.00% Amr::initSubcycle() 1 5.675e-05 6.232e-05 9.708e-05 0.00% MultiFab::Swap() 5 7.081e-05 7.388e-05 8.983e-05 0.00% knapsack() 1 5.873e-05 6.362e-05 8.773e-05 0.00% MLPoisson::prepareForSolve() 19 7.091e-05 7.562e-05 8.429e-05 0.00% Castro::finalize_advance() 1 1.972e-05 3.275e-05 8.186e-05 0.00% Gravity::swapTimeLevels() 8 3.378e-05 3.813e-05 5.561e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 4.922e-05 5.097e-05 5.354e-05 0.00% MLMG::computeMLResidual() 18 4.126e-05 4.503e-05 5.093e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.134e-05 3.438e-05 4.781e-05 0.00% MLMG::getGradSolution() 18 4.094e-05 4.254e-05 4.76e-05 0.00% Castro::estTimeStep() 19 2.751e-05 3.11e-05 4.719e-05 0.00% MLMG::buildFineMask() 18 4.15e-05 4.468e-05 4.718e-05 0.00% Amr::FinalizeInit() 1 9.213e-06 2.075e-05 4.307e-05 0.00% MLMG::MLResNormInf() 18 3.306e-05 3.47e-05 4.002e-05 0.00% Amr::regrid() 1 1.205e-05 1.731e-05 3.748e-05 0.00% Castro::construct_old_rotation_source() 20 2.981e-05 3.068e-05 3.209e-05 0.00% Castro::construct_new_rotation_source() 17 2.229e-05 2.294e-05 2.392e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.665e-05 1.881e-05 2.391e-05 0.00% Castro::post_regrid() 2 1.13e-05 1.342e-05 2.039e-05 0.00% Amr::init() 1 7.957e-06 1.285e-05 1.974e-05 0.00% Amr::timeStep() 1 1.152e-05 1.383e-05 1.791e-05 0.00% Gravity::set_mass_offset() 2 4.303e-06 8.394e-06 1.663e-05 0.00% Amr::InitializeInit() 1 6.61e-06 7.62e-06 1.379e-05 0.00% Amr::initialInit() 1 3.014e-06 5.359e-06 1.229e-05 0.00% Castro::computeInitialDt() 2 7.036e-06 7.944e-06 1.138e-05 0.00% Amr::bldFineLevels() 1 7.579e-06 8.265e-06 9.886e-06 0.00% BoxList::parallelComplementIn() 4 7.283e-06 7.614e-06 8.097e-06 0.00% Castro::advance() 1 6.327e-06 6.79e-06 7.286e-06 0.00% BoxList::complementIn 4 6.328e-06 6.579e-06 7.081e-06 0.00% Castro::errorEst() 2 5.783e-06 6.233e-06 6.98e-06 0.00% Castro::gwstrain() 2 4.312e-06 4.821e-06 6.402e-06 0.00% Castro::FluxRegFineAdd() 1 1.681e-06 1.957e-06 2.386e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.32 14.32 14.32 100.00% Amr::coarseTimeStep() 1 12.05 12.05 12.05 84.11% Amr::timeStep() 1 11.99 11.99 11.99 83.72% Castro::advance() 1 11.89 11.89 11.9 83.06% Castro::subcycle_advance_ctu() 1 11.84 11.84 11.85 82.72% Castro::do_advance_ctu() 20 11.8 11.8 11.8 82.39% Castro::construct_ctu_hydro_source() 20 5.281 5.338 5.4 37.70% Castro::clean_state() 79 3.584 3.674 3.828 26.73% Castro::computeTemp() 80 2.377 2.488 2.698 18.84% Castro::reset_internal_energy() 80 1.482 1.529 1.666 11.63% Gravity::solve_phi_with_mlmg() 19 1.382 1.436 1.461 10.20% Castro::construct_new_gravity() 17 1.314 1.368 1.393 9.73% Gravity::solve_for_phi() 17 1.278 1.332 1.357 9.48% Amr::InitAmr() 1 1.341 1.342 1.342 9.37% Castro::do_old_sources() 20 1.185 1.238 1.291 9.02% Castro::initialize_do_advance() 20 1.239 1.247 1.258 8.79% Gravity::actual_solve_with_mlmg() 19 1.185 1.188 1.193 8.33% Castro::do_new_sources() 17 1.109 1.143 1.174 8.20% MLMG::solve() 18 1.135 1.138 1.14 7.96% Castro::evaluate_source_change() 196 1.049 1.054 1.065 7.43% MLMG::oneIter() 128 1.017 1.018 1.02 7.12% MLMG::mgVcycle() 128 1.003 1.004 1.006 7.02% FabArray::ParallelCopy() 1583 0.4584 0.8033 0.9832 6.86% Amr::init() 1 0.9329 0.9331 0.9331 6.51% Amr::initialInit() 1 0.876 0.8762 0.8763 6.12% Castro::enforce_min_density() 79 0.7834 0.7934 0.8126 5.67% FabArray::ParallelCopy_finish() 1583 0.1397 0.4796 0.6598 4.61% MLCellLinOp::smooth() 3072 0.4815 0.5263 0.6416 4.48% Amr::InitializeInit() 1 0.4546 0.514 0.6232 4.35% Amr::defBaseLevel() 1 0.4546 0.514 0.6232 4.35% MultiFab::AddProduct() 3920 0.6139 0.6151 0.6169 4.31% FillPatchIterator::Initialize 301 0.4141 0.4725 0.5537 3.87% FillPatchSingleLevel 301 0.3769 0.4432 0.527 3.68% Castro::normalize_species() 79 0.4509 0.4544 0.4928 3.44% FabArray::setVal() 5502 0.4457 0.4495 0.4592 3.21% Amr::FinalizeInit() 1 0.253 0.3622 0.4217 2.94% MLMG::mgVcycle_up::1 128 0.08723 0.2333 0.4057 2.83% MLMG::addInterpCorrection() 768 0.1407 0.2855 0.3584 2.50% MLPoisson::Fsmooth() 6144 0.2656 0.2861 0.3476 2.43% MultiFab::Subtract() 159 0.3404 0.3421 0.3464 2.42% FabArray::ParallelCopy_nowait() 1583 0.2999 0.3198 0.3449 2.41% MLCellLinOp::applyBC() 7156 0.2534 0.2828 0.3372 2.35% MLMG::mgVcycle_up::2 128 0.009708 0.1123 0.2708 1.89% Gravity::fill_multipole_BCs() 19 0.1961 0.2465 0.2703 1.89% Castro::initData() 1 0.07781 0.1341 0.2602 1.82% FabArray::FillBoundary() 6388 0.1971 0.2229 0.2555 1.78% MLMG::mgVcycle_down::0 128 0.2343 0.2351 0.2363 1.65% Amr::bldFineLevels() 1 0.04567 0.1546 0.2134 1.49% MultiFab::sum() 3920 0.2081 0.2096 0.2103 1.47% Castro::construct_new_source() 102 0.2063 0.2075 0.2096 1.46% Castro::expand_state() 20 0.1772 0.1845 0.2025 1.41% MultiFab::Saxpy() 91 0.1934 0.1939 0.1947 1.36% MLMG::mgVcycle_up::3 128 0.009655 0.02252 0.1813 1.27% MLMG::mgVcycle_up::0 128 0.1707 0.1712 0.1717 1.20% Amr::grid_places() 2 0.002694 0.1119 0.1714 1.20% AmrMesh::MakeNewGrids() 2 0.002601 0.1118 0.1712 1.20% MLCellLinOp::apply() 994 0.1422 0.1516 0.1705 1.19% MultiFab::min() 23 0.002162 0.09876 0.1701 1.19% TagBoxArray::mapPRD 2 0.0007888 0.1103 0.1699 1.19% Castro::post_init() 1 0.1643 0.1654 0.1669 1.17% amrex::average_down 768 0.03332 0.0474 0.1665 1.16% FillBoundary_nowait() 6388 0.08833 0.1167 0.1472 1.03% Castro::create_source_corrector() 17 0.1301 0.1375 0.1468 1.02% Castro::derive() 156 0.141 0.1424 0.1447 1.01% MLMG::mgVcycle_down::5 128 0.01162 0.02083 0.1446 1.01% MLMG:computeResOfCorrection() 768 0.1092 0.1178 0.1404 0.98% Castro::construct_old_source() 120 0.1372 0.1382 0.1391 0.97% MLCellLinOp::correctionResidual() 776 0.1077 0.1166 0.1389 0.97% FillBoundary_finish() 6388 0.07612 0.09251 0.1199 0.84% MLMG::mgVcycle_down::1 128 0.1035 0.1059 0.1084 0.76% MLPoisson::Fapply() 994 0.09326 0.09706 0.1067 0.75% MLMG::mgVcycle_up::5 128 0.009719 0.01576 0.1024 0.72% Castro::post_timestep() 1 0.09417 0.09597 0.09794 0.68% Amr::writePlotFile() 2 0.09743 0.09751 0.09752 0.68% Gravity::multilevel_solve_for_new_phi() 1 0.09343 0.09346 0.0935 0.65% Gravity::actual_multilevel_solve() 1 0.09337 0.09341 0.09345 0.65% MLCellLinOp::solutionResidual() 147 0.08358 0.08784 0.09105 0.64% Castro::post_regrid() 2 0.08334 0.08491 0.08598 0.60% MLMG::mgVcycle_bottom 128 0.0003711 0.005621 0.08425 0.59% MLMG::actualBottomSolve() 128 0.0001444 0.005389 0.08397 0.59% MLCGSolver::bicgstab 8 0 0.005141 0.08226 0.57% Castro::construct_old_gravity() 20 0.03858 0.06372 0.08191 0.57% Gravity::get_old_grav_vector() 20 0.03849 0.06362 0.08181 0.57% Castro::construct_new_gravity_source() 17 0.07937 0.08013 0.08097 0.57% Castro::apply_source_to_state() 37 0.07853 0.07886 0.07952 0.56% Castro::problem_post_timestep() 2 0.07368 0.07552 0.07778 0.54% MLMG::computeResidual() 128 0.07286 0.07311 0.07354 0.51% MLMG::mgVcycle_down::2 128 0.01242 0.03836 0.06642 0.46% Castro::construct_old_gravity_source() 20 0.06163 0.06207 0.06254 0.44% MultiFab::Xpay() 923 0.05003 0.05193 0.05733 0.40% MLMG::mgVcycle_down::3 128 0.01171 0.01751 0.05657 0.40% Castro::volWgtSum() 66 0.05284 0.05336 0.05383 0.38% Castro::initialize_advance() 1 0.04967 0.05062 0.05189 0.36% Castro::check_for_nan() 37 0.04532 0.04554 0.04611 0.32% MultiFab::contains_nan() 37 0.04519 0.04541 0.04596 0.32% Castro::retry_advance_ctu() 11 0.04432 0.04473 0.04507 0.31% StateDataPhysBCFunct::() 301 0.001194 0.02334 0.04478 0.31% Amr::regrid() 1 0.04288 0.04359 0.04415 0.31% StateData::FillBoundary(geom) 143 0 0.02203 0.04339 0.30% MLPoisson::define() 19 0.02913 0.0337 0.03972 0.28% Gravity::get_new_grav_vector() 18 0.03463 0.03541 0.03612 0.25% Castro::wd_update() 2 0.0308 0.03268 0.03497 0.24% MLMG::mgVcycle_down::4 128 0.01169 0.01322 0.03288 0.23% VisMF::Write(FabArray) 4 0.01407 0.01516 0.02675 0.19% MLMG::mgVcycle_up::4 128 0.009752 0.01079 0.02453 0.17% MLCellLinOp::defineAuxData() 19 0.01891 0.02057 0.02391 0.17% Castro::volInBoundary() 14 0.0203 0.02075 0.02246 0.16% MLMG::prepareForSolve() 18 0.01687 0.01762 0.01956 0.14% MLMG::computeMLResidual() 18 0.0103 0.01432 0.01753 0.12% FabArray::setDomainBndry() 301 0.0008029 0.008799 0.01654 0.12% CGSolver::sxay() 203 0 0.0009504 0.01521 0.11% Amr::writeSmallPlotFile() 2 0.01476 0.01476 0.01476 0.10% Gravity::test_composite_phi() 1 0.01396 0.01399 0.01401 0.10% FabArrayBase::getCPC() 2005 0.008895 0.01029 0.01323 0.09% MLMG::ResNormInf() 146 0.01026 0.01176 0.01307 0.09% FabArrayBase::getFB() 6388 0.009996 0.01068 0.01242 0.09% MLLinOp::define() 19 0.003308 0.007097 0.01116 0.08% MLLinOp::defineGrids() 19 0.003155 0.006915 0.01097 0.08% MLCGSolver::ParallelAllReduce 189 0 0.0006067 0.009707 0.07% MultiFab::LinComb() 203 0 0.0005904 0.009447 0.07% MLLinOp::makeSubCommunicator() 19 0.0003254 0.004001 0.007811 0.05% MLMG::getGradSolution() 18 0.007197 0.007357 0.00751 0.05% MLCellLinOp::compGrad() 18 0.007157 0.007315 0.007467 0.05% FabArray::mult() 59 0.006965 0.007082 0.007389 0.05% MLCellLinOp::defineBC() 19 0.005728 0.005911 0.006276 0.04% FabArrayBase::CPC::define() 576 0.002144 0.003366 0.00601 0.04% MultiFab::Dot() 142 0 0.000365 0.00584 0.04% Castro::locWgtSum() 12 0.005057 0.005123 0.005185 0.04% BndryData::define() 19 0.004042 0.004233 0.004524 0.03% Gravity::update_max_rhs() 2 0.001419 0.002517 0.004086 0.03% MultiFab::max() 8 0.0004953 0.001619 0.003203 0.02% Castro::volProductSum() 4 0.002952 0.002985 0.003036 0.02% MLPoisson::normalize() 79 0 0.0001807 0.002891 0.02% MLPoisson::prepareForSolve() 19 0.00179 0.001917 0.002146 0.01% MultiFab::Copy() 18 0.002058 0.00207 0.002083 0.01% MLCellLinOp::prepareForSolve() 19 0.001712 0.001842 0.002075 0.01% AmrLevel::AmrLevel(dm) 1 0.001431 0.001507 0.001829 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001335 0.001524 0.001815 0.01% StateData::define() 6 0.0014 0.001473 0.001782 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009873 0.001062 0.001333 0.01% FabArrayBase::FB::FB() 75 0.0002723 0.0006806 0.001293 0.01% Gravity::swapTimeLevels() 8 0.001134 0.00117 0.00127 0.01% MLMG::compResidual() 1 0.0009527 0.001081 0.00121 0.01% MLMG::MLResNormInf() 18 0.001138 0.00115 0.001168 0.01% MLMG::MLRhsNormInf() 18 0.00111 0.001123 0.001137 0.01% Castro::swap_state_time_levels() 8 0.0005291 0.001017 0.001071 0.01% TagBoxArray::collate() 2 7.185e-05 0.000513 0.0009065 0.01% makeSFC 95 0.000607 0.0006741 0.000884 0.01% MLCellLinOp::setLevelBC() 19 0.000574 0.0006843 0.0008266 0.01% Gravity::applyMetricTerms() 2 0.0004668 0.0004803 0.0004923 0.00% Castro::enforce_consistent_e() 1 0.000365 0.0003781 0.0004326 0.00% DistributionMapping::Distribute() 95 0.000222 0.000242 0.0003636 0.00% Castro::errorEst() 2 0.0003117 0.0003318 0.0003579 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001303 0.0003159 0.0003496 0.00% DistributionMapping::LeastUsedCPUs() 1 1.958e-05 0.0002335 0.0002716 0.00% OwnerMask() 2 0.0001357 0.0001706 0.00023 0.00% Castro::apply_tagging_restrictions() 2 0.0001373 0.000156 0.0001838 0.00% Castro::finalize_do_advance() 17 0.0001382 0.0001534 0.0001817 0.00% Castro::apply_problem_tags() 2 0.0001618 0.0001695 0.0001806 0.00% Castro::enforce_speed_limit() 79 0.0001055 0.0001093 0.0001148 0.00% Amr::initSubcycle() 1 5.675e-05 6.232e-05 9.708e-05 0.00% MultiFab::Swap() 5 7.081e-05 7.388e-05 8.983e-05 0.00% knapsack() 1 5.873e-05 6.362e-05 8.773e-05 0.00% Castro::finalize_advance() 1 2.171e-05 3.471e-05 8.425e-05 0.00% Castro::estTimeStep() 19 2.751e-05 3.11e-05 4.719e-05 0.00% MLMG::buildFineMask() 18 4.15e-05 4.468e-05 4.718e-05 0.00% Castro::construct_old_rotation_source() 20 2.981e-05 3.068e-05 3.209e-05 0.00% Castro::construct_new_rotation_source() 17 2.229e-05 2.294e-05 2.392e-05 0.00% Gravity::set_mass_offset() 2 4.303e-06 8.394e-06 1.663e-05 0.00% Castro::computeInitialDt() 2 1.052e-05 1.162e-05 1.53e-05 0.00% BoxList::parallelComplementIn() 4 1.368e-05 1.419e-05 1.518e-05 0.00% BoxList::complementIn 4 6.328e-06 6.579e-06 7.081e-06 0.00% Castro::gwstrain() 2 4.312e-06 4.821e-06 6.402e-06 0.00% Castro::FluxRegFineAdd() 1 1.681e-06 1.957e-06 2.386e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 2) :: [0.0e0, 0.0e0] [TOP]::castro.dtnuc_mode(nvals = 1) :: [1] [TOP]::integrator.do_constant_volume_burn(nvals = 1) :: [1] [TOP]::mg.v(nvals = 1) :: [0] AMReX (22.03-24-g1ac5d7919b44) finalized