MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.01-26-g65f906216a5e) initialized Starting run at 08:07:32 UTC on 2022-01-14. Successfully read inputs file ... Castro git describe: 21.12-25-g169653a90 AMReX git describe: 22.01-26-g65f906216 Microphysics git describe: 22.01-15-gfb7348bf reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 castro.use_stopping_criterion = 1 castro.dtnuc_mode = 1 Warning: the following integrator.* parameters are ignored integrator.do_constant_volume_burn = 1 Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.130383702 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000985672 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.0113286972 Gravity::fill_multipole_BCs() time = 0.01129484177 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -2.5098073e-31 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.064254929 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.006951079 seconds [Level 0 step 1] ADVANCE with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.07784771919 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2977201939 Advance was unsuccessful with reason: negative density (density = -9.081732e+02 at index (14,70); started at 4.477055e+03); proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.07638144493 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2969839573 Advance was unsuccessful with reason: negative density (density = -1.592544e+00 at index (20,79); started at 2.790161e+00); proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.07337069511 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2974784374 Advance was unsuccessful with reason: negative density (density = -1.060745e-01 at index (20,78); started at 2.068339e-01); proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.07207775116 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2967071533 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01592564583 Gravity::solve_for_phi() time = 0.112729311 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.07807374001 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.07309675217 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2973165512 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01531624794 Gravity::solve_for_phi() time = 0.1123273373 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.07859492302 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.07312321663 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.294788599 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0149166584 Gravity::solve_for_phi() time = 0.1107604504 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.07766914368 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.07290101051 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2946870327 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.997068055e+46 ener added: 2.415044041e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01609039307 Gravity::solve_for_phi() time = 0.1123986244 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.543114243e+44 ener added: 4.768138875e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.765646947e+35 ymom added: 1.797592414e+26 zmom added: 0 eint added: 0 ener added: 5.380039006e+43 Castro::do_new_sources() time = 0.07770061493 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.07237100601 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2995758057 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.317346246e+44 ener added: 3.120883219e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01589345932 Gravity::solve_for_phi() time = 0.1118626595 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.957879842e+46 ener added: 4.564181618e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.001437306e+36 ymom added: 1.471489396e+25 zmom added: 0 eint added: 0 ener added: 6.980886509e+46 Castro::do_new_sources() time = 0.07770299911 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.07326126099 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2947113514 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.012688492e+46 ener added: 2.110657671e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0169506073 Gravity::solve_for_phi() time = 0.1127374172 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.326633224e+44 ener added: 1.174460404e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.711471844e+35 ymom added: 1.66063198e+26 zmom added: 0 eint added: 0 ener added: 2.826321793e+43 Castro::do_new_sources() time = 0.07816386223 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.07208395004 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3006961346 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.090986835e+44 ener added: 2.655092076e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0163795948 Gravity::solve_for_phi() time = 0.1123044491 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.968859957e+46 ener added: 1.10301368e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.004822123e+36 ymom added: -8.771795742e+24 zmom added: 0 eint added: 0 ener added: 6.987657644e+46 Castro::do_new_sources() time = 0.07787823677 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.07338690758 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2948846817 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.025000527e+46 ener added: 2.183068315e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01722860336 Gravity::solve_for_phi() time = 0.1131470203 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.651474965e+44 ener added: 1.477761377e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.60533052e+35 ymom added: 1.690843319e+26 zmom added: 0 eint added: 0 ener added: -1.190247427e+43 Castro::do_new_sources() time = 0.07777309418 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.07223558426 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.300082922 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.213015184e+44 ener added: 2.894439872e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01685452461 Gravity::solve_for_phi() time = 0.1127226353 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.97482432e+46 ener added: 1.388215779e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.00305216e+36 ymom added: 1.271497176e+24 zmom added: 0 eint added: 0 ener added: 6.99302976e+46 Castro::do_new_sources() time = 0.07749557495 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.07257509232 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2995166779 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.046400343e+46 ener added: 2.16073557e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01688218117 Gravity::solve_for_phi() time = 0.1138830185 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.248919276e+44 ener added: 1.60656791e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.450686215e+35 ymom added: 1.697312961e+26 zmom added: 0 eint added: 0 ener added: -6.185767806e+43 Castro::do_new_sources() time = 0.07806062698 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.07289028168 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3090994358 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.824816589e+44 ener added: 2.945461224e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01666784286 Gravity::solve_for_phi() time = 0.1141238213 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.977981871e+46 ener added: 1.507699921e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.996348783e+36 ymom added: 3.069538214e+24 zmom added: 0 eint added: 0 ener added: 6.997250022e+46 Castro::do_new_sources() time = 0.07861280441 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.07269883156 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3010499477 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.067953295e+46 ener added: 2.185941597e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01730823517 Gravity::solve_for_phi() time = 0.1132798195 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.036038551e+44 ener added: 1.710131682e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.236317743e+35 ymom added: 1.665059198e+26 zmom added: 0 eint added: 0 ener added: -1.282743578e+44 Castro::do_new_sources() time = 0.07804298401 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.07281470299 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3002839088 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.23178587e+44 ener added: 2.927676839e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01710891724 Gravity::solve_for_phi() time = 0.1130628586 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.979285299e+46 ener added: 1.614875382e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.983606539e+36 ymom added: -1.663453594e+24 zmom added: 0 eint added: 0 ener added: 6.999733101e+46 Castro::do_new_sources() time = 0.07803797722 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.07297968864 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2953023911 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.076022112e+46 ener added: 2.369765675e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01784181595 Gravity::solve_for_phi() time = 0.113704443 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.768256697e+44 ener added: 1.742935385e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.789276502e+34 ymom added: 1.761383669e+26 zmom added: 0 eint added: 0 ener added: -1.824543748e+44 Castro::do_new_sources() time = 0.07770204544 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.07242441177 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.300886631 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.399341724e+44 ener added: 3.055404896e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0172829628 Gravity::solve_for_phi() time = 0.1134827137 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.981378524e+46 ener added: 1.65468052e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.966651828e+36 ymom added: 1.133367956e+23 zmom added: 0 eint added: 0 ener added: 7.003642946e+46 Castro::do_new_sources() time = 0.07779407501 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.07283711433 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.303442955 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.085134477e+46 ener added: 2.616682453e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01739501953 Gravity::solve_for_phi() time = 0.1145169735 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.966387031e+44 ener added: 1.764409733e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.086349894e+34 ymom added: 1.71437251e+26 zmom added: 0 eint added: 0 ener added: -1.814844154e+44 Castro::do_new_sources() time = 0.07809638977 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.0728058815 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3091433048 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.20798565e+44 ener added: 3.358777738e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01734280586 Gravity::solve_for_phi() time = 0.1142137051 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988653412e+46 ener added: 1.671056473e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.948364053e+36 ymom added: 7.142579305e+23 zmom added: 0 eint added: 0 ener added: 7.013022432e+46 Castro::do_new_sources() time = 0.07864880562 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002391974042 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.548275694e+29 ener added: 1.548275694e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -2.890848341e+38 TIME= 0.25 YMOM = 8.975065285e+27 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.505143013e+38 TIME= 0.25 RHO*e = 1.331449006e+50 TIME= 0.25 RHO*K = 3.171006988e+49 TIME= 0.25 RHO*E = 1.648549705e+50 TIME= 0.25 RHO*PHI = -5.460195609e+50 TIME= 0.25 TOTAL ENERGY= -1.0815481e+50 TIME= 0.25 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0.25 CENTER OF MASS X-VEL = -113366.7542 TIME= 0.25 CENTER OF MASS Y-LOC = -4.196397805e-29 TIME= 0.25 CENTER OF MASS Y-VEL = 3.519638182e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 [STEP 1] Coarse TimeStep time: 13.8139321 [STEP 1] FAB kilobyte spread across MPI nodes: [8620 ... 8620] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.05396404 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.006988704 seconds Ending run at 08:07:48 UTC on 2022-01-14. Run time = 16.28984523 Run time without initialization = 13.87754965 Average number of zones advanced per microsecond: 0.002 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 16.29 ... 16.29 ... 16.29 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.8355 5.9223 5.9892 36.77% Amr::InitAmr() 1 1.409 1.409 1.41 8.65% Castro::reset_internal_energy() 80 0.9398 1.007 1.188 7.30% Castro::computeTemp() 80 0.8986 1.002 1.164 7.15% FabArray::ParallelCopy_finish() 1583 0.2838 0.6378 0.8598 5.28% MultiFab::AddProduct() 3920 0.6947 0.7001 0.7049 4.33% Castro::normalize_species() 79 0.528 0.5319 0.5368 3.30% FabArray::setVal() 5502 0.5068 0.5108 0.5159 3.17% MLPoisson::Fsmooth() 6144 0.3169 0.342 0.4165 2.56% FabArray::ParallelCopy_nowait() 1583 0.3477 0.3701 0.3926 2.41% MultiFab::Subtract() 159 0.3742 0.3773 0.3808 2.34% Amr::defBaseLevel() 1 0.3705 0.3726 0.3767 2.31% Gravity::fill_multipole_BCs() 19 0.2162 0.2685 0.3018 1.85% Castro::enforce_min_density() 79 0.1981 0.2323 0.2946 1.81% MultiFab::sum() 3920 0.2698 0.2716 0.2741 1.68% Castro::do_advance_ctu() 20 0.1619 0.169 0.2215 1.36% MultiFab::Saxpy() 91 0.2063 0.2084 0.2107 1.29% FillBoundary_nowait() 6388 0.118 0.1469 0.1783 1.09% MultiFab::min() 23 0.00221 0.1089 0.1644 1.01% FillBoundary_finish() 6388 0.09776 0.1138 0.1389 0.85% MLCellLinOp::applyBC() 7156 0.08108 0.09843 0.1363 0.84% Castro::initData() 1 0.0038 0.0236 0.1324 0.81% MLPoisson::Fapply() 994 0.1122 0.1175 0.1291 0.79% Castro::derive() 156 0.1011 0.1049 0.1263 0.78% Castro::expand_state() 20 0.07128 0.07417 0.09713 0.60% Castro::construct_new_gravity_source() 17 0.09347 0.09426 0.09556 0.59% FabArray::FillBoundary() 6388 0.06791 0.0696 0.08265 0.51% Castro::create_source_corrector() 17 0.05435 0.05682 0.07362 0.45% Castro::construct_old_gravity_source() 20 0.07166 0.07232 0.07288 0.45% MultiFab::Xpay() 923 0.05792 0.06031 0.06646 0.41% MLCellLinOp::smooth() 3072 0.05439 0.0552 0.05637 0.35% Castro::do_new_sources() 17 0.0008575 0.011 0.05558 0.34% MLCGSolver::bicgstab 8 0 0.003403 0.05444 0.33% MultiFab::contains_nan() 37 0.05137 0.05175 0.05212 0.32% Castro::do_old_sources() 20 0.001022 0.01149 0.04984 0.31% StateData::FillBoundary(geom) 143 0 0.02512 0.04964 0.30% Castro::evaluate_source_change() 196 0.04791 0.04843 0.04905 0.30% Amr::writePlotFile() 2 0.01927 0.04482 0.04894 0.30% VisMF::Write(FabArray) 4 0.01312 0.01614 0.0477 0.29% MLMG::addInterpCorrection() 768 0.03556 0.03804 0.04499 0.28% amrex::average_down 768 0.0312 0.03323 0.03979 0.24% Castro::retry_advance_ctu() 11 0.02523 0.02634 0.03379 0.21% FabArrayBase::getFB() 6388 0.02404 0.02537 0.03135 0.19% Gravity::get_old_grav_vector() 20 0.02073 0.02128 0.02558 0.16% CGSolver::sxay() 203 0 0.001529 0.02447 0.15% MLCellLinOp::apply() 994 0.009721 0.01082 0.02403 0.15% FillPatchIterator::Initialize 301 0.02306 0.02329 0.02394 0.15% Gravity::get_new_grav_vector() 18 0.01874 0.01941 0.02274 0.14% MLCellLinOp::defineAuxData() 19 0.0186 0.0192 0.02088 0.13% Castro::construct_new_source() 102 0.01947 0.01966 0.01994 0.12% Castro::problem_post_timestep() 2 0.00484 0.01795 0.01991 0.12% MultiFab::LinComb() 203 0 0.001232 0.01972 0.12% FabArray::setDomainBndry() 301 0.001638 0.01044 0.01896 0.12% MLCGSolver::ParallelAllReduce 189 0 0.001168 0.01869 0.11% FabArray::ParallelCopy() 1583 0.01656 0.01687 0.01721 0.11% MLMG::oneIter() 128 0.01622 0.01636 0.01655 0.10% MLMG::ResNormInf() 146 0.01233 0.01409 0.01581 0.10% FabArrayBase::getCPC() 2005 0.01403 0.01429 0.01459 0.09% Castro::volWgtSum() 66 0.01078 0.01113 0.01427 0.09% Castro::construct_old_source() 120 0.01316 0.01328 0.01341 0.08% MultiFab::Dot() 142 0 0.0008074 0.01292 0.08% Amr::writeSmallPlotFile() 2 0.00777 0.01172 0.01228 0.08% Castro::wd_update() 2 0.004194 0.009324 0.01177 0.07% Castro::post_init() 1 0.0004755 0.009455 0.01042 0.06% MLCellLinOp::correctionResidual() 776 0.008082 0.008379 0.009676 0.06% MLMG::prepareForSolve() 18 0.008461 0.0086 0.008976 0.06% FabArray::mult() 59 0.007649 0.00782 0.008321 0.05% Gravity::actual_solve_with_mlmg() 19 0.007035 0.007283 0.007913 0.05% MLLinOp::makeSubCommunicator() 19 0.0002558 0.004007 0.007897 0.05% FabArrayBase::CPC::define() 576 0.003495 0.004811 0.007804 0.05% MLCellLinOp::compGrad() 18 0.00664 0.006711 0.006749 0.04% MLPoisson::normalize() 79 0 0.0004215 0.006744 0.04% MLMG::mgVcycle() 128 0.006331 0.006477 0.006653 0.04% MLMG::solve() 18 0.002386 0.004271 0.006428 0.04% MultiFab::max() 8 0.0005843 0.003916 0.006202 0.04% MLMG:computeResOfCorrection() 768 0.005429 0.005544 0.005672 0.03% Castro::initialize_do_advance() 20 0.004495 0.004575 0.004705 0.03% Castro::volInBoundary() 14 0.004078 0.004175 0.004497 0.03% BndryData::define() 19 0.003734 0.003793 0.003855 0.02% Castro::post_timestep() 1 0.0003028 0.003306 0.00368 0.02% Gravity::solve_for_phi() 17 0.002725 0.002938 0.003596 0.02% FillPatchSingleLevel 301 0.003306 0.003389 0.003464 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.002712 0.003044 0.003339 0.02% Castro::construct_new_gravity() 17 0.002487 0.002591 0.003092 0.02% MLMG::mgVcycle_down::0 128 0.002762 0.002856 0.002991 0.02% StateDataPhysBCFunct::() 301 0.00198 0.002546 0.002955 0.02% MLMG::mgVcycle_down::2 128 0.002626 0.002773 0.002928 0.02% MLMG::mgVcycle_down::3 128 0.002674 0.002742 0.002891 0.02% MLMG::actualBottomSolve() 128 0.0004338 0.0006111 0.002864 0.02% MLMG::mgVcycle_down::1 128 0.00262 0.002742 0.002854 0.02% MLMG::mgVcycle_down::4 128 0.002617 0.002693 0.002807 0.02% MLMG::mgVcycle_down::5 128 0.002655 0.002734 0.002806 0.02% MultiFab::Copy() 18 0.002164 0.002234 0.002724 0.02% Castro::locWgtSum() 12 0.001881 0.001942 0.002471 0.02% MLLinOp::defineGrids() 19 0.002005 0.00215 0.002383 0.01% MLMG::mgVcycle_up::3 128 0.001796 0.0019 0.002357 0.01% MLCellLinOp::prepareForSolve() 19 0.001871 0.001996 0.002333 0.01% TagBoxArray::collate() 2 0.0001256 0.000539 0.002299 0.01% MLMG::mgVcycle_up::2 128 0.001792 0.001898 0.002062 0.01% MLMG::mgVcycle_up::1 128 0.001795 0.001869 0.002038 0.01% MLMG::mgVcycle_up::0 128 0.001792 0.001869 0.00203 0.01% MLMG::mgVcycle_up::5 128 0.00175 0.001845 0.002013 0.01% MLMG::mgVcycle_up::4 128 0.001771 0.001845 0.001949 0.01% MLCellLinOp::defineBC() 19 0.001806 0.001847 0.001946 0.01% MLCellLinOp::solutionResidual() 147 0.001557 0.001628 0.001709 0.01% Castro::clean_state() 79 0.001498 0.001567 0.001626 0.01% StateData::define() 6 0.001521 0.001537 0.001553 0.01% FabArrayBase::FB::FB() 75 0.0004447 0.0008686 0.001536 0.01% MLMG::MLRhsNormInf() 18 0.001222 0.001253 0.001312 0.01% main() 1 0.0009766 0.001152 0.001222 0.01% Castro::volProductSum() 4 0.0008481 0.000888 0.001179 0.01% Castro::swap_state_time_levels() 8 0.0005567 0.001046 0.001134 0.01% makeSFC 95 0.0008907 0.000969 0.00111 0.01% Castro::subcycle_advance_ctu() 1 0.0004447 0.0005202 0.001053 0.01% MLMG::mgVcycle_bottom 128 0.000883 0.0009202 0.0009874 0.01% MLMG::computeResidual() 128 0.0008892 0.0009397 0.0009864 0.01% MLCellLinOp::setLevelBC() 19 0.0006136 0.000751 0.0009223 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0006705 0.0007242 0.0008008 0.00% Gravity::test_composite_phi() 1 0.0004282 0.0005051 0.0006254 0.00% AmrMesh::MakeNewGrids() 2 0.0005548 0.0005784 0.0006182 0.00% DistributionMapping::Distribute() 95 0.0004242 0.0004709 0.000549 0.00% Gravity::applyMetricTerms() 2 0.0005185 0.0005326 0.0005483 0.00% Gravity::update_max_rhs() 2 0.0004319 0.0004524 0.0005175 0.00% Gravity::solve_phi_with_mlmg() 19 0.0004475 0.0004685 0.0005076 0.00% Castro::enforce_consistent_e() 1 0.0004135 0.0004225 0.0004346 0.00% Castro::check_for_nan() 37 0.0003087 0.0003305 0.0003682 0.00% Castro::initialize_advance() 1 0.000259 0.0003281 0.0003559 0.00% MLPoisson::define() 19 0.0003182 0.0003333 0.0003525 0.00% Castro::enforce_speed_limit() 79 0.0002405 0.0003116 0.0003438 0.00% Castro::apply_source_to_state() 37 0.0002994 0.0003118 0.0003294 0.00% MLMG::compResidual() 1 0.0002686 0.0002759 0.0002901 0.00% MLLinOp::define() 19 0.0002504 0.000265 0.0002848 0.00% Castro::construct_old_gravity() 20 0.00021 0.0002202 0.0002595 0.00% Castro::finalize_do_advance() 17 0.0001877 0.0002018 0.0002278 0.00% Castro::apply_tagging_restrictions() 2 0.000159 0.0001754 0.0001998 0.00% MLPoisson::prepareForSolve() 19 0.0001537 0.0001679 0.0001934 0.00% Gravity::actual_multilevel_solve() 1 0.0001443 0.0001483 0.0001895 0.00% Castro::apply_problem_tags() 2 0.0001648 0.0001686 0.0001792 0.00% OwnerMask() 2 0.000151 0.0001692 0.0001772 0.00% MLMG::computeMLResidual() 18 0.0001303 0.0001435 0.0001647 0.00% Castro::construct_old_rotation_source() 20 0.0001302 0.0001407 0.0001609 0.00% TagBoxArray::mapPRD 2 0.0001375 0.0001423 0.00016 0.00% MLMG::getGradSolution() 18 0.000147 0.000152 0.0001548 0.00% Amr::coarseTimeStep() 1 0.0001226 0.0001477 0.0001517 0.00% MLMG::MLResNormInf() 18 0.0001227 0.000132 0.000148 0.00% Amr::grid_places() 2 0.0001094 0.0001183 0.0001332 0.00% Castro::construct_new_rotation_source() 17 0.0001075 0.0001158 0.0001217 0.00% Gravity::swapTimeLevels() 8 9.846e-05 0.0001016 0.0001049 0.00% MLMG::buildFineMask() 18 8.013e-05 9.193e-05 0.0001032 0.00% MultiFab::Swap() 5 8.438e-05 8.881e-05 9.817e-05 0.00% Castro::estTimeStep() 19 7.354e-05 7.761e-05 9.329e-05 0.00% Amr::FinalizeInit() 1 2e-05 3.497e-05 7.258e-05 0.00% knapsack() 1 6.075e-05 6.421e-05 7.008e-05 0.00% Amr::initSubcycle() 1 6.475e-05 6.667e-05 6.858e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.379e-05 5.607e-05 5.675e-05 0.00% AmrLevel::AmrLevel(dm) 1 4.721e-05 4.949e-05 5.238e-05 0.00% Castro::finalize_advance() 1 2.683e-05 3.153e-05 4.729e-05 0.00% Amr::regrid() 1 1.858e-05 2.239e-05 4.408e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.742e-05 3.467e-05 4.35e-05 0.00% BoxList::parallelComplementIn() 4 2.883e-05 3.008e-05 3.271e-05 0.00% DistributionMapping::KnapSackDoIt() 1 2.6e-05 2.867e-05 3.071e-05 0.00% Amr::init() 1 2.042e-05 2.178e-05 3.042e-05 0.00% Amr::bldFineLevels() 1 1.608e-05 1.805e-05 2.983e-05 0.00% Amr::timeStep() 1 2.067e-05 2.293e-05 2.575e-05 0.00% Castro::errorEst() 2 1.9e-05 2.208e-05 2.421e-05 0.00% Castro::post_regrid() 2 2.025e-05 2.16e-05 2.408e-05 0.00% Castro::advance() 1 1.65e-05 1.919e-05 2.225e-05 0.00% Amr::InitializeInit() 1 1.354e-05 1.483e-05 2.121e-05 0.00% Castro::computeInitialDt() 2 1.771e-05 2.006e-05 2.112e-05 0.00% BoxList::complementIn 4 1.525e-05 1.717e-05 1.858e-05 0.00% Amr::initialInit() 1 1.142e-05 1.247e-05 1.275e-05 0.00% Castro::gwstrain() 2 8.416e-06 1.063e-05 1.225e-05 0.00% Gravity::set_mass_offset() 2 8.334e-06 8.474e-06 9.25e-06 0.00% Castro::FluxRegFineAdd() 1 3.583e-06 4.594e-06 5e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 16.29 16.29 16.29 100.00% Amr::coarseTimeStep() 1 13.88 13.88 13.88 85.19% Amr::timeStep() 1 13.81 13.81 13.81 84.80% Castro::advance() 1 13.7 13.7 13.7 84.10% Castro::subcycle_advance_ctu() 1 13.64 13.64 13.64 83.75% Castro::do_advance_ctu() 20 13.58 13.59 13.59 83.45% Castro::construct_ctu_hydro_source() 20 5.836 5.922 5.989 36.77% Castro::clean_state() 79 3.982 4.132 4.323 26.54% Castro::computeTemp() 80 2.584 2.719 2.933 18.01% Gravity::solve_phi_with_mlmg() 19 1.968 2.024 2.062 12.66% Castro::construct_new_gravity() 17 1.868 1.921 1.958 12.02% Gravity::solve_for_phi() 17 1.826 1.881 1.919 11.78% Castro::reset_internal_energy() 80 1.648 1.717 1.895 11.63% Gravity::actual_solve_with_mlmg() 19 1.75 1.754 1.758 10.79% MLMG::solve() 18 1.687 1.691 1.692 10.39% MLMG::oneIter() 128 1.539 1.541 1.543 9.47% MLMG::mgVcycle() 128 1.523 1.525 1.527 9.37% Castro::do_old_sources() 20 1.347 1.393 1.464 8.99% Castro::initialize_do_advance() 20 1.375 1.403 1.447 8.88% Amr::InitAmr() 1 1.409 1.409 1.41 8.65% Castro::do_new_sources() 17 1.245 1.284 1.326 8.14% Castro::evaluate_source_change() 196 1.268 1.275 1.283 7.88% FabArray::ParallelCopy() 1583 0.6719 1.036 1.255 7.70% Amr::init() 1 1.002 1.002 1.002 6.15% Castro::enforce_min_density() 79 0.8978 0.934 0.9976 6.12% Amr::initialInit() 1 0.9281 0.9281 0.9282 5.70% MLCellLinOp::smooth() 3072 0.7188 0.7689 0.8995 5.52% FabArray::ParallelCopy_finish() 1583 0.2838 0.6378 0.8598 5.28% MultiFab::AddProduct() 3920 0.6947 0.7001 0.7049 4.33% FillPatchIterator::Initialize 301 0.4829 0.57 0.6545 4.02% FillPatchSingleLevel 301 0.4406 0.5362 0.6234 3.83% MLMG::mgVcycle_up::1 128 0.1142 0.3317 0.5965 3.66% Amr::InitializeInit() 1 0.4656 0.5111 0.5946 3.65% Amr::defBaseLevel() 1 0.4656 0.5111 0.5945 3.65% MLMG::addInterpCorrection() 768 0.1656 0.4514 0.5402 3.32% Castro::normalize_species() 79 0.528 0.5319 0.5368 3.30% FabArray::setVal() 5502 0.5068 0.5108 0.5159 3.17% MLCellLinOp::applyBC() 7156 0.4205 0.455 0.5113 3.14% Amr::FinalizeInit() 1 0.3336 0.417 0.4625 2.84% MLMG::mgVcycle_up::2 128 0.03159 0.1939 0.4498 2.76% MLPoisson::Fsmooth() 6144 0.3169 0.342 0.4165 2.56% FabArray::ParallelCopy_nowait() 1583 0.3583 0.3813 0.4047 2.48% FabArray::FillBoundary() 6388 0.3258 0.3566 0.3898 2.39% MultiFab::Subtract() 159 0.3742 0.3773 0.3808 2.34% MLMG::mgVcycle_up::3 128 0.03161 0.05407 0.351 2.15% Gravity::fill_multipole_BCs() 19 0.2162 0.2685 0.3018 1.85% MLMG::mgVcycle_down::0 128 0.289 0.2903 0.2919 1.79% MultiFab::sum() 3920 0.2698 0.2716 0.2741 1.68% MLCellLinOp::apply() 994 0.1972 0.2093 0.2711 1.66% MLMG::mgVcycle_up::5 128 0.03108 0.04596 0.2614 1.60% Castro::post_init() 1 0.2339 0.2373 0.2394 1.47% Castro::construct_new_source() 102 0.2303 0.2321 0.2338 1.44% Castro::expand_state() 20 0.1993 0.2067 0.2253 1.38% MLMG::mgVcycle_bottom 128 0.001333 0.01517 0.2219 1.36% MLMG::actualBottomSolve() 128 0.0004338 0.01424 0.221 1.36% MLCGSolver::bicgstab 8 0 0.01357 0.2172 1.33% Castro::initData() 1 0.08453 0.131 0.2165 1.33% MLMG::mgVcycle_up::0 128 0.2099 0.211 0.2117 1.30% MultiFab::Saxpy() 91 0.2063 0.2084 0.2107 1.29% FillBoundary_nowait() 6388 0.1432 0.1732 0.2059 1.26% amrex::average_down 768 0.05153 0.06692 0.1987 1.22% MLMG:computeResOfCorrection() 768 0.1623 0.1725 0.198 1.22% MLCellLinOp::correctionResidual() 776 0.1569 0.1676 0.1925 1.18% Castro::create_source_corrector() 17 0.1452 0.1621 0.1901 1.17% Castro::derive() 156 0.1539 0.1596 0.1895 1.16% MLMG::mgVcycle_down::5 128 0.03801 0.04835 0.1853 1.14% Amr::bldFineLevels() 1 0.04857 0.1329 0.178 1.09% MultiFab::min() 23 0.00221 0.1089 0.1644 1.01% Castro::construct_old_source() 120 0.1541 0.1554 0.1564 0.96% MLMG::mgVcycle_down::1 128 0.1415 0.1443 0.1471 0.90% FillBoundary_finish() 6388 0.09776 0.1138 0.1389 0.85% Amr::grid_places() 2 0.002467 0.08593 0.1314 0.81% AmrMesh::MakeNewGrids() 2 0.002334 0.08581 0.1313 0.81% Gravity::multilevel_solve_for_new_phi() 1 0.131 0.131 0.1311 0.80% Gravity::actual_multilevel_solve() 1 0.131 0.131 0.131 0.80% TagBoxArray::mapPRD 2 0.0007566 0.08411 0.13 0.80% MLPoisson::Fapply() 994 0.1122 0.1175 0.1291 0.79% Castro::construct_old_gravity() 20 0.04459 0.09731 0.1287 0.79% Gravity::get_old_grav_vector() 20 0.04436 0.09709 0.1285 0.79% Amr::writePlotFile() 2 0.1211 0.1211 0.1212 0.74% Castro::post_timestep() 1 0.1147 0.1168 0.1184 0.73% MLCellLinOp::solutionResidual() 147 0.1033 0.1078 0.1113 0.68% Castro::problem_post_timestep() 2 0.1016 0.1037 0.1058 0.65% MLMG::mgVcycle_down::2 128 0.03883 0.06705 0.09712 0.60% Castro::post_regrid() 2 0.0916 0.09372 0.09705 0.60% Castro::construct_new_gravity_source() 17 0.09347 0.09426 0.09556 0.59% MLMG::computeResidual() 128 0.09039 0.09095 0.09158 0.56% MLMG::mgVcycle_down::3 128 0.03847 0.04458 0.08755 0.54% Castro::apply_source_to_state() 37 0.08433 0.08515 0.08604 0.53% Castro::volWgtSum() 66 0.05974 0.06193 0.07797 0.48% Castro::construct_old_gravity_source() 20 0.07166 0.07232 0.07288 0.45% MultiFab::Xpay() 923 0.05792 0.06031 0.06646 0.41% MLMG::mgVcycle_down::4 128 0.03707 0.03924 0.06239 0.38% Castro::initialize_advance() 1 0.0547 0.05638 0.05745 0.35% Castro::retry_advance_ctu() 11 0.04666 0.04821 0.05546 0.34% StateDataPhysBCFunct::() 301 0.00198 0.02767 0.05248 0.32% Castro::check_for_nan() 37 0.05169 0.05208 0.05245 0.32% MultiFab::contains_nan() 37 0.05137 0.05175 0.05212 0.32% MLPoisson::define() 19 0.04004 0.04473 0.05056 0.31% Amr::regrid() 1 0.04672 0.04797 0.04983 0.31% StateData::FillBoundary(geom) 143 0 0.02512 0.04964 0.30% MLMG::mgVcycle_up::4 128 0.03132 0.03268 0.04843 0.30% VisMF::Write(FabArray) 4 0.01312 0.01614 0.0477 0.29% CGSolver::sxay() 203 0 0.002762 0.04419 0.27% Gravity::get_new_grav_vector() 18 0.03873 0.04004 0.04335 0.27% Castro::wd_update() 2 0.03615 0.03822 0.04035 0.25% FabArrayBase::getFB() 6388 0.02455 0.02624 0.03206 0.20% MLCellLinOp::defineAuxData() 19 0.02722 0.0287 0.03202 0.20% Castro::volInBoundary() 14 0.02324 0.02401 0.0269 0.17% MLCGSolver::ParallelAllReduce 189 0 0.001604 0.02566 0.16% MLMG::prepareForSolve() 18 0.02086 0.02166 0.02407 0.15% FabArrayBase::getCPC() 2005 0.01771 0.0191 0.022 0.14% MLMG::computeMLResidual() 18 0.01325 0.01709 0.02065 0.13% MultiFab::LinComb() 203 0 0.001232 0.01972 0.12% FabArray::setDomainBndry() 301 0.001638 0.01044 0.01896 0.12% Amr::writeSmallPlotFile() 2 0.01598 0.01599 0.01599 0.10% MLMG::ResNormInf() 146 0.01233 0.01409 0.01581 0.10% Gravity::test_composite_phi() 1 0.01546 0.01548 0.0155 0.10% MultiFab::Dot() 142 0 0.0008074 0.01292 0.08% MLLinOp::define() 19 0.004597 0.008586 0.0128 0.08% MLLinOp::defineGrids() 19 0.004344 0.008321 0.01254 0.08% MLMG::getGradSolution() 18 0.009016 0.009177 0.009365 0.06% MLCellLinOp::compGrad() 18 0.008867 0.009025 0.00921 0.06% FabArray::mult() 59 0.007649 0.00782 0.008321 0.05% MLLinOp::makeSubCommunicator() 19 0.0002558 0.004007 0.007897 0.05% FabArrayBase::CPC::define() 576 0.003495 0.004811 0.007804 0.05% Castro::locWgtSum() 12 0.005815 0.006011 0.007507 0.05% MLCellLinOp::defineBC() 19 0.006961 0.007114 0.007281 0.04% Gravity::update_max_rhs() 2 0.001556 0.004895 0.007021 0.04% MLPoisson::normalize() 79 0 0.0004215 0.006744 0.04% MultiFab::max() 8 0.0005843 0.003916 0.006202 0.04% BndryData::define() 19 0.005136 0.005267 0.005439 0.03% Castro::volProductSum() 4 0.003407 0.003567 0.004483 0.03% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.002712 0.003044 0.003339 0.02% MultiFab::Copy() 18 0.002164 0.002234 0.002724 0.02% MLPoisson::prepareForSolve() 19 0.002028 0.002164 0.002508 0.02% MLLinOp::makeAgglomeratedDMap 19 0.001989 0.002164 0.002427 0.01% MLCellLinOp::prepareForSolve() 19 0.001871 0.001996 0.002333 0.01% TagBoxArray::collate() 2 0.0001256 0.000539 0.002299 0.01% makeSFC 95 0.001315 0.00144 0.001628 0.01% AmrLevel::AmrLevel(dm) 1 0.001568 0.001586 0.001606 0.01% StateData::define() 6 0.001521 0.001537 0.001553 0.01% FabArrayBase::FB::FB() 75 0.0004447 0.0008686 0.001536 0.01% MLMG::MLResNormInf() 18 0.001345 0.001369 0.001421 0.01% Gravity::swapTimeLevels() 8 0.001334 0.001374 0.001418 0.01% MLMG::compResidual() 1 0.001084 0.001217 0.001356 0.01% MLMG::MLRhsNormInf() 18 0.001222 0.001253 0.001312 0.01% Castro::swap_state_time_levels() 8 0.0005567 0.001046 0.001134 0.01% MLCellLinOp::setLevelBC() 19 0.0006136 0.000751 0.0009223 0.01% DistributionMapping::Distribute() 95 0.0004242 0.0004709 0.000549 0.00% Gravity::applyMetricTerms() 2 0.0005185 0.0005326 0.0005483 0.00% Castro::enforce_consistent_e() 1 0.0004135 0.0004225 0.0004346 0.00% Castro::errorEst() 2 0.000346 0.000366 0.0003883 0.00% Castro::enforce_speed_limit() 79 0.0002405 0.0003116 0.0003438 0.00% Castro::finalize_do_advance() 17 0.0001877 0.0002018 0.0002278 0.00% Castro::apply_tagging_restrictions() 2 0.000159 0.0001754 0.0001998 0.00% Castro::apply_problem_tags() 2 0.0001648 0.0001686 0.0001792 0.00% OwnerMask() 2 0.000151 0.0001692 0.0001772 0.00% Castro::construct_old_rotation_source() 20 0.0001302 0.0001407 0.0001609 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001088 0.0001276 0.0001413 0.00% Castro::construct_new_rotation_source() 17 0.0001075 0.0001158 0.0001217 0.00% MLMG::buildFineMask() 18 8.013e-05 9.193e-05 0.0001032 0.00% MultiFab::Swap() 5 8.438e-05 8.881e-05 9.817e-05 0.00% Castro::estTimeStep() 19 7.354e-05 7.761e-05 9.329e-05 0.00% knapsack() 1 6.075e-05 6.421e-05 7.008e-05 0.00% Amr::initSubcycle() 1 6.475e-05 6.667e-05 6.858e-05 0.00% Castro::finalize_advance() 1 3.121e-05 3.612e-05 5.196e-05 0.00% BoxList::parallelComplementIn() 4 4.463e-05 4.725e-05 5.063e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.742e-05 3.467e-05 4.35e-05 0.00% Castro::computeInitialDt() 2 2.567e-05 2.831e-05 2.933e-05 0.00% BoxList::complementIn 4 1.525e-05 1.717e-05 1.858e-05 0.00% Castro::gwstrain() 2 8.416e-06 1.063e-05 1.225e-05 0.00% Gravity::set_mass_offset() 2 8.334e-06 8.474e-06 9.25e-06 0.00% Castro::FluxRegFineAdd() 1 3.583e-06 4.594e-06 5e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 2) :: [0.0e0, 0.0e0] [TOP]::castro.dtnuc_mode(nvals = 1) :: [1] [TOP]::integrator.do_constant_volume_burn(nvals = 1) :: [1] [TOP]::mg.v(nvals = 1) :: [0] AMReX (22.01-26-g65f906216a5e) finalized