MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.03-33-g9907ac197518) initialized Starting run at 07:21:26 UTC on 2022-03-29. Successfully read inputs file ... Castro git describe: 22.02-19-ga92ac477d AMReX git describe: 22.03-33-g9907ac197 Microphysics git describe: 22.03-13-gf58972c7 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 castro.use_stopping_criterion = 1 castro.dtnuc_mode = 1 Warning: the following integrator.* parameters are ignored integrator.do_constant_volume_burn = 1 integrator.retry_burn = 1 Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.154883618 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000897825 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.01048725 Gravity::fill_multipole_BCs() time = 0.010585507 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -2.5098073e-31 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.047433599 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.006515172 seconds [Level 0 step 1] ADVANCE with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.061984132 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.232181367 Advance was unsuccessful with reason: negative density (density = -9.081732e+02 at index (14,70); started at 4.477055e+03); proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.061000085 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.22956778 Advance was unsuccessful with reason: negative density (density = -1.592544e+00 at index (20,79); started at 2.790161e+00); proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.057566878 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.229508615 Advance was unsuccessful with reason: negative density (density = -1.060745e-01 at index (20,78); started at 2.068339e-01); proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.055106027 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.229938404 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01593607 Gravity::solve_for_phi() time = 0.084292283 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.0589439 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.055143217 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.229217791 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014701826 Gravity::solve_for_phi() time = 0.08289958 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.060086433 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.055562662 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.234350896 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014925973 Gravity::solve_for_phi() time = 0.083096384 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.060160722 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.055476037 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.234735323 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.997068055e+46 ener added: 2.415044041e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015787121 Gravity::solve_for_phi() time = 0.087126532 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.543114243e+44 ener added: 4.768138875e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.765646947e+35 ymom added: 1.797592414e+26 zmom added: 0 eint added: 0 ener added: 5.380039006e+43 Castro::do_new_sources() time = 0.058630996 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.054981563 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.240523756 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.317346246e+44 ener added: 3.120883219e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014989185 Gravity::solve_for_phi() time = 0.083301434 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.957879842e+46 ener added: 4.564181618e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.001437306e+36 ymom added: 1.471489396e+25 zmom added: 0 eint added: 0 ener added: 6.980886509e+46 Castro::do_new_sources() time = 0.059909381 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.05542692 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.234842897 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.012688492e+46 ener added: 2.110657671e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015186605 Gravity::solve_for_phi() time = 0.083254166 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.326633224e+44 ener added: 1.174460404e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.711471844e+35 ymom added: 1.66063198e+26 zmom added: 0 eint added: 0 ener added: 2.826321793e+43 Castro::do_new_sources() time = 0.059012853 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.055114587 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.27165475 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.090986835e+44 ener added: 2.655092076e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015153448 Gravity::solve_for_phi() time = 0.086060251 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.968859957e+46 ener added: 1.10301368e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.004822123e+36 ymom added: -8.771795742e+24 zmom added: 0 eint added: 0 ener added: 6.987657644e+46 Castro::do_new_sources() time = 0.059785762 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.055318327 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.235310571 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.025000527e+46 ener added: 2.183068315e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015818551 Gravity::solve_for_phi() time = 0.087550551 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.651474965e+44 ener added: 1.477761377e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.60533052e+35 ymom added: 1.690843319e+26 zmom added: 0 eint added: 0 ener added: -1.190247427e+43 Castro::do_new_sources() time = 0.059407269 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.055249536 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.240188986 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.213015184e+44 ener added: 2.894439872e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015121105 Gravity::solve_for_phi() time = 0.083502483 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.97482432e+46 ener added: 1.388215779e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.00305216e+36 ymom added: 1.271497176e+24 zmom added: 0 eint added: 0 ener added: 6.99302976e+46 Castro::do_new_sources() time = 0.05993807 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.055563394 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.235701701 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.046400343e+46 ener added: 2.16073557e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015616042 Gravity::solve_for_phi() time = 0.083784364 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.248919276e+44 ener added: 1.60656791e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.450686215e+35 ymom added: 1.697312961e+26 zmom added: 0 eint added: 0 ener added: -6.185767806e+43 Castro::do_new_sources() time = 0.058772099 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.054996722 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.24022725 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.824816589e+44 ener added: 2.945461224e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014862316 Gravity::solve_for_phi() time = 0.083277374 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.977981871e+46 ener added: 1.507699921e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.996348783e+36 ymom added: 3.069538214e+24 zmom added: 0 eint added: 0 ener added: 6.997250022e+46 Castro::do_new_sources() time = 0.05999038 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.055421655 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.235524159 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.067953295e+46 ener added: 2.185941597e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01604653 Gravity::solve_for_phi() time = 0.083829472 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.036038551e+44 ener added: 1.710131682e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.236317743e+35 ymom added: 1.665059198e+26 zmom added: 0 eint added: 0 ener added: -1.282743578e+44 Castro::do_new_sources() time = 0.059140163 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.054989904 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.239413045 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.23178587e+44 ener added: 2.927676839e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015621236 Gravity::solve_for_phi() time = 0.083677218 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.979285299e+46 ener added: 1.614875382e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.983606539e+36 ymom added: -1.663453594e+24 zmom added: 0 eint added: 0 ener added: 6.999733101e+46 Castro::do_new_sources() time = 0.059800252 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.055744251 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.235993383 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.076022112e+46 ener added: 2.369765675e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015993964 Gravity::solve_for_phi() time = 0.083999086 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.768256697e+44 ener added: 1.742935385e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.789276502e+34 ymom added: 1.761383669e+26 zmom added: 0 eint added: 0 ener added: -1.824543748e+44 Castro::do_new_sources() time = 0.059143569 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.055105135 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.239971126 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.399341724e+44 ener added: 3.055404896e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015750091 Gravity::solve_for_phi() time = 0.086733014 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.981378524e+46 ener added: 1.65468052e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.966651828e+36 ymom added: 1.133367956e+23 zmom added: 0 eint added: 0 ener added: 7.003642946e+46 Castro::do_new_sources() time = 0.060103315 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.055671449 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.235844412 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.085134477e+46 ener added: 2.616682453e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01513281 Gravity::solve_for_phi() time = 0.083219367 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.966387031e+44 ener added: 1.764409733e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.086349894e+34 ymom added: 1.71437251e+26 zmom added: 0 eint added: 0 ener added: -1.814844154e+44 Castro::do_new_sources() time = 0.059227216 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.055873532 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.27080462 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.20798565e+44 ener added: 3.358777738e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.019571385 Gravity::solve_for_phi() time = 0.088135878 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988653412e+46 ener added: 1.671056473e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.948364053e+36 ymom added: 7.142579305e+23 zmom added: 0 eint added: 0 ener added: 7.013022432e+46 Castro::do_new_sources() time = 0.060547369 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.003015494884 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.548275694e+29 ener added: 1.548275694e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -2.890848341e+38 TIME= 0.25 YMOM = 8.975065285e+27 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.505143013e+38 TIME= 0.25 RHO*e = 1.331449006e+50 TIME= 0.25 RHO*K = 3.171006988e+49 TIME= 0.25 RHO*E = 1.648549705e+50 TIME= 0.25 RHO*PHI = -5.460195609e+50 TIME= 0.25 TOTAL ENERGY= -1.0815481e+50 TIME= 0.25 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0.25 CENTER OF MASS X-VEL = -113366.7542 TIME= 0.25 CENTER OF MASS Y-LOC = -4.196397805e-29 TIME= 0.25 CENTER OF MASS Y-VEL = 3.519638182e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 [STEP 1] Coarse TimeStep time: 10.96251608 [STEP 1] FAB kilobyte spread across MPI nodes: [7068 ... 7068] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.04722533 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.006736568 seconds Ending run at 07:21:40 UTC on 2022-03-29. Run time = 13.23721496 Run time without initialization = 11.01987067 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 13.24 ... 13.24 ... 13.24 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 4.5406 4.6789 4.7744 36.07% Amr::InitAmr() 1 1.312 1.312 1.312 9.91% Castro::computeTemp() 80 0.8797 0.974 1.124 8.49% Castro::reset_internal_energy() 80 0.8771 0.9377 1.089 8.23% FabArray::ParallelCopy_finish() 1583 0.1302 0.4626 0.7168 5.42% MultiFab::AddProduct() 3439 0.5508 0.5599 0.5687 4.30% Castro::normalize_species() 79 0.4687 0.4798 0.5046 3.81% Amr::defBaseLevel() 1 0.3544 0.3624 0.3712 2.80% FabArray::setVal() 5021 0.3519 0.3583 0.366 2.76% MLPoisson::Fsmooth() 6144 0.2721 0.2961 0.358 2.70% MultiFab::Subtract() 159 0.3414 0.3468 0.3521 2.66% Gravity::fill_multipole_BCs() 19 0.2029 0.2542 0.2821 2.13% FabArray::ParallelCopy_nowait() 1583 0.2246 0.2419 0.2635 1.99% MultiFab::min() 23 0.002035 0.1091 0.2549 1.93% Castro::enforce_min_density() 79 0.1846 0.2016 0.2367 1.79% MultiFab::sum() 3439 0.1826 0.1858 0.1888 1.43% FillBoundary_nowait() 6388 0.07965 0.1082 0.1406 1.06% FillBoundary_finish() 6388 0.08751 0.1096 0.135 1.02% Castro::initData() 1 0.003425 0.02354 0.135 1.02% Castro::do_advance_ctu() 20 0.1117 0.1137 0.1156 0.87% MLPoisson::Fapply() 994 0.09403 0.1003 0.1121 0.85% Castro::derive() 156 0.09486 0.09687 0.09993 0.75% MLCellLinOp::applyBC() 7156 0.04641 0.06114 0.09778 0.74% Castro::construct_new_gravity_source() 17 0.06834 0.0699 0.07192 0.54% MultiFab::Saxpy() 91 0.06873 0.06987 0.07113 0.54% Castro::expand_state() 20 0.066 0.06726 0.06837 0.52% MultiFab::Xpay() 923 0.0521 0.05507 0.05971 0.45% Castro::do_old_sources() 20 0.0002769 0.01261 0.05358 0.40% MLMG::addInterpCorrection() 768 0.03388 0.03711 0.04577 0.35% Castro::construct_old_gravity_source() 20 0.04372 0.04453 0.04575 0.35% MultiFab::contains_nan() 37 0.0441 0.04489 0.04554 0.34% Castro::do_new_sources() 17 0.0002368 0.01027 0.04538 0.34% amrex::average_down 768 0.02529 0.02757 0.0347 0.26% StateData::FillBoundary(geom) 143 0 0.01706 0.03243 0.24% Amr::writePlotFile() 2 0.01755 0.0269 0.02915 0.22% VisMF::Write(FabArray) 4 0.01262 0.01417 0.02776 0.21% MLCGSolver::bicgstab 8 0 0.001496 0.02394 0.18% Castro::retry_advance_ctu() 11 0.01923 0.01961 0.02005 0.15% Gravity::get_old_grav_vector() 20 0.01871 0.01906 0.0194 0.15% Castro::create_source_corrector() 17 0.01797 0.01841 0.01876 0.14% MLCellLinOp::defineAuxData() 19 0.01505 0.01563 0.01862 0.14% MLMG::ResNormInf() 146 0.01165 0.01654 0.01843 0.14% Gravity::get_new_grav_vector() 18 0.01723 0.01749 0.01768 0.13% FillPatchIterator::Initialize 301 0.0163 0.01665 0.01701 0.13% Castro::construct_new_source() 102 0.01544 0.01576 0.01618 0.12% FabArray::FillBoundary() 6388 0.01316 0.01373 0.01605 0.12% MLMG::oneIter() 128 0.01439 0.01464 0.01486 0.11% MLCellLinOp::smooth() 3072 0.011 0.01156 0.01374 0.10% Castro::evaluate_source_change() 196 0.01232 0.01277 0.01318 0.10% FabArray::setDomainBndry() 301 0.000806 0.006647 0.01226 0.09% FabArrayBase::getFB() 6388 0.009529 0.01008 0.01219 0.09% Amr::writeSmallPlotFile() 2 0.006921 0.01068 0.01113 0.08% Castro::wd_update() 2 0.004011 0.007664 0.01055 0.08% Castro::volWgtSum() 66 0.01 0.01012 0.01024 0.08% Castro::construct_old_source() 120 0.009754 0.009933 0.01015 0.08% MultiFab::LinComb() 203 0 0.0006146 0.009834 0.07% MLMG::solve() 18 0.001049 0.004441 0.008587 0.06% Gravity::actual_solve_with_mlmg() 19 0.006814 0.007194 0.008429 0.06% TagBoxArray::collate() 2 0.0001003 0.001522 0.008047 0.06% MLLinOp::makeSubCommunicator() 19 0.000338 0.004109 0.007924 0.06% FabArrayBase::getCPC() 2005 0.006843 0.007029 0.00772 0.06% MLMG::prepareForSolve() 18 0.006554 0.006809 0.007657 0.06% FabArray::mult() 59 0.00696 0.007096 0.007259 0.05% MLCGSolver::ParallelAllReduce 189 0 0.0004257 0.006811 0.05% FabArrayBase::CPC::define() 576 0.00217 0.003374 0.006389 0.05% MultiFab::Dot() 142 0 0.0003807 0.006092 0.05% MLCellLinOp::compGrad() 18 0.005782 0.005909 0.006009 0.05% CGSolver::sxay() 203 0 0.000368 0.005889 0.04% MLCellLinOp::apply() 994 0.002083 0.002343 0.005224 0.04% Castro::initialize_do_advance() 20 0.004236 0.004406 0.004571 0.03% FabArray::ParallelCopy() 1583 0.003764 0.003939 0.004395 0.03% MultiFab::max() 8 0.0004927 0.001619 0.004097 0.03% Castro::volInBoundary() 14 0.003555 0.003667 0.004054 0.03% BndryData::define() 19 0.00312 0.003194 0.003333 0.03% Gravity::solve_for_phi() 17 0.00244 0.00267 0.003216 0.02% MLPoisson::normalize() 79 0 0.0001896 0.003033 0.02% main() 1 0.001073 0.00138 0.002471 0.02% Castro::construct_new_gravity() 17 0.00222 0.00227 0.002442 0.02% MLCellLinOp::correctionResidual() 776 0.001863 0.001951 0.002316 0.02% MLCellLinOp::prepareForSolve() 19 0.001686 0.001864 0.00231 0.02% MLLinOp::defineGrids() 19 0.001768 0.001884 0.002143 0.02% MultiFab::Copy() 18 0.002 0.002035 0.002064 0.02% MLMG::mgVcycle() 128 0.001578 0.001681 0.00191 0.01% Castro::locWgtSum() 12 0.001827 0.001861 0.001894 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001252 0.001553 0.001837 0.01% MLCellLinOp::defineBC() 19 0.001625 0.001681 0.001828 0.01% Castro::problem_post_timestep() 2 0.0004415 0.0009719 0.001631 0.01% MLMG:computeResOfCorrection() 768 0.001425 0.001487 0.001603 0.01% StateDataPhysBCFunct::() 301 0.001086 0.001232 0.001397 0.01% FabArrayBase::FB::FB() 75 0.0002783 0.0006983 0.001375 0.01% MLMG::actualBottomSolve() 128 0.0001422 0.0002219 0.001263 0.01% MLMG::mgVcycle_down::2 128 0.0006665 0.0007612 0.001224 0.01% StateData::define() 6 0.001145 0.00116 0.001185 0.01% MLMG::MLRhsNormInf() 18 0.001088 0.001116 0.001164 0.01% Castro::post_init() 1 0.0003026 0.0005926 0.0009103 0.01% FillPatchSingleLevel 301 0.0008308 0.000854 0.0008724 0.01% MLCellLinOp::setLevelBC() 19 0.0005715 0.0006862 0.0008612 0.01% MLMG::mgVcycle_down::3 128 0.000597 0.0006567 0.0008192 0.01% Castro::volProductSum() 4 0.0007734 0.0007867 0.000803 0.01% MLMG::mgVcycle_down::4 128 0.0005931 0.000624 0.0008002 0.01% Castro::subcycle_advance_ctu() 1 0.0002993 0.0003593 0.0007925 0.01% MLMG::mgVcycle_down::0 128 0.0007169 0.0007327 0.0007771 0.01% MLMG::mgVcycle_down::1 128 0.0006892 0.0007165 0.0007739 0.01% MLMG::mgVcycle_down::5 128 0.0005823 0.0006095 0.0007429 0.01% Gravity::test_composite_phi() 1 0.0003908 0.0005291 0.0007424 0.01% Castro::post_timestep() 1 0.0002625 0.0005985 0.0006596 0.00% Castro::swap_state_time_levels() 8 0.0004117 0.0006205 0.0006477 0.00% MLMG::mgVcycle_up::1 128 0.0004937 0.0005236 0.0005789 0.00% MLMG::mgVcycle_up::0 128 0.0004991 0.0005222 0.0005679 0.00% MLMG::mgVcycle_up::3 128 0.0004207 0.000445 0.0005573 0.00% AmrMesh::MakeNewGrids() 2 0.0004821 0.0005062 0.0005567 0.00% MLMG::mgVcycle_up::2 128 0.0004156 0.0004686 0.000556 0.00% Castro::enforce_consistent_e() 1 0.000368 0.0003925 0.0005482 0.00% MLMG::mgVcycle_up::5 128 0.0004365 0.0004576 0.0005369 0.00% MLMG::mgVcycle_up::4 128 0.0004185 0.0004354 0.0005302 0.00% makeSFC 95 0.0003993 0.0004316 0.000511 0.00% Castro::clean_state() 79 0.0004022 0.0004265 0.0004918 0.00% Gravity::applyMetricTerms() 2 0.0004646 0.000476 0.0004862 0.00% MLCellLinOp::solutionResidual() 147 0.0004326 0.0004433 0.0004522 0.00% Gravity::update_max_rhs() 2 0.0003849 0.0004029 0.000419 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003737 0.0003852 0.0004099 0.00% DistributionMapping::Distribute() 95 0.0002247 0.0002406 0.0003829 0.00% Gravity::solve_phi_with_mlmg() 19 0.000238 0.0002636 0.0003262 0.00% MLMG::mgVcycle_bottom 128 0.0002242 0.0002368 0.0002874 0.00% MLMG::computeResidual() 128 0.0002595 0.0002695 0.0002786 0.00% MLMG::compResidual() 1 0.0002478 0.0002547 0.0002599 0.00% OwnerMask() 2 0.0001372 0.0001707 0.0002222 0.00% MLLinOp::define() 19 0.0001444 0.0001652 0.0001942 0.00% Castro::finalize_do_advance() 17 0.0001431 0.0001542 0.0001868 0.00% Castro::apply_tagging_restrictions() 2 0.0001327 0.0001509 0.0001815 0.00% Castro::apply_problem_tags() 2 0.0001596 0.0001654 0.0001754 0.00% MLPoisson::define() 19 0.0001181 0.000129 0.00017 0.00% Amr::grid_places() 2 8.209e-05 0.0001068 0.0001498 0.00% Gravity::actual_multilevel_solve() 1 0.0001326 0.000137 0.0001433 0.00% Amr::coarseTimeStep() 1 0.0001138 0.0001392 0.0001428 0.00% TagBoxArray::mapPRD 2 0.000113 0.0001212 0.0001356 0.00% Castro::check_for_nan() 37 0.0001067 0.0001143 0.0001286 0.00% Castro::enforce_speed_limit() 79 0.0001056 0.0001113 0.0001178 0.00% Castro::initialize_advance() 1 9.695e-05 0.0001011 0.0001059 0.00% Castro::apply_source_to_state() 37 8.564e-05 9.189e-05 0.000103 0.00% Castro::construct_old_gravity() 20 8.512e-05 9.071e-05 9.515e-05 0.00% MLPoisson::prepareForSolve() 19 7.272e-05 7.817e-05 8.417e-05 0.00% MultiFab::Swap() 5 7.197e-05 7.468e-05 7.985e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 4.903e-05 5.247e-05 7.784e-05 0.00% Castro::estTimeStep() 19 2.8e-05 3.151e-05 6.435e-05 0.00% knapsack() 1 5.826e-05 6.084e-05 6.283e-05 0.00% Amr::initSubcycle() 1 5.641e-05 5.866e-05 5.94e-05 0.00% Gravity::swapTimeLevels() 8 3.328e-05 3.646e-05 5.672e-05 0.00% MLMG::computeMLResidual() 18 4.252e-05 4.656e-05 4.995e-05 0.00% MLMG::buildFineMask() 18 4.232e-05 4.518e-05 4.764e-05 0.00% MLMG::getGradSolution() 18 4.083e-05 4.296e-05 4.531e-05 0.00% Amr::FinalizeInit() 1 8.351e-06 1.744e-05 4.379e-05 0.00% MLMG::MLResNormInf() 18 3.378e-05 3.59e-05 3.93e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.7e-05 2.822e-05 3.914e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.147e-05 3.377e-05 3.844e-05 0.00% Amr::regrid() 1 1.178e-05 1.808e-05 3.75e-05 0.00% Castro::finalize_advance() 1 1.886e-05 2.297e-05 3.723e-05 0.00% Castro::construct_old_rotation_source() 20 2.932e-05 3.035e-05 3.128e-05 0.00% Castro::construct_new_rotation_source() 17 2.188e-05 2.291e-05 2.423e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.673e-05 1.821e-05 1.945e-05 0.00% Amr::timeStep() 1 1.155e-05 1.364e-05 1.831e-05 0.00% Gravity::set_mass_offset() 2 4.344e-06 6.943e-06 1.631e-05 0.00% Amr::InitializeInit() 1 6.456e-06 7.607e-06 1.449e-05 0.00% Castro::post_regrid() 2 1.081e-05 1.162e-05 1.365e-05 0.00% Amr::init() 1 7.575e-06 8.359e-06 9.425e-06 0.00% BoxList::parallelComplementIn() 4 7.098e-06 7.722e-06 9.357e-06 0.00% Amr::initialInit() 1 2.939e-06 4.401e-06 9.061e-06 0.00% Amr::bldFineLevels() 1 7.355e-06 7.857e-06 8.448e-06 0.00% Castro::computeInitialDt() 2 6.666e-06 7.04e-06 7.592e-06 0.00% BoxList::complementIn 4 6.048e-06 6.556e-06 7.274e-06 0.00% Castro::advance() 1 6.265e-06 6.715e-06 7.244e-06 0.00% Castro::gwstrain() 2 4.504e-06 4.933e-06 6.609e-06 0.00% Castro::errorEst() 2 5.878e-06 6.168e-06 6.484e-06 0.00% Castro::FluxRegFineAdd() 1 1.701e-06 1.929e-06 2.338e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 13.24 13.24 13.24 100.00% Amr::coarseTimeStep() 1 11.02 11.02 11.02 83.24% Amr::timeStep() 1 10.96 10.96 10.96 82.82% Castro::advance() 1 10.86 10.86 10.87 82.09% Castro::subcycle_advance_ctu() 1 10.81 10.82 10.82 81.72% Castro::do_advance_ctu() 20 10.77 10.78 10.78 81.43% Castro::construct_ctu_hydro_source() 20 4.541 4.679 4.774 36.07% Castro::clean_state() 79 3.639 3.773 3.899 29.45% Castro::computeTemp() 80 2.402 2.533 2.727 20.60% Castro::reset_internal_energy() 80 1.489 1.559 1.701 12.85% Gravity::solve_phi_with_mlmg() 19 1.46 1.512 1.541 11.64% Castro::construct_new_gravity() 17 1.388 1.439 1.468 11.09% Gravity::solve_for_phi() 17 1.352 1.404 1.433 10.82% Amr::InitAmr() 1 1.312 1.312 1.312 9.91% Castro::initialize_do_advance() 20 1.246 1.275 1.288 9.73% Gravity::actual_solve_with_mlmg() 19 1.252 1.256 1.261 9.52% MLMG::solve() 18 1.201 1.206 1.207 9.12% Castro::do_old_sources() 20 1.027 1.082 1.117 8.44% MLMG::oneIter() 128 1.071 1.072 1.075 8.12% MLMG::mgVcycle() 128 1.056 1.058 1.06 8.01% Castro::do_new_sources() 17 0.935 0.9823 1.012 7.65% Castro::evaluate_source_change() 196 0.9456 0.9613 0.9763 7.38% FabArray::ParallelCopy() 1583 0.381 0.7146 0.9672 7.31% Amr::init() 1 0.9043 0.9044 0.9044 6.83% Amr::initialInit() 1 0.8481 0.8481 0.8482 6.41% Castro::enforce_min_density() 79 0.7896 0.8154 0.8409 6.35% FabArray::ParallelCopy_finish() 1583 0.1302 0.4626 0.7168 5.42% MLCellLinOp::smooth() 3072 0.5025 0.5524 0.6752 5.10% Amr::InitializeInit() 1 0.4377 0.496 0.5909 4.46% Amr::defBaseLevel() 1 0.4377 0.496 0.5909 4.46% MultiFab::AddProduct() 3439 0.5508 0.5599 0.5687 4.30% Castro::normalize_species() 79 0.4687 0.4798 0.5046 3.81% FillPatchIterator::Initialize 301 0.3158 0.3726 0.4954 3.74% FillPatchSingleLevel 301 0.2867 0.3493 0.4742 3.58% MLMG::mgVcycle_up::1 128 0.08882 0.2428 0.4265 3.22% Amr::FinalizeInit() 1 0.2572 0.3521 0.4104 3.10% MLMG::addInterpCorrection() 768 0.1516 0.3059 0.382 2.89% FabArray::setVal() 5021 0.3519 0.3583 0.366 2.76% MLCellLinOp::applyBC() 7156 0.2679 0.3035 0.3637 2.75% MLPoisson::Fsmooth() 6144 0.2721 0.2961 0.358 2.70% MultiFab::Subtract() 159 0.3414 0.3468 0.3521 2.66% MLMG::mgVcycle_up::2 128 0.009632 0.119 0.2875 2.17% Gravity::fill_multipole_BCs() 19 0.2029 0.2542 0.2821 2.13% FabArray::ParallelCopy_nowait() 1583 0.23 0.248 0.2706 2.04% FabArray::FillBoundary() 6388 0.2156 0.2423 0.2705 2.04% MultiFab::min() 23 0.002035 0.1091 0.2549 1.93% MLMG::mgVcycle_down::0 128 0.2452 0.2472 0.2543 1.92% Castro::initData() 1 0.07659 0.1279 0.2305 1.74% Castro::expand_state() 20 0.1767 0.1841 0.2106 1.59% Amr::bldFineLevels() 1 0.04481 0.1405 0.1977 1.49% MLMG::mgVcycle_up::3 128 0.009598 0.02343 0.1933 1.46% MultiFab::sum() 3439 0.1826 0.1858 0.1888 1.43% MLMG::mgVcycle_up::0 128 0.1832 0.1842 0.1847 1.40% MLCellLinOp::apply() 994 0.1476 0.1595 0.1766 1.33% amrex::average_down 768 0.03341 0.04863 0.1749 1.32% Castro::post_init() 1 0.1675 0.1686 0.171 1.29% Amr::grid_places() 2 0.002614 0.09748 0.1558 1.18% AmrMesh::MakeNewGrids() 2 0.002482 0.09737 0.1557 1.18% TagBoxArray::mapPRD 2 0.0006435 0.09486 0.1537 1.16% MLMG::mgVcycle_down::5 128 0.0116 0.02145 0.1526 1.15% FillBoundary_nowait() 6388 0.08945 0.119 0.152 1.15% MLMG:computeResOfCorrection() 768 0.1129 0.1231 0.1462 1.10% Castro::derive() 156 0.1386 0.1413 0.1448 1.09% MLCellLinOp::correctionResidual() 776 0.1115 0.1219 0.1446 1.09% FillBoundary_finish() 6388 0.08751 0.1096 0.135 1.02% Castro::construct_new_source() 102 0.123 0.1255 0.1283 0.97% MLMG::mgVcycle_down::1 128 0.1075 0.1149 0.1184 0.89% MLPoisson::Fapply() 994 0.09403 0.1003 0.1121 0.85% Castro::create_source_corrector() 17 0.04739 0.06748 0.1074 0.81% MLMG::mgVcycle_up::5 128 0.009636 0.01602 0.1062 0.80% MLCellLinOp::solutionResidual() 147 0.08681 0.0936 0.1039 0.78% Castro::post_timestep() 1 0.09593 0.09765 0.0995 0.75% Gravity::multilevel_solve_for_new_phi() 1 0.09723 0.09727 0.09733 0.74% Gravity::actual_multilevel_solve() 1 0.09716 0.09722 0.09728 0.73% Amr::writePlotFile() 2 0.09693 0.097 0.09701 0.73% Castro::post_regrid() 2 0.08352 0.08597 0.08708 0.66% MLMG::mgVcycle_bottom 128 0.0003686 0.00579 0.08685 0.66% MLMG::actualBottomSolve() 128 0.0001422 0.005553 0.08656 0.65% MLCGSolver::bicgstab 8 0 0.005298 0.08477 0.64% MLMG::computeResidual() 128 0.07583 0.077 0.08214 0.62% Castro::construct_old_source() 120 0.07651 0.07788 0.07953 0.60% Castro::problem_post_timestep() 2 0.07355 0.07502 0.07722 0.58% Castro::construct_new_gravity_source() 17 0.06834 0.0699 0.07192 0.54% MultiFab::Saxpy() 91 0.06873 0.06987 0.07113 0.54% MLMG::mgVcycle_down::2 128 0.01245 0.03914 0.06834 0.52% Castro::construct_old_gravity() 20 0.04169 0.04963 0.06057 0.46% Gravity::get_old_grav_vector() 20 0.0416 0.04954 0.06049 0.46% MultiFab::Xpay() 923 0.0521 0.05507 0.05971 0.45% MLMG::mgVcycle_down::3 128 0.01177 0.01783 0.05827 0.44% Castro::volWgtSum() 66 0.05264 0.05333 0.05388 0.41% Castro::initialize_advance() 1 0.04806 0.04938 0.04986 0.38% Castro::construct_old_gravity_source() 20 0.04372 0.04453 0.04575 0.35% Castro::check_for_nan() 37 0.04423 0.04501 0.04564 0.34% MultiFab::contains_nan() 37 0.0441 0.04489 0.04554 0.34% Amr::regrid() 1 0.04277 0.04392 0.04443 0.34% MLPoisson::define() 19 0.02924 0.03371 0.03949 0.30% Castro::retry_advance_ctu() 11 0.03643 0.03704 0.03773 0.29% Gravity::get_new_grav_vector() 18 0.03522 0.03558 0.0359 0.27% MLMG::mgVcycle_down::4 128 0.01169 0.01337 0.03499 0.26% Castro::wd_update() 2 0.03093 0.03246 0.0347 0.26% StateDataPhysBCFunct::() 301 0.001086 0.01829 0.03374 0.25% StateData::FillBoundary(geom) 143 0 0.01706 0.03243 0.24% Castro::apply_source_to_state() 37 0.0279 0.02842 0.02901 0.22% VisMF::Write(FabArray) 4 0.01262 0.01417 0.02776 0.21% MLMG::mgVcycle_up::4 128 0.009615 0.01086 0.02632 0.20% MLCellLinOp::defineAuxData() 19 0.01906 0.02042 0.02537 0.19% Castro::volInBoundary() 14 0.02 0.02067 0.02269 0.17% MLMG::computeMLResidual() 18 0.0106 0.01615 0.02114 0.16% MLMG::prepareForSolve() 18 0.01696 0.01792 0.02053 0.16% MLMG::ResNormInf() 146 0.01165 0.01654 0.01843 0.14% CGSolver::sxay() 203 0 0.0009827 0.01572 0.12% Amr::writeSmallPlotFile() 2 0.01477 0.01478 0.01478 0.11% Gravity::test_composite_phi() 1 0.01407 0.01411 0.01414 0.11% FabArrayBase::getCPC() 2005 0.009042 0.0104 0.01411 0.11% FabArrayBase::getFB() 6388 0.009807 0.01078 0.01271 0.10% FabArray::setDomainBndry() 301 0.000806 0.006647 0.01226 0.09% MLLinOp::define() 19 0.003371 0.007216 0.01136 0.09% MLLinOp::defineGrids() 19 0.003226 0.007051 0.01121 0.08% MLCGSolver::ParallelAllReduce 189 0 0.0006331 0.01013 0.08% MultiFab::LinComb() 203 0 0.0006146 0.009834 0.07% TagBoxArray::collate() 2 0.0001003 0.001522 0.008047 0.06% MLMG::getGradSolution() 18 0.007493 0.007702 0.00797 0.06% MLCellLinOp::compGrad() 18 0.007448 0.007659 0.007926 0.06% MLLinOp::makeSubCommunicator() 19 0.000338 0.004109 0.007924 0.06% FabArray::mult() 59 0.00696 0.007096 0.007259 0.05% FabArrayBase::CPC::define() 576 0.00217 0.003374 0.006389 0.05% MLCellLinOp::defineBC() 19 0.005693 0.00594 0.006169 0.05% MultiFab::Dot() 142 0 0.0003807 0.006092 0.05% Castro::locWgtSum() 12 0.005075 0.005139 0.005193 0.04% Gravity::update_max_rhs() 2 0.001397 0.002511 0.004969 0.04% BndryData::define() 19 0.004033 0.00426 0.004461 0.03% MultiFab::max() 8 0.0004927 0.001619 0.004097 0.03% MLPoisson::normalize() 79 0 0.0001896 0.003033 0.02% Castro::volProductSum() 4 0.002919 0.002966 0.003009 0.02% MLPoisson::prepareForSolve() 19 0.001768 0.001942 0.002386 0.02% MLCellLinOp::prepareForSolve() 19 0.001686 0.001864 0.00231 0.02% MultiFab::Copy() 18 0.002 0.002035 0.002064 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001252 0.001553 0.001837 0.01% FabArrayBase::FB::FB() 75 0.0002783 0.0006983 0.001375 0.01% Gravity::swapTimeLevels() 8 0.001171 0.00122 0.001313 0.01% MLMG::compResidual() 1 0.0009404 0.001116 0.001293 0.01% AmrLevel::AmrLevel(dm) 1 0.001178 0.001194 0.001218 0.01% MLMG::MLResNormInf() 18 0.001135 0.001162 0.001198 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009999 0.001057 0.00119 0.01% StateData::define() 6 0.001145 0.00116 0.001185 0.01% MLMG::MLRhsNormInf() 18 0.001088 0.001116 0.001164 0.01% MLCellLinOp::setLevelBC() 19 0.0005715 0.0006862 0.0008612 0.01% makeSFC 95 0.0006262 0.0006723 0.0008158 0.01% Castro::swap_state_time_levels() 8 0.0004117 0.0006205 0.0006477 0.00% Castro::enforce_consistent_e() 1 0.000368 0.0003925 0.0005482 0.00% Gravity::applyMetricTerms() 2 0.0004646 0.000476 0.0004862 0.00% DistributionMapping::Distribute() 95 0.0002247 0.0002406 0.0003829 0.00% Castro::errorEst() 2 0.0002981 0.0003224 0.0003616 0.00% OwnerMask() 2 0.0001372 0.0001707 0.0002222 0.00% Castro::finalize_do_advance() 17 0.0001431 0.0001542 0.0001868 0.00% Castro::apply_tagging_restrictions() 2 0.0001327 0.0001509 0.0001815 0.00% Castro::apply_problem_tags() 2 0.0001596 0.0001654 0.0001754 0.00% DistributionMapping::KnapSackDoIt() 1 9.588e-05 0.0001073 0.0001182 0.00% Castro::enforce_speed_limit() 79 0.0001056 0.0001113 0.0001178 0.00% MultiFab::Swap() 5 7.197e-05 7.468e-05 7.985e-05 0.00% Castro::estTimeStep() 19 2.8e-05 3.151e-05 6.435e-05 0.00% knapsack() 1 5.826e-05 6.084e-05 6.283e-05 0.00% Amr::initSubcycle() 1 5.641e-05 5.866e-05 5.94e-05 0.00% MLMG::buildFineMask() 18 4.232e-05 4.518e-05 4.764e-05 0.00% Castro::finalize_advance() 1 2.057e-05 2.49e-05 3.931e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.7e-05 2.822e-05 3.914e-05 0.00% Castro::construct_old_rotation_source() 20 2.932e-05 3.035e-05 3.128e-05 0.00% Castro::construct_new_rotation_source() 17 2.188e-05 2.291e-05 2.423e-05 0.00% BoxList::parallelComplementIn() 4 1.315e-05 1.428e-05 1.663e-05 0.00% Gravity::set_mass_offset() 2 4.344e-06 6.943e-06 1.631e-05 0.00% Castro::computeInitialDt() 2 1.008e-05 1.05e-05 1.147e-05 0.00% BoxList::complementIn 4 6.048e-06 6.556e-06 7.274e-06 0.00% Castro::gwstrain() 2 4.504e-06 4.933e-06 6.609e-06 0.00% Castro::FluxRegFineAdd() 1 1.701e-06 1.929e-06 2.338e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 2) :: [0.0e0, 0.0e0] [TOP]::castro.dtnuc_mode(nvals = 1) :: [1] [TOP]::integrator.do_constant_volume_burn(nvals = 1) :: [1] [TOP]::integrator.retry_burn(nvals = 1) :: [1] [TOP]::mg.v(nvals = 1) :: [0] AMReX (22.03-33-g9907ac197518) finalized