MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.02-15-g067830e6c9fe) initialized Starting run at 07:58:07 UTC on 2022-02-28. Successfully read inputs file ... Castro git describe: 22.02-4-g0d942c92d AMReX git describe: 22.02-15-g067830e6c Microphysics git describe: 22.02-10-g1a114f0a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 castro.use_stopping_criterion = 1 castro.dtnuc_mode = 1 Warning: the following integrator.* parameters are ignored integrator.do_constant_volume_burn = 1 Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.152448906 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000914701 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010584202 Gravity::fill_multipole_BCs() time = 0.010555286 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -2.5098073e-31 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.048537899 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.006725055 seconds [Level 0 step 1] ADVANCE with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.073533159 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.300572989 Advance was unsuccessful with reason: negative density (density = -9.081732e+02 at index (14,70); started at 4.477055e+03); proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.079178611 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.275011533 Advance was unsuccessful with reason: negative density (density = -1.592544e+00 at index (20,79); started at 2.790161e+00); proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.075386268 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.292033796 Advance was unsuccessful with reason: negative density (density = -1.060745e-01 at index (20,78); started at 2.068339e-01); proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.066091162 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.274873495 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016277366 Gravity::solve_for_phi() time = 0.085031164 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.071048424 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.066033068 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.274638953 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016109612 Gravity::solve_for_phi() time = 0.086678565 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.072651812 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.093118555 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.286613744 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015358945 Gravity::solve_for_phi() time = 0.082863974 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.071767807 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.066779212 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.285148726 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.997068055e+46 ener added: 2.415044041e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015946449 Gravity::solve_for_phi() time = 0.083086336 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.543114243e+44 ener added: 4.768138875e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.765646947e+35 ymom added: 1.797592414e+26 zmom added: 0 eint added: 0 ener added: 5.380039006e+43 Castro::do_new_sources() time = 0.071087193 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.066708844 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.295043712 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.317346246e+44 ener added: 3.120883219e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015308494 Gravity::solve_for_phi() time = 0.083129212 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.957879842e+46 ener added: 4.564181618e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.001437306e+36 ymom added: 1.471489396e+25 zmom added: 0 eint added: 0 ener added: 6.980886509e+46 Castro::do_new_sources() time = 0.071779754 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.066746659 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.276869543 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.012688492e+46 ener added: 2.110657671e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015709683 Gravity::solve_for_phi() time = 0.082666713 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.326633224e+44 ener added: 1.174460404e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.711471844e+35 ymom added: 1.66063198e+26 zmom added: 0 eint added: 0 ener added: 2.826321793e+43 Castro::do_new_sources() time = 0.071069731 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.066972523 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.283056872 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.090986835e+44 ener added: 2.655092076e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015711433 Gravity::solve_for_phi() time = 0.083170006 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.968859957e+46 ener added: 1.10301368e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.004822123e+36 ymom added: -8.771795742e+24 zmom added: 0 eint added: 0 ener added: 6.987657644e+46 Castro::do_new_sources() time = 0.072518917 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.066140358 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.280265062 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.025000527e+46 ener added: 2.183068315e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015544189 Gravity::solve_for_phi() time = 0.083065338 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.651474965e+44 ener added: 1.477761377e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.60533052e+35 ymom added: 1.690843319e+26 zmom added: 0 eint added: 0 ener added: -1.190247427e+43 Castro::do_new_sources() time = 0.071707391 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.065916026 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.285901806 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.213015184e+44 ener added: 2.894439872e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014917874 Gravity::solve_for_phi() time = 0.082368659 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.97482432e+46 ener added: 1.388215779e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.00305216e+36 ymom added: 1.271497176e+24 zmom added: 0 eint added: 0 ener added: 6.99302976e+46 Castro::do_new_sources() time = 0.072660997 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.066100381 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.280886252 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.046400343e+46 ener added: 2.16073557e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015549768 Gravity::solve_for_phi() time = 0.083129536 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.248919276e+44 ener added: 1.60656791e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.450686215e+35 ymom added: 1.697312961e+26 zmom added: 0 eint added: 0 ener added: -6.185767806e+43 Castro::do_new_sources() time = 0.071171588 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.065938691 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.287858346 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.824816589e+44 ener added: 2.945461224e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015051982 Gravity::solve_for_phi() time = 0.082662497 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.977981871e+46 ener added: 1.507699921e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.996348783e+36 ymom added: 3.069538214e+24 zmom added: 0 eint added: 0 ener added: 6.997250022e+46 Castro::do_new_sources() time = 0.0722363 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.066158231 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.281675264 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.067953295e+46 ener added: 2.185941597e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015733821 Gravity::solve_for_phi() time = 0.083222644 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.036038551e+44 ener added: 1.710131682e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.236317743e+35 ymom added: 1.665059198e+26 zmom added: 0 eint added: 0 ener added: -1.282743578e+44 Castro::do_new_sources() time = 0.071493235 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.065994456 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.286226791 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.23178587e+44 ener added: 2.927676839e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014834725 Gravity::solve_for_phi() time = 0.08234393 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.979285299e+46 ener added: 1.614875382e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.983606539e+36 ymom added: -1.663453594e+24 zmom added: 0 eint added: 0 ener added: 6.999733101e+46 Castro::do_new_sources() time = 0.072991072 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.066103241 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.28139765 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.076022112e+46 ener added: 2.369765675e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015856591 Gravity::solve_for_phi() time = 0.083254227 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.768256697e+44 ener added: 1.742935385e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.789276502e+34 ymom added: 1.761383669e+26 zmom added: 0 eint added: 0 ener added: -1.824543748e+44 Castro::do_new_sources() time = 0.0712945 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.0664401 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.285869651 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.399341724e+44 ener added: 3.055404896e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01511835 Gravity::solve_for_phi() time = 0.082609719 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.981378524e+46 ener added: 1.65468052e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.966651828e+36 ymom added: 1.133367956e+23 zmom added: 0 eint added: 0 ener added: 7.003642946e+46 Castro::do_new_sources() time = 0.072264753 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.066213022 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.281423463 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.085134477e+46 ener added: 2.616682453e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016504702 Gravity::solve_for_phi() time = 0.084804455 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.966387031e+44 ener added: 1.764409733e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.086349894e+34 ymom added: 1.71437251e+26 zmom added: 0 eint added: 0 ener added: -1.814844154e+44 Castro::do_new_sources() time = 0.071976818 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.065870537 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.286413387 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.20798565e+44 ener added: 3.358777738e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015215177 Gravity::solve_for_phi() time = 0.082655683 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988653412e+46 ener added: 1.671056473e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.948364053e+36 ymom added: 7.142579305e+23 zmom added: 0 eint added: 0 ener added: 7.013022432e+46 Castro::do_new_sources() time = 0.07260924 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002629291862 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.548275694e+29 ener added: 1.548275694e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -2.890848341e+38 TIME= 0.25 YMOM = 8.975065285e+27 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.505143013e+38 TIME= 0.25 RHO*e = 1.331449006e+50 TIME= 0.25 RHO*K = 3.171006988e+49 TIME= 0.25 RHO*E = 1.648549705e+50 TIME= 0.25 RHO*PHI = -5.460195609e+50 TIME= 0.25 TOTAL ENERGY= -1.0815481e+50 TIME= 0.25 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0.25 CENTER OF MASS X-VEL = -113366.7542 TIME= 0.25 CENTER OF MASS Y-LOC = -4.196397805e-29 TIME= 0.25 CENTER OF MASS Y-VEL = 3.519638182e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 [STEP 1] Coarse TimeStep time: 12.55987937 [STEP 1] FAB kilobyte spread across MPI nodes: [8620 ... 8620] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.048292014 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.006675049 seconds Ending run at 07:58:21 UTC on 2022-02-28. Run time = 14.84971461 Run time without initialization = 12.61699475 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.85 ... 14.85 ... 14.85 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.4643 5.5331 5.6755 38.22% Amr::InitAmr() 1 1.316 1.316 1.316 8.86% Castro::computeTemp() 80 0.8877 0.986 1.143 7.69% Castro::reset_internal_energy() 80 0.8974 0.9439 1.092 7.36% FabArray::ParallelCopy_finish() 1583 0.1531 0.5337 0.7492 5.04% MultiFab::AddProduct() 3920 0.6446 0.6538 0.7172 4.83% FabArray::setVal() 5502 0.4667 0.4696 0.4743 3.19% Castro::normalize_species() 79 0.4616 0.464 0.4716 3.18% Amr::defBaseLevel() 1 0.3626 0.3664 0.3818 2.57% MLPoisson::Fsmooth() 6144 0.2753 0.2971 0.3592 2.42% MultiFab::Subtract() 159 0.3467 0.3483 0.3529 2.38% FabArray::ParallelCopy_nowait() 1583 0.3054 0.3262 0.3478 2.34% Gravity::fill_multipole_BCs() 19 0.2022 0.256 0.282 1.90% MultiFab::min() 23 0.001986 0.184 0.264 1.78% Castro::enforce_min_density() 79 0.1914 0.2039 0.249 1.68% MultiFab::sum() 3920 0.2228 0.2251 0.2276 1.53% MultiFab::Saxpy() 91 0.1999 0.2011 0.2057 1.39% Castro::do_advance_ctu() 20 0.1569 0.1582 0.1645 1.11% FillBoundary_nowait() 6388 0.08088 0.1084 0.1395 0.94% Castro::initData() 1 0.003544 0.02346 0.1338 0.90% FillBoundary_finish() 6388 0.07772 0.1018 0.1285 0.87% MLPoisson::Fapply() 994 0.09847 0.1028 0.113 0.76% Castro::derive() 156 0.09799 0.09878 0.1007 0.68% MLCellLinOp::applyBC() 7156 0.04656 0.0616 0.09413 0.63% Castro::construct_new_gravity_source() 17 0.08235 0.08313 0.08611 0.58% Castro::expand_state() 20 0.06907 0.06936 0.06984 0.47% Castro::construct_old_gravity_source() 20 0.06458 0.06557 0.0682 0.46% Castro::do_old_sources() 20 0.0003 0.01657 0.06738 0.45% Castro::do_new_sources() 17 0.0002506 0.01236 0.06409 0.43% MultiFab::Xpay() 923 0.05212 0.05427 0.05978 0.40% Castro::create_source_corrector() 17 0.05314 0.05353 0.05452 0.37% MultiFab::contains_nan() 37 0.04616 0.04641 0.04699 0.32% StateData::FillBoundary(geom) 143 0 0.0228 0.04419 0.30% MLMG::addInterpCorrection() 768 0.02959 0.03202 0.03932 0.26% amrex::average_down 768 0.026 0.02812 0.03418 0.23% VisMF::Write(FabArray) 4 0.01424 0.01569 0.02749 0.19% Amr::writePlotFile() 2 0.01795 0.0262 0.02729 0.18% Castro::retry_advance_ctu() 11 0.02395 0.02453 0.02503 0.17% MLCGSolver::bicgstab 8 0 0.001521 0.02433 0.16% FillPatchIterator::Initialize 301 0.02073 0.02102 0.02204 0.15% Gravity::get_old_grav_vector() 20 0.01951 0.0196 0.0198 0.13% Castro::construct_new_source() 102 0.01746 0.01766 0.01832 0.12% Gravity::get_new_grav_vector() 18 0.01769 0.01786 0.01819 0.12% MLCellLinOp::defineAuxData() 19 0.01548 0.01606 0.01763 0.12% FabArray::setDomainBndry() 301 0.0008763 0.00922 0.01757 0.12% MLMG::oneIter() 128 0.01465 0.01484 0.01637 0.11% FabArray::FillBoundary() 6388 0.01334 0.01377 0.01607 0.11% Castro::evaluate_source_change() 196 0.01411 0.01436 0.01539 0.10% MLMG::ResNormInf() 146 0.01084 0.01292 0.01444 0.10% FabArrayBase::getFB() 6388 0.009936 0.01038 0.01235 0.08% MLCellLinOp::smooth() 3072 0.01083 0.01124 0.01224 0.08% Castro::construct_old_source() 120 0.01175 0.01186 0.01213 0.08% Amr::writeSmallPlotFile() 2 0.007031 0.01082 0.01136 0.08% Castro::wd_update() 2 0.004016 0.008383 0.01084 0.07% Castro::volWgtSum() 66 0.01009 0.01015 0.0103 0.07% MultiFab::LinComb() 203 0 0.0006122 0.009795 0.07% MLLinOp::makeSubCommunicator() 19 0.000318 0.004035 0.008138 0.05% Gravity::actual_solve_with_mlmg() 19 0.006939 0.007221 0.007904 0.05% MLMG::prepareForSolve() 18 0.006819 0.007003 0.007521 0.05% FabArrayBase::getCPC() 2005 0.006915 0.007082 0.007407 0.05% FabArray::mult() 59 0.007241 0.007281 0.007369 0.05% MLCGSolver::ParallelAllReduce 189 0 0.0004279 0.006847 0.05% FabArrayBase::CPC::define() 576 0.002204 0.003418 0.006177 0.04% MultiFab::Dot() 142 0 0.0003749 0.005998 0.04% MLCellLinOp::compGrad() 18 0.005714 0.005764 0.005956 0.04% CGSolver::sxay() 203 0 0.0003636 0.005818 0.04% MLCellLinOp::apply() 994 0.002036 0.002281 0.005035 0.03% Castro::initialize_do_advance() 20 0.004366 0.004487 0.004827 0.03% FabArray::ParallelCopy() 1583 0.003802 0.003932 0.00414 0.03% MLMG::solve() 18 0.0007924 0.002064 0.003986 0.03% Castro::volInBoundary() 14 0.003547 0.003626 0.003963 0.03% BndryData::define() 19 0.003229 0.003269 0.003558 0.02% Gravity::solve_for_phi() 17 0.002485 0.002713 0.003462 0.02% MLPoisson::normalize() 79 0 0.0001895 0.003033 0.02% Castro::construct_new_gravity() 17 0.002297 0.002348 0.002561 0.02% MLCellLinOp::correctionResidual() 776 0.001878 0.001948 0.002267 0.02% MLCellLinOp::prepareForSolve() 19 0.001754 0.001894 0.002149 0.01% MultiFab::Copy() 18 0.002076 0.002096 0.00211 0.01% MLLinOp::defineGrids() 19 0.001803 0.001912 0.002063 0.01% MultiFab::max() 8 0.0005297 0.001467 0.001973 0.01% Castro::locWgtSum() 12 0.001851 0.001861 0.001888 0.01% StateData::define() 6 0.001412 0.001502 0.00186 0.01% MLMG::mgVcycle() 128 0.001592 0.001674 0.001829 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.00131 0.001567 0.001829 0.01% MLCellLinOp::defineBC() 19 0.001664 0.001706 0.001783 0.01% MLMG:computeResOfCorrection() 768 0.001435 0.0015 0.001565 0.01% Castro::problem_post_timestep() 2 0.0001443 0.0009468 0.001548 0.01% StateDataPhysBCFunct::() 301 0.001219 0.001381 0.001536 0.01% main() 1 0.001005 0.001176 0.001332 0.01% FabArrayBase::FB::FB() 75 0.0002822 0.000704 0.001331 0.01% MLMG::actualBottomSolve() 128 0.0001471 0.0002207 0.001248 0.01% MLMG::MLRhsNormInf() 18 0.001156 0.001179 0.001205 0.01% TagBoxArray::collate() 2 6.57e-05 0.0005822 0.001146 0.01% Castro::swap_state_time_levels() 8 0.000557 0.001017 0.00106 0.01% FillPatchSingleLevel 301 0.0008702 0.0008961 0.0009276 0.01% Castro::volProductSum() 4 0.0007848 0.0008083 0.0009174 0.01% Castro::post_init() 1 0.0004004 0.0007821 0.0009117 0.01% MLCellLinOp::setLevelBC() 19 0.0005535 0.0006854 0.0008413 0.01% Castro::subcycle_advance_ctu() 1 0.0003035 0.000383 0.0008369 0.01% MLMG::mgVcycle_down::0 128 0.0007265 0.0007425 0.0007904 0.01% MLMG::mgVcycle_down::2 128 0.0006661 0.0007256 0.0007796 0.01% MLMG::mgVcycle_down::1 128 0.0007069 0.0007215 0.0007708 0.01% MLMG::mgVcycle_down::3 128 0.000599 0.0006501 0.0007621 0.01% MLMG::mgVcycle_down::4 128 0.0005988 0.0006193 0.0007246 0.00% MLMG::mgVcycle_down::5 128 0.0005853 0.0006062 0.0006763 0.00% MLMG::mgVcycle_up::0 128 0.0005049 0.0005179 0.000564 0.00% MLMG::mgVcycle_up::1 128 0.000499 0.0005231 0.0005522 0.00% AmrMesh::MakeNewGrids() 2 0.0004916 0.0005135 0.0005366 0.00% MLMG::mgVcycle_up::2 128 0.0004192 0.0004667 0.0005217 0.00% Castro::clean_state() 79 0.000447 0.0004719 0.0005176 0.00% Gravity::test_composite_phi() 1 0.0004015 0.0004635 0.0005097 0.00% MLMG::mgVcycle_up::3 128 0.0004244 0.0004432 0.0005057 0.00% Castro::post_timestep() 1 0.0002216 0.00045 0.0004985 0.00% MLMG::mgVcycle_up::5 128 0.0004324 0.0004515 0.0004948 0.00% makeSFC 95 0.0003981 0.0004335 0.0004876 0.00% Gravity::applyMetricTerms() 2 0.0004748 0.0004774 0.0004817 0.00% MLMG::mgVcycle_up::4 128 0.0004159 0.0004301 0.0004724 0.00% MLCellLinOp::solutionResidual() 147 0.0004315 0.0004395 0.0004508 0.00% Gravity::update_max_rhs() 2 0.0004017 0.0004063 0.0004175 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003779 0.0003883 0.0004012 0.00% Castro::enforce_consistent_e() 1 0.0003785 0.0003841 0.0003971 0.00% Castro::initialize_advance() 1 0.0002258 0.0002884 0.0003258 0.00% MLMG::mgVcycle_bottom 128 0.0002313 0.0002404 0.0002834 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002439 0.0002592 0.0002822 0.00% MLMG::computeResidual() 128 0.0002667 0.0002732 0.0002806 0.00% MLMG::compResidual() 1 0.0002497 0.0002595 0.0002669 0.00% DistributionMapping::LeastUsedCPUs() 1 2.067e-05 0.0002166 0.0002459 0.00% DistributionMapping::Distribute() 95 0.000224 0.0002292 0.0002404 0.00% OwnerMask() 2 0.000135 0.0001723 0.0002187 0.00% MLLinOp::define() 19 0.0001567 0.00018 0.0001982 0.00% Castro::apply_tagging_restrictions() 2 0.0001418 0.0001589 0.0001899 0.00% Castro::finalize_do_advance() 17 0.0001426 0.0001573 0.0001886 0.00% Castro::apply_problem_tags() 2 0.0001668 0.000172 0.0001846 0.00% Amr::grid_places() 2 7.819e-05 0.0001123 0.0001708 0.00% Castro::apply_source_to_state() 37 0.0001112 0.0001205 0.0001676 0.00% MLPoisson::define() 19 0.0001179 0.000126 0.0001537 0.00% Castro::check_for_nan() 37 0.0001255 0.0001348 0.0001484 0.00% Gravity::actual_multilevel_solve() 1 0.0001397 0.0001413 0.0001435 0.00% TagBoxArray::mapPRD 2 0.0001169 0.0001207 0.0001299 0.00% Amr::coarseTimeStep() 1 9.685e-05 0.0001239 0.0001275 0.00% Castro::enforce_speed_limit() 79 0.0001028 0.00011 0.0001172 0.00% Castro::construct_old_gravity() 20 9.525e-05 0.000101 0.0001084 0.00% Amr::initSubcycle() 1 5.788e-05 6.317e-05 9.627e-05 0.00% knapsack() 1 6.264e-05 6.829e-05 8.563e-05 0.00% MLPoisson::prepareForSolve() 19 7.183e-05 7.734e-05 8.293e-05 0.00% MultiFab::Swap() 5 7.416e-05 7.598e-05 8.15e-05 0.00% Amr::FinalizeInit() 1 8.738e-06 1.918e-05 6.352e-05 0.00% Castro::finalize_advance() 1 1.925e-05 2.671e-05 5.686e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.094e-05 5.202e-05 5.477e-05 0.00% MLMG::computeMLResidual() 18 4.253e-05 4.608e-05 5.416e-05 0.00% MLMG::buildFineMask() 18 4.336e-05 4.546e-05 4.788e-05 0.00% MLMG::getGradSolution() 18 4.143e-05 4.36e-05 4.778e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.178e-05 3.488e-05 4.701e-05 0.00% Gravity::swapTimeLevels() 8 3.609e-05 3.822e-05 4.074e-05 0.00% Castro::estTimeStep() 19 2.787e-05 3.255e-05 4.065e-05 0.00% Castro::construct_old_rotation_source() 20 3.095e-05 3.214e-05 3.758e-05 0.00% Amr::regrid() 1 1.194e-05 1.519e-05 3.708e-05 0.00% MLMG::MLResNormInf() 18 3.423e-05 3.522e-05 3.62e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.865e-05 2.466e-05 3.474e-05 0.00% Castro::construct_new_rotation_source() 17 2.228e-05 2.371e-05 2.515e-05 0.00% Amr::timeStep() 1 1.245e-05 1.447e-05 2.149e-05 0.00% Gravity::set_mass_offset() 2 4.4e-06 7.512e-06 1.851e-05 0.00% Castro::post_regrid() 2 1.17e-05 1.273e-05 1.765e-05 0.00% Castro::computeInitialDt() 2 7.392e-06 1.14e-05 1.653e-05 0.00% Amr::InitializeInit() 1 6.937e-06 8.295e-06 1.57e-05 0.00% BoxList::parallelComplementIn() 4 7.183e-06 7.824e-06 1.228e-05 0.00% Amr::init() 1 7.783e-06 8.794e-06 9.837e-06 0.00% Amr::bldFineLevels() 1 7.602e-06 8.416e-06 9.73e-06 0.00% Castro::advance() 1 6.415e-06 7.406e-06 8.093e-06 0.00% Amr::initialInit() 1 2.935e-06 3.641e-06 7.574e-06 0.00% BoxList::complementIn 4 6.41e-06 6.652e-06 7.039e-06 0.00% Castro::errorEst() 2 6.059e-06 6.34e-06 6.919e-06 0.00% Castro::gwstrain() 2 4.463e-06 5.041e-06 6.256e-06 0.00% Castro::FluxRegFineAdd() 1 1.669e-06 1.951e-06 2.368e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.85 14.85 14.85 100.00% Amr::coarseTimeStep() 1 12.62 12.62 12.62 84.96% Amr::timeStep() 1 12.56 12.56 12.56 84.58% Castro::advance() 1 12.46 12.46 12.46 83.92% Castro::subcycle_advance_ctu() 1 12.41 12.41 12.41 83.57% Castro::do_advance_ctu() 20 12.36 12.36 12.37 83.27% Castro::construct_ctu_hydro_source() 20 5.464 5.533 5.675 38.22% Castro::clean_state() 79 3.703 3.801 3.961 26.68% Castro::computeTemp() 80 2.46 2.564 2.775 18.69% Castro::reset_internal_energy() 80 1.528 1.578 1.724 11.61% Gravity::solve_phi_with_mlmg() 19 1.435 1.489 1.52 10.23% Castro::construct_new_gravity() 17 1.365 1.42 1.45 9.77% Gravity::solve_for_phi() 17 1.329 1.384 1.414 9.52% Castro::do_old_sources() 20 1.236 1.293 1.374 9.25% Amr::InitAmr() 1 1.316 1.316 1.316 8.86% Castro::initialize_do_advance() 20 1.275 1.288 1.31 8.82% Gravity::actual_solve_with_mlmg() 19 1.228 1.232 1.236 8.33% Castro::do_new_sources() 17 1.15 1.184 1.222 8.23% Castro::evaluate_source_change() 196 1.113 1.124 1.187 7.99% MLMG::solve() 18 1.178 1.181 1.182 7.96% FabArray::ParallelCopy() 1583 0.4897 0.8701 1.085 7.31% MLMG::oneIter() 128 1.053 1.055 1.057 7.12% MLMG::mgVcycle() 128 1.038 1.04 1.042 7.02% Amr::init() 1 0.9157 0.9159 0.9159 6.17% Castro::enforce_min_density() 79 0.8123 0.8296 0.8722 5.87% Amr::initialInit() 1 0.8581 0.8583 0.8585 5.78% FabArray::ParallelCopy_finish() 1583 0.1531 0.5337 0.7492 5.04% MultiFab::AddProduct() 3920 0.6446 0.6538 0.7172 4.83% MLCellLinOp::smooth() 3072 0.5009 0.5483 0.6628 4.46% FillPatchIterator::Initialize 301 0.4432 0.5462 0.6373 4.29% FillPatchSingleLevel 301 0.4053 0.5159 0.6092 4.10% Amr::InitializeInit() 1 0.4514 0.5033 0.6019 4.05% Amr::defBaseLevel() 1 0.4513 0.5033 0.6019 4.05% FabArray::setVal() 5502 0.4667 0.4696 0.4743 3.19% Castro::normalize_species() 79 0.4616 0.464 0.4716 3.18% MLMG::mgVcycle_up::1 128 0.0886 0.2368 0.4135 2.78% Amr::FinalizeInit() 1 0.2562 0.3551 0.407 2.74% MLMG::addInterpCorrection() 768 0.1413 0.2912 0.3664 2.47% MLPoisson::Fsmooth() 6144 0.2753 0.2971 0.3592 2.42% FabArray::ParallelCopy_nowait() 1583 0.311 0.3325 0.3549 2.39% MultiFab::Subtract() 159 0.3467 0.3483 0.3529 2.38% MLCellLinOp::applyBC() 7156 0.2665 0.2966 0.3506 2.36% Gravity::fill_multipole_BCs() 19 0.2022 0.256 0.282 1.90% MLMG::mgVcycle_up::2 128 0.009856 0.1151 0.2763 1.86% FabArray::FillBoundary() 6388 0.2105 0.235 0.2714 1.83% MultiFab::min() 23 0.001986 0.184 0.264 1.78% MLMG::mgVcycle_down::0 128 0.2461 0.2476 0.2498 1.68% Castro::initData() 1 0.0802 0.1296 0.231 1.56% MultiFab::sum() 3920 0.2228 0.2251 0.2276 1.53% Castro::construct_new_source() 102 0.2131 0.2142 0.2167 1.46% Castro::expand_state() 20 0.1833 0.1928 0.2086 1.40% MultiFab::Saxpy() 91 0.1999 0.2011 0.2057 1.39% Amr::bldFineLevels() 1 0.04663 0.145 0.1968 1.33% MLMG::mgVcycle_up::3 128 0.009793 0.02308 0.1865 1.26% MLMG::mgVcycle_up::0 128 0.1783 0.1788 0.1793 1.21% MLCellLinOp::apply() 994 0.1516 0.1599 0.1778 1.20% amrex::average_down 768 0.03425 0.04887 0.1695 1.14% Castro::post_init() 1 0.1658 0.1668 0.1673 1.13% Castro::create_source_corrector() 17 0.1352 0.1511 0.1607 1.08% Amr::grid_places() 2 0.002606 0.1014 0.1534 1.03% AmrMesh::MakeNewGrids() 2 0.002517 0.1013 0.1533 1.03% TagBoxArray::mapPRD 2 0.0007442 0.09972 0.1521 1.02% FillBoundary_nowait() 6388 0.09126 0.1195 0.151 1.02% MLMG:computeResOfCorrection() 768 0.1151 0.1242 0.1473 0.99% Castro::construct_old_source() 120 0.1431 0.1443 0.1473 0.99% MLMG::mgVcycle_down::5 128 0.01191 0.02124 0.147 0.99% Castro::derive() 156 0.1431 0.1441 0.1461 0.98% MLCellLinOp::correctionResidual() 776 0.1136 0.1229 0.1458 0.98% FillBoundary_finish() 6388 0.07772 0.1018 0.1285 0.87% MLMG::mgVcycle_down::1 128 0.1097 0.1125 0.1155 0.78% MLPoisson::Fapply() 994 0.09847 0.1028 0.113 0.76% MLMG::mgVcycle_up::5 128 0.009912 0.01615 0.1053 0.71% Castro::post_timestep() 1 0.09716 0.0994 0.1014 0.68% Amr::writePlotFile() 2 0.09902 0.09911 0.09912 0.67% Castro::construct_old_gravity() 20 0.04398 0.07711 0.09877 0.67% Gravity::get_old_grav_vector() 20 0.04387 0.077 0.09867 0.66% MLCellLinOp::solutionResidual() 147 0.08867 0.09213 0.09495 0.64% Gravity::multilevel_solve_for_new_phi() 1 0.09485 0.09489 0.09492 0.64% Gravity::actual_multilevel_solve() 1 0.0948 0.09483 0.09487 0.64% Castro::post_regrid() 2 0.08634 0.08683 0.08778 0.59% MLMG::mgVcycle_bottom 128 0.00038 0.005787 0.08675 0.58% MLMG::actualBottomSolve() 128 0.0001471 0.005547 0.08646 0.58% Castro::construct_new_gravity_source() 17 0.08235 0.08313 0.08611 0.58% Castro::apply_source_to_state() 37 0.08137 0.08213 0.0858 0.58% MLCGSolver::bicgstab 8 0 0.005293 0.08469 0.57% Castro::problem_post_timestep() 2 0.07402 0.07672 0.07889 0.53% MLMG::computeResidual() 128 0.07587 0.0773 0.07808 0.53% Castro::construct_old_gravity_source() 20 0.06458 0.06557 0.0682 0.46% MLMG::mgVcycle_down::2 128 0.01268 0.03905 0.06776 0.46% MultiFab::Xpay() 923 0.05212 0.05427 0.05978 0.40% MLMG::mgVcycle_down::3 128 0.01195 0.01786 0.05707 0.38% Castro::volWgtSum() 66 0.05381 0.0542 0.055 0.37% Castro::initialize_advance() 1 0.05123 0.05157 0.05309 0.36% Castro::check_for_nan() 37 0.04629 0.04655 0.04712 0.32% MultiFab::contains_nan() 37 0.04616 0.04641 0.04699 0.32% Castro::retry_advance_ctu() 11 0.04379 0.04489 0.04584 0.31% StateDataPhysBCFunct::() 301 0.001219 0.02418 0.04573 0.31% Amr::regrid() 1 0.04416 0.04448 0.04504 0.30% StateData::FillBoundary(geom) 143 0 0.0228 0.04419 0.30% MLPoisson::define() 19 0.02967 0.03419 0.03994 0.27% Gravity::get_new_grav_vector() 18 0.03578 0.03608 0.03646 0.25% Castro::wd_update() 2 0.03083 0.03353 0.03571 0.24% MLMG::mgVcycle_down::4 128 0.01193 0.01351 0.03365 0.23% VisMF::Write(FabArray) 4 0.01424 0.01569 0.02749 0.19% MLMG::mgVcycle_up::4 128 0.009853 0.01099 0.02504 0.17% MLCellLinOp::defineAuxData() 19 0.01947 0.02085 0.02396 0.16% Castro::volInBoundary() 14 0.02049 0.02094 0.02261 0.15% MLMG::prepareForSolve() 18 0.01739 0.0182 0.02021 0.14% FabArray::setDomainBndry() 301 0.0008763 0.00922 0.01757 0.12% MLMG::computeMLResidual() 18 0.01082 0.01445 0.0175 0.12% CGSolver::sxay() 203 0 0.0009758 0.01561 0.11% Amr::writeSmallPlotFile() 2 0.01493 0.01493 0.01493 0.10% MLMG::ResNormInf() 146 0.01084 0.01292 0.01444 0.10% Gravity::test_composite_phi() 1 0.014 0.01404 0.01406 0.09% FabArrayBase::getCPC() 2005 0.009154 0.0105 0.01351 0.09% FabArrayBase::getFB() 6388 0.01027 0.01108 0.01286 0.09% MLLinOp::define() 19 0.003391 0.007178 0.01145 0.08% MLLinOp::defineGrids() 19 0.003193 0.006998 0.01128 0.08% MLCGSolver::ParallelAllReduce 189 0 0.0006333 0.01013 0.07% MultiFab::LinComb() 203 0 0.0006122 0.009795 0.07% MLLinOp::makeSubCommunicator() 19 0.000318 0.004035 0.008138 0.05% MLMG::getGradSolution() 18 0.007465 0.007629 0.007818 0.05% MLCellLinOp::compGrad() 18 0.007421 0.007586 0.00777 0.05% FabArray::mult() 59 0.007241 0.007281 0.007369 0.05% MLCellLinOp::defineBC() 19 0.005884 0.00604 0.006484 0.04% FabArrayBase::CPC::define() 576 0.002204 0.003418 0.006177 0.04% MultiFab::Dot() 142 0 0.0003749 0.005998 0.04% Castro::locWgtSum() 12 0.005172 0.005209 0.005315 0.04% BndryData::define() 19 0.004134 0.004334 0.004706 0.03% Castro::volProductSum() 4 0.002986 0.003037 0.00319 0.02% MLPoisson::normalize() 79 0 0.0001895 0.003033 0.02% Gravity::update_max_rhs() 2 0.001406 0.002348 0.002849 0.02% MLPoisson::prepareForSolve() 19 0.001837 0.001971 0.002229 0.02% MLCellLinOp::prepareForSolve() 19 0.001754 0.001894 0.002149 0.01% MultiFab::Copy() 18 0.002076 0.002096 0.00211 0.01% MultiFab::max() 8 0.0005297 0.001467 0.001973 0.01% AmrLevel::AmrLevel(dm) 1 0.001444 0.001537 0.001906 0.01% StateData::define() 6 0.001412 0.001502 0.00186 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.00131 0.001567 0.001829 0.01% FabArrayBase::FB::FB() 75 0.0002822 0.000704 0.001331 0.01% Gravity::swapTimeLevels() 8 0.001187 0.001203 0.001231 0.01% MLMG::MLResNormInf() 18 0.0012 0.001209 0.001223 0.01% MLMG::MLRhsNormInf() 18 0.001156 0.001179 0.001205 0.01% MLMG::compResidual() 1 0.0009396 0.001065 0.001186 0.01% TagBoxArray::collate() 2 6.57e-05 0.0005822 0.001146 0.01% MLLinOp::makeAgglomeratedDMap 19 0.001003 0.001051 0.001101 0.01% Castro::swap_state_time_levels() 8 0.000557 0.001017 0.00106 0.01% MLCellLinOp::setLevelBC() 19 0.0005535 0.0006854 0.0008413 0.01% makeSFC 95 0.0006231 0.0006627 0.0007154 0.00% Gravity::applyMetricTerms() 2 0.0004748 0.0004774 0.0004817 0.00% Castro::enforce_consistent_e() 1 0.0003785 0.0003841 0.0003971 0.00% Castro::errorEst() 2 0.0003159 0.0003372 0.000372 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001298 0.0003096 0.0003439 0.00% DistributionMapping::LeastUsedCPUs() 1 2.067e-05 0.0002166 0.0002459 0.00% DistributionMapping::Distribute() 95 0.000224 0.0002292 0.0002404 0.00% OwnerMask() 2 0.000135 0.0001723 0.0002187 0.00% Castro::apply_tagging_restrictions() 2 0.0001418 0.0001589 0.0001899 0.00% Castro::finalize_do_advance() 17 0.0001426 0.0001573 0.0001886 0.00% Castro::apply_problem_tags() 2 0.0001668 0.000172 0.0001846 0.00% Castro::enforce_speed_limit() 79 0.0001028 0.00011 0.0001172 0.00% Amr::initSubcycle() 1 5.788e-05 6.317e-05 9.627e-05 0.00% knapsack() 1 6.264e-05 6.829e-05 8.563e-05 0.00% MultiFab::Swap() 5 7.416e-05 7.598e-05 8.15e-05 0.00% Castro::finalize_advance() 1 2.11e-05 2.866e-05 5.923e-05 0.00% MLMG::buildFineMask() 18 4.336e-05 4.546e-05 4.788e-05 0.00% Castro::estTimeStep() 19 2.787e-05 3.255e-05 4.065e-05 0.00% Castro::construct_old_rotation_source() 20 3.095e-05 3.214e-05 3.758e-05 0.00% Castro::construct_new_rotation_source() 17 2.228e-05 2.371e-05 2.515e-05 0.00% Castro::computeInitialDt() 2 1.566e-05 1.777e-05 2.118e-05 0.00% BoxList::parallelComplementIn() 4 1.359e-05 1.448e-05 1.885e-05 0.00% Gravity::set_mass_offset() 2 4.4e-06 7.512e-06 1.851e-05 0.00% BoxList::complementIn 4 6.41e-06 6.652e-06 7.039e-06 0.00% Castro::gwstrain() 2 4.463e-06 5.041e-06 6.256e-06 0.00% Castro::FluxRegFineAdd() 1 1.669e-06 1.951e-06 2.368e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 2) :: [0.0e0, 0.0e0] [TOP]::castro.dtnuc_mode(nvals = 1) :: [1] [TOP]::integrator.do_constant_volume_burn(nvals = 1) :: [1] [TOP]::mg.v(nvals = 1) :: [0] AMReX (22.02-15-g067830e6c9fe) finalized