MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.01-12-g1404c4a9acc6) initialized Starting run at 08:07:12 UTC on 2022-01-07. Successfully read inputs file ... Castro git describe: 21.12-23-g727e39bb6 AMReX git describe: 22.01-12-g1404c4a9a Microphysics git describe: 22.01-14-geeef682d reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 castro.use_stopping_criterion = 1 castro.dtnuc_mode = 1 Warning: the following integrator.* parameters are ignored integrator.do_constant_volume_burn = 1 Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.130581077 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001008297 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.01094698906 Gravity::fill_multipole_BCs() time = 0.01174354553 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -2.5098073e-31 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049943935 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.006857828 seconds [Level 0 step 1] ADVANCE with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.07590723038 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3014388084 Advance was unsuccessful with reason: negative density (density = -9.081732e+02 at index (14,70); started at 4.477055e+03); proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.07419490814 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2988512516 Advance was unsuccessful with reason: negative density (density = -1.592544e+00 at index (20,79); started at 2.790161e+00); proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.07119059563 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2970035076 Advance was unsuccessful with reason: negative density (density = -1.060745e-01 at index (20,78); started at 2.068339e-01); proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.07245898247 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3007953167 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0160112381 Gravity::solve_for_phi() time = 0.1136441231 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.07804918289 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.07328414917 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3011271954 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01612997055 Gravity::solve_for_phi() time = 0.1138446331 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.07868862152 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.07311296463 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3066978455 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01568055153 Gravity::solve_for_phi() time = 0.1134166718 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.948673093e+46 ener added: 3.718993455e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.993343564e+36 ymom added: -3.766130952e+27 zmom added: 0 eint added: 0 ener added: 6.97362419e+46 Castro::do_new_sources() time = 0.07858991623 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.07324886322 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3066763878 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.997068055e+46 ener added: 2.415044041e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0165605545 Gravity::solve_for_phi() time = 0.1309251785 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.543114243e+44 ener added: 4.768138875e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.765646947e+35 ymom added: 1.797592414e+26 zmom added: 0 eint added: 0 ener added: 5.380039006e+43 Castro::do_new_sources() time = 0.09487175941 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503787228e+25 ener added: 4.503787228e+25 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.994270532e+46 ener added: 5.341284592e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.468670409e+40 ymom added: 5.931292302e+26 zmom added: 0 eint added: 0 ener added: 8.719870913e+46 Castro::do_old_sources() time = 0.0732486248 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3128941059 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.317346246e+44 ener added: 3.120883219e+42 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0161356926 Gravity::solve_for_phi() time = 0.1134445667 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.957879842e+46 ener added: 4.564181618e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.001437306e+36 ymom added: 1.471489396e+25 zmom added: 0 eint added: 0 ener added: 6.980886509e+46 Castro::do_new_sources() time = 0.0786921978 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.07338857651 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.307956934 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.012688492e+46 ener added: 2.110657671e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01711893082 Gravity::solve_for_phi() time = 0.1142110825 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.326633224e+44 ener added: 1.174460404e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.711471844e+35 ymom added: 1.66063198e+26 zmom added: 0 eint added: 0 ener added: 2.826321793e+43 Castro::do_new_sources() time = 0.07792019844 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.002879254e+46 ener added: 6.901118887e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.469670696e+40 ymom added: 6.16552168e+26 zmom added: 0 eint added: 0 ener added: 8.772022862e+46 Castro::do_old_sources() time = 0.0731408596 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3120875359 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.090986835e+44 ener added: 2.655092076e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01655602455 Gravity::solve_for_phi() time = 0.1138827801 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.968859957e+46 ener added: 1.10301368e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.004822123e+36 ymom added: -8.771795742e+24 zmom added: 0 eint added: 0 ener added: 6.987657644e+46 Castro::do_new_sources() time = 0.07866621017 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.1049005985 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.299074173 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.025000527e+46 ener added: 2.183068315e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01555776596 Gravity::solve_for_phi() time = 0.1124193668 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.651474965e+44 ener added: 1.477761377e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.60533052e+35 ymom added: 1.690843319e+26 zmom added: 0 eint added: 0 ener added: -1.190247427e+43 Castro::do_new_sources() time = 0.07619571686 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.011724564e+46 ener added: 1.143975262e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.47067166e+40 ymom added: 6.065029721e+26 zmom added: 0 eint added: 0 ener added: 8.82072643e+46 Castro::do_old_sources() time = 0.07344388962 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3148298264 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.213015184e+44 ener added: 2.894439872e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01532196999 Gravity::solve_for_phi() time = 0.1115410328 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.97482432e+46 ener added: 1.388215779e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.00305216e+36 ymom added: 1.271497176e+24 zmom added: 0 eint added: 0 ener added: 6.99302976e+46 Castro::do_new_sources() time = 0.07704520226 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.07021594048 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2995378971 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.046400343e+46 ener added: 2.16073557e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01541638374 Gravity::solve_for_phi() time = 0.1118986607 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.248919276e+44 ener added: 1.60656791e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.450686215e+35 ymom added: 1.697312961e+26 zmom added: 0 eint added: 0 ener added: -6.185767806e+43 Castro::do_new_sources() time = 0.07661986351 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.25179549e+29 ener added: 1.25179549e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.020672591e+46 ener added: 1.490478693e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.471672271e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.865830705e+46 Castro::do_old_sources() time = 0.07131648064 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3040525913 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.824816589e+44 ener added: 2.945461224e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01572537422 Gravity::solve_for_phi() time = 0.1128454208 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.977981871e+46 ener added: 1.507699921e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.996348783e+36 ymom added: 3.069538214e+24 zmom added: 0 eint added: 0 ener added: 6.997250022e+46 Castro::do_new_sources() time = 0.07638168335 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.07013225555 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2979543209 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.067953295e+46 ener added: 2.185941597e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01521086693 Gravity::solve_for_phi() time = 0.111978054 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.036038551e+44 ener added: 1.710131682e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.236317743e+35 ymom added: 1.665059198e+26 zmom added: 0 eint added: 0 ener added: -1.282743578e+44 Castro::do_new_sources() time = 0.07647299767 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.258977451e+28 ener added: 6.258977451e+28 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.029400513e+46 ener added: 2.040436118e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.472671541e+40 ymom added: 6.126231591e+26 zmom added: 0 eint added: 0 ener added: 8.906898514e+46 Castro::do_old_sources() time = 0.07105469704 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3044235706 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.23178587e+44 ener added: 2.927676839e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01563596725 Gravity::solve_for_phi() time = 0.1121702194 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.979285299e+46 ener added: 1.614875382e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.983606539e+36 ymom added: -1.663453594e+24 zmom added: 0 eint added: 0 ener added: 6.999733101e+46 Castro::do_new_sources() time = 0.07695317268 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.07186365128 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3078458309 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.076022112e+46 ener added: 2.369765675e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01736092567 Gravity::solve_for_phi() time = 0.1152672768 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.768256697e+44 ener added: 1.742935385e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.789276502e+34 ymom added: 1.761383669e+26 zmom added: 0 eint added: 0 ener added: -1.824543748e+44 Castro::do_new_sources() time = 0.07808089256 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.75538647e+29 ener added: 3.75538647e+29 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.038531048e+46 ener added: 2.158325616e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.473668262e+40 ymom added: 6.057473935e+26 zmom added: 0 eint added: 0 ener added: 8.943835283e+46 Castro::do_old_sources() time = 0.07276844978 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3131277561 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.399341724e+44 ener added: 3.055404896e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01675462723 Gravity::solve_for_phi() time = 0.1144914627 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.981378524e+46 ener added: 1.65468052e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.966651828e+36 ymom added: 1.133367956e+23 zmom added: 0 eint added: 0 ener added: 7.003642946e+46 Castro::do_new_sources() time = 0.07862067223 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.07304239273 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.320971489 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.085134477e+46 ener added: 2.616682453e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01773691177 Gravity::solve_for_phi() time = 0.115367651 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.966387031e+44 ener added: 1.764409733e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.086349894e+34 ymom added: 1.71437251e+26 zmom added: 0 eint added: 0 ener added: -1.814844154e+44 Castro::do_new_sources() time = 0.07804012299 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.047344521e+46 ener added: 2.557244057e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.474661592e+40 ymom added: 6.086941502e+26 zmom added: 0 eint added: 0 ener added: 8.976696152e+46 Castro::do_old_sources() time = 0.07354068756 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.3108391762 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.20798565e+44 ener added: 3.358777738e+43 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015873909 Gravity::solve_for_phi() time = 0.112046957 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988653412e+46 ener added: 1.671056473e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.948364053e+36 ymom added: 7.142579305e+23 zmom added: 0 eint added: 0 ener added: 7.013022432e+46 Castro::do_new_sources() time = 0.07673144341 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002365574377 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.548275694e+29 ener added: 1.548275694e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -2.890848341e+38 TIME= 0.25 YMOM = 8.975065285e+27 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.505143013e+38 TIME= 0.25 RHO*e = 1.331449006e+50 TIME= 0.25 RHO*K = 3.171006988e+49 TIME= 0.25 RHO*E = 1.648549705e+50 TIME= 0.25 RHO*PHI = -5.460195609e+50 TIME= 0.25 TOTAL ENERGY= -1.0815481e+50 TIME= 0.25 CENTER OF MASS X-LOC = 9.947183943e-17 TIME= 0.25 CENTER OF MASS X-VEL = -113366.7542 TIME= 0.25 CENTER OF MASS Y-LOC = -4.196397805e-29 TIME= 0.25 CENTER OF MASS Y-VEL = 3.519638182e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 [STEP 1] Coarse TimeStep time: 13.95814825 [STEP 1] FAB kilobyte spread across MPI nodes: [8620 ... 8620] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.050056185 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.006876245 seconds Ending run at 08:07:28 UTC on 2022-01-07. Run time = 16.30291295 Run time without initialization = 14.01769614 Average number of zones advanced per microsecond: 0.002 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 16.3 ... 16.3 ... 16.3 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.8993 6.0170 6.1119 37.49% Amr::InitAmr() 1 1.32 1.32 1.32 8.10% Castro::computeTemp() 80 0.8964 1.006 1.172 7.19% Castro::reset_internal_energy() 80 0.9379 0.9877 1.13 6.93% FabArray::ParallelCopy_finish() 1583 0.2877 0.6703 0.8601 5.28% MultiFab::AddProduct() 3920 0.7025 0.7172 0.7664 4.70% Castro::normalize_species() 79 0.5131 0.519 0.5273 3.23% FabArray::setVal() 5502 0.5108 0.5158 0.5211 3.20% MLPoisson::Fsmooth() 6144 0.3137 0.3405 0.4169 2.56% Amr::defBaseLevel() 1 0.3705 0.3773 0.3941 2.42% FabArray::ParallelCopy_nowait() 1583 0.3459 0.3643 0.3869 2.37% MultiFab::Subtract() 159 0.3725 0.3765 0.3802 2.33% Gravity::fill_multipole_BCs() 19 0.2142 0.2656 0.2943 1.80% MultiFab::min() 23 0.00206 0.1405 0.2824 1.73% Castro::enforce_min_density() 79 0.2011 0.2203 0.2785 1.71% MultiFab::sum() 3920 0.2505 0.2532 0.2553 1.57% MultiFab::Saxpy() 91 0.2091 0.2117 0.2154 1.32% FillBoundary_nowait() 6388 0.1192 0.1468 0.176 1.08% Castro::do_advance_ctu() 20 0.1654 0.1681 0.1706 1.05% FillBoundary_finish() 6388 0.1109 0.131 0.1508 0.92% MLCellLinOp::applyBC() 7156 0.08154 0.09861 0.142 0.87% Castro::initData() 1 0.003912 0.02358 0.1334 0.82% MLPoisson::Fapply() 994 0.1097 0.1159 0.1279 0.78% Castro::derive() 156 0.1018 0.1026 0.1041 0.64% Castro::construct_new_gravity_source() 17 0.09393 0.09516 0.0964 0.59% Castro::do_old_sources() 20 0.001026 0.02001 0.0883 0.54% FabArray::FillBoundary() 6388 0.0677 0.06948 0.08255 0.51% Castro::expand_state() 20 0.07238 0.07373 0.07537 0.46% Castro::construct_old_gravity_source() 20 0.07069 0.07149 0.07242 0.44% Castro::do_new_sources() 17 0.0008515 0.01478 0.07188 0.44% MultiFab::Xpay() 923 0.05676 0.0597 0.06535 0.40% Castro::create_source_corrector() 17 0.05542 0.05657 0.05783 0.35% MLCellLinOp::smooth() 3072 0.05455 0.05514 0.05609 0.34% MLCGSolver::bicgstab 8 0 0.003392 0.05427 0.33% MultiFab::contains_nan() 37 0.04986 0.05036 0.05083 0.31% Castro::evaluate_source_change() 196 0.04801 0.04867 0.05023 0.31% StateData::FillBoundary(geom) 143 0 0.02492 0.04955 0.30% MLMG::addInterpCorrection() 768 0.03629 0.03919 0.04752 0.29% amrex::average_down 768 0.03095 0.03326 0.04047 0.25% FabArrayBase::getFB() 6388 0.02451 0.0255 0.03189 0.20% VisMF::Write(FabArray) 4 0.01473 0.01651 0.02845 0.17% Amr::writePlotFile() 2 0.01903 0.02744 0.02831 0.17% Castro::retry_advance_ctu() 11 0.02564 0.02592 0.02626 0.16% CGSolver::sxay() 203 0 0.00154 0.02464 0.15% MLCellLinOp::apply() 994 0.009664 0.01078 0.02416 0.15% FillPatchIterator::Initialize 301 0.02298 0.02321 0.02392 0.15% MLMG::ResNormInf() 146 0.01664 0.01982 0.02342 0.14% MLCellLinOp::defineAuxData() 19 0.01853 0.01919 0.0227 0.14% Gravity::get_old_grav_vector() 20 0.02093 0.02123 0.02177 0.13% Gravity::get_new_grav_vector() 18 0.0192 0.01944 0.02032 0.12% Castro::construct_new_source() 102 0.01939 0.01969 0.02018 0.12% MultiFab::LinComb() 203 0 0.001247 0.01995 0.12% FabArray::setDomainBndry() 301 0.001616 0.01058 0.01953 0.12% MLCGSolver::ParallelAllReduce 189 0 0.00118 0.01888 0.12% MLMG::oneIter() 128 0.01613 0.01647 0.01826 0.11% FabArray::ParallelCopy() 1583 0.0165 0.01687 0.01743 0.11% FabArrayBase::getCPC() 2005 0.01427 0.01445 0.01487 0.09% Castro::construct_old_source() 120 0.01311 0.01325 0.01339 0.08% MultiFab::Dot() 142 0 0.0008127 0.013 0.08% Amr::writeSmallPlotFile() 2 0.007631 0.01154 0.01216 0.07% Castro::wd_update() 2 0.004684 0.008663 0.01145 0.07% Castro::volWgtSum() 66 0.01082 0.01088 0.01102 0.07% MLMG::solve() 18 0.002407 0.00606 0.0101 0.06% MLCellLinOp::correctionResidual() 776 0.008051 0.008379 0.009791 0.06% MLMG::prepareForSolve() 18 0.008422 0.008598 0.009592 0.06% FabArray::mult() 59 0.008038 0.008244 0.008964 0.05% Gravity::actual_solve_with_mlmg() 19 0.007085 0.007373 0.008757 0.05% MLLinOp::makeSubCommunicator() 19 0.0002694 0.004145 0.008216 0.05% FabArrayBase::CPC::define() 576 0.003423 0.004771 0.008138 0.05% MLCellLinOp::compGrad() 18 0.006676 0.00682 0.007444 0.05% MLMG::mgVcycle() 128 0.00639 0.006557 0.006806 0.04% MLPoisson::normalize() 79 0 0.0004175 0.006681 0.04% MLMG:computeResOfCorrection() 768 0.005439 0.005518 0.005635 0.03% Castro::initialize_do_advance() 20 0.004496 0.004598 0.004803 0.03% Castro::volInBoundary() 14 0.003942 0.004048 0.004397 0.03% Gravity::solve_for_phi() 17 0.00277 0.003073 0.004249 0.03% BndryData::define() 19 0.003719 0.003793 0.004053 0.02% FillPatchSingleLevel 301 0.003281 0.003375 0.003473 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.002757 0.003073 0.003388 0.02% MLMG::mgVcycle_down::0 128 0.002789 0.002925 0.003021 0.02% StateDataPhysBCFunct::() 301 0.001959 0.002503 0.003013 0.02% MLMG::mgVcycle_down::2 128 0.002673 0.002774 0.002951 0.02% MLMG::mgVcycle_down::3 128 0.002665 0.002738 0.002895 0.02% MLMG::mgVcycle_down::5 128 0.002634 0.002734 0.002891 0.02% MLMG::mgVcycle_down::1 128 0.002659 0.002758 0.002876 0.02% Castro::construct_new_gravity() 17 0.002506 0.002594 0.002863 0.02% MLMG::actualBottomSolve() 128 0.0004302 0.0006048 0.002843 0.02% MLMG::mgVcycle_down::4 128 0.002598 0.002692 0.002811 0.02% MLCellLinOp::prepareForSolve() 19 0.001843 0.00201 0.002473 0.02% MLLinOp::defineGrids() 19 0.001988 0.002121 0.002383 0.01% MultiFab::Copy() 18 0.00218 0.002239 0.002286 0.01% MLMG::mgVcycle_up::2 128 0.001801 0.00191 0.002153 0.01% MultiFab::max() 8 0.0005927 0.001326 0.002122 0.01% MLCellLinOp::defineBC() 19 0.001787 0.001846 0.002113 0.01% MLMG::mgVcycle_up::5 128 0.001799 0.001863 0.002103 0.01% Castro::locWgtSum() 12 0.001942 0.001959 0.002033 0.01% MLMG::mgVcycle_up::4 128 0.001789 0.001868 0.002031 0.01% MLMG::mgVcycle_up::3 128 0.001798 0.001868 0.00203 0.01% MLMG::mgVcycle_up::0 128 0.001826 0.001893 0.002018 0.01% MLMG::mgVcycle_up::1 128 0.001801 0.001886 0.001975 0.01% Castro::clean_state() 79 0.001542 0.001579 0.001686 0.01% MLCellLinOp::solutionResidual() 147 0.001565 0.001634 0.001685 0.01% FabArrayBase::FB::FB() 75 0.0004498 0.0008807 0.001582 0.01% StateData::define() 6 0.001493 0.001526 0.001556 0.01% MLMG::MLRhsNormInf() 18 0.001349 0.001373 0.001416 0.01% Castro::post_init() 1 0.00053 0.001197 0.001358 0.01% Castro::subcycle_advance_ctu() 1 0.0004439 0.0005107 0.001122 0.01% Castro::problem_post_timestep() 2 0.0004705 0.000959 0.001094 0.01% main() 1 0.0008465 0.0009889 0.001091 0.01% Castro::swap_state_time_levels() 8 0.0005779 0.001032 0.001085 0.01% makeSFC 95 0.0008932 0.0009688 0.001042 0.01% MLMG::computeResidual() 128 0.0009118 0.0009599 0.001002 0.01% MLMG::mgVcycle_bottom 128 0.0008803 0.0009081 0.0009724 0.01% Castro::post_timestep() 1 0.0003599 0.0008036 0.0009442 0.01% MLCellLinOp::setLevelBC() 19 0.0006193 0.0007524 0.000937 0.01% Castro::volProductSum() 4 0.000834 0.0008555 0.0008941 0.01% TagBoxArray::collate() 2 9.329e-05 0.000414 0.0008913 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0006802 0.0007384 0.0008514 0.01% Gravity::test_composite_phi() 1 0.000469 0.0006188 0.0007991 0.00% AmrMesh::MakeNewGrids() 2 0.000559 0.0005906 0.0006231 0.00% Gravity::solve_phi_with_mlmg() 19 0.000424 0.0004559 0.0005592 0.00% DistributionMapping::Distribute() 95 0.000413 0.0004708 0.0005423 0.00% Gravity::applyMetricTerms() 2 0.0005161 0.0005245 0.0005419 0.00% Gravity::update_max_rhs() 2 0.000449 0.0004589 0.0004754 0.00% Castro::enforce_consistent_e() 1 0.0004048 0.0004171 0.0004365 0.00% MLPoisson::define() 19 0.0003089 0.0003279 0.0003636 0.00% Castro::check_for_nan() 37 0.000318 0.0003335 0.0003632 0.00% Castro::enforce_speed_limit() 79 0.0003013 0.0003206 0.0003443 0.00% Castro::initialize_advance() 1 0.0002664 0.0003186 0.0003438 0.00% Castro::apply_source_to_state() 37 0.0003048 0.0003156 0.0003355 0.00% MLMG::compResidual() 1 0.000271 0.0002886 0.0003123 0.00% Castro::finalize_do_advance() 17 0.0001832 0.0002007 0.000238 0.00% Castro::construct_old_gravity() 20 0.0002081 0.0002175 0.0002356 0.00% MLLinOp::define() 19 0.0001906 0.0002077 0.0002169 0.00% Castro::apply_tagging_restrictions() 2 0.0001625 0.0001794 0.0002031 0.00% MLPoisson::prepareForSolve() 19 0.0001555 0.0001727 0.0002005 0.00% Amr::coarseTimeStep() 1 0.0001591 0.0001851 0.0001895 0.00% OwnerMask() 2 0.000153 0.0001656 0.0001809 0.00% Castro::apply_problem_tags() 2 0.0001678 0.0001715 0.000175 0.00% MLMG::getGradSolution() 18 0.0001503 0.0001528 0.0001612 0.00% MLMG::computeMLResidual() 18 0.000133 0.0001413 0.00016 0.00% Castro::construct_old_rotation_source() 20 0.0001333 0.0001433 0.0001582 0.00% TagBoxArray::mapPRD 2 0.0001357 0.0001411 0.0001572 0.00% Gravity::actual_multilevel_solve() 1 0.000145 0.0001483 0.0001516 0.00% MLMG::MLResNormInf() 18 0.0001225 0.0001298 0.0001473 0.00% Amr::grid_places() 2 0.0001033 0.0001189 0.0001426 0.00% Castro::construct_new_rotation_source() 17 0.0001081 0.0001177 0.000133 0.00% Amr::FinalizeInit() 1 2.142e-05 2.953e-05 0.000113 0.00% Gravity::swapTimeLevels() 8 9.729e-05 0.0001025 0.000108 0.00% MultiFab::Swap() 5 8.3e-05 8.911e-05 0.0001052 0.00% MLMG::buildFineMask() 18 7.979e-05 9.023e-05 9.804e-05 0.00% Castro::estTimeStep() 19 7.142e-05 8.019e-05 9.288e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.308e-05 6.69e-05 7.833e-05 0.00% knapsack() 1 5.983e-05 6.41e-05 6.679e-05 0.00% AmrLevel::AmrLevel(dm) 1 4.921e-05 5.216e-05 5.438e-05 0.00% Amr::initSubcycle() 1 4.917e-05 4.917e-05 4.917e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.958e-05 2.829e-05 4.467e-05 0.00% Amr::regrid() 1 1.942e-05 2.272e-05 4.208e-05 0.00% BoxList::parallelComplementIn() 4 2.908e-05 3.459e-05 3.992e-05 0.00% Castro::finalize_advance() 1 2.763e-05 3.06e-05 3.533e-05 0.00% Amr::bldFineLevels() 1 1.25e-05 1.574e-05 3.092e-05 0.00% Castro::post_regrid() 2 2.025e-05 2.301e-05 3.054e-05 0.00% Amr::initialInit() 1 1.179e-05 1.329e-05 3e-05 0.00% Amr::timeStep() 1 2.146e-05 2.339e-05 2.975e-05 0.00% Castro::computeInitialDt() 2 1.796e-05 1.994e-05 2.937e-05 0.00% DistributionMapping::KnapSackDoIt() 1 2.704e-05 2.731e-05 2.792e-05 0.00% Amr::InitializeInit() 1 1.508e-05 1.596e-05 2.379e-05 0.00% Castro::errorEst() 2 2.163e-05 2.277e-05 2.346e-05 0.00% Amr::init() 1 2.146e-05 2.181e-05 2.183e-05 0.00% Castro::advance() 1 1.925e-05 2.032e-05 2.113e-05 0.00% BoxList::complementIn 4 1.558e-05 1.693e-05 1.767e-05 0.00% Castro::gwstrain() 2 7.5e-06 9.963e-06 1.267e-05 0.00% Gravity::set_mass_offset() 2 8.999e-06 9.082e-06 9.333e-06 0.00% Castro::FluxRegFineAdd() 1 2.75e-06 4.492e-06 5.375e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 16.3 16.3 16.3 100.00% Amr::coarseTimeStep() 1 14.02 14.02 14.02 85.98% Amr::timeStep() 1 13.96 13.96 13.96 85.62% Castro::advance() 1 13.85 13.85 13.85 84.97% Castro::subcycle_advance_ctu() 1 13.79 13.79 13.8 84.63% Castro::do_advance_ctu() 20 13.74 13.75 13.75 84.33% Castro::construct_ctu_hydro_source() 20 5.899 6.017 6.112 37.49% Castro::clean_state() 79 4.002 4.091 4.252 26.08% Castro::computeTemp() 80 2.62 2.704 2.888 17.72% Gravity::solve_phi_with_mlmg() 19 2 2.054 2.087 12.80% Castro::construct_new_gravity() 17 1.897 1.95 1.982 12.16% Gravity::solve_for_phi() 17 1.854 1.909 1.942 11.91% Castro::reset_internal_energy() 80 1.64 1.698 1.831 11.23% Gravity::actual_solve_with_mlmg() 19 1.783 1.787 1.791 10.99% MLMG::solve() 18 1.718 1.723 1.725 10.58% MLMG::oneIter() 128 1.561 1.564 1.567 9.61% MLMG::mgVcycle() 128 1.545 1.547 1.55 9.51% Castro::do_old_sources() 20 1.345 1.399 1.476 9.06% Castro::initialize_do_advance() 20 1.388 1.397 1.409 8.64% Castro::do_new_sources() 17 1.257 1.286 1.336 8.19% Castro::evaluate_source_change() 196 1.259 1.277 1.327 8.14% Amr::InitAmr() 1 1.32 1.32 1.321 8.10% FabArray::ParallelCopy() 1583 0.6783 1.063 1.252 7.68% Castro::enforce_min_density() 79 0.8942 0.9215 0.9737 5.97% Amr::init() 1 0.9643 0.9643 0.9643 5.91% MLCellLinOp::smooth() 3072 0.7309 0.7801 0.9144 5.61% Amr::initialInit() 1 0.9047 0.9048 0.9048 5.55% FabArray::ParallelCopy_finish() 1583 0.2877 0.6703 0.8601 5.28% MultiFab::AddProduct() 3920 0.7025 0.7172 0.7664 4.70% FillPatchIterator::Initialize 301 0.4833 0.5903 0.6696 4.11% FillPatchSingleLevel 301 0.4433 0.5565 0.6437 3.95% MLMG::mgVcycle_up::1 128 0.1145 0.3374 0.6074 3.73% Amr::InitializeInit() 1 0.4673 0.5165 0.5967 3.66% Amr::defBaseLevel() 1 0.4673 0.5165 0.5967 3.66% MLMG::addInterpCorrection() 768 0.1684 0.4617 0.5512 3.38% MLCellLinOp::applyBC() 7156 0.4237 0.4723 0.5277 3.24% Castro::normalize_species() 79 0.5131 0.519 0.5273 3.23% FabArray::setVal() 5502 0.5108 0.5158 0.5211 3.20% MLMG::mgVcycle_up::2 128 0.03171 0.1979 0.4601 2.82% Amr::FinalizeInit() 1 0.3081 0.3882 0.4374 2.68% MLPoisson::Fsmooth() 6144 0.3137 0.3405 0.4169 2.56% FabArray::FillBoundary() 6388 0.3284 0.3737 0.4122 2.53% FabArray::ParallelCopy_nowait() 1583 0.3568 0.3756 0.3989 2.45% MultiFab::Subtract() 159 0.3725 0.3765 0.3802 2.33% MLMG::mgVcycle_up::3 128 0.03164 0.0549 0.3611 2.21% MLMG::mgVcycle_down::0 128 0.2892 0.2921 0.2952 1.81% Gravity::fill_multipole_BCs() 19 0.2142 0.2656 0.2943 1.80% MultiFab::min() 23 0.00206 0.1405 0.2824 1.73% MLCellLinOp::apply() 994 0.1981 0.2123 0.2745 1.68% MLMG::mgVcycle_up::5 128 0.03103 0.04632 0.2646 1.62% MultiFab::sum() 3920 0.2505 0.2532 0.2553 1.57% Castro::construct_new_source() 102 0.2322 0.2352 0.2394 1.47% Castro::expand_state() 20 0.1978 0.2159 0.2338 1.43% MLMG::mgVcycle_bottom 128 0.001317 0.01523 0.2232 1.37% MLMG::actualBottomSolve() 128 0.0004302 0.01432 0.2223 1.36% MLCGSolver::bicgstab 8 0 0.01366 0.2185 1.34% MLMG::mgVcycle_up::0 128 0.2143 0.2152 0.2167 1.33% Castro::initData() 1 0.08471 0.1316 0.2155 1.32% MultiFab::Saxpy() 91 0.2091 0.2117 0.2154 1.32% Castro::post_init() 1 0.213 0.2137 0.2145 1.32% FillBoundary_nowait() 6388 0.1449 0.1732 0.2029 1.24% amrex::average_down 768 0.05121 0.06753 0.2023 1.24% MLMG:computeResOfCorrection() 768 0.1621 0.1724 0.1981 1.21% MLCellLinOp::correctionResidual() 776 0.1566 0.1675 0.1925 1.18% MLMG::mgVcycle_down::5 128 0.0379 0.04861 0.1888 1.16% Castro::create_source_corrector() 17 0.1438 0.1604 0.1802 1.11% Amr::bldFineLevels() 1 0.04864 0.1285 0.1777 1.09% Castro::derive() 156 0.1547 0.1557 0.1577 0.97% Castro::construct_old_source() 120 0.1537 0.1554 0.1572 0.96% MLMG::mgVcycle_down::1 128 0.1449 0.1493 0.1533 0.94% FillBoundary_finish() 6388 0.1109 0.131 0.1508 0.92% Gravity::multilevel_solve_for_new_phi() 1 0.1335 0.1335 0.1336 0.82% Gravity::actual_multilevel_solve() 1 0.1334 0.1335 0.1335 0.82% Amr::grid_places() 2 0.002223 0.0824 0.1316 0.81% AmrMesh::MakeNewGrids() 2 0.002081 0.08228 0.1315 0.81% TagBoxArray::mapPRD 2 0.0007804 0.08068 0.1301 0.80% MLPoisson::Fapply() 994 0.1097 0.1159 0.1279 0.78% MLCellLinOp::solutionResidual() 147 0.1041 0.1102 0.1171 0.72% Castro::post_timestep() 1 0.106 0.1083 0.1103 0.68% Amr::writePlotFile() 2 0.1026 0.1027 0.1027 0.63% MLMG::mgVcycle_down::2 128 0.03853 0.06689 0.09746 0.60% Castro::construct_new_gravity_source() 17 0.09393 0.09516 0.0964 0.59% Castro::construct_old_gravity() 20 0.04652 0.07822 0.09507 0.58% Gravity::get_old_grav_vector() 20 0.04628 0.078 0.09483 0.58% MLMG::computeResidual() 128 0.09161 0.09253 0.09367 0.57% Castro::post_regrid() 2 0.09119 0.092 0.09267 0.57% MLMG::mgVcycle_down::3 128 0.03835 0.04448 0.08797 0.54% Castro::apply_source_to_state() 37 0.08552 0.08649 0.08745 0.54% Castro::problem_post_timestep() 2 0.08167 0.08453 0.08678 0.53% Castro::construct_old_gravity_source() 20 0.07069 0.07149 0.07242 0.44% MultiFab::Xpay() 923 0.05676 0.0597 0.06535 0.40% MLMG::mgVcycle_down::4 128 0.03723 0.03939 0.06379 0.39% Castro::volWgtSum() 66 0.05982 0.06011 0.06094 0.37% Castro::initialize_advance() 1 0.05403 0.05472 0.05575 0.34% StateDataPhysBCFunct::() 301 0.001959 0.02742 0.05235 0.32% Castro::check_for_nan() 37 0.05019 0.05069 0.05114 0.31% MLMG::mgVcycle_up::4 128 0.03132 0.03307 0.05107 0.31% MLPoisson::define() 19 0.04015 0.04485 0.05086 0.31% MultiFab::contains_nan() 37 0.04986 0.05036 0.05083 0.31% StateData::FillBoundary(geom) 143 0 0.02492 0.04955 0.30% Castro::retry_advance_ctu() 11 0.04695 0.04752 0.049 0.30% Amr::regrid() 1 0.04668 0.04708 0.04747 0.29% CGSolver::sxay() 203 0 0.002787 0.04459 0.27% Gravity::get_new_grav_vector() 18 0.03986 0.04092 0.04209 0.26% Castro::wd_update() 2 0.03409 0.03728 0.03956 0.24% MLCellLinOp::defineAuxData() 19 0.02718 0.02873 0.03421 0.21% FabArrayBase::getFB() 6388 0.02497 0.02638 0.03264 0.20% VisMF::Write(FabArray) 4 0.01473 0.01651 0.02845 0.17% MLCGSolver::ParallelAllReduce 189 0 0.001625 0.02599 0.16% Castro::volInBoundary() 14 0.0233 0.0238 0.02549 0.16% MLMG::prepareForSolve() 18 0.02085 0.02173 0.02492 0.15% MLMG::computeMLResidual() 18 0.01266 0.0179 0.02351 0.14% MLMG::ResNormInf() 146 0.01664 0.01982 0.02342 0.14% FabArrayBase::getCPC() 2005 0.01781 0.01923 0.02301 0.14% MultiFab::LinComb() 203 0 0.001247 0.01995 0.12% FabArray::setDomainBndry() 301 0.001616 0.01058 0.01953 0.12% Gravity::test_composite_phi() 1 0.01612 0.01616 0.01617 0.10% Amr::writeSmallPlotFile() 2 0.01574 0.01574 0.01574 0.10% MultiFab::Dot() 142 0 0.0008127 0.013 0.08% MLLinOp::define() 19 0.004693 0.008652 0.01298 0.08% MLLinOp::defineGrids() 19 0.00449 0.008444 0.01277 0.08% MLMG::getGradSolution() 18 0.009079 0.00928 0.009802 0.06% MLCellLinOp::compGrad() 18 0.008927 0.009127 0.009648 0.06% FabArray::mult() 59 0.008038 0.008244 0.008964 0.05% MLLinOp::makeSubCommunicator() 19 0.0002694 0.004145 0.008216 0.05% FabArrayBase::CPC::define() 576 0.003423 0.004771 0.008138 0.05% MLCellLinOp::defineBC() 19 0.006934 0.007139 0.00753 0.05% MLPoisson::normalize() 79 0 0.0004175 0.006681 0.04% Castro::locWgtSum() 12 0.005848 0.005907 0.006115 0.04% BndryData::define() 19 0.005112 0.005293 0.00542 0.03% Castro::volProductSum() 4 0.003445 0.003475 0.00355 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.002757 0.003073 0.003388 0.02% Gravity::update_max_rhs() 2 0.001567 0.002289 0.003099 0.02% MLPoisson::prepareForSolve() 19 0.002012 0.002182 0.002673 0.02% MLCellLinOp::prepareForSolve() 19 0.001843 0.00201 0.002473 0.02% MLLinOp::makeAgglomeratedDMap 19 0.001991 0.002178 0.002415 0.01% MultiFab::Copy() 18 0.00218 0.002239 0.002286 0.01% MultiFab::max() 8 0.0005927 0.001326 0.002122 0.01% AmrLevel::AmrLevel(dm) 1 0.001544 0.001578 0.001605 0.01% FabArrayBase::FB::FB() 75 0.0004498 0.0008807 0.001582 0.01% makeSFC 95 0.001311 0.00144 0.001577 0.01% StateData::define() 6 0.001493 0.001526 0.001556 0.01% MLMG::MLResNormInf() 18 0.001489 0.001514 0.001537 0.01% MLMG::compResidual() 1 0.001101 0.001286 0.001521 0.01% Gravity::swapTimeLevels() 8 0.001359 0.00139 0.001437 0.01% MLMG::MLRhsNormInf() 18 0.001349 0.001373 0.001416 0.01% Castro::swap_state_time_levels() 8 0.0005779 0.001032 0.001085 0.01% MLCellLinOp::setLevelBC() 19 0.0006193 0.0007524 0.000937 0.01% TagBoxArray::collate() 2 9.329e-05 0.000414 0.0008913 0.01% DistributionMapping::Distribute() 95 0.000413 0.0004708 0.0005423 0.00% Gravity::applyMetricTerms() 2 0.0005161 0.0005245 0.0005419 0.00% Castro::enforce_consistent_e() 1 0.0004048 0.0004171 0.0004365 0.00% Castro::errorEst() 2 0.000357 0.0003737 0.0003974 0.00% Castro::enforce_speed_limit() 79 0.0003013 0.0003206 0.0003443 0.00% Castro::finalize_do_advance() 17 0.0001832 0.0002007 0.000238 0.00% Castro::apply_tagging_restrictions() 2 0.0001625 0.0001794 0.0002031 0.00% OwnerMask() 2 0.000153 0.0001656 0.0001809 0.00% Castro::apply_problem_tags() 2 0.0001678 0.0001715 0.000175 0.00% Castro::construct_old_rotation_source() 20 0.0001333 0.0001433 0.0001582 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001077 0.0001197 0.0001378 0.00% Castro::construct_new_rotation_source() 17 0.0001081 0.0001177 0.000133 0.00% MultiFab::Swap() 5 8.3e-05 8.911e-05 0.0001052 0.00% MLMG::buildFineMask() 18 7.979e-05 9.023e-05 9.804e-05 0.00% Castro::estTimeStep() 19 7.142e-05 8.019e-05 9.288e-05 0.00% knapsack() 1 5.983e-05 6.41e-05 6.679e-05 0.00% BoxList::parallelComplementIn() 4 4.592e-05 5.151e-05 5.721e-05 0.00% Amr::initSubcycle() 1 4.917e-05 4.917e-05 4.917e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.958e-05 2.829e-05 4.467e-05 0.00% Castro::finalize_advance() 1 3.075e-05 3.509e-05 4.008e-05 0.00% Castro::computeInitialDt() 2 2.663e-05 2.889e-05 3.779e-05 0.00% BoxList::complementIn 4 1.558e-05 1.693e-05 1.767e-05 0.00% Castro::gwstrain() 2 7.5e-06 9.963e-06 1.267e-05 0.00% Gravity::set_mass_offset() 2 8.999e-06 9.082e-06 9.333e-06 0.00% Castro::FluxRegFineAdd() 1 2.75e-06 4.492e-06 5.375e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 2) :: [0.0e0, 0.0e0] [TOP]::castro.dtnuc_mode(nvals = 1) :: [1] [TOP]::integrator.do_constant_volume_burn(nvals = 1) :: [1] [TOP]::mg.v(nvals = 1) :: [0] AMReX (22.01-12-g1404c4a9acc6) finalized