Initializing AMReX (24.04-9-g2a3955a5f5aa)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.04-9-g2a3955a5f5aa) initialized Starting run at 07:12:06 UTC on 2024-04-10. Successfully read inputs file ... Castro git describe: 24.04-11-g2407e8176 AMReX git describe: 24.04-9-g2a3955a5f Microphysics git describe: 24.04-5-g43dc7a53 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.150577151 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001083176 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.011442601 Gravity::multilevel_solve_for_new_phi() time = 0.105927445 Gravity::fill_multipole_BCs() time = 0.010661939 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.048936538 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.005203787 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003888826 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.062513692 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007584654 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.061742483 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007780978 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.059625107 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005933742 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058631056 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.322704516 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014301989 Gravity::solve_for_phi() time = 0.087216411 on level 0 Castro::construct_new_gravity() time = 0.089308962 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.061896147 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.003683755 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.057896955 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321853988 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014465714 Gravity::solve_for_phi() time = 0.089582907 on level 0 Castro::construct_new_gravity() time = 0.091628749 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.05904675 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002845538 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060717991 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331970927 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014524851 Gravity::solve_for_phi() time = 0.086188172 on level 0 Castro::construct_new_gravity() time = 0.08938289 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.0604512 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002710739 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060630992 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336175157 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014532792 Gravity::solve_for_phi() time = 0.089776597 on level 0 Castro::construct_new_gravity() time = 0.091819716 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.060302813 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002734603 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058944468 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336736715 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015223766 Gravity::solve_for_phi() time = 0.087511571 on level 0 Castro::construct_new_gravity() time = 0.089643657 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060504293 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002664146 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058541043 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323660422 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014476369 Gravity::solve_for_phi() time = 0.083822475 on level 0 Castro::construct_new_gravity() time = 0.085873793 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.058169135 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002215684 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.063341846 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331359756 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014646806 Gravity::solve_for_phi() time = 0.084213475 on level 0 Castro::construct_new_gravity() time = 0.086292131 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.058433022 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002539964 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.057906007 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325013876 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01623286 Gravity::solve_for_phi() time = 0.084901801 on level 0 Castro::construct_new_gravity() time = 0.08702629 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.058784971 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00265635 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.057840417 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330658091 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015096287 Gravity::solve_for_phi() time = 0.083949566 on level 0 Castro::construct_new_gravity() time = 0.086049154 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.058595102 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002603701 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.057961551 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324463207 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015150284 Gravity::solve_for_phi() time = 0.084349535 on level 0 Castro::construct_new_gravity() time = 0.086402207 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.058228174 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002555868 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.057712513 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329410575 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015113468 Gravity::solve_for_phi() time = 0.084294354 on level 0 Castro::construct_new_gravity() time = 0.086337361 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.058602121 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002838179 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.057519368 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33373104 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.020195256 Gravity::solve_for_phi() time = 0.090276091 on level 0 Castro::construct_new_gravity() time = 0.092459409 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059786063 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003678404 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059064163 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331373651 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015187009 Gravity::solve_for_phi() time = 0.083892085 on level 0 Castro::construct_new_gravity() time = 0.085981561 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.058079502 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002706312 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.057576166 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325445674 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015379462 Gravity::solve_for_phi() time = 0.084129617 on level 0 Castro::construct_new_gravity() time = 0.086208765 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059243809 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002688248 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.057497093 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331604418 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015502263 Gravity::solve_for_phi() time = 0.084943942 on level 0 Castro::construct_new_gravity() time = 0.086994155 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.058095126 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.00265764 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.061592888 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329554254 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015681247 Gravity::solve_for_phi() time = 0.085111939 on level 0 Castro::construct_new_gravity() time = 0.087163806 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059271568 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002873478 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.061518383 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336093779 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017791324 Gravity::solve_for_phi() time = 0.089898796 on level 0 Castro::construct_new_gravity() time = 0.092045068 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.058556606 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002797310647 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.7769489 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.048296076 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.005585869 seconds Ending run at 07:12:21 UTC on 2024-04-10. Run time = 14.55545016 Run time without initialization = 11.83180998 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.56 ... 14.56 ... 14.56 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3470 5.4245 5.5545 38.16% Amr::InitAmr() 1 1.803 1.803 1.803 12.39% Castro::computeTemp() 80 0.8317 0.9392 1.092 7.50% amrex::Copy() 724 0.7659 0.7739 0.7876 5.41% FabArray::ParallelCopy_finish() 1429 0.05952 0.4863 0.7051 4.84% MultiFab::AddProduct() 3439 0.5467 0.5514 0.5676 3.90% Castro::normalize_species() 79 0.5351 0.5406 0.5493 3.77% Castro::reset_internal_energy(Fab) 160 0.5118 0.5181 0.5242 3.60% MLPoisson::Fsmooth() 6144 0.3108 0.3374 0.4102 2.82% Castro::initMFs() 1 0.3528 0.3597 0.373 2.56% FabArray::setVal() 5013 0.3502 0.3567 0.3651 2.51% MultiFab::Subtract() 159 0.3403 0.3436 0.3516 2.42% Gravity::fill_multipole_BCs() 19 0.2023 0.2417 0.2793 1.92% check_for_negative_density() 20 0.03053 0.1822 0.2629 1.81% FabArray::ParallelCopy_nowait() 1429 0.1848 0.2031 0.2172 1.49% FabArray::sum() 3439 0.1871 0.1888 0.1951 1.34% Castro::reset_internal_energy(MultiFab) 80 0.02271 0.05703 0.1713 1.18% Castro::initData() 1 0.00328 0.02608 0.1508 1.04% FillBoundary_finish() 6380 0.1047 0.1228 0.1456 1.00% FillBoundary_nowait() 6380 0.07657 0.1028 0.1298 0.89% MLPoisson::Fapply() 986 0.09459 0.09939 0.1141 0.78% MLCellLinOp::applyBC() 7148 0.04669 0.0622 0.1039 0.71% FabArray::Saxpy() 264 0.06802 0.06906 0.07626 0.52% Castro::construct_new_gravity_source() 17 0.06801 0.06894 0.06996 0.48% FabArray::Xpay() 945 0.05082 0.05302 0.06023 0.41% Castro::enforce_min_density() 79 0.01762 0.02879 0.0575 0.40% Castro::do_new_sources() 17 0.0003564 0.01006 0.05615 0.39% Castro::sum_integrated_quantities() 2 0.001589 0.04907 0.05247 0.36% Castro::problem_post_timestep() 2 1.083e-05 0.003161 0.0504 0.35% Castro::construct_old_gravity_source() 20 0.04573 0.04605 0.04708 0.32% MultiFab::contains_nan() 37 0.04432 0.04492 0.04707 0.32% Castro::do_old_sources() 20 0.0004971 0.01193 0.0461 0.32% MLMG::addInterpCorrection() 768 0.03301 0.03561 0.04229 0.29% AmrLevel::derive() 18 0.03988 0.04051 0.04169 0.29% StateData::FillBoundary(geom) 143 0 0.01735 0.03347 0.23% amrex::average_down 768 0.02452 0.02645 0.03234 0.22% VisMF::Write(FabArray) 4 0.01282 0.01426 0.02444 0.17% Amr::writePlotFile() 2 0.008845 0.01784 0.0198 0.14% MLCellLinOp::defineAuxData() 19 0.01469 0.01544 0.01788 0.12% FabArray::FillBoundary() 6380 0.01361 0.01422 0.01713 0.12% Castro::construct_new_source() 102 0.01544 0.01566 0.01683 0.12% MLCGSolver::bicgstab 8 0 0.001016 0.01626 0.11% Castro::wd_update() 2 0.005128 0.01241 0.01553 0.11% FabArray::norminf() 282 0.01096 0.01143 0.01548 0.11% amrex::Add() 128 0.01419 0.01432 0.01458 0.10% FillPatchIterator::Initialize 147 0.01237 0.01282 0.01331 0.09% Castro::evaluate_source_change() 196 0.01237 0.01265 0.01299 0.09% FabArrayBase::getFB() 6380 0.009757 0.01018 0.01279 0.09% MLCellLinOp::smooth() 3072 0.01107 0.01152 0.0124 0.09% Castro::construct_old_gravity() 20 0.0003729 0.002185 0.01187 0.08% FabArray::setDomainBndry() 147 0.00045 0.006145 0.01147 0.08% MLMG::prepareForSolve() 18 0.01023 0.0105 0.01109 0.08% MLMG::ResNormInf() 146 0.005633 0.007892 0.01099 0.08% Castro::construct_old_source() 120 0.009813 0.009911 0.01016 0.07% MLLinOp::makeSubCommunicator() 19 0.001027 0.004664 0.008693 0.06% Gravity::actual_solve_with_mlmg() 19 0.006724 0.007044 0.008019 0.06% FabArrayBase::getCPC() 2005 0.007165 0.007415 0.007787 0.05% FabArray::mult() 59 0.007319 0.007445 0.007723 0.05% Castro::volWgtSum() 46 0.007293 0.007382 0.007578 0.05% Amr::writeSmallPlotFile() 2 0.005181 0.007143 0.007386 0.05% Gravity::get_old_grav_vector() 20 0.006349 0.006537 0.00697 0.05% Gravity::get_new_grav_vector() 18 0.005957 0.006191 0.006661 0.05% MLCellLinOp::compGrad() 18 0.005821 0.005976 0.0066 0.05% MLMG::solve() 18 0.0008407 0.003556 0.006356 0.04% FabArrayBase::CPC::define() 576 0.002148 0.00329 0.006354 0.04% amrex::Dot() 142 0 0.0003728 0.005966 0.04% Castro::volInBoundary() 14 0.003387 0.003694 0.005359 0.04% Castro::initialize_do_advance() 20 0.004458 0.004771 0.005215 0.04% MultiFab::max() 2 0.0009689 0.002962 0.004923 0.03% MLCGSolver::ParallelAllReduce 227 0 0.0002984 0.004774 0.03% MLCellLinOp::apply() 986 0.001981 0.002198 0.004629 0.03% FabArray::ParallelCopy() 1429 0.003516 0.003662 0.003997 0.03% BndryData::define() 19 0.003091 0.003149 0.003236 0.02% MLPoisson::normalize() 79 0 0.0001979 0.003166 0.02% AmrLevel::FillPatch() 147 0.002119 0.002246 0.002329 0.02% MLCellLinOp::prepareForSolve() 19 0.001671 0.001795 0.002149 0.01% Castro::construct_new_gravity() 17 0.0002893 0.0007064 0.002105 0.01% MLLinOp::defineGrids() 19 0.00175 0.001892 0.002057 0.01% MLCellLinOp::correctionResidual() 768 0.00183 0.001884 0.00196 0.01% MLMG::mgVcycle() 128 0.001605 0.001689 0.00185 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001301 0.001556 0.001761 0.01% MLCellLinOp::defineBC() 19 0.001492 0.001531 0.00168 0.01% Castro::save_data_for_retry() 3 0.001253 0.001334 0.001645 0.01% StateData::define() 6 0.001308 0.001468 0.001627 0.01% MLMG:computeResOfCorrection() 768 0.00138 0.001424 0.001503 0.01% FabArrayBase::FB::FB() 75 0.0002797 0.000668 0.001445 0.01% main() 1 0.001026 0.001208 0.001381 0.01% Gravity::solve_for_phi() 17 0.0008111 0.0009396 0.001293 0.01% Castro::locWgtSum() 6 0.001114 0.001129 0.001154 0.01% MLMG::actualBottomSolve() 128 0.0001305 0.0001954 0.00106 0.01% StateDataPhysBCFunct::() 147 0.0006613 0.0008152 0.000936 0.01% Castro::subcycle_advance_ctu() 1 0.0001726 0.0002472 0.0008658 0.01% MLCellLinOp::setLevelBC() 19 0.0005339 0.0006702 0.0008515 0.01% MLMG::mgVcycle_down::2 128 0.0006186 0.0006725 0.0007453 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006788 0.0007035 0.0007367 0.01% MLMG::mgVcycle_down::3 128 0.0005745 0.0006245 0.000718 0.00% MLMG::mgVcycle_down::4 128 0.0005625 0.0005855 0.0006917 0.00% MLMG::mgVcycle_down::0 128 0.0006526 0.0006673 0.0006846 0.00% MLMG::mgVcycle_down::1 128 0.0006484 0.0006656 0.0006839 0.00% MLMG::mgVcycle_down::5 128 0.0005832 0.0006053 0.0006748 0.00% Castro::buildMetrics() 1 0.0005863 0.0006068 0.0006261 0.00% Castro::Castro() 1 0.0004623 0.0005028 0.0005452 0.00% AmrMesh::MakeNewGrids() 2 0.0004934 0.0005142 0.000542 0.00% Castro::do_advance_ctu() 20 0.000418 0.0004615 0.0005331 0.00% Castro::apply_tagging_restrictions() 2 0.0004043 0.000472 0.0005326 0.00% Castro::swap_state_time_levels() 8 0.0004657 0.0004878 0.0005236 0.00% Castro::clean_state() 79 0.0004564 0.0004863 0.0005214 0.00% Gravity::applyMetricTerms() 2 0.0004693 0.0004844 0.0005043 0.00% MLMG::mgVcycle_up::1 128 0.0004595 0.0004809 0.0005035 0.00% FillPatchSingleLevel 147 0.0004628 0.0004815 0.000499 0.00% MLMG::mgVcycle_up::0 128 0.0004648 0.0004783 0.0004936 0.00% MLMG::mgVcycle_up::2 128 0.0003888 0.0004312 0.0004813 0.00% MLMG::mgVcycle_up::3 128 0.0003853 0.0004049 0.0004809 0.00% MLMG::mgVcycle_up::5 128 0.0003997 0.0004122 0.0004666 0.00% MLCellLinOp::solutionResidual() 147 0.000423 0.0004338 0.0004634 0.00% MLMG::mgVcycle_up::4 128 0.0003902 0.0004033 0.0004425 0.00% makeSFC 95 0.000369 0.0003918 0.0004214 0.00% Castro::enforce_consistent_e() 1 0.000365 0.0003771 0.0004195 0.00% Castro::volProductSum() 2 0.0003999 0.0004045 0.0004136 0.00% MLMG::oneIter() 128 0.0003809 0.0003927 0.000401 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003231 0.0003443 0.000392 0.00% TagBoxArray::collate() 2 0.0001088 0.0002263 0.0003669 0.00% DistributionMapping::Distribute() 95 0.0002096 0.0002259 0.0002759 0.00% MLMG::computeResidual() 128 0.0002344 0.0002472 0.0002658 0.00% Gravity::solve_phi_with_mlmg() 19 0.000221 0.0002363 0.0002558 0.00% MLMG::mgVcycle_bottom 128 0.0002283 0.0002351 0.0002467 0.00% Castro::finalize_do_advance() 17 0.0001629 0.0001791 0.0001956 0.00% Gravity::update_max_rhs() 2 0.000164 0.0001719 0.0001948 0.00% DistributionMapping::LeastUsedCPUs() 1 3.874e-05 0.0001695 0.0001911 0.00% MLMG::compResidual() 1 0.0001588 0.0001669 0.0001799 0.00% Amr::coarseTimeStep() 1 0.0001385 0.0001678 0.0001735 0.00% Castro::retry_advance_ctu() 11 5.534e-05 7.376e-05 0.0001642 0.00% MLPoisson::define() 19 0.0001296 0.0001397 0.0001596 0.00% OwnerMask() 2 0.000134 0.0001505 0.0001591 0.00% Castro::initialize_advance() 1 0.0001277 0.0001404 0.0001542 0.00% Amr::defBaseLevel() 1 8.533e-05 0.0001193 0.0001387 0.00% Castro::check_for_nan() 37 0.0001034 0.0001155 0.0001384 0.00% Castro::enforce_speed_limit() 79 0.00011 0.0001203 0.0001346 0.00% TagBoxArray::mapPRD 2 0.000111 0.0001167 0.000124 0.00% Castro::apply_source_to_state() 37 9.568e-05 0.0001062 0.0001208 0.00% Gravity::test_composite_phi() 1 9.119e-05 9.823e-05 0.0001152 0.00% Amr::grid_places() 2 6.881e-05 7.92e-05 0.0001008 0.00% MultiFab::Swap() 5 6.791e-05 7.542e-05 9.957e-05 0.00% Castro::apply_problem_tags() 2 9.135e-05 9.354e-05 9.61e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.191e-05 7.033e-05 9.4e-05 0.00% MLLinOp::define() 19 7.531e-05 8.422e-05 9.231e-05 0.00% MLPoisson::prepareForSolve() 19 7.435e-05 7.873e-05 8.478e-05 0.00% Amr::initSubcycle() 1 5.513e-05 6.778e-05 7.43e-05 0.00% Castro::create_source_corrector() 17 5.573e-05 6.463e-05 7.135e-05 0.00% knapsack() 1 5.59e-05 6.005e-05 7.035e-05 0.00% Castro::expand_state() 20 5.292e-05 5.659e-05 6.414e-05 0.00% MLMG::computeMLResidual() 18 3.906e-05 4.529e-05 5.362e-05 0.00% Amr::FinalizeInit() 1 8.347e-06 1.207e-05 5.225e-05 0.00% MLMG::getGradSolution() 18 3.861e-05 4.201e-05 4.97e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.476e-05 3.709e-05 4.707e-05 0.00% Castro::derive() 18 4.066e-05 4.34e-05 4.604e-05 0.00% Gravity::swapTimeLevels() 8 3.322e-05 3.895e-05 4.325e-05 0.00% MLMG::MLResNormInf() 18 3.345e-05 3.545e-05 4.22e-05 0.00% MLMG::MLRhsNormInf() 18 3.079e-05 3.206e-05 3.329e-05 0.00% Castro::construct_old_rotation_source() 20 2.989e-05 3.052e-05 3.147e-05 0.00% Amr::regrid() 1 1.068e-05 1.268e-05 3.064e-05 0.00% Amr::timeStep() 1 1.265e-05 1.76e-05 3.015e-05 0.00% Gravity::actual_multilevel_solve() 1 2.675e-05 2.848e-05 3.01e-05 0.00% Castro::finalize_advance() 1 1.686e-05 2.043e-05 2.762e-05 0.00% Castro::construct_new_rotation_source() 17 2.084e-05 2.209e-05 2.588e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.585e-05 1.776e-05 1.949e-05 0.00% Castro::estTimeStep() 10 1.28e-05 1.392e-05 1.754e-05 0.00% Castro::post_init() 1 1.167e-05 1.253e-05 1.684e-05 0.00% Castro::advance() 1 7.353e-06 9.59e-06 1.428e-05 0.00% Amr::InitializeInit() 1 6.348e-06 7.532e-06 1.271e-05 0.00% Castro::post_regrid() 2 1.097e-05 1.165e-05 1.27e-05 0.00% Amr::init() 1 7.191e-06 8.175e-06 9.897e-06 0.00% Castro::computeInitialDt() 2 6.829e-06 7.701e-06 9.884e-06 0.00% BoxList::parallelComplementIn() 4 6.882e-06 7.341e-06 9.822e-06 0.00% BoxList::complementIn 4 5.974e-06 6.351e-06 8.342e-06 0.00% Gravity::set_mass_offset() 2 4.496e-06 5.443e-06 7.939e-06 0.00% Amr::bldFineLevels() 1 6.528e-06 7.015e-06 7.838e-06 0.00% Castro::post_timestep() 1 5.64e-06 6.078e-06 6.916e-06 0.00% Castro::gwstrain() 2 4.307e-06 4.728e-06 6.88e-06 0.00% Castro::errorEst() 2 5.909e-06 6.266e-06 6.862e-06 0.00% Amr::initialInit() 1 2.798e-06 3.144e-06 3.63e-06 0.00% Castro::FluxRegCrseInit 1 1.772e-06 1.999e-06 2.644e-06 0.00% Castro::FluxRegFineAdd() 1 1.38e-06 1.547e-06 1.958e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.56 14.56 14.56 100.00% Amr::coarseTimeStep() 1 11.83 11.83 11.83 81.28% Amr::timeStep() 1 11.78 11.78 11.78 80.91% Castro::advance() 1 11.71 11.71 11.72 80.49% Castro::subcycle_advance_ctu() 1 11.66 11.66 11.66 80.14% Castro::do_advance_ctu() 20 11.62 11.62 11.63 79.88% Castro::construct_ctu_hydro_source() 20 6.343 6.376 6.421 44.12% Castro::clean_state() 79 3.666 3.75 3.9 26.79% Castro::computeTemp() 80 2.357 2.461 2.663 18.29% Amr::InitAmr() 1 1.803 1.803 1.803 12.39% Castro::reset_internal_energy(MultiFab) 80 1.473 1.522 1.644 11.30% Gravity::solve_phi_with_mlmg() 19 1.494 1.536 1.578 10.84% Castro::construct_new_gravity() 17 1.416 1.457 1.498 10.29% Gravity::solve_for_phi() 17 1.377 1.419 1.461 10.04% Castro::initialize_do_advance() 20 1.357 1.388 1.418 9.74% Gravity::actual_solve_with_mlmg() 19 1.287 1.291 1.295 8.90% MLMG::solve() 18 1.236 1.24 1.242 8.53% Castro::do_old_sources() 20 1.139 1.165 1.183 8.13% MLMG::oneIter() 128 1.102 1.104 1.106 7.60% MLMG::mgVcycle() 128 1.087 1.089 1.091 7.50% Castro::do_new_sources() 17 0.9332 0.9669 1.006 6.91% Castro::evaluate_source_change() 196 0.9458 0.9542 0.9822 6.75% FabArray::ParallelCopy() 1429 0.2882 0.7124 0.9272 6.37% Amr::init() 1 0.9199 0.9201 0.9201 6.32% Amr::initialInit() 1 0.8649 0.8651 0.8652 5.94% Castro::enforce_min_density() 79 0.7839 0.8012 0.843 5.79% amrex::Copy() 724 0.7659 0.7739 0.7876 5.41% MLCellLinOp::smooth() 3072 0.5523 0.6025 0.7267 4.99% FabArray::ParallelCopy_finish() 1429 0.05952 0.4863 0.7051 4.84% AmrLevel::FillPatch() 147 0.4803 0.557 0.6359 4.37% Amr::InitializeInit() 1 0.4367 0.4937 0.5861 4.03% Amr::defBaseLevel() 1 0.4366 0.4937 0.5861 4.03% MultiFab::AddProduct() 3439 0.5467 0.5514 0.5676 3.90% Castro::normalize_species() 79 0.5351 0.5406 0.5493 3.77% Castro::reset_internal_energy(Fab) 160 0.5118 0.5181 0.5242 3.60% FillPatchIterator::Initialize 147 0.3032 0.3806 0.4612 3.17% FillPatchIterator::FillFromLevel0() 147 0.2787 0.3617 0.4444 3.05% FillPatchSingleLevel 147 0.278 0.361 0.4437 3.05% Amr::FinalizeInit() 1 0.2791 0.3714 0.4284 2.94% MLMG::mgVcycle_up::1 128 0.0995 0.2624 0.4262 2.93% MLPoisson::Fsmooth() 6144 0.3108 0.3374 0.4102 2.82% MLCellLinOp::applyBC() 7148 0.2795 0.3129 0.3802 2.61% Castro::Castro() 1 0.3581 0.3651 0.3783 2.60% Castro::initMFs() 1 0.353 0.3599 0.3732 2.56% MLMG::addInterpCorrection() 768 0.06458 0.3005 0.3719 2.56% FabArray::setVal() 5013 0.3502 0.3567 0.3651 2.51% MultiFab::Subtract() 159 0.3403 0.3436 0.3516 2.42% FabArray::FillBoundary() 6380 0.22 0.2507 0.2913 2.00% Gravity::fill_multipole_BCs() 19 0.2044 0.2438 0.2814 1.93% MLMG::mgVcycle_up::2 128 0.01067 0.1153 0.2746 1.89% check_for_negative_density() 20 0.03053 0.1822 0.2629 1.81% MLMG::mgVcycle_down::0 128 0.256 0.2583 0.2607 1.79% Castro::expand_state() 20 0.1794 0.2084 0.2404 1.65% FabArray::ParallelCopy_nowait() 1429 0.2035 0.2224 0.2372 1.63% Castro::initData() 1 0.07638 0.1267 0.2242 1.54% MLMG::mgVcycle_up::0 128 0.1998 0.2005 0.2011 1.38% FabArray::sum() 3439 0.1871 0.1888 0.1951 1.34% Amr::bldFineLevels() 1 0.0459 0.1378 0.194 1.33% MLCellLinOp::apply() 986 0.1498 0.159 0.1933 1.33% Castro::post_init() 1 0.1886 0.1906 0.1925 1.32% MLMG::mgVcycle_up::3 128 0.01062 0.02329 0.1758 1.21% Amr::grid_places() 2 0.002254 0.09464 0.1517 1.04% AmrMesh::MakeNewGrids() 2 0.002153 0.09456 0.1516 1.04% TagBoxArray::mapPRD 2 0.0007206 0.09309 0.1502 1.03% FillBoundary_finish() 6380 0.1047 0.1228 0.1456 1.00% MLMG:computeResOfCorrection() 768 0.1113 0.1214 0.1448 1.00% MLCellLinOp::correctionResidual() 768 0.11 0.1199 0.1433 0.98% FillBoundary_nowait() 6380 0.08667 0.1136 0.1411 0.97% Castro::construct_new_source() 102 0.1224 0.1238 0.1257 0.86% MLMG::mgVcycle_down::1 128 0.1117 0.1156 0.1195 0.82% MLPoisson::Fapply() 986 0.09459 0.09939 0.1141 0.78% Gravity::multilevel_solve_for_new_phi() 1 0.1059 0.1059 0.106 0.73% Gravity::actual_multilevel_solve() 1 0.1058 0.1058 0.1059 0.73% Amr::writePlotFile() 2 0.0978 0.09788 0.09789 0.67% MLCellLinOp::solutionResidual() 147 0.0875 0.09282 0.0977 0.67% Castro::post_regrid() 2 0.08419 0.08607 0.08808 0.61% Castro::construct_old_source() 120 0.07849 0.07903 0.08001 0.55% MLMG::computeResidual() 128 0.07619 0.07709 0.07834 0.54% FabArray::Saxpy() 264 0.06802 0.06906 0.07626 0.52% Castro::create_source_corrector() 17 0.04803 0.05826 0.07431 0.51% Castro::sum_integrated_quantities() 2 0.0209 0.06807 0.07122 0.49% MLMG::mgVcycle_down::2 128 0.01247 0.04037 0.07095 0.49% MLMG::mgVcycle_bottom 128 0.0003631 0.004782 0.07094 0.49% MLMG::actualBottomSolve() 128 0.0001305 0.004547 0.07069 0.49% Castro::derive() 18 0.06787 0.06885 0.07029 0.48% AmrLevel::derive() 18 0.06783 0.06881 0.07025 0.48% Castro::construct_new_gravity_source() 17 0.06801 0.06894 0.06996 0.48% MLCGSolver::bicgstab 8 0 0.004323 0.06916 0.48% Castro::post_timestep() 1 0.06167 0.06448 0.06687 0.46% Castro::construct_old_gravity() 20 0.04578 0.05605 0.0645 0.44% Gravity::get_old_grav_vector() 20 0.04077 0.05387 0.06408 0.44% Castro::problem_post_timestep() 2 0.008675 0.01926 0.0638 0.44% FabArray::Xpay() 945 0.05082 0.05302 0.06023 0.41% MLMG::mgVcycle_down::3 128 0.01187 0.01796 0.05948 0.41% amrex::average_down 768 0.03274 0.03888 0.0547 0.38% Castro::initialize_advance() 1 0.04875 0.04986 0.05132 0.35% Castro::check_for_nan() 37 0.04443 0.04503 0.04718 0.32% Castro::construct_old_gravity_source() 20 0.04573 0.04605 0.04708 0.32% MultiFab::contains_nan() 37 0.04432 0.04492 0.04707 0.32% Amr::regrid() 1 0.04332 0.04422 0.04506 0.31% MLPoisson::define() 19 0.02915 0.03375 0.03903 0.27% Castro::retry_advance_ctu() 11 0.03547 0.03681 0.03817 0.26% Gravity::get_new_grav_vector() 18 0.03473 0.0362 0.03758 0.26% MLMG::mgVcycle_down::4 128 0.01175 0.0134 0.03467 0.24% StateDataPhysBCFunct::() 147 0.0006613 0.01816 0.03436 0.24% StateData::FillBoundary(geom) 143 0 0.01735 0.03347 0.23% Castro::apply_source_to_state() 37 0.0277 0.02799 0.02826 0.19% MLMG::mgVcycle_up::4 128 0.0107 0.01185 0.02683 0.18% MLCellLinOp::defineAuxData() 19 0.01872 0.02027 0.02465 0.17% VisMF::Write(FabArray) 4 0.01282 0.01426 0.02444 0.17% MLMG::prepareForSolve() 18 0.02057 0.02143 0.02391 0.16% MLMG::mgVcycle_down::5 128 0.01173 0.01258 0.02284 0.16% MLMG::ResNormInf() 146 0.01535 0.01761 0.02071 0.14% Castro::save_data_for_retry() 3 0.01843 0.01892 0.02027 0.14% MLMG::computeMLResidual() 18 0.01075 0.01529 0.02008 0.14% MLMG::mgVcycle_up::5 128 0.01083 0.0115 0.0195 0.13% Castro::wd_update() 2 0.008661 0.0161 0.01893 0.13% FabArray::norminf() 282 0.01096 0.01143 0.01548 0.11% amrex::Add() 128 0.01419 0.01432 0.01458 0.10% Gravity::test_composite_phi() 1 0.01418 0.01422 0.01425 0.10% FabArrayBase::getFB() 6380 0.0101 0.01085 0.01424 0.10% FabArrayBase::getCPC() 2005 0.009397 0.0107 0.01414 0.10% MLLinOp::define() 19 0.004024 0.007602 0.01178 0.08% MLLinOp::defineGrids() 19 0.003935 0.007518 0.0117 0.08% FabArray::setDomainBndry() 147 0.00045 0.006145 0.01147 0.08% Amr::writeSmallPlotFile() 2 0.01119 0.0112 0.0112 0.08% MLLinOp::makeSubCommunicator() 19 0.001027 0.004664 0.008693 0.06% MLMG::getGradSolution() 18 0.007526 0.007807 0.008393 0.06% MLCellLinOp::compGrad() 18 0.007485 0.007765 0.008343 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005016 0.008025 0.06% FabArray::mult() 59 0.007319 0.007445 0.007723 0.05% Castro::volWgtSum() 46 0.007293 0.007382 0.007578 0.05% FabArrayBase::CPC::define() 576 0.002148 0.00329 0.006354 0.04% Gravity::update_max_rhs() 2 0.002239 0.004269 0.006162 0.04% amrex::Dot() 142 0 0.0003728 0.005966 0.04% MLCellLinOp::defineBC() 19 0.005508 0.005735 0.005848 0.04% Castro::volInBoundary() 14 0.003387 0.003694 0.005359 0.04% MultiFab::max() 2 0.0009689 0.002962 0.004923 0.03% BndryData::define() 19 0.00401 0.004204 0.004316 0.03% MLPoisson::normalize() 79 0 0.0001979 0.003166 0.02% MLPoisson::prepareForSolve() 19 0.001753 0.001874 0.002228 0.02% MLCellLinOp::prepareForSolve() 19 0.001671 0.001795 0.002149 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001301 0.001556 0.001761 0.01% AmrLevel::AmrLevel(dm) 1 0.001343 0.001505 0.001663 0.01% StateData::define() 6 0.001308 0.001468 0.001627 0.01% FabArrayBase::FB::FB() 75 0.0002797 0.000668 0.001445 0.01% Gravity::swapTimeLevels() 8 0.001177 0.001251 0.001341 0.01% MLMG::MLResNormInf() 18 0.001246 0.001268 0.001297 0.01% MLMG::compResidual() 1 0.0009523 0.001105 0.00128 0.01% MLMG::MLRhsNormInf() 18 0.001206 0.001219 0.001231 0.01% Castro::locWgtSum() 6 0.001114 0.001129 0.001154 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009082 0.000962 0.001038 0.01% MLCellLinOp::setLevelBC() 19 0.0005339 0.0006702 0.0008515 0.01% Castro::buildMetrics() 1 0.0006476 0.0006694 0.0006902 0.00% makeSFC 95 0.0005794 0.0006177 0.0006708 0.00% Castro::errorEst() 2 0.0005027 0.0005718 0.0006347 0.00% Castro::apply_tagging_restrictions() 2 0.0004043 0.000472 0.0005326 0.00% Castro::swap_state_time_levels() 8 0.0004657 0.0004878 0.0005236 0.00% Gravity::applyMetricTerms() 2 0.0004693 0.0004844 0.0005043 0.00% Castro::enforce_consistent_e() 1 0.000365 0.0003771 0.0004195 0.00% Castro::volProductSum() 2 0.0003999 0.0004045 0.0004136 0.00% TagBoxArray::collate() 2 0.0001088 0.0002263 0.0003669 0.00% Castro::finalize_advance() 1 0.0002525 0.0002663 0.0002869 0.00% DistributionMapping::Distribute() 95 0.0002096 0.0002259 0.0002759 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001105 0.0002473 0.0002701 0.00% Castro::finalize_do_advance() 17 0.0001727 0.0001896 0.0002098 0.00% DistributionMapping::LeastUsedCPUs() 1 3.874e-05 0.0001695 0.0001911 0.00% OwnerMask() 2 0.000134 0.0001505 0.0001591 0.00% Castro::enforce_speed_limit() 79 0.00011 0.0001203 0.0001346 0.00% MultiFab::Swap() 5 6.791e-05 7.542e-05 9.957e-05 0.00% Castro::apply_problem_tags() 2 9.135e-05 9.354e-05 9.61e-05 0.00% Amr::initSubcycle() 1 5.513e-05 6.778e-05 7.43e-05 0.00% knapsack() 1 5.59e-05 6.005e-05 7.035e-05 0.00% Castro::construct_old_rotation_source() 20 2.989e-05 3.052e-05 3.147e-05 0.00% Castro::construct_new_rotation_source() 17 2.084e-05 2.209e-05 2.588e-05 0.00% BoxList::parallelComplementIn() 4 1.286e-05 1.369e-05 1.816e-05 0.00% Castro::estTimeStep() 10 1.28e-05 1.392e-05 1.754e-05 0.00% Castro::computeInitialDt() 2 9.742e-06 1.103e-05 1.469e-05 0.00% BoxList::complementIn 4 5.974e-06 6.351e-06 8.342e-06 0.00% Gravity::set_mass_offset() 2 4.496e-06 5.443e-06 7.939e-06 0.00% Castro::gwstrain() 2 4.307e-06 4.728e-06 6.88e-06 0.00% Castro::FluxRegCrseInit 1 1.772e-06 1.999e-06 2.644e-06 0.00% Castro::FluxRegFineAdd() 1 1.38e-06 1.547e-06 1.958e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 13 B 19 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-9-g2a3955a5f5aa) finalized