Initializing AMReX (24.04-15-g7813bb7d6bc6)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.04-15-g7813bb7d6bc6) initialized Starting run at 07:18:33 UTC on 2024-04-12. Successfully read inputs file ... Castro git describe: 24.04-14-g3d76cd5a0 AMReX git describe: 24.04-15-g7813bb7d6 Microphysics git describe: 24.04-7-gd4312a6c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.183047242 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001079228 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010611254 Gravity::multilevel_solve_for_new_phi() time = 0.099563951 Gravity::fill_multipole_BCs() time = 0.010640281 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.047342364 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004277392 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002715397 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.064330245 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879-160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 , 193, 0 -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = , 0 Invalid density = -1.089487306 at index 6, 191, 0 -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006446247 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.063483434 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003970819 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060505636 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003541028 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059500254 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.322640744 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015348505 Gravity::solve_for_phi() time = 0.085403092 on level 0 Castro::construct_new_gravity() time = 0.087561225 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060106439 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002760119 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059671361 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.398309707 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015504369 Gravity::solve_for_phi() time = 0.086586175 on level 0 Castro::construct_new_gravity() time = 0.088702721 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.059617284 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.00277334 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059286806 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327037019 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01558421 Gravity::solve_for_phi() time = 0.086335622 on level 0 Castro::construct_new_gravity() time = 0.08845218 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.059743141 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.00270412 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059126923 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329969513 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01685388 Gravity::solve_for_phi() time = 0.08716745 on level 0 Castro::construct_new_gravity() time = 0.089295911 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.059960133 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002771109 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059344323 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335925667 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015613705 Gravity::solve_for_phi() time = 0.08613383 on level 0 Castro::construct_new_gravity() time = 0.088247856 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.059818301 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002665108 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059048585 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329428915 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015916297 Gravity::solve_for_phi() time = 0.088824273 on level 0 Castro::construct_new_gravity() time = 0.091363684 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.065986627 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002719618 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059297486 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333931614 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015862237 Gravity::solve_for_phi() time = 0.086063673 on level 0 Castro::construct_new_gravity() time = 0.088183927 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059792676 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002693536 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058973381 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331979533 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016029388 Gravity::solve_for_phi() time = 0.086959242 on level 0 Castro::construct_new_gravity() time = 0.089068955 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.059980136 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002694101 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.05926234 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335316125 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016522733 Gravity::solve_for_phi() time = 0.087489244 on level 0 Castro::construct_new_gravity() time = 0.089610814 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.05983496 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002726374 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059380124 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331235117 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016432184 Gravity::solve_for_phi() time = 0.087414619 on level 0 Castro::construct_new_gravity() time = 0.089555054 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.059814793 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002724233 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.05932832 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335580468 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016415734 Gravity::solve_for_phi() time = 0.086918408 on level 0 Castro::construct_new_gravity() time = 0.089030525 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059792095 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002706299 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059281847 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33125617 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016048957 Gravity::solve_for_phi() time = 0.0869823 on level 0 Castro::construct_new_gravity() time = 0.089103226 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.06129355 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002851734 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059371356 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337471008 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0162708 Gravity::solve_for_phi() time = 0.087093273 on level 0 Castro::construct_new_gravity() time = 0.089205088 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059783913 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002684312 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059183646 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330914304 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016773901 Gravity::solve_for_phi() time = 0.087331081 on level 0 Castro::construct_new_gravity() time = 0.089447835 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059850083 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002703712 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059188307 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335866863 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016621565 Gravity::solve_for_phi() time = 0.086999243 on level 0 Castro::construct_new_gravity() time = 0.089108995 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.05982829 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002693021 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059024767 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331269412 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016793199 Gravity::solve_for_phi() time = 0.088159477 on level 0 Castro::construct_new_gravity() time = 0.090286749 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059883498 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002791929 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059197088 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337156664 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016951688 Gravity::solve_for_phi() time = 0.088097406 on level 0 Castro::construct_new_gravity() time = 0.090200177 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.060024443 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002761745566 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.92352688 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.076873732 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004367977 seconds Ending run at 07:18:47 UTC on 2024-04-12. Run time = 14.76810902 Run time without initialization = 12.00579519 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.77 ... 14.77 ... 14.77 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3477 5.4622 5.6201 38.06% Amr::InitAmr() 1 1.868 1.868 1.868 12.65% Castro::computeTemp() 80 0.8424 0.9453 1.121 7.59% amrex::Copy() 724 0.7679 0.7788 0.7883 5.34% FabArray::ParallelCopy_finish() 1429 0.06733 0.5197 0.7826 5.30% MultiFab::AddProduct() 3439 0.5469 0.5548 0.5625 3.81% Castro::normalize_species() 79 0.5348 0.5436 0.5515 3.73% Castro::reset_internal_energy(Fab) 160 0.5122 0.5212 0.5298 3.59% MLPoisson::Fsmooth() 6144 0.316 0.3451 0.411 2.78% Castro::initMFs() 1 0.3541 0.3606 0.3817 2.58% check_for_negative_density() 20 0.09169 0.2464 0.3758 2.54% FabArray::setVal() 5013 0.3518 0.3592 0.3644 2.47% MultiFab::Subtract() 159 0.3394 0.3444 0.3489 2.36% Gravity::fill_multipole_BCs() 19 0.2004 0.2494 0.2938 1.99% Castro::reset_internal_energy(MultiFab) 80 0.0225 0.06201 0.2333 1.58% FabArray::ParallelCopy_nowait() 1429 0.1889 0.2023 0.2172 1.47% FabArray::sum() 3439 0.1867 0.1896 0.1923 1.30% FillBoundary_finish() 6380 0.09716 0.1176 0.1582 1.07% Castro::initData() 1 0.003275 0.02654 0.1553 1.05% FillBoundary_nowait() 6380 0.08037 0.1038 0.1295 0.88% MLPoisson::Fapply() 986 0.09381 0.09908 0.1123 0.76% MLCellLinOp::applyBC() 7148 0.04808 0.06275 0.1026 0.69% FabArray::Saxpy() 264 0.06818 0.06966 0.07534 0.51% Castro::construct_new_gravity_source() 17 0.06912 0.07013 0.07164 0.49% Castro::do_new_sources() 17 0.0003716 0.01153 0.06187 0.42% FabArray::Xpay() 945 0.05114 0.05393 0.06011 0.41% Castro::enforce_min_density() 79 0.01745 0.02722 0.05959 0.40% Castro::do_old_sources() 20 0.0005144 0.01153 0.04756 0.32% MultiFab::contains_nan() 37 0.04537 0.04616 0.04678 0.32% Amr::writePlotFile() 2 0.03693 0.045 0.04671 0.32% Castro::construct_old_gravity_source() 20 0.04406 0.04474 0.04542 0.31% AmrLevel::derive() 18 0.04023 0.04078 0.04142 0.28% MLMG::addInterpCorrection() 768 0.03259 0.03531 0.04135 0.28% StateData::FillBoundary(geom) 143 0 0.01735 0.03399 0.23% amrex::average_down 768 0.0242 0.02643 0.03167 0.21% VisMF::Write(FabArray) 4 0.01194 0.01309 0.02353 0.16% TagBoxArray::collate() 2 0.0001607 0.002648 0.01857 0.13% MLCellLinOp::defineAuxData() 19 0.01493 0.01559 0.01807 0.12% Castro::construct_new_source() 102 0.01552 0.01584 0.01664 0.11% FabArray::FillBoundary() 6380 0.01345 0.01408 0.01659 0.11% MLCGSolver::bicgstab 8 0 0.000996 0.01594 0.11% FabArray::norminf() 282 0.01088 0.0114 0.01528 0.10% amrex::Add() 128 0.01415 0.01442 0.01462 0.10% Castro::evaluate_source_change() 196 0.01235 0.01272 0.01363 0.09% FillPatchIterator::Initialize 147 0.01231 0.01265 0.01339 0.09% MLCellLinOp::smooth() 3072 0.01106 0.01162 0.01281 0.09% Castro::wd_update() 2 0.004722 0.008786 0.01273 0.09% FabArrayBase::getFB() 6380 0.009722 0.01019 0.01235 0.08% FabArray::setDomainBndry() 147 0.0004385 0.006179 0.01171 0.08% MLMG::prepareForSolve() 18 0.0101 0.01047 0.01148 0.08% Castro::construct_old_source() 120 0.009866 0.01008 0.01063 0.07% MLMG::ResNormInf() 146 0.002695 0.006533 0.009518 0.06% MLLinOp::makeSubCommunicator() 19 0.001017 0.004477 0.008277 0.06% FabArrayBase::getCPC() 2005 0.007171 0.007389 0.00799 0.05% Gravity::actual_solve_with_mlmg() 19 0.00674 0.007123 0.007888 0.05% FabArray::mult() 59 0.007341 0.007455 0.007676 0.05% Castro::volWgtSum() 46 0.007474 0.007515 0.00764 0.05% Castro::construct_old_gravity() 20 0.0003749 0.001616 0.007111 0.05% Gravity::get_old_grav_vector() 20 0.006398 0.006576 0.006858 0.05% Gravity::get_new_grav_vector() 18 0.006093 0.006206 0.00656 0.04% MLMG::solve() 18 0.0008152 0.00252 0.006411 0.04% FabArrayBase::CPC::define() 576 0.002168 0.003312 0.006244 0.04% MLCellLinOp::compGrad() 18 0.005869 0.005992 0.006133 0.04% Amr::writeSmallPlotFile() 2 0.003971 0.005652 0.006121 0.04% amrex::Dot() 142 0 0.0003738 0.00598 0.04% Castro::initialize_do_advance() 20 0.004349 0.004742 0.005736 0.04% Castro::volInBoundary() 14 0.003531 0.00378 0.005576 0.04% MLCGSolver::ParallelAllReduce 227 0 0.000299 0.004783 0.03% MLCellLinOp::apply() 986 0.001994 0.002227 0.00467 0.03% FabArray::ParallelCopy() 1429 0.003454 0.003624 0.003893 0.03% BndryData::define() 19 0.003037 0.003172 0.003394 0.02% MLPoisson::normalize() 79 0 0.0002048 0.003277 0.02% MultiFab::max() 2 0.00022 0.00112 0.002433 0.02% AmrLevel::FillPatch() 147 0.002134 0.002248 0.002432 0.02% MLLinOp::defineGrids() 19 0.001798 0.001884 0.002162 0.01% Castro::sum_integrated_quantities() 2 0.001654 0.001913 0.002075 0.01% MLCellLinOp::prepareForSolve() 19 0.001687 0.001803 0.002049 0.01% MLCellLinOp::correctionResidual() 768 0.001844 0.001909 0.001958 0.01% Castro::construct_new_gravity() 17 0.0003035 0.0005906 0.001799 0.01% Gravity::solve_for_phi() 17 0.0008199 0.001019 0.001791 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001287 0.001538 0.001768 0.01% MLMG::mgVcycle() 128 0.001557 0.001634 0.001763 0.01% MLCellLinOp::defineBC() 19 0.00147 0.001544 0.001653 0.01% MLMG:computeResOfCorrection() 768 0.001359 0.001434 0.001623 0.01% main() 1 0.0009408 0.001129 0.001457 0.01% Castro::save_data_for_retry() 3 0.001274 0.001308 0.001428 0.01% FabArrayBase::FB::FB() 75 0.0002824 0.000674 0.001427 0.01% StateData::define() 6 0.001322 0.00134 0.001375 0.01% Castro::locWgtSum() 6 0.001133 0.00115 0.001177 0.01% MLMG::actualBottomSolve() 128 0.0001324 0.0001947 0.001041 0.01% StateDataPhysBCFunct::() 147 0.0006792 0.0008199 0.0009169 0.01% MLCellLinOp::setLevelBC() 19 0.0005415 0.0006628 0.0008256 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006768 0.0007095 0.0007688 0.01% Castro::subcycle_advance_ctu() 1 0.0001865 0.0002417 0.0007486 0.01% MLMG::mgVcycle_down::2 128 0.0006077 0.0006598 0.0007413 0.01% MLMG::mgVcycle_down::0 128 0.0006436 0.0006623 0.0007297 0.00% MLMG::mgVcycle_down::1 128 0.0006362 0.000659 0.0007147 0.00% MLMG::mgVcycle_down::3 128 0.0005722 0.000619 0.0007017 0.00% MLMG::mgVcycle_down::4 128 0.0005513 0.0005799 0.0006583 0.00% MLMG::mgVcycle_down::5 128 0.0005781 0.0005982 0.0006471 0.00% Castro::do_advance_ctu() 20 0.000408 0.0004568 0.0006183 0.00% Castro::buildMetrics() 1 0.0005816 0.0005951 0.0006072 0.00% Castro::Castro() 1 0.0004625 0.0004962 0.0005578 0.00% Castro::clean_state() 79 0.0004323 0.0004604 0.0005536 0.00% Castro::apply_tagging_restrictions() 2 0.0004118 0.000478 0.0005472 0.00% AmrMesh::MakeNewGrids() 2 0.0004844 0.0005013 0.0005202 0.00% Gravity::applyMetricTerms() 2 0.0004927 0.0004992 0.0005067 0.00% FillPatchSingleLevel 147 0.0004606 0.00048 0.0005057 0.00% MLMG::mgVcycle_up::1 128 0.0004404 0.0004667 0.0005046 0.00% MLMG::mgVcycle_up::0 128 0.0004554 0.0004718 0.0004954 0.00% MLMG::mgVcycle_up::2 128 0.0003784 0.0004205 0.0004772 0.00% MLCellLinOp::solutionResidual() 147 0.0004253 0.0004425 0.0004679 0.00% Castro::swap_state_time_levels() 8 0.0004176 0.0004299 0.000449 0.00% Castro::problem_post_timestep() 2 1.086e-05 3.91e-05 0.000446 0.00% MLMG::mgVcycle_up::3 128 0.0003743 0.000393 0.0004354 0.00% makeSFC 95 0.0003806 0.000395 0.0004349 0.00% MLMG::mgVcycle_up::5 128 0.0003905 0.0004056 0.0004326 0.00% MLMG::oneIter() 128 0.0003795 0.0003952 0.0004326 0.00% MLMG::mgVcycle_up::4 128 0.0003801 0.0003945 0.0004274 0.00% Castro::volProductSum() 2 0.0003994 0.0004072 0.0004166 0.00% Castro::enforce_consistent_e() 1 0.000364 0.0003748 0.0003891 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003233 0.0003349 0.0003532 0.00% Castro::finalize_do_advance() 17 0.0001504 0.0001739 0.0002784 0.00% MLMG::computeResidual() 128 0.0002378 0.0002464 0.0002623 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002141 0.000229 0.0002622 0.00% MLMG::mgVcycle_bottom 128 0.0002235 0.0002341 0.0002519 0.00% DistributionMapping::Distribute() 95 0.0002116 0.0002191 0.0002339 0.00% MLPoisson::define() 19 0.0001381 0.000168 0.0002093 0.00% Gravity::update_max_rhs() 2 0.0001587 0.0001656 0.0001844 0.00% MLMG::compResidual() 1 0.0001561 0.0001642 0.0001707 0.00% OwnerMask() 2 0.000134 0.0001543 0.00017 0.00% Amr::coarseTimeStep() 1 0.0001271 0.0001517 0.000158 0.00% Amr::grid_places() 2 7.003e-05 9.223e-05 0.000153 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.174e-05 7.816e-05 0.0001496 0.00% Castro::retry_advance_ctu() 11 5.319e-05 6.885e-05 0.0001396 0.00% Castro::enforce_speed_limit() 79 0.0001077 0.000117 0.0001357 0.00% Amr::defBaseLevel() 1 9.873e-05 0.0001172 0.0001318 0.00% Castro::check_for_nan() 37 0.0001018 0.0001095 0.0001247 0.00% TagBoxArray::mapPRD 2 0.0001086 0.0001147 0.0001227 0.00% Castro::apply_source_to_state() 37 9.643e-05 0.0001027 0.0001187 0.00% Gravity::test_composite_phi() 1 9.36e-05 9.801e-05 0.0001139 0.00% Castro::initialize_advance() 1 0.0001004 0.000105 0.0001137 0.00% Castro::apply_problem_tags() 2 9.292e-05 9.523e-05 0.0001076 0.00% MLLinOp::define() 19 7.604e-05 8.087e-05 0.0001011 0.00% Castro::create_source_corrector() 17 5.784e-05 6.668e-05 9.445e-05 0.00% MultiFab::Swap() 5 6.72e-05 7.173e-05 9.425e-05 0.00% knapsack() 1 5.747e-05 6.665e-05 8.537e-05 0.00% MLPoisson::prepareForSolve() 19 6.746e-05 7.169e-05 7.753e-05 0.00% Amr::initSubcycle() 1 5.717e-05 6.404e-05 7.189e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 4.796e-05 5.919e-05 6.733e-05 0.00% Amr::FinalizeInit() 1 8.312e-06 1.262e-05 6.607e-05 0.00% Castro::expand_state() 20 5.145e-05 5.503e-05 6.474e-05 0.00% Gravity::swapTimeLevels() 8 3.248e-05 3.777e-05 5.567e-05 0.00% Castro::derive() 18 4.011e-05 4.234e-05 5.104e-05 0.00% MLMG::computeMLResidual() 18 3.985e-05 4.228e-05 4.689e-05 0.00% MLMG::getGradSolution() 18 4.001e-05 4.206e-05 4.557e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.31e-05 3.561e-05 4.282e-05 0.00% MLMG::MLResNormInf() 18 3.349e-05 3.6e-05 3.861e-05 0.00% Amr::timeStep() 1 1.231e-05 1.851e-05 3.72e-05 0.00% Castro::construct_old_rotation_source() 20 2.972e-05 3.138e-05 3.717e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.683e-05 1.905e-05 3.358e-05 0.00% MLMG::MLRhsNormInf() 18 3.085e-05 3.182e-05 3.308e-05 0.00% Castro::advance() 1 6.367e-06 1.376e-05 3.139e-05 0.00% Gravity::actual_multilevel_solve() 1 2.752e-05 2.84e-05 3.087e-05 0.00% Castro::post_init() 1 1.139e-05 1.358e-05 3.036e-05 0.00% Amr::regrid() 1 1.035e-05 1.227e-05 2.955e-05 0.00% Castro::post_regrid() 2 1.053e-05 1.232e-05 2.909e-05 0.00% Castro::computeInitialDt() 2 5.991e-06 8.66e-06 2.619e-05 0.00% Castro::finalize_advance() 1 1.644e-05 1.86e-05 2.616e-05 0.00% Castro::construct_new_rotation_source() 17 2.136e-05 2.237e-05 2.38e-05 0.00% BoxList::complementIn 4 6.129e-06 9.513e-06 2.337e-05 0.00% Castro::estTimeStep() 10 1.146e-05 1.401e-05 1.795e-05 0.00% Amr::InitializeInit() 1 6.684e-06 7.66e-06 1.248e-05 0.00% Amr::init() 1 6.756e-06 7.448e-06 9.656e-06 0.00% Amr::bldFineLevels() 1 6.511e-06 7.136e-06 8.038e-06 0.00% BoxList::parallelComplementIn() 4 6.823e-06 7.227e-06 7.533e-06 0.00% Castro::post_timestep() 1 5.668e-06 6.252e-06 7.429e-06 0.00% Gravity::set_mass_offset() 2 4.21e-06 4.74e-06 7.413e-06 0.00% Castro::gwstrain() 2 4.301e-06 4.826e-06 7.382e-06 0.00% Castro::errorEst() 2 5.838e-06 6.184e-06 6.492e-06 0.00% Amr::initialInit() 1 2.868e-06 3.102e-06 3.557e-06 0.00% Castro::FluxRegFineAdd() 1 1.387e-06 1.568e-06 2.259e-06 0.00% Castro::FluxRegCrseInit 1 1.719e-06 1.856e-06 2.028e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.77 14.77 14.77 100.00% Amr::coarseTimeStep() 1 12.01 12.01 12.01 81.29% Amr::timeStep() 1 11.92 11.92 11.92 80.74% Castro::advance() 1 11.86 11.86 11.86 80.34% Castro::subcycle_advance_ctu() 1 11.81 11.81 11.82 80.01% Castro::do_advance_ctu() 20 11.77 11.77 11.78 79.75% Castro::construct_ctu_hydro_source() 20 6.444 6.484 6.534 44.25% Castro::clean_state() 79 3.637 3.771 3.97 26.88% Castro::computeTemp() 80 2.344 2.482 2.699 18.28% Amr::InitAmr() 1 1.868 1.868 1.869 12.65% Castro::reset_internal_energy(MultiFab) 80 1.476 1.536 1.694 11.47% Gravity::solve_phi_with_mlmg() 19 1.489 1.542 1.59 10.77% Castro::construct_new_gravity() 17 1.416 1.469 1.516 10.27% Gravity::solve_for_phi() 17 1.379 1.432 1.48 10.02% Castro::initialize_do_advance() 20 1.366 1.408 1.449 9.81% Gravity::actual_solve_with_mlmg() 19 1.285 1.289 1.293 8.76% MLMG::solve() 18 1.234 1.238 1.24 8.39% Castro::do_old_sources() 20 1.132 1.174 1.196 8.10% MLMG::oneIter() 128 1.102 1.105 1.108 7.50% MLMG::mgVcycle() 128 1.088 1.09 1.093 7.40% Castro::do_new_sources() 17 0.9251 0.9757 1.024 6.93% FabArray::ParallelCopy() 1429 0.2912 0.7451 1.005 6.81% Castro::evaluate_source_change() 196 0.9473 0.9611 0.9746 6.60% Amr::init() 1 0.8934 0.8934 0.8934 6.05% Castro::enforce_min_density() 79 0.7838 0.8045 0.8417 5.70% Amr::initialInit() 1 0.8409 0.8409 0.841 5.69% amrex::Copy() 724 0.7679 0.7788 0.7883 5.34% FabArray::ParallelCopy_finish() 1429 0.06733 0.5197 0.7826 5.30% MLCellLinOp::smooth() 3072 0.5545 0.6058 0.7329 4.96% AmrLevel::FillPatch() 147 0.4826 0.5706 0.6866 4.65% Amr::InitializeInit() 1 0.4381 0.5013 0.6196 4.20% Amr::defBaseLevel() 1 0.438 0.5013 0.6196 4.20% MultiFab::AddProduct() 3439 0.5469 0.5548 0.5625 3.81% Castro::normalize_species() 79 0.5348 0.5436 0.5515 3.73% Castro::reset_internal_energy(Fab) 160 0.5122 0.5212 0.5298 3.59% FillPatchIterator::Initialize 147 0.3041 0.3934 0.5118 3.47% FillPatchIterator::FillFromLevel0() 147 0.2797 0.3746 0.4948 3.35% FillPatchSingleLevel 147 0.279 0.3739 0.4941 3.35% MLMG::mgVcycle_up::1 128 0.09409 0.2564 0.4178 2.83% MLPoisson::Fsmooth() 6144 0.316 0.3451 0.411 2.78% Amr::FinalizeInit() 1 0.2213 0.3397 0.4029 2.73% MLCellLinOp::applyBC() 7148 0.2702 0.3091 0.3889 2.63% Castro::Castro() 1 0.3596 0.366 0.3871 2.62% Castro::initMFs() 1 0.3543 0.3607 0.3819 2.59% check_for_negative_density() 20 0.09169 0.2464 0.3758 2.54% MLMG::addInterpCorrection() 768 0.06201 0.296 0.3673 2.49% FabArray::setVal() 5013 0.3518 0.3592 0.3644 2.47% MultiFab::Subtract() 159 0.3394 0.3444 0.3489 2.36% Gravity::fill_multipole_BCs() 19 0.2025 0.2515 0.2958 2.00% FabArray::FillBoundary() 6380 0.2102 0.2464 0.2914 1.97% Castro::expand_state() 20 0.1805 0.2228 0.2752 1.86% MLMG::mgVcycle_up::2 128 0.01072 0.1124 0.2694 1.82% MLMG::mgVcycle_down::0 128 0.2611 0.2639 0.268 1.82% Castro::initData() 1 0.0768 0.1336 0.2581 1.75% FabArray::ParallelCopy_nowait() 1429 0.208 0.2217 0.2374 1.61% Amr::bldFineLevels() 1 0.04615 0.164 0.2265 1.53% MLMG::mgVcycle_up::0 128 0.1987 0.1991 0.1997 1.35% MLCellLinOp::apply() 986 0.1489 0.1595 0.1947 1.32% FabArray::sum() 3439 0.1867 0.1896 0.1923 1.30% Amr::grid_places() 2 0.002574 0.1209 0.1841 1.25% AmrMesh::MakeNewGrids() 2 0.002503 0.1208 0.1841 1.25% TagBoxArray::mapPRD 2 0.0007007 0.1169 0.1823 1.23% MLMG::mgVcycle_up::3 128 0.01067 0.02325 0.1732 1.17% FillBoundary_finish() 6380 0.09716 0.1176 0.1582 1.07% MLMG:computeResOfCorrection() 768 0.1132 0.1231 0.1456 0.99% MLCellLinOp::correctionResidual() 768 0.1118 0.1216 0.1441 0.98% FillBoundary_nowait() 6380 0.09075 0.1147 0.1406 0.95% Castro::post_init() 1 0.1318 0.1327 0.134 0.91% Castro::construct_new_source() 102 0.1236 0.1256 0.128 0.87% Amr::writePlotFile() 2 0.1248 0.1249 0.1249 0.85% MLMG::mgVcycle_down::1 128 0.1154 0.1188 0.1218 0.82% MLPoisson::Fapply() 986 0.09381 0.09908 0.1123 0.76% Gravity::multilevel_solve_for_new_phi() 1 0.09942 0.0995 0.0996 0.67% Gravity::actual_multilevel_solve() 1 0.09936 0.09942 0.09951 0.67% MLCellLinOp::solutionResidual() 147 0.08799 0.0926 0.09627 0.65% Castro::post_regrid() 2 0.08466 0.08595 0.08686 0.59% Castro::construct_old_source() 120 0.07691 0.07807 0.07906 0.54% MLMG::computeResidual() 128 0.07613 0.07667 0.07709 0.52% FabArray::Saxpy() 264 0.06818 0.06966 0.07534 0.51% MLMG::mgVcycle_down::2 128 0.01248 0.04157 0.07396 0.50% Castro::construct_new_gravity_source() 17 0.06912 0.07013 0.07164 0.49% MLMG::mgVcycle_bottom 128 0.0003592 0.004746 0.07037 0.48% Castro::derive() 18 0.06857 0.06941 0.0703 0.48% AmrLevel::derive() 18 0.06853 0.06937 0.07026 0.48% MLMG::actualBottomSolve() 128 0.0001324 0.004512 0.07012 0.47% Castro::create_source_corrector() 17 0.04721 0.0571 0.07005 0.47% MLCGSolver::bicgstab 8 0 0.004289 0.06863 0.46% Castro::post_timestep() 1 0.0585 0.0614 0.0645 0.44% Castro::construct_old_gravity() 20 0.04166 0.05072 0.06034 0.41% FabArray::Xpay() 945 0.05114 0.05393 0.06011 0.41% MLMG::mgVcycle_down::3 128 0.01192 0.01812 0.05923 0.40% Gravity::get_old_grav_vector() 20 0.04123 0.04911 0.05873 0.40% amrex::average_down 768 0.03233 0.03896 0.05388 0.36% Castro::initialize_advance() 1 0.04804 0.04891 0.04955 0.34% Castro::check_for_nan() 37 0.04547 0.04627 0.0469 0.32% MultiFab::contains_nan() 37 0.04537 0.04616 0.04678 0.32% Castro::construct_old_gravity_source() 20 0.04406 0.04474 0.04542 0.31% Amr::regrid() 1 0.04347 0.04419 0.04467 0.30% Castro::retry_advance_ctu() 11 0.03536 0.03663 0.04116 0.28% MLPoisson::define() 19 0.02908 0.03372 0.03924 0.27% Gravity::get_new_grav_vector() 18 0.03572 0.03609 0.03725 0.25% StateDataPhysBCFunct::() 147 0.0006792 0.01817 0.03487 0.24% MLMG::mgVcycle_down::4 128 0.01178 0.01352 0.03433 0.23% StateData::FillBoundary(geom) 143 0 0.01735 0.03399 0.23% Castro::apply_source_to_state() 37 0.02775 0.02823 0.02879 0.19% MLMG::mgVcycle_up::4 128 0.01073 0.012 0.02666 0.18% MLCellLinOp::defineAuxData() 19 0.01903 0.0204 0.02407 0.16% Castro::save_data_for_retry() 3 0.01855 0.01914 0.02385 0.16% VisMF::Write(FabArray) 4 0.01194 0.01309 0.02353 0.16% MLMG::prepareForSolve() 18 0.02033 0.02141 0.02325 0.16% MLMG::mgVcycle_down::5 128 0.01185 0.01282 0.02279 0.15% Castro::sum_integrated_quantities() 2 0.02091 0.02125 0.02127 0.14% MLMG::mgVcycle_up::5 128 0.01087 0.01164 0.01929 0.13% MLMG::ResNormInf() 146 0.01257 0.01632 0.01913 0.13% MLMG::computeMLResidual() 18 0.01127 0.01548 0.01908 0.13% TagBoxArray::collate() 2 0.0001607 0.002648 0.01857 0.13% Castro::problem_post_timestep() 2 0.009379 0.01261 0.01628 0.11% Castro::wd_update() 2 0.009362 0.01257 0.01627 0.11% FabArray::norminf() 282 0.01088 0.0114 0.01528 0.10% amrex::Add() 128 0.01415 0.01442 0.01462 0.10% Gravity::test_composite_phi() 1 0.01398 0.01406 0.01412 0.10% FabArrayBase::getFB() 6380 0.01005 0.01086 0.01378 0.09% FabArrayBase::getCPC() 2005 0.009467 0.0107 0.01377 0.09% FabArray::setDomainBndry() 147 0.0004385 0.006179 0.01171 0.08% MLLinOp::define() 19 0.003939 0.007391 0.01148 0.08% MLLinOp::defineGrids() 19 0.003861 0.00731 0.0114 0.08% Amr::writeSmallPlotFile() 2 0.009037 0.009046 0.009053 0.06% MLLinOp::makeSubCommunicator() 19 0.001017 0.004477 0.008277 0.06% MLMG::getGradSolution() 18 0.0075 0.007843 0.008177 0.06% MLCellLinOp::compGrad() 18 0.007457 0.007801 0.008135 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005015 0.008024 0.05% FabArray::mult() 59 0.007341 0.007455 0.007676 0.05% Castro::volWgtSum() 46 0.007474 0.007515 0.00764 0.05% FabArrayBase::CPC::define() 576 0.002168 0.003312 0.006244 0.04% MLCellLinOp::defineBC() 19 0.005555 0.005759 0.006175 0.04% amrex::Dot() 142 0 0.0003738 0.00598 0.04% Castro::volInBoundary() 14 0.003531 0.00378 0.005576 0.04% BndryData::define() 19 0.003911 0.004215 0.004521 0.03% Gravity::update_max_rhs() 2 0.001477 0.002384 0.003686 0.02% MLPoisson::normalize() 79 0 0.0002048 0.003277 0.02% MultiFab::max() 2 0.00022 0.00112 0.002433 0.02% MLPoisson::prepareForSolve() 19 0.001763 0.001875 0.002122 0.01% MLCellLinOp::prepareForSolve() 19 0.001687 0.001803 0.002049 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001287 0.001538 0.001768 0.01% Gravity::swapTimeLevels() 8 0.001162 0.001221 0.00149 0.01% FabArrayBase::FB::FB() 75 0.0002824 0.000674 0.001427 0.01% AmrLevel::AmrLevel(dm) 1 0.001361 0.001376 0.001409 0.01% StateData::define() 6 0.001322 0.00134 0.001375 0.01% MLMG::MLResNormInf() 18 0.001243 0.001275 0.001316 0.01% MLMG::MLRhsNormInf() 18 0.001204 0.00123 0.001285 0.01% MLMG::compResidual() 1 0.0009358 0.001111 0.001232 0.01% Castro::locWgtSum() 6 0.001133 0.00115 0.001177 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009208 0.000949 0.001014 0.01% MLCellLinOp::setLevelBC() 19 0.0005415 0.0006628 0.0008256 0.01% Castro::buildMetrics() 1 0.0006429 0.000658 0.0006733 0.00% makeSFC 95 0.0005922 0.0006141 0.0006607 0.00% Castro::errorEst() 2 0.0005105 0.0005794 0.0006483 0.00% Castro::apply_tagging_restrictions() 2 0.0004118 0.000478 0.0005472 0.00% Gravity::applyMetricTerms() 2 0.0004927 0.0004992 0.0005067 0.00% Castro::swap_state_time_levels() 8 0.0004176 0.0004299 0.000449 0.00% Castro::volProductSum() 2 0.0003994 0.0004072 0.0004166 0.00% Castro::enforce_consistent_e() 1 0.000364 0.0003748 0.0003891 0.00% Castro::finalize_do_advance() 17 0.0001602 0.0001847 0.0002902 0.00% Castro::finalize_advance() 1 0.0002508 0.0002619 0.0002879 0.00% DistributionMapping::Distribute() 95 0.0002116 0.0002191 0.0002339 0.00% OwnerMask() 2 0.000134 0.0001543 0.00017 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001359 0.0001449 0.0001656 0.00% Castro::enforce_speed_limit() 79 0.0001077 0.000117 0.0001357 0.00% Castro::apply_problem_tags() 2 9.292e-05 9.523e-05 0.0001076 0.00% MultiFab::Swap() 5 6.72e-05 7.173e-05 9.425e-05 0.00% knapsack() 1 5.747e-05 6.665e-05 8.537e-05 0.00% Amr::initSubcycle() 1 5.717e-05 6.404e-05 7.189e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 4.796e-05 5.919e-05 6.733e-05 0.00% Castro::construct_old_rotation_source() 20 2.972e-05 3.138e-05 3.717e-05 0.00% Castro::computeInitialDt() 2 8.718e-06 1.186e-05 3.088e-05 0.00% BoxList::parallelComplementIn() 4 1.319e-05 1.674e-05 3.041e-05 0.00% Castro::construct_new_rotation_source() 17 2.136e-05 2.237e-05 2.38e-05 0.00% BoxList::complementIn 4 6.129e-06 9.513e-06 2.337e-05 0.00% Castro::estTimeStep() 10 1.146e-05 1.401e-05 1.795e-05 0.00% Gravity::set_mass_offset() 2 4.21e-06 4.74e-06 7.413e-06 0.00% Castro::gwstrain() 2 4.301e-06 4.826e-06 7.382e-06 0.00% Castro::FluxRegFineAdd() 1 1.387e-06 1.568e-06 2.259e-06 0.00% Castro::FluxRegCrseInit 1 1.719e-06 1.856e-06 2.028e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 10 B 13 B 17 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-15-g7813bb7d6bc6) finalized