Initializing AMReX (v2024-35-gb892132f6144)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (v2024-35-gb892132f6144) initialized Starting run at 07:38:22 UTC on 2024-03-27. Successfully read inputs file ... Castro git describe: 24.03-31-g760ecc416 AMReX git describe: v2024-35-gb892132f6 Microphysics git describe: 24.03-22-gf47a7fcc reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.156262095 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001064607 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010643807 Gravity::multilevel_solve_for_new_phi() time = 0.099844336 Gravity::fill_multipole_BCs() time = 0.010692723 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.048655831 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004157602 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002756365 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065210755 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003590607 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.064041959 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004242071 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060694349 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004212014 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060031163 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321674158 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015196772 Gravity::solve_for_phi() time = 0.085583485 on level 0 Castro::construct_new_gravity() time = 0.087734465 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060490955 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002673533 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060278123 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321938798 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015608606 Gravity::solve_for_phi() time = 0.08587695 on level 0 Castro::construct_new_gravity() time = 0.087971842 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.060124996 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.003234205 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060020114 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326543547 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01539112 Gravity::solve_for_phi() time = 0.086305818 on level 0 Castro::construct_new_gravity() time = 0.088414782 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.060333635 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003720931 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059903485 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.359265883 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015805772 Gravity::solve_for_phi() time = 0.100619181 on level 0 Castro::construct_new_gravity() time = 0.10276291 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.060637767 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00317611 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.081187074 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.354339515 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01590821 Gravity::solve_for_phi() time = 0.08644596 on level 0 Castro::construct_new_gravity() time = 0.088620473 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060438042 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.00275862 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.079394265 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.355064766 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015474049 Gravity::solve_for_phi() time = 0.086179131 on level 0 Castro::construct_new_gravity() time = 0.088377012 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.060349688 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.015997389 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.064240017 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.352064543 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.020740737 Gravity::solve_for_phi() time = 0.090992797 on level 0 Castro::construct_new_gravity() time = 0.093112208 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.069982727 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.005564323 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.05998498 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.364363291 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017224426 Gravity::solve_for_phi() time = 0.087492057 on level 0 Castro::construct_new_gravity() time = 0.089598178 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.06023755 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002851135 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.076001412 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.350919141 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016101714 Gravity::solve_for_phi() time = 0.087253969 on level 0 Castro::construct_new_gravity() time = 0.089368069 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.079605338 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002962012 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.060108794 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.351502683 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016177213 Gravity::solve_for_phi() time = 0.086911809 on level 0 Castro::construct_new_gravity() time = 0.089090244 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.07725524 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002766623 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059926148 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335333072 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016498198 Gravity::solve_for_phi() time = 0.087874673 on level 0 Castro::construct_new_gravity() time = 0.090039378 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.060659811 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002757361 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060109316 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330250703 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016307085 Gravity::solve_for_phi() time = 0.086751836 on level 0 Castro::construct_new_gravity() time = 0.08884781 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.060473789 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002734143 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.061113403 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337159774 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016166452 Gravity::solve_for_phi() time = 0.086386471 on level 0 Castro::construct_new_gravity() time = 0.088527939 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.060577385 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002677527 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059847401 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330741305 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0160164 Gravity::solve_for_phi() time = 0.086090897 on level 0 Castro::construct_new_gravity() time = 0.088193174 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.060209883 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002816534 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059941269 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334988973 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016000041 Gravity::solve_for_phi() time = 0.086089514 on level 0 Castro::construct_new_gravity() time = 0.088195461 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.060244617 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002792161 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.060038408 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331376759 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01587055 Gravity::solve_for_phi() time = 0.085902856 on level 0 Castro::construct_new_gravity() time = 0.087998811 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.060567937 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002713857 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059835538 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335173819 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015729667 Gravity::solve_for_phi() time = 0.086170461 on level 0 Castro::construct_new_gravity() time = 0.088271597 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.060786906 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002702944529 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.18237641 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.047823221 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004137184 seconds Ending run at 07:38:36 UTC on 2024-03-27. Run time = 14.62093927 Run time without initialization = 12.23512852 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.62 ... 14.62 ... 14.62 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3626 5.4727 5.7016 39.00% Amr::InitAmr() 1 1.508 1.508 1.508 10.31% Castro::computeTemp() 80 0.8262 0.9509 1.127 7.71% amrex::Copy() 724 0.8103 0.8258 0.8805 6.02% FabArray::ParallelCopy_finish() 1429 0.06246 0.5942 0.8716 5.96% Castro::normalize_species() 79 0.551 0.5624 0.5824 3.98% MultiFab::AddProduct() 3439 0.5438 0.5525 0.5677 3.88% Castro::reset_internal_energy(Fab) 160 0.5118 0.5213 0.5364 3.67% MLPoisson::Fsmooth() 6144 0.315 0.3438 0.4221 2.89% check_for_negative_density() 20 0.06836 0.3006 0.4084 2.79% Castro::initMFs() 1 0.3552 0.3606 0.3881 2.65% MultiFab::Subtract() 159 0.3413 0.3483 0.3853 2.64% FabArray::setVal() 5013 0.3437 0.3513 0.3654 2.50% Gravity::fill_multipole_BCs() 19 0.1992 0.2514 0.2947 2.02% FabArray::ParallelCopy_nowait() 1429 0.1923 0.2093 0.2351 1.61% Castro::reset_internal_energy(MultiFab) 80 0.02264 0.06693 0.2337 1.60% FabArray::sum() 3439 0.1905 0.1958 0.1999 1.37% Castro::initData() 1 0.003365 0.02653 0.156 1.07% FillBoundary_finish() 6380 0.09529 0.1173 0.1417 0.97% FillBoundary_nowait() 6380 0.08035 0.1034 0.1345 0.92% MLPoisson::Fapply() 986 0.09523 0.1007 0.1172 0.80% Castro::do_old_sources() 20 0.0005289 0.01535 0.112 0.77% MLCellLinOp::applyBC() 7148 0.04814 0.06257 0.1061 0.73% Castro::enforce_min_density() 79 0.01744 0.03529 0.1044 0.71% Castro::construct_new_gravity_source() 17 0.06762 0.06983 0.0817 0.56% FabArray::Saxpy() 264 0.06931 0.07135 0.07848 0.54% Castro::do_new_sources() 17 0.0003695 0.01289 0.0765 0.52% FabArray::Xpay() 945 0.04946 0.05218 0.0595 0.41% Castro::construct_old_gravity_source() 20 0.04475 0.04562 0.04858 0.33% MultiFab::contains_nan() 37 0.04506 0.04587 0.04695 0.32% MLMG::addInterpCorrection() 768 0.03266 0.03527 0.04267 0.29% AmrLevel::derive() 18 0.04006 0.04082 0.04156 0.28% StateData::FillBoundary(geom) 143 0 0.01736 0.034 0.23% amrex::average_down 768 0.02406 0.02624 0.03238 0.22% VisMF::Write(FabArray) 4 0.01186 0.013 0.02211 0.15% Amr::writePlotFile() 2 0.007242 0.01567 0.01735 0.12% FabArray::FillBoundary() 6380 0.01351 0.0141 0.01728 0.12% MLCellLinOp::defineAuxData() 19 0.01434 0.01494 0.01698 0.12% MLCGSolver::bicgstab 8 0 0.001005 0.01609 0.11% Castro::construct_new_source() 102 0.0154 0.0157 0.01608 0.11% FabArray::norminf() 282 0.01089 0.01155 0.01568 0.11% MLMG::solve() 18 0.004139 0.008871 0.01494 0.10% amrex::Add() 128 0.01401 0.01427 0.01457 0.10% Castro::wd_update() 2 0.004615 0.008823 0.01333 0.09% Castro::construct_old_gravity() 20 0.0003752 0.002033 0.01328 0.09% FabArrayBase::getFB() 6380 0.009812 0.01029 0.01305 0.09% FillPatchIterator::Initialize 147 0.01222 0.01266 0.01304 0.09% Castro::evaluate_source_change() 196 0.01202 0.01247 0.013 0.09% MLCellLinOp::smooth() 3072 0.01093 0.01143 0.0125 0.09% MLMG::ResNormInf() 146 0.004851 0.008043 0.01179 0.08% FabArray::setDomainBndry() 147 0.0004373 0.006094 0.01158 0.08% MLMG::prepareForSolve() 18 0.009796 0.01015 0.0111 0.08% Castro::construct_old_source() 120 0.00983 0.01002 0.01024 0.07% TagBoxArray::collate() 2 0.0001762 0.001577 0.009461 0.06% MLLinOp::makeSubCommunicator() 19 0.0007539 0.00524 0.009174 0.06% Gravity::actual_solve_with_mlmg() 19 0.006579 0.006869 0.007798 0.05% FabArrayBase::getCPC() 2005 0.007231 0.007461 0.00775 0.05% Castro::volWgtSum() 46 0.007412 0.007515 0.007675 0.05% FabArray::mult() 59 0.00705 0.007201 0.007632 0.05% Gravity::get_old_grav_vector() 20 0.006459 0.006612 0.006844 0.05% Gravity::get_new_grav_vector() 18 0.005999 0.006173 0.006424 0.04% FabArrayBase::CPC::define() 576 0.002179 0.003315 0.006352 0.04% amrex::Dot() 142 0 0.0003808 0.006093 0.04% MLCellLinOp::compGrad() 18 0.005753 0.005856 0.006013 0.04% Amr::writeSmallPlotFile() 2 0.003598 0.005247 0.005667 0.04% Castro::volInBoundary() 14 0.00343 0.003718 0.005337 0.04% Castro::initialize_do_advance() 20 0.004411 0.004616 0.004845 0.03% MLCGSolver::ParallelAllReduce 227 0 0.0003021 0.004834 0.03% MLCellLinOp::apply() 986 0.001983 0.002225 0.004759 0.03% FabArray::ParallelCopy() 1429 0.003377 0.003567 0.003929 0.03% BndryData::define() 19 0.00304 0.003104 0.003431 0.02% MLPoisson::normalize() 79 0 0.0001969 0.00315 0.02% Castro::construct_new_gravity() 17 0.0002872 0.0007111 0.003112 0.02% MultiFab::max() 2 0.0001719 0.00119 0.002874 0.02% Castro::sum_integrated_quantities() 2 0.001623 0.002083 0.002443 0.02% AmrLevel::FillPatch() 147 0.002099 0.002167 0.002272 0.02% MLLinOp::defineGrids() 19 0.001756 0.001926 0.002169 0.01% MLCellLinOp::prepareForSolve() 19 0.001624 0.001777 0.002085 0.01% MLCellLinOp::correctionResidual() 768 0.001816 0.001879 0.001969 0.01% MLMG::mgVcycle() 128 0.0016 0.001676 0.001869 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001303 0.001561 0.001805 0.01% MLCellLinOp::defineBC() 19 0.001483 0.001527 0.001694 0.01% Gravity::solve_for_phi() 17 0.0007879 0.0009887 0.001569 0.01% MLMG:computeResOfCorrection() 768 0.001376 0.001436 0.00156 0.01% StateData::define() 6 0.001336 0.001364 0.001484 0.01% FabArrayBase::FB::FB() 75 0.0002827 0.0006774 0.001465 0.01% Castro::save_data_for_retry() 3 0.001255 0.0013 0.001427 0.01% main() 1 0.001052 0.00115 0.001251 0.01% Castro::locWgtSum() 6 0.00114 0.001164 0.001186 0.01% MLMG::actualBottomSolve() 128 0.0001331 0.0001966 0.001085 0.01% StateDataPhysBCFunct::() 147 0.0006896 0.0008158 0.0009217 0.01% MLCellLinOp::setLevelBC() 19 0.0005377 0.0006643 0.0008359 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006937 0.0007185 0.0007532 0.01% MLMG::mgVcycle_down::3 128 0.000571 0.0006184 0.0007484 0.01% MLMG::mgVcycle_down::2 128 0.000611 0.0006728 0.0007362 0.01% Castro::subcycle_advance_ctu() 1 0.0001916 0.0002408 0.00073 0.00% MLMG::mgVcycle_down::1 128 0.0006503 0.0006707 0.0007014 0.00% MLMG::mgVcycle_down::4 128 0.0005515 0.0005772 0.0007008 0.00% MLMG::mgVcycle_down::0 128 0.0006594 0.0006859 0.0007001 0.00% Castro::buildMetrics() 1 0.0005711 0.0005935 0.0006874 0.00% MLMG::mgVcycle_down::5 128 0.0005798 0.0005962 0.0006769 0.00% Castro::Castro() 1 0.0004514 0.0005213 0.0005851 0.00% AmrMesh::MakeNewGrids() 2 0.0004946 0.0005141 0.0005477 0.00% FillPatchSingleLevel 147 0.0004623 0.0004832 0.0005271 0.00% Castro::apply_tagging_restrictions() 2 0.0004151 0.0004705 0.0005261 0.00% MLMG::mgVcycle_up::1 128 0.000444 0.0004655 0.0004925 0.00% Gravity::applyMetricTerms() 2 0.0004699 0.00048 0.0004909 0.00% Castro::clean_state() 79 0.0004305 0.0004522 0.0004876 0.00% MLMG::mgVcycle_up::0 128 0.0004475 0.0004606 0.0004813 0.00% MLCellLinOp::solutionResidual() 147 0.0004238 0.0004452 0.000472 0.00% MLMG::mgVcycle_up::2 128 0.0003839 0.0004209 0.000467 0.00% Castro::do_advance_ctu() 20 0.0004049 0.0004283 0.0004542 0.00% Castro::swap_state_time_levels() 8 0.0004254 0.0004366 0.0004512 0.00% makeSFC 95 0.0003735 0.0003974 0.000445 0.00% MLMG::mgVcycle_up::3 128 0.0003794 0.0003981 0.0004447 0.00% MLMG::mgVcycle_up::5 128 0.0003979 0.0004139 0.0004436 0.00% MLMG::mgVcycle_up::4 128 0.000382 0.0003935 0.0004277 0.00% Castro::enforce_consistent_e() 1 0.0003695 0.0003827 0.000405 0.00% Castro::volProductSum() 2 0.0003844 0.0003938 0.0004014 0.00% MLMG::oneIter() 128 0.0003703 0.0003872 0.000401 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003271 0.0003416 0.0003836 0.00% DistributionMapping::Distribute() 95 0.0002072 0.0002223 0.0002706 0.00% Castro::problem_post_timestep() 2 1.079e-05 2.951e-05 0.0002638 0.00% MLMG::computeResidual() 128 0.0002371 0.0002467 0.0002588 0.00% MLMG::mgVcycle_bottom 128 0.0002226 0.0002307 0.0002521 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002116 0.0002245 0.000244 0.00% Castro::finalize_do_advance() 17 0.0001455 0.000173 0.0002213 0.00% Amr::coarseTimeStep() 1 0.0001086 0.0001386 0.0002209 0.00% Castro::retry_advance_ctu() 11 5.881e-05 7.352e-05 0.0001697 0.00% Gravity::update_max_rhs() 2 0.0001528 0.0001599 0.0001668 0.00% MLMG::compResidual() 1 0.0001569 0.0001589 0.0001652 0.00% OwnerMask() 2 0.0001318 0.0001509 0.0001649 0.00% MLPoisson::define() 19 0.0001227 0.0001291 0.0001368 0.00% Castro::initialize_advance() 1 9.966e-05 0.0001109 0.0001341 0.00% Amr::grid_places() 2 7.209e-05 9.502e-05 0.0001302 0.00% Castro::check_for_nan() 37 9.927e-05 0.0001094 0.0001275 0.00% DistributionMapping::LeastUsedCPUs() 1 6.34e-05 0.0001071 0.0001257 0.00% Castro::apply_source_to_state() 37 9.604e-05 0.0001029 0.0001205 0.00% Gravity::test_composite_phi() 1 9.921e-05 0.0001034 0.0001203 0.00% TagBoxArray::mapPRD 2 0.0001076 0.0001138 0.0001196 0.00% Amr::defBaseLevel() 1 8.928e-05 0.0001054 0.0001172 0.00% Castro::enforce_speed_limit() 79 0.0001031 0.0001106 0.0001166 0.00% Castro::apply_problem_tags() 2 9.635e-05 0.0001027 0.0001126 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.901e-05 6.925e-05 9.941e-05 0.00% Castro::create_source_corrector() 17 5.508e-05 6.799e-05 9.838e-05 0.00% MLLinOp::define() 19 7.482e-05 8.021e-05 8.65e-05 0.00% MLPoisson::prepareForSolve() 19 7.575e-05 8.066e-05 8.578e-05 0.00% knapsack() 1 5.773e-05 6.849e-05 7.975e-05 0.00% MultiFab::Swap() 5 6.436e-05 6.771e-05 7.11e-05 0.00% Amr::initSubcycle() 1 5.335e-05 5.682e-05 6.348e-05 0.00% Castro::expand_state() 20 5.001e-05 5.53e-05 6.166e-05 0.00% Amr::FinalizeInit() 1 8.476e-06 1.605e-05 5.861e-05 0.00% MLMG::computeMLResidual() 18 3.962e-05 4.254e-05 4.783e-05 0.00% MLMG::getGradSolution() 18 3.858e-05 4.089e-05 4.389e-05 0.00% Castro::derive() 18 3.818e-05 4.066e-05 4.322e-05 0.00% MLMG::MLResNormInf() 18 3.38e-05 3.663e-05 4.096e-05 0.00% Gravity::swapTimeLevels() 8 3.288e-05 3.579e-05 4.019e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.128e-05 3.328e-05 3.703e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.741e-05 2.155e-05 3.602e-05 0.00% MLMG::MLRhsNormInf() 18 3.085e-05 3.187e-05 3.54e-05 0.00% Castro::construct_old_rotation_source() 20 2.956e-05 3.101e-05 3.199e-05 0.00% Amr::regrid() 1 1.06e-05 1.23e-05 2.971e-05 0.00% Gravity::actual_multilevel_solve() 1 2.621e-05 2.699e-05 2.827e-05 0.00% Amr::init() 1 5.945e-06 8.729e-06 2.752e-05 0.00% Castro::construct_new_rotation_source() 17 2.129e-05 2.233e-05 2.417e-05 0.00% Castro::finalize_advance() 1 1.625e-05 1.778e-05 2.073e-05 0.00% Amr::timeStep() 1 1.165e-05 1.576e-05 2.011e-05 0.00% Castro::advance() 1 7.109e-06 9.755e-06 1.731e-05 0.00% Castro::estTimeStep() 10 1.248e-05 1.336e-05 1.489e-05 0.00% Castro::post_init() 1 1.196e-05 1.273e-05 1.424e-05 0.00% Castro::post_regrid() 2 1.048e-05 1.126e-05 1.363e-05 0.00% Amr::InitializeInit() 1 6.873e-06 7.973e-06 1.333e-05 0.00% Amr::bldFineLevels() 1 6.633e-06 7.703e-06 8.882e-06 0.00% BoxList::parallelComplementIn() 4 6.777e-06 7.173e-06 7.925e-06 0.00% Castro::computeInitialDt() 2 6.501e-06 7.155e-06 7.816e-06 0.00% Castro::post_timestep() 1 5.447e-06 6.229e-06 7.498e-06 0.00% Castro::errorEst() 2 6.274e-06 6.497e-06 6.955e-06 0.00% BoxList::complementIn 4 5.945e-06 6.309e-06 6.635e-06 0.00% Castro::gwstrain() 2 4.177e-06 4.649e-06 6.544e-06 0.00% Gravity::set_mass_offset() 2 4.172e-06 4.546e-06 4.97e-06 0.00% Amr::initialInit() 1 3.036e-06 3.31e-06 3.846e-06 0.00% Castro::FluxRegCrseInit 1 1.599e-06 1.896e-06 2.173e-06 0.00% Castro::FluxRegFineAdd() 1 1.465e-06 1.57e-06 1.89e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.62 14.62 14.62 100.00% Amr::coarseTimeStep() 1 12.23 12.23 12.23 83.68% Amr::timeStep() 1 12.18 12.18 12.18 83.32% Castro::advance() 1 12.12 12.12 12.12 82.92% Castro::subcycle_advance_ctu() 1 12.07 12.07 12.07 82.57% Castro::do_advance_ctu() 20 12.03 12.03 12.03 82.31% Castro::construct_ctu_hydro_source() 20 6.524 6.562 6.599 45.13% Castro::clean_state() 79 3.667 3.845 4.078 27.89% Castro::computeTemp() 80 2.352 2.515 2.765 18.91% Castro::reset_internal_energy(MultiFab) 80 1.494 1.564 1.725 11.80% Gravity::solve_phi_with_mlmg() 19 1.499 1.554 1.599 10.94% Castro::initialize_do_advance() 20 1.397 1.471 1.525 10.43% Castro::construct_new_gravity() 17 1.429 1.481 1.525 10.43% Amr::InitAmr() 1 1.508 1.508 1.508 10.31% Gravity::solve_for_phi() 17 1.389 1.444 1.489 10.18% Gravity::actual_solve_with_mlmg() 19 1.295 1.299 1.304 8.92% Castro::do_old_sources() 20 1.167 1.239 1.266 8.66% MLMG::solve() 18 1.245 1.249 1.251 8.55% MLMG::oneIter() 128 1.103 1.106 1.109 7.59% FabArray::ParallelCopy() 1429 0.295 0.8273 1.096 7.49% MLMG::mgVcycle() 128 1.088 1.091 1.094 7.48% Castro::do_new_sources() 17 0.9386 0.993 1.073 7.34% Castro::evaluate_source_change() 196 0.9417 0.9589 0.983 6.72% Castro::enforce_min_density() 79 0.7907 0.824 0.8854 6.06% amrex::Copy() 724 0.8103 0.8258 0.8805 6.02% Amr::init() 1 0.8771 0.8771 0.8772 6.00% FabArray::ParallelCopy_finish() 1429 0.06246 0.5942 0.8716 5.96% Amr::initialInit() 1 0.8234 0.8235 0.8236 5.63% AmrLevel::FillPatch() 147 0.5024 0.6724 0.8076 5.52% MLCellLinOp::smooth() 3072 0.5514 0.6014 0.7313 5.00% FillPatchIterator::Initialize 147 0.3129 0.4853 0.6233 4.26% FillPatchIterator::FillFromLevel0() 147 0.2884 0.4666 0.6066 4.15% FillPatchSingleLevel 147 0.2877 0.4659 0.6058 4.14% Amr::InitializeInit() 1 0.4453 0.4988 0.6001 4.10% Amr::defBaseLevel() 1 0.4453 0.4987 0.6001 4.10% Castro::normalize_species() 79 0.551 0.5624 0.5824 3.98% MultiFab::AddProduct() 3439 0.5438 0.5525 0.5677 3.88% Castro::reset_internal_energy(Fab) 160 0.5118 0.5213 0.5364 3.67% MLPoisson::Fsmooth() 6144 0.315 0.3438 0.4221 2.89% MLMG::mgVcycle_up::1 128 0.0933 0.2577 0.422 2.89% check_for_negative_density() 20 0.06836 0.3006 0.4084 2.79% Castro::Castro() 1 0.3606 0.3663 0.3953 2.70% Castro::initMFs() 1 0.3553 0.3607 0.3883 2.66% MultiFab::Subtract() 159 0.3413 0.3483 0.3853 2.64% Amr::FinalizeInit() 1 0.2235 0.3248 0.3782 2.59% MLCellLinOp::applyBC() 7148 0.2695 0.3083 0.3725 2.55% MLMG::addInterpCorrection() 768 0.0633 0.3021 0.3722 2.55% FabArray::setVal() 5013 0.3437 0.3513 0.3654 2.50% Castro::expand_state() 20 0.1842 0.2492 0.3015 2.06% Gravity::fill_multipole_BCs() 19 0.2015 0.2536 0.2968 2.03% FabArray::FillBoundary() 6380 0.2094 0.2458 0.2782 1.90% MLMG::mgVcycle_up::2 128 0.01054 0.1155 0.2762 1.89% MLMG::mgVcycle_down::0 128 0.2625 0.2662 0.2701 1.85% FabArray::ParallelCopy_nowait() 1429 0.2123 0.2296 0.2559 1.75% Castro::initData() 1 0.07782 0.1307 0.2334 1.60% Amr::bldFineLevels() 1 0.04682 0.1477 0.2006 1.37% FabArray::sum() 3439 0.1905 0.1958 0.1999 1.37% MLMG::mgVcycle_up::0 128 0.196 0.1969 0.1975 1.35% MLCellLinOp::apply() 986 0.151 0.1633 0.1961 1.34% MLMG::mgVcycle_up::3 128 0.01045 0.02328 0.1766 1.21% Amr::grid_places() 2 0.002588 0.1039 0.1573 1.08% AmrMesh::MakeNewGrids() 2 0.002458 0.1038 0.1572 1.08% TagBoxArray::mapPRD 2 0.0007332 0.101 0.1557 1.07% MLMG:computeResOfCorrection() 768 0.113 0.1229 0.1466 1.00% FillBoundary_nowait() 6380 0.09072 0.1144 0.1465 1.00% MLCellLinOp::correctionResidual() 768 0.1116 0.1214 0.145 0.99% FillBoundary_finish() 6380 0.09529 0.1173 0.1417 0.97% Castro::construct_new_source() 102 0.1221 0.1254 0.1382 0.95% Castro::post_init() 1 0.1325 0.1334 0.1351 0.92% MLMG::mgVcycle_down::1 128 0.1139 0.1174 0.123 0.84% MLPoisson::Fapply() 986 0.09523 0.1007 0.1172 0.80% Castro::create_source_corrector() 17 0.04858 0.07481 0.1048 0.72% MLCellLinOp::solutionResidual() 147 0.08733 0.09472 0.1015 0.69% Gravity::multilevel_solve_for_new_phi() 1 0.0998 0.09983 0.09987 0.68% Gravity::actual_multilevel_solve() 1 0.09974 0.09976 0.0998 0.68% Amr::writePlotFile() 2 0.09703 0.09711 0.09712 0.66% Castro::post_regrid() 2 0.08575 0.08742 0.08839 0.60% Castro::construct_old_source() 120 0.07759 0.07909 0.08248 0.56% Castro::construct_new_gravity_source() 17 0.06762 0.06983 0.0817 0.56% FabArray::Saxpy() 264 0.06931 0.07135 0.07848 0.54% MLMG::computeResidual() 128 0.07563 0.07631 0.07759 0.53% Castro::construct_old_gravity() 20 0.04521 0.05868 0.07584 0.52% Castro::derive() 18 0.06956 0.07072 0.07195 0.49% AmrLevel::derive() 18 0.06952 0.07068 0.07191 0.49% MLMG::mgVcycle_down::2 128 0.0124 0.04064 0.07162 0.49% MLMG::mgVcycle_bottom 128 0.0003568 0.004798 0.07127 0.49% Gravity::get_old_grav_vector() 20 0.04285 0.05664 0.07107 0.49% MLMG::actualBottomSolve() 128 0.0001331 0.004567 0.07102 0.49% MLCGSolver::bicgstab 8 0 0.004342 0.06947 0.48% Castro::post_timestep() 1 0.05926 0.06213 0.06533 0.45% MLMG::mgVcycle_down::3 128 0.01172 0.018 0.06015 0.41% FabArray::Xpay() 945 0.04946 0.05218 0.0595 0.41% amrex::average_down 768 0.03229 0.03885 0.05395 0.37% Castro::initialize_advance() 1 0.04875 0.04983 0.05149 0.35% Castro::construct_old_gravity_source() 20 0.04475 0.04562 0.04858 0.33% Castro::check_for_nan() 37 0.04516 0.04598 0.04706 0.32% MultiFab::contains_nan() 37 0.04506 0.04587 0.04695 0.32% Amr::regrid() 1 0.04408 0.04492 0.04543 0.31% MLPoisson::define() 19 0.02926 0.03377 0.03971 0.27% Gravity::get_new_grav_vector() 18 0.03532 0.03622 0.03886 0.27% Castro::retry_advance_ctu() 11 0.03645 0.03717 0.03815 0.26% MLMG::mgVcycle_down::4 128 0.01166 0.01343 0.03532 0.24% StateDataPhysBCFunct::() 147 0.0006896 0.01818 0.03488 0.24% StateData::FillBoundary(geom) 143 0 0.01736 0.034 0.23% Castro::apply_source_to_state() 37 0.02828 0.02897 0.03222 0.22% MLMG::mgVcycle_up::4 128 0.01057 0.01175 0.02726 0.19% MLMG::prepareForSolve() 18 0.02001 0.02117 0.0251 0.17% MLMG::computeMLResidual() 18 0.01085 0.01796 0.02473 0.17% MLCellLinOp::defineAuxData() 19 0.01841 0.01974 0.02358 0.16% MLMG::mgVcycle_down::5 128 0.01167 0.01257 0.02313 0.16% VisMF::Write(FabArray) 4 0.01186 0.013 0.02211 0.15% Castro::sum_integrated_quantities() 2 0.0215 0.02166 0.02168 0.15% MLMG::ResNormInf() 146 0.01479 0.0179 0.02146 0.15% Castro::save_data_for_retry() 3 0.01942 0.01984 0.02036 0.14% MLMG::mgVcycle_up::5 128 0.01066 0.01137 0.01952 0.13% Castro::problem_post_timestep() 2 0.009238 0.01257 0.01678 0.11% Castro::wd_update() 2 0.009214 0.01254 0.01676 0.11% FabArray::norminf() 282 0.01089 0.01155 0.01568 0.11% amrex::Add() 128 0.01401 0.01427 0.01457 0.10% FabArrayBase::getFB() 6380 0.01013 0.01097 0.01452 0.10% Gravity::test_composite_phi() 1 0.01411 0.01413 0.01416 0.10% FabArrayBase::getCPC() 2005 0.009456 0.01078 0.0141 0.10% MLLinOp::define() 19 0.003992 0.008208 0.01242 0.08% MLLinOp::defineGrids() 19 0.003905 0.008128 0.01234 0.08% FabArray::setDomainBndry() 147 0.0004373 0.006094 0.01158 0.08% TagBoxArray::collate() 2 0.0001762 0.001577 0.009461 0.06% MLLinOp::makeSubCommunicator() 19 0.0007539 0.00524 0.009174 0.06% Amr::writeSmallPlotFile() 2 0.008664 0.008669 0.008671 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005087 0.008139 0.06% MLMG::getGradSolution() 18 0.007441 0.007723 0.008039 0.05% MLCellLinOp::compGrad() 18 0.007399 0.007682 0.007999 0.05% Castro::volWgtSum() 46 0.007412 0.007515 0.007675 0.05% FabArray::mult() 59 0.00705 0.007201 0.007632 0.05% FabArrayBase::CPC::define() 576 0.002179 0.003315 0.006352 0.04% MLCellLinOp::defineBC() 19 0.00547 0.005693 0.006158 0.04% amrex::Dot() 142 0 0.0003808 0.006093 0.04% Castro::volInBoundary() 14 0.00343 0.003718 0.005337 0.04% BndryData::define() 19 0.003975 0.004166 0.004553 0.03% Gravity::update_max_rhs() 2 0.001418 0.00242 0.004091 0.03% MLPoisson::normalize() 79 0 0.0001969 0.00315 0.02% MultiFab::max() 2 0.0001719 0.00119 0.002874 0.02% MLPoisson::prepareForSolve() 19 0.001709 0.001858 0.002166 0.01% MLCellLinOp::prepareForSolve() 19 0.001624 0.001777 0.002085 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001303 0.001561 0.001805 0.01% MLMG::MLResNormInf() 18 0.00126 0.001309 0.001658 0.01% MLMG::MLRhsNormInf() 18 0.001194 0.001259 0.001625 0.01% AmrLevel::AmrLevel(dm) 1 0.001367 0.001397 0.001521 0.01% StateData::define() 6 0.001336 0.001364 0.001484 0.01% FabArrayBase::FB::FB() 75 0.0002827 0.0006774 0.001465 0.01% Gravity::swapTimeLevels() 8 0.001138 0.001175 0.001233 0.01% MLMG::compResidual() 1 0.000972 0.001101 0.001233 0.01% Castro::locWgtSum() 6 0.00114 0.001164 0.001186 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009119 0.0009614 0.001082 0.01% MLCellLinOp::setLevelBC() 19 0.0005377 0.0006643 0.0008359 0.01% Castro::buildMetrics() 1 0.0006317 0.0006553 0.0007591 0.01% makeSFC 95 0.0005812 0.0006197 0.0006984 0.00% Castro::errorEst() 2 0.0005211 0.0005798 0.0006427 0.00% Castro::apply_tagging_restrictions() 2 0.0004151 0.0004705 0.0005261 0.00% Gravity::applyMetricTerms() 2 0.0004699 0.00048 0.0004909 0.00% Castro::swap_state_time_levels() 8 0.0004254 0.0004366 0.0004512 0.00% Castro::enforce_consistent_e() 1 0.0003695 0.0003827 0.000405 0.00% Castro::volProductSum() 2 0.0003844 0.0003938 0.0004014 0.00% Castro::finalize_advance() 1 0.0002617 0.0002695 0.0002948 0.00% DistributionMapping::Distribute() 95 0.0002072 0.0002223 0.0002706 0.00% Castro::finalize_do_advance() 17 0.0001561 0.0001832 0.0002322 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001503 0.0001971 0.0002212 0.00% OwnerMask() 2 0.0001318 0.0001509 0.0001649 0.00% DistributionMapping::LeastUsedCPUs() 1 6.34e-05 0.0001071 0.0001257 0.00% Castro::enforce_speed_limit() 79 0.0001031 0.0001106 0.0001166 0.00% Castro::apply_problem_tags() 2 9.635e-05 0.0001027 0.0001126 0.00% knapsack() 1 5.773e-05 6.849e-05 7.975e-05 0.00% MultiFab::Swap() 5 6.436e-05 6.771e-05 7.11e-05 0.00% Amr::initSubcycle() 1 5.335e-05 5.682e-05 6.348e-05 0.00% Castro::construct_old_rotation_source() 20 2.956e-05 3.101e-05 3.199e-05 0.00% Castro::construct_new_rotation_source() 17 2.129e-05 2.233e-05 2.417e-05 0.00% Castro::estTimeStep() 10 1.248e-05 1.336e-05 1.489e-05 0.00% BoxList::parallelComplementIn() 4 1.272e-05 1.348e-05 1.443e-05 0.00% Castro::computeInitialDt() 2 9.664e-06 1.029e-05 1.091e-05 0.00% BoxList::complementIn 4 5.945e-06 6.309e-06 6.635e-06 0.00% Castro::gwstrain() 2 4.177e-06 4.649e-06 6.544e-06 0.00% Gravity::set_mass_offset() 2 4.172e-06 4.546e-06 4.97e-06 0.00% Castro::FluxRegCrseInit 1 1.599e-06 1.896e-06 2.173e-06 0.00% Castro::FluxRegFineAdd() 1 1.465e-06 1.57e-06 1.89e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 14 B 22 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-35-gb892132f6144) finalized