Initializing AMReX (24.09-35-g23a7f34fd7a4)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.09-35-g23a7f34fd7a4) initialized Starting run at 08:06:54 UTC on 2024-09-18. Successfully read inputs file ... Castro git describe: 24.09-9-gf39525f5f AMReX git describe: 24.09-35-g23a7f34fd Microphysics git describe: 24.09-4-gca10c3ea reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data Now regridding at level lbase = 0 grid_places() time: 0.174918433 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 grid_places() time: 0.001169006 new finest: 0 Gravity::fill_multipole_BCs() time = 0.011652212 Gravity::multilevel_solve_for_new_phi() time = 0.112520288 ... norm of composite residual at level 0 1.193955541e-11 Gravity::fill_multipole_BCs() time = 0.010670022 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.04978595 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.00423571 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Castro::construct_old_gravity() time = 0.004402608 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065519441 on level 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Castro::construct_old_gravity() time = 0.005284339 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.065185179 on level 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Castro::construct_old_gravity() time = 0.005239166 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.061005485 on level 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. ... Entering construct_ctu_hydro_source() on level 0 Castro::construct_old_gravity() time = 0.005331654 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059286162 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Castro::construct_ctu_hydro_source() time = 0.323663538 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015752569 Gravity::solve_for_phi() time = 0.096802871 on level 0 Castro::construct_new_gravity() time = 0.098952329 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060095466 on level 0 Castro::construct_old_gravity() time = 0.003388728 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059123477 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Castro::construct_ctu_hydro_source() time = 0.327032876 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015969237 Gravity::solve_for_phi() time = 0.093756729 on level 0 Castro::construct_new_gravity() time = 0.095972767 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.058682523 on level 0 Castro::construct_old_gravity() time = 0.003560799 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.061802696 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Castro::construct_ctu_hydro_source() time = 0.332097145 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015636835 Gravity::solve_for_phi() time = 0.096280247 on level 0 Castro::construct_new_gravity() time = 0.098477503 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.060892627 on level 0 Castro::construct_old_gravity() time = 0.007282595 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059868549 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 Castro::construct_ctu_hydro_source() time = 0.336165997 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.016002265 Gravity::solve_for_phi() time = 0.095620142 on level 0 Castro::construct_new_gravity() time = 0.098345009 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.061475545 on level 0 Castro::construct_old_gravity() time = 0.005051112 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059819438 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 Castro::construct_ctu_hydro_source() time = 0.343628848 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.016712603 Gravity::solve_for_phi() time = 0.098520135 on level 0 Castro::construct_new_gravity() time = 0.100677508 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060786771 on level 0 Castro::construct_old_gravity() time = 0.003517485 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.060798493 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 Castro::construct_ctu_hydro_source() time = 0.338367356 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.016073437 Gravity::solve_for_phi() time = 0.099333898 on level 0 Castro::construct_new_gravity() time = 0.101583077 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.059939043 on level 0 Castro::construct_old_gravity() time = 0.004625137 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.060431186 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 Castro::construct_ctu_hydro_source() time = 0.343451922 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015998857 Gravity::solve_for_phi() time = 0.100665749 on level 0 Castro::construct_new_gravity() time = 0.102889266 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060331111 on level 0 Castro::construct_old_gravity() time = 0.003298319 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.061730426 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 Castro::construct_ctu_hydro_source() time = 0.333082704 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.016947641 Gravity::solve_for_phi() time = 0.095239314 on level 0 Castro::construct_new_gravity() time = 0.097439547 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.058984007 on level 0 Castro::construct_old_gravity() time = 0.00376564 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058579285 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 Castro::construct_ctu_hydro_source() time = 0.330211415 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015424378 Gravity::solve_for_phi() time = 0.093684662 on level 0 Castro::construct_new_gravity() time = 0.095817855 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.05904088 on level 0 Castro::construct_old_gravity() time = 0.003127147 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058649845 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 Castro::construct_ctu_hydro_source() time = 0.324084483 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014913092 Gravity::solve_for_phi() time = 0.092237949 on level 0 Castro::construct_new_gravity() time = 0.09439843 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.058981837 on level 0 Castro::construct_old_gravity() time = 0.003006943 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059067851 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 Castro::construct_ctu_hydro_source() time = 0.333423444 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.01566531 Gravity::solve_for_phi() time = 0.094400401 on level 0 Castro::construct_new_gravity() time = 0.096543854 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059153571 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003711071 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059345216 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 Castro::construct_ctu_hydro_source() time = 0.32562276 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.01659667 Gravity::solve_for_phi() time = 0.096189563 on level 0 Castro::construct_new_gravity() time = 0.098572099 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.058972952 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.004513281 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058605036 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 Castro::construct_ctu_hydro_source() time = 0.328633576 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.016811037 Gravity::solve_for_phi() time = 0.093741788 on level 0 Castro::construct_new_gravity() time = 0.095879978 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059243158 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.00287029 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058538484 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 Castro::construct_ctu_hydro_source() time = 0.321468722 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.016511645 Gravity::solve_for_phi() time = 0.093214515 on level 0 Castro::construct_new_gravity() time = 0.095377657 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059058041 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.00278585 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058390601 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 Castro::construct_ctu_hydro_source() time = 0.327050388 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015158944 Gravity::solve_for_phi() time = 0.094392285 on level 0 Castro::construct_new_gravity() time = 0.096543932 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.058864417 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002818377 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058521867 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 Castro::construct_ctu_hydro_source() time = 0.319159594 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.01610081 Gravity::solve_for_phi() time = 0.092484166 on level 0 Castro::construct_new_gravity() time = 0.094703417 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.058963502 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002949059 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058486762 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 Castro::construct_ctu_hydro_source() time = 0.32542939 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002743362179 [Level 0 step 1] Advanced 32768 cells Gravity::fill_multipole_BCs() time = 0.016739517 Gravity::solve_for_phi() time = 0.094176369 on level 0 Castro::construct_new_gravity() time = 0.096326168 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059618902 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 STEP = 1 TIME = 0.25 DT = 0.25 [STEP 1] Coarse TimeStep time: 12.00372882 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.048152643 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004175558 seconds Ending run at 08:07:09 UTC on 2024-09-18. Run time = 15.00474046 Run time without initialization = 12.05696956 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 15.0047 ... 15.0048 ... 15.0048 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.2581 5.3306 5.5130 36.74% Amr::InitAmr() 1 2.042 2.042 2.042 13.61% Castro::computeTemp() 80 0.8526 0.9534 1.103 7.35% amrex::Copy() 724 0.7893 0.8009 0.8217 5.48% FabArray::ParallelCopy_finish() 1429 0.2237 0.5755 0.8181 5.45% Castro::normalize_species() 79 0.5469 0.5544 0.571 3.81% MultiFab::AddProduct() 3439 0.5412 0.5482 0.5621 3.75% Castro::reset_internal_energy(Fab) 160 0.5161 0.5254 0.5357 3.57% MLPoisson::Fsmooth() 6144 0.3494 0.3798 0.4594 3.06% Castro::initMFs() 1 0.3533 0.3599 0.3744 2.50% FabArray::setVal() 5013 0.349 0.3551 0.3648 2.43% MultiFab::Subtract() 159 0.3435 0.3478 0.3545 2.36% check_for_negative_density() 20 0.04567 0.2531 0.3442 2.29% Gravity::fill_multipole_BCs() 19 0.2066 0.2642 0.2922 1.95% FabArray::ParallelCopy_nowait() 1429 0.2047 0.2232 0.2469 1.65% FabArray::sum() 3439 0.1851 0.1871 0.1926 1.28% FillBoundary_finish() 6380 0.1309 0.1519 0.1852 1.23% Castro::initData() 1 0.003301 0.0276 0.1633 1.09% FillBoundary_nowait() 6380 0.09348 0.1219 0.1586 1.06% TagBoxArray::collate() 2 0.0001893 0.03195 0.1482 0.99% MLCellLinOp::applyBC() 7148 0.06423 0.08006 0.1272 0.85% MLPoisson::Fapply() 986 0.09314 0.09888 0.1139 0.76% FabArray::Saxpy() 264 0.07063 0.07193 0.07921 0.53% Castro::construct_new_gravity_source() 17 0.06897 0.07017 0.0741 0.49% FabArray::Xpay() 945 0.05105 0.05358 0.06095 0.41% MultiFab::contains_nan() 37 0.04545 0.04614 0.0473 0.32% Castro::construct_old_gravity_source() 20 0.04486 0.04557 0.04643 0.31% MLMG::addInterpCorrection() 768 0.03375 0.03656 0.04447 0.30% AmrLevel::derive() 18 0.04047 0.04105 0.04209 0.28% amrex::average_down 768 0.02476 0.02721 0.03417 0.23% StateData::FillBoundary(geom) 143 0 0.01754 0.03345 0.22% VisMF::Write(FabArray) 4 0.0135 0.01463 0.02494 0.17% Castro::reset_internal_energy(MultiFab) 80 0.02319 0.02379 0.02443 0.16% Castro::enforce_min_density() 79 0.01871 0.01903 0.02051 0.14% MLCellLinOp::defineAuxData() 19 0.01588 0.01698 0.02041 0.14% MLCGSolver::bicgstab 8 0 0.001136 0.01818 0.12% Castro::construct_new_source() 102 0.01592 0.01621 0.018 0.12% Amr::writePlotFile() 2 0.006788 0.016 0.01775 0.12% FabArray::FillBoundary() 6380 0.01378 0.01444 0.01741 0.12% FabArray::norminf() 282 0.01111 0.01167 0.01587 0.11% Castro::evaluate_source_change() 196 0.01376 0.01429 0.01513 0.10% amrex::Add() 128 0.01422 0.01444 0.01512 0.10% FabArray::setDomainBndry() 147 0.0004717 0.007795 0.01482 0.10% MLMG::ResNormInf() 146 0.004753 0.01037 0.01467 0.10% FabArrayBase::getFB() 6380 0.01082 0.01139 0.01395 0.09% MLCellLinOp::smooth() 3072 0.01189 0.01257 0.01372 0.09% FillPatchIterator::Initialize 147 0.01277 0.01314 0.01352 0.09% MLMG::prepareForSolve() 18 0.01033 0.01073 0.01179 0.08% Castro::wd_update() 2 0.00463 0.008088 0.0117 0.08% Castro::construct_old_source() 120 0.0102 0.01049 0.01169 0.08% Gravity::actual_solve_with_mlmg() 19 0.007424 0.007893 0.009276 0.06% FabArrayBase::getCPC() 2005 0.007568 0.007778 0.008117 0.05% Gravity::get_new_grav_vector() 18 0.006052 0.006271 0.00748 0.05% Gravity::get_old_grav_vector() 20 0.006559 0.00673 0.007343 0.05% MLMG::solve() 18 0.001511 0.003764 0.007268 0.05% MLCellLinOp::apply() 986 0.002057 0.002291 0.004862 0.03% Castro::initialize_do_advance() 20 0.004505 0.004707 0.004835 0.03% FabArray::ParallelCopy() 1429 0.003571 0.003743 0.004109 0.03% AmrLevel::FillPatch() 147 0.002422 0.002495 0.002713 0.02% Castro::sum_integrated_quantities() 2 0.001734 0.002329 0.002705 0.02% MLCellLinOp::correctionResidual() 768 0.001901 0.001979 0.002094 0.01% Castro::save_data_for_retry() 3 0.001304 0.001558 0.002079 0.01% MLMG::mgVcycle() 128 0.001604 0.001679 0.001837 0.01% MLMG:computeResOfCorrection() 768 0.001458 0.001527 0.001597 0.01% MLMG::actualBottomSolve() 128 0.0001329 0.0001961 0.001072 0.01% StateDataPhysBCFunct::() 147 0.000729 0.0008762 0.001022 0.01% Castro::subcycle_advance_ctu() 1 0.0002448 0.0003336 0.001005 0.01% main() 1 0.0006999 0.000746 0.0008756 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006955 0.0007203 0.0007862 0.01% Gravity::solve_for_phi() 17 0.0006571 0.0006969 0.0007757 0.01% MLMG::mgVcycle_down::2 128 0.0006505 0.0007052 0.0007575 0.01% MLMG::mgVcycle_down::1 128 0.0006772 0.0006959 0.0007538 0.01% MLMG::mgVcycle_down::3 128 0.000602 0.0006592 0.0007536 0.01% MLMG::mgVcycle_down::0 128 0.0006812 0.000698 0.0007419 0.00% MLMG::mgVcycle_down::4 128 0.0005917 0.000619 0.0007175 0.00% MLMG::mgVcycle_down::5 128 0.0006098 0.0006326 0.0007017 0.00% AmrMesh::MakeNewGrids() 2 0.0005405 0.00056 0.00058 0.00% MLMG::mgVcycle_up::0 128 0.0004837 0.0005054 0.0005517 0.00% MLMG::mgVcycle_up::1 128 0.0004796 0.0005049 0.0005384 0.00% Castro::clean_state() 79 0.0004538 0.0004798 0.0005184 0.00% FillPatchSingleLevel 147 0.000474 0.0004919 0.0005122 0.00% MLMG::mgVcycle_up::2 128 0.000419 0.0004616 0.0005101 0.00% MLCellLinOp::solutionResidual() 147 0.0004535 0.00047 0.0004913 0.00% MLMG::mgVcycle_up::3 128 0.0004151 0.0004345 0.0004795 0.00% MLMG::mgVcycle_up::5 128 0.0004106 0.000426 0.0004719 0.00% MLMG::mgVcycle_up::4 128 0.0004193 0.0004371 0.0004718 0.00% Castro::Castro() 1 0.0003704 0.0003904 0.000452 0.00% Castro::do_advance_ctu() 20 0.0004012 0.00042 0.0004505 0.00% MLMG::oneIter() 128 0.000388 0.0004046 0.0004281 0.00% Castro::do_old_sources() 20 0.0002907 0.000302 0.0003208 0.00% Castro::construct_new_gravity() 17 0.0001603 0.0001743 0.0002916 0.00% Castro::do_new_sources() 17 0.0002176 0.0002333 0.0002761 0.00% MLMG::computeResidual() 128 0.0002359 0.0002462 0.0002666 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002224 0.0002374 0.000259 0.00% MLMG::mgVcycle_bottom 128 0.0002278 0.0002342 0.0002544 0.00% Castro::problem_post_timestep() 2 1.153e-05 2.735e-05 0.0002467 0.00% Amr::coarseTimeStep() 1 0.0001345 0.0001604 0.0001651 0.00% Gravity::test_composite_phi() 1 0.0001071 0.0001139 0.0001514 0.00% Castro::check_for_nan() 37 0.0001086 0.0001162 0.0001402 0.00% TagBoxArray::mapPRD 2 0.0001248 0.0001316 0.0001383 0.00% Castro::construct_old_gravity() 20 0.0001029 0.0001175 0.0001346 0.00% MLPoisson::define() 19 0.0001189 0.0001279 0.0001337 0.00% Castro::retry_advance_ctu() 11 6.068e-05 7.544e-05 0.0001251 0.00% Castro::initialize_advance() 1 0.0001062 0.0001105 0.000118 0.00% Castro::apply_source_to_state() 37 0.0001007 0.0001053 0.0001154 0.00% Amr::defBaseLevel() 1 9.591e-05 0.0001038 0.0001153 0.00% MLLinOp::define() 19 7.415e-05 7.779e-05 8.5e-05 0.00% Castro::create_source_corrector() 17 5.585e-05 6.228e-05 8.121e-05 0.00% Amr::grid_places() 2 5.809e-05 6.401e-05 7.292e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.947e-05 6.138e-05 6.398e-05 0.00% Castro::expand_state() 20 5.217e-05 5.471e-05 5.771e-05 0.00% Amr::regrid() 1 1.627e-05 2.209e-05 5.425e-05 0.00% Amr::FinalizeInit() 1 8.172e-06 1.221e-05 5.15e-05 0.00% Castro::derive() 18 4.15e-05 4.418e-05 5.081e-05 0.00% MLMG::computeMLResidual() 18 4.027e-05 4.319e-05 4.837e-05 0.00% Gravity::actual_multilevel_solve() 1 3.112e-05 3.274e-05 3.522e-05 0.00% Amr::timeStep() 1 1.387e-05 1.64e-05 2.017e-05 0.00% Amr::InitializeInit() 1 7.059e-06 8.512e-06 1.535e-05 0.00% Amr::init() 1 6.536e-06 7.636e-06 1.449e-05 0.00% Castro::post_init() 1 1.157e-05 1.238e-05 1.359e-05 0.00% Castro::post_regrid() 2 1.083e-05 1.126e-05 1.219e-05 0.00% Castro::advance() 1 6.682e-06 7.84e-06 1.198e-05 0.00% Amr::bldFineLevels() 1 6.866e-06 7.721e-06 1.153e-05 0.00% Castro::post_timestep() 1 5.578e-06 6.273e-06 8.406e-06 0.00% Amr::initialInit() 1 2.879e-06 3.173e-06 3.848e-06 0.00% Other 2459 0.04947 0.06299 0.09174 0.61% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 15 15 15 100.00% Amr::coarseTimeStep() 1 12.06 12.06 12.06 80.35% Amr::timeStep() 1 12 12 12 80.00% Castro::advance() 1 11.94 11.94 11.95 79.61% Castro::subcycle_advance_ctu() 1 11.89 11.89 11.9 79.29% Castro::do_advance_ctu() 20 11.85 11.85 11.86 79.03% Castro::construct_ctu_hydro_source() 20 6.333 6.364 6.426 42.83% Castro::clean_state() 79 3.679 3.788 3.924 26.15% Castro::computeTemp() 80 2.367 2.462 2.601 17.33% Amr::InitAmr() 1 2.042 2.042 2.042 13.61% Gravity::solve_phi_with_mlmg() 19 1.656 1.715 1.744 11.62% Castro::construct_new_gravity() 17 1.57 1.629 1.658 11.05% Gravity::solve_for_phi() 17 1.533 1.591 1.62 10.80% Castro::reset_internal_energy(MultiFab) 80 1.488 1.508 1.542 10.27% Castro::initialize_do_advance() 20 1.384 1.435 1.485 9.90% Gravity::actual_solve_with_mlmg() 19 1.443 1.447 1.451 9.67% MLMG::solve() 18 1.387 1.393 1.395 9.29% MLMG::oneIter() 128 1.244 1.247 1.251 8.34% MLMG::mgVcycle() 128 1.229 1.233 1.236 8.24% Castro::do_old_sources() 20 1.159 1.174 1.189 7.92% FabArray::ParallelCopy() 1429 0.474 0.8227 1.061 7.07% Castro::do_new_sources() 17 0.9224 0.9666 1.004 6.69% Castro::evaluate_source_change() 196 0.939 0.9512 0.9757 6.50% Amr::init() 1 0.9053 0.9053 0.9054 6.03% Amr::initialInit() 1 0.8508 0.8509 0.851 5.67% MLCellLinOp::smooth() 3072 0.6367 0.6966 0.8395 5.59% amrex::Copy() 724 0.7893 0.8009 0.8217 5.48% Castro::enforce_min_density() 79 0.7875 0.7992 0.8194 5.46% FabArray::ParallelCopy_finish() 1429 0.2237 0.5755 0.8181 5.45% AmrLevel::FillPatch() 147 0.5397 0.6229 0.7102 4.73% Amr::InitializeInit() 1 0.438 0.4701 0.6113 4.07% Amr::defBaseLevel() 1 0.438 0.47 0.6113 4.07% Castro::normalize_species() 79 0.5469 0.5544 0.571 3.81% MultiFab::AddProduct() 3439 0.5412 0.5482 0.5621 3.75% Castro::reset_internal_energy(Fab) 160 0.5161 0.5254 0.5357 3.57% FillPatchIterator::Initialize 147 0.3524 0.4402 0.5304 3.53% FillPatchIterator::FillFromLevel0() 147 0.3334 0.4193 0.5116 3.41% FillPatchSingleLevel 147 0.3327 0.4186 0.5108 3.40% MLMG::mgVcycle_up::1 128 0.1072 0.2928 0.4784 3.19% MLCellLinOp::applyBC() 7148 0.3467 0.3805 0.4653 3.10% MLPoisson::Fsmooth() 6144 0.3494 0.3798 0.4594 3.06% MLMG::addInterpCorrection() 768 0.06689 0.3351 0.4147 2.76% Amr::FinalizeInit() 1 0.2396 0.3808 0.4128 2.75% Castro::Castro() 1 0.3586 0.3653 0.3798 2.53% Castro::initMFs() 1 0.3535 0.3601 0.3746 2.50% FabArray::setVal() 5013 0.349 0.3551 0.3648 2.43% MultiFab::Subtract() 159 0.3435 0.3478 0.3545 2.36% check_for_negative_density() 20 0.04567 0.2531 0.3442 2.29% FabArray::FillBoundary() 6380 0.2649 0.3004 0.3436 2.29% MLMG::mgVcycle_up::2 128 0.01394 0.1319 0.3115 2.08% Gravity::fill_multipole_BCs() 19 0.2088 0.2663 0.2943 1.96% MLMG::mgVcycle_down::0 128 0.2839 0.2874 0.2923 1.95% Castro::expand_state() 20 0.1953 0.2323 0.2782 1.85% FabArray::ParallelCopy_nowait() 1429 0.2243 0.2435 0.2684 1.79% Castro::initData() 1 0.07752 0.1031 0.2397 1.60% Amr::bldFineLevels() 1 0.04705 0.1877 0.2188 1.46% MLMG::mgVcycle_up::0 128 0.215 0.2161 0.2176 1.45% MLCellLinOp::apply() 986 0.1631 0.1755 0.2157 1.44% MLMG::mgVcycle_up::3 128 0.01391 0.02827 0.1991 1.33% FabArray::sum() 3439 0.1851 0.1871 0.1926 1.28% FillBoundary_finish() 6380 0.1309 0.1519 0.1852 1.23% Amr::grid_places() 2 0.002834 0.144 0.176 1.17% AmrMesh::MakeNewGrids() 2 0.002772 0.144 0.176 1.17% TagBoxArray::mapPRD 2 0.001177 0.1107 0.1744 1.16% FillBoundary_nowait() 6380 0.1057 0.1341 0.1719 1.15% MLMG:computeResOfCorrection() 768 0.1195 0.1327 0.1602 1.07% MLCellLinOp::correctionResidual() 768 0.1181 0.1311 0.1586 1.06% Castro::post_init() 1 0.1462 0.1497 0.1515 1.01% TagBoxArray::collate() 2 0.0001893 0.03195 0.1482 0.99% MLMG::mgVcycle_down::1 128 0.1299 0.1335 0.1399 0.93% Castro::construct_new_source() 102 0.1246 0.1266 0.1334 0.89% MLPoisson::Fapply() 986 0.09314 0.09888 0.1139 0.76% Gravity::multilevel_solve_for_new_phi() 1 0.1125 0.1125 0.1125 0.75% Gravity::actual_multilevel_solve() 1 0.1124 0.1124 0.1125 0.75% MLCellLinOp::solutionResidual() 147 0.09182 0.09858 0.1036 0.69% Amr::writePlotFile() 2 0.09828 0.09837 0.09838 0.66% Castro::create_source_corrector() 17 0.05185 0.07205 0.09413 0.63% Castro::post_regrid() 2 0.08523 0.08706 0.09051 0.60% MLMG::computeResidual() 128 0.07942 0.08083 0.08644 0.58% MLMG::mgVcycle_down::2 128 0.01616 0.04886 0.08621 0.57% Castro::construct_old_source() 120 0.07866 0.07976 0.08216 0.55% FabArray::Saxpy() 264 0.07063 0.07193 0.07921 0.53% MLMG::mgVcycle_bottom 128 0.0003616 0.005223 0.07801 0.52% MLMG::actualBottomSolve() 128 0.0001329 0.004989 0.07775 0.52% MLCGSolver::bicgstab 8 0 0.004761 0.07617 0.51% Castro::construct_new_gravity_source() 17 0.06897 0.07017 0.0741 0.49% Castro::derive() 18 0.06935 0.07047 0.07179 0.48% AmrLevel::derive() 18 0.06931 0.07043 0.07175 0.48% Castro::construct_old_gravity() 20 0.04645 0.06237 0.0712 0.47% Gravity::get_old_grav_vector() 20 0.04633 0.06225 0.07108 0.47% MLMG::mgVcycle_down::3 128 0.01551 0.02257 0.06859 0.46% Castro::post_timestep() 1 0.05832 0.06108 0.06387 0.43% FabArray::Xpay() 945 0.05105 0.05358 0.06095 0.41% amrex::average_down 768 0.03374 0.04137 0.06028 0.40% Castro::initialize_advance() 1 0.04848 0.04948 0.05121 0.34% Castro::check_for_nan() 37 0.04557 0.04626 0.04742 0.32% MultiFab::contains_nan() 37 0.04545 0.04614 0.0473 0.32% Amr::regrid() 1 0.04388 0.04482 0.0465 0.31% Castro::construct_old_gravity_source() 20 0.04486 0.04557 0.04643 0.31% MLPoisson::define() 19 0.03303 0.03682 0.04297 0.29% MLMG::mgVcycle_down::4 128 0.01545 0.01737 0.04076 0.27% Castro::retry_advance_ctu() 11 0.03575 0.03759 0.03932 0.26% Gravity::get_new_grav_vector() 18 0.0368 0.03777 0.03881 0.26% StateDataPhysBCFunct::() 147 0.000729 0.01842 0.03441 0.23% StateData::FillBoundary(geom) 143 0 0.01754 0.03345 0.22% MLMG::mgVcycle_up::4 128 0.01399 0.01541 0.03243 0.22% Castro::apply_source_to_state() 37 0.02878 0.02912 0.02977 0.20% MLMG::mgVcycle_down::5 128 0.0154 0.01651 0.02876 0.19% MLCellLinOp::defineAuxData() 19 0.02014 0.02203 0.02767 0.18% VisMF::Write(FabArray) 4 0.0135 0.01463 0.02494 0.17% MLMG::mgVcycle_up::5 128 0.0141 0.01505 0.02473 0.16% MLMG::ResNormInf() 146 0.01472 0.02027 0.02464 0.16% MLMG::prepareForSolve() 18 0.02072 0.02177 0.02456 0.16% MLMG::computeMLResidual() 18 0.01095 0.01723 0.02216 0.15% Castro::sum_integrated_quantities() 2 0.02179 0.02193 0.02194 0.15% Castro::save_data_for_retry() 3 0.01893 0.01988 0.02125 0.14% FabArray::norminf() 282 0.01111 0.01167 0.01587 0.11% FabArrayBase::getFB() 6380 0.01118 0.01214 0.01562 0.10% FabArrayBase::getCPC() 2005 0.01 0.01137 0.01529 0.10% Castro::problem_post_timestep() 2 0.009626 0.01181 0.01514 0.10% Castro::wd_update() 2 0.009614 0.01178 0.01512 0.10% amrex::Add() 128 0.01422 0.01444 0.01512 0.10% FabArray::setDomainBndry() 147 0.0004717 0.007795 0.01482 0.10% Gravity::test_composite_phi() 1 0.01448 0.01452 0.01454 0.10% MLLinOp::define() 19 0.004027 0.008154 0.01179 0.08% Other 2459 0.08263 0.1032 0.1413 0.94% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 9 B 12 B 19 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- Cpu Memory Usage: ------------------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------------------------------- Castro::save_data_for_retry() 416 416 1493 KiB 1494 KiB 1494 KiB 2297 KiB 2297 KiB 2297 KiB Castro::construct_ctu_hydro_source() 6400 6400 369 KiB 374 KiB 387 KiB 1156 KiB 1156 KiB 1156 KiB StateData::define() 192 192 991 KiB 992 KiB 992 KiB 1148 KiB 1148 KiB 1148 KiB Castro::initMFs() 256 256 943 KiB 944 KiB 944 KiB 1093 KiB 1093 KiB 1093 KiB Castro::swap_state_time_levels() 160 160 632 KiB 632 KiB 632 KiB 787 KiB 787 KiB 787 KiB Amr::writePlotFile() 64 64 4111 B 4202 B 4712 B 736 KiB 736 KiB 736 KiB Castro::reset_internal_energy(MultiFab) 5120 5120 48 KiB 49 KiB 50 KiB 640 KiB 640 KiB 640 KiB FillPatchIterator::Initialize 4704 4704 11 KiB 13 KiB 15 KiB 500 KiB 500 KiB 500 KiB Castro::initialize_do_advance() 640 640 395 KiB 396 KiB 396 KiB 500 KiB 500 KiB 500 KiB FabArray::ParallelCopy_nowait() 12704 12704 1996 B 3896 B 5377 B 215 KiB 285 KiB 360 KiB AmrLevel::derive() 1152 1152 1282 B 1301 B 1329 B 336 KiB 336 KiB 336 KiB Castro::enforce_min_density() 2528 2528 16 KiB 16 KiB 17 KiB 320 KiB 320 KiB 320 KiB Castro::initialize_advance() 32 32 125 KiB 125 KiB 125 KiB 157 KiB 157 KiB 157 KiB MLMG::prepareForSolve() 6102 6102 9696 B 10 KiB 11 KiB 102 KiB 108 KiB 126 KiB Castro::buildMetrics() 160 160 101 KiB 101 KiB 101 KiB 117 KiB 117 KiB 117 KiB Castro::construct_old_source() 640 640 250 B 253 B 265 B 112 KiB 112 KiB 112 KiB Castro::construct_new_source() 544 544 419 B 424 B 446 B 112 KiB 112 KiB 112 KiB Amr::writeSmallPlotFile() 64 64 17 B 20 B 35 B 80 KiB 80 KiB 80 KiB Castro::Castro() 128 128 31 KiB 32 KiB 32 KiB 74 KiB 74 KiB 74 KiB Gravity::test_composite_phi() 96 96 50 B 50 B 51 B 52 KiB 52 KiB 52 KiB Gravity::update_max_rhs() 192 192 3 B 6 B 9 B 49 KiB 49 KiB 49 KiB Gravity::get_new_grav_vector() 576 576 110 B 113 B 116 B 45 KiB 45 KiB 45 KiB Gravity::get_old_grav_vector() 640 640 140 B 189 B 217 B 45 KiB 45 KiB 45 KiB Gravity::multilevel_solve_for_new_phi() 64 64 30 KiB 30 KiB 30 KiB 37 KiB 37 KiB 37 KiB Gravity::fill_multipole_BCs() 2432 2432 228 B 233 B 239 B 17 KiB 17 KiB 17 KiB Castro::evaluate_source_change() 6272 6272 1020 B 1033 B 1060 B 16 KiB 16 KiB 16 KiB Gravity::actual_multilevel_solve() 32 32 122 B 122 B 122 B 16 KiB 16 KiB 16 KiB Gravity::solve_for_phi() 544 544 1672 B 1736 B 1768 B 16 KiB 16 KiB 16 KiB MLMG::compResidual() 32 32 0 B 0 B 1 B 16 KiB 16 KiB 16 KiB MLCellLinOp::defineAuxData() 11704 11704 438 B 490 B 680 B 4608 B 5151 B 7152 B BndryData::define() 4864 4864 456 B 457 B 458 B 4864 B 4864 B 4864 B FillBoundary_nowait() 91296 91296 26 B 36 B 47 B 2592 B 3392 B 4192 B AmrMesh::MakeNewGrids() 128 128 0 B 18 B 30 B 2916 B 2916 B 2916 B OwnerMask() 64 64 0 B 0 B 0 B 2592 B 2592 B 2592 B MLMG::addInterpCorrection() 5632 5632 1 B 16 B 26 B 1024 B 1024 B 1024 B amrex::average_down 5632 5632 0 B 0 B 1 B 1024 B 1024 B 1024 B TagBoxArray::mapPRD 64 64 0 B 5 B 7 B 648 B 648 B 648 B MLCGSolver::bicgstab 640 640 0 B 0 B 2 B 0 B 36 B 576 B MLCellLinOp::applyBC() 114375 114375 0 B 0 B 0 B 8 B 8 B 8 B ------------------------------------------------------------------------------------------------------------------------------- AMReX (24.09-35-g23a7f34fd7a4) finalized