Initializing AMReX (v2024-32-g33701ffd5611)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (v2024-32-g33701ffd5611) initialized Starting run at 07:40:42 UTC on 2024-03-25. Successfully read inputs file ... Castro git describe: 24.03-26-g5707c0c2f AMReX git describe: v2024-32-g33701ffd5 Microphysics git describe: 24.03-21-g81de2adb reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.17420017 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001104481 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.011249438 Gravity::multilevel_solve_for_new_phi() time = 0.105993081 Gravity::fill_multipole_BCs() time = 0.011397105 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049303014 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004213574 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.004064842 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.064015718 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149Invalid density = -8.076810125 at index 20, at index 10, 66, 0 174, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67Invalid density = -15.15828486 at index 20, 175, 0 , 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -552.7694089 at index 17, 74Invalid density = -415.2911996 at index 16, , 0 Invalid density = 183, 0 Invalid density = -160.2179808 at index 18, 75, 0 -764.1508347 at index 15, 184, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, Invalid density = -61.58489855 at index 19, 77, 0 186, 0 Invalid density = Invalid density = -108.2035501 at index 19, 78, 0 -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = Invalid density = -15.15828486 at index 20, 80, 0 -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, Invalid density = -8.076810125 at index 20, 81, 0 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003105647 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.063446959 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004466945 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.06002107 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004343828 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059245658 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.376270946 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.049838667 Gravity::solve_for_phi() time = 0.130107401 on level 0 Castro::construct_new_gravity() time = 0.132343982 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.05970514 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002631728 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059168258 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324533563 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014112135 Gravity::solve_for_phi() time = 0.101219165 on level 0 Castro::construct_new_gravity() time = 0.107548258 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.067636828 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002740755 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059718266 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.367704657 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014381367 Gravity::solve_for_phi() time = 0.085317435 on level 0 Castro::construct_new_gravity() time = 0.096597247 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.085171819 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002857363 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059029953 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.341878035 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014919678 Gravity::solve_for_phi() time = 0.110525208 on level 0 Castro::construct_new_gravity() time = 0.113622085 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.071025267 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002680469 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060536863 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.359566542 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014903093 Gravity::solve_for_phi() time = 0.084282794 on level 0 Castro::construct_new_gravity() time = 0.086445191 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.07230627 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.03186983 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.066943664 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332345783 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01536593 Gravity::solve_for_phi() time = 0.084186277 on level 0 Castro::construct_new_gravity() time = 0.086347103 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.060727765 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.020119646 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.060911111 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.350040501 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014149468 Gravity::solve_for_phi() time = 0.083326474 on level 0 Castro::construct_new_gravity() time = 0.085475926 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059931423 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002747058 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.060484929 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333905824 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015120205 Gravity::solve_for_phi() time = 0.08455807 on level 0 Castro::construct_new_gravity() time = 0.086782472 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.059628863 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002826876 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.061411948 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.339368576 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014786305 Gravity::solve_for_phi() time = 0.083914829 on level 0 Castro::construct_new_gravity() time = 0.08610612 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059473128 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003001906 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059233185 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330202557 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015115428 Gravity::solve_for_phi() time = 0.08503052 on level 0 Castro::construct_new_gravity() time = 0.087194269 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.059720828 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003126544 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.05913797 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333683564 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015192576 Gravity::solve_for_phi() time = 0.090584458 on level 0 Castro::construct_new_gravity() time = 0.092721916 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059398162 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002757162 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.05903606 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325808329 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015768003 Gravity::solve_for_phi() time = 0.085791935 on level 0 Castro::construct_new_gravity() time = 0.088042045 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.060881209 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002924592 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.06042491 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332408144 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015455186 Gravity::solve_for_phi() time = 0.084324373 on level 0 Castro::construct_new_gravity() time = 0.086503275 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059872352 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002590801 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059053946 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325846104 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015324677 Gravity::solve_for_phi() time = 0.08409965 on level 0 Castro::construct_new_gravity() time = 0.086262263 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059724339 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002758619 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.05888576 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330549659 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015510116 Gravity::solve_for_phi() time = 0.084377074 on level 0 Castro::construct_new_gravity() time = 0.086563396 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059372071 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002623957 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058800616 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325680487 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015833106 Gravity::solve_for_phi() time = 0.086567972 on level 0 Castro::construct_new_gravity() time = 0.088781502 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059544695 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002734225 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058565772 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33140902 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015481035 Gravity::solve_for_phi() time = 0.084250702 on level 0 Castro::construct_new_gravity() time = 0.086407245 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059494443 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002711258578 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.14435413 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.047159657 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004179233 seconds Ending run at 07:40:56 UTC on 2024-03-25. Run time = 14.56088967 Run time without initialization = 12.1965159 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.56 ... 14.56 ... 14.56 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3779 5.4521 5.5484 38.10% Amr::InitAmr() 1 1.467 1.468 1.468 10.08% Castro::computeTemp() 80 0.8246 0.942 1.102 7.57% amrex::Copy() 724 0.8049 0.8122 0.8449 5.80% FabArray::ParallelCopy_finish() 1429 0.09988 0.5848 0.8056 5.53% MultiFab::AddProduct() 3439 0.558 0.5634 0.5737 3.94% Castro::normalize_species() 79 0.5508 0.5564 0.5678 3.90% Castro::reset_internal_energy(Fab) 160 0.5135 0.5215 0.5364 3.68% MLPoisson::Fsmooth() 6144 0.3137 0.3396 0.4089 2.81% FabArray::setVal() 5013 0.3649 0.3697 0.3783 2.60% Castro::initMFs() 1 0.35 0.3593 0.3769 2.59% MultiFab::Subtract() 159 0.3374 0.3416 0.3545 2.43% check_for_negative_density() 20 0.1625 0.2635 0.3463 2.38% Gravity::fill_multipole_BCs() 19 0.1977 0.2613 0.3103 2.13% Castro::reset_internal_energy(MultiFab) 80 0.02283 0.08252 0.288 1.98% FabArray::ParallelCopy_nowait() 1429 0.1878 0.2035 0.2213 1.52% FabArray::sum() 3439 0.1835 0.1853 0.1891 1.30% FillBoundary_finish() 6380 0.1196 0.1524 0.1863 1.28% Castro::initData() 1 0.003315 0.02682 0.1566 1.08% FillBoundary_nowait() 6380 0.07836 0.103 0.1302 0.89% Castro::enforce_min_density() 79 0.01737 0.04373 0.1196 0.82% MLPoisson::Fapply() 986 0.09604 0.1012 0.1144 0.79% MLCellLinOp::applyBC() 7148 0.04771 0.06184 0.1019 0.70% Castro::construct_new_gravity_source() 17 0.0696 0.072 0.0876 0.60% FabArray::Saxpy() 264 0.07032 0.07129 0.07757 0.53% Castro::do_new_sources() 17 0.0003899 0.01203 0.07254 0.50% FabArray::Xpay() 945 0.05172 0.05437 0.06079 0.42% Castro::do_old_sources() 20 0.0005287 0.01065 0.06049 0.42% MultiFab::contains_nan() 37 0.04566 0.0463 0.04802 0.33% Castro::construct_old_gravity_source() 20 0.04614 0.0466 0.04773 0.33% MLMG::addInterpCorrection() 768 0.03316 0.03561 0.04207 0.29% AmrLevel::derive() 18 0.03981 0.04043 0.04204 0.29% StateData::FillBoundary(geom) 143 0 0.01717 0.033 0.23% amrex::average_down 768 0.02445 0.02653 0.03178 0.22% VisMF::Write(FabArray) 4 0.01233 0.01341 0.02462 0.17% Castro::construct_new_source() 102 0.01541 0.01582 0.01783 0.12% Amr::writePlotFile() 2 0.007285 0.01602 0.01766 0.12% MLCellLinOp::defineAuxData() 19 0.01437 0.01507 0.01703 0.12% FabArray::FillBoundary() 6380 0.01356 0.01399 0.01656 0.11% MLCGSolver::bicgstab 8 0 0.0009784 0.01565 0.11% FabArray::norminf() 282 0.01105 0.01157 0.01547 0.11% amrex::Add() 128 0.0139 0.01404 0.01439 0.10% MLMG::ResNormInf() 146 0.008806 0.01145 0.0141 0.10% Castro::construct_new_gravity() 17 0.0003095 0.00304 0.014 0.10% MLMG::solve() 18 0.001065 0.00701 0.01299 0.09% FillPatchIterator::Initialize 147 0.0125 0.01262 0.01287 0.09% Castro::evaluate_source_change() 196 0.01211 0.01238 0.01284 0.09% FabArrayBase::getFB() 6380 0.009835 0.01019 0.01254 0.09% MLCellLinOp::smooth() 3072 0.011 0.01134 0.01209 0.08% FabArray::setDomainBndry() 147 0.0004447 0.006039 0.01136 0.08% Castro::construct_old_source() 120 0.009862 0.01003 0.01125 0.08% Castro::wd_update() 2 0.004792 0.007638 0.01093 0.08% MLMG::prepareForSolve() 18 0.009747 0.01002 0.01079 0.07% MLLinOp::makeSubCommunicator() 19 0.001255 0.004622 0.008418 0.06% Castro::volWgtSum() 46 0.007212 0.007339 0.008389 0.06% FabArray::mult() 59 0.007315 0.007517 0.008202 0.06% Castro::construct_old_gravity() 20 0.0004138 0.0026 0.008009 0.06% Gravity::actual_solve_with_mlmg() 19 0.00665 0.006963 0.007878 0.05% FabArrayBase::getCPC() 2005 0.00727 0.007436 0.007734 0.05% Gravity::get_new_grav_vector() 18 0.006004 0.00638 0.007658 0.05% MLCellLinOp::compGrad() 18 0.005701 0.005929 0.007394 0.05% Gravity::get_old_grav_vector() 20 0.006396 0.006493 0.006968 0.05% FabArrayBase::CPC::define() 576 0.002226 0.003353 0.006311 0.04% amrex::Dot() 142 0 0.0003758 0.006012 0.04% Amr::writeSmallPlotFile() 2 0.003669 0.005348 0.005675 0.04% MultiFab::max() 2 0.0001894 0.002921 0.005499 0.04% Castro::volInBoundary() 14 0.003391 0.003679 0.005454 0.04% Castro::initialize_do_advance() 20 0.004551 0.004725 0.005005 0.03% Gravity::solve_for_phi() 17 0.0008197 0.001796 0.004826 0.03% MLCGSolver::ParallelAllReduce 227 0 0.0003014 0.004822 0.03% MLCellLinOp::apply() 986 0.001962 0.002169 0.004578 0.03% FabArray::ParallelCopy() 1429 0.003586 0.003729 0.003941 0.03% BndryData::define() 19 0.003025 0.003091 0.003355 0.02% Castro::sum_integrated_quantities() 2 0.00213 0.002959 0.003277 0.02% MLPoisson::normalize() 79 0 0.000193 0.003089 0.02% AmrLevel::FillPatch() 147 0.002142 0.002205 0.002289 0.02% MLLinOp::defineGrids() 19 0.001766 0.001948 0.002261 0.02% MLCellLinOp::prepareForSolve() 19 0.001614 0.001742 0.001989 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001295 0.001572 0.001944 0.01% MLCellLinOp::correctionResidual() 768 0.001849 0.00189 0.001943 0.01% TagBoxArray::collate() 2 0.0001135 0.0006139 0.001783 0.01% MLMG::mgVcycle() 128 0.001564 0.00162 0.001752 0.01% MLCellLinOp::defineBC() 19 0.001511 0.001545 0.001639 0.01% StateData::define() 6 0.00132 0.001375 0.001556 0.01% MLMG:computeResOfCorrection() 768 0.001382 0.001424 0.001502 0.01% Castro::save_data_for_retry() 3 0.001261 0.001322 0.001493 0.01% FabArrayBase::FB::FB() 75 0.0002841 0.0006802 0.001441 0.01% main() 1 0.0009545 0.001131 0.001289 0.01% Castro::locWgtSum() 6 0.001109 0.001137 0.001164 0.01% MLMG::actualBottomSolve() 128 0.0001348 0.000198 0.001059 0.01% StateDataPhysBCFunct::() 147 0.0007038 0.0008084 0.0009195 0.01% Castro::subcycle_advance_ctu() 1 0.0001983 0.0002544 0.0008317 0.01% MLCellLinOp::setLevelBC() 19 0.0005714 0.0006653 0.0008261 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006986 0.000725 0.0007529 0.01% MLMG::mgVcycle_down::2 128 0.0006047 0.0006566 0.0007097 0.00% MLMG::mgVcycle_down::3 128 0.0005735 0.0006127 0.0007095 0.00% Castro::buildMetrics() 1 0.0005735 0.000594 0.0006914 0.00% MLMG::mgVcycle_down::0 128 0.0006586 0.0006674 0.0006866 0.00% MLMG::mgVcycle_down::1 128 0.0006465 0.00066 0.0006781 0.00% MLMG::mgVcycle_down::5 128 0.0005839 0.0005984 0.0006697 0.00% MLMG::mgVcycle_down::4 128 0.0005569 0.0005813 0.0006688 0.00% Castro::Castro() 1 0.0004652 0.0005151 0.0005786 0.00% AmrMesh::MakeNewGrids() 2 0.0005102 0.0005237 0.0005344 0.00% Castro::apply_tagging_restrictions() 2 0.0004226 0.0004757 0.0005275 0.00% FillPatchSingleLevel 147 0.0004661 0.0004784 0.0005015 0.00% MLMG::mgVcycle_up::0 128 0.0004603 0.0004753 0.0005006 0.00% Gravity::applyMetricTerms() 2 0.0004836 0.0004915 0.000498 0.00% Castro::clean_state() 79 0.0004428 0.0004684 0.0004872 0.00% MLMG::mgVcycle_up::1 128 0.0004525 0.0004694 0.0004867 0.00% MLMG::mgVcycle_up::2 128 0.0003927 0.0004284 0.0004725 0.00% MLCellLinOp::solutionResidual() 147 0.0004325 0.0004474 0.0004682 0.00% Castro::do_advance_ctu() 20 0.0004038 0.0004319 0.000458 0.00% makeSFC 95 0.0003667 0.0004032 0.000457 0.00% Castro::swap_state_time_levels() 8 0.000416 0.0004267 0.0004503 0.00% MLMG::mgVcycle_up::5 128 0.0003946 0.0004051 0.0004456 0.00% MLMG::mgVcycle_up::3 128 0.0003826 0.0003994 0.0004453 0.00% Castro::volProductSum() 2 0.0003939 0.0004039 0.0004396 0.00% MLMG::mgVcycle_up::4 128 0.0003871 0.0004019 0.0004247 0.00% MLMG::oneIter() 128 0.0003857 0.0003946 0.0004066 0.00% Castro::enforce_consistent_e() 1 0.0003666 0.0003753 0.0003847 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003254 0.0003438 0.0003705 0.00% Castro::problem_post_timestep() 2 1.031e-05 3.267e-05 0.0003507 0.00% DistributionMapping::Distribute() 95 0.0002101 0.0002233 0.0002658 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002141 0.0002286 0.0002589 0.00% MLMG::mgVcycle_bottom 128 0.0002294 0.0002367 0.0002562 0.00% MLMG::computeResidual() 128 0.0002412 0.0002475 0.0002529 0.00% Castro::finalize_do_advance() 17 0.000162 0.0001724 0.000185 0.00% OwnerMask() 2 0.0001331 0.0001504 0.000176 0.00% Gravity::update_max_rhs() 2 0.0001593 0.0001624 0.0001703 0.00% MLMG::compResidual() 1 0.0001526 0.0001585 0.0001648 0.00% Amr::coarseTimeStep() 1 0.0001344 0.0001559 0.0001602 0.00% Castro::retry_advance_ctu() 11 5.558e-05 7.526e-05 0.0001543 0.00% Amr::defBaseLevel() 1 9.569e-05 0.0001182 0.0001499 0.00% MLPoisson::define() 19 0.0001279 0.0001369 0.0001426 0.00% DistributionMapping::LeastUsedCPUs() 1 4.064e-05 0.0001088 0.0001338 0.00% Amr::grid_places() 2 8.152e-05 9.625e-05 0.0001316 0.00% Castro::check_for_nan() 37 0.0001042 0.0001137 0.000126 0.00% Castro::enforce_speed_limit() 79 0.00011 0.0001171 0.0001225 0.00% TagBoxArray::mapPRD 2 0.0001066 0.000112 0.0001195 0.00% Castro::initialize_advance() 1 9.977e-05 0.0001075 0.0001143 0.00% Castro::apply_source_to_state() 37 9.719e-05 0.0001015 0.0001123 0.00% Gravity::test_composite_phi() 1 9.182e-05 9.696e-05 0.0001094 0.00% Castro::apply_problem_tags() 2 9.348e-05 9.564e-05 9.974e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.991e-05 7.038e-05 9.452e-05 0.00% MLLinOp::define() 19 7.516e-05 8.273e-05 9.36e-05 0.00% knapsack() 1 5.665e-05 6.535e-05 8.474e-05 0.00% MultiFab::Swap() 5 6.444e-05 6.824e-05 8.462e-05 0.00% MLPoisson::prepareForSolve() 19 7.575e-05 7.938e-05 8.454e-05 0.00% Castro::create_source_corrector() 17 5.437e-05 6.336e-05 7.381e-05 0.00% Castro::expand_state() 20 5.378e-05 5.732e-05 6.829e-05 0.00% Amr::initSubcycle() 1 5.475e-05 5.823e-05 6.782e-05 0.00% Amr::FinalizeInit() 1 8.913e-06 1.515e-05 4.849e-05 0.00% MLMG::computeMLResidual() 18 4.065e-05 4.26e-05 4.607e-05 0.00% Castro::derive() 18 4.069e-05 4.227e-05 4.487e-05 0.00% MLMG::getGradSolution() 18 3.99e-05 4.17e-05 4.444e-05 0.00% Gravity::swapTimeLevels() 8 3.295e-05 3.554e-05 4.373e-05 0.00% MLMG::MLResNormInf() 18 3.247e-05 3.583e-05 4.108e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.182e-05 3.401e-05 3.835e-05 0.00% MLMG::MLRhsNormInf() 18 3.074e-05 3.175e-05 3.593e-05 0.00% Amr::regrid() 1 1.069e-05 1.329e-05 3.419e-05 0.00% Castro::construct_old_rotation_source() 20 2.969e-05 3.066e-05 3.238e-05 0.00% Amr::timeStep() 1 1.244e-05 1.705e-05 3.065e-05 0.00% Gravity::actual_multilevel_solve() 1 2.665e-05 2.757e-05 2.868e-05 0.00% Castro::construct_new_rotation_source() 17 2.055e-05 2.164e-05 2.467e-05 0.00% Amr::init() 1 6.753e-06 8.518e-06 2.384e-05 0.00% BoxList::parallelComplementIn() 4 6.857e-06 8.339e-06 2.372e-05 0.00% BoxList::complementIn 4 6.151e-06 8.425e-06 2.303e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.644e-05 1.839e-05 2.193e-05 0.00% Castro::finalize_advance() 1 1.678e-05 1.795e-05 2.156e-05 0.00% Castro::estTimeStep() 10 1.23e-05 1.329e-05 1.422e-05 0.00% Castro::advance() 1 7.062e-06 8.399e-06 1.412e-05 0.00% Castro::post_init() 1 1.18e-05 1.275e-05 1.376e-05 0.00% Amr::initialInit() 1 2.915e-06 4.201e-06 1.305e-05 0.00% Amr::InitializeInit() 1 6.787e-06 8.014e-06 1.297e-05 0.00% Castro::computeInitialDt() 2 7.026e-06 7.722e-06 1.284e-05 0.00% Castro::post_regrid() 2 1.1e-05 1.148e-05 1.204e-05 0.00% Castro::errorEst() 2 6.125e-06 6.69e-06 1.086e-05 0.00% Amr::bldFineLevels() 1 6.829e-06 7.718e-06 9.55e-06 0.00% Castro::post_timestep() 1 5.681e-06 6.012e-06 6.874e-06 0.00% Castro::gwstrain() 2 4.534e-06 4.886e-06 6.352e-06 0.00% Gravity::set_mass_offset() 2 4.427e-06 4.837e-06 5.213e-06 0.00% Castro::FluxRegCrseInit 1 1.832e-06 2.003e-06 2.453e-06 0.00% Castro::FluxRegFineAdd() 1 1.479e-06 1.582e-06 1.797e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.56 14.56 14.56 100.00% Amr::coarseTimeStep() 1 12.2 12.2 12.2 83.76% Amr::timeStep() 1 12.14 12.14 12.14 83.40% Castro::advance() 1 12.08 12.08 12.09 83.00% Castro::subcycle_advance_ctu() 1 12.03 12.03 12.04 82.66% Castro::do_advance_ctu() 20 11.99 11.99 12 82.39% Castro::construct_ctu_hydro_source() 20 6.471 6.507 6.556 45.03% Castro::clean_state() 79 3.728 3.844 4.06 27.88% Castro::computeTemp() 80 2.386 2.516 2.772 19.04% Castro::reset_internal_energy(MultiFab) 80 1.5 1.574 1.765 12.12% Gravity::solve_phi_with_mlmg() 19 1.527 1.594 1.646 11.31% Castro::construct_new_gravity() 17 1.466 1.527 1.578 10.84% Gravity::solve_for_phi() 17 1.414 1.478 1.529 10.50% Castro::initialize_do_advance() 20 1.432 1.489 1.525 10.48% Amr::InitAmr() 1 1.467 1.468 1.468 10.08% Gravity::actual_solve_with_mlmg() 19 1.325 1.329 1.334 9.16% MLMG::solve() 18 1.275 1.279 1.281 8.79% Castro::do_old_sources() 20 1.161 1.187 1.202 8.26% MLMG::oneIter() 128 1.128 1.131 1.133 7.78% MLMG::mgVcycle() 128 1.114 1.116 1.119 7.68% Castro::do_new_sources() 17 0.9547 1.004 1.073 7.37% FabArray::ParallelCopy() 1429 0.3261 0.8121 1.031 7.08% Castro::evaluate_source_change() 196 0.9615 0.9707 0.9892 6.79% Castro::enforce_min_density() 79 0.8002 0.8323 0.9006 6.19% Amr::init() 1 0.896 0.8961 0.8961 6.15% amrex::Copy() 724 0.8049 0.8122 0.8449 5.80% Amr::initialInit() 1 0.8417 0.8418 0.8418 5.78% FabArray::ParallelCopy_finish() 1429 0.09988 0.5848 0.8056 5.53% MLCellLinOp::smooth() 3072 0.5735 0.6229 0.7497 5.15% AmrLevel::FillPatch() 147 0.5237 0.6552 0.7475 5.13% Amr::InitializeInit() 1 0.4353 0.5037 0.6084 4.18% Amr::defBaseLevel() 1 0.4353 0.5037 0.6083 4.18% MultiFab::AddProduct() 3439 0.558 0.5634 0.5737 3.94% Castro::normalize_species() 79 0.5508 0.5564 0.5678 3.90% FillPatchIterator::Initialize 147 0.3397 0.4707 0.5623 3.86% FillPatchIterator::FillFromLevel0() 147 0.3159 0.4521 0.5454 3.75% FillPatchSingleLevel 147 0.3152 0.4513 0.5447 3.74% Castro::reset_internal_energy(Fab) 160 0.5135 0.5215 0.5364 3.68% MLMG::mgVcycle_up::1 128 0.09565 0.2571 0.419 2.88% MLCellLinOp::applyBC() 7148 0.3044 0.3421 0.4165 2.86% MLPoisson::Fsmooth() 6144 0.3137 0.3396 0.4089 2.81% Amr::FinalizeInit() 1 0.2334 0.3381 0.4064 2.79% Castro::Castro() 1 0.3556 0.3651 0.3832 2.63% FabArray::setVal() 5013 0.3649 0.3697 0.3783 2.60% Castro::initMFs() 1 0.3502 0.3594 0.3771 2.59% MLMG::addInterpCorrection() 768 0.0623 0.2969 0.3671 2.52% MultiFab::Subtract() 159 0.3374 0.3416 0.3545 2.43% check_for_negative_density() 20 0.1625 0.2635 0.3463 2.38% FabArray::FillBoundary() 6380 0.2538 0.2803 0.3192 2.19% Gravity::fill_multipole_BCs() 19 0.1999 0.2635 0.3124 2.15% Castro::expand_state() 20 0.1826 0.2469 0.3011 2.07% MLMG::mgVcycle_down::0 128 0.2717 0.2765 0.2845 1.95% MLMG::mgVcycle_up::2 128 0.01056 0.1125 0.2676 1.84% Castro::initData() 1 0.07745 0.1368 0.2498 1.72% FabArray::ParallelCopy_nowait() 1429 0.2072 0.2235 0.2421 1.66% Amr::bldFineLevels() 1 0.0465 0.1509 0.2181 1.50% MLCellLinOp::apply() 986 0.1606 0.1717 0.2051 1.41% MLMG::mgVcycle_up::0 128 0.1978 0.1986 0.2004 1.38% FabArray::sum() 3439 0.1835 0.1853 0.1891 1.30% FillBoundary_finish() 6380 0.1196 0.1524 0.1863 1.28% Amr::grid_places() 2 0.002297 0.107 0.1753 1.20% AmrMesh::MakeNewGrids() 2 0.002207 0.1069 0.1752 1.20% TagBoxArray::mapPRD 2 0.0007044 0.105 0.1738 1.19% MLMG::mgVcycle_up::3 128 0.01046 0.0229 0.1721 1.18% MLMG:computeResOfCorrection() 768 0.1202 0.1303 0.1521 1.04% MLCellLinOp::correctionResidual() 768 0.1188 0.1289 0.1506 1.03% Castro::construct_new_source() 102 0.1253 0.1284 0.146 1.00% Castro::post_init() 1 0.1403 0.1431 0.1456 1.00% FillBoundary_nowait() 6380 0.08851 0.1139 0.1416 0.97% MLMG::mgVcycle_down::1 128 0.1257 0.1335 0.1409 0.97% Castro::create_source_corrector() 17 0.05398 0.09586 0.123 0.84% MLPoisson::Fapply() 986 0.09604 0.1012 0.1144 0.79% Gravity::multilevel_solve_for_new_phi() 1 0.106 0.106 0.106 0.73% Gravity::actual_multilevel_solve() 1 0.1059 0.1059 0.1059 0.73% Castro::construct_old_gravity() 20 0.04742 0.06261 0.104 0.71% MLCellLinOp::solutionResidual() 147 0.09273 0.09798 0.1023 0.70% Amr::writePlotFile() 2 0.09706 0.09713 0.09714 0.67% Gravity::get_old_grav_vector() 20 0.04305 0.06001 0.09662 0.66% Castro::post_regrid() 2 0.08542 0.08798 0.09073 0.62% Castro::construct_new_gravity_source() 17 0.0696 0.072 0.0876 0.60% Castro::construct_old_source() 120 0.07972 0.08051 0.0829 0.57% MLMG::computeResidual() 128 0.07662 0.07808 0.08076 0.55% FabArray::Saxpy() 264 0.07032 0.07129 0.07757 0.53% MLMG::mgVcycle_down::2 128 0.01242 0.04175 0.07423 0.51% Castro::derive() 18 0.06902 0.07004 0.07154 0.49% AmrLevel::derive() 18 0.06898 0.07 0.07149 0.49% MLMG::mgVcycle_bottom 128 0.0003663 0.004729 0.07001 0.48% MLMG::actualBottomSolve() 128 0.0001348 0.004492 0.06977 0.48% MLCGSolver::bicgstab 8 0 0.004267 0.06826 0.47% Castro::post_timestep() 1 0.05841 0.06027 0.06297 0.43% FabArray::Xpay() 945 0.05172 0.05437 0.06079 0.42% MLMG::mgVcycle_down::3 128 0.01185 0.01786 0.05876 0.40% amrex::average_down 768 0.03272 0.03978 0.05578 0.38% Castro::initialize_advance() 1 0.04876 0.05017 0.0526 0.36% Gravity::get_new_grav_vector() 18 0.03789 0.04575 0.05147 0.35% Castro::check_for_nan() 37 0.04579 0.04641 0.04813 0.33% MultiFab::contains_nan() 37 0.04566 0.0463 0.04802 0.33% Castro::construct_old_gravity_source() 20 0.04614 0.0466 0.04773 0.33% Amr::regrid() 1 0.04384 0.04505 0.04576 0.31% MLPoisson::define() 19 0.02888 0.03342 0.03941 0.27% Castro::retry_advance_ctu() 11 0.03684 0.03773 0.0385 0.26% MLMG::mgVcycle_down::4 128 0.01177 0.01332 0.03413 0.23% StateDataPhysBCFunct::() 147 0.0007038 0.01797 0.03388 0.23% StateData::FillBoundary(geom) 143 0 0.01717 0.033 0.23% Castro::apply_source_to_state() 37 0.02872 0.02891 0.02933 0.20% MLMG::mgVcycle_up::4 128 0.01057 0.01173 0.02655 0.18% VisMF::Write(FabArray) 4 0.01233 0.01341 0.02462 0.17% MLMG::computeMLResidual() 18 0.01495 0.01947 0.02424 0.17% MLMG::ResNormInf() 146 0.01893 0.02133 0.02383 0.16% MLMG::prepareForSolve() 18 0.0202 0.02128 0.0238 0.16% MLCellLinOp::defineAuxData() 19 0.01846 0.01997 0.02376 0.16% MLMG::mgVcycle_down::5 128 0.01179 0.01261 0.0226 0.16% Castro::sum_integrated_quantities() 2 0.022 0.02226 0.02228 0.15% Castro::save_data_for_retry() 3 0.01933 0.01954 0.01985 0.14% MLMG::mgVcycle_up::5 128 0.01078 0.01142 0.01908 0.13% FabArray::norminf() 282 0.01105 0.01157 0.01547 0.11% Gravity::test_composite_phi() 1 0.01485 0.01487 0.0149 0.10% Castro::problem_post_timestep() 2 0.009353 0.01135 0.01441 0.10% Castro::wd_update() 2 0.009339 0.01132 0.0144 0.10% amrex::Add() 128 0.0139 0.01404 0.01439 0.10% FabArrayBase::getFB() 6380 0.01013 0.01087 0.01398 0.10% FabArrayBase::getCPC() 2005 0.0095 0.01079 0.01396 0.10% MLLinOp::define() 19 0.004303 0.007623 0.0118 0.08% MLLinOp::defineGrids() 19 0.004222 0.007541 0.01172 0.08% FabArray::setDomainBndry() 147 0.0004447 0.006039 0.01136 0.08% MLMG::getGradSolution() 18 0.007381 0.007855 0.009547 0.07% MLCellLinOp::compGrad() 18 0.007339 0.007813 0.009503 0.07% Amr::writeSmallPlotFile() 2 0.008783 0.008792 0.008809 0.06% MLLinOp::makeSubCommunicator() 19 0.001255 0.004622 0.008418 0.06% Castro::volWgtSum() 46 0.007212 0.007339 0.008389 0.06% FabArray::mult() 59 0.007315 0.007517 0.008202 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005051 0.008081 0.06% Gravity::update_max_rhs() 2 0.00145 0.004188 0.006758 0.05% FabArrayBase::CPC::define() 576 0.002226 0.003353 0.006311 0.04% MLCellLinOp::defineBC() 19 0.005455 0.005685 0.006307 0.04% amrex::Dot() 142 0 0.0003758 0.006012 0.04% MultiFab::max() 2 0.0001894 0.002921 0.005499 0.04% Castro::volInBoundary() 14 0.003391 0.003679 0.005454 0.04% BndryData::define() 19 0.003903 0.004141 0.004688 0.03% MLPoisson::normalize() 79 0 0.000193 0.003089 0.02% MLPoisson::prepareForSolve() 19 0.001695 0.001822 0.002069 0.01% MLCellLinOp::prepareForSolve() 19 0.001614 0.001742 0.001989 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001295 0.001572 0.001944 0.01% TagBoxArray::collate() 2 0.0001135 0.0006139 0.001783 0.01% MLMG::MLResNormInf() 18 0.001256 0.001301 0.001598 0.01% AmrLevel::AmrLevel(dm) 1 0.001353 0.001409 0.001594 0.01% MLMG::MLRhsNormInf() 18 0.001235 0.001278 0.001559 0.01% StateData::define() 6 0.00132 0.001375 0.001556 0.01% FabArrayBase::FB::FB() 75 0.0002841 0.0006802 0.001441 0.01% Gravity::swapTimeLevels() 8 0.001196 0.001218 0.001266 0.01% MLMG::compResidual() 1 0.0009414 0.001092 0.001229 0.01% Castro::locWgtSum() 6 0.001109 0.001137 0.001164 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009124 0.0009703 0.001086 0.01% MLCellLinOp::setLevelBC() 19 0.0005714 0.0006653 0.0008261 0.01% Castro::buildMetrics() 1 0.000636 0.0006582 0.0007659 0.01% makeSFC 95 0.0005802 0.0006265 0.0007151 0.00% Castro::errorEst() 2 0.0005247 0.000578 0.0006297 0.00% Castro::apply_tagging_restrictions() 2 0.0004226 0.0004757 0.0005275 0.00% Gravity::applyMetricTerms() 2 0.0004836 0.0004915 0.000498 0.00% Castro::swap_state_time_levels() 8 0.000416 0.0004267 0.0004503 0.00% Castro::volProductSum() 2 0.0003939 0.0004039 0.0004396 0.00% Castro::enforce_consistent_e() 1 0.0003666 0.0003753 0.0003847 0.00% Castro::finalize_advance() 1 0.0002591 0.0002675 0.0002771 0.00% DistributionMapping::Distribute() 95 0.0002101 0.0002233 0.0002658 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001273 0.0001925 0.0002224 0.00% Castro::finalize_do_advance() 17 0.0001716 0.0001826 0.0001943 0.00% OwnerMask() 2 0.0001331 0.0001504 0.000176 0.00% DistributionMapping::LeastUsedCPUs() 1 4.064e-05 0.0001088 0.0001338 0.00% Castro::enforce_speed_limit() 79 0.00011 0.0001171 0.0001225 0.00% Castro::apply_problem_tags() 2 9.348e-05 9.564e-05 9.974e-05 0.00% knapsack() 1 5.665e-05 6.535e-05 8.474e-05 0.00% MultiFab::Swap() 5 6.444e-05 6.824e-05 8.462e-05 0.00% Amr::initSubcycle() 1 5.475e-05 5.823e-05 6.782e-05 0.00% BoxList::parallelComplementIn() 4 1.301e-05 1.676e-05 4.675e-05 0.00% Castro::construct_old_rotation_source() 20 2.969e-05 3.066e-05 3.238e-05 0.00% Castro::construct_new_rotation_source() 17 2.055e-05 2.164e-05 2.467e-05 0.00% BoxList::complementIn 4 6.151e-06 8.425e-06 2.303e-05 0.00% Castro::computeInitialDt() 2 1.017e-05 1.089e-05 1.608e-05 0.00% Castro::estTimeStep() 10 1.23e-05 1.329e-05 1.422e-05 0.00% Castro::gwstrain() 2 4.534e-06 4.886e-06 6.352e-06 0.00% Gravity::set_mass_offset() 2 4.427e-06 4.837e-06 5.213e-06 0.00% Castro::FluxRegCrseInit 1 1.832e-06 2.003e-06 2.453e-06 0.00% Castro::FluxRegFineAdd() 1 1.479e-06 1.582e-06 1.797e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 14 B 20 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-32-g33701ffd5611) finalized