Initializing AMReX (v2024-32-g33701ffd5611)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (v2024-32-g33701ffd5611) initialized Starting run at 16:44:13 UTC on 2024-03-24. Successfully read inputs file ... Castro git describe: 24.03-26-g5707c0c2f AMReX git describe: v2024-32-g33701ffd5 Microphysics git describe: 24.03-21-g81de2adb reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.155479013 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001131835 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.01069034 Gravity::multilevel_solve_for_new_phi() time = 0.100341707 Gravity::fill_multipole_BCs() time = 0.010650221 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.05184892 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.033045365 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002704608 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065477878 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.009253842 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.064390459 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004530061 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060996049 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005584465 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058762637 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324366082 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015369737 Gravity::solve_for_phi() time = 0.088816948 on level 0 Castro::construct_new_gravity() time = 0.090987717 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060183062 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002704784 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058384367 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326536629 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015461422 Gravity::solve_for_phi() time = 0.085781393 on level 0 Castro::construct_new_gravity() time = 0.087886187 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.061712266 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.003645741 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059047362 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331818097 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015645076 Gravity::solve_for_phi() time = 0.086668664 on level 0 Castro::construct_new_gravity() time = 0.088796936 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.059088435 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002704431 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058260818 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334077501 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015199365 Gravity::solve_for_phi() time = 0.086241948 on level 0 Castro::construct_new_gravity() time = 0.088357947 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.059435399 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.005025538 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058448541 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.340551024 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016535536 Gravity::solve_for_phi() time = 0.088058066 on level 0 Castro::construct_new_gravity() time = 0.090227113 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.059594101 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002742119 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058460431 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331806391 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014942218 Gravity::solve_for_phi() time = 0.085543139 on level 0 Castro::construct_new_gravity() time = 0.087701383 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.058695503 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002835917 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059543638 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331723707 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015694793 Gravity::solve_for_phi() time = 0.08683788 on level 0 Castro::construct_new_gravity() time = 0.08899237 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059274511 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.007395939 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058978283 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329808037 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014718563 Gravity::solve_for_phi() time = 0.087637925 on level 0 Castro::construct_new_gravity() time = 0.08977213 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060078478 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00266101 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058214258 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334826576 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015114758 Gravity::solve_for_phi() time = 0.08570833 on level 0 Castro::construct_new_gravity() time = 0.087832357 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.061338144 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002583391 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.057985555 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331930158 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015895147 Gravity::solve_for_phi() time = 0.086041869 on level 0 Castro::construct_new_gravity() time = 0.088170157 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.059117367 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002624476 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058461266 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.339353307 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015622337 Gravity::solve_for_phi() time = 0.085830245 on level 0 Castro::construct_new_gravity() time = 0.087962853 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.058740544 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002612341 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058115862 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328683231 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015683151 Gravity::solve_for_phi() time = 0.086076826 on level 0 Castro::construct_new_gravity() time = 0.088205126 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059901797 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002544735 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058222226 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337831484 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016464453 Gravity::solve_for_phi() time = 0.087430674 on level 0 Castro::construct_new_gravity() time = 0.089606202 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.060007446 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002723998 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058202594 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334768742 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016546988 Gravity::solve_for_phi() time = 0.086997728 on level 0 Castro::construct_new_gravity() time = 0.089119462 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059648281 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002681021 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058279763 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.339622109 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016408161 Gravity::solve_for_phi() time = 0.086206364 on level 0 Castro::construct_new_gravity() time = 0.088331539 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.058618705 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002661936 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058211581 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331477143 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015890827 Gravity::solve_for_phi() time = 0.085915045 on level 0 Castro::construct_new_gravity() time = 0.088046962 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059354113 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002614883 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058027089 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334345759 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015351219 Gravity::solve_for_phi() time = 0.08525669 on level 0 Castro::construct_new_gravity() time = 0.087400282 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.05848874 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002760884233 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.92680196 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.369998475 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.011188887 seconds Ending run at 16:44:28 UTC on 2024-03-24. Run time = 14.57223927 Run time without initialization = 12.30900101 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.57 ... 14.57 ... 14.57 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3968 5.4717 5.6249 38.60% Amr::InitAmr() 1 1.354 1.354 1.355 9.30% Castro::computeTemp() 80 0.8447 0.9447 1.105 7.59% amrex::Copy() 724 0.7864 0.7952 0.8027 5.51% FabArray::ParallelCopy_finish() 1429 0.06888 0.5196 0.7621 5.23% Castro::normalize_species() 79 0.5626 0.5701 0.6009 4.12% MultiFab::AddProduct() 3439 0.5528 0.5581 0.5647 3.88% Castro::reset_internal_energy(Fab) 160 0.5158 0.5224 0.5308 3.64% MLPoisson::Fsmooth() 6144 0.3201 0.3471 0.4164 2.86% Castro::initMFs() 1 0.3579 0.3619 0.3946 2.71% FabArray::setVal() 5013 0.3357 0.3409 0.3472 2.38% MultiFab::Subtract() 159 0.339 0.3424 0.3465 2.38% Amr::writePlotFile() 2 0.3207 0.3413 0.344 2.36% Gravity::fill_multipole_BCs() 19 0.1955 0.242 0.2848 1.95% check_for_negative_density() 20 0.02703 0.2016 0.2831 1.94% Castro::reset_internal_energy(MultiFab) 80 0.02294 0.06482 0.2437 1.67% FabArray::ParallelCopy_nowait() 1429 0.1882 0.2016 0.2193 1.50% FabArray::sum() 3439 0.1854 0.1877 0.1902 1.31% Castro::initData() 1 0.003371 0.02654 0.1559 1.07% FillBoundary_finish() 6380 0.09794 0.1188 0.1533 1.05% FillBoundary_nowait() 6380 0.07639 0.1031 0.1302 0.89% MLPoisson::Fapply() 986 0.0941 0.09894 0.1126 0.77% MLCellLinOp::applyBC() 7148 0.05186 0.06233 0.1029 0.71% FabArray::Saxpy() 264 0.06753 0.06833 0.07478 0.51% Castro::enforce_min_density() 79 0.01772 0.03094 0.07314 0.50% Castro::construct_new_gravity_source() 17 0.06926 0.07021 0.07124 0.49% Castro::do_new_sources() 17 0.0003912 0.01209 0.06605 0.45% FabArray::Xpay() 945 0.05177 0.05426 0.06095 0.42% Castro::construct_old_gravity_source() 20 0.04517 0.04565 0.04628 0.32% MultiFab::contains_nan() 37 0.04491 0.04551 0.04603 0.32% AmrLevel::derive() 18 0.03988 0.04085 0.04476 0.31% Amr::writeSmallPlotFile() 2 0.03961 0.04145 0.0419 0.29% MLMG::addInterpCorrection() 768 0.03283 0.03531 0.04177 0.29% Castro::do_old_sources() 20 0.0005544 0.008501 0.03767 0.26% StateData::FillBoundary(geom) 143 0 0.0174 0.03386 0.23% amrex::average_down 768 0.02432 0.02645 0.03183 0.22% VisMF::Write(FabArray) 4 0.01196 0.01358 0.0289 0.20% MLCellLinOp::defineAuxData() 19 0.01462 0.01522 0.01719 0.12% FabArray::FillBoundary() 6380 0.01334 0.01394 0.01649 0.11% Castro::construct_new_source() 102 0.01547 0.01568 0.01648 0.11% MLCGSolver::bicgstab 8 0 0.0009887 0.01582 0.11% FabArray::norminf() 282 0.01085 0.01121 0.01516 0.10% amrex::Add() 128 0.0141 0.01424 0.01466 0.10% FillPatchIterator::Initialize 147 0.0124 0.01266 0.01348 0.09% Castro::evaluate_source_change() 196 0.01222 0.01257 0.01328 0.09% FabArrayBase::getFB() 6380 0.009805 0.01031 0.01269 0.09% MLCellLinOp::smooth() 3072 0.0108 0.01136 0.01217 0.08% FabArray::setDomainBndry() 147 0.0004396 0.006346 0.01191 0.08% MLMG::prepareForSolve() 18 0.009735 0.01001 0.01055 0.07% Castro::wd_update() 2 0.004464 0.007679 0.01054 0.07% Castro::construct_old_source() 120 0.009825 0.009947 0.01005 0.07% Castro::construct_old_gravity() 20 0.0004532 0.003104 0.00872 0.06% MLMG::ResNormInf() 146 0.00412 0.00671 0.0086 0.06% MLLinOp::makeSubCommunicator() 19 0.001242 0.00436 0.008032 0.06% FabArrayBase::getCPC() 2005 0.00726 0.007464 0.00791 0.05% Castro::volWgtSum() 46 0.007519 0.007553 0.007686 0.05% Gravity::actual_solve_with_mlmg() 19 0.006539 0.006919 0.007681 0.05% FabArray::mult() 59 0.007305 0.007397 0.007591 0.05% Gravity::get_old_grav_vector() 20 0.006481 0.006575 0.006711 0.05% Gravity::get_new_grav_vector() 18 0.006126 0.006261 0.006675 0.05% FabArrayBase::CPC::define() 576 0.00223 0.003374 0.006312 0.04% MLCellLinOp::compGrad() 18 0.005908 0.005991 0.006221 0.04% amrex::Dot() 142 0 0.0003757 0.006011 0.04% Castro::initialize_do_advance() 20 0.004495 0.004727 0.005691 0.04% Castro::volInBoundary() 14 0.00346 0.003711 0.005473 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0002985 0.004776 0.03% MLCellLinOp::apply() 986 0.001957 0.002185 0.004624 0.03% MLMG::solve() 18 0.0008988 0.002811 0.004516 0.03% FabArray::ParallelCopy() 1429 0.00354 0.003696 0.003944 0.03% BndryData::define() 19 0.003072 0.00319 0.003709 0.03% MLPoisson::normalize() 79 0 0.0001955 0.003127 0.02% MultiFab::max() 2 0.0004215 0.001388 0.002888 0.02% AmrLevel::FillPatch() 147 0.002073 0.002207 0.002423 0.02% MLLinOp::defineGrids() 19 0.00179 0.00196 0.002267 0.02% MLCellLinOp::prepareForSolve() 19 0.001602 0.001742 0.002038 0.01% Castro::sum_integrated_quantities() 2 0.001648 0.001814 0.001977 0.01% MLCellLinOp::correctionResidual() 768 0.001801 0.001862 0.001937 0.01% Castro::save_data_for_retry() 3 0.001248 0.00135 0.001865 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001344 0.001541 0.001801 0.01% MLMG::mgVcycle() 128 0.001596 0.001661 0.001795 0.01% MLCellLinOp::defineBC() 19 0.001496 0.001546 0.001642 0.01% MLMG:computeResOfCorrection() 768 0.001376 0.001427 0.001496 0.01% Gravity::solve_for_phi() 17 0.0008259 0.001007 0.001495 0.01% FabArrayBase::FB::FB() 75 0.0002899 0.000693 0.001446 0.01% StateData::define() 6 0.001328 0.001358 0.00139 0.01% main() 1 0.0009708 0.001159 0.001373 0.01% Castro::construct_new_gravity() 17 0.0003047 0.0005106 0.001231 0.01% Castro::locWgtSum() 6 0.00111 0.00113 0.001157 0.01% TagBoxArray::collate() 2 0.0003935 0.0006856 0.00105 0.01% MLMG::actualBottomSolve() 128 0.0001303 0.0001934 0.001046 0.01% StateDataPhysBCFunct::() 147 0.0006776 0.0008207 0.0009284 0.01% Castro::subcycle_advance_ctu() 1 0.0001963 0.0002589 0.0008587 0.01% MLCellLinOp::setLevelBC() 19 0.0005535 0.000662 0.0008237 0.01% Gravity::applyMetricTerms() 2 0.0004893 0.0005372 0.0008012 0.01% FillPatchIterator::FillFromLevel0() 147 0.0007047 0.0007365 0.0007933 0.01% AmrMesh::MakeNewGrids() 2 0.0004921 0.0005247 0.0007646 0.01% MLMG::mgVcycle_down::1 128 0.0006595 0.0006758 0.0007377 0.01% MLMG::mgVcycle_down::2 128 0.0006067 0.0006645 0.0007252 0.00% MLMG::mgVcycle_down::0 128 0.0006585 0.0006795 0.0007091 0.00% MLMG::mgVcycle_down::3 128 0.0005723 0.0006171 0.0007046 0.00% MLMG::mgVcycle_down::4 128 0.0005533 0.0005793 0.0006715 0.00% MLMG::mgVcycle_down::5 128 0.0005746 0.0005939 0.000666 0.00% Castro::Castro() 1 0.0005216 0.0005719 0.0006135 0.00% Castro::buildMetrics() 1 0.0005723 0.0005871 0.0006029 0.00% Castro::swap_state_time_levels() 8 0.0004138 0.0004414 0.0005764 0.00% Castro::apply_tagging_restrictions() 2 0.0004167 0.0004773 0.0005372 0.00% Castro::clean_state() 79 0.0004334 0.0004645 0.0005296 0.00% MLMG::mgVcycle_up::0 128 0.0004598 0.0004759 0.0005217 0.00% FillPatchSingleLevel 147 0.0004637 0.0004825 0.0004988 0.00% Castro::do_advance_ctu() 20 0.0004098 0.0004354 0.0004923 0.00% MLMG::mgVcycle_up::1 128 0.0004547 0.0004717 0.000492 0.00% MLMG::mgVcycle_up::2 128 0.0003915 0.000428 0.0004709 0.00% MLCellLinOp::solutionResidual() 147 0.0004355 0.0004485 0.000463 0.00% MLMG::mgVcycle_up::3 128 0.0003857 0.0004001 0.0004586 0.00% makeSFC 95 0.0003679 0.0003946 0.0004582 0.00% MLMG::mgVcycle_up::5 128 0.0003962 0.0004097 0.0004471 0.00% MLMG::mgVcycle_up::4 128 0.0003871 0.0004027 0.0004346 0.00% MLMG::oneIter() 128 0.0003802 0.0003915 0.0004317 0.00% Castro::volProductSum() 2 0.0003905 0.0003954 0.0004024 0.00% Castro::enforce_consistent_e() 1 0.0003762 0.000388 0.0003997 0.00% Castro::problem_post_timestep() 2 1.094e-05 3.55e-05 0.000386 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003278 0.0003399 0.0003689 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002086 0.0002301 0.0002664 0.00% MLMG::computeResidual() 128 0.0002416 0.0002492 0.0002605 0.00% MLMG::mgVcycle_bottom 128 0.0002233 0.0002325 0.0002431 0.00% DistributionMapping::Distribute() 95 0.0002081 0.0002164 0.0002305 0.00% Castro::retry_advance_ctu() 11 5.639e-05 7.807e-05 0.0002033 0.00% Castro::finalize_do_advance() 17 0.0001579 0.0001748 0.0001995 0.00% Gravity::update_max_rhs() 2 0.0001559 0.000166 0.0001825 0.00% OwnerMask() 2 0.0001314 0.0001507 0.0001689 0.00% Amr::grid_places() 2 8.296e-05 0.0001151 0.0001628 0.00% MLMG::compResidual() 1 0.0001524 0.000156 0.000162 0.00% Castro::initialize_advance() 1 0.000112 0.0001215 0.0001586 0.00% MLPoisson::define() 19 0.0001248 0.000137 0.0001477 0.00% Amr::coarseTimeStep() 1 0.0001089 0.0001351 0.0001393 0.00% Amr::defBaseLevel() 1 0.0001135 0.0001249 0.0001368 0.00% TagBoxArray::mapPRD 2 0.0001071 0.0001158 0.0001301 0.00% Castro::enforce_speed_limit() 79 0.0001079 0.0001153 0.000129 0.00% Castro::check_for_nan() 37 0.0001017 0.0001129 0.0001273 0.00% Castro::apply_problem_tags() 2 9.393e-05 0.0001017 0.000122 0.00% Castro::create_source_corrector() 17 5.706e-05 6.632e-05 0.0001141 0.00% Gravity::test_composite_phi() 1 9.374e-05 9.798e-05 0.0001124 0.00% Castro::apply_source_to_state() 37 9.506e-05 0.0001009 0.0001121 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.142e-05 6.922e-05 0.0001001 0.00% MLPoisson::prepareForSolve() 19 7.806e-05 8.216e-05 8.972e-05 0.00% MLLinOp::define() 19 7.366e-05 8.055e-05 8.87e-05 0.00% Amr::FinalizeInit() 1 1.038e-05 2.13e-05 8.569e-05 0.00% knapsack() 1 5.739e-05 6.109e-05 7.942e-05 0.00% MultiFab::Swap() 5 6.435e-05 6.615e-05 7.088e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 2.593e-05 4.844e-05 6.388e-05 0.00% Amr::initSubcycle() 1 6.007e-05 6.208e-05 6.323e-05 0.00% Castro::expand_state() 20 5.121e-05 5.49e-05 6.054e-05 0.00% Castro::derive() 18 3.98e-05 4.337e-05 5.08e-05 0.00% Gravity::swapTimeLevels() 8 3.27e-05 3.596e-05 4.556e-05 0.00% MLMG::getGradSolution() 18 4.008e-05 4.208e-05 4.474e-05 0.00% MLMG::computeMLResidual() 18 4.07e-05 4.21e-05 4.443e-05 0.00% MLMG::MLResNormInf() 18 3.246e-05 3.441e-05 3.705e-05 0.00% MLMG::MLRhsNormInf() 18 3.081e-05 3.209e-05 3.618e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.099e-05 3.353e-05 3.55e-05 0.00% Castro::construct_old_rotation_source() 20 2.911e-05 3.06e-05 3.151e-05 0.00% Gravity::actual_multilevel_solve() 1 2.683e-05 2.768e-05 3.015e-05 0.00% Castro::estTimeStep() 10 1.16e-05 1.38e-05 2.933e-05 0.00% Amr::regrid() 1 1.082e-05 1.259e-05 2.922e-05 0.00% Castro::construct_new_rotation_source() 17 2.031e-05 2.204e-05 2.59e-05 0.00% Amr::timeStep() 1 1.327e-05 1.652e-05 2.333e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.649e-05 1.805e-05 2.16e-05 0.00% Castro::finalize_advance() 1 1.648e-05 1.765e-05 2.116e-05 0.00% Amr::InitializeInit() 1 7.322e-06 8.185e-06 1.487e-05 0.00% Castro::post_init() 1 1.185e-05 1.264e-05 1.386e-05 0.00% Castro::post_regrid() 2 1.06e-05 1.128e-05 1.294e-05 0.00% Amr::initialInit() 1 3.14e-06 4.154e-06 1.261e-05 0.00% Castro::advance() 1 6.633e-06 8.228e-06 1.152e-05 0.00% Amr::init() 1 6.614e-06 7.697e-06 1.039e-05 0.00% Amr::bldFineLevels() 1 7.041e-06 8.376e-06 1.025e-05 0.00% Castro::computeInitialDt() 2 7.103e-06 7.444e-06 7.919e-06 0.00% BoxList::parallelComplementIn() 4 6.981e-06 7.333e-06 7.69e-06 0.00% Castro::errorEst() 2 6.43e-06 6.751e-06 7.622e-06 0.00% Castro::post_timestep() 1 5.725e-06 6.098e-06 6.808e-06 0.00% BoxList::complementIn 4 6.115e-06 6.291e-06 6.525e-06 0.00% Castro::gwstrain() 2 4.327e-06 4.763e-06 6.357e-06 0.00% Gravity::set_mass_offset() 2 4.706e-06 4.925e-06 5.283e-06 0.00% Castro::FluxRegCrseInit 1 1.669e-06 1.941e-06 2.159e-06 0.00% Castro::FluxRegFineAdd() 1 1.47e-06 1.587e-06 1.809e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.57 14.57 14.57 100.00% Amr::coarseTimeStep() 1 12.31 12.31 12.31 84.46% Amr::timeStep() 1 11.93 11.93 11.93 81.85% Castro::advance() 1 11.86 11.87 11.87 81.45% Castro::subcycle_advance_ctu() 1 11.78 11.81 11.82 81.10% Castro::do_advance_ctu() 20 11.74 11.77 11.78 80.85% Castro::construct_ctu_hydro_source() 20 6.421 6.453 6.493 44.56% Castro::clean_state() 79 3.678 3.807 3.965 27.21% Castro::computeTemp() 80 2.357 2.487 2.707 18.57% Castro::reset_internal_energy(MultiFab) 80 1.483 1.542 1.705 11.70% Gravity::solve_phi_with_mlmg() 19 1.488 1.535 1.582 10.86% Castro::construct_new_gravity() 17 1.414 1.461 1.508 10.35% Castro::initialize_do_advance() 20 1.388 1.442 1.487 10.20% Gravity::solve_for_phi() 17 1.377 1.424 1.471 10.10% Amr::InitAmr() 1 1.354 1.355 1.355 9.30% Gravity::actual_solve_with_mlmg() 19 1.286 1.29 1.294 8.88% MLMG::solve() 18 1.236 1.24 1.241 8.52% Castro::do_old_sources() 20 1.142 1.167 1.183 8.12% MLMG::oneIter() 128 1.105 1.107 1.109 7.61% MLMG::mgVcycle() 128 1.09 1.093 1.095 7.51% Castro::do_new_sources() 17 0.9334 0.9791 1.013 6.95% FabArray::ParallelCopy() 1429 0.2945 0.7448 0.9851 6.76% Castro::evaluate_source_change() 196 0.9402 0.95 0.9609 6.59% Amr::init() 1 0.908 0.908 0.908 6.23% Castro::enforce_min_density() 79 0.7854 0.8062 0.8411 5.77% Amr::initialInit() 1 0.8221 0.8221 0.8222 5.64% amrex::Copy() 724 0.7864 0.7952 0.8027 5.51% FabArray::ParallelCopy_finish() 1429 0.06888 0.5196 0.7621 5.23% MLCellLinOp::smooth() 3072 0.5579 0.608 0.7347 5.04% AmrLevel::FillPatch() 147 0.4908 0.5901 0.6994 4.80% Castro::normalize_species() 79 0.5626 0.5701 0.6009 4.12% Amr::InitializeInit() 1 0.4448 0.5 0.5986 4.11% Amr::defBaseLevel() 1 0.4448 0.5 0.5985 4.11% MultiFab::AddProduct() 3439 0.5528 0.5581 0.5647 3.88% Castro::reset_internal_energy(Fab) 160 0.5158 0.5224 0.5308 3.64% FillPatchIterator::Initialize 147 0.3107 0.4099 0.5206 3.57% FillPatchIterator::FillFromLevel0() 147 0.2863 0.3909 0.5035 3.46% FillPatchSingleLevel 147 0.2855 0.3902 0.5028 3.45% Amr::writePlotFile() 2 0.4224 0.4225 0.4225 2.90% MLMG::mgVcycle_up::1 128 0.09663 0.2578 0.4198 2.88% MLPoisson::Fsmooth() 6144 0.3201 0.3471 0.4164 2.86% Castro::Castro() 1 0.3638 0.3678 0.4016 2.76% Castro::initMFs() 1 0.358 0.3621 0.3947 2.71% MLCellLinOp::applyBC() 7148 0.2727 0.3092 0.3848 2.64% Amr::FinalizeInit() 1 0.2235 0.322 0.3772 2.59% MLMG::addInterpCorrection() 768 0.0615 0.2968 0.3665 2.51% FabArray::setVal() 5013 0.3357 0.3409 0.3472 2.38% MultiFab::Subtract() 159 0.339 0.3424 0.3465 2.38% Castro::expand_state() 20 0.1803 0.2367 0.2935 2.01% Gravity::fill_multipole_BCs() 19 0.1977 0.2441 0.2868 1.97% FabArray::FillBoundary() 6380 0.2128 0.2469 0.2864 1.97% check_for_negative_density() 20 0.02703 0.2016 0.2831 1.94% MLMG::mgVcycle_up::2 128 0.01056 0.1131 0.2694 1.85% MLMG::mgVcycle_down::0 128 0.2625 0.2648 0.2674 1.83% FabArray::ParallelCopy_nowait() 1429 0.2079 0.2215 0.2399 1.65% Castro::initData() 1 0.07724 0.1305 0.2321 1.59% MLMG::mgVcycle_up::0 128 0.1998 0.2005 0.2017 1.38% Amr::bldFineLevels() 1 0.04699 0.145 0.1995 1.37% MLCellLinOp::apply() 986 0.15 0.159 0.1944 1.33% FabArray::sum() 3439 0.1854 0.1877 0.1902 1.31% MLMG::mgVcycle_up::3 128 0.01051 0.02307 0.1737 1.19% Amr::grid_places() 2 0.002934 0.1015 0.1566 1.07% AmrMesh::MakeNewGrids() 2 0.002851 0.1013 0.1565 1.07% TagBoxArray::mapPRD 2 0.0008511 0.09938 0.1546 1.06% FillBoundary_finish() 6380 0.09794 0.1188 0.1533 1.05% MLMG:computeResOfCorrection() 768 0.1137 0.1233 0.1468 1.01% MLCellLinOp::correctionResidual() 768 0.1123 0.1219 0.1453 1.00% FillBoundary_nowait() 6380 0.08651 0.1141 0.1417 0.97% Castro::post_init() 1 0.1328 0.1338 0.1353 0.93% Castro::construct_new_source() 102 0.1228 0.1241 0.1258 0.86% MLMG::mgVcycle_down::1 128 0.1151 0.1187 0.1226 0.84% MLPoisson::Fapply() 986 0.0941 0.09894 0.1126 0.77% Gravity::multilevel_solve_for_new_phi() 1 0.1003 0.1003 0.1004 0.69% Gravity::actual_multilevel_solve() 1 0.1002 0.1003 0.1003 0.69% MLCellLinOp::solutionResidual() 147 0.08741 0.09209 0.09589 0.66% Castro::create_source_corrector() 17 0.04912 0.06415 0.0934 0.64% Castro::post_regrid() 2 0.08526 0.08671 0.08772 0.60% Castro::initialize_advance() 1 0.04854 0.05613 0.08499 0.58% MLMG::computeResidual() 128 0.07601 0.07701 0.07898 0.54% Castro::construct_old_source() 120 0.07729 0.07801 0.07888 0.54% Castro::derive() 18 0.06853 0.06989 0.0756 0.52% AmrLevel::derive() 18 0.06849 0.06984 0.07555 0.52% FabArray::Saxpy() 264 0.06753 0.06833 0.07478 0.51% MLMG::mgVcycle_down::2 128 0.01238 0.04118 0.07303 0.50% Castro::construct_new_gravity_source() 17 0.06926 0.07021 0.07124 0.49% MLMG::mgVcycle_bottom 128 0.0003548 0.004725 0.07007 0.48% MLMG::actualBottomSolve() 128 0.0001303 0.004492 0.06983 0.48% MLCGSolver::bicgstab 8 0 0.004271 0.06834 0.47% Castro::construct_old_gravity() 20 0.04533 0.05723 0.06713 0.46% Gravity::get_old_grav_vector() 20 0.04359 0.05413 0.0665 0.46% Castro::post_timestep() 1 0.0581 0.05991 0.06233 0.43% FabArray::Xpay() 945 0.05177 0.05426 0.06095 0.42% MLMG::mgVcycle_down::3 128 0.01173 0.01795 0.0594 0.41% amrex::average_down 768 0.03253 0.03925 0.05488 0.38% Castro::construct_old_gravity_source() 20 0.04517 0.04565 0.04628 0.32% Castro::check_for_nan() 37 0.04502 0.04563 0.04614 0.32% MultiFab::contains_nan() 37 0.04491 0.04551 0.04603 0.32% Amr::regrid() 1 0.044 0.04465 0.04524 0.31% Amr::writeSmallPlotFile() 2 0.04486 0.04486 0.04487 0.31% Castro::retry_advance_ctu() 11 0.03536 0.03657 0.04244 0.29% MLPoisson::define() 19 0.02893 0.03335 0.03955 0.27% Gravity::get_new_grav_vector() 18 0.03535 0.03588 0.03641 0.25% StateDataPhysBCFunct::() 147 0.0006776 0.01822 0.03479 0.24% MLMG::mgVcycle_down::4 128 0.01166 0.01336 0.03447 0.24% StateData::FillBoundary(geom) 143 0 0.0174 0.03386 0.23% VisMF::Write(FabArray) 4 0.01196 0.01358 0.0289 0.20% Castro::apply_source_to_state() 37 0.02761 0.02776 0.02793 0.19% MLMG::mgVcycle_up::4 128 0.01059 0.0118 0.02679 0.18% Castro::save_data_for_retry() 3 0.01893 0.01964 0.02522 0.17% MLCellLinOp::defineAuxData() 19 0.01881 0.02007 0.02382 0.16% MLMG::mgVcycle_down::5 128 0.01164 0.01256 0.02263 0.16% MLMG::prepareForSolve() 18 0.01967 0.02055 0.02255 0.15% Castro::sum_integrated_quantities() 2 0.02077 0.02105 0.02107 0.14% MLMG::mgVcycle_up::5 128 0.01066 0.01138 0.01914 0.13% MLMG::computeMLResidual() 18 0.0106 0.01465 0.01825 0.13% MLMG::ResNormInf() 146 0.01375 0.01631 0.01814 0.12% FabArray::norminf() 282 0.01085 0.01121 0.01516 0.10% amrex::Add() 128 0.0141 0.01424 0.01466 0.10% FabArrayBase::getFB() 6380 0.01012 0.011 0.01414 0.10% Gravity::test_composite_phi() 1 0.01409 0.01411 0.01413 0.10% Castro::problem_post_timestep() 2 0.009697 0.01143 0.01407 0.10% Castro::wd_update() 2 0.009492 0.01139 0.01406 0.10% FabArrayBase::getCPC() 2005 0.009522 0.01084 0.01393 0.10% FabArray::setDomainBndry() 147 0.0004396 0.006346 0.01191 0.08% MLLinOp::define() 19 0.00407 0.007351 0.01141 0.08% MLLinOp::defineGrids() 19 0.003992 0.007271 0.01133 0.08% MLMG::getGradSolution() 18 0.007525 0.007835 0.008068 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005021 0.008034 0.06% MLLinOp::makeSubCommunicator() 19 0.001242 0.00436 0.008032 0.06% MLCellLinOp::compGrad() 18 0.007482 0.007793 0.008026 0.06% Castro::volWgtSum() 46 0.007519 0.007553 0.007686 0.05% FabArray::mult() 59 0.007305 0.007397 0.007591 0.05% MLCellLinOp::defineBC() 19 0.005567 0.005791 0.006556 0.04% FabArrayBase::CPC::define() 576 0.00223 0.003374 0.006312 0.04% amrex::Dot() 142 0 0.0003757 0.006011 0.04% Castro::volInBoundary() 14 0.00346 0.003711 0.005473 0.04% BndryData::define() 19 0.003959 0.004245 0.00493 0.03% Gravity::update_max_rhs() 2 0.001674 0.00268 0.004141 0.03% MLPoisson::normalize() 79 0 0.0001955 0.003127 0.02% MultiFab::max() 2 0.0004215 0.001388 0.002888 0.02% MLPoisson::prepareForSolve() 19 0.001685 0.001824 0.002119 0.01% MLCellLinOp::prepareForSolve() 19 0.001602 0.001742 0.002038 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001344 0.001541 0.001801 0.01% FabArrayBase::FB::FB() 75 0.0002899 0.000693 0.001446 0.01% AmrLevel::AmrLevel(dm) 1 0.001361 0.001392 0.001425 0.01% StateData::define() 6 0.001328 0.001358 0.00139 0.01% MLMG::MLResNormInf() 18 0.001229 0.001252 0.001269 0.01% Gravity::swapTimeLevels() 8 0.001118 0.001169 0.001258 0.01% MLMG::MLRhsNormInf() 18 0.001186 0.001207 0.001256 0.01% MLMG::compResidual() 1 0.0009394 0.001085 0.001241 0.01% Castro::locWgtSum() 6 0.00111 0.00113 0.001157 0.01% TagBoxArray::collate() 2 0.0003935 0.0006856 0.00105 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009061 0.000951 0.001038 0.01% MLCellLinOp::setLevelBC() 19 0.0005535 0.000662 0.0008237 0.01% Gravity::applyMetricTerms() 2 0.0004893 0.0005372 0.0008012 0.01% makeSFC 95 0.0005764 0.000611 0.0006832 0.00% Castro::buildMetrics() 1 0.0006293 0.0006452 0.0006622 0.00% Castro::errorEst() 2 0.000523 0.0005858 0.0006512 0.00% Castro::swap_state_time_levels() 8 0.0004138 0.0004414 0.0005764 0.00% Castro::apply_tagging_restrictions() 2 0.0004167 0.0004773 0.0005372 0.00% Castro::volProductSum() 2 0.0003905 0.0003954 0.0004024 0.00% Castro::enforce_consistent_e() 1 0.0003762 0.000388 0.0003997 0.00% Castro::finalize_advance() 1 0.0002535 0.0002601 0.0002691 0.00% DistributionMapping::Distribute() 95 0.0002081 0.0002164 0.0002305 0.00% Castro::finalize_do_advance() 17 0.0001665 0.0001843 0.000209 0.00% OwnerMask() 2 0.0001314 0.0001507 0.0001689 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001165 0.0001276 0.000144 0.00% Castro::enforce_speed_limit() 79 0.0001079 0.0001153 0.000129 0.00% Castro::apply_problem_tags() 2 9.393e-05 0.0001017 0.000122 0.00% knapsack() 1 5.739e-05 6.109e-05 7.942e-05 0.00% MultiFab::Swap() 5 6.435e-05 6.615e-05 7.088e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 2.593e-05 4.844e-05 6.388e-05 0.00% Amr::initSubcycle() 1 6.007e-05 6.208e-05 6.323e-05 0.00% Castro::construct_old_rotation_source() 20 2.911e-05 3.06e-05 3.151e-05 0.00% Castro::estTimeStep() 10 1.16e-05 1.38e-05 2.933e-05 0.00% Castro::computeInitialDt() 2 1.01e-05 1.178e-05 2.707e-05 0.00% Castro::construct_new_rotation_source() 17 2.031e-05 2.204e-05 2.59e-05 0.00% BoxList::parallelComplementIn() 4 1.31e-05 1.362e-05 1.42e-05 0.00% BoxList::complementIn 4 6.115e-06 6.291e-06 6.525e-06 0.00% Castro::gwstrain() 2 4.327e-06 4.763e-06 6.357e-06 0.00% Gravity::set_mass_offset() 2 4.706e-06 4.925e-06 5.283e-06 0.00% Castro::FluxRegCrseInit 1 1.669e-06 1.941e-06 2.159e-06 0.00% Castro::FluxRegFineAdd() 1 1.47e-06 1.587e-06 1.809e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 12 B 14 B 24 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-32-g33701ffd5611) finalized