Initializing AMReX (v2024-34-g9e8f8d60eca3)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (v2024-34-g9e8f8d60eca3) initialized Starting run at 08:09:43 UTC on 2024-03-26. Successfully read inputs file ... Castro git describe: 24.03-26-g5707c0c2f AMReX git describe: v2024-34-g9e8f8d60e Microphysics git describe: 24.03-21-g81de2adb reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.17217178 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001044218 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010640081 Gravity::multilevel_solve_for_new_phi() time = 0.102994592 Gravity::fill_multipole_BCs() time = 0.011640486 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.046774857 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004187548 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003359058 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.063692381 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.009540181 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.062784947 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006524636 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.06040373 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007410311 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.062130929 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.317825061 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015178165 Gravity::solve_for_phi() time = 0.084293762 on level 0 Castro::construct_new_gravity() time = 0.086728676 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.059888141 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.00318442 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058359114 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.315398115 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015108314 Gravity::solve_for_phi() time = 0.091441356 on level 0 Castro::construct_new_gravity() time = 0.093508281 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.061005993 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.003059593 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058308699 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.320291192 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014760618 Gravity::solve_for_phi() time = 0.083824491 on level 0 Castro::construct_new_gravity() time = 0.085872835 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.059641847 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003016816 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058505654 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.322601154 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015349866 Gravity::solve_for_phi() time = 0.084412783 on level 0 Castro::construct_new_gravity() time = 0.086442263 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.05922901 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00286706 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058213884 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329605218 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015810098 Gravity::solve_for_phi() time = 0.085216239 on level 0 Castro::construct_new_gravity() time = 0.08729773 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060301547 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003495535 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059242954 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323590586 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015189485 Gravity::solve_for_phi() time = 0.083857735 on level 0 Castro::construct_new_gravity() time = 0.085892835 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.05941106 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003307848 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058316181 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327387404 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015098328 Gravity::solve_for_phi() time = 0.084535467 on level 0 Castro::construct_new_gravity() time = 0.086575732 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059634873 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003196981 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059273856 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324409863 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015874186 Gravity::solve_for_phi() time = 0.08480669 on level 0 Castro::construct_new_gravity() time = 0.086825633 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060105058 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003497479 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058195209 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328454 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016568699 Gravity::solve_for_phi() time = 0.085960313 on level 0 Castro::construct_new_gravity() time = 0.087986493 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059527933 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003448012 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058547506 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323563321 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015477669 Gravity::solve_for_phi() time = 0.085175378 on level 0 Castro::construct_new_gravity() time = 0.087216558 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.058999609 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003255929 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058269832 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327692224 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015498805 Gravity::solve_for_phi() time = 0.084122428 on level 0 Castro::construct_new_gravity() time = 0.08614873 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.058965838 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.0031219 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058468321 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323228881 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015330088 Gravity::solve_for_phi() time = 0.08423976 on level 0 Castro::construct_new_gravity() time = 0.086273474 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059321792 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.00302291 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058361618 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329104223 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015393569 Gravity::solve_for_phi() time = 0.084904641 on level 0 Castro::construct_new_gravity() time = 0.086936704 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059975655 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003434732 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058438321 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324105092 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015354718 Gravity::solve_for_phi() time = 0.084519332 on level 0 Castro::construct_new_gravity() time = 0.086611029 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059641508 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.00297842 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058210026 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328593078 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015213914 Gravity::solve_for_phi() time = 0.084757457 on level 0 Castro::construct_new_gravity() time = 0.092045749 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.065443339 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.003332921 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058638812 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326878033 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015926532 Gravity::solve_for_phi() time = 0.085019077 on level 0 Castro::construct_new_gravity() time = 0.087126837 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059310688 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.003132693 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058536447 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328590732 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015379067 Gravity::solve_for_phi() time = 0.084382483 on level 0 Castro::construct_new_gravity() time = 0.086498171 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059634954 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002810797106 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.71592711 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.046880882 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004180142 seconds Ending run at 08:09:57 UTC on 2024-03-26. Run time = 13.98671637 Run time without initialization = 11.76782042 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 13.99 ... 13.99 ... 13.99 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3450 5.4101 5.4817 39.19% Amr::InitAmr() 1 1.326 1.326 1.326 9.48% Castro::computeTemp() 80 0.8231 0.9439 1.111 7.95% amrex::Copy() 724 0.7711 0.7788 0.789 5.64% FabArray::ParallelCopy_finish() 1429 0.04905 0.5079 0.7094 5.07% Castro::normalize_species() 79 0.5487 0.563 0.683 4.88% MultiFab::AddProduct() 3439 0.5446 0.5489 0.5549 3.97% Castro::reset_internal_energy(Fab) 160 0.5122 0.5191 0.5329 3.81% MLPoisson::Fsmooth() 6144 0.312 0.3398 0.4132 2.95% Castro::initMFs() 1 0.3524 0.3682 0.4037 2.89% FabArray::setVal() 5013 0.3307 0.3363 0.345 2.47% MultiFab::Subtract() 159 0.3324 0.3358 0.3402 2.43% Gravity::fill_multipole_BCs() 19 0.1968 0.2406 0.2812 2.01% Castro::reset_internal_energy(MultiFab) 80 0.0227 0.06464 0.2433 1.74% FabArray::ParallelCopy_nowait() 1429 0.1861 0.1993 0.2196 1.57% FabArray::sum() 3439 0.1873 0.1889 0.1907 1.36% check_for_negative_density() 20 0.07 0.1305 0.1848 1.32% Castro::initData() 1 0.003347 0.02628 0.1513 1.08% FillBoundary_finish() 6380 0.09433 0.1147 0.1363 0.97% FillBoundary_nowait() 6380 0.07832 0.1023 0.131 0.94% MLPoisson::Fapply() 986 0.09332 0.09803 0.1133 0.81% MLCellLinOp::applyBC() 7148 0.046 0.06184 0.1039 0.74% Castro::construct_new_gravity_source() 17 0.06857 0.07131 0.09588 0.69% Castro::enforce_min_density() 79 0.01733 0.03604 0.08991 0.64% FabArray::Saxpy() 264 0.06796 0.06898 0.07604 0.54% FabArray::Xpay() 945 0.05097 0.0535 0.06072 0.43% MultiFab::contains_nan() 37 0.04456 0.04499 0.04551 0.33% Castro::construct_old_gravity_source() 20 0.04419 0.04449 0.04501 0.32% Castro::do_old_sources() 20 0.0005624 0.009268 0.04413 0.32% Castro::do_new_sources() 17 0.0003717 0.007823 0.04376 0.31% MLMG::addInterpCorrection() 768 0.03246 0.0349 0.04161 0.30% AmrLevel::derive() 18 0.03965 0.04013 0.04069 0.29% StateData::FillBoundary(geom) 143 0 0.01701 0.03322 0.24% amrex::average_down 768 0.02443 0.02653 0.0322 0.23% Castro::construct_old_gravity() 20 0.0003849 0.005169 0.02539 0.18% TagBoxArray::collate() 2 0.0001309 0.00375 0.02336 0.17% VisMF::Write(FabArray) 4 0.01185 0.01293 0.02216 0.16% MLCellLinOp::defineAuxData() 19 0.0142 0.01498 0.0171 0.12% FabArray::FillBoundary() 6380 0.01333 0.01386 0.01671 0.12% Amr::writePlotFile() 2 0.00738 0.01541 0.01665 0.12% MLCGSolver::bicgstab 8 0 0.000993 0.01589 0.11% Castro::construct_new_source() 102 0.01536 0.01554 0.01576 0.11% FabArray::norminf() 282 0.01072 0.01118 0.01522 0.11% amrex::Add() 128 0.01418 0.01434 0.01459 0.10% Castro::evaluate_source_change() 196 0.01199 0.0123 0.01297 0.09% FillPatchIterator::Initialize 147 0.01218 0.01251 0.01296 0.09% FabArrayBase::getFB() 6380 0.009741 0.01018 0.01264 0.09% FabArray::setDomainBndry() 147 0.0004117 0.006302 0.01223 0.09% MLCellLinOp::smooth() 3072 0.01071 0.01124 0.01223 0.09% Castro::wd_update() 2 0.005033 0.008622 0.01072 0.08% MLMG::prepareForSolve() 18 0.009827 0.01007 0.01068 0.08% Castro::construct_old_source() 120 0.009817 0.009878 0.009984 0.07% MLMG::ResNormInf() 146 0.004064 0.006345 0.008416 0.06% FabArray::mult() 59 0.007319 0.007511 0.00824 0.06% MLLinOp::makeSubCommunicator() 19 0.00105 0.004189 0.007908 0.06% Gravity::get_new_grav_vector() 18 0.005852 0.006141 0.007769 0.06% FabArrayBase::getCPC() 2005 0.007203 0.007388 0.007752 0.06% Gravity::actual_solve_with_mlmg() 19 0.00656 0.006801 0.007672 0.05% Castro::volWgtSum() 46 0.007317 0.00739 0.007482 0.05% Castro::construct_new_gravity() 17 0.000301 0.002069 0.007427 0.05% MultiFab::max() 2 0.0001722 0.00585 0.007315 0.05% Gravity::get_old_grav_vector() 20 0.006338 0.006391 0.006462 0.05% FabArrayBase::CPC::define() 576 0.002164 0.003283 0.006294 0.04% MLMG::solve() 18 0.001046 0.003136 0.006158 0.04% amrex::Dot() 142 0 0.0003783 0.006052 0.04% MLCellLinOp::compGrad() 18 0.005833 0.005883 0.005977 0.04% Amr::writeSmallPlotFile() 2 0.003742 0.005422 0.005836 0.04% Castro::volInBoundary() 14 0.003415 0.003656 0.005377 0.04% Castro::initialize_do_advance() 20 0.004355 0.004582 0.004802 0.03% MLCGSolver::ParallelAllReduce 227 0 0.0002992 0.004787 0.03% MLCellLinOp::apply() 986 0.001954 0.002181 0.00463 0.03% FabArray::ParallelCopy() 1429 0.003448 0.003589 0.003862 0.03% BndryData::define() 19 0.003002 0.003074 0.003277 0.02% MLPoisson::normalize() 79 0 0.000193 0.003088 0.02% AmrLevel::FillPatch() 147 0.002047 0.002152 0.002334 0.02% MLLinOp::defineGrids() 19 0.001759 0.001895 0.002161 0.02% MLCellLinOp::prepareForSolve() 19 0.001611 0.001764 0.002062 0.01% Castro::sum_integrated_quantities() 2 0.001616 0.001846 0.00196 0.01% MLCellLinOp::correctionResidual() 768 0.001796 0.001843 0.00194 0.01% StateData::define() 6 0.001311 0.001409 0.001781 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001291 0.001509 0.001778 0.01% MLMG::mgVcycle() 128 0.001516 0.001601 0.001765 0.01% MLCellLinOp::defineBC() 19 0.001463 0.00152 0.001624 0.01% MLMG:computeResOfCorrection() 768 0.001358 0.001411 0.001498 0.01% Castro::save_data_for_retry() 3 0.001254 0.001303 0.001474 0.01% FabArrayBase::FB::FB() 75 0.0002778 0.0006678 0.001426 0.01% main() 1 0.0009575 0.001144 0.00128 0.01% Castro::locWgtSum() 6 0.00113 0.001137 0.001164 0.01% Gravity::solve_for_phi() 17 0.0008162 0.0009141 0.001105 0.01% MLMG::actualBottomSolve() 128 0.0001322 0.0001916 0.001038 0.01% Castro::buildMetrics() 1 0.000569 0.0006321 0.0009501 0.01% StateDataPhysBCFunct::() 147 0.0006439 0.000809 0.0008985 0.01% MLCellLinOp::setLevelBC() 19 0.0005246 0.0006573 0.000819 0.01% Castro::subcycle_advance_ctu() 1 0.0001854 0.0002449 0.0007825 0.01% Castro::Castro() 1 0.0005182 0.0005801 0.0007776 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006849 0.0007071 0.0007237 0.01% MLMG::mgVcycle_down::2 128 0.0005896 0.000648 0.0007106 0.01% MLMG::mgVcycle_down::0 128 0.0006412 0.0006624 0.0007012 0.01% MLMG::mgVcycle_down::3 128 0.0005528 0.0005967 0.0006978 0.00% MLMG::mgVcycle_down::1 128 0.0006344 0.0006497 0.0006884 0.00% MLMG::mgVcycle_down::4 128 0.0005364 0.0005607 0.0006775 0.00% MLMG::mgVcycle_down::5 128 0.0005591 0.0005752 0.0006475 0.00% Castro::apply_tagging_restrictions() 2 0.0004178 0.0004727 0.0005278 0.00% AmrMesh::MakeNewGrids() 2 0.0004732 0.0004983 0.0005186 0.00% Castro::clean_state() 79 0.0004252 0.0004601 0.0005023 0.00% MLMG::mgVcycle_up::0 128 0.0004429 0.0004642 0.0005013 0.00% Gravity::applyMetricTerms() 2 0.0004549 0.0004685 0.0004865 0.00% FillPatchSingleLevel 147 0.0004575 0.0004727 0.0004845 0.00% MLMG::mgVcycle_up::1 128 0.0004347 0.0004558 0.0004826 0.00% MLCellLinOp::solutionResidual() 147 0.0004279 0.0004414 0.0004788 0.00% Castro::swap_state_time_levels() 8 0.0004283 0.000445 0.0004736 0.00% Castro::do_advance_ctu() 20 0.0004055 0.0004282 0.0004691 0.00% makeSFC 95 0.0003689 0.0003936 0.0004591 0.00% MLMG::mgVcycle_up::2 128 0.0003722 0.0004084 0.0004524 0.00% MLMG::mgVcycle_up::5 128 0.0003838 0.0003959 0.000433 0.00% MLMG::mgVcycle_up::4 128 0.0003709 0.0003855 0.0004282 0.00% MLMG::mgVcycle_up::3 128 0.0003682 0.000385 0.0004257 0.00% MLMG::oneIter() 128 0.000367 0.0003822 0.0004127 0.00% Castro::volProductSum() 2 0.0003903 0.0003929 0.0003986 0.00% Castro::enforce_consistent_e() 1 0.0003696 0.0003802 0.0003913 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003181 0.0003338 0.000358 0.00% DistributionMapping::LeastUsedCPUs() 1 2.916e-05 0.0002415 0.0002903 0.00% Castro::problem_post_timestep() 2 1.226e-05 3.117e-05 0.0002849 0.00% MLMG::computeResidual() 128 0.0002315 0.0002389 0.000262 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002141 0.000229 0.0002557 0.00% MLMG::mgVcycle_bottom 128 0.0002233 0.0002294 0.0002455 0.00% DistributionMapping::Distribute() 95 0.0002057 0.0002185 0.0002344 0.00% Castro::finalize_do_advance() 17 0.0001546 0.0001732 0.0002114 0.00% MLMG::compResidual() 1 0.0001554 0.000157 0.0001676 0.00% Gravity::update_max_rhs() 2 0.0001544 0.0001599 0.000167 0.00% OwnerMask() 2 0.0001349 0.0001496 0.0001652 0.00% Amr::coarseTimeStep() 1 0.0001282 0.0001518 0.0001563 0.00% Castro::retry_advance_ctu() 11 5.271e-05 7.029e-05 0.0001503 0.00% MLPoisson::define() 19 0.0001195 0.0001269 0.0001445 0.00% Gravity::test_composite_phi() 1 9.777e-05 0.0001057 0.0001417 0.00% Amr::defBaseLevel() 1 9.625e-05 0.0001192 0.0001416 0.00% Castro::initialize_advance() 1 0.0001076 0.0001151 0.0001378 0.00% Castro::enforce_speed_limit() 79 0.0001017 0.0001085 0.0001242 0.00% Castro::check_for_nan() 37 9.829e-05 0.0001064 0.0001221 0.00% TagBoxArray::mapPRD 2 0.0001089 0.0001131 0.0001201 0.00% Amr::initSubcycle() 1 5.839e-05 6.607e-05 0.0001198 0.00% Amr::grid_places() 2 7.774e-05 9.46e-05 0.0001186 0.00% Castro::apply_source_to_state() 37 9.353e-05 0.0001003 0.000114 0.00% Castro::apply_problem_tags() 2 9.191e-05 9.398e-05 9.83e-05 0.00% Amr::FinalizeInit() 1 1.149e-05 2.107e-05 9.185e-05 0.00% MLPoisson::prepareForSolve() 19 7.553e-05 8.114e-05 9.109e-05 0.00% knapsack() 1 5.531e-05 6.292e-05 8.372e-05 0.00% MultiFab::Swap() 5 6.414e-05 6.768e-05 8.363e-05 0.00% MLLinOp::define() 19 7.447e-05 7.823e-05 8.249e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.059e-05 6.465e-05 7.716e-05 0.00% Castro::create_source_corrector() 17 5.306e-05 5.976e-05 7.058e-05 0.00% Castro::expand_state() 20 5.058e-05 5.365e-05 5.893e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.071e-05 3.512e-05 5.318e-05 0.00% MLMG::computeMLResidual() 18 3.941e-05 4.154e-05 4.526e-05 0.00% MLMG::getGradSolution() 18 3.99e-05 4.177e-05 4.423e-05 0.00% Castro::derive() 18 3.963e-05 4.096e-05 4.289e-05 0.00% Gravity::swapTimeLevels() 8 3.331e-05 3.73e-05 4.196e-05 0.00% MLMG::MLResNormInf() 18 3.184e-05 3.356e-05 3.549e-05 0.00% MLMG::MLRhsNormInf() 18 3.058e-05 3.125e-05 3.517e-05 0.00% Castro::construct_old_rotation_source() 20 2.971e-05 3.087e-05 3.465e-05 0.00% Gravity::actual_multilevel_solve() 1 3.123e-05 3.201e-05 3.394e-05 0.00% Amr::regrid() 1 1.051e-05 1.25e-05 2.965e-05 0.00% Castro::advance() 1 7.347e-06 9.574e-06 2.666e-05 0.00% Castro::construct_new_rotation_source() 17 2.053e-05 2.155e-05 2.538e-05 0.00% Castro::computeInitialDt() 2 6.887e-06 8.73e-06 2.522e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.584e-05 1.937e-05 2.349e-05 0.00% Castro::finalize_advance() 1 1.625e-05 1.795e-05 2.158e-05 0.00% Amr::timeStep() 1 1.219e-05 1.44e-05 2.155e-05 0.00% Amr::InitializeInit() 1 6.799e-06 9.073e-06 1.793e-05 0.00% BoxList::complementIn 4 6.103e-06 6.967e-06 1.755e-05 0.00% Castro::estTimeStep() 10 1.146e-05 1.267e-05 1.418e-05 0.00% Castro::post_init() 1 1.158e-05 1.249e-05 1.342e-05 0.00% Castro::post_regrid() 2 1.079e-05 1.147e-05 1.297e-05 0.00% Amr::init() 1 6.473e-06 7.669e-06 1.209e-05 0.00% Amr::bldFineLevels() 1 7.107e-06 7.975e-06 9.472e-06 0.00% BoxList::parallelComplementIn() 4 7.087e-06 7.26e-06 7.594e-06 0.00% Castro::post_timestep() 1 5.585e-06 6.11e-06 7.216e-06 0.00% Amr::initialInit() 1 3.058e-06 3.551e-06 7.071e-06 0.00% Castro::errorEst() 2 6.06e-06 6.366e-06 6.732e-06 0.00% Castro::gwstrain() 2 4.165e-06 4.555e-06 6.425e-06 0.00% Castro::FluxRegCrseInit 1 1.741e-06 2.234e-06 6.346e-06 0.00% Gravity::set_mass_offset() 2 4.469e-06 4.688e-06 5.118e-06 0.00% Castro::FluxRegFineAdd() 1 1.458e-06 1.598e-06 1.805e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 13.99 13.99 13.99 100.00% Amr::coarseTimeStep() 1 11.77 11.77 11.77 84.13% Amr::timeStep() 1 11.72 11.72 11.72 83.76% Castro::advance() 1 11.65 11.66 11.66 83.35% Castro::subcycle_advance_ctu() 1 11.6 11.61 11.61 82.99% Castro::do_advance_ctu() 20 11.56 11.57 11.57 82.73% Castro::construct_ctu_hydro_source() 20 6.271 6.313 6.351 45.41% Castro::clean_state() 79 3.637 3.771 3.968 28.37% Castro::computeTemp() 80 2.329 2.466 2.732 19.53% Castro::reset_internal_energy(MultiFab) 80 1.467 1.522 1.708 12.21% Gravity::solve_phi_with_mlmg() 19 1.469 1.515 1.56 11.15% Castro::construct_new_gravity() 17 1.391 1.441 1.484 10.61% Gravity::solve_for_phi() 17 1.354 1.401 1.445 10.33% Castro::initialize_do_advance() 20 1.367 1.417 1.437 10.28% Amr::InitAmr() 1 1.326 1.326 1.326 9.48% Gravity::actual_solve_with_mlmg() 19 1.267 1.271 1.276 9.12% MLMG::solve() 18 1.218 1.222 1.224 8.75% Castro::do_old_sources() 20 1.131 1.158 1.182 8.45% MLMG::oneIter() 128 1.089 1.091 1.093 7.81% MLMG::mgVcycle() 128 1.074 1.076 1.078 7.71% Castro::do_new_sources() 17 0.9431 0.9686 1.02 7.29% Castro::evaluate_source_change() 196 0.9316 0.9392 0.9497 6.79% FabArray::ParallelCopy() 1429 0.2734 0.7301 0.9349 6.68% Amr::init() 1 0.8919 0.8921 0.8922 6.38% Castro::enforce_min_density() 79 0.7744 0.7995 0.8476 6.06% Amr::initialInit() 1 0.84 0.8402 0.8403 6.01% amrex::Copy() 724 0.7711 0.7788 0.789 5.64% MLCellLinOp::smooth() 3072 0.5488 0.5966 0.7202 5.15% FabArray::ParallelCopy_finish() 1429 0.04905 0.5079 0.7094 5.07% Castro::normalize_species() 79 0.5487 0.563 0.683 4.88% AmrLevel::FillPatch() 147 0.4691 0.5743 0.6458 4.62% Amr::InitializeInit() 1 0.4393 0.5083 0.6102 4.36% Amr::defBaseLevel() 1 0.4393 0.5083 0.6102 4.36% MultiFab::AddProduct() 3439 0.5446 0.5489 0.5549 3.97% Castro::reset_internal_energy(Fab) 160 0.5122 0.5191 0.5329 3.81% FillPatchIterator::Initialize 147 0.2911 0.3971 0.4699 3.36% FillPatchIterator::FillFromLevel0() 147 0.2664 0.3783 0.4535 3.24% FillPatchSingleLevel 147 0.2657 0.3776 0.4528 3.24% MLMG::mgVcycle_up::1 128 0.09378 0.2527 0.4133 2.96% MLPoisson::Fsmooth() 6144 0.312 0.3398 0.4132 2.95% Castro::Castro() 1 0.3582 0.3742 0.4105 2.94% Castro::initMFs() 1 0.3526 0.3684 0.4038 2.89% Amr::FinalizeInit() 1 0.23 0.3318 0.4009 2.87% MLCellLinOp::applyBC() 7148 0.2679 0.3036 0.3698 2.64% MLMG::addInterpCorrection() 768 0.06137 0.2946 0.3615 2.58% FabArray::setVal() 5013 0.3307 0.3363 0.345 2.47% MultiFab::Subtract() 159 0.3324 0.3358 0.3402 2.43% Gravity::fill_multipole_BCs() 19 0.1989 0.2426 0.2832 2.02% FabArray::FillBoundary() 6380 0.2088 0.2418 0.2721 1.95% MLMG::mgVcycle_up::2 128 0.01037 0.1128 0.2691 1.92% MLMG::mgVcycle_down::0 128 0.2608 0.2629 0.2653 1.90% Castro::expand_state() 20 0.178 0.2166 0.2512 1.80% FabArray::ParallelCopy_nowait() 1429 0.205 0.2186 0.2398 1.71% Castro::initData() 1 0.07673 0.1323 0.2358 1.69% Amr::bldFineLevels() 1 0.04909 0.1473 0.2158 1.54% MLMG::mgVcycle_up::0 128 0.1938 0.195 0.1958 1.40% MLCellLinOp::apply() 986 0.1462 0.1565 0.1914 1.37% FabArray::sum() 3439 0.1873 0.1889 0.1907 1.36% check_for_negative_density() 20 0.07 0.1305 0.1848 1.32% Amr::grid_places() 2 0.002259 0.1041 0.1732 1.24% MLMG::mgVcycle_up::3 128 0.01031 0.02287 0.1732 1.24% AmrMesh::MakeNewGrids() 2 0.00214 0.1041 0.1731 1.24% TagBoxArray::mapPRD 2 0.0007477 0.09906 0.1716 1.23% Castro::construct_new_source() 102 0.122 0.1251 0.1492 1.07% MLMG:computeResOfCorrection() 768 0.1123 0.1213 0.1447 1.03% MLCellLinOp::correctionResidual() 768 0.111 0.1199 0.1432 1.02% Castro::post_init() 1 0.1361 0.1418 0.1432 1.02% FillBoundary_nowait() 6380 0.08846 0.1132 0.1424 1.02% FillBoundary_finish() 6380 0.09433 0.1147 0.1363 0.97% MLMG::mgVcycle_down::1 128 0.1147 0.118 0.1211 0.87% MLPoisson::Fapply() 986 0.09332 0.09803 0.1133 0.81% Gravity::multilevel_solve_for_new_phi() 1 0.103 0.103 0.103 0.74% Gravity::actual_multilevel_solve() 1 0.1029 0.1029 0.1029 0.74% Castro::create_source_corrector() 17 0.04729 0.06755 0.1021 0.73% Castro::construct_new_gravity_source() 17 0.06857 0.07131 0.09588 0.69% MLCellLinOp::solutionResidual() 147 0.08614 0.09084 0.09527 0.68% Amr::writePlotFile() 2 0.09428 0.09438 0.09439 0.67% Castro::post_regrid() 2 0.08442 0.08586 0.0915 0.65% Castro::construct_old_gravity() 20 0.0401 0.06259 0.08871 0.63% Castro::construct_old_source() 120 0.07634 0.07684 0.07753 0.55% MLMG::computeResidual() 128 0.07437 0.07516 0.07653 0.55% FabArray::Saxpy() 264 0.06796 0.06898 0.07604 0.54% MLMG::mgVcycle_bottom 128 0.0003572 0.004724 0.07013 0.50% MLMG::mgVcycle_down::2 128 0.01221 0.0397 0.0701 0.50% MLMG::actualBottomSolve() 128 0.0001322 0.004495 0.06988 0.50% Castro::derive() 18 0.06768 0.06838 0.06928 0.50% AmrLevel::derive() 18 0.06764 0.06834 0.06923 0.49% MLCGSolver::bicgstab 8 0 0.004275 0.0684 0.49% Gravity::get_old_grav_vector() 20 0.03825 0.05743 0.06437 0.46% Castro::post_timestep() 1 0.05798 0.06066 0.06255 0.45% FabArray::Xpay() 945 0.05097 0.0535 0.06072 0.43% MLMG::mgVcycle_down::3 128 0.01156 0.01769 0.05877 0.42% amrex::average_down 768 0.03265 0.0389 0.05396 0.39% Castro::initialize_advance() 1 0.048 0.04887 0.051 0.36% Amr::regrid() 1 0.04339 0.04422 0.049 0.35% Castro::check_for_nan() 37 0.04467 0.04509 0.04562 0.33% MultiFab::contains_nan() 37 0.04456 0.04499 0.04551 0.33% Castro::construct_old_gravity_source() 20 0.04419 0.04449 0.04501 0.32% Gravity::get_new_grav_vector() 18 0.03437 0.03821 0.04305 0.31% MLPoisson::define() 19 0.02838 0.0326 0.03848 0.28% Castro::retry_advance_ctu() 11 0.03466 0.03562 0.03802 0.27% MLMG::mgVcycle_down::4 128 0.01148 0.01314 0.03421 0.24% StateDataPhysBCFunct::() 147 0.0006439 0.01782 0.0341 0.24% StateData::FillBoundary(geom) 143 0 0.01701 0.03322 0.24% Castro::apply_source_to_state() 37 0.02773 0.02796 0.02851 0.20% MLMG::mgVcycle_up::4 128 0.0104 0.01159 0.02654 0.19% MLCellLinOp::defineAuxData() 19 0.0182 0.01973 0.02367 0.17% TagBoxArray::collate() 2 0.0001309 0.00375 0.02336 0.17% MLMG::prepareForSolve() 18 0.01966 0.02052 0.02287 0.16% MLMG::mgVcycle_down::5 128 0.01145 0.01234 0.0225 0.16% VisMF::Write(FabArray) 4 0.01185 0.01293 0.02216 0.16% Castro::save_data_for_retry() 3 0.01859 0.01906 0.02092 0.15% Castro::sum_integrated_quantities() 2 0.02059 0.02077 0.02079 0.15% MLMG::computeMLResidual() 18 0.01066 0.01521 0.01933 0.14% MLMG::mgVcycle_up::5 128 0.01045 0.01118 0.01914 0.14% MLMG::ResNormInf() 146 0.01356 0.01589 0.01804 0.13% FabArray::norminf() 282 0.01072 0.01118 0.01522 0.11% Gravity::test_composite_phi() 1 0.01506 0.01509 0.0151 0.11% amrex::Add() 128 0.01418 0.01434 0.01459 0.10% Castro::problem_post_timestep() 2 0.009137 0.01231 0.01418 0.10% Castro::wd_update() 2 0.008852 0.01228 0.01416 0.10% FabArrayBase::getFB() 6380 0.01006 0.01085 0.01407 0.10% FabArrayBase::getCPC() 2005 0.009424 0.01067 0.01391 0.10% FabArray::setDomainBndry() 147 0.0004117 0.006302 0.01223 0.09% MLLinOp::define() 19 0.003864 0.007108 0.01119 0.08% MLLinOp::defineGrids() 19 0.003784 0.00703 0.01111 0.08% Amr::writeSmallPlotFile() 2 0.008823 0.008828 0.008831 0.06% Gravity::update_max_rhs() 2 0.00138 0.007052 0.0085 0.06% FabArray::mult() 59 0.007319 0.007511 0.00824 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005041 0.008066 0.06% MLLinOp::makeSubCommunicator() 19 0.00105 0.004189 0.007908 0.06% MLMG::getGradSolution() 18 0.007489 0.007688 0.007863 0.06% MLCellLinOp::compGrad() 18 0.007448 0.007647 0.007822 0.06% Castro::volWgtSum() 46 0.007317 0.00739 0.007482 0.05% MultiFab::max() 2 0.0001722 0.00585 0.007315 0.05% FabArrayBase::CPC::define() 576 0.002164 0.003283 0.006294 0.04% amrex::Dot() 142 0 0.0003783 0.006052 0.04% MLCellLinOp::defineBC() 19 0.005357 0.005628 0.005881 0.04% Castro::volInBoundary() 14 0.003415 0.003656 0.005377 0.04% BndryData::define() 19 0.003875 0.004108 0.004308 0.03% MLPoisson::normalize() 79 0 0.000193 0.003088 0.02% MLPoisson::prepareForSolve() 19 0.0017 0.001845 0.002146 0.02% MLCellLinOp::prepareForSolve() 19 0.001611 0.001764 0.002062 0.01% AmrLevel::AmrLevel(dm) 1 0.001344 0.001445 0.001834 0.01% StateData::define() 6 0.001311 0.001409 0.001781 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001291 0.001509 0.001778 0.01% FabArrayBase::FB::FB() 75 0.0002778 0.0006678 0.001426 0.01% MLMG::MLResNormInf() 18 0.001223 0.001237 0.001262 0.01% MLMG::compResidual() 1 0.00094 0.001094 0.001247 0.01% MLMG::MLRhsNormInf() 18 0.001185 0.001198 0.001219 0.01% Gravity::swapTimeLevels() 8 0.001123 0.001151 0.001204 0.01% Castro::locWgtSum() 6 0.00113 0.001137 0.001164 0.01% Castro::buildMetrics() 1 0.000626 0.0006963 0.001065 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009022 0.0009459 0.001037 0.01% MLCellLinOp::setLevelBC() 19 0.0005246 0.0006573 0.000819 0.01% makeSFC 95 0.0005818 0.0006121 0.0006924 0.00% Castro::errorEst() 2 0.0005183 0.000573 0.0006323 0.00% Castro::apply_tagging_restrictions() 2 0.0004178 0.0004727 0.0005278 0.00% Gravity::applyMetricTerms() 2 0.0004549 0.0004685 0.0004865 0.00% Castro::swap_state_time_levels() 8 0.0004283 0.000445 0.0004736 0.00% Castro::volProductSum() 2 0.0003903 0.0003929 0.0003986 0.00% Castro::enforce_consistent_e() 1 0.0003696 0.0003802 0.0003913 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001316 0.0003238 0.0003692 0.00% DistributionMapping::LeastUsedCPUs() 1 2.916e-05 0.0002415 0.0002903 0.00% Castro::finalize_advance() 1 0.000252 0.0002604 0.000277 0.00% DistributionMapping::Distribute() 95 0.0002057 0.0002185 0.0002344 0.00% Castro::finalize_do_advance() 17 0.0001642 0.0001827 0.0002223 0.00% OwnerMask() 2 0.0001349 0.0001496 0.0001652 0.00% Castro::enforce_speed_limit() 79 0.0001017 0.0001085 0.0001242 0.00% Amr::initSubcycle() 1 5.839e-05 6.607e-05 0.0001198 0.00% Castro::apply_problem_tags() 2 9.191e-05 9.398e-05 9.83e-05 0.00% knapsack() 1 5.531e-05 6.292e-05 8.372e-05 0.00% MultiFab::Swap() 5 6.414e-05 6.768e-05 8.363e-05 0.00% Castro::construct_old_rotation_source() 20 2.971e-05 3.087e-05 3.465e-05 0.00% Castro::computeInitialDt() 2 9.788e-06 1.189e-05 2.858e-05 0.00% Castro::construct_new_rotation_source() 17 2.053e-05 2.155e-05 2.538e-05 0.00% BoxList::parallelComplementIn() 4 1.319e-05 1.423e-05 2.481e-05 0.00% BoxList::complementIn 4 6.103e-06 6.967e-06 1.755e-05 0.00% Castro::estTimeStep() 10 1.146e-05 1.267e-05 1.418e-05 0.00% Castro::gwstrain() 2 4.165e-06 4.555e-06 6.425e-06 0.00% Castro::FluxRegCrseInit 1 1.741e-06 2.234e-06 6.346e-06 0.00% Gravity::set_mass_offset() 2 4.469e-06 4.688e-06 5.118e-06 0.00% Castro::FluxRegFineAdd() 1 1.458e-06 1.598e-06 1.805e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 12 B 14 B 17 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-34-g9e8f8d60eca3) finalized