Initializing AMReX (v2024-42-g7437aa17d36f)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (v2024-42-g7437aa17d36f) initialized Starting run at 10:17:12 UTC on 2024-03-28. Successfully read inputs file ... Castro git describe: 24.03-37-g6b90dd1c0 AMReX git describe: v2024-42-g7437aa17d Microphysics git describe: 24.03-23-g3112c13a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.156088125 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001052594 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.01062717 Gravity::multilevel_solve_for_new_phi() time = 0.103414266 Gravity::fill_multipole_BCs() time = 0.010635483 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.048150149 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004182579 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003242197 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065596644 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006823274 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.06444673 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004187166 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.061000603 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006074376 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060083613 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323047309 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015727032 Gravity::solve_for_phi() time = 0.087311098 on level 0 Castro::construct_new_gravity() time = 0.089374079 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.06051706 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.00325379 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.06196766 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324181033 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015608849 Gravity::solve_for_phi() time = 0.0870982 on level 0 Castro::construct_new_gravity() time = 0.089157622 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.060422233 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002694106 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058659273 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326849335 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015463142 Gravity::solve_for_phi() time = 0.089266352 on level 0 Castro::construct_new_gravity() time = 0.092115975 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.059341804 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002728126 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059009621 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335252757 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01719803 Gravity::solve_for_phi() time = 0.087381198 on level 0 Castro::construct_new_gravity() time = 0.089501979 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.059760649 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002734979 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058837668 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336921148 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015971662 Gravity::solve_for_phi() time = 0.090208719 on level 0 Castro::construct_new_gravity() time = 0.092271101 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.06004459 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.00273797 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059255501 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330990041 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015439117 Gravity::solve_for_phi() time = 0.085781085 on level 0 Castro::construct_new_gravity() time = 0.087832124 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.059995476 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002727595 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058448622 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333666895 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015732072 Gravity::solve_for_phi() time = 0.086438024 on level 0 Castro::construct_new_gravity() time = 0.088505141 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.062565046 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002730842 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059031718 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33067062 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015761112 Gravity::solve_for_phi() time = 0.08633602 on level 0 Castro::construct_new_gravity() time = 0.088446932 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.059905217 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002749583 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.05840267 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335597891 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016574294 Gravity::solve_for_phi() time = 0.087689451 on level 0 Castro::construct_new_gravity() time = 0.089749556 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059939538 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002717378 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058984292 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330954575 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015873486 Gravity::solve_for_phi() time = 0.086648453 on level 0 Castro::construct_new_gravity() time = 0.088789204 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.05990814 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002719531 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059171466 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32753822 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014460437 Gravity::solve_for_phi() time = 0.084077477 on level 0 Castro::construct_new_gravity() time = 0.086230056 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.058707567 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002519984 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058377576 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323177203 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014942166 Gravity::solve_for_phi() time = 0.086069387 on level 0 Castro::construct_new_gravity() time = 0.088239481 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059078787 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002885427 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058453258 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333864821 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016519468 Gravity::solve_for_phi() time = 0.090848953 on level 0 Castro::construct_new_gravity() time = 0.093090571 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.062188265 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002965369 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.060440117 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3374582 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015275549 Gravity::solve_for_phi() time = 0.086076688 on level 0 Castro::construct_new_gravity() time = 0.088237547 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059100098 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002840922 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058354045 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330259216 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014932432 Gravity::solve_for_phi() time = 0.084448939 on level 0 Castro::construct_new_gravity() time = 0.086600525 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059125295 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002775979 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058034456 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325215947 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015854028 Gravity::solve_for_phi() time = 0.087245642 on level 0 Castro::construct_new_gravity() time = 0.089397967 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059085716 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002916672 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058380818 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329768226 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015108096 Gravity::solve_for_phi() time = 0.085485917 on level 0 Castro::construct_new_gravity() time = 0.087626679 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059316359 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002777737875 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.85539833 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.047059656 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004180759 seconds Ending run at 10:17:27 UTC on 2024-03-28. Run time = 14.12808516 Run time without initialization = 11.90747434 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.13 ... 14.13 ... 14.13 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3872 5.4693 5.5529 39.30% Amr::InitAmr() 1 1.337 1.337 1.338 9.47% Castro::computeTemp() 80 0.8408 0.9462 1.092 7.73% amrex::Copy() 724 0.7905 0.8008 0.8101 5.73% FabArray::ParallelCopy_finish() 1429 0.05524 0.4884 0.6754 4.78% Castro::normalize_species() 79 0.5464 0.555 0.5835 4.13% MultiFab::AddProduct() 3439 0.5493 0.5565 0.5629 3.98% Castro::reset_internal_energy(Fab) 160 0.5119 0.5206 0.5264 3.73% MLPoisson::Fsmooth() 6144 0.3119 0.3397 0.4142 2.93% Castro::initMFs() 1 0.3581 0.3626 0.3927 2.78% FabArray::setVal() 5013 0.3449 0.3517 0.3607 2.55% MultiFab::Subtract() 159 0.349 0.3529 0.3569 2.53% Gravity::fill_multipole_BCs() 19 0.1976 0.2427 0.2805 1.99% check_for_negative_density() 20 0.0587 0.154 0.2267 1.60% FabArray::ParallelCopy_nowait() 1429 0.1832 0.2007 0.2219 1.57% Castro::reset_internal_energy(MultiFab) 80 0.02286 0.06367 0.2217 1.57% FabArray::sum() 3439 0.1837 0.1862 0.1886 1.34% Castro::initData() 1 0.003288 0.02577 0.1522 1.08% FillBoundary_finish() 6380 0.1083 0.1264 0.1451 1.03% FillBoundary_nowait() 6380 0.07582 0.1032 0.1322 0.94% MLPoisson::Fapply() 986 0.09502 0.1003 0.1181 0.84% MLCellLinOp::applyBC() 7148 0.04699 0.06293 0.1056 0.75% FabArray::Saxpy() 264 0.07103 0.07241 0.08031 0.57% Castro::construct_new_gravity_source() 17 0.06876 0.06969 0.07088 0.50% FabArray::Xpay() 945 0.0516 0.0544 0.06218 0.44% Castro::enforce_min_density() 79 0.01758 0.02903 0.06147 0.44% Castro::do_new_sources() 17 0.0003963 0.01088 0.05804 0.41% Castro::construct_old_gravity_source() 20 0.04545 0.04614 0.04686 0.33% MultiFab::contains_nan() 37 0.04466 0.04528 0.04627 0.33% MLMG::addInterpCorrection() 768 0.03192 0.03449 0.0415 0.29% AmrLevel::derive() 18 0.03986 0.0404 0.0411 0.29% Castro::do_old_sources() 20 0.0005101 0.009218 0.03854 0.27% amrex::average_down 768 0.025 0.02727 0.03333 0.24% StateData::FillBoundary(geom) 143 0 0.01708 0.03306 0.23% VisMF::Write(FabArray) 4 0.01194 0.01291 0.02244 0.16% MLCellLinOp::defineAuxData() 19 0.01423 0.01497 0.01708 0.12% FabArray::FillBoundary() 6380 0.01342 0.01402 0.01699 0.12% Amr::writePlotFile() 2 0.007497 0.01571 0.01688 0.12% MLCGSolver::bicgstab 8 0 0.001014 0.01622 0.11% Castro::construct_new_source() 102 0.01571 0.01587 0.01605 0.11% FabArray::norminf() 282 0.01063 0.0111 0.01541 0.11% amrex::Add() 128 0.01406 0.0143 0.01453 0.10% MLMG::ResNormInf() 146 0.007303 0.009624 0.01361 0.10% Castro::evaluate_source_change() 196 0.01237 0.01261 0.01302 0.09% FabArrayBase::getFB() 6380 0.009845 0.01033 0.01293 0.09% FillPatchIterator::Initialize 147 0.01235 0.01251 0.01273 0.09% MLCellLinOp::smooth() 3072 0.01088 0.01147 0.01249 0.09% FabArray::setDomainBndry() 147 0.0004368 0.006209 0.0118 0.08% Castro::wd_update() 2 0.00622 0.008408 0.01067 0.08% MLMG::prepareForSolve() 18 0.009718 0.009982 0.01052 0.07% Castro::construct_old_source() 120 0.009902 0.01007 0.0102 0.07% Castro::construct_old_gravity() 20 0.000392 0.002879 0.008886 0.06% FabArray::mult() 59 0.007469 0.007654 0.008158 0.06% MLLinOp::makeSubCommunicator() 19 0.0006759 0.004409 0.008084 0.06% Gravity::actual_solve_with_mlmg() 19 0.006576 0.006897 0.007795 0.06% FabArrayBase::getCPC() 2005 0.007244 0.00747 0.007785 0.06% Castro::volWgtSum() 46 0.007322 0.007436 0.007542 0.05% MultiFab::max() 2 0.0001763 0.004195 0.007493 0.05% FabArrayBase::CPC::define() 576 0.002174 0.003349 0.006673 0.05% Gravity::get_old_grav_vector() 20 0.006399 0.006503 0.006615 0.05% Gravity::get_new_grav_vector() 18 0.005941 0.006124 0.006505 0.05% MLCellLinOp::compGrad() 18 0.005734 0.00587 0.006351 0.04% MLMG::solve() 18 0.0009283 0.003171 0.006196 0.04% amrex::Dot() 142 0 0.0003805 0.006087 0.04% Amr::writeSmallPlotFile() 2 0.003653 0.005318 0.005623 0.04% Castro::volInBoundary() 14 0.003385 0.003673 0.005519 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003078 0.004925 0.03% MLCellLinOp::apply() 986 0.001988 0.002234 0.004786 0.03% Castro::initialize_do_advance() 20 0.004383 0.004531 0.004699 0.03% FabArray::ParallelCopy() 1429 0.00354 0.003706 0.003963 0.03% BndryData::define() 19 0.003047 0.00313 0.003311 0.02% MLPoisson::normalize() 79 0 0.0002037 0.003259 0.02% Castro::sum_integrated_quantities() 2 0.001633 0.002383 0.002708 0.02% Castro::construct_new_gravity() 17 0.0002991 0.0007981 0.002507 0.02% AmrLevel::FillPatch() 147 0.00209 0.002204 0.002481 0.02% MLLinOp::defineGrids() 19 0.001764 0.001914 0.002255 0.02% MLCellLinOp::prepareForSolve() 19 0.001611 0.001768 0.002087 0.01% MLCellLinOp::correctionResidual() 768 0.00184 0.00191 0.002029 0.01% MLMG::mgVcycle() 128 0.00154 0.001633 0.001827 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001273 0.001541 0.001808 0.01% MLCellLinOp::defineBC() 19 0.001467 0.00152 0.001638 0.01% MLMG:computeResOfCorrection() 768 0.001394 0.001462 0.001573 0.01% FabArrayBase::FB::FB() 75 0.0002796 0.00068 0.001448 0.01% Gravity::solve_for_phi() 17 0.0008097 0.0009835 0.001424 0.01% StateData::define() 6 0.001334 0.001371 0.001391 0.01% Castro::save_data_for_retry() 3 0.00124 0.00127 0.001304 0.01% main() 1 0.0009605 0.001148 0.001287 0.01% Castro::locWgtSum() 6 0.001126 0.001147 0.001197 0.01% MLMG::actualBottomSolve() 128 0.0001349 0.0001985 0.00107 0.01% TagBoxArray::collate() 2 0.000115 0.000512 0.001032 0.01% StateDataPhysBCFunct::() 147 0.0006661 0.0008059 0.0008882 0.01% MLCellLinOp::setLevelBC() 19 0.0005211 0.0006599 0.0008355 0.01% MLMG::mgVcycle_down::4 128 0.0005572 0.0006 0.000824 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006937 0.000725 0.0007572 0.01% Castro::subcycle_advance_ctu() 1 0.0001849 0.0002373 0.0007501 0.01% MLMG::mgVcycle_down::3 128 0.0005763 0.0006252 0.0007385 0.01% MLMG::mgVcycle_down::2 128 0.0006086 0.0006667 0.0007312 0.01% MLMG::mgVcycle_down::0 128 0.0006544 0.0006702 0.0007108 0.01% MLMG::mgVcycle_down::1 128 0.0006456 0.0006667 0.0007006 0.00% MLMG::mgVcycle_down::5 128 0.0005772 0.0006054 0.0006931 0.00% Castro::Castro() 1 0.0005017 0.0005577 0.0006352 0.00% Castro::buildMetrics() 1 0.0005741 0.0005919 0.0006047 0.00% Castro::apply_tagging_restrictions() 2 0.0004074 0.0004806 0.0005534 0.00% AmrMesh::MakeNewGrids() 2 0.0004924 0.0005153 0.0005502 0.00% Castro::clean_state() 79 0.0004609 0.0004758 0.0005218 0.00% Castro::problem_post_timestep() 2 1.192e-05 4.555e-05 0.0005159 0.00% MLCellLinOp::solutionResidual() 147 0.000437 0.0004584 0.0005098 0.00% FillPatchSingleLevel 147 0.0004699 0.000482 0.0005083 0.00% MLMG::mgVcycle_up::0 128 0.0004633 0.0004815 0.0005066 0.00% MLMG::mgVcycle_up::1 128 0.0004423 0.0004721 0.000499 0.00% Gravity::applyMetricTerms() 2 0.0004686 0.0004798 0.0004891 0.00% MLMG::mgVcycle_up::2 128 0.0003811 0.0004231 0.0004793 0.00% MLMG::mgVcycle_up::5 128 0.0003928 0.0004081 0.0004705 0.00% Castro::do_advance_ctu() 20 0.0004017 0.0004239 0.0004539 0.00% MLMG::mgVcycle_up::3 128 0.0003766 0.0003968 0.0004532 0.00% makeSFC 95 0.0003604 0.0003849 0.0004397 0.00% MLMG::mgVcycle_up::4 128 0.0003824 0.0003971 0.0004329 0.00% Castro::swap_state_time_levels() 8 0.0004109 0.0004219 0.0004322 0.00% MLMG::oneIter() 128 0.0003834 0.0004002 0.0004316 0.00% Castro::volProductSum() 2 0.0003922 0.0003972 0.0004171 0.00% Castro::enforce_consistent_e() 1 0.0003644 0.0003745 0.0003839 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003226 0.0003429 0.0003657 0.00% Gravity::solve_phi_with_mlmg() 19 0.000214 0.000236 0.0002648 0.00% MLMG::computeResidual() 128 0.0002403 0.0002469 0.0002564 0.00% MLMG::mgVcycle_bottom 128 0.0002314 0.0002403 0.0002539 0.00% DistributionMapping::Distribute() 95 0.0002087 0.0002185 0.0002344 0.00% Amr::coarseTimeStep() 1 0.0001207 0.0001741 0.0002075 0.00% Castro::finalize_do_advance() 17 0.0001587 0.0001697 0.0001814 0.00% Gravity::update_max_rhs() 2 0.0001559 0.0001625 0.0001736 0.00% OwnerMask() 2 0.0001351 0.0001508 0.0001642 0.00% MLMG::compResidual() 1 0.0001546 0.0001571 0.0001593 0.00% MLPoisson::define() 19 0.0001299 0.0001392 0.0001528 0.00% Amr::defBaseLevel() 1 0.0001075 0.0001147 0.0001388 0.00% Castro::retry_advance_ctu() 11 5.329e-05 6.337e-05 0.0001346 0.00% Castro::initialize_advance() 1 0.0001072 0.0001141 0.0001335 0.00% Castro::enforce_speed_limit() 79 0.0001093 0.0001149 0.0001319 0.00% Castro::check_for_nan() 37 0.0001061 0.0001155 0.0001316 0.00% Amr::grid_places() 2 7.962e-05 9.876e-05 0.0001258 0.00% TagBoxArray::mapPRD 2 0.0001083 0.0001159 0.0001244 0.00% Gravity::test_composite_phi() 1 9.136e-05 9.81e-05 0.0001123 0.00% Castro::apply_source_to_state() 37 9.666e-05 0.0001033 0.000112 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.885e-05 6.948e-05 0.0001058 0.00% Castro::apply_problem_tags() 2 9.207e-05 9.391e-05 9.646e-05 0.00% MLPoisson::prepareForSolve() 19 7.53e-05 8.115e-05 8.869e-05 0.00% Castro::create_source_corrector() 17 5.497e-05 6.22e-05 8.757e-05 0.00% MLLinOp::define() 19 7.515e-05 7.978e-05 8.551e-05 0.00% MultiFab::Swap() 5 6.532e-05 7.072e-05 8.516e-05 0.00% knapsack() 1 5.728e-05 6.258e-05 7.693e-05 0.00% Castro::expand_state() 20 5.252e-05 5.557e-05 6.012e-05 0.00% Amr::initSubcycle() 1 5.552e-05 5.797e-05 5.867e-05 0.00% Amr::FinalizeInit() 1 1.07e-05 1.887e-05 5.858e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 3.317e-05 4.24e-05 5.21e-05 0.00% Castro::derive() 18 4.149e-05 4.353e-05 4.945e-05 0.00% MLMG::computeMLResidual() 18 4.014e-05 4.274e-05 4.63e-05 0.00% Gravity::swapTimeLevels() 8 3.265e-05 3.616e-05 4.629e-05 0.00% MLMG::getGradSolution() 18 3.967e-05 4.15e-05 4.377e-05 0.00% MLMG::MLResNormInf() 18 3.254e-05 3.505e-05 4.028e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.638e-05 2.19e-05 3.585e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.03e-05 3.199e-05 3.468e-05 0.00% Castro::construct_old_rotation_source() 20 2.937e-05 3.05e-05 3.259e-05 0.00% MLMG::MLRhsNormInf() 18 3.085e-05 3.136e-05 3.204e-05 0.00% Amr::regrid() 1 1.039e-05 1.234e-05 3.08e-05 0.00% Gravity::actual_multilevel_solve() 1 2.655e-05 2.766e-05 2.919e-05 0.00% Castro::construct_new_rotation_source() 17 2.109e-05 2.215e-05 2.481e-05 0.00% Amr::timeStep() 1 1.136e-05 1.593e-05 2.326e-05 0.00% Castro::finalize_advance() 1 1.681e-05 1.83e-05 2.311e-05 0.00% Castro::post_init() 1 1.173e-05 1.278e-05 1.448e-05 0.00% Castro::post_regrid() 2 1.038e-05 1.163e-05 1.392e-05 0.00% Castro::estTimeStep() 10 1.228e-05 1.292e-05 1.381e-05 0.00% Castro::advance() 1 7.236e-06 8.666e-06 1.301e-05 0.00% Amr::InitializeInit() 1 7.23e-06 8.379e-06 1.263e-05 0.00% Amr::init() 1 5.662e-06 7.187e-06 1.216e-05 0.00% BoxList::parallelComplementIn() 4 6.963e-06 7.655e-06 1.182e-05 0.00% Castro::computeInitialDt() 2 6.623e-06 7.453e-06 9.922e-06 0.00% Amr::bldFineLevels() 1 6.651e-06 8.086e-06 9.847e-06 0.00% BoxList::complementIn 4 5.773e-06 6.22e-06 8.577e-06 0.00% Gravity::set_mass_offset() 2 4.469e-06 5.535e-06 7.834e-06 0.00% Castro::post_timestep() 1 5.746e-06 6.301e-06 7.087e-06 0.00% Castro::errorEst() 2 5.872e-06 6.31e-06 6.736e-06 0.00% Castro::gwstrain() 2 4.312e-06 4.736e-06 6.52e-06 0.00% Amr::initialInit() 1 2.859e-06 3.154e-06 3.455e-06 0.00% Castro::FluxRegFineAdd() 1 1.385e-06 1.573e-06 2.227e-06 0.00% Castro::FluxRegCrseInit 1 1.708e-06 1.907e-06 2.204e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.13 14.13 14.13 100.00% Amr::coarseTimeStep() 1 11.91 11.91 11.91 84.28% Amr::timeStep() 1 11.86 11.86 11.86 83.91% Castro::advance() 1 11.79 11.79 11.8 83.50% Castro::subcycle_advance_ctu() 1 11.74 11.74 11.75 83.15% Castro::do_advance_ctu() 20 11.7 11.71 11.71 82.89% Castro::construct_ctu_hydro_source() 20 6.37 6.404 6.441 45.59% Castro::clean_state() 79 3.72 3.806 3.951 27.97% Castro::computeTemp() 80 2.384 2.495 2.688 19.02% Castro::reset_internal_energy(MultiFab) 80 1.49 1.549 1.689 11.95% Gravity::solve_phi_with_mlmg() 19 1.498 1.546 1.588 11.24% Castro::construct_new_gravity() 17 1.424 1.469 1.51 10.68% Gravity::solve_for_phi() 17 1.385 1.432 1.474 10.43% Castro::initialize_do_advance() 20 1.379 1.407 1.437 10.17% Amr::InitAmr() 1 1.337 1.337 1.338 9.47% Gravity::actual_solve_with_mlmg() 19 1.296 1.3 1.305 9.24% MLMG::solve() 18 1.246 1.25 1.252 8.86% Castro::do_old_sources() 20 1.154 1.177 1.191 8.43% MLMG::oneIter() 128 1.111 1.112 1.114 7.89% MLMG::mgVcycle() 128 1.096 1.098 1.1 7.78% Castro::do_new_sources() 17 0.9462 0.9809 1.019 7.21% Castro::evaluate_source_change() 196 0.9417 0.9537 0.9642 6.82% FabArray::ParallelCopy() 1429 0.2827 0.7128 0.9036 6.40% Amr::init() 1 0.8825 0.8825 0.8825 6.25% Castro::enforce_min_density() 79 0.7912 0.8118 0.8371 5.92% Amr::initialInit() 1 0.8293 0.8293 0.8294 5.87% amrex::Copy() 724 0.7905 0.8008 0.8101 5.73% MLCellLinOp::smooth() 3072 0.5578 0.606 0.7326 5.19% FabArray::ParallelCopy_finish() 1429 0.05524 0.4884 0.6754 4.78% AmrLevel::FillPatch() 147 0.4818 0.5567 0.6118 4.33% Amr::InitializeInit() 1 0.4428 0.5008 0.5974 4.23% Amr::defBaseLevel() 1 0.4428 0.5008 0.5974 4.23% Castro::normalize_species() 79 0.5464 0.555 0.5835 4.13% MultiFab::AddProduct() 3439 0.5493 0.5565 0.5629 3.98% Castro::reset_internal_energy(Fab) 160 0.5119 0.5206 0.5264 3.73% FillPatchIterator::Initialize 147 0.2984 0.3754 0.431 3.05% MLMG::mgVcycle_up::1 128 0.09837 0.2608 0.4248 3.01% MLPoisson::Fsmooth() 6144 0.3119 0.3397 0.4142 2.93% FillPatchIterator::FillFromLevel0() 147 0.2742 0.3567 0.414 2.93% FillPatchSingleLevel 147 0.2734 0.356 0.4132 2.92% Castro::Castro() 1 0.364 0.3685 0.3999 2.83% Castro::initMFs() 1 0.3582 0.3627 0.3928 2.78% Amr::FinalizeInit() 1 0.2321 0.3285 0.3866 2.74% MLCellLinOp::applyBC() 7148 0.2856 0.3175 0.3836 2.72% MLMG::addInterpCorrection() 768 0.06155 0.3 0.3698 2.62% FabArray::setVal() 5013 0.3449 0.3517 0.3607 2.55% MultiFab::Subtract() 159 0.349 0.3529 0.3569 2.53% FabArray::FillBoundary() 6380 0.2316 0.2546 0.286 2.02% Gravity::fill_multipole_BCs() 19 0.1998 0.2449 0.2826 2.00% MLMG::mgVcycle_up::2 128 0.01054 0.1147 0.2745 1.94% MLMG::mgVcycle_down::0 128 0.2627 0.267 0.2693 1.91% FabArray::ParallelCopy_nowait() 1429 0.2024 0.2207 0.2428 1.72% Castro::expand_state() 20 0.1817 0.2083 0.2341 1.66% Castro::initData() 1 0.07712 0.1306 0.2299 1.63% check_for_negative_density() 20 0.0587 0.154 0.2267 1.60% Amr::bldFineLevels() 1 0.04698 0.1431 0.1997 1.41% MLCellLinOp::apply() 986 0.1523 0.1634 0.1991 1.41% MLMG::mgVcycle_up::0 128 0.1949 0.1964 0.1977 1.40% FabArray::sum() 3439 0.1837 0.1862 0.1886 1.34% MLMG::mgVcycle_up::3 128 0.01049 0.02332 0.1768 1.25% Amr::grid_places() 2 0.002584 0.0991 0.1572 1.11% AmrMesh::MakeNewGrids() 2 0.002458 0.099 0.1571 1.11% TagBoxArray::mapPRD 2 0.0008433 0.09722 0.1557 1.10% MLMG:computeResOfCorrection() 768 0.1153 0.126 0.1499 1.06% MLCellLinOp::correctionResidual() 768 0.1139 0.1245 0.1483 1.05% FillBoundary_finish() 6380 0.1083 0.1264 0.1451 1.03% Castro::post_init() 1 0.1378 0.1413 0.1446 1.02% FillBoundary_nowait() 6380 0.08594 0.1142 0.1438 1.02% Castro::construct_new_source() 102 0.1244 0.1258 0.1274 0.90% MLMG::mgVcycle_down::1 128 0.1177 0.1212 0.1264 0.89% MLPoisson::Fapply() 986 0.09502 0.1003 0.1181 0.84% Gravity::multilevel_solve_for_new_phi() 1 0.1033 0.1034 0.1034 0.73% Gravity::actual_multilevel_solve() 1 0.1033 0.1033 0.1034 0.73% MLCellLinOp::solutionResidual() 147 0.08986 0.09402 0.09883 0.70% Amr::writePlotFile() 2 0.09577 0.09584 0.09585 0.68% Castro::create_source_corrector() 17 0.04865 0.06097 0.09191 0.65% Castro::post_regrid() 2 0.08479 0.08803 0.09153 0.65% Castro::construct_old_source() 120 0.07868 0.07987 0.08076 0.57% FabArray::Saxpy() 264 0.07103 0.07241 0.08031 0.57% MLMG::computeResidual() 128 0.07621 0.07811 0.079 0.56% MLMG::mgVcycle_bottom 128 0.0003698 0.00484 0.07173 0.51% MLMG::actualBottomSolve() 128 0.0001349 0.004599 0.07148 0.51% MLMG::mgVcycle_down::2 128 0.0124 0.04047 0.07104 0.50% Castro::construct_new_gravity_source() 17 0.06876 0.06969 0.07088 0.50% Castro::derive() 18 0.06881 0.06958 0.07032 0.50% AmrLevel::derive() 18 0.06877 0.06954 0.07027 0.50% MLCGSolver::bicgstab 8 0 0.004371 0.06994 0.50% Castro::post_timestep() 1 0.05842 0.06064 0.06292 0.45% FabArray::Xpay() 945 0.0516 0.0544 0.06218 0.44% Castro::construct_old_gravity() 20 0.04338 0.0545 0.06202 0.44% Gravity::get_old_grav_vector() 20 0.04017 0.05162 0.06156 0.44% MLMG::mgVcycle_down::3 128 0.01173 0.01805 0.05998 0.42% amrex::average_down 768 0.03334 0.04002 0.05621 0.40% Castro::initialize_advance() 1 0.04849 0.04986 0.05148 0.36% Castro::construct_old_gravity_source() 20 0.04545 0.04614 0.04686 0.33% Amr::regrid() 1 0.04355 0.04504 0.04657 0.33% Castro::check_for_nan() 37 0.04478 0.04539 0.0464 0.33% MultiFab::contains_nan() 37 0.04466 0.04528 0.04627 0.33% Castro::retry_advance_ctu() 11 0.03546 0.03649 0.03905 0.28% MLPoisson::define() 19 0.02836 0.03296 0.03892 0.28% Gravity::get_new_grav_vector() 18 0.03512 0.03685 0.03821 0.27% MLMG::mgVcycle_down::4 128 0.01172 0.01349 0.03502 0.25% StateDataPhysBCFunct::() 147 0.0006661 0.01789 0.03393 0.24% StateData::FillBoundary(geom) 143 0 0.01708 0.03306 0.23% Castro::apply_source_to_state() 37 0.02895 0.02931 0.02971 0.21% MLMG::mgVcycle_up::4 128 0.01056 0.01182 0.02701 0.19% MLCellLinOp::defineAuxData() 19 0.01827 0.01977 0.02377 0.17% MLMG::prepareForSolve() 18 0.01991 0.02086 0.0232 0.16% MLMG::mgVcycle_down::5 128 0.01174 0.01269 0.0231 0.16% MLMG::ResNormInf() 146 0.01683 0.0191 0.02297 0.16% VisMF::Write(FabArray) 4 0.01194 0.01291 0.02244 0.16% Castro::sum_integrated_quantities() 2 0.02139 0.02176 0.02182 0.15% Castro::save_data_for_retry() 3 0.01883 0.01945 0.02177 0.15% MLMG::computeMLResidual() 18 0.01102 0.01545 0.01966 0.14% MLMG::mgVcycle_up::5 128 0.01069 0.01144 0.01951 0.14% FabArray::norminf() 282 0.01063 0.0111 0.01541 0.11% amrex::Add() 128 0.01406 0.0143 0.01453 0.10% FabArrayBase::getFB() 6380 0.01012 0.01101 0.01438 0.10% FabArrayBase::getCPC() 2005 0.009486 0.01082 0.01437 0.10% Gravity::test_composite_phi() 1 0.01405 0.01411 0.01415 0.10% Castro::problem_post_timestep() 2 0.0097 0.01213 0.01413 0.10% Castro::wd_update() 2 0.009686 0.01208 0.01412 0.10% FabArray::setDomainBndry() 147 0.0004368 0.006209 0.0118 0.08% MLLinOp::define() 19 0.00356 0.007349 0.01143 0.08% MLLinOp::defineGrids() 19 0.003477 0.007269 0.01135 0.08% Amr::writeSmallPlotFile() 2 0.008743 0.008747 0.008753 0.06% Gravity::update_max_rhs() 2 0.001964 0.005466 0.008717 0.06% MLMG::getGradSolution() 18 0.007403 0.007703 0.008353 0.06% MLCellLinOp::compGrad() 18 0.007361 0.007662 0.008313 0.06% MLCGSolver::ParallelAllReduce 227 0 0.000514 0.008224 0.06% FabArray::mult() 59 0.007469 0.007654 0.008158 0.06% MLLinOp::makeSubCommunicator() 19 0.0006759 0.004409 0.008084 0.06% Castro::volWgtSum() 46 0.007322 0.007436 0.007542 0.05% MultiFab::max() 2 0.0001763 0.004195 0.007493 0.05% FabArrayBase::CPC::define() 576 0.002174 0.003349 0.006673 0.05% amrex::Dot() 142 0 0.0003805 0.006087 0.04% MLCellLinOp::defineBC() 19 0.005523 0.005705 0.005988 0.04% Castro::volInBoundary() 14 0.003385 0.003673 0.005519 0.04% BndryData::define() 19 0.003992 0.004185 0.004439 0.03% MLPoisson::normalize() 79 0 0.0002037 0.003259 0.02% MLPoisson::prepareForSolve() 19 0.001695 0.001849 0.002169 0.02% MLCellLinOp::prepareForSolve() 19 0.001611 0.001768 0.002087 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001273 0.001541 0.001808 0.01% FabArrayBase::FB::FB() 75 0.0002796 0.00068 0.001448 0.01% AmrLevel::AmrLevel(dm) 1 0.001364 0.001403 0.001425 0.01% StateData::define() 6 0.001334 0.001371 0.001391 0.01% MLMG::compResidual() 1 0.0009853 0.001122 0.001273 0.01% MLMG::MLResNormInf() 18 0.001203 0.001225 0.001254 0.01% MLMG::MLRhsNormInf() 18 0.001164 0.001191 0.00124 0.01% Gravity::swapTimeLevels() 8 0.001186 0.00121 0.001236 0.01% Castro::locWgtSum() 6 0.001126 0.001147 0.001197 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0008952 0.0009463 0.00104 0.01% TagBoxArray::collate() 2 0.000115 0.000512 0.001032 0.01% MLCellLinOp::setLevelBC() 19 0.0005211 0.0006599 0.0008355 0.01% makeSFC 95 0.0005726 0.0006034 0.0006741 0.00% Castro::buildMetrics() 1 0.0006329 0.000652 0.0006661 0.00% Castro::errorEst() 2 0.0005059 0.0005808 0.0006554 0.00% Castro::apply_tagging_restrictions() 2 0.0004074 0.0004806 0.0005534 0.00% Gravity::applyMetricTerms() 2 0.0004686 0.0004798 0.0004891 0.00% Castro::swap_state_time_levels() 8 0.0004109 0.0004219 0.0004322 0.00% Castro::volProductSum() 2 0.0003922 0.0003972 0.0004171 0.00% Castro::enforce_consistent_e() 1 0.0003644 0.0003745 0.0003839 0.00% Castro::finalize_advance() 1 0.0002549 0.000267 0.000299 0.00% DistributionMapping::Distribute() 95 0.0002087 0.0002185 0.0002344 0.00% Castro::finalize_do_advance() 17 0.0001679 0.0001795 0.000191 0.00% OwnerMask() 2 0.0001351 0.0001508 0.0001642 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001135 0.0001269 0.0001449 0.00% Castro::enforce_speed_limit() 79 0.0001093 0.0001149 0.0001319 0.00% Castro::apply_problem_tags() 2 9.207e-05 9.391e-05 9.646e-05 0.00% MultiFab::Swap() 5 6.532e-05 7.072e-05 8.516e-05 0.00% knapsack() 1 5.728e-05 6.258e-05 7.693e-05 0.00% Amr::initSubcycle() 1 5.552e-05 5.797e-05 5.867e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 3.317e-05 4.24e-05 5.21e-05 0.00% Castro::construct_old_rotation_source() 20 2.937e-05 3.05e-05 3.259e-05 0.00% Castro::construct_new_rotation_source() 17 2.109e-05 2.215e-05 2.481e-05 0.00% BoxList::parallelComplementIn() 4 1.275e-05 1.388e-05 2.04e-05 0.00% Castro::computeInitialDt() 2 9.498e-06 1.055e-05 1.44e-05 0.00% Castro::estTimeStep() 10 1.228e-05 1.292e-05 1.381e-05 0.00% BoxList::complementIn 4 5.773e-06 6.22e-06 8.577e-06 0.00% Gravity::set_mass_offset() 2 4.469e-06 5.535e-06 7.834e-06 0.00% Castro::gwstrain() 2 4.312e-06 4.736e-06 6.52e-06 0.00% Castro::FluxRegFineAdd() 1 1.385e-06 1.573e-06 2.227e-06 0.00% Castro::FluxRegCrseInit 1 1.708e-06 1.907e-06 2.204e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 14 B 17 B 21 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-42-g7437aa17d36f) finalized