Initializing AMReX (v2024-42-g7437aa17d36f)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (v2024-42-g7437aa17d36f) initialized Starting run at 07:10:22 UTC on 2024-03-29. Successfully read inputs file ... Castro git describe: 24.03-37-g6b90dd1c0 AMReX git describe: v2024-42-g7437aa17d Microphysics git describe: 24.03-23-g3112c13a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.166330857 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001040832 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010492732 Gravity::multilevel_solve_for_new_phi() time = 0.104471688 Gravity::fill_multipole_BCs() time = 0.01063849 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049246407 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.007199305 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003930073 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065240891 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005568424 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.06429827 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.00571969 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060772412 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005337383 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059704343 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324661799 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015581756 Gravity::solve_for_phi() time = 0.090623513 on level 0 Castro::construct_new_gravity() time = 0.092790864 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.06059196 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.00267839 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059724292 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32398718 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01550169 Gravity::solve_for_phi() time = 0.089431492 on level 0 Castro::construct_new_gravity() time = 0.091515927 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.060729646 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.003594471 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059849933 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330506279 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015326026 Gravity::solve_for_phi() time = 0.085438133 on level 0 Castro::construct_new_gravity() time = 0.087509997 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.063341817 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003005451 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059753174 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335048308 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01587623 Gravity::solve_for_phi() time = 0.088976265 on level 0 Castro::construct_new_gravity() time = 0.091082456 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.061219998 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003426287 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059314267 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336522232 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015037851 Gravity::solve_for_phi() time = 0.087613624 on level 0 Castro::construct_new_gravity() time = 0.089724238 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060262791 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002825969 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059242468 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331829053 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014924557 Gravity::solve_for_phi() time = 0.089202622 on level 0 Castro::construct_new_gravity() time = 0.091279563 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.060252866 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00395223 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059927152 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.344308675 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.020650647 Gravity::solve_for_phi() time = 0.093991082 on level 0 Castro::construct_new_gravity() time = 0.096961848 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059128774 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002867744 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059157715 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333523947 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016002656 Gravity::solve_for_phi() time = 0.089043551 on level 0 Castro::construct_new_gravity() time = 0.092128168 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.06047 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002668527 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058717469 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338243775 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015808098 Gravity::solve_for_phi() time = 0.087964254 on level 0 Castro::construct_new_gravity() time = 0.090102727 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.060063628 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003909816 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059550857 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335555521 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01591376 Gravity::solve_for_phi() time = 0.086601433 on level 0 Castro::construct_new_gravity() time = 0.088684358 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.060328208 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.004004932 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059776942 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338824562 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015740191 Gravity::solve_for_phi() time = 0.089103897 on level 0 Castro::construct_new_gravity() time = 0.091237498 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.05975368 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002703156 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059291141 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.377128243 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015606099 Gravity::solve_for_phi() time = 0.086588748 on level 0 Castro::construct_new_gravity() time = 0.088700317 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059077371 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002900496 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059719573 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338356664 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016066916 Gravity::solve_for_phi() time = 0.087251806 on level 0 Castro::construct_new_gravity() time = 0.089431931 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.061487945 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.017427421 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.06993509 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332922278 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016305515 Gravity::solve_for_phi() time = 0.087792896 on level 0 Castro::construct_new_gravity() time = 0.089880337 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059849019 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003558995 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059179126 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33949861 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016285476 Gravity::solve_for_phi() time = 0.089270751 on level 0 Castro::construct_new_gravity() time = 0.092403369 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.060554509 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002582173 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058949191 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3374092 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016842822 Gravity::solve_for_phi() time = 0.092117616 on level 0 Castro::construct_new_gravity() time = 0.094824801 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.061917309 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.003404738 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059278105 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338560985 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015376188 Gravity::solve_for_phi() time = 0.087001908 on level 0 Castro::construct_new_gravity() time = 0.089082749 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.060473661 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002725319628 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.08213637 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.051165874 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.005675181 seconds Ending run at 07:10:37 UTC on 2024-03-29. Run time = 14.49301865 Run time without initialization = 12.13993854 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.49 ... 14.49 ... 14.49 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3540 5.4572 5.6618 39.07% Amr::InitAmr() 1 1.465 1.465 1.465 10.11% Castro::computeTemp() 80 0.8195 0.9409 1.104 7.62% amrex::Copy() 724 0.7874 0.8008 0.848 5.85% FabArray::ParallelCopy_finish() 1429 0.06935 0.5504 0.7936 5.48% MultiFab::AddProduct() 3439 0.5456 0.5542 0.5803 4.00% Castro::normalize_species() 79 0.5433 0.5527 0.5731 3.95% Castro::reset_internal_energy(Fab) 160 0.5083 0.5173 0.5313 3.67% MLPoisson::Fsmooth() 6144 0.3099 0.3387 0.4103 2.83% check_for_negative_density() 20 0.06569 0.286 0.3888 2.68% Castro::initMFs() 1 0.3497 0.3583 0.3735 2.58% MultiFab::Subtract() 159 0.3469 0.3528 0.3731 2.57% FabArray::setVal() 5013 0.345 0.3515 0.3695 2.55% Gravity::fill_multipole_BCs() 19 0.1948 0.2416 0.2886 1.99% Castro::reset_internal_energy(MultiFab) 80 0.02277 0.08489 0.2614 1.80% FabArray::ParallelCopy_nowait() 1429 0.1874 0.2025 0.2202 1.52% FabArray::sum() 3439 0.1829 0.1856 0.1945 1.34% FillBoundary_finish() 6380 0.1071 0.151 0.1802 1.24% Castro::initData() 1 0.003282 0.02604 0.1512 1.04% FillBoundary_nowait() 6380 0.07794 0.1029 0.1307 0.90% MLPoisson::Fapply() 986 0.0944 0.09996 0.115 0.79% MLCellLinOp::applyBC() 7148 0.04666 0.06247 0.1049 0.72% Castro::enforce_min_density() 79 0.0177 0.03837 0.08903 0.61% FabArray::Saxpy() 264 0.0709 0.07225 0.07934 0.55% Castro::do_new_sources() 17 0.0003776 0.01285 0.07835 0.54% Castro::construct_new_gravity_source() 17 0.0682 0.0697 0.07119 0.49% FabArray::Xpay() 945 0.05131 0.05408 0.06139 0.42% MultiFab::contains_nan() 37 0.0445 0.04542 0.04807 0.33% Castro::construct_old_gravity_source() 20 0.04523 0.04592 0.04792 0.33% Castro::do_old_sources() 20 0.0005211 0.009234 0.04199 0.29% MLMG::addInterpCorrection() 768 0.03174 0.03435 0.04108 0.28% AmrLevel::derive() 18 0.03976 0.0404 0.04097 0.28% StateData::FillBoundary(geom) 143 0 0.01707 0.03326 0.23% amrex::average_down 768 0.02475 0.02711 0.0329 0.23% VisMF::Write(FabArray) 4 0.01412 0.01541 0.02799 0.19% Amr::writePlotFile() 2 0.00845 0.01955 0.02131 0.15% Castro::construct_old_gravity() 20 0.0003752 0.004601 0.01922 0.13% Castro::construct_new_source() 102 0.01564 0.01592 0.0172 0.12% MLCellLinOp::defineAuxData() 19 0.0143 0.01499 0.01695 0.12% FabArray::FillBoundary() 6380 0.01326 0.01393 0.01666 0.11% MLMG::ResNormInf() 146 0.0071 0.01207 0.01609 0.11% MLCGSolver::bicgstab 8 0 0.0009988 0.01598 0.11% amrex::Add() 128 0.01403 0.01427 0.01563 0.11% FabArray::norminf() 282 0.01055 0.01108 0.0152 0.10% Castro::evaluate_source_change() 196 0.01218 0.01256 0.01314 0.09% FillPatchIterator::Initialize 147 0.01254 0.01282 0.01314 0.09% FabArrayBase::getFB() 6380 0.009824 0.01027 0.01278 0.09% MLCellLinOp::smooth() 3072 0.01076 0.01134 0.01229 0.08% Castro::wd_update() 2 0.005376 0.008927 0.01226 0.08% FabArray::setDomainBndry() 147 0.0004354 0.006196 0.01179 0.08% Castro::construct_old_source() 120 0.009965 0.0101 0.01052 0.07% MLMG::prepareForSolve() 18 0.009777 0.01004 0.01045 0.07% FabArray::mult() 59 0.007433 0.007723 0.009329 0.06% Amr::writeSmallPlotFile() 2 0.006828 0.008604 0.009019 0.06% MLLinOp::makeSubCommunicator() 19 0.001672 0.004816 0.00863 0.06% Castro::volWgtSum() 46 0.007319 0.007504 0.008564 0.06% MLMG::solve() 18 0.002877 0.004921 0.007987 0.06% Gravity::actual_solve_with_mlmg() 19 0.006618 0.006913 0.007824 0.05% FabArrayBase::getCPC() 2005 0.007342 0.007496 0.007804 0.05% Gravity::get_new_grav_vector() 18 0.005973 0.006228 0.007203 0.05% Gravity::get_old_grav_vector() 20 0.006484 0.006567 0.006726 0.05% MLCellLinOp::compGrad() 18 0.005822 0.005962 0.00668 0.05% MultiFab::max() 2 0.0002197 0.003684 0.006492 0.04% FabArrayBase::CPC::define() 576 0.002186 0.003349 0.006385 0.04% amrex::Dot() 142 0 0.0003801 0.006082 0.04% Castro::volInBoundary() 14 0.003388 0.003657 0.005449 0.04% Castro::initialize_do_advance() 20 0.004672 0.004967 0.005231 0.04% Castro::construct_new_gravity() 17 0.0002968 0.001413 0.004998 0.03% MLCGSolver::ParallelAllReduce 227 0 0.0003063 0.004901 0.03% MLCellLinOp::apply() 986 0.001972 0.002205 0.004667 0.03% FabArray::ParallelCopy() 1429 0.003519 0.003682 0.003926 0.03% Castro::sum_integrated_quantities() 2 0.002207 0.003108 0.003438 0.02% BndryData::define() 19 0.003044 0.003104 0.003277 0.02% MLPoisson::normalize() 79 0 0.0001982 0.003171 0.02% AmrLevel::FillPatch() 147 0.002099 0.002219 0.002411 0.02% MLLinOp::defineGrids() 19 0.001794 0.001938 0.002277 0.02% MLCellLinOp::prepareForSolve() 19 0.001602 0.001758 0.002044 0.01% Gravity::solve_for_phi() 17 0.0007942 0.001098 0.001995 0.01% MLCellLinOp::correctionResidual() 768 0.00182 0.001888 0.001968 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001307 0.001558 0.00185 0.01% MLMG::mgVcycle() 128 0.001526 0.001622 0.001797 0.01% MLCellLinOp::defineBC() 19 0.00147 0.001513 0.001642 0.01% StateData::define() 6 0.001341 0.001476 0.0016 0.01% MLMG:computeResOfCorrection() 768 0.001369 0.001435 0.001515 0.01% FabArrayBase::FB::FB() 75 0.000282 0.0006797 0.00146 0.01% Castro::save_data_for_retry() 3 0.001258 0.001306 0.001367 0.01% main() 1 0.001002 0.0012 0.00133 0.01% Castro::locWgtSum() 6 0.001117 0.001133 0.001146 0.01% TagBoxArray::collate() 2 0.0001281 0.0005376 0.001059 0.01% MLMG::actualBottomSolve() 128 0.0001322 0.0001955 0.001058 0.01% StateDataPhysBCFunct::() 147 0.000663 0.0008129 0.00096 0.01% Castro::subcycle_advance_ctu() 1 0.0001836 0.0002729 0.0008384 0.01% MLCellLinOp::setLevelBC() 19 0.0005246 0.0006585 0.0008214 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006971 0.0007256 0.0007619 0.01% MLMG::mgVcycle_down::2 128 0.0006053 0.0006642 0.0007427 0.01% Castro::swap_state_time_levels() 8 0.0005787 0.0006699 0.0007299 0.01% MLMG::mgVcycle_down::3 128 0.0005716 0.0006184 0.0007088 0.00% MLMG::mgVcycle_down::0 128 0.000648 0.0006686 0.0006975 0.00% MLMG::mgVcycle_down::1 128 0.0006369 0.0006602 0.0006826 0.00% MLMG::mgVcycle_down::5 128 0.0005761 0.0005994 0.0006726 0.00% MLMG::mgVcycle_down::4 128 0.0005548 0.0005793 0.0006718 0.00% Castro::buildMetrics() 1 0.0005987 0.0006189 0.0006372 0.00% Castro::Castro() 1 0.0004611 0.0005123 0.0005536 0.00% Castro::apply_tagging_restrictions() 2 0.0004121 0.0004741 0.0005256 0.00% AmrMesh::MakeNewGrids() 2 0.000492 0.0005073 0.0005254 0.00% FillPatchSingleLevel 147 0.0004648 0.0004815 0.0005155 0.00% Castro::clean_state() 79 0.0004452 0.0004808 0.0005096 0.00% MLMG::mgVcycle_up::1 128 0.0004403 0.000467 0.0004973 0.00% MLMG::mgVcycle_up::0 128 0.0004577 0.0004726 0.0004957 0.00% Gravity::applyMetricTerms() 2 0.0004685 0.0004799 0.0004935 0.00% MLMG::mgVcycle_up::2 128 0.0003782 0.0004206 0.0004844 0.00% Castro::do_advance_ctu() 20 0.0004184 0.0004427 0.0004843 0.00% MLMG::mgVcycle_up::5 128 0.0003909 0.0004043 0.0004567 0.00% MLCellLinOp::solutionResidual() 147 0.0004344 0.0004454 0.0004555 0.00% MLMG::mgVcycle_up::3 128 0.000375 0.0003929 0.000454 0.00% makeSFC 95 0.0003682 0.0003896 0.0004489 0.00% MLMG::mgVcycle_up::4 128 0.0003805 0.0003929 0.0004377 0.00% MLMG::oneIter() 128 0.0003834 0.0004001 0.0004271 0.00% Castro::volProductSum() 2 0.0003924 0.0004015 0.0004151 0.00% Castro::enforce_consistent_e() 1 0.0003652 0.0003759 0.0003959 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003332 0.0003452 0.0003661 0.00% MLMG::mgVcycle_bottom 128 0.0002261 0.0002399 0.000255 0.00% MLMG::computeResidual() 128 0.000236 0.0002447 0.0002528 0.00% Castro::problem_post_timestep() 2 1.332e-05 2.89e-05 0.000246 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002149 0.0002279 0.0002457 0.00% DistributionMapping::Distribute() 95 0.0002108 0.0002201 0.0002407 0.00% Castro::finalize_do_advance() 17 0.0001637 0.0001816 0.0002053 0.00% Gravity::update_max_rhs() 2 0.0001637 0.0001714 0.0001994 0.00% Castro::initialize_advance() 1 0.0001293 0.000148 0.0001691 0.00% OwnerMask() 2 0.0001336 0.000149 0.0001665 0.00% MLMG::compResidual() 1 0.0001545 0.0001588 0.0001655 0.00% Amr::defBaseLevel() 1 0.0001215 0.0001399 0.0001636 0.00% Amr::coarseTimeStep() 1 0.0001283 0.0001531 0.0001612 0.00% MLPoisson::define() 19 0.0001264 0.0001364 0.0001495 0.00% Amr::grid_places() 2 6.964e-05 9.202e-05 0.0001369 0.00% Castro::retry_advance_ctu() 11 5.834e-05 7.187e-05 0.0001336 0.00% Castro::enforce_speed_limit() 79 0.0001108 0.0001177 0.0001321 0.00% TagBoxArray::mapPRD 2 0.0001082 0.0001134 0.0001234 0.00% Castro::check_for_nan() 37 0.0001046 0.0001132 0.0001224 0.00% Castro::apply_source_to_state() 37 9.703e-05 0.0001088 0.0001207 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.205e-05 7.292e-05 0.0001138 0.00% Gravity::test_composite_phi() 1 9.116e-05 9.652e-05 0.0001138 0.00% Castro::apply_problem_tags() 2 9.225e-05 9.666e-05 0.0001115 0.00% MLLinOp::define() 19 7.696e-05 8.186e-05 8.89e-05 0.00% MLPoisson::prepareForSolve() 19 7.436e-05 7.879e-05 8.835e-05 0.00% Castro::create_source_corrector() 17 5.456e-05 7.092e-05 8.713e-05 0.00% MultiFab::Swap() 5 6.555e-05 6.922e-05 8.454e-05 0.00% Castro::expand_state() 20 5.212e-05 5.869e-05 7.549e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 3.628e-05 4.975e-05 6.269e-05 0.00% knapsack() 1 5.685e-05 5.974e-05 6.14e-05 0.00% Amr::initSubcycle() 1 5.56e-05 5.814e-05 6.013e-05 0.00% Amr::FinalizeInit() 1 8.395e-06 1.474e-05 5.902e-05 0.00% MLMG::computeMLResidual() 18 3.945e-05 4.496e-05 4.863e-05 0.00% Castro::derive() 18 4.163e-05 4.43e-05 4.695e-05 0.00% Gravity::swapTimeLevels() 8 3.649e-05 4.039e-05 4.633e-05 0.00% MLMG::getGradSolution() 18 3.941e-05 4.149e-05 4.501e-05 0.00% MLMG::MLResNormInf() 18 3.268e-05 3.555e-05 3.933e-05 0.00% MLMG::MLRhsNormInf() 18 3.078e-05 3.213e-05 3.651e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.018e-05 3.233e-05 3.494e-05 0.00% Castro::construct_old_rotation_source() 20 2.958e-05 3.049e-05 3.227e-05 0.00% Gravity::actual_multilevel_solve() 1 2.798e-05 2.925e-05 3.227e-05 0.00% Amr::regrid() 1 1.07e-05 1.246e-05 3.045e-05 0.00% Castro::construct_new_rotation_source() 17 2.066e-05 2.186e-05 2.684e-05 0.00% Amr::timeStep() 1 1.254e-05 1.724e-05 2.665e-05 0.00% Castro::advance() 1 7.054e-06 1.222e-05 2.565e-05 0.00% Castro::finalize_advance() 1 1.722e-05 1.977e-05 2.511e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.617e-05 1.789e-05 1.989e-05 0.00% Castro::estTimeStep() 10 1.193e-05 1.301e-05 1.465e-05 0.00% Castro::post_init() 1 1.203e-05 1.258e-05 1.394e-05 0.00% Castro::post_regrid() 2 1.038e-05 1.161e-05 1.368e-05 0.00% Amr::InitializeInit() 1 6.535e-06 8.173e-06 1.345e-05 0.00% Castro::computeInitialDt() 2 7.137e-06 7.756e-06 1.037e-05 0.00% Amr::bldFineLevels() 1 6.921e-06 7.832e-06 9.095e-06 0.00% Amr::init() 1 6.928e-06 8.05e-06 9.067e-06 0.00% Gravity::set_mass_offset() 2 4.475e-06 6.062e-06 8.125e-06 0.00% BoxList::parallelComplementIn() 4 7.081e-06 7.302e-06 7.664e-06 0.00% Castro::post_timestep() 1 5.477e-06 6.218e-06 6.664e-06 0.00% Castro::errorEst() 2 5.877e-06 6.179e-06 6.626e-06 0.00% Castro::gwstrain() 2 4.278e-06 4.79e-06 6.604e-06 0.00% BoxList::complementIn 4 5.848e-06 6.038e-06 6.273e-06 0.00% Amr::initialInit() 1 2.888e-06 3.23e-06 3.696e-06 0.00% Castro::FluxRegCrseInit 1 1.728e-06 2.048e-06 2.55e-06 0.00% Castro::FluxRegFineAdd() 1 1.363e-06 1.5e-06 1.771e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.49 14.49 14.49 100.00% Amr::coarseTimeStep() 1 12.14 12.14 12.14 83.76% Amr::timeStep() 1 12.08 12.08 12.08 83.36% Castro::advance() 1 12.02 12.02 12.02 82.96% Castro::subcycle_advance_ctu() 1 11.97 11.97 11.97 82.60% Castro::do_advance_ctu() 20 11.93 11.93 11.93 82.33% Castro::construct_ctu_hydro_source() 20 6.479 6.524 6.564 45.29% Castro::clean_state() 79 3.678 3.817 4.019 27.73% Castro::computeTemp() 80 2.373 2.506 2.747 18.95% Castro::reset_internal_energy(MultiFab) 80 1.479 1.565 1.745 12.04% Gravity::solve_phi_with_mlmg() 19 1.521 1.571 1.619 11.17% Castro::construct_new_gravity() 17 1.448 1.496 1.543 10.65% Castro::initialize_do_advance() 20 1.414 1.459 1.508 10.41% Gravity::solve_for_phi() 17 1.407 1.455 1.504 10.38% Amr::InitAmr() 1 1.465 1.465 1.465 10.11% Gravity::actual_solve_with_mlmg() 19 1.322 1.325 1.33 9.18% MLMG::solve() 18 1.271 1.275 1.277 8.81% Castro::do_old_sources() 20 1.155 1.188 1.204 8.31% MLMG::oneIter() 128 1.128 1.131 1.134 7.82% MLMG::mgVcycle() 128 1.114 1.117 1.118 7.71% Castro::do_new_sources() 17 0.9302 0.982 1.03 7.10% FabArray::ParallelCopy() 1429 0.2956 0.7765 1.024 7.07% Castro::evaluate_source_change() 196 0.9355 0.95 0.995 6.87% Amr::init() 1 0.8872 0.8873 0.8873 6.12% Castro::enforce_min_density() 79 0.7873 0.8189 0.874 6.03% amrex::Copy() 724 0.7874 0.8008 0.848 5.85% Amr::initialInit() 1 0.83 0.83 0.8301 5.73% FabArray::ParallelCopy_finish() 1429 0.06935 0.5504 0.7936 5.48% MLCellLinOp::smooth() 3072 0.5766 0.6251 0.7513 5.18% AmrLevel::FillPatch() 147 0.4916 0.6208 0.7141 4.93% Amr::InitializeInit() 1 0.434 0.5013 0.5988 4.13% Amr::defBaseLevel() 1 0.434 0.5013 0.5987 4.13% MultiFab::AddProduct() 3439 0.5456 0.5542 0.5803 4.00% Castro::normalize_species() 79 0.5433 0.5527 0.5731 3.95% FillPatchIterator::Initialize 147 0.3094 0.4389 0.5339 3.68% Castro::reset_internal_energy(Fab) 160 0.5083 0.5173 0.5313 3.67% FillPatchIterator::FillFromLevel0() 147 0.285 0.4199 0.5163 3.56% FillPatchSingleLevel 147 0.2843 0.4192 0.5155 3.56% MLMG::mgVcycle_up::1 128 0.1028 0.2659 0.4303 2.97% MLPoisson::Fsmooth() 6144 0.3099 0.3387 0.4103 2.83% MLCellLinOp::applyBC() 7148 0.2886 0.3412 0.4084 2.82% Amr::FinalizeInit() 1 0.2313 0.3287 0.396 2.73% check_for_negative_density() 20 0.06569 0.286 0.3888 2.68% Castro::Castro() 1 0.3551 0.3639 0.3795 2.62% Castro::initMFs() 1 0.3499 0.3584 0.3736 2.58% MultiFab::Subtract() 159 0.3469 0.3528 0.3731 2.57% MLMG::addInterpCorrection() 768 0.06186 0.2989 0.3699 2.55% FabArray::setVal() 5013 0.345 0.3515 0.3695 2.55% FabArray::FillBoundary() 6380 0.233 0.2787 0.314 2.17% Gravity::fill_multipole_BCs() 19 0.197 0.2437 0.2907 2.01% MLMG::mgVcycle_down::0 128 0.2712 0.2747 0.2772 1.91% MLMG::mgVcycle_up::2 128 0.01049 0.1137 0.2721 1.88% Castro::expand_state() 20 0.1817 0.2169 0.2646 1.83% FabArray::ParallelCopy_nowait() 1429 0.2069 0.2224 0.241 1.66% Castro::initData() 1 0.077 0.1356 0.2373 1.64% Amr::bldFineLevels() 1 0.04655 0.1439 0.2099 1.45% MLMG::mgVcycle_up::0 128 0.1992 0.201 0.2017 1.39% MLCellLinOp::apply() 986 0.153 0.1664 0.1976 1.36% FabArray::sum() 3439 0.1829 0.1856 0.1945 1.34% FillBoundary_finish() 6380 0.1071 0.151 0.1802 1.24% MLMG::mgVcycle_up::3 128 0.01042 0.02315 0.1749 1.21% Amr::grid_places() 2 0.002651 0.1001 0.1674 1.15% AmrMesh::MakeNewGrids() 2 0.00257 0.09997 0.1673 1.15% TagBoxArray::mapPRD 2 0.0008172 0.09819 0.1658 1.14% MLMG:computeResOfCorrection() 768 0.1141 0.1266 0.1478 1.02% MLCellLinOp::correctionResidual() 768 0.1127 0.1251 0.1463 1.01% Castro::post_init() 1 0.1387 0.1411 0.1438 0.99% FillBoundary_nowait() 6380 0.08822 0.1139 0.1421 0.98% Castro::create_source_corrector() 17 0.04843 0.09263 0.1326 0.91% Castro::construct_new_source() 102 0.1235 0.1257 0.1312 0.91% MLMG::mgVcycle_down::1 128 0.1185 0.1231 0.1282 0.88% MLPoisson::Fapply() 986 0.0944 0.09996 0.115 0.79% Gravity::multilevel_solve_for_new_phi() 1 0.1044 0.1045 0.1045 0.72% Gravity::actual_multilevel_solve() 1 0.1043 0.1044 0.1044 0.72% Amr::writePlotFile() 2 0.101 0.1011 0.1011 0.70% MLCellLinOp::solutionResidual() 147 0.08981 0.09609 0.1 0.69% Castro::post_regrid() 2 0.08473 0.08744 0.08987 0.62% Castro::construct_old_gravity() 20 0.04698 0.06708 0.08323 0.57% MLMG::computeResidual() 128 0.07727 0.0799 0.08251 0.57% Castro::construct_old_source() 120 0.07853 0.07966 0.0825 0.57% FabArray::Saxpy() 264 0.0709 0.07225 0.07934 0.55% Gravity::get_old_grav_vector() 20 0.04661 0.06248 0.07786 0.54% MLMG::mgVcycle_down::2 128 0.01231 0.04174 0.07407 0.51% Castro::construct_new_gravity_source() 17 0.0682 0.0697 0.07119 0.49% Castro::derive() 18 0.06857 0.06959 0.07117 0.49% AmrLevel::derive() 18 0.06853 0.06955 0.07112 0.49% MLMG::mgVcycle_bottom 128 0.0003637 0.004793 0.07103 0.49% MLMG::actualBottomSolve() 128 0.0001322 0.004553 0.07078 0.49% MLCGSolver::bicgstab 8 0 0.004329 0.06927 0.48% Castro::post_timestep() 1 0.05855 0.06146 0.064 0.44% FabArray::Xpay() 945 0.05131 0.05408 0.06139 0.42% MLMG::mgVcycle_down::3 128 0.01167 0.01786 0.05917 0.41% amrex::average_down 768 0.03305 0.04037 0.05722 0.39% Castro::initialize_advance() 1 0.04962 0.05116 0.05231 0.36% Castro::check_for_nan() 37 0.0446 0.04554 0.04818 0.33% MultiFab::contains_nan() 37 0.0445 0.04542 0.04807 0.33% Castro::construct_old_gravity_source() 20 0.04523 0.04592 0.04792 0.33% Amr::regrid() 1 0.04349 0.04485 0.04634 0.32% Gravity::get_new_grav_vector() 18 0.03556 0.03848 0.0409 0.28% Castro::retry_advance_ctu() 11 0.0358 0.03719 0.03977 0.27% MLPoisson::define() 19 0.02913 0.03344 0.03928 0.27% MLMG::mgVcycle_down::4 128 0.01165 0.01333 0.03453 0.24% StateDataPhysBCFunct::() 147 0.000663 0.01788 0.03414 0.24% StateData::FillBoundary(geom) 143 0 0.01707 0.03326 0.23% Castro::apply_source_to_state() 37 0.02888 0.0293 0.03062 0.21% VisMF::Write(FabArray) 4 0.01412 0.01541 0.02799 0.19% MLMG::mgVcycle_up::4 128 0.0105 0.01173 0.02668 0.18% MLMG::ResNormInf() 146 0.01744 0.02151 0.02559 0.18% MLCellLinOp::defineAuxData() 19 0.01842 0.01984 0.02368 0.16% MLMG::prepareForSolve() 18 0.01993 0.02084 0.02302 0.16% MLMG::mgVcycle_down::5 128 0.01169 0.01259 0.02278 0.16% Castro::sum_integrated_quantities() 2 0.02234 0.02249 0.02251 0.16% Castro::save_data_for_retry() 3 0.01899 0.01941 0.02024 0.14% MLMG::computeMLResidual() 18 0.01072 0.01574 0.01962 0.14% MLMG::mgVcycle_up::5 128 0.01059 0.01136 0.0193 0.13% Castro::problem_post_timestep() 2 0.008779 0.01261 0.01566 0.11% Castro::wd_update() 2 0.008765 0.01258 0.01565 0.11% amrex::Add() 128 0.01403 0.01427 0.01563 0.11% FabArray::norminf() 282 0.01055 0.01108 0.0152 0.10% Gravity::test_composite_phi() 1 0.01457 0.0146 0.01463 0.10% FabArrayBase::getFB() 6380 0.01012 0.01095 0.01424 0.10% FabArrayBase::getCPC() 2005 0.009573 0.01084 0.01405 0.10% Amr::writeSmallPlotFile() 2 0.01326 0.01326 0.01326 0.09% MLLinOp::define() 19 0.004581 0.007791 0.01199 0.08% MLLinOp::defineGrids() 19 0.004499 0.007709 0.01191 0.08% FabArray::setDomainBndry() 147 0.0004354 0.006196 0.01179 0.08% FabArray::mult() 59 0.007433 0.007723 0.009329 0.06% MLLinOp::makeSubCommunicator() 19 0.001672 0.004816 0.00863 0.06% Castro::volWgtSum() 46 0.007319 0.007504 0.008564 0.06% MLMG::getGradSolution() 18 0.007547 0.00786 0.008477 0.06% MLCellLinOp::compGrad() 18 0.007502 0.007818 0.008434 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005127 0.008204 0.06% Gravity::update_max_rhs() 2 0.002558 0.005003 0.00773 0.05% MultiFab::max() 2 0.0002197 0.003684 0.006492 0.04% FabArrayBase::CPC::define() 576 0.002186 0.003349 0.006385 0.04% amrex::Dot() 142 0 0.0003801 0.006082 0.04% MLCellLinOp::defineBC() 19 0.005453 0.005674 0.005877 0.04% Castro::volInBoundary() 14 0.003388 0.003657 0.005449 0.04% BndryData::define() 19 0.003964 0.004161 0.004306 0.03% MLPoisson::normalize() 79 0 0.0001982 0.003171 0.02% MLPoisson::prepareForSolve() 19 0.00169 0.001837 0.002123 0.01% MLCellLinOp::prepareForSolve() 19 0.001602 0.001758 0.002044 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001307 0.001558 0.00185 0.01% AmrLevel::AmrLevel(dm) 1 0.001371 0.001508 0.001635 0.01% StateData::define() 6 0.001341 0.001476 0.0016 0.01% MLMG::MLResNormInf() 18 0.001206 0.001254 0.00158 0.01% MLMG::MLRhsNormInf() 18 0.001158 0.001204 0.001528 0.01% FabArrayBase::FB::FB() 75 0.000282 0.0006797 0.00146 0.01% MLMG::compResidual() 1 0.0009618 0.001115 0.001266 0.01% Gravity::swapTimeLevels() 8 0.001186 0.001225 0.001251 0.01% Castro::locWgtSum() 6 0.001117 0.001133 0.001146 0.01% TagBoxArray::collate() 2 0.0001281 0.0005376 0.001059 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009209 0.000955 0.001043 0.01% MLCellLinOp::setLevelBC() 19 0.0005246 0.0006585 0.0008214 0.01% Castro::swap_state_time_levels() 8 0.0005787 0.0006699 0.0007299 0.01% Castro::buildMetrics() 1 0.0006596 0.0006799 0.0006983 0.00% makeSFC 95 0.0005824 0.0006097 0.0006805 0.00% Castro::errorEst() 2 0.0005105 0.000577 0.000624 0.00% Castro::apply_tagging_restrictions() 2 0.0004121 0.0004741 0.0005256 0.00% Gravity::applyMetricTerms() 2 0.0004685 0.0004799 0.0004935 0.00% Castro::volProductSum() 2 0.0003924 0.0004015 0.0004151 0.00% Castro::enforce_consistent_e() 1 0.0003652 0.0003759 0.0003959 0.00% Castro::finalize_advance() 1 0.0002578 0.0002685 0.0002771 0.00% DistributionMapping::Distribute() 95 0.0002108 0.0002201 0.0002407 0.00% Castro::finalize_do_advance() 17 0.0001733 0.0001914 0.0002148 0.00% OwnerMask() 2 0.0001336 0.000149 0.0001665 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001108 0.0001274 0.0001435 0.00% Castro::enforce_speed_limit() 79 0.0001108 0.0001177 0.0001321 0.00% Castro::apply_problem_tags() 2 9.225e-05 9.666e-05 0.0001115 0.00% MultiFab::Swap() 5 6.555e-05 6.922e-05 8.454e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 3.628e-05 4.975e-05 6.269e-05 0.00% knapsack() 1 5.685e-05 5.974e-05 6.14e-05 0.00% Amr::initSubcycle() 1 5.56e-05 5.814e-05 6.013e-05 0.00% Castro::construct_old_rotation_source() 20 2.958e-05 3.049e-05 3.227e-05 0.00% Castro::construct_new_rotation_source() 17 2.066e-05 2.186e-05 2.684e-05 0.00% Castro::computeInitialDt() 2 1.007e-05 1.096e-05 1.511e-05 0.00% Castro::estTimeStep() 10 1.193e-05 1.301e-05 1.465e-05 0.00% BoxList::parallelComplementIn() 4 1.295e-05 1.334e-05 1.384e-05 0.00% Gravity::set_mass_offset() 2 4.475e-06 6.062e-06 8.125e-06 0.00% Castro::gwstrain() 2 4.278e-06 4.79e-06 6.604e-06 0.00% BoxList::complementIn 4 5.848e-06 6.038e-06 6.273e-06 0.00% Castro::FluxRegCrseInit 1 1.728e-06 2.048e-06 2.55e-06 0.00% Castro::FluxRegFineAdd() 1 1.363e-06 1.5e-06 1.771e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 14 B 18 B 25 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-42-g7437aa17d36f) finalized