Initializing AMReX (23.12-24-g75571e2dcbf2)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.12-24-g75571e2dcbf2) initialized Starting run at 08:29:13 UTC on 2023-12-29. Successfully read inputs file ... Castro git describe: 23.12-18-gc3509d44c AMReX git describe: 23.12-24-g75571e2dc Microphysics git describe: 23.12-15-gb8815845 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.163512222 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000975901 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010942489 Gravity::multilevel_solve_for_new_phi() time = 0.102324853 Gravity::fill_multipole_BCs() time = 0.011293103 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049106882 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004076072 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002735823 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065697886 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006174543 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.06446104 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004428746 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.061138946 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005196257 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060346855 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327725016 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015399257 Gravity::solve_for_phi() time = 0.085001359 on level 0 Castro::construct_new_gravity() time = 0.087044665 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.062053363 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002950027 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060225221 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323675268 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015753747 Gravity::solve_for_phi() time = 0.085179065 on level 0 Castro::construct_new_gravity() time = 0.087207963 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.061221928 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.004167339 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060236605 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.37062976 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018281392 Gravity::solve_for_phi() time = 0.089719978 on level 0 Castro::construct_new_gravity() time = 0.091754248 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.061297933 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003100155 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059042739 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332992979 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014629631 Gravity::solve_for_phi() time = 0.085300756 on level 0 Castro::construct_new_gravity() time = 0.087325395 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.059662797 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003395656 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058704777 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.340055294 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014766656 Gravity::solve_for_phi() time = 0.084805707 on level 0 Castro::construct_new_gravity() time = 0.087032969 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060584566 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.005156158 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058764012 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332565083 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014702307 Gravity::solve_for_phi() time = 0.08489952 on level 0 Castro::construct_new_gravity() time = 0.086929006 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.05934655 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002653234 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058651223 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332768159 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015096409 Gravity::solve_for_phi() time = 0.082140468 on level 0 Castro::construct_new_gravity() time = 0.084175312 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059954732 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.004358398 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.061068626 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335790858 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015074085 Gravity::solve_for_phi() time = 0.084553903 on level 0 Castro::construct_new_gravity() time = 0.086589944 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060613544 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.005096319 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058754054 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335778339 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015747802 Gravity::solve_for_phi() time = 0.086511174 on level 0 Castro::construct_new_gravity() time = 0.088536321 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059333762 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.004127473 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.060059329 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329174317 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016510718 Gravity::solve_for_phi() time = 0.085409453 on level 0 Castro::construct_new_gravity() time = 0.088485018 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.061002276 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003719739 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.064463344 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329099738 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015264367 Gravity::solve_for_phi() time = 0.081906889 on level 0 Castro::construct_new_gravity() time = 0.083946798 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059307116 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003155559 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059012663 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326327349 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01613161 Gravity::solve_for_phi() time = 0.084032078 on level 0 Castro::construct_new_gravity() time = 0.086076796 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059351459 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.004684567 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058714908 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331253529 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01526601 Gravity::solve_for_phi() time = 0.08191889 on level 0 Castro::construct_new_gravity() time = 0.083960371 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059287376 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002966601 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.05871013 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331033761 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015369098 Gravity::solve_for_phi() time = 0.084170074 on level 0 Castro::construct_new_gravity() time = 0.086211079 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059326657 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003021933 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058673534 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330969688 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015431256 Gravity::solve_for_phi() time = 0.082039766 on level 0 Castro::construct_new_gravity() time = 0.08407469 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059497349 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002879774 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058667797 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338983711 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015699896 Gravity::solve_for_phi() time = 0.082295561 on level 0 Castro::construct_new_gravity() time = 0.084309566 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059363037 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.00264586 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058767445 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330907833 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016574149 Gravity::solve_for_phi() time = 0.083024729 on level 0 Castro::construct_new_gravity() time = 0.085054564 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.061032649 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002775284999 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.86548948 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.050049958 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004044193 seconds Ending run at 08:29:27 UTC on 2023-12-29. Run time = 14.29900257 Run time without initialization = 11.92056151 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.3 ... 14.3 ... 14.3 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3903 5.4698 5.5842 39.05% Amr::InitAmr() 1 1.484 1.484 1.484 10.38% Castro::computeTemp() 80 0.8376 0.9588 1.131 7.91% amrex::Copy() 724 0.7683 0.7766 0.7936 5.55% FabArray::ParallelCopy_finish() 1429 0.04617 0.4867 0.7309 5.11% Castro::normalize_species() 79 0.5374 0.5454 0.5707 3.99% MultiFab::AddProduct() 3439 0.5527 0.5575 0.5662 3.96% Castro::reset_internal_energy(Fab) 160 0.5215 0.5285 0.5387 3.77% MLPoisson::Fsmooth() 6144 0.3105 0.3354 0.4052 2.83% Castro::initMFs() 1 0.362 0.3694 0.3818 2.67% FabArray::setVal() 5013 0.3531 0.3594 0.3668 2.57% MultiFab::Subtract() 159 0.3491 0.3519 0.3639 2.54% check_for_negative_density() 20 0.1015 0.2129 0.3084 2.16% Gravity::fill_multipole_BCs() 19 0.1969 0.2437 0.2851 1.99% FabArray::ParallelCopy_nowait() 1429 0.1881 0.2006 0.2154 1.51% Castro::reset_internal_energy(MultiFab) 80 0.02181 0.06172 0.1996 1.40% FabArray::sum() 3439 0.1829 0.1867 0.1885 1.32% Castro::initData() 1 0.003349 0.02758 0.159 1.11% FillBoundary_finish() 6380 0.09031 0.111 0.1334 0.93% FillBoundary_nowait() 6380 0.07044 0.09325 0.1169 0.82% MLPoisson::Fapply() 986 0.09342 0.09847 0.1124 0.79% MLCellLinOp::applyBC() 7148 0.04568 0.06101 0.102 0.71% Castro::do_new_sources() 17 0.0003334 0.01285 0.07796 0.55% FabArray::Saxpy() 264 0.06888 0.07019 0.07709 0.54% Castro::construct_new_gravity_source() 17 0.06806 0.06911 0.07027 0.49% Castro::do_old_sources() 20 0.000445 0.01229 0.06127 0.43% FabArray::Xpay() 945 0.05116 0.05348 0.06066 0.42% Castro::construct_old_gravity_source() 20 0.04549 0.04597 0.0469 0.33% Castro::enforce_min_density() 79 0.01706 0.02451 0.04684 0.33% MultiFab::contains_nan() 37 0.04435 0.04502 0.04654 0.33% AmrLevel::derive() 18 0.04093 0.04159 0.0435 0.30% MLMG::addInterpCorrection() 768 0.03263 0.0351 0.04213 0.29% StateData::FillBoundary(geom) 143 0 0.01773 0.03397 0.24% amrex::average_down 768 0.02377 0.02576 0.0315 0.22% VisMF::Write(FabArray) 4 0.01184 0.01305 0.02578 0.18% Amr::writePlotFile() 2 0.007883 0.01894 0.02085 0.15% Castro::construct_new_source() 102 0.01559 0.01586 0.01793 0.13% MLCellLinOp::defineAuxData() 19 0.01388 0.01472 0.01671 0.12% FabArray::FillBoundary() 6380 0.01342 0.0138 0.01639 0.11% MLCGSolver::bicgstab 8 0 0.0009983 0.01597 0.11% FabArray::norminf() 282 0.01082 0.01126 0.01525 0.11% amrex::Add() 128 0.0137 0.01386 0.01443 0.10% Castro::construct_old_gravity() 20 0.0003298 0.003671 0.01367 0.10% Castro::evaluate_source_change() 196 0.01209 0.01251 0.01294 0.09% FabArrayBase::getFB() 6380 0.009892 0.01025 0.0126 0.09% FillPatchIterator::Initialize 147 0.01179 0.01211 0.01249 0.09% Castro::wd_update() 2 0.0052 0.009032 0.01245 0.09% MLCellLinOp::smooth() 3072 0.01101 0.01146 0.01231 0.09% FabArray::setDomainBndry() 147 0.0004418 0.005942 0.01122 0.08% MLMG::ResNormInf() 146 0.005533 0.008952 0.01104 0.08% MLMG::prepareForSolve() 18 0.009674 0.009864 0.01037 0.07% Castro::construct_old_source() 120 0.009906 0.01002 0.01019 0.07% MLLinOp::makeSubCommunicator() 19 0.0009499 0.004943 0.00877 0.06% Castro::volWgtSum() 46 0.007296 0.007487 0.008498 0.06% Gravity::actual_solve_with_mlmg() 19 0.006492 0.006699 0.007574 0.05% FabArrayBase::getCPC() 2005 0.007013 0.007223 0.007547 0.05% FabArray::mult() 59 0.007113 0.007283 0.007533 0.05% Gravity::get_old_grav_vector() 20 0.006294 0.006444 0.006723 0.05% Gravity::get_new_grav_vector() 18 0.00593 0.00613 0.006543 0.05% FabArrayBase::CPC::define() 576 0.002159 0.003258 0.006324 0.04% MLMG::solve() 18 0.0009917 0.003207 0.006233 0.04% amrex::Dot() 142 0 0.0003779 0.006046 0.04% MLCellLinOp::compGrad() 18 0.005658 0.005725 0.005813 0.04% Amr::writeSmallPlotFile() 2 0.003514 0.005124 0.00556 0.04% Castro::volInBoundary() 14 0.00337 0.003735 0.005473 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003396 0.005434 0.04% Castro::initialize_do_advance() 20 0.00417 0.004395 0.004752 0.03% MLCellLinOp::apply() 986 0.002003 0.002211 0.00466 0.03% FabArray::ParallelCopy() 1429 0.003412 0.003533 0.003802 0.03% Castro::sum_integrated_quantities() 2 0.002117 0.003025 0.003376 0.02% MultiFab::max() 2 0.0001407 0.002853 0.003347 0.02% BndryData::define() 19 0.002977 0.003057 0.00321 0.02% MLPoisson::normalize() 79 0 0.0001907 0.003051 0.02% Castro::construct_new_gravity() 17 0.0002584 0.0008127 0.002724 0.02% AmrLevel::FillPatch() 147 0.001994 0.002146 0.002296 0.02% MLLinOp::defineGrids() 19 0.001689 0.001833 0.00214 0.01% MLCellLinOp::prepareForSolve() 19 0.001628 0.001745 0.002034 0.01% MLCellLinOp::correctionResidual() 768 0.001825 0.001869 0.001947 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.00136 0.001554 0.00178 0.01% MLMG::mgVcycle() 128 0.001575 0.001629 0.001756 0.01% Castro::enforce_consistent_e() 1 0.0003656 0.0005218 0.001736 0.01% MLCellLinOp::defineBC() 19 0.001479 0.001524 0.001645 0.01% MLMG:computeResOfCorrection() 768 0.001391 0.001447 0.001514 0.01% main() 1 0.0009783 0.001194 0.001419 0.01% FabArrayBase::FB::FB() 75 0.0002732 0.0006601 0.001418 0.01% StateData::define() 6 0.00124 0.001271 0.001322 0.01% Castro::save_data_for_retry() 3 0.001231 0.001252 0.001271 0.01% Castro::locWgtSum() 6 0.001116 0.001127 0.001141 0.01% TagBoxArray::collate() 2 0.0002343 0.0006177 0.001108 0.01% MLMG::actualBottomSolve() 128 0.0001331 0.0001969 0.001063 0.01% Gravity::solve_for_phi() 17 0.0007074 0.0008238 0.0009952 0.01% MLCellLinOp::setLevelBC() 19 0.000539 0.0006702 0.0008683 0.01% StateDataPhysBCFunct::() 147 0.0006386 0.0007851 0.000866 0.01% Castro::subcycle_advance_ctu() 1 0.0001712 0.0002257 0.0007721 0.01% AmrMesh::MakeNewGrids() 2 0.0004978 0.0005346 0.0007348 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006663 0.0006971 0.0007293 0.01% MLMG::mgVcycle_down::1 128 0.0006429 0.000657 0.0007108 0.00% MLMG::mgVcycle_down::3 128 0.0005768 0.0006127 0.0006876 0.00% MLMG::mgVcycle_down::0 128 0.0006443 0.0006554 0.0006868 0.00% MLMG::mgVcycle_down::2 128 0.0006109 0.0006499 0.0006829 0.00% Castro::Castro() 1 0.0004508 0.0005058 0.0006653 0.00% MLMG::mgVcycle_down::4 128 0.0005626 0.0005817 0.0006548 0.00% MLMG::mgVcycle_down::5 128 0.0005816 0.0005984 0.0006489 0.00% Castro::apply_tagging_restrictions() 2 0.0004295 0.0004907 0.0006083 0.00% Castro::buildMetrics() 1 0.000544 0.0005616 0.0005963 0.00% Gravity::applyMetricTerms() 2 0.0004865 0.0004978 0.0005102 0.00% Castro::clean_state() 79 0.0004077 0.0004512 0.0005092 0.00% MLMG::mgVcycle_up::0 128 0.000459 0.000472 0.0005071 0.00% FillPatchSingleLevel 147 0.0004626 0.0004767 0.0004947 0.00% Castro::do_advance_ctu() 20 0.0004223 0.0004491 0.0004897 0.00% MLMG::mgVcycle_up::1 128 0.0004482 0.0004652 0.0004837 0.00% makeSFC 95 0.0003589 0.000382 0.0004663 0.00% MLMG::mgVcycle_up::2 128 0.0003881 0.0004221 0.0004591 0.00% MLCellLinOp::solutionResidual() 147 0.000416 0.0004268 0.0004504 0.00% Castro::swap_state_time_levels() 8 0.0004073 0.0004182 0.0004494 0.00% MLMG::mgVcycle_up::5 128 0.0003984 0.0004095 0.0004485 0.00% MLMG::mgVcycle_up::3 128 0.0003804 0.0003948 0.0004325 0.00% MLMG::mgVcycle_up::4 128 0.0003863 0.0003988 0.0004226 0.00% MLMG::oneIter() 128 0.0003724 0.0003837 0.0004053 0.00% Castro::volProductSum() 2 0.000392 0.000398 0.0004052 0.00% MLLinOp::makeAgglomeratedDMap 19 0.000317 0.000332 0.000363 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.699e-05 7.95e-05 0.000348 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002058 0.0002223 0.0002495 0.00% DistributionMapping::Distribute() 95 0.0002014 0.0002152 0.0002477 0.00% MLMG::computeResidual() 128 0.0002367 0.0002417 0.0002464 0.00% Castro::problem_post_timestep() 2 1.012e-05 2.629e-05 0.0002458 0.00% MLMG::mgVcycle_bottom 128 0.0002192 0.0002272 0.0002409 0.00% Castro::finalize_do_advance() 17 0.0001523 0.0001724 0.0002111 0.00% Amr::coarseTimeStep() 1 0.0001532 0.0001758 0.0001805 0.00% Gravity::update_max_rhs() 2 0.0001561 0.0001647 0.0001792 0.00% OwnerMask() 2 0.0001338 0.0001517 0.0001703 0.00% Amr::defBaseLevel() 1 0.0001068 0.0001262 0.0001622 0.00% MLMG::compResidual() 1 0.0001539 0.0001571 0.0001606 0.00% TagBoxArray::mapPRD 2 0.0001063 0.0001174 0.0001409 0.00% MLPoisson::define() 19 0.0001216 0.0001287 0.0001395 0.00% Castro::retry_advance_ctu() 11 5.177e-05 5.921e-05 0.0001383 0.00% Castro::apply_problem_tags() 2 9.135e-05 9.747e-05 0.0001282 0.00% Amr::grid_places() 2 7.912e-05 0.0001011 0.0001281 0.00% Gravity::test_composite_phi() 1 9.156e-05 9.714e-05 0.0001262 0.00% Castro::initialize_advance() 1 9.917e-05 0.0001045 0.0001235 0.00% Castro::check_for_nan() 37 0.0001013 0.0001091 0.0001206 0.00% Castro::enforce_speed_limit() 79 9.904e-05 0.0001072 0.0001156 0.00% Castro::apply_source_to_state() 37 9.342e-05 0.0001001 0.0001099 0.00% DistributionMapping::LeastUsedCPUs() 1 2.041e-05 6.847e-05 9.632e-05 0.00% MLPoisson::prepareForSolve() 19 7.268e-05 8.007e-05 9.127e-05 0.00% MLLinOp::define() 19 7.611e-05 7.999e-05 8.435e-05 0.00% MultiFab::Swap() 5 6.369e-05 6.762e-05 8.413e-05 0.00% knapsack() 1 5.496e-05 5.94e-05 7.126e-05 0.00% Castro::create_source_corrector() 17 5.564e-05 6.217e-05 6.796e-05 0.00% Amr::FinalizeInit() 1 9.296e-06 3.154e-05 6.652e-05 0.00% Amr::initSubcycle() 1 5.656e-05 5.866e-05 6.084e-05 0.00% Castro::expand_state() 20 4.912e-05 5.368e-05 6.046e-05 0.00% Amr::regrid() 1 1.074e-05 1.414e-05 5.129e-05 0.00% MLMG::computeMLResidual() 18 4.143e-05 4.352e-05 4.708e-05 0.00% Castro::derive() 18 3.987e-05 4.193e-05 4.438e-05 0.00% MLMG::getGradSolution() 18 3.966e-05 4.063e-05 4.248e-05 0.00% Castro::advance() 1 7.336e-06 1.286e-05 3.979e-05 0.00% Gravity::swapTimeLevels() 8 3.146e-05 3.465e-05 3.866e-05 0.00% Amr::timeStep() 1 1.184e-05 1.714e-05 3.775e-05 0.00% MLMG::MLRhsNormInf() 18 3.103e-05 3.224e-05 3.682e-05 0.00% MLMG::MLResNormInf() 18 3.241e-05 3.433e-05 3.624e-05 0.00% Gravity::actual_multilevel_solve() 1 2.597e-05 2.758e-05 3.521e-05 0.00% Castro::construct_old_rotation_source() 20 3.008e-05 3.126e-05 3.477e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.16e-05 3.259e-05 3.466e-05 0.00% Castro::construct_new_rotation_source() 17 2.145e-05 2.216e-05 2.311e-05 0.00% Castro::post_regrid() 2 1.077e-05 1.491e-05 2.275e-05 0.00% Castro::finalize_advance() 1 1.599e-05 1.777e-05 2.242e-05 0.00% Castro::post_init() 1 1.198e-05 1.331e-05 2.087e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.618e-05 1.746e-05 1.928e-05 0.00% Castro::computeInitialDt() 2 7.593e-06 1.302e-05 1.893e-05 0.00% Gravity::set_mass_offset() 2 4.358e-06 8.611e-06 1.869e-05 0.00% Amr::InitializeInit() 1 6.597e-06 8.767e-06 1.795e-05 0.00% Castro::estTimeStep() 10 1.18e-05 1.348e-05 1.743e-05 0.00% Castro::errorEst() 2 6.071e-06 7.383e-06 1.291e-05 0.00% Amr::bldFineLevels() 1 7.2e-06 9.176e-06 1.224e-05 0.00% BoxList::parallelComplementIn() 4 7.156e-06 7.765e-06 1.136e-05 0.00% Amr::initialInit() 1 2.959e-06 5.097e-06 1.021e-05 0.00% Amr::init() 1 6.483e-06 7.324e-06 9.649e-06 0.00% BoxList::complementIn 4 6.056e-06 6.425e-06 7.926e-06 0.00% Castro::post_timestep() 1 5.237e-06 5.878e-06 7.055e-06 0.00% Castro::gwstrain() 2 4.106e-06 4.654e-06 6.85e-06 0.00% Castro::FluxRegCrseInit 1 1.533e-06 1.941e-06 3.505e-06 0.00% Castro::FluxRegFineAdd() 1 1.323e-06 1.465e-06 1.645e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.3 14.3 14.3 100.00% Amr::coarseTimeStep() 1 11.92 11.92 11.92 83.36% Amr::timeStep() 1 11.87 11.87 11.87 82.98% Castro::advance() 1 11.8 11.8 11.81 82.57% Castro::subcycle_advance_ctu() 1 11.75 11.75 11.76 82.22% Castro::do_advance_ctu() 20 11.71 11.72 11.72 81.95% Castro::construct_ctu_hydro_source() 20 6.424 6.461 6.501 45.47% Castro::clean_state() 79 3.665 3.796 3.971 27.77% Castro::computeTemp() 80 2.38 2.506 2.727 19.07% Castro::reset_internal_energy(MultiFab) 80 1.494 1.548 1.688 11.80% Gravity::solve_phi_with_mlmg() 19 1.451 1.501 1.546 10.81% Amr::InitAmr() 1 1.484 1.484 1.484 10.38% Castro::construct_new_gravity() 17 1.377 1.424 1.469 10.27% Castro::initialize_do_advance() 20 1.368 1.402 1.442 10.08% Gravity::solve_for_phi() 17 1.338 1.387 1.433 10.02% Gravity::actual_solve_with_mlmg() 19 1.25 1.253 1.258 8.80% MLMG::solve() 18 1.201 1.205 1.206 8.43% Castro::do_old_sources() 20 1.149 1.181 1.201 8.40% MLMG::oneIter() 128 1.069 1.071 1.073 7.50% MLMG::mgVcycle() 128 1.055 1.056 1.059 7.40% Castro::do_new_sources() 17 0.9381 0.9777 1.023 7.15% Castro::evaluate_source_change() 196 0.9506 0.9605 0.9738 6.81% FabArray::ParallelCopy() 1429 0.2708 0.7103 0.9507 6.65% Amr::init() 1 0.8936 0.8936 0.8936 6.25% Amr::initialInit() 1 0.8396 0.8396 0.8397 5.87% Castro::enforce_min_density() 79 0.7905 0.8052 0.829 5.80% amrex::Copy() 724 0.7683 0.7766 0.7936 5.55% FabArray::ParallelCopy_finish() 1429 0.04617 0.4867 0.7309 5.11% MLCellLinOp::smooth() 3072 0.5329 0.5823 0.7026 4.91% AmrLevel::FillPatch() 147 0.4633 0.5601 0.664 4.64% Amr::InitializeInit() 1 0.4499 0.5175 0.6113 4.28% Amr::defBaseLevel() 1 0.4499 0.5175 0.6113 4.28% Castro::normalize_species() 79 0.5374 0.5454 0.5707 3.99% MultiFab::AddProduct() 3439 0.5527 0.5575 0.5662 3.96% Castro::reset_internal_energy(Fab) 160 0.5215 0.5285 0.5387 3.77% FillPatchIterator::Initialize 147 0.2877 0.3848 0.4901 3.43% FillPatchIterator::FillFromLevel0() 147 0.2643 0.3667 0.474 3.32% FillPatchSingleLevel 147 0.2636 0.366 0.4734 3.31% MLMG::mgVcycle_up::1 128 0.09132 0.2487 0.4067 2.84% MLPoisson::Fsmooth() 6144 0.3105 0.3354 0.4052 2.83% Amr::FinalizeInit() 1 0.2283 0.3221 0.3897 2.73% Castro::Castro() 1 0.3673 0.3751 0.3873 2.71% Castro::initMFs() 1 0.3622 0.3696 0.382 2.67% FabArray::setVal() 5013 0.3531 0.3594 0.3668 2.57% MultiFab::Subtract() 159 0.3491 0.3519 0.3639 2.54% MLMG::addInterpCorrection() 768 0.06311 0.2921 0.3586 2.51% MLCellLinOp::applyBC() 7148 0.2553 0.29 0.3573 2.50% check_for_negative_density() 20 0.1015 0.2129 0.3084 2.16% Gravity::fill_multipole_BCs() 19 0.199 0.2458 0.2872 2.01% MLMG::mgVcycle_up::2 128 0.01057 0.1127 0.2685 1.88% FabArray::FillBoundary() 6380 0.1968 0.229 0.266 1.86% MLMG::mgVcycle_down::0 128 0.2548 0.2568 0.2592 1.81% Castro::initData() 1 0.08056 0.1408 0.2365 1.65% FabArray::ParallelCopy_nowait() 1429 0.2073 0.22 0.2355 1.65% Castro::expand_state() 20 0.1739 0.1869 0.2104 1.47% Amr::bldFineLevels() 1 0.04729 0.1407 0.2074 1.45% MLMG::mgVcycle_up::0 128 0.1928 0.1937 0.1951 1.36% FabArray::sum() 3439 0.1829 0.1867 0.1885 1.32% MLCellLinOp::apply() 986 0.1435 0.1536 0.1878 1.31% MLMG::mgVcycle_up::3 128 0.01043 0.02291 0.1733 1.21% Amr::grid_places() 2 0.003065 0.09685 0.1645 1.15% AmrMesh::MakeNewGrids() 2 0.002958 0.09675 0.1644 1.15% TagBoxArray::mapPRD 2 0.0007146 0.09483 0.1629 1.14% MLMG:computeResOfCorrection() 768 0.1079 0.1185 0.1413 0.99% MLCellLinOp::correctionResidual() 768 0.1065 0.117 0.1398 0.98% Castro::post_init() 1 0.1353 0.138 0.1384 0.97% FillBoundary_finish() 6380 0.09031 0.111 0.1334 0.93% Castro::construct_new_source() 102 0.123 0.1246 0.1286 0.90% FillBoundary_nowait() 6380 0.0807 0.1042 0.1282 0.90% Castro::create_source_corrector() 17 0.04728 0.08205 0.1166 0.82% MLMG::mgVcycle_down::1 128 0.1064 0.1099 0.113 0.79% MLPoisson::Fapply() 986 0.09342 0.09847 0.1124 0.79% Gravity::multilevel_solve_for_new_phi() 1 0.102 0.1021 0.1023 0.72% Gravity::actual_multilevel_solve() 1 0.102 0.102 0.1023 0.72% Amr::writePlotFile() 2 0.09968 0.09978 0.09979 0.70% MLCellLinOp::solutionResidual() 147 0.08594 0.09078 0.09579 0.67% Castro::post_regrid() 2 0.08675 0.08722 0.08985 0.63% Castro::construct_old_source() 120 0.07858 0.07936 0.08033 0.56% Castro::construct_old_gravity() 20 0.04773 0.05833 0.07861 0.55% MLMG::computeResidual() 128 0.07489 0.07563 0.0783 0.55% FabArray::Saxpy() 264 0.06888 0.07019 0.07709 0.54% Castro::derive() 18 0.06906 0.07014 0.07439 0.52% AmrLevel::derive() 18 0.06902 0.0701 0.07435 0.52% MLMG::mgVcycle_bottom 128 0.000353 0.004783 0.07105 0.50% MLMG::actualBottomSolve() 128 0.0001331 0.004556 0.07081 0.50% Castro::construct_new_gravity_source() 17 0.06806 0.06911 0.07027 0.49% MLCGSolver::bicgstab 8 0 0.004329 0.06927 0.48% MLMG::mgVcycle_down::2 128 0.01236 0.03882 0.0678 0.47% Gravity::get_old_grav_vector() 20 0.03849 0.05466 0.06585 0.46% Castro::post_timestep() 1 0.05835 0.06207 0.06482 0.45% FabArray::Xpay() 945 0.05116 0.05348 0.06066 0.42% MLMG::mgVcycle_down::3 128 0.01175 0.01762 0.05757 0.40% amrex::average_down 768 0.03178 0.03745 0.05198 0.36% Castro::initialize_advance() 1 0.04864 0.04969 0.05182 0.36% Amr::regrid() 1 0.04381 0.04486 0.04691 0.33% Castro::construct_old_gravity_source() 20 0.04549 0.04597 0.0469 0.33% Castro::check_for_nan() 37 0.04446 0.04513 0.04666 0.33% MultiFab::contains_nan() 37 0.04435 0.04502 0.04654 0.33% Castro::retry_advance_ctu() 11 0.03564 0.03644 0.03856 0.27% MLPoisson::define() 19 0.02878 0.03298 0.03808 0.27% Gravity::get_new_grav_vector() 18 0.03476 0.03584 0.03717 0.26% StateDataPhysBCFunct::() 147 0.0006386 0.01851 0.03483 0.24% MLMG::mgVcycle_down::4 128 0.01166 0.01324 0.0342 0.24% StateData::FillBoundary(geom) 143 0 0.01773 0.03397 0.24% Castro::apply_source_to_state() 37 0.02801 0.02844 0.02954 0.21% MLMG::mgVcycle_up::4 128 0.01049 0.01165 0.0265 0.19% VisMF::Write(FabArray) 4 0.01184 0.01305 0.02578 0.18% MLCellLinOp::defineAuxData() 19 0.01792 0.01944 0.02336 0.16% MLMG::prepareForSolve() 18 0.01999 0.02076 0.02303 0.16% MLMG::mgVcycle_down::5 128 0.01164 0.01249 0.02258 0.16% Castro::sum_integrated_quantities() 2 0.02201 0.02215 0.02216 0.15% Castro::save_data_for_retry() 3 0.01846 0.01903 0.02083 0.15% MLMG::ResNormInf() 146 0.01506 0.01852 0.02069 0.14% MLMG::mgVcycle_up::5 128 0.01059 0.01129 0.01913 0.13% MLMG::computeMLResidual() 18 0.01043 0.01471 0.01849 0.13% Castro::problem_post_timestep() 2 0.009336 0.01279 0.01583 0.11% Castro::wd_update() 2 0.00909 0.01277 0.01582 0.11% FabArray::norminf() 282 0.01082 0.01126 0.01525 0.11% Gravity::test_composite_phi() 1 0.0144 0.01467 0.01473 0.10% amrex::Add() 128 0.0137 0.01386 0.01443 0.10% FabArrayBase::getFB() 6380 0.01022 0.01091 0.01402 0.10% FabArrayBase::getCPC() 2005 0.009255 0.01048 0.01387 0.10% MLLinOp::define() 19 0.003935 0.007786 0.01196 0.08% MLLinOp::defineGrids() 19 0.003856 0.007706 0.01188 0.08% FabArray::setDomainBndry() 147 0.0004418 0.005942 0.01122 0.08% MLLinOp::makeSubCommunicator() 19 0.0009499 0.004943 0.00877 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005445 0.008712 0.06% Amr::writeSmallPlotFile() 2 0.0085 0.008501 0.008502 0.06% Castro::volWgtSum() 46 0.007296 0.007487 0.008498 0.06% MLMG::getGradSolution() 18 0.007238 0.007374 0.007587 0.05% MLCellLinOp::compGrad() 18 0.007196 0.007333 0.007545 0.05% FabArray::mult() 59 0.007113 0.007283 0.007533 0.05% FabArrayBase::CPC::define() 576 0.002159 0.003258 0.006324 0.04% amrex::Dot() 142 0 0.0003779 0.006046 0.04% MLCellLinOp::defineBC() 19 0.005359 0.005626 0.005846 0.04% Castro::volInBoundary() 14 0.00337 0.003735 0.005473 0.04% Gravity::update_max_rhs() 2 0.001443 0.004121 0.004613 0.03% BndryData::define() 19 0.003875 0.004102 0.004326 0.03% MultiFab::max() 2 0.0001407 0.002853 0.003347 0.02% MLPoisson::normalize() 79 0 0.0001907 0.003051 0.02% MLPoisson::prepareForSolve() 19 0.001712 0.001825 0.002112 0.01% MLCellLinOp::prepareForSolve() 19 0.001628 0.001745 0.002034 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.00136 0.001554 0.00178 0.01% Castro::enforce_consistent_e() 1 0.0003656 0.0005218 0.001736 0.01% FabArrayBase::FB::FB() 75 0.0002732 0.0006601 0.001418 0.01% AmrLevel::AmrLevel(dm) 1 0.001272 0.001304 0.001355 0.01% StateData::define() 6 0.00124 0.001271 0.001322 0.01% MLMG::MLResNormInf() 18 0.001244 0.001259 0.001296 0.01% Gravity::swapTimeLevels() 8 0.001167 0.001208 0.001287 0.01% MLMG::MLRhsNormInf() 18 0.001204 0.001219 0.001241 0.01% MLMG::compResidual() 1 0.0009375 0.001075 0.001241 0.01% Castro::locWgtSum() 6 0.001116 0.001127 0.001141 0.01% TagBoxArray::collate() 2 0.0002343 0.0006177 0.001108 0.01% MLLinOp::makeAgglomeratedDMap 19 0.00088 0.0009291 0.001048 0.01% MLCellLinOp::setLevelBC() 19 0.000539 0.0006702 0.0008683 0.01% Castro::errorEst() 2 0.0005311 0.0005955 0.0007456 0.01% makeSFC 95 0.000563 0.0005971 0.0006965 0.00% Castro::buildMetrics() 1 0.0006054 0.0006242 0.0006594 0.00% Castro::apply_tagging_restrictions() 2 0.0004295 0.0004907 0.0006083 0.00% Gravity::applyMetricTerms() 2 0.0004865 0.0004978 0.0005102 0.00% Castro::swap_state_time_levels() 8 0.0004073 0.0004182 0.0004494 0.00% Castro::volProductSum() 2 0.000392 0.000398 0.0004052 0.00% Castro::finalize_advance() 1 0.0002486 0.0002565 0.0002885 0.00% DistributionMapping::Distribute() 95 0.0002014 0.0002152 0.0002477 0.00% Castro::finalize_do_advance() 17 0.0001609 0.0001826 0.0002252 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001106 0.0001453 0.0001725 0.00% OwnerMask() 2 0.0001338 0.0001517 0.0001703 0.00% Castro::apply_problem_tags() 2 9.135e-05 9.747e-05 0.0001282 0.00% Castro::enforce_speed_limit() 79 9.904e-05 0.0001072 0.0001156 0.00% DistributionMapping::LeastUsedCPUs() 1 2.041e-05 6.847e-05 9.632e-05 0.00% MultiFab::Swap() 5 6.369e-05 6.762e-05 8.413e-05 0.00% knapsack() 1 5.496e-05 5.94e-05 7.126e-05 0.00% Amr::initSubcycle() 1 5.656e-05 5.866e-05 6.084e-05 0.00% Castro::construct_old_rotation_source() 20 3.008e-05 3.126e-05 3.477e-05 0.00% Castro::construct_new_rotation_source() 17 2.145e-05 2.216e-05 2.311e-05 0.00% Castro::computeInitialDt() 2 1.094e-05 1.628e-05 2.234e-05 0.00% BoxList::parallelComplementIn() 4 1.321e-05 1.419e-05 1.929e-05 0.00% Gravity::set_mass_offset() 2 4.358e-06 8.611e-06 1.869e-05 0.00% Castro::estTimeStep() 10 1.18e-05 1.348e-05 1.743e-05 0.00% BoxList::complementIn 4 6.056e-06 6.425e-06 7.926e-06 0.00% Castro::gwstrain() 2 4.106e-06 4.654e-06 6.85e-06 0.00% Castro::FluxRegCrseInit 1 1.533e-06 1.941e-06 3.505e-06 0.00% Castro::FluxRegFineAdd() 1 1.323e-06 1.465e-06 1.645e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 13 B 16 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.12-24-g75571e2dcbf2) finalized