Initializing AMReX (24.02-4-ga8bc0bfbcf10)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.02-4-ga8bc0bfbcf10) initialized Starting run at 09:20:31 UTC on 2024-02-06. Successfully read inputs file ... Castro git describe: 24.02-2-gcff739306 AMReX git describe: 24.02-4-ga8bc0bfbc Microphysics git describe: 24.02-6-g49fba8d7 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.488897041 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001032047 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.011607959 Gravity::multilevel_solve_for_new_phi() time = 0.09924342 Gravity::fill_multipole_BCs() time = 0.011509258 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049282549 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004080272 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.006045314 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065175199 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.008662129 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.064153078 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007858832 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060892113 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006141596 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060410771 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.315319278 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015446619 Gravity::solve_for_phi() time = 0.083958409 on level 0 Castro::construct_new_gravity() time = 0.086165187 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060946225 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.004774786 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060292094 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.317241444 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015186826 Gravity::solve_for_phi() time = 0.083902205 on level 0 Castro::construct_new_gravity() time = 0.086013996 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.060991828 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.004744993 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060402407 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.322882626 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015224347 Gravity::solve_for_phi() time = 0.083013413 on level 0 Castro::construct_new_gravity() time = 0.085105689 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.060410018 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.0048314 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060109758 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329174328 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01514083 Gravity::solve_for_phi() time = 0.0840792 on level 0 Castro::construct_new_gravity() time = 0.0861167 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.06052392 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.004413891 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059851545 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329830861 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015261377 Gravity::solve_for_phi() time = 0.083712393 on level 0 Castro::construct_new_gravity() time = 0.08580301 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060687494 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.004877454 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.067099723 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.371282517 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.020969894 Gravity::solve_for_phi() time = 0.094952548 on level 0 Castro::construct_new_gravity() time = 0.0969884 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.05992258 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.004505089 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059595437 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331228393 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015187498 Gravity::solve_for_phi() time = 0.083517571 on level 0 Castro::construct_new_gravity() time = 0.085646196 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060039669 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003639192 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059466852 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323264865 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015527297 Gravity::solve_for_phi() time = 0.083998714 on level 0 Castro::construct_new_gravity() time = 0.086028643 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.06023311 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.004365339 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.05953939 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329264169 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015469575 Gravity::solve_for_phi() time = 0.083698445 on level 0 Castro::construct_new_gravity() time = 0.085746056 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.060165595 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.004544849 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059970383 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323748047 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015571884 Gravity::solve_for_phi() time = 0.084482638 on level 0 Castro::construct_new_gravity() time = 0.086521339 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.060072287 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00390627 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059929997 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328717171 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015568579 Gravity::solve_for_phi() time = 0.084726175 on level 0 Castro::construct_new_gravity() time = 0.086758718 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.061295932 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.004794434 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059876767 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324493762 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015533896 Gravity::solve_for_phi() time = 0.083675006 on level 0 Castro::construct_new_gravity() time = 0.085784442 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.060175292 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.004289914 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.05960219 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329926949 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015669008 Gravity::solve_for_phi() time = 0.083967313 on level 0 Castro::construct_new_gravity() time = 0.086052687 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.06047368 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.004116861 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059360914 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324704894 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01616154 Gravity::solve_for_phi() time = 0.08436763 on level 0 Castro::construct_new_gravity() time = 0.08648912 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.060525914 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.004822744 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.060210049 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329525525 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015914058 Gravity::solve_for_phi() time = 0.084369149 on level 0 Castro::construct_new_gravity() time = 0.086397018 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.061477484 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.004783044 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.06029724 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325819826 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016608905 Gravity::solve_for_phi() time = 0.085246955 on level 0 Castro::construct_new_gravity() time = 0.087342745 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.061378684 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.005063441 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.06055382 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332230167 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0164666 Gravity::solve_for_phi() time = 0.085139264 on level 0 Castro::construct_new_gravity() time = 0.087257956 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.060939724 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.00278765006 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.81489502 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.048086761 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004116183 seconds Ending run at 09:20:46 UTC on 2024-02-06. Run time = 14.41395749 Run time without initialization = 11.86810287 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.41 ... 14.41 ... 14.41 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3866 5.4272 5.5003 38.16% Amr::InitAmr() 1 1.333 1.333 1.334 9.25% Castro::computeTemp() 80 0.838 0.9542 1.113 7.72% FabArray::ParallelCopy_finish() 1429 0.05049 0.7408 1.084 7.52% amrex::Copy() 724 0.7832 0.7882 0.7966 5.53% Castro::initMFs() 1 0.3556 0.4042 0.679 4.71% MultiFab::AddProduct() 3439 0.5625 0.5701 0.6362 4.41% Castro::normalize_species() 79 0.5437 0.5465 0.5587 3.88% Castro::reset_internal_energy(MultiFab) 80 0.0223 0.1172 0.5281 3.66% Castro::reset_internal_energy(Fab) 160 0.5183 0.5218 0.5255 3.65% FabArray::setVal() 5013 0.332 0.3457 0.4812 3.34% MLPoisson::Fsmooth() 6144 0.3141 0.3394 0.4109 2.85% MultiFab::Subtract() 159 0.3447 0.3461 0.3487 2.42% Gravity::fill_multipole_BCs() 19 0.1975 0.2504 0.2915 2.02% FabArray::ParallelCopy_nowait() 1429 0.1762 0.1921 0.2106 1.46% check_for_negative_density() 20 0.1186 0.1601 0.1916 1.33% FabArray::sum() 3439 0.1853 0.1859 0.1873 1.30% TagBoxArray::collate() 2 0.0001924 0.02071 0.1614 1.12% Castro::initData() 1 0.003352 0.02684 0.158 1.10% FillBoundary_finish() 6380 0.08881 0.1024 0.1261 0.88% FillBoundary_nowait() 6380 0.06932 0.09261 0.1224 0.85% MLPoisson::Fapply() 986 0.09387 0.09923 0.1126 0.78% MLCellLinOp::applyBC() 7148 0.04633 0.06176 0.1037 0.72% Castro::enforce_min_density() 79 0.01719 0.02896 0.08543 0.59% Castro::do_new_sources() 17 0.0003414 0.01412 0.07844 0.54% FabArray::Saxpy() 264 0.06772 0.0686 0.07567 0.52% Castro::do_old_sources() 20 0.0004676 0.01543 0.07202 0.50% Castro::construct_new_gravity_source() 17 0.0685 0.06932 0.0708 0.49% FabArray::Xpay() 945 0.05042 0.05254 0.05949 0.41% MLMG::addInterpCorrection() 768 0.03768 0.0404 0.04833 0.34% Castro::construct_old_gravity_source() 20 0.04556 0.04572 0.0461 0.32% MultiFab::contains_nan() 37 0.04355 0.04403 0.04546 0.32% AmrLevel::derive() 18 0.04068 0.04105 0.04362 0.30% StateData::FillBoundary(geom) 143 0 0.01714 0.03307 0.23% Castro::construct_old_gravity() 20 0.0003173 0.005351 0.03292 0.23% amrex::average_down 768 0.02428 0.02626 0.032 0.22% VisMF::Write(FabArray) 4 0.01202 0.01322 0.02463 0.17% Amr::writePlotFile() 2 0.007695 0.01735 0.01849 0.13% MLCellLinOp::defineAuxData() 19 0.01432 0.01524 0.01767 0.12% FabArray::FillBoundary() 6380 0.01313 0.01362 0.01659 0.12% Castro::construct_new_source() 102 0.01542 0.0156 0.01626 0.11% MLCGSolver::bicgstab 8 0 0.001016 0.01626 0.11% FabArray::norminf() 282 0.01072 0.01107 0.01521 0.11% Castro::wd_update() 2 0.004728 0.01078 0.01475 0.10% amrex::Add() 128 0.01374 0.01383 0.01391 0.10% Castro::evaluate_source_change() 196 0.01249 0.01274 0.01361 0.09% MLCellLinOp::smooth() 3072 0.01087 0.01137 0.01313 0.09% FillPatchIterator::Initialize 147 0.01207 0.0123 0.01276 0.09% FabArrayBase::getFB() 6380 0.009719 0.01008 0.01241 0.09% FabArray::setDomainBndry() 147 0.0004322 0.005998 0.01134 0.08% MLMG::prepareForSolve() 18 0.009782 0.01002 0.01094 0.08% Castro::construct_old_source() 120 0.00983 0.009934 0.01045 0.07% MultiFab::max() 2 0.0001708 0.005533 0.008167 0.06% FabArrayBase::getCPC() 2005 0.00712 0.007351 0.008115 0.06% Castro::volWgtSum() 46 0.007187 0.007299 0.008091 0.06% FabArray::mult() 59 0.007256 0.007392 0.007945 0.06% MLLinOp::makeSubCommunicator() 19 0.0005379 0.004085 0.007923 0.05% MLMG::ResNormInf() 146 0.002737 0.006035 0.007876 0.05% Gravity::actual_solve_with_mlmg() 19 0.00647 0.006743 0.007601 0.05% MLMG::solve() 18 0.0009519 0.001702 0.006747 0.05% Gravity::get_old_grav_vector() 20 0.00637 0.006447 0.006533 0.05% Gravity::get_new_grav_vector() 18 0.005934 0.006147 0.00651 0.05% FabArrayBase::CPC::define() 576 0.002128 0.003265 0.006235 0.04% amrex::Dot() 142 0 0.0003784 0.006055 0.04% MLCellLinOp::compGrad() 18 0.005604 0.005689 0.00577 0.04% Amr::writeSmallPlotFile() 2 0.003592 0.005228 0.005549 0.04% Castro::volInBoundary() 14 0.003369 0.003634 0.005355 0.04% Castro::initialize_do_advance() 20 0.004246 0.004434 0.005047 0.04% MLCGSolver::ParallelAllReduce 227 0 0.000314 0.005025 0.03% MLCellLinOp::apply() 986 0.001953 0.00218 0.004684 0.03% FabArray::ParallelCopy() 1429 0.003388 0.003522 0.003923 0.03% BndryData::define() 19 0.003067 0.003122 0.00335 0.02% MLPoisson::normalize() 79 0 0.0001906 0.003049 0.02% Castro::sum_integrated_quantities() 2 0.001648 0.002817 0.003002 0.02% AmrLevel::FillPatch() 147 0.00205 0.002133 0.002357 0.02% MLLinOp::defineGrids() 19 0.001713 0.001877 0.002195 0.02% MLCellLinOp::prepareForSolve() 19 0.001639 0.001799 0.002173 0.02% MLCellLinOp::correctionResidual() 768 0.001789 0.001839 0.001954 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001257 0.001514 0.001854 0.01% MLMG::mgVcycle() 128 0.00154 0.001609 0.00177 0.01% MLCellLinOp::defineBC() 19 0.001498 0.001544 0.001727 0.01% Castro::save_data_for_retry() 3 0.001252 0.001315 0.001668 0.01% StateData::define() 6 0.001254 0.001333 0.001661 0.01% MLMG:computeResOfCorrection() 768 0.001364 0.001414 0.001541 0.01% FabArrayBase::FB::FB() 75 0.0002708 0.0006584 0.001392 0.01% main() 1 0.0009452 0.00115 0.001353 0.01% Castro::locWgtSum() 6 0.001102 0.00112 0.001154 0.01% MLMG::actualBottomSolve() 128 0.0001298 0.0001903 0.00105 0.01% Gravity::solve_for_phi() 17 0.0007301 0.00085 0.001041 0.01% Castro::construct_new_gravity() 17 0.0002624 0.0004683 0.001029 0.01% Castro::buildMetrics() 1 0.0005416 0.0006085 0.0009525 0.01% StateDataPhysBCFunct::() 147 0.0006525 0.0007808 0.0008692 0.01% Castro::subcycle_advance_ctu() 1 0.0001752 0.0002348 0.0008621 0.01% MLCellLinOp::setLevelBC() 19 0.0005329 0.0006494 0.0008141 0.01% MLMG::mgVcycle_down::3 128 0.0005644 0.0006109 0.0007709 0.01% FillPatchIterator::FillFromLevel0() 147 0.000661 0.000691 0.000767 0.01% MLMG::mgVcycle_down::2 128 0.0006043 0.0006569 0.0007644 0.01% MLMG::mgVcycle_down::0 128 0.000643 0.0006573 0.0007204 0.00% MLMG::mgVcycle_down::1 128 0.000634 0.0006547 0.0007085 0.00% MLMG::mgVcycle_down::5 128 0.0005664 0.0005861 0.0006782 0.00% MLMG::mgVcycle_down::4 128 0.0005447 0.0005708 0.0006771 0.00% Castro::Castro() 1 0.0004424 0.0004918 0.0005681 0.00% AmrMesh::MakeNewGrids() 2 0.0004881 0.0005187 0.0005555 0.00% Castro::apply_tagging_restrictions() 2 0.0004231 0.0004854 0.0005431 0.00% FillPatchSingleLevel 147 0.0004699 0.0004818 0.0005267 0.00% MLMG::mgVcycle_up::1 128 0.0004386 0.0004634 0.0005207 0.00% MLMG::mgVcycle_up::0 128 0.0004495 0.0004663 0.0005134 0.00% MLMG::mgVcycle_up::2 128 0.0003833 0.0004194 0.0005024 0.00% Castro::do_advance_ctu() 20 0.0004068 0.0004406 0.0004968 0.00% Castro::clean_state() 79 0.0004105 0.0004372 0.0004928 0.00% Gravity::applyMetricTerms() 2 0.0004752 0.0004801 0.0004866 0.00% Castro::swap_state_time_levels() 8 0.0004063 0.0004255 0.0004762 0.00% MLMG::mgVcycle_up::3 128 0.0003769 0.0003941 0.0004756 0.00% MLMG::mgVcycle_up::5 128 0.0003946 0.0004113 0.0004583 0.00% MLCellLinOp::solutionResidual() 147 0.0004088 0.0004203 0.0004418 0.00% MLMG::mgVcycle_up::4 128 0.0003838 0.000393 0.0004377 0.00% makeSFC 95 0.000355 0.0003918 0.0004328 0.00% MLMG::oneIter() 128 0.0003666 0.000377 0.0004207 0.00% Castro::enforce_consistent_e() 1 0.0003672 0.0003848 0.0004159 0.00% Castro::volProductSum() 2 0.0003938 0.0003958 0.0004005 0.00% Castro::problem_post_timestep() 2 1.083e-05 3.411e-05 0.0003725 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003189 0.0003347 0.0003539 0.00% OwnerMask() 2 0.0001355 0.0001786 0.0003107 0.00% DistributionMapping::LeastUsedCPUs() 1 1.992e-05 0.0002287 0.0002753 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002112 0.0002261 0.0002692 0.00% Castro::retry_advance_ctu() 11 5.215e-05 7.331e-05 0.0002666 0.00% MLMG::mgVcycle_bottom 128 0.0002217 0.0002307 0.0002539 0.00% DistributionMapping::Distribute() 95 0.0002032 0.0002186 0.00025 0.00% MLMG::computeResidual() 128 0.0002304 0.0002362 0.0002432 0.00% TagBoxArray::mapPRD 2 0.0001088 0.0001232 0.0001953 0.00% Amr::coarseTimeStep() 1 0.0001549 0.0001821 0.0001877 0.00% Gravity::update_max_rhs() 2 0.0001585 0.0001639 0.000179 0.00% Castro::finalize_do_advance() 17 0.0001543 0.000165 0.0001747 0.00% Amr::grid_places() 2 7.27e-05 9.967e-05 0.000164 0.00% MLMG::compResidual() 1 0.0001527 0.000156 0.0001601 0.00% Castro::initialize_advance() 1 0.0001002 0.000109 0.000138 0.00% Amr::defBaseLevel() 1 8.796e-05 0.0001155 0.0001366 0.00% MLPoisson::define() 19 0.0001179 0.000124 0.0001342 0.00% Amr::initSubcycle() 1 5.592e-05 6.497e-05 0.0001247 0.00% Castro::check_for_nan() 37 9.775e-05 0.0001062 0.0001214 0.00% Castro::enforce_speed_limit() 79 0.0001017 0.0001079 0.0001182 0.00% Castro::apply_source_to_state() 37 8.754e-05 9.758e-05 0.0001143 0.00% Gravity::test_composite_phi() 1 8.86e-05 9.411e-05 0.0001085 0.00% Amr::FinalizeInit() 1 8.293e-06 1.962e-05 0.0001058 0.00% AmrLevel::AmrLevel(dm) 1 5.742e-05 7.479e-05 0.0001044 0.00% knapsack() 1 5.661e-05 6.535e-05 0.0001028 0.00% Castro::apply_problem_tags() 2 9.158e-05 9.489e-05 0.0001017 0.00% MLLinOp::define() 19 7.483e-05 8.077e-05 9.109e-05 0.00% MultiFab::Swap() 5 6.492e-05 7.046e-05 8.883e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.86e-05 6.35e-05 8.209e-05 0.00% MLPoisson::prepareForSolve() 19 6.665e-05 7.051e-05 7.547e-05 0.00% Castro::create_source_corrector() 17 5.311e-05 5.88e-05 6.951e-05 0.00% Castro::expand_state() 20 4.879e-05 5.32e-05 5.936e-05 0.00% MLMG::computeMLResidual() 18 4.063e-05 4.423e-05 4.825e-05 0.00% Amr::regrid() 1 1.083e-05 1.406e-05 4.622e-05 0.00% Castro::derive() 18 3.893e-05 4.105e-05 4.412e-05 0.00% MLMG::getGradSolution() 18 3.865e-05 3.986e-05 4.211e-05 0.00% Castro::computeInitialDt() 2 7.289e-06 1.588e-05 4.064e-05 0.00% MLMG::MLResNormInf() 18 3.354e-05 3.508e-05 3.813e-05 0.00% Gravity::swapTimeLevels() 8 3.156e-05 3.398e-05 3.764e-05 0.00% Castro::post_regrid() 2 1.031e-05 1.349e-05 3.675e-05 0.00% MLMG::MLRhsNormInf() 18 3.095e-05 3.18e-05 3.324e-05 0.00% Castro::construct_old_rotation_source() 20 3.014e-05 3.07e-05 3.249e-05 0.00% Gravity::actual_multilevel_solve() 1 2.585e-05 2.687e-05 2.941e-05 0.00% Castro::estTimeStep() 10 1.174e-05 1.389e-05 2.928e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.614e-05 1.895e-05 2.821e-05 0.00% Castro::construct_new_rotation_source() 17 2.066e-05 2.162e-05 2.308e-05 0.00% Amr::InitializeInit() 1 6.746e-06 9.365e-06 2.167e-05 0.00% Castro::finalize_advance() 1 1.602e-05 1.764e-05 2.089e-05 0.00% Gravity::set_mass_offset() 2 4.129e-06 9.596e-06 1.926e-05 0.00% Amr::timeStep() 1 1.171e-05 1.339e-05 1.924e-05 0.00% Castro::post_init() 1 1.159e-05 1.262e-05 1.59e-05 0.00% Amr::initialInit() 1 2.876e-06 4.519e-06 1.564e-05 0.00% Amr::bldFineLevels() 1 7.023e-06 8.641e-06 1.386e-05 0.00% Castro::advance() 1 7.423e-06 8.543e-06 1.246e-05 0.00% Amr::init() 1 6.558e-06 7.718e-06 1.107e-05 0.00% Castro::errorEst() 2 6.001e-06 6.87e-06 1.066e-05 0.00% BoxList::parallelComplementIn() 4 6.85e-06 7.349e-06 1.06e-05 0.00% BoxList::complementIn 4 5.873e-06 6.393e-06 9.177e-06 0.00% Castro::post_timestep() 1 5.637e-06 5.989e-06 6.77e-06 0.00% Castro::gwstrain() 2 4.149e-06 4.632e-06 6.067e-06 0.00% Castro::FluxRegCrseInit 1 1.64e-06 1.908e-06 2.225e-06 0.00% Castro::FluxRegFineAdd() 1 1.378e-06 1.517e-06 1.832e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.41 14.41 14.41 100.00% Amr::coarseTimeStep() 1 11.87 11.87 11.87 82.33% Amr::timeStep() 1 11.81 11.81 11.81 81.97% Castro::advance() 1 11.75 11.75 11.76 81.56% Castro::subcycle_advance_ctu() 1 11.7 11.7 11.7 81.20% Castro::do_advance_ctu() 20 11.66 11.66 11.67 80.95% Castro::construct_ctu_hydro_source() 20 6.328 6.366 6.407 44.45% Castro::clean_state() 79 3.682 3.795 4.01 27.82% Castro::computeTemp() 80 2.36 2.554 3.032 21.03% Castro::reset_internal_energy(MultiFab) 80 1.495 1.599 2.016 13.99% Gravity::solve_phi_with_mlmg() 19 1.453 1.509 1.551 10.76% Castro::construct_new_gravity() 17 1.38 1.434 1.475 10.23% Castro::initialize_do_advance() 20 1.364 1.419 1.466 10.17% Gravity::solve_for_phi() 17 1.343 1.398 1.44 9.99% Amr::InitAmr() 1 1.333 1.333 1.334 9.25% FabArray::ParallelCopy() 1429 0.2667 0.9559 1.296 8.99% Gravity::actual_solve_with_mlmg() 19 1.251 1.255 1.26 8.74% Amr::init() 1 1.212 1.212 1.212 8.41% Castro::do_old_sources() 20 1.141 1.186 1.21 8.40% MLMG::solve() 18 1.202 1.206 1.208 8.38% Amr::initialInit() 1 1.157 1.158 1.158 8.03% FabArray::ParallelCopy_finish() 1429 0.05049 0.7408 1.084 7.52% MLMG::oneIter() 128 1.075 1.076 1.078 7.48% MLMG::mgVcycle() 128 1.061 1.062 1.064 7.38% Castro::evaluate_source_change() 196 0.9518 0.9659 1.042 7.23% Castro::do_new_sources() 17 0.9325 0.9798 1.03 7.15% Amr::InitializeInit() 1 0.441 0.6033 0.9283 6.44% Amr::defBaseLevel() 1 0.441 0.6033 0.9283 6.44% Castro::enforce_min_density() 79 0.7921 0.8114 0.8747 6.07% amrex::Copy() 724 0.7832 0.7882 0.7966 5.53% Amr::FinalizeInit() 1 0.2294 0.5542 0.7166 4.97% MLCellLinOp::smooth() 3072 0.5282 0.5763 0.7026 4.87% AmrLevel::FillPatch() 147 0.4572 0.593 0.7025 4.87% Castro::Castro() 1 0.3607 0.4095 0.6866 4.76% Castro::initMFs() 1 0.3558 0.4044 0.6793 4.71% MultiFab::AddProduct() 3439 0.5625 0.5701 0.6362 4.41% Castro::normalize_species() 79 0.5437 0.5465 0.5587 3.88% Castro::initData() 1 0.07748 0.1919 0.5516 3.83% Amr::bldFineLevels() 1 0.04857 0.3717 0.5329 3.70% Castro::reset_internal_energy(Fab) 160 0.5183 0.5218 0.5255 3.65% FillPatchIterator::Initialize 147 0.2782 0.4135 0.524 3.64% FillPatchIterator::FillFromLevel0() 147 0.2547 0.3952 0.5076 3.52% FillPatchSingleLevel 147 0.254 0.3945 0.5069 3.52% Amr::grid_places() 2 0.00258 0.3276 0.49 3.40% AmrMesh::MakeNewGrids() 2 0.002416 0.3275 0.4899 3.40% TagBoxArray::mapPRD 2 0.0006458 0.3055 0.4878 3.38% FabArray::setVal() 5013 0.332 0.3457 0.4812 3.34% MLMG::mgVcycle_up::1 128 0.09098 0.2517 0.4116 2.86% MLPoisson::Fsmooth() 6144 0.3141 0.3394 0.4109 2.85% MLMG::addInterpCorrection() 768 0.06709 0.3031 0.3687 2.56% MLCellLinOp::applyBC() 7148 0.2455 0.2811 0.3506 2.43% MultiFab::Subtract() 159 0.3447 0.3461 0.3487 2.42% Gravity::fill_multipole_BCs() 19 0.1996 0.2525 0.2936 2.04% MLMG::mgVcycle_up::2 128 0.0106 0.1141 0.2729 1.89% MLMG::mgVcycle_down::0 128 0.2538 0.2556 0.2593 1.80% FabArray::FillBoundary() 6380 0.1868 0.2194 0.2469 1.71% Castro::expand_state() 20 0.1722 0.2012 0.2446 1.70% FabArray::ParallelCopy_nowait() 1429 0.1953 0.2116 0.2316 1.61% MLMG::mgVcycle_up::0 128 0.1927 0.193 0.1933 1.34% check_for_negative_density() 20 0.1186 0.1601 0.1916 1.33% FabArray::sum() 3439 0.1853 0.1859 0.1873 1.30% MLCellLinOp::apply() 986 0.1413 0.1554 0.1871 1.30% MLMG::mgVcycle_up::3 128 0.01047 0.02287 0.1717 1.19% TagBoxArray::collate() 2 0.0001924 0.02071 0.1614 1.12% Castro::post_init() 1 0.1334 0.1387 0.1413 0.98% MLMG:computeResOfCorrection() 768 0.1095 0.119 0.1411 0.98% MLCellLinOp::correctionResidual() 768 0.1081 0.1176 0.1395 0.97% FillBoundary_nowait() 6380 0.07936 0.1033 0.1349 0.94% Castro::construct_new_source() 102 0.1222 0.1233 0.1273 0.88% FillBoundary_finish() 6380 0.08881 0.1024 0.1261 0.88% Castro::construct_old_gravity() 20 0.04005 0.06742 0.1168 0.81% MLMG::mgVcycle_down::1 128 0.1089 0.1127 0.1159 0.80% Castro::create_source_corrector() 17 0.04654 0.08489 0.1159 0.80% MLPoisson::Fapply() 986 0.09387 0.09923 0.1126 0.78% Gravity::multilevel_solve_for_new_phi() 1 0.09921 0.09923 0.09927 0.69% Gravity::actual_multilevel_solve() 1 0.09915 0.09917 0.09919 0.69% Amr::writePlotFile() 2 0.0979 0.09799 0.098 0.68% MLCellLinOp::solutionResidual() 147 0.08416 0.09106 0.09599 0.67% Castro::post_regrid() 2 0.08527 0.08792 0.0932 0.65% Gravity::get_old_grav_vector() 20 0.03813 0.06207 0.08423 0.58% Castro::construct_old_source() 120 0.07775 0.07833 0.08125 0.56% MLMG::computeResidual() 128 0.07305 0.07384 0.0766 0.53% FabArray::Saxpy() 264 0.06772 0.0686 0.07567 0.52% Castro::derive() 18 0.06927 0.06975 0.07232 0.50% AmrLevel::derive() 18 0.06923 0.06971 0.07227 0.50% MLMG::mgVcycle_bottom 128 0.0003543 0.004792 0.07124 0.49% MLMG::actualBottomSolve() 128 0.0001298 0.004561 0.07098 0.49% Castro::construct_new_gravity_source() 17 0.0685 0.06932 0.0708 0.49% MLCGSolver::bicgstab 8 0 0.004341 0.06946 0.48% MLMG::mgVcycle_down::2 128 0.0123 0.03879 0.06796 0.47% Castro::post_timestep() 1 0.05876 0.06327 0.06631 0.46% MLMG::mgVcycle_down::3 128 0.01175 0.01788 0.06006 0.42% FabArray::Xpay() 945 0.05042 0.05254 0.05949 0.41% amrex::average_down 768 0.03214 0.03818 0.05486 0.38% Castro::initialize_advance() 1 0.04826 0.04917 0.05214 0.36% Amr::regrid() 1 0.04378 0.04519 0.04747 0.33% Castro::construct_old_gravity_source() 20 0.04556 0.04572 0.0461 0.32% Castro::check_for_nan() 37 0.04367 0.04414 0.04556 0.32% MultiFab::contains_nan() 37 0.04355 0.04403 0.04546 0.32% Castro::retry_advance_ctu() 11 0.03479 0.0361 0.04337 0.30% MLPoisson::define() 19 0.02814 0.03286 0.04137 0.29% Gravity::get_new_grav_vector() 18 0.03417 0.035 0.03574 0.25% MLMG::mgVcycle_down::4 128 0.01166 0.01328 0.03441 0.24% StateDataPhysBCFunct::() 147 0.0006525 0.01792 0.0339 0.24% StateData::FillBoundary(geom) 143 0 0.01714 0.03307 0.23% Castro::apply_source_to_state() 37 0.02773 0.02789 0.02812 0.20% MLMG::mgVcycle_up::4 128 0.01057 0.01175 0.02716 0.19% VisMF::Write(FabArray) 4 0.01202 0.01322 0.02463 0.17% MLCellLinOp::defineAuxData() 19 0.01833 0.02004 0.02408 0.17% MLMG::prepareForSolve() 18 0.01983 0.02076 0.02286 0.16% MLMG::mgVcycle_down::5 128 0.01168 0.01253 0.02283 0.16% Castro::sum_integrated_quantities() 2 0.0215 0.02177 0.02179 0.15% Castro::save_data_for_retry() 3 0.01878 0.01916 0.02087 0.14% MLMG::computeMLResidual() 18 0.01063 0.0167 0.01965 0.14% MLMG::mgVcycle_up::5 128 0.01067 0.01136 0.01949 0.14% Castro::problem_post_timestep() 2 0.009229 0.01445 0.01813 0.13% Castro::wd_update() 2 0.009121 0.01442 0.01812 0.13% MLMG::ResNormInf() 146 0.01223 0.01554 0.0174 0.12% FabArray::norminf() 282 0.01072 0.01107 0.01521 0.11% Gravity::test_composite_phi() 1 0.01496 0.01499 0.015 0.10% FabArrayBase::getCPC() 2005 0.009339 0.01062 0.01401 0.10% amrex::Add() 128 0.01374 0.01383 0.01391 0.10% FabArrayBase::getFB() 6380 0.01004 0.01074 0.0138 0.10% FabArray::setDomainBndry() 147 0.0004322 0.005998 0.01134 0.08% MLLinOp::define() 19 0.003311 0.006988 0.0112 0.08% MLLinOp::defineGrids() 19 0.003231 0.006907 0.01112 0.08% Gravity::update_max_rhs() 2 0.001413 0.006763 0.00941 0.07% Amr::writeSmallPlotFile() 2 0.008636 0.008637 0.008639 0.06% MLCGSolver::ParallelAllReduce 227 0 0.00052 0.008319 0.06% MultiFab::max() 2 0.0001708 0.005533 0.008167 0.06% Castro::volWgtSum() 46 0.007187 0.007299 0.008091 0.06% FabArray::mult() 59 0.007256 0.007392 0.007945 0.06% MLLinOp::makeSubCommunicator() 19 0.0005379 0.004085 0.007923 0.05% MLMG::getGradSolution() 18 0.007166 0.007344 0.0075 0.05% MLCellLinOp::compGrad() 18 0.007128 0.007304 0.00746 0.05% MLCellLinOp::defineBC() 19 0.005463 0.005703 0.00632 0.04% FabArrayBase::CPC::define() 576 0.002128 0.003265 0.006235 0.04% amrex::Dot() 142 0 0.0003784 0.006055 0.04% Castro::volInBoundary() 14 0.003369 0.003634 0.005355 0.04% BndryData::define() 19 0.003957 0.004159 0.004593 0.03% MLPoisson::normalize() 79 0 0.0001906 0.003049 0.02% MLPoisson::prepareForSolve() 19 0.001713 0.00187 0.002248 0.02% MLCellLinOp::prepareForSolve() 19 0.001639 0.001799 0.002173 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001257 0.001514 0.001854 0.01% AmrLevel::AmrLevel(dm) 1 0.001333 0.001408 0.001758 0.01% StateData::define() 6 0.001254 0.001333 0.001661 0.01% Gravity::swapTimeLevels() 8 0.001107 0.001173 0.001501 0.01% FabArrayBase::FB::FB() 75 0.0002708 0.0006584 0.001392 0.01% MLMG::compResidual() 1 0.0009299 0.001159 0.001266 0.01% MLMG::MLResNormInf() 18 0.00123 0.001244 0.001265 0.01% MLMG::MLRhsNormInf() 18 0.001183 0.001191 0.001223 0.01% Castro::locWgtSum() 6 0.001102 0.00112 0.001154 0.01% Castro::buildMetrics() 1 0.0005997 0.0006727 0.001043 0.01% MLLinOp::makeAgglomeratedDMap 19 0.000881 0.0009451 0.001007 0.01% MLCellLinOp::setLevelBC() 19 0.0005329 0.0006494 0.0008141 0.01% makeSFC 95 0.00056 0.0006104 0.0006547 0.00% Castro::errorEst() 2 0.0005253 0.0005871 0.0006491 0.00% Castro::apply_tagging_restrictions() 2 0.0004231 0.0004854 0.0005431 0.00% Gravity::applyMetricTerms() 2 0.0004752 0.0004801 0.0004866 0.00% Castro::swap_state_time_levels() 8 0.0004063 0.0004255 0.0004762 0.00% Castro::enforce_consistent_e() 1 0.0003672 0.0003848 0.0004159 0.00% Castro::volProductSum() 2 0.0003938 0.0003958 0.0004005 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001201 0.000313 0.0003548 0.00% OwnerMask() 2 0.0001355 0.0001786 0.0003107 0.00% Castro::finalize_advance() 1 0.0002547 0.0002625 0.0002924 0.00% DistributionMapping::LeastUsedCPUs() 1 1.992e-05 0.0002287 0.0002753 0.00% DistributionMapping::Distribute() 95 0.0002032 0.0002186 0.00025 0.00% Castro::finalize_do_advance() 17 0.0001641 0.0001746 0.0001849 0.00% Amr::initSubcycle() 1 5.592e-05 6.497e-05 0.0001247 0.00% Castro::enforce_speed_limit() 79 0.0001017 0.0001079 0.0001182 0.00% knapsack() 1 5.661e-05 6.535e-05 0.0001028 0.00% Castro::apply_problem_tags() 2 9.158e-05 9.489e-05 0.0001017 0.00% MultiFab::Swap() 5 6.492e-05 7.046e-05 8.883e-05 0.00% Castro::computeInitialDt() 2 1.024e-05 2.022e-05 4.592e-05 0.00% Castro::construct_old_rotation_source() 20 3.014e-05 3.07e-05 3.249e-05 0.00% Castro::estTimeStep() 10 1.174e-05 1.389e-05 2.928e-05 0.00% Castro::construct_new_rotation_source() 17 2.066e-05 2.162e-05 2.308e-05 0.00% BoxList::parallelComplementIn() 4 1.282e-05 1.374e-05 1.977e-05 0.00% Gravity::set_mass_offset() 2 4.129e-06 9.596e-06 1.926e-05 0.00% BoxList::complementIn 4 5.873e-06 6.393e-06 9.177e-06 0.00% Castro::gwstrain() 2 4.149e-06 4.632e-06 6.067e-06 0.00% Castro::FluxRegCrseInit 1 1.64e-06 1.908e-06 2.225e-06 0.00% Castro::FluxRegFineAdd() 1 1.378e-06 1.517e-06 1.832e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 12 B 15 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.02-4-ga8bc0bfbcf10) finalized