Initializing AMReX (23.12-18-g3497f016d920)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.12-18-g3497f016d920) initialized Starting run at 04:54:31 UTC on 2023-12-18. Successfully read inputs file ... Castro git describe: 23.12-38-g2543d6c45 AMReX git describe: 23.12-18-g3497f016d Microphysics git describe: 23.12-3-g96f4c7ef reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.154723021 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000971375 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010256701 Gravity::multilevel_solve_for_new_phi() time = 0.094962031 Gravity::fill_multipole_BCs() time = 0.010263358 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.047088246 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.00398348 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002592252 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.064170744 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.002681119 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.063414651 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003173638 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.059932191 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.002787809 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058659476 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.316059756 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014111271 Gravity::solve_for_phi() time = 0.081748407 on level 0 Castro::construct_new_gravity() time = 0.083786818 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.059181716 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002516006 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058643058 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.317454703 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014536124 Gravity::solve_for_phi() time = 0.081957182 on level 0 Castro::construct_new_gravity() time = 0.083971414 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.059221954 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002578266 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058725376 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321409914 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017862831 Gravity::solve_for_phi() time = 0.12361622 on level 0 Castro::construct_new_gravity() time = 0.125705056 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.060834845 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003752564 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059788966 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325160715 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014394301 Gravity::solve_for_phi() time = 0.082242629 on level 0 Castro::construct_new_gravity() time = 0.084274566 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.059310405 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002658114 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058678385 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327855398 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014538804 Gravity::solve_for_phi() time = 0.082408132 on level 0 Castro::construct_new_gravity() time = 0.0844155 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.05960755 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.010015771 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058721694 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323343719 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015247239 Gravity::solve_for_phi() time = 0.083150958 on level 0 Castro::construct_new_gravity() time = 0.085192532 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.059970624 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002911028 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058886031 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32911799 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014435327 Gravity::solve_for_phi() time = 0.081888963 on level 0 Castro::construct_new_gravity() time = 0.083973684 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059064741 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002703511 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058620289 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323717869 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014824094 Gravity::solve_for_phi() time = 0.082415796 on level 0 Castro::construct_new_gravity() time = 0.084474919 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.059743269 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002648263 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058708838 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.341321619 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014840795 Gravity::solve_for_phi() time = 0.082721145 on level 0 Castro::construct_new_gravity() time = 0.084750464 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059218903 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002537752 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058599558 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323677886 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014822437 Gravity::solve_for_phi() time = 0.084690325 on level 0 Castro::construct_new_gravity() time = 0.086728624 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.05951522 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003281807 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059723952 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329182886 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014902914 Gravity::solve_for_phi() time = 0.082953873 on level 0 Castro::construct_new_gravity() time = 0.084993089 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059417343 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002569705 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058689828 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324416704 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014997734 Gravity::solve_for_phi() time = 0.082590026 on level 0 Castro::construct_new_gravity() time = 0.084614661 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059095915 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002561835 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058620955 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329313734 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015013306 Gravity::solve_for_phi() time = 0.082552107 on level 0 Castro::construct_new_gravity() time = 0.084593766 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059326148 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002690899 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059058961 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330830254 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015140575 Gravity::solve_for_phi() time = 0.082593413 on level 0 Castro::construct_new_gravity() time = 0.084617788 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059887589 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002653535 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058434532 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33058398 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015149252 Gravity::solve_for_phi() time = 0.083140306 on level 0 Castro::construct_new_gravity() time = 0.085218894 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059850434 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002642669 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058589964 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33008844 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015480131 Gravity::solve_for_phi() time = 0.084015664 on level 0 Castro::construct_new_gravity() time = 0.086054494 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059276115 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002560942 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.0586616 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329729728 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015334145 Gravity::solve_for_phi() time = 0.094406626 on level 0 Castro::construct_new_gravity() time = 0.096450626 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.074500623 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002807346146 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.14641781 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.054876889 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004077623 seconds Ending run at 04:54:46 UTC on 2023-12-18. Run time = 14.82700888 Run time without initialization = 12.20623118 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.83 ... 14.83 ... 14.83 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3790 5.4276 5.4896 37.02% Amr::InitAmr() 1 1.754 1.754 1.754 11.83% Castro::computeTemp() 80 0.8451 0.9609 1.122 7.57% amrex::Copy() 724 0.7708 0.776 0.7883 5.32% FabArray::ParallelCopy_finish() 1429 0.05602 0.4638 0.6591 4.44% MultiFab::AddProduct() 3439 0.5452 0.5524 0.616 4.15% Castro::normalize_species() 79 0.5478 0.5518 0.5736 3.87% Castro::reset_internal_energy(Fab) 160 0.5241 0.528 0.5335 3.60% MLPoisson::Fsmooth() 6144 0.3168 0.3439 0.4109 2.77% Castro::sum_integrated_quantities() 2 0.002161 0.3635 0.388 2.62% Castro::problem_post_timestep() 2 1.04e-05 0.02412 0.3858 2.60% FabArray::setVal() 5021 0.3596 0.3627 0.3699 2.49% MultiFab::Subtract() 159 0.3501 0.3521 0.3624 2.44% Castro::initMFs() 1 0.3573 0.359 0.3615 2.44% Gravity::fill_multipole_BCs() 19 0.197 0.2336 0.2734 1.84% FabArray::ParallelCopy_nowait() 1429 0.1811 0.1967 0.2128 1.44% Castro::reset_internal_energy(MultiFab) 80 0.02224 0.06216 0.2038 1.37% FabArray::sum() 3439 0.1851 0.186 0.1903 1.28% check_for_negative_density() 20 0.03868 0.1151 0.1709 1.15% FillBoundary_finish() 6388 0.08802 0.1234 0.1572 1.06% Castro::initData() 1 0.003292 0.0264 0.154 1.04% FillBoundary_nowait() 6388 0.07063 0.09421 0.1199 0.81% MLPoisson::Fapply() 994 0.09253 0.0971 0.1116 0.75% MLCellLinOp::applyBC() 7156 0.04594 0.06123 0.1024 0.69% FabArray::Saxpy() 264 0.07024 0.07128 0.07867 0.53% Castro::do_new_sources() 17 0.0003295 0.0132 0.07676 0.52% Castro::construct_new_gravity_source() 17 0.06734 0.06824 0.06998 0.47% FabArray::Xpay() 953 0.05162 0.05404 0.06132 0.41% Castro::enforce_min_density() 79 0.01722 0.02648 0.05706 0.38% Castro::wd_update() 2 0.00438 0.04532 0.05634 0.38% Castro::construct_old_gravity_source() 20 0.04586 0.04602 0.04652 0.31% MultiFab::contains_nan() 37 0.04439 0.04461 0.0454 0.31% MLMG::addInterpCorrection() 768 0.0325 0.03485 0.04141 0.28% AmrLevel::derive() 18 0.04063 0.04084 0.04134 0.28% Castro::do_old_sources() 20 0.0004647 0.008718 0.03937 0.27% StateData::FillBoundary(geom) 143 0 0.01767 0.03398 0.23% amrex::average_down 768 0.02437 0.02634 0.03198 0.22% Castro::construct_old_gravity() 20 0.0003373 0.003654 0.02446 0.16% Amr::writePlotFile() 2 0.01506 0.02309 0.02396 0.16% VisMF::Write(FabArray) 4 0.01189 0.01295 0.02266 0.15% MLCGSolver::bicgstab 8 0 0.001059 0.01694 0.11% FabArray::FillBoundary() 6388 0.01326 0.01368 0.01643 0.11% MLCellLinOp::defineAuxData() 19 0.01399 0.01462 0.01625 0.11% Castro::construct_new_source() 102 0.01542 0.01549 0.0157 0.11% FabArray::norminf() 282 0.01078 0.01123 0.01513 0.10% amrex::Add() 136 0.01414 0.0143 0.01503 0.10% Castro::evaluate_source_change() 196 0.01248 0.01284 0.01353 0.09% FillPatchIterator::Initialize 147 0.01205 0.01233 0.01302 0.09% MLCellLinOp::smooth() 3072 0.01101 0.01149 0.01284 0.09% FabArrayBase::getFB() 6388 0.009818 0.01017 0.01269 0.09% MLMG::ResNormInf() 146 0.003698 0.009085 0.01262 0.09% FabArray::setDomainBndry() 147 0.0004461 0.006002 0.0111 0.07% MLMG::prepareForSolve() 18 0.009696 0.009909 0.01052 0.07% Castro::construct_old_source() 120 0.009742 0.009836 0.01015 0.07% Castro::volWgtSum() 46 0.00722 0.007396 0.008599 0.06% MLLinOp::makeSubCommunicator() 19 0.0008394 0.004414 0.008376 0.06% FabArray::mult() 59 0.007071 0.007143 0.0077 0.05% FabArrayBase::getCPC() 2005 0.006956 0.007146 0.00758 0.05% Gravity::actual_solve_with_mlmg() 19 0.006429 0.006675 0.007478 0.05% Gravity::get_old_grav_vector() 20 0.006339 0.006415 0.006579 0.04% Castro::volInBoundary() 14 0.003399 0.003709 0.006377 0.04% FabArrayBase::CPC::define() 576 0.002119 0.003217 0.006178 0.04% Gravity::get_new_grav_vector() 18 0.005933 0.005993 0.00612 0.04% MLMG::solve() 18 0.0009475 0.00297 0.006071 0.04% amrex::Dot() 142 0 0.0003747 0.005996 0.04% MLCellLinOp::compGrad() 18 0.005639 0.005698 0.005855 0.04% Amr::writeSmallPlotFile() 2 0.00347 0.005098 0.005516 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003194 0.005111 0.03% MLCellLinOp::apply() 994 0.001961 0.002197 0.004889 0.03% Castro::initialize_do_advance() 20 0.004283 0.004369 0.004617 0.03% FabArray::ParallelCopy() 1429 0.003396 0.003523 0.003787 0.03% BndryData::define() 19 0.002955 0.003015 0.003215 0.02% MLPoisson::normalize() 79 0 0.0001937 0.0031 0.02% Castro::construct_new_gravity() 17 0.000259 0.0006086 0.002437 0.02% AmrLevel::FillPatch() 147 0.002074 0.002149 0.002394 0.02% MLCellLinOp::correctionResidual() 776 0.001815 0.001884 0.002299 0.02% MLLinOp::defineGrids() 19 0.00171 0.00182 0.002108 0.01% MLCellLinOp::prepareForSolve() 19 0.001644 0.00178 0.002062 0.01% MultiFab::max() 2 0.0001734 0.001187 0.00205 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001281 0.00153 0.001767 0.01% MLMG::mgVcycle() 128 0.001507 0.001582 0.001748 0.01% MLCellLinOp::defineBC() 19 0.001463 0.001507 0.001588 0.01% MLMG:computeResOfCorrection() 768 0.001382 0.00144 0.001547 0.01% FabArrayBase::FB::FB() 75 0.0002747 0.0006642 0.001427 0.01% main() 1 0.0009229 0.001128 0.001321 0.01% StateData::define() 6 0.001281 0.001297 0.001318 0.01% Castro::save_data_for_retry() 3 0.001211 0.001246 0.00126 0.01% Castro::locWgtSum() 6 0.001121 0.001147 0.001227 0.01% Gravity::solve_for_phi() 17 0.0007324 0.0008352 0.00113 0.01% MLMG::actualBottomSolve() 128 0.000131 0.0001931 0.001071 0.01% Castro::volProductSum() 2 0.0003872 0.0004279 0.0009587 0.01% StateDataPhysBCFunct::() 147 0.000642 0.0007727 0.0009148 0.01% MLCellLinOp::setLevelBC() 19 0.0005245 0.0006546 0.0008229 0.01% TagBoxArray::collate() 2 9.583e-05 0.0004155 0.0008128 0.01% MLMG::mgVcycle_down::2 128 0.0005992 0.0006513 0.0007501 0.01% FillPatchIterator::FillFromLevel0() 147 0.000676 0.0006953 0.0007387 0.00% MLMG::mgVcycle_down::1 128 0.0006434 0.0006614 0.0007275 0.00% MLMG::mgVcycle_down::0 128 0.0006578 0.0006733 0.0007155 0.00% Castro::subcycle_advance_ctu() 1 0.0001775 0.0002296 0.0006905 0.00% MLMG::mgVcycle_down::3 128 0.000564 0.000606 0.0006804 0.00% MLMG::mgVcycle_down::4 128 0.000553 0.0005754 0.0006611 0.00% MLMG::mgVcycle_down::5 128 0.0005717 0.0005905 0.000656 0.00% Castro::do_advance_ctu() 20 0.0004106 0.0004525 0.0006244 0.00% Castro::Castro() 1 0.000478 0.0005396 0.0006058 0.00% Castro::buildMetrics() 1 0.0005598 0.0005706 0.0005926 0.00% AmrMesh::MakeNewGrids() 2 0.0004967 0.0005089 0.000534 0.00% Castro::apply_tagging_restrictions() 2 0.0004144 0.0004756 0.0005263 0.00% MLMG::mgVcycle_up::0 128 0.000449 0.0004624 0.0005117 0.00% MLMG::mgVcycle_up::1 128 0.0004421 0.0004593 0.0005112 0.00% FillPatchSingleLevel 147 0.0004507 0.0004706 0.000495 0.00% Castro::clean_state() 79 0.0004156 0.0004375 0.0004925 0.00% Gravity::applyMetricTerms() 2 0.0004756 0.0004825 0.0004887 0.00% MLMG::mgVcycle_up::2 128 0.0003825 0.0004193 0.0004825 0.00% MLCellLinOp::solutionResidual() 147 0.0004183 0.0004263 0.0004486 0.00% MLMG::mgVcycle_up::5 128 0.0003939 0.0004081 0.0004412 0.00% MLMG::mgVcycle_up::3 128 0.0003784 0.0003957 0.0004342 0.00% Castro::swap_state_time_levels() 8 0.0004043 0.0004151 0.0004326 0.00% MLMG::mgVcycle_up::4 128 0.0003821 0.0003954 0.00043 0.00% MLMG::oneIter() 128 0.0003788 0.0003899 0.0004297 0.00% Castro::enforce_consistent_e() 1 0.0003658 0.0003756 0.0004267 0.00% makeSFC 95 0.0003518 0.0003707 0.0004146 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003197 0.0003299 0.0003508 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002148 0.0002262 0.0002565 0.00% MLMG::computeResidual() 128 0.0002353 0.0002417 0.0002511 0.00% MLMG::mgVcycle_bottom 128 0.0002222 0.0002301 0.0002389 0.00% DistributionMapping::Distribute() 95 0.0002012 0.0002112 0.0002261 0.00% Castro::finalize_do_advance() 17 0.0001546 0.0001741 0.0002092 0.00% Gravity::update_max_rhs() 2 0.0001549 0.0001585 0.0001659 0.00% OwnerMask() 2 0.0001321 0.0001473 0.000159 0.00% MLMG::compResidual() 1 0.0001554 0.0001561 0.0001571 0.00% Castro::retry_advance_ctu() 11 5.168e-05 6.035e-05 0.0001372 0.00% MLPoisson::define() 19 0.0001173 0.0001268 0.0001363 0.00% TagBoxArray::mapPRD 2 0.0001057 0.0001145 0.0001244 0.00% Amr::defBaseLevel() 1 9.255e-05 0.0001044 0.0001201 0.00% Castro::check_for_nan() 37 9.956e-05 0.0001086 0.0001199 0.00% Castro::enforce_speed_limit() 79 0.0001014 0.0001062 0.0001146 0.00% Amr::coarseTimeStep() 1 8.597e-05 0.000106 0.0001121 0.00% Castro::apply_source_to_state() 37 9.276e-05 9.747e-05 0.0001105 0.00% Gravity::test_composite_phi() 1 8.94e-05 9.463e-05 0.0001083 0.00% Castro::initialize_advance() 1 9.833e-05 0.000101 0.0001053 0.00% Castro::apply_problem_tags() 2 9.199e-05 9.368e-05 9.829e-05 0.00% Amr::grid_places() 2 7.23e-05 8.407e-05 9.675e-05 0.00% MLLinOp::define() 19 7.271e-05 7.672e-05 8.46e-05 0.00% MLPoisson::prepareForSolve() 19 7.004e-05 7.55e-05 8.242e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.715e-05 6.029e-05 7.373e-05 0.00% MultiFab::Swap() 5 6.452e-05 6.652e-05 7.235e-05 0.00% Amr::FinalizeInit() 1 8.417e-06 1.975e-05 6.562e-05 0.00% Castro::create_source_corrector() 17 5.3e-05 5.871e-05 6.548e-05 0.00% knapsack() 1 5.531e-05 5.824e-05 6.146e-05 0.00% Amr::initSubcycle() 1 5.453e-05 5.739e-05 5.912e-05 0.00% Castro::expand_state() 20 4.746e-05 5.232e-05 5.772e-05 0.00% MLMG::computeMLResidual() 18 4.166e-05 4.422e-05 5.161e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.696e-05 3.651e-05 5.017e-05 0.00% Gravity::swapTimeLevels() 8 3.207e-05 3.436e-05 4.692e-05 0.00% Castro::derive() 18 3.967e-05 4.191e-05 4.567e-05 0.00% MLMG::getGradSolution() 18 3.787e-05 3.924e-05 4.074e-05 0.00% MLMG::MLResNormInf() 18 3.28e-05 3.477e-05 3.853e-05 0.00% MLMG::MLRhsNormInf() 18 3.272e-05 3.397e-05 3.781e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.248e-05 3.338e-05 3.645e-05 0.00% Castro::advance() 1 6.87e-06 1.087e-05 3.187e-05 0.00% Castro::construct_old_rotation_source() 20 2.962e-05 3.04e-05 3.141e-05 0.00% Amr::regrid() 1 1.094e-05 1.268e-05 3.059e-05 0.00% Gravity::actual_multilevel_solve() 1 2.557e-05 2.643e-05 2.737e-05 0.00% Castro::construct_new_rotation_source() 17 2.15e-05 2.255e-05 2.711e-05 0.00% Castro::post_regrid() 2 1.05e-05 1.378e-05 2.53e-05 0.00% Amr::bldFineLevels() 1 6.678e-06 8.61e-06 2.065e-05 0.00% Castro::finalize_advance() 1 1.596e-05 1.734e-05 2.008e-05 0.00% Amr::timeStep() 1 1.216e-05 1.432e-05 1.914e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.603e-05 1.744e-05 1.887e-05 0.00% Amr::InitializeInit() 1 6.292e-06 8.398e-06 1.793e-05 0.00% Castro::estTimeStep() 10 1.164e-05 1.342e-05 1.695e-05 0.00% Castro::post_init() 1 1.153e-05 1.247e-05 1.661e-05 0.00% Amr::initialInit() 1 2.763e-06 3.96e-06 1.446e-05 0.00% Amr::init() 1 6.153e-06 7.253e-06 1.089e-05 0.00% Castro::computeInitialDt() 2 7.253e-06 8.235e-06 1.03e-05 0.00% BoxList::parallelComplementIn() 4 6.867e-06 7.242e-06 9.233e-06 0.00% Castro::post_timestep() 1 5.339e-06 6.249e-06 8.789e-06 0.00% BoxList::complementIn 4 5.866e-06 6.213e-06 8.184e-06 0.00% Gravity::set_mass_offset() 2 4.232e-06 4.968e-06 7.564e-06 0.00% Castro::errorEst() 2 5.985e-06 6.264e-06 6.781e-06 0.00% Castro::gwstrain() 2 4.074e-06 4.695e-06 5.885e-06 0.00% Castro::FluxRegCrseInit 1 1.615e-06 1.864e-06 2.463e-06 0.00% Castro::FluxRegFineAdd() 1 1.388e-06 1.458e-06 1.561e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.83 14.83 14.83 100.00% Amr::coarseTimeStep() 1 12.21 12.21 12.21 82.32% Amr::timeStep() 1 12.15 12.15 12.15 81.92% Castro::advance() 1 11.65 11.66 11.67 78.72% Castro::subcycle_advance_ctu() 1 11.6 11.61 11.62 78.39% Castro::do_advance_ctu() 20 11.57 11.57 11.59 78.13% Castro::construct_ctu_hydro_source() 20 6.291 6.322 6.357 42.88% Castro::clean_state() 79 3.661 3.807 3.952 26.65% Castro::computeTemp() 80 2.377 2.506 2.715 18.31% Amr::InitAmr() 1 1.754 1.754 1.754 11.83% Castro::reset_internal_energy(MultiFab) 80 1.495 1.545 1.684 11.36% Gravity::solve_phi_with_mlmg() 19 1.481 1.52 1.564 10.55% Castro::construct_new_gravity() 17 1.412 1.451 1.494 10.08% Gravity::solve_for_phi() 17 1.376 1.415 1.459 9.84% Castro::initialize_do_advance() 20 1.356 1.381 1.405 9.48% Gravity::actual_solve_with_mlmg() 19 1.279 1.283 1.288 8.69% MLMG::solve() 18 1.232 1.235 1.237 8.34% Castro::do_old_sources() 20 1.137 1.166 1.185 8.00% MLMG::oneIter() 128 1.096 1.1 1.104 7.45% MLMG::mgVcycle() 128 1.081 1.085 1.089 7.35% Castro::do_new_sources() 17 0.9485 0.9855 1.027 6.93% Castro::evaluate_source_change() 196 0.949 0.9583 1.02 6.88% FabArray::ParallelCopy() 1429 0.2777 0.6833 0.8785 5.92% Amr::init() 1 0.8658 0.8658 0.8658 5.84% Castro::enforce_min_density() 79 0.7912 0.8062 0.8338 5.62% Amr::initialInit() 1 0.8139 0.814 0.814 5.49% amrex::Copy() 724 0.7708 0.776 0.7883 5.32% MLCellLinOp::smooth() 3072 0.5517 0.5996 0.7243 4.88% FabArray::ParallelCopy_finish() 1429 0.05602 0.4638 0.6591 4.44% MultiFab::AddProduct() 3439 0.5452 0.5524 0.616 4.15% Amr::InitializeInit() 1 0.4437 0.4981 0.5967 4.02% Amr::defBaseLevel() 1 0.4437 0.4981 0.5967 4.02% AmrLevel::FillPatch() 147 0.4711 0.5219 0.5935 4.00% Castro::normalize_species() 79 0.5478 0.5518 0.5736 3.87% Castro::reset_internal_energy(Fab) 160 0.5241 0.528 0.5335 3.60% Castro::post_timestep() 1 0.4741 0.4888 0.4943 3.33% FillPatchIterator::Initialize 147 0.2932 0.3449 0.4162 2.81% MLMG::mgVcycle_up::1 128 0.09052 0.2535 0.4162 2.81% MLPoisson::Fsmooth() 6144 0.3168 0.3439 0.4109 2.77% Castro::sum_integrated_quantities() 2 0.02111 0.3827 0.4068 2.74% FillPatchIterator::FillFromLevel0() 147 0.27 0.3266 0.3993 2.69% FillPatchSingleLevel 147 0.2693 0.3259 0.3986 2.69% Castro::problem_post_timestep() 2 0.01077 0.07315 0.3983 2.69% MLCellLinOp::applyBC() 7156 0.2456 0.3034 0.3814 2.57% Amr::FinalizeInit() 1 0.2173 0.3158 0.3702 2.50% FabArray::setVal() 5021 0.3596 0.3627 0.3699 2.49% MLMG::addInterpCorrection() 768 0.0615 0.2995 0.3682 2.48% Castro::Castro() 1 0.3628 0.3646 0.3669 2.47% MultiFab::Subtract() 159 0.3501 0.3521 0.3624 2.44% Castro::initMFs() 1 0.3575 0.3591 0.3617 2.44% FabArray::FillBoundary() 6388 0.1923 0.2421 0.279 1.88% Gravity::fill_multipole_BCs() 19 0.1991 0.2356 0.2754 1.86% MLMG::mgVcycle_up::2 128 0.01049 0.1136 0.2727 1.84% MLMG::mgVcycle_down::0 128 0.2599 0.2631 0.2671 1.80% FabArray::ParallelCopy_nowait() 1429 0.1997 0.216 0.2328 1.57% Castro::initData() 1 0.07807 0.132 0.2307 1.56% MLMG::mgVcycle_up::0 128 0.1985 0.2006 0.2048 1.38% Amr::bldFineLevels() 1 0.04628 0.1449 0.199 1.34% Castro::expand_state() 20 0.1741 0.1785 0.1953 1.32% MLCellLinOp::apply() 994 0.1473 0.1569 0.1952 1.32% FabArray::sum() 3439 0.1851 0.186 0.1903 1.28% MLMG::mgVcycle_up::3 128 0.01052 0.02327 0.1782 1.20% check_for_negative_density() 20 0.03868 0.1151 0.1709 1.15% FillBoundary_finish() 6388 0.08802 0.1234 0.1572 1.06% Amr::grid_places() 2 0.00271 0.1013 0.1557 1.05% AmrMesh::MakeNewGrids() 2 0.002623 0.1012 0.1556 1.05% TagBoxArray::mapPRD 2 0.0007151 0.09955 0.1542 1.04% MLCellLinOp::correctionResidual() 776 0.1096 0.1194 0.1463 0.99% MLMG:computeResOfCorrection() 768 0.111 0.1206 0.1437 0.97% FillBoundary_nowait() 6388 0.08079 0.105 0.1311 0.88% Castro::post_init() 1 0.1268 0.1278 0.1286 0.87% Castro::construct_new_source() 102 0.123 0.124 0.1271 0.86% MLMG::mgVcycle_down::1 128 0.1107 0.1161 0.1222 0.82% MLPoisson::Fapply() 994 0.09253 0.0971 0.1116 0.75% Amr::writePlotFile() 2 0.1024 0.1025 0.1025 0.69% MLCellLinOp::solutionResidual() 147 0.08795 0.0923 0.09575 0.65% Gravity::multilevel_solve_for_new_phi() 1 0.09492 0.09494 0.09498 0.64% Gravity::actual_multilevel_solve() 1 0.09486 0.09488 0.09492 0.64% Castro::post_regrid() 2 0.08587 0.08672 0.08771 0.59% Castro::create_source_corrector() 17 0.04737 0.06827 0.08532 0.58% Castro::construct_old_source() 120 0.07926 0.07948 0.08022 0.54% MLMG::computeResidual() 128 0.07488 0.07632 0.07867 0.53% FabArray::Saxpy() 264 0.07024 0.07128 0.07867 0.53% MLMG::mgVcycle_bottom 128 0.0003552 0.005068 0.07562 0.51% MLMG::actualBottomSolve() 128 0.000131 0.004838 0.07539 0.51% Castro::construct_old_gravity() 20 0.04037 0.05559 0.07451 0.50% MLCGSolver::bicgstab 8 0 0.004615 0.07384 0.50% MLMG::mgVcycle_down::2 128 0.01244 0.04121 0.07267 0.49% Castro::derive() 18 0.06882 0.06917 0.07161 0.48% AmrLevel::derive() 18 0.06878 0.06913 0.07157 0.48% Castro::construct_new_gravity_source() 17 0.06734 0.06824 0.06998 0.47% FabArray::Xpay() 953 0.05162 0.05404 0.06132 0.41% Gravity::get_old_grav_vector() 20 0.0394 0.05193 0.06053 0.41% Castro::wd_update() 2 0.01076 0.04903 0.05975 0.40% MLMG::mgVcycle_down::3 128 0.01179 0.01781 0.05817 0.39% amrex::average_down 768 0.03233 0.03881 0.05467 0.37% Castro::initialize_advance() 1 0.04879 0.04911 0.04944 0.33% Castro::construct_old_gravity_source() 20 0.04586 0.04602 0.04652 0.31% Castro::check_for_nan() 37 0.04449 0.04472 0.04552 0.31% Amr::regrid() 1 0.04394 0.0446 0.04546 0.31% MultiFab::contains_nan() 37 0.04439 0.04461 0.0454 0.31% MLPoisson::define() 19 0.0274 0.03214 0.0376 0.25% Gravity::get_new_grav_vector() 18 0.03413 0.0348 0.03648 0.25% Castro::retry_advance_ctu() 11 0.03589 0.03607 0.03639 0.25% StateDataPhysBCFunct::() 147 0.000642 0.01844 0.03479 0.23% MLMG::mgVcycle_down::4 128 0.01168 0.01331 0.03421 0.23% StateData::FillBoundary(geom) 143 0 0.01767 0.03398 0.23% Castro::apply_source_to_state() 37 0.02857 0.02889 0.03148 0.21% MLMG::mgVcycle_up::4 128 0.01054 0.01173 0.02656 0.18% MLMG::prepareForSolve() 18 0.02013 0.02096 0.02308 0.16% VisMF::Write(FabArray) 4 0.01189 0.01295 0.02266 0.15% MLCellLinOp::defineAuxData() 19 0.0179 0.01924 0.02266 0.15% MLMG::mgVcycle_down::5 128 0.01167 0.01252 0.02264 0.15% MLMG::ResNormInf() 146 0.01361 0.01869 0.02216 0.15% MLMG::mgVcycle_up::5 128 0.01067 0.01137 0.01921 0.13% MLMG::computeMLResidual() 18 0.01098 0.01557 0.01905 0.13% Castro::save_data_for_retry() 3 0.01846 0.01859 0.01887 0.13% FabArray::norminf() 282 0.01078 0.01123 0.01513 0.10% amrex::Add() 136 0.01414 0.0143 0.01503 0.10% FabArrayBase::getFB() 6388 0.01015 0.01084 0.01412 0.10% Gravity::test_composite_phi() 1 0.01355 0.01358 0.0136 0.09% FabArrayBase::getCPC() 2005 0.009198 0.01036 0.01354 0.09% MLLinOp::define() 19 0.00357 0.007223 0.01151 0.08% MLLinOp::defineGrids() 19 0.003495 0.007146 0.01143 0.08% FabArray::setDomainBndry() 147 0.0004461 0.006002 0.0111 0.07% Castro::volWgtSum() 46 0.00722 0.007396 0.008599 0.06% Amr::writeSmallPlotFile() 2 0.008429 0.008431 0.008433 0.06% MLLinOp::makeSubCommunicator() 19 0.0008394 0.004414 0.008376 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005225 0.00836 0.06% FabArray::mult() 59 0.007071 0.007143 0.0077 0.05% MLMG::getGradSolution() 18 0.007217 0.007365 0.007462 0.05% MLCellLinOp::compGrad() 18 0.007178 0.007325 0.007423 0.05% Castro::volInBoundary() 14 0.003399 0.003709 0.006377 0.04% FabArrayBase::CPC::define() 576 0.002119 0.003217 0.006178 0.04% amrex::Dot() 142 0 0.0003747 0.005996 0.04% MLCellLinOp::defineBC() 19 0.005329 0.005549 0.005795 0.04% BndryData::define() 19 0.003836 0.004042 0.004206 0.03% Gravity::update_max_rhs() 2 0.001392 0.002413 0.003278 0.02% MLPoisson::normalize() 79 0 0.0001937 0.0031 0.02% MLPoisson::prepareForSolve() 19 0.001722 0.001855 0.002138 0.01% MLCellLinOp::prepareForSolve() 19 0.001644 0.00178 0.002062 0.01% MultiFab::max() 2 0.0001734 0.001187 0.00205 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001281 0.00153 0.001767 0.01% FabArrayBase::FB::FB() 75 0.0002747 0.0006642 0.001427 0.01% AmrLevel::AmrLevel(dm) 1 0.001314 0.00133 0.001351 0.01% StateData::define() 6 0.001281 0.001297 0.001318 0.01% Gravity::swapTimeLevels() 8 0.001175 0.001198 0.001314 0.01% MLMG::MLResNormInf() 18 0.001239 0.001258 0.001296 0.01% MLMG::MLRhsNormInf() 18 0.001196 0.001212 0.00128 0.01% Castro::locWgtSum() 6 0.001121 0.001147 0.001227 0.01% MLMG::compResidual() 1 0.0009285 0.001057 0.001187 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0008726 0.0009117 0.0009915 0.01% Castro::volProductSum() 2 0.0003872 0.0004279 0.0009587 0.01% MLCellLinOp::setLevelBC() 19 0.0005245 0.0006546 0.0008229 0.01% TagBoxArray::collate() 2 9.583e-05 0.0004155 0.0008128 0.01% Castro::buildMetrics() 1 0.0006243 0.0006341 0.0006574 0.00% makeSFC 95 0.000553 0.0005818 0.0006407 0.00% Castro::errorEst() 2 0.0005128 0.0005756 0.0006253 0.00% Castro::apply_tagging_restrictions() 2 0.0004144 0.0004756 0.0005263 0.00% Gravity::applyMetricTerms() 2 0.0004756 0.0004825 0.0004887 0.00% Castro::swap_state_time_levels() 8 0.0004043 0.0004151 0.0004326 0.00% Castro::enforce_consistent_e() 1 0.0003658 0.0003756 0.0004267 0.00% Castro::finalize_advance() 1 0.00025 0.0002545 0.0002629 0.00% DistributionMapping::Distribute() 95 0.0002012 0.0002112 0.0002261 0.00% Castro::finalize_do_advance() 17 0.0001652 0.0001842 0.0002194 0.00% OwnerMask() 2 0.0001321 0.0001473 0.000159 0.00% DistributionMapping::KnapSackDoIt() 1 9.178e-05 0.0001122 0.0001277 0.00% Castro::enforce_speed_limit() 79 0.0001014 0.0001062 0.0001146 0.00% Castro::apply_problem_tags() 2 9.199e-05 9.368e-05 9.829e-05 0.00% MultiFab::Swap() 5 6.452e-05 6.652e-05 7.235e-05 0.00% knapsack() 1 5.531e-05 5.824e-05 6.146e-05 0.00% Amr::initSubcycle() 1 5.453e-05 5.739e-05 5.912e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.696e-05 3.651e-05 5.017e-05 0.00% Castro::construct_old_rotation_source() 20 2.962e-05 3.04e-05 3.141e-05 0.00% Castro::construct_new_rotation_source() 17 2.15e-05 2.255e-05 2.711e-05 0.00% BoxList::parallelComplementIn() 4 1.28e-05 1.345e-05 1.742e-05 0.00% Castro::estTimeStep() 10 1.164e-05 1.342e-05 1.695e-05 0.00% Castro::computeInitialDt() 2 1.005e-05 1.151e-05 1.475e-05 0.00% BoxList::complementIn 4 5.866e-06 6.213e-06 8.184e-06 0.00% Gravity::set_mass_offset() 2 4.232e-06 4.968e-06 7.564e-06 0.00% Castro::gwstrain() 2 4.074e-06 4.695e-06 5.885e-06 0.00% Castro::FluxRegCrseInit 1 1.615e-06 1.864e-06 2.463e-06 0.00% Castro::FluxRegFineAdd() 1 1.388e-06 1.458e-06 1.561e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 10 B 12 B 15 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.12-18-g3497f016d920) finalized