Initializing AMReX (v2024-27-ga9b452ab5e8b)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (v2024-27-ga9b452ab5e8b) initialized Starting run at 07:43:17 UTC on 2024-03-21. Successfully read inputs file ... Castro git describe: 24.03-25-g09bde5fae AMReX git describe: v2024-27-ga9b452ab5 Microphysics git describe: 24.03-20-gb934b16f reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.15681024 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001081846 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010724344 Gravity::multilevel_solve_for_new_phi() time = 0.10020071 Gravity::fill_multipole_BCs() time = 0.010805232 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.048253926 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004181139 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002785919 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065818599 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.009809928 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.064682697 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004147475 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.061402664 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.00594805 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059074409 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321939064 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015997449 Gravity::solve_for_phi() time = 0.086974976 on level 0 Castro::construct_new_gravity() time = 0.089095959 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060504562 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002743426 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058929132 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32214921 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01561037 Gravity::solve_for_phi() time = 0.085947998 on level 0 Castro::construct_new_gravity() time = 0.088030171 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.06006456 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002833885 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.05910022 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326925084 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015695631 Gravity::solve_for_phi() time = 0.085915517 on level 0 Castro::construct_new_gravity() time = 0.08800357 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.061577184 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002716665 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059024694 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329479607 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015971961 Gravity::solve_for_phi() time = 0.08779598 on level 0 Castro::construct_new_gravity() time = 0.089970885 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.061217093 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.004305718 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.06046159 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336221665 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015398991 Gravity::solve_for_phi() time = 0.085960213 on level 0 Castro::construct_new_gravity() time = 0.088091981 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.0601205 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002736113 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058740737 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329202431 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015898846 Gravity::solve_for_phi() time = 0.086339556 on level 0 Castro::construct_new_gravity() time = 0.088417017 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.060750573 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00287206 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059439432 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334226663 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015873277 Gravity::solve_for_phi() time = 0.086497805 on level 0 Castro::construct_new_gravity() time = 0.088646827 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059939584 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002664908 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058913087 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331141056 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016107311 Gravity::solve_for_phi() time = 0.086745211 on level 0 Castro::construct_new_gravity() time = 0.088827731 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060200957 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002681968 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059562133 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335194294 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016228689 Gravity::solve_for_phi() time = 0.08654468 on level 0 Castro::construct_new_gravity() time = 0.088652777 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.060631962 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002768792 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058787854 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329834055 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016199637 Gravity::solve_for_phi() time = 0.08683101 on level 0 Castro::construct_new_gravity() time = 0.088941916 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.060102253 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002743956 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059469485 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.374041322 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018826345 Gravity::solve_for_phi() time = 0.09023587 on level 0 Castro::construct_new_gravity() time = 0.092406865 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.060109233 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002749182 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058723946 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.35557711 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015793086 Gravity::solve_for_phi() time = 0.087468823 on level 0 Castro::construct_new_gravity() time = 0.089635764 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.060368511 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002902488 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060068469 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338192228 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016118729 Gravity::solve_for_phi() time = 0.087504129 on level 0 Castro::construct_new_gravity() time = 0.089621575 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.060263604 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002756665 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058971208 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328405145 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015583338 Gravity::solve_for_phi() time = 0.085346984 on level 0 Castro::construct_new_gravity() time = 0.087456184 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059242455 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003639983 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.05862014 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330659382 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015555304 Gravity::solve_for_phi() time = 0.085703181 on level 0 Castro::construct_new_gravity() time = 0.087806087 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059398997 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002631902 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058413867 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325354804 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015980515 Gravity::solve_for_phi() time = 0.089589662 on level 0 Castro::construct_new_gravity() time = 0.091821373 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059820613 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002765766 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058471768 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332161838 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015534156 Gravity::solve_for_phi() time = 0.085332789 on level 0 Castro::construct_new_gravity() time = 0.087438588 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059281115 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002755873031 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.9495217 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.047217061 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004287852 seconds Ending run at 07:43:32 UTC on 2024-03-21. Run time = 14.48151039 Run time without initialization = 12.00209862 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.48 ... 14.48 ... 14.48 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3514 5.4708 5.5601 38.39% Amr::InitAmr() 1 1.604 1.604 1.604 11.08% Castro::computeTemp() 80 0.8459 0.9455 1.088 7.51% amrex::Copy() 724 0.8073 0.8206 0.8388 5.79% FabArray::ParallelCopy_finish() 1429 0.059 0.4865 0.7581 5.24% Castro::normalize_species() 79 0.5512 0.5595 0.5689 3.93% MultiFab::AddProduct() 3439 0.5498 0.5585 0.5677 3.92% Castro::reset_internal_energy(Fab) 160 0.5128 0.5235 0.5348 3.69% MLPoisson::Fsmooth() 6144 0.3155 0.3455 0.4213 2.91% Castro::initMFs() 1 0.3559 0.36 0.3883 2.68% FabArray::setVal() 5013 0.3503 0.358 0.3682 2.54% MultiFab::Subtract() 159 0.3406 0.3459 0.3512 2.43% check_for_negative_density() 20 0.09271 0.2075 0.322 2.22% Gravity::fill_multipole_BCs() 19 0.2047 0.2442 0.2911 2.01% Castro::reset_internal_energy(MultiFab) 80 0.02249 0.07121 0.2353 1.62% FabArray::ParallelCopy_nowait() 1429 0.1841 0.2019 0.224 1.55% FabArray::sum() 3439 0.1958 0.2002 0.204 1.41% Castro::initData() 1 0.003323 0.02649 0.1556 1.07% FillBoundary_nowait() 6380 0.07608 0.1035 0.1333 0.92% FillBoundary_finish() 6380 0.09138 0.1109 0.1314 0.91% MLPoisson::Fapply() 986 0.09401 0.09913 0.1158 0.80% MLCellLinOp::applyBC() 7148 0.04727 0.06307 0.1056 0.73% Castro::do_new_sources() 17 0.0003705 0.01345 0.07883 0.54% FabArray::Saxpy() 264 0.06925 0.07067 0.07847 0.54% Castro::construct_new_gravity_source() 17 0.06833 0.06983 0.07082 0.49% Castro::enforce_min_density() 79 0.01722 0.02876 0.06477 0.45% FabArray::Xpay() 945 0.05127 0.054 0.06188 0.43% Castro::construct_old_gravity_source() 20 0.04597 0.04664 0.04737 0.33% MultiFab::contains_nan() 37 0.04353 0.04425 0.04508 0.31% Castro::do_old_sources() 20 0.0005257 0.009344 0.04421 0.31% MLMG::addInterpCorrection() 768 0.03255 0.03528 0.04248 0.29% AmrLevel::derive() 18 0.03982 0.04046 0.0413 0.29% StateData::FillBoundary(geom) 143 0 0.01728 0.03306 0.23% amrex::average_down 768 0.02409 0.02631 0.03223 0.22% VisMF::Write(FabArray) 4 0.01186 0.01293 0.02255 0.16% FabArray::FillBoundary() 6380 0.01356 0.01426 0.01745 0.12% Castro::construct_new_source() 102 0.01549 0.016 0.01735 0.12% MLCellLinOp::defineAuxData() 19 0.01426 0.01506 0.0172 0.12% Amr::writePlotFile() 2 0.007134 0.01557 0.01715 0.12% MLCGSolver::bicgstab 8 0 0.001011 0.01618 0.11% FabArray::norminf() 282 0.01095 0.01154 0.01576 0.11% amrex::Add() 128 0.01423 0.01446 0.01466 0.10% MLCellLinOp::smooth() 3072 0.01095 0.01164 0.01348 0.09% Castro::evaluate_source_change() 196 0.01213 0.0125 0.01324 0.09% FillPatchIterator::Initialize 147 0.01236 0.01267 0.01294 0.09% FabArrayBase::getFB() 6380 0.009646 0.01016 0.01251 0.09% Castro::wd_update() 2 0.005182 0.008229 0.01194 0.08% FabArray::setDomainBndry() 147 0.0004326 0.006064 0.01176 0.08% Castro::construct_old_source() 120 0.009842 0.01018 0.01103 0.08% MLMG::prepareForSolve() 18 0.009804 0.01017 0.01089 0.08% Castro::construct_old_gravity() 20 0.0003922 0.002735 0.01062 0.07% MLMG::ResNormInf() 146 0.003264 0.006227 0.008821 0.06% Gravity::actual_solve_with_mlmg() 19 0.006597 0.006931 0.007926 0.05% FabArrayBase::getCPC() 2005 0.007117 0.00737 0.007849 0.05% MLLinOp::makeSubCommunicator() 19 0.0006956 0.004058 0.007712 0.05% Castro::volWgtSum() 46 0.007083 0.007249 0.007655 0.05% FabArray::mult() 59 0.007215 0.007379 0.007555 0.05% Gravity::get_old_grav_vector() 20 0.006495 0.006623 0.006845 0.05% MLMG::solve() 18 0.0008006 0.003037 0.006675 0.05% Gravity::get_new_grav_vector() 18 0.006052 0.006212 0.006466 0.04% FabArrayBase::CPC::define() 576 0.002139 0.00332 0.006346 0.04% MLCellLinOp::compGrad() 18 0.005951 0.006069 0.006202 0.04% amrex::Dot() 142 0 0.000386 0.006176 0.04% Amr::writeSmallPlotFile() 2 0.003607 0.00539 0.005792 0.04% Castro::volInBoundary() 14 0.003394 0.00368 0.005525 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003095 0.004952 0.03% Castro::initialize_do_advance() 20 0.004378 0.004568 0.004787 0.03% MLCellLinOp::apply() 986 0.001981 0.002223 0.00477 0.03% FabArray::ParallelCopy() 1429 0.00346 0.003686 0.004038 0.03% MultiFab::max() 2 0.0001825 0.001695 0.00392 0.03% BndryData::define() 19 0.003021 0.003115 0.003313 0.02% MLPoisson::normalize() 79 0 0.0002002 0.003203 0.02% Castro::sum_integrated_quantities() 2 0.001911 0.002408 0.002824 0.02% AmrLevel::FillPatch() 147 0.002081 0.002186 0.002397 0.02% MLLinOp::defineGrids() 19 0.001733 0.00187 0.002182 0.02% MLCellLinOp::prepareForSolve() 19 0.00161 0.001761 0.002055 0.01% MLCellLinOp::correctionResidual() 768 0.001807 0.001877 0.001972 0.01% MLMG::mgVcycle() 128 0.001528 0.001613 0.001812 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001254 0.001506 0.001772 0.01% MLCellLinOp::defineBC() 19 0.001487 0.001548 0.001687 0.01% MLMG:computeResOfCorrection() 768 0.001406 0.001458 0.001545 0.01% Castro::construct_new_gravity() 17 0.0003048 0.0005784 0.00154 0.01% StateData::define() 6 0.001344 0.00138 0.001523 0.01% Gravity::solve_for_phi() 17 0.0008055 0.0009792 0.001504 0.01% FabArrayBase::FB::FB() 75 0.0002794 0.0006798 0.00148 0.01% main() 1 0.0009381 0.001137 0.001409 0.01% Castro::save_data_for_retry() 3 0.001232 0.001272 0.001299 0.01% Castro::locWgtSum() 6 0.00111 0.001154 0.001211 0.01% TagBoxArray::collate() 2 0.0001484 0.0005368 0.001069 0.01% MLMG::actualBottomSolve() 128 0.0001341 0.000197 0.001056 0.01% StateDataPhysBCFunct::() 147 0.0006623 0.0008087 0.0008881 0.01% MLCellLinOp::setLevelBC() 19 0.0005137 0.0006486 0.0008416 0.01% MLMG::mgVcycle_down::2 128 0.0005876 0.0006519 0.0007682 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006961 0.000713 0.0007462 0.01% MLMG::mgVcycle_down::0 128 0.0006455 0.0006767 0.0007364 0.01% MLMG::mgVcycle_down::3 128 0.0005498 0.0006009 0.0007142 0.00% MLMG::mgVcycle_down::1 128 0.0006327 0.0006605 0.000706 0.00% Castro::subcycle_advance_ctu() 1 0.0001886 0.000237 0.000705 0.00% Castro::buildMetrics() 1 0.000591 0.0006105 0.0006924 0.00% MLMG::mgVcycle_down::4 128 0.000536 0.0005662 0.000664 0.00% MLMG::mgVcycle_down::5 128 0.0005545 0.0005869 0.0006606 0.00% Castro::Castro() 1 0.0004552 0.0004865 0.0005586 0.00% Castro::apply_tagging_restrictions() 2 0.0004059 0.0004674 0.0005317 0.00% MLMG::mgVcycle_up::1 128 0.0004482 0.0004749 0.0005239 0.00% MLMG::mgVcycle_up::0 128 0.0004587 0.0004764 0.0005219 0.00% AmrMesh::MakeNewGrids() 2 0.000483 0.0004989 0.0005137 0.00% FillPatchSingleLevel 147 0.0004607 0.0004744 0.0005082 0.00% Castro::clean_state() 79 0.0004338 0.0004619 0.0005077 0.00% MLMG::mgVcycle_up::2 128 0.0003813 0.0004272 0.0004943 0.00% Gravity::applyMetricTerms() 2 0.0004619 0.0004723 0.0004835 0.00% MLCellLinOp::solutionResidual() 147 0.0004172 0.0004371 0.0004674 0.00% Castro::do_advance_ctu() 20 0.0003975 0.0004247 0.0004616 0.00% MLMG::mgVcycle_up::3 128 0.0003777 0.0004003 0.000461 0.00% MLMG::mgVcycle_up::5 128 0.0003929 0.0004094 0.0004595 0.00% makeSFC 95 0.0003758 0.0003956 0.0004589 0.00% Castro::enforce_consistent_e() 1 0.0003699 0.000383 0.0004498 0.00% Castro::swap_state_time_levels() 8 0.0004167 0.0004287 0.0004477 0.00% MLMG::oneIter() 128 0.0003779 0.0003963 0.0004436 0.00% MLMG::mgVcycle_up::4 128 0.0003816 0.0003984 0.0004361 0.00% Castro::volProductSum() 2 0.0003946 0.0004064 0.0004252 0.00% Castro::problem_post_timestep() 2 1.092e-05 3.448e-05 0.0003645 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003235 0.0003378 0.0003625 0.00% MLMG::computeResidual() 128 0.0002321 0.0002429 0.0002649 0.00% Gravity::solve_phi_with_mlmg() 19 0.000214 0.000228 0.0002636 0.00% MLMG::mgVcycle_bottom 128 0.0002148 0.0002274 0.0002405 0.00% DistributionMapping::Distribute() 95 0.0002108 0.0002215 0.0002404 0.00% Castro::finalize_do_advance() 17 0.000153 0.0001729 0.0001923 0.00% Amr::coarseTimeStep() 1 0.0001412 0.0001723 0.0001785 0.00% Gravity::update_max_rhs() 2 0.0001552 0.0001628 0.0001724 0.00% OwnerMask() 2 0.0001314 0.0001471 0.0001705 0.00% MLMG::compResidual() 1 0.0001539 0.0001577 0.0001612 0.00% DistributionMapping::LeastUsedCPUs() 1 5.697e-05 0.0001301 0.0001606 0.00% MLPoisson::define() 19 0.0001272 0.0001356 0.0001575 0.00% Castro::retry_advance_ctu() 11 5.721e-05 7.001e-05 0.0001532 0.00% Amr::defBaseLevel() 1 0.0001029 0.0001156 0.0001333 0.00% Castro::check_for_nan() 37 0.0001051 0.000114 0.0001292 0.00% Gravity::test_composite_phi() 1 9.872e-05 0.0001057 0.0001262 0.00% TagBoxArray::mapPRD 2 0.0001061 0.0001109 0.0001217 0.00% Amr::grid_places() 2 7.052e-05 8.352e-05 0.0001186 0.00% Castro::enforce_speed_limit() 79 0.0001034 0.0001093 0.0001182 0.00% Castro::apply_source_to_state() 37 9.291e-05 9.999e-05 0.0001141 0.00% Castro::initialize_advance() 1 9.737e-05 0.000103 0.0001058 0.00% Castro::apply_problem_tags() 2 9.132e-05 9.48e-05 0.0001035 0.00% MLPoisson::prepareForSolve() 19 7.638e-05 8.026e-05 9.34e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.905e-05 6.838e-05 9.279e-05 0.00% Amr::initSubcycle() 1 5.48e-05 6.106e-05 8.92e-05 0.00% Castro::create_source_corrector() 17 5.533e-05 6.477e-05 8.745e-05 0.00% MLLinOp::define() 19 7.351e-05 8.066e-05 8.589e-05 0.00% MultiFab::Swap() 5 6.572e-05 6.932e-05 8.425e-05 0.00% knapsack() 1 5.656e-05 5.967e-05 6.876e-05 0.00% Castro::expand_state() 20 5.047e-05 5.406e-05 5.929e-05 0.00% Amr::FinalizeInit() 1 8.369e-06 1.157e-05 4.887e-05 0.00% MLMG::computeMLResidual() 18 3.994e-05 4.233e-05 4.805e-05 0.00% Castro::derive() 18 4.043e-05 4.244e-05 4.639e-05 0.00% MLMG::getGradSolution() 18 3.992e-05 4.156e-05 4.421e-05 0.00% Gravity::swapTimeLevels() 8 3.324e-05 3.644e-05 4.396e-05 0.00% MLMG::MLResNormInf() 18 3.226e-05 3.455e-05 3.792e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.183e-05 3.439e-05 3.753e-05 0.00% Castro::construct_old_rotation_source() 20 2.701e-05 3.111e-05 3.718e-05 0.00% MLMG::MLRhsNormInf() 18 3.053e-05 3.188e-05 3.584e-05 0.00% Amr::timeStep() 1 1.263e-05 1.648e-05 3.476e-05 0.00% Amr::regrid() 1 1.055e-05 1.246e-05 2.986e-05 0.00% Gravity::actual_multilevel_solve() 1 2.662e-05 2.772e-05 2.949e-05 0.00% Castro::advance() 1 6.937e-06 9.932e-06 2.375e-05 0.00% Castro::construct_new_rotation_source() 17 2.08e-05 2.147e-05 2.267e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.676e-05 1.827e-05 2.158e-05 0.00% Castro::finalize_advance() 1 1.637e-05 1.791e-05 2.14e-05 0.00% Amr::InitializeInit() 1 6.884e-06 8.171e-06 1.516e-05 0.00% Castro::post_init() 1 1.178e-05 1.293e-05 1.511e-05 0.00% Castro::estTimeStep() 10 1.175e-05 1.288e-05 1.422e-05 0.00% Castro::post_regrid() 2 1.04e-05 1.116e-05 1.208e-05 0.00% Castro::computeInitialDt() 2 6.353e-06 7.412e-06 1.149e-05 0.00% Amr::bldFineLevels() 1 6.675e-06 7.399e-06 8.472e-06 0.00% Amr::init() 1 6.326e-06 7.251e-06 8.168e-06 0.00% Castro::errorEst() 2 5.993e-06 6.419e-06 7.901e-06 0.00% BoxList::parallelComplementIn() 4 6.727e-06 7.069e-06 7.542e-06 0.00% Gravity::set_mass_offset() 2 4.181e-06 4.907e-06 7.399e-06 0.00% Castro::post_timestep() 1 5.606e-06 6.036e-06 7.023e-06 0.00% Castro::gwstrain() 2 4.383e-06 4.999e-06 6.856e-06 0.00% BoxList::complementIn 4 5.913e-06 6.234e-06 6.822e-06 0.00% Amr::initialInit() 1 3.084e-06 3.378e-06 3.95e-06 0.00% Castro::FluxRegCrseInit 1 1.723e-06 1.987e-06 2.576e-06 0.00% Castro::FluxRegFineAdd() 1 1.463e-06 1.583e-06 2.011e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.48 14.48 14.48 100.00% Amr::coarseTimeStep() 1 12 12 12 82.87% Amr::timeStep() 1 11.95 11.95 11.95 82.51% Castro::advance() 1 11.89 11.89 11.89 82.11% Castro::subcycle_advance_ctu() 1 11.84 11.84 11.84 81.76% Castro::do_advance_ctu() 20 11.79 11.8 11.8 81.50% Castro::construct_ctu_hydro_source() 20 6.435 6.468 6.502 44.90% Castro::clean_state() 79 3.694 3.838 3.977 27.46% Castro::computeTemp() 80 2.371 2.519 2.718 18.77% Castro::reset_internal_energy(MultiFab) 80 1.504 1.574 1.713 11.83% Amr::InitAmr() 1 1.604 1.604 1.604 11.08% Gravity::solve_phi_with_mlmg() 19 1.498 1.539 1.587 10.96% Castro::construct_new_gravity() 17 1.425 1.465 1.512 10.44% Gravity::solve_for_phi() 17 1.387 1.428 1.476 10.19% Castro::initialize_do_advance() 20 1.391 1.419 1.461 10.09% Gravity::actual_solve_with_mlmg() 19 1.288 1.291 1.296 8.95% MLMG::solve() 18 1.238 1.242 1.244 8.59% Castro::do_old_sources() 20 1.168 1.184 1.195 8.25% MLMG::oneIter() 128 1.105 1.108 1.11 7.67% MLMG::mgVcycle() 128 1.09 1.093 1.096 7.57% Castro::do_new_sources() 17 0.9388 0.9911 1.024 7.07% Castro::evaluate_source_change() 196 0.9583 0.9742 0.9904 6.84% FabArray::ParallelCopy() 1429 0.2883 0.7121 0.9792 6.76% Amr::init() 1 0.8747 0.8748 0.8748 6.04% Castro::enforce_min_density() 79 0.7983 0.8214 0.8466 5.85% amrex::Copy() 724 0.8073 0.8206 0.8388 5.79% Amr::initialInit() 1 0.8214 0.8215 0.8216 5.67% FabArray::ParallelCopy_finish() 1429 0.059 0.4865 0.7581 5.24% MLCellLinOp::smooth() 3072 0.5484 0.5997 0.7273 5.02% AmrLevel::FillPatch() 147 0.4915 0.5625 0.6852 4.73% Amr::InitializeInit() 1 0.4408 0.5054 0.5961 4.12% Amr::defBaseLevel() 1 0.4408 0.5054 0.5961 4.12% Castro::normalize_species() 79 0.5512 0.5595 0.5689 3.93% MultiFab::AddProduct() 3439 0.5498 0.5585 0.5677 3.92% Castro::reset_internal_energy(Fab) 160 0.5128 0.5235 0.5348 3.69% FillPatchIterator::Initialize 147 0.3026 0.376 0.501 3.46% FillPatchIterator::FillFromLevel0() 147 0.2785 0.3572 0.4841 3.34% FillPatchSingleLevel 147 0.2778 0.3565 0.4834 3.34% MLMG::mgVcycle_up::1 128 0.09496 0.2613 0.4277 2.95% MLPoisson::Fsmooth() 6144 0.3155 0.3455 0.4213 2.91% Castro::Castro() 1 0.3613 0.3655 0.3945 2.72% Castro::initMFs() 1 0.3561 0.3602 0.3884 2.68% Amr::FinalizeInit() 1 0.2255 0.3161 0.3807 2.63% MLMG::addInterpCorrection() 768 0.06327 0.3056 0.3775 2.61% MLCellLinOp::applyBC() 7148 0.2634 0.3026 0.3696 2.55% FabArray::setVal() 5013 0.3503 0.358 0.3682 2.54% MultiFab::Subtract() 159 0.3406 0.3459 0.3512 2.43% check_for_negative_density() 20 0.09271 0.2075 0.322 2.22% Gravity::fill_multipole_BCs() 19 0.2069 0.2464 0.2933 2.03% MLMG::mgVcycle_up::2 128 0.01053 0.1163 0.2796 1.93% FabArray::FillBoundary() 6380 0.2041 0.2395 0.2745 1.90% MLMG::mgVcycle_down::0 128 0.2601 0.2631 0.266 1.84% Castro::expand_state() 20 0.1849 0.2156 0.2626 1.81% FabArray::ParallelCopy_nowait() 1429 0.2034 0.2219 0.2451 1.69% Castro::initData() 1 0.0776 0.1381 0.2327 1.61% FabArray::sum() 3439 0.1958 0.2002 0.204 1.41% Amr::bldFineLevels() 1 0.04718 0.1374 0.2009 1.39% MLMG::mgVcycle_up::0 128 0.1946 0.1964 0.1988 1.37% MLCellLinOp::apply() 986 0.1489 0.1596 0.1956 1.35% MLMG::mgVcycle_up::3 128 0.01053 0.02353 0.1779 1.23% Amr::grid_places() 2 0.002614 0.0933 0.1579 1.09% AmrMesh::MakeNewGrids() 2 0.002495 0.09322 0.1578 1.09% TagBoxArray::mapPRD 2 0.0007925 0.09146 0.1563 1.08% MLMG:computeResOfCorrection() 768 0.1112 0.1229 0.1474 1.02% MLCellLinOp::correctionResidual() 768 0.1098 0.1214 0.1458 1.01% FillBoundary_nowait() 6380 0.08603 0.1144 0.1451 1.00% Castro::post_init() 1 0.1335 0.1349 0.1371 0.95% FillBoundary_finish() 6380 0.09138 0.1109 0.1314 0.91% Castro::construct_new_source() 102 0.1232 0.1256 0.1282 0.89% MLMG::mgVcycle_down::1 128 0.1127 0.1169 0.1203 0.83% MLPoisson::Fapply() 986 0.09401 0.09913 0.1158 0.80% Gravity::multilevel_solve_for_new_phi() 1 0.1002 0.1002 0.1002 0.69% Gravity::actual_multilevel_solve() 1 0.1001 0.1001 0.1002 0.69% MLCellLinOp::solutionResidual() 147 0.08856 0.09287 0.09727 0.67% Amr::writePlotFile() 2 0.09605 0.09615 0.09616 0.66% Castro::post_regrid() 2 0.08566 0.08786 0.08931 0.62% Castro::create_source_corrector() 17 0.04938 0.05952 0.08541 0.59% Castro::construct_old_source() 120 0.07893 0.08025 0.08173 0.56% FabArray::Saxpy() 264 0.06925 0.07067 0.07847 0.54% MLMG::computeResidual() 128 0.07505 0.07675 0.07755 0.54% MLMG::mgVcycle_down::2 128 0.01242 0.04126 0.0732 0.51% MLMG::mgVcycle_bottom 128 0.0003489 0.004822 0.07166 0.49% Castro::derive() 18 0.06911 0.07009 0.07145 0.49% MLMG::actualBottomSolve() 128 0.0001341 0.004595 0.07142 0.49% AmrLevel::derive() 18 0.06906 0.07004 0.07141 0.49% Castro::construct_new_gravity_source() 17 0.06833 0.06983 0.07082 0.49% MLCGSolver::bicgstab 8 0 0.004369 0.0699 0.48% Castro::construct_old_gravity() 20 0.04525 0.05448 0.06757 0.47% Gravity::get_old_grav_vector() 20 0.04044 0.05175 0.06718 0.46% Castro::post_timestep() 1 0.05924 0.06099 0.06381 0.44% FabArray::Xpay() 945 0.05127 0.054 0.06188 0.43% MLMG::mgVcycle_down::3 128 0.01179 0.01825 0.06113 0.42% amrex::average_down 768 0.03229 0.03898 0.05565 0.38% Castro::initialize_advance() 1 0.0486 0.04965 0.05026 0.35% Castro::construct_old_gravity_source() 20 0.04597 0.04664 0.04737 0.33% Amr::regrid() 1 0.04404 0.04513 0.04616 0.32% Castro::check_for_nan() 37 0.04363 0.04437 0.0452 0.31% MultiFab::contains_nan() 37 0.04353 0.04425 0.04508 0.31% Castro::retry_advance_ctu() 11 0.03613 0.03781 0.04394 0.30% MLPoisson::define() 19 0.02795 0.03261 0.03855 0.27% Gravity::get_new_grav_vector() 18 0.03509 0.03614 0.0369 0.25% MLMG::mgVcycle_down::4 128 0.0117 0.0135 0.03512 0.24% StateDataPhysBCFunct::() 147 0.0006623 0.01809 0.0339 0.23% StateData::FillBoundary(geom) 143 0 0.01728 0.03306 0.23% Castro::apply_source_to_state() 37 0.02824 0.02865 0.02906 0.20% MLMG::mgVcycle_up::4 128 0.01057 0.01187 0.02725 0.19% Castro::save_data_for_retry() 3 0.01924 0.02011 0.02647 0.18% MLCellLinOp::defineAuxData() 19 0.0182 0.01981 0.02382 0.16% MLMG::prepareForSolve() 18 0.0201 0.02122 0.0238 0.16% MLMG::mgVcycle_down::5 128 0.01168 0.01269 0.02314 0.16% VisMF::Write(FabArray) 4 0.01186 0.01293 0.02255 0.16% Castro::sum_integrated_quantities() 2 0.02146 0.02169 0.02172 0.15% MLMG::computeMLResidual() 18 0.01091 0.01565 0.02016 0.14% MLMG::mgVcycle_up::5 128 0.01074 0.01156 0.01974 0.14% MLMG::ResNormInf() 146 0.01319 0.01606 0.01854 0.13% FabArray::norminf() 282 0.01095 0.01154 0.01576 0.11% Castro::problem_post_timestep() 2 0.008926 0.01194 0.01541 0.11% Castro::wd_update() 2 0.008914 0.01191 0.01539 0.11% amrex::Add() 128 0.01423 0.01446 0.01466 0.10% Gravity::test_composite_phi() 1 0.01429 0.01433 0.01437 0.10% FabArrayBase::getCPC() 2005 0.009305 0.01069 0.01404 0.10% FabArrayBase::getFB() 6380 0.009942 0.01084 0.01399 0.10% FabArray::setDomainBndry() 147 0.0004326 0.006064 0.01176 0.08% MLLinOp::define() 19 0.003644 0.006964 0.01098 0.08% MLLinOp::defineGrids() 19 0.003564 0.006883 0.0109 0.08% Amr::writeSmallPlotFile() 2 0.008851 0.008854 0.008857 0.06% MLCGSolver::ParallelAllReduce 227 0 0.00052 0.00832 0.06% MLMG::getGradSolution() 18 0.007632 0.007905 0.008153 0.06% MLCellLinOp::compGrad() 18 0.007591 0.007863 0.008113 0.06% MLLinOp::makeSubCommunicator() 19 0.0006956 0.004058 0.007712 0.05% Castro::volWgtSum() 46 0.007083 0.007249 0.007655 0.05% FabArray::mult() 59 0.007215 0.007379 0.007555 0.05% FabArrayBase::CPC::define() 576 0.002139 0.00332 0.006346 0.04% amrex::Dot() 142 0 0.000386 0.006176 0.04% MLCellLinOp::defineBC() 19 0.005473 0.0057 0.006049 0.04% Castro::volInBoundary() 14 0.003394 0.00368 0.005525 0.04% Gravity::update_max_rhs() 2 0.001444 0.002931 0.005132 0.04% BndryData::define() 19 0.003941 0.004152 0.004404 0.03% MultiFab::max() 2 0.0001825 0.001695 0.00392 0.03% MLPoisson::normalize() 79 0 0.0002002 0.003203 0.02% MLPoisson::prepareForSolve() 19 0.001694 0.001841 0.002136 0.01% MLCellLinOp::prepareForSolve() 19 0.00161 0.001761 0.002055 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001254 0.001506 0.001772 0.01% AmrLevel::AmrLevel(dm) 1 0.00138 0.001415 0.00156 0.01% StateData::define() 6 0.001344 0.00138 0.001523 0.01% FabArrayBase::FB::FB() 75 0.0002794 0.0006798 0.00148 0.01% MLMG::MLResNormInf() 18 0.001257 0.001281 0.001318 0.01% MLMG::compResidual() 1 0.0009756 0.001127 0.001267 0.01% MLMG::MLRhsNormInf() 18 0.001203 0.001232 0.001257 0.01% Gravity::swapTimeLevels() 8 0.001168 0.001201 0.00123 0.01% Castro::locWgtSum() 6 0.00111 0.001154 0.001211 0.01% TagBoxArray::collate() 2 0.0001484 0.0005368 0.001069 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009114 0.0009549 0.001061 0.01% MLCellLinOp::setLevelBC() 19 0.0005137 0.0006486 0.0008416 0.01% Castro::buildMetrics() 1 0.0006597 0.0006799 0.0007661 0.01% makeSFC 95 0.0005878 0.0006171 0.0006981 0.00% Castro::errorEst() 2 0.0005035 0.0005687 0.0006329 0.00% Castro::apply_tagging_restrictions() 2 0.0004059 0.0004674 0.0005317 0.00% Gravity::applyMetricTerms() 2 0.0004619 0.0004723 0.0004835 0.00% Castro::enforce_consistent_e() 1 0.0003699 0.000383 0.0004498 0.00% Castro::swap_state_time_levels() 8 0.0004167 0.0004287 0.0004477 0.00% Castro::volProductSum() 2 0.0003946 0.0004064 0.0004252 0.00% Castro::finalize_advance() 1 0.0002628 0.0002709 0.0002808 0.00% DistributionMapping::Distribute() 95 0.0002108 0.0002215 0.0002404 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001319 0.0002081 0.0002393 0.00% Castro::finalize_do_advance() 17 0.0001618 0.0001826 0.0002018 0.00% OwnerMask() 2 0.0001314 0.0001471 0.0001705 0.00% DistributionMapping::LeastUsedCPUs() 1 5.697e-05 0.0001301 0.0001606 0.00% Castro::enforce_speed_limit() 79 0.0001034 0.0001093 0.0001182 0.00% Castro::apply_problem_tags() 2 9.132e-05 9.48e-05 0.0001035 0.00% Amr::initSubcycle() 1 5.48e-05 6.106e-05 8.92e-05 0.00% MultiFab::Swap() 5 6.572e-05 6.932e-05 8.425e-05 0.00% knapsack() 1 5.656e-05 5.967e-05 6.876e-05 0.00% Castro::construct_old_rotation_source() 20 2.701e-05 3.111e-05 3.718e-05 0.00% Castro::construct_new_rotation_source() 17 2.08e-05 2.147e-05 2.267e-05 0.00% Castro::computeInitialDt() 2 9.343e-06 1.06e-05 1.46e-05 0.00% Castro::estTimeStep() 10 1.175e-05 1.288e-05 1.422e-05 0.00% BoxList::parallelComplementIn() 4 1.268e-05 1.33e-05 1.417e-05 0.00% Gravity::set_mass_offset() 2 4.181e-06 4.907e-06 7.399e-06 0.00% Castro::gwstrain() 2 4.383e-06 4.999e-06 6.856e-06 0.00% BoxList::complementIn 4 5.913e-06 6.234e-06 6.822e-06 0.00% Castro::FluxRegCrseInit 1 1.723e-06 1.987e-06 2.576e-06 0.00% Castro::FluxRegFineAdd() 1 1.463e-06 1.583e-06 2.011e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 13 B 15 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-27-ga9b452ab5e8b) finalized