Initializing AMReX (v2024-33-g9e71c2cb9714)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (v2024-33-g9e71c2cb9714) initialized Starting run at 15:11:06 UTC on 2024-03-25. Successfully read inputs file ... Castro git describe: 24.03-30-g437ebcb19 AMReX git describe: v2024-33-g9e71c2cb9 Microphysics git describe: 24.03-21-g81de2adb reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.156418746 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001167811 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.011929289 Gravity::multilevel_solve_for_new_phi() time = 0.104512923 Gravity::fill_multipole_BCs() time = 0.011538501 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049371129 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004404116 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.004719483 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.063033673 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007503042 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.061878306 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006715121 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.061017506 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006895981 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059875222 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328552991 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015354098 Gravity::solve_for_phi() time = 0.085774422 on level 0 Castro::construct_new_gravity() time = 0.087850221 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.062065951 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002563794 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.095869337 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.318926098 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014898412 Gravity::solve_for_phi() time = 0.084244929 on level 0 Castro::construct_new_gravity() time = 0.086272823 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.07094809 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.024223141 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058056935 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.397326432 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.078347374 Gravity::solve_for_phi() time = 0.150466068 on level 0 Castro::construct_new_gravity() time = 0.152579074 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.0587298 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002666737 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.057722658 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.395214738 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014897059 Gravity::solve_for_phi() time = 0.099758709 on level 0 Castro::construct_new_gravity() time = 0.104814734 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.058454591 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002650817 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.061512501 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.343062409 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.023899537 Gravity::solve_for_phi() time = 0.094859114 on level 0 Castro::construct_new_gravity() time = 0.096888483 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.057977769 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002530567 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.057621216 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.339828073 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016220602 Gravity::solve_for_phi() time = 0.098462452 on level 0 Castro::construct_new_gravity() time = 0.100601769 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.062988304 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.011127351 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.064244668 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.350161181 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015654528 Gravity::solve_for_phi() time = 0.095761235 on level 0 Castro::construct_new_gravity() time = 0.097828878 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060561007 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.00253998 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059894043 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.352256969 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015886762 Gravity::solve_for_phi() time = 0.102272651 on level 0 Castro::construct_new_gravity() time = 0.104356881 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.06127324 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002903626 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.05730924 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.340272833 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01615976 Gravity::solve_for_phi() time = 0.0888308 on level 0 Castro::construct_new_gravity() time = 0.09093423 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.058391655 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002903416 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058803974 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337245874 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014903704 Gravity::solve_for_phi() time = 0.085787804 on level 0 Castro::construct_new_gravity() time = 0.08788704 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.061892058 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00293637 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058606485 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.343916149 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016317227 Gravity::solve_for_phi() time = 0.090462795 on level 0 Castro::construct_new_gravity() time = 0.092540627 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.060581001 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003359571 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060311119 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336413337 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016907771 Gravity::solve_for_phi() time = 0.089506044 on level 0 Castro::construct_new_gravity() time = 0.091596864 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059820122 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.0039819 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060420279 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.340790491 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016537618 Gravity::solve_for_phi() time = 0.090400195 on level 0 Castro::construct_new_gravity() time = 0.092535108 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.060150083 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002919943 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058765985 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334125037 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016372906 Gravity::solve_for_phi() time = 0.090713146 on level 0 Castro::construct_new_gravity() time = 0.092810383 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059996862 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.00306733 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.0612834 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.343739898 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017712027 Gravity::solve_for_phi() time = 0.093963464 on level 0 Castro::construct_new_gravity() time = 0.09605082 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059988208 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.004215879 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.061264594 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.347205814 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016100497 Gravity::solve_for_phi() time = 0.086497663 on level 0 Castro::construct_new_gravity() time = 0.088534528 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.063210034 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.00265889 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058603113 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.350883195 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016154145 Gravity::solve_for_phi() time = 0.091046097 on level 0 Castro::construct_new_gravity() time = 0.09309969 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.061454674 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.00268055207 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.28496165 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.048502894 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.00414907 seconds Ending run at 15:11:21 UTC on 2024-03-25. Run time = 14.86912949 Run time without initialization = 12.33852856 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.87 ... 14.87 ... 14.87 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3745 5.4511 5.6944 38.30% Amr::InitAmr() 1 1.652 1.652 1.652 11.11% Castro::computeTemp() 80 0.8377 0.9409 1.103 7.42% FabArray::ParallelCopy_finish() 1429 0.05177 0.5819 0.8545 5.75% amrex::Copy() 724 0.7647 0.7759 0.8019 5.39% Castro::normalize_species() 79 0.5514 0.56 0.5881 3.95% MultiFab::AddProduct() 3439 0.5328 0.54 0.5598 3.76% Castro::reset_internal_energy(Fab) 160 0.5107 0.52 0.5394 3.63% check_for_negative_density() 20 0.1466 0.3949 0.4665 3.14% MLPoisson::Fsmooth() 6144 0.3194 0.3479 0.4215 2.83% Castro::initMFs() 1 0.3495 0.3583 0.3734 2.51% Gravity::fill_multipole_BCs() 19 0.1982 0.3033 0.3586 2.41% MultiFab::Subtract() 159 0.3343 0.3399 0.3533 2.38% FabArray::setVal() 5013 0.3332 0.339 0.3491 2.35% Castro::reset_internal_energy(MultiFab) 80 0.02278 0.08895 0.3014 2.03% FabArray::ParallelCopy_nowait() 1429 0.1839 0.1984 0.2162 1.45% FillBoundary_finish() 6380 0.1339 0.1783 0.2043 1.37% FabArray::sum() 3439 0.176 0.1784 0.1848 1.24% Castro::enforce_min_density() 79 0.01762 0.05687 0.1783 1.20% Castro::initData() 1 0.003387 0.02643 0.1535 1.03% FillBoundary_nowait() 6380 0.07894 0.104 0.1329 0.89% MLPoisson::Fapply() 986 0.09308 0.09806 0.1124 0.76% MLCellLinOp::applyBC() 7148 0.05224 0.06306 0.1045 0.70% Castro::construct_new_gravity_source() 17 0.06845 0.07057 0.07817 0.53% FabArray::Saxpy() 264 0.06678 0.06802 0.07468 0.50% FabArray::Xpay() 945 0.05173 0.05458 0.06136 0.41% Castro::do_new_sources() 17 0.0003776 0.01037 0.05752 0.39% Castro::construct_old_gravity_source() 20 0.04469 0.04552 0.0501 0.34% MultiFab::contains_nan() 37 0.04618 0.04662 0.04853 0.33% AmrLevel::derive() 18 0.03971 0.04039 0.04228 0.28% MLMG::addInterpCorrection() 768 0.03274 0.03544 0.04178 0.28% Castro::do_old_sources() 20 0.0005048 0.01027 0.04125 0.28% StateData::FillBoundary(geom) 143 0 0.01712 0.03347 0.23% amrex::average_down 768 0.02434 0.0264 0.03196 0.21% VisMF::Write(FabArray) 4 0.01204 0.01327 0.02596 0.17% Castro::construct_old_gravity() 20 0.0003653 0.007162 0.02546 0.17% MLMG::ResNormInf() 146 0.004756 0.01451 0.02082 0.14% Amr::writePlotFile() 2 0.007764 0.01888 0.02055 0.14% MLCellLinOp::defineAuxData() 19 0.01423 0.015 0.01692 0.11% FabArray::FillBoundary() 6380 0.01338 0.01396 0.01675 0.11% Castro::wd_update() 2 0.00533 0.00989 0.01605 0.11% MLCGSolver::bicgstab 8 0 0.0009915 0.01586 0.11% Castro::construct_new_source() 102 0.01528 0.01541 0.01576 0.11% FabArray::norminf() 282 0.01082 0.01138 0.01546 0.10% amrex::Add() 128 0.014 0.01415 0.01461 0.10% Castro::evaluate_source_change() 196 0.01238 0.01271 0.01345 0.09% FillPatchIterator::Initialize 147 0.01224 0.01254 0.01327 0.09% FabArrayBase::getFB() 6380 0.009754 0.01024 0.01274 0.09% MLCellLinOp::smooth() 3072 0.01091 0.01147 0.01247 0.08% Castro::volWgtSum() 46 0.007381 0.007776 0.01198 0.08% FabArray::setDomainBndry() 147 0.0004263 0.006318 0.01182 0.08% Castro::construct_old_source() 120 0.009805 0.009967 0.01086 0.07% MLMG::prepareForSolve() 18 0.009884 0.01019 0.01072 0.07% MultiFab::max() 2 0.0004219 0.006649 0.009349 0.06% FabArray::mult() 59 0.007084 0.007308 0.008249 0.06% Gravity::get_old_grav_vector() 20 0.006379 0.006614 0.007965 0.05% MLLinOp::makeSubCommunicator() 19 0.0008416 0.004183 0.007856 0.05% FabArrayBase::getCPC() 2005 0.00724 0.007424 0.007827 0.05% MLMG::solve() 18 0.001055 0.003307 0.007757 0.05% Gravity::actual_solve_with_mlmg() 19 0.006507 0.006841 0.007694 0.05% MLCellLinOp::compGrad() 18 0.005925 0.006094 0.00761 0.05% Castro::sum_integrated_quantities() 2 0.001983 0.00615 0.006749 0.05% Gravity::get_new_grav_vector() 18 0.005936 0.006134 0.006474 0.04% FabArrayBase::CPC::define() 576 0.002174 0.00332 0.006347 0.04% amrex::Dot() 142 0 0.0003943 0.006309 0.04% Amr::writeSmallPlotFile() 2 0.003874 0.005527 0.005861 0.04% Castro::volInBoundary() 14 0.003414 0.003715 0.005535 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003033 0.004852 0.03% Castro::initialize_do_advance() 20 0.004406 0.004639 0.004825 0.03% MLCellLinOp::apply() 986 0.001985 0.002225 0.004695 0.03% Castro::construct_new_gravity() 17 0.0003005 0.001402 0.00428 0.03% BndryData::define() 19 0.003025 0.003159 0.004222 0.03% FabArray::ParallelCopy() 1429 0.003458 0.003613 0.003902 0.03% Gravity::solve_for_phi() 17 0.0008218 0.001173 0.003274 0.02% MLPoisson::normalize() 79 0 0.0001996 0.003194 0.02% AmrLevel::FillPatch() 147 0.002068 0.00217 0.002389 0.02% MLLinOp::defineGrids() 19 0.001775 0.001897 0.002229 0.01% MLCellLinOp::prepareForSolve() 19 0.001637 0.001767 0.002068 0.01% MLCellLinOp::correctionResidual() 768 0.001793 0.001854 0.001927 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001326 0.001536 0.001837 0.01% MLMG::mgVcycle() 128 0.001561 0.001632 0.001798 0.01% MLCellLinOp::defineBC() 19 0.001483 0.001532 0.001636 0.01% MLMG:computeResOfCorrection() 768 0.00136 0.001421 0.001508 0.01% FabArrayBase::FB::FB() 75 0.0002789 0.0006865 0.001441 0.01% main() 1 0.0009521 0.001148 0.001435 0.01% StateData::define() 6 0.001332 0.001355 0.001384 0.01% Castro::save_data_for_retry() 3 0.001229 0.001273 0.001322 0.01% Castro::locWgtSum() 6 0.001157 0.001189 0.001252 0.01% TagBoxArray::collate() 2 0.0001591 0.0005758 0.001069 0.01% MLMG::actualBottomSolve() 128 0.000131 0.0001933 0.001047 0.01% Gravity::applyMetricTerms() 2 0.0004748 0.0005211 0.001043 0.01% StateDataPhysBCFunct::() 147 0.0006808 0.0008098 0.0009232 0.01% MLCellLinOp::setLevelBC() 19 0.0005733 0.0006589 0.0008344 0.01% FillPatchIterator::FillFromLevel0() 147 0.000697 0.0007224 0.000777 0.01% Castro::subcycle_advance_ctu() 1 0.0001852 0.0002399 0.0007758 0.01% AmrMesh::MakeNewGrids() 2 0.0004778 0.0005122 0.0007538 0.01% MLMG::mgVcycle_down::2 128 0.000599 0.0006645 0.0007228 0.00% MLMG::mgVcycle_down::0 128 0.0006642 0.000682 0.0007089 0.00% MLMG::mgVcycle_down::3 128 0.0005669 0.0006085 0.0007089 0.00% MLMG::mgVcycle_down::1 128 0.0006448 0.0006598 0.0007007 0.00% MLMG::mgVcycle_down::4 128 0.0005449 0.0005704 0.0006817 0.00% MLMG::mgVcycle_down::5 128 0.0005635 0.0005851 0.000664 0.00% Castro::buildMetrics() 1 0.0005743 0.0005899 0.0006047 0.00% Castro::clean_state() 79 0.0004355 0.0004695 0.0005426 0.00% Castro::Castro() 1 0.0004586 0.0004931 0.0005399 0.00% Castro::apply_tagging_restrictions() 2 0.0004067 0.0004672 0.0005296 0.00% MLMG::mgVcycle_up::1 128 0.0004525 0.0004744 0.000506 0.00% FillPatchSingleLevel 147 0.0004628 0.000477 0.0005032 0.00% MLMG::mgVcycle_up::0 128 0.0004543 0.0004668 0.0004999 0.00% Castro::do_advance_ctu() 20 0.0004042 0.0004379 0.0004899 0.00% MLMG::mgVcycle_up::2 128 0.0003785 0.0004228 0.0004795 0.00% makeSFC 95 0.0003707 0.0003908 0.0004726 0.00% MLMG::mgVcycle_up::5 128 0.0003912 0.0004054 0.0004537 0.00% Castro::swap_state_time_levels() 8 0.0004151 0.0004261 0.0004459 0.00% MLCellLinOp::solutionResidual() 147 0.0004245 0.0004331 0.0004439 0.00% MLMG::mgVcycle_up::3 128 0.0003691 0.0003912 0.0004409 0.00% MLMG::mgVcycle_up::4 128 0.000376 0.0003901 0.0004366 0.00% MLMG::oneIter() 128 0.0003774 0.0003934 0.000422 0.00% Castro::volProductSum() 2 0.0003998 0.0004077 0.000414 0.00% Castro::enforce_consistent_e() 1 0.0003703 0.000381 0.0003936 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003194 0.0003332 0.000363 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002152 0.000237 0.0002722 0.00% MLMG::mgVcycle_bottom 128 0.0002248 0.0002337 0.0002568 0.00% MLMG::computeResidual() 128 0.0002343 0.0002412 0.0002486 0.00% DistributionMapping::Distribute() 95 0.0002114 0.0002222 0.0002417 0.00% Castro::problem_post_timestep() 2 1.069e-05 2.703e-05 0.0002371 0.00% Castro::finalize_do_advance() 17 0.0001499 0.0001744 0.0002237 0.00% Castro::retry_advance_ctu() 11 5.776e-05 7.196e-05 0.0001814 0.00% Gravity::update_max_rhs() 2 0.0001546 0.0001627 0.0001793 0.00% OwnerMask() 2 0.0001335 0.00015 0.0001673 0.00% MLMG::compResidual() 1 0.0001531 0.000155 0.0001569 0.00% Amr::defBaseLevel() 1 0.0001235 0.0001331 0.000149 0.00% MLPoisson::define() 19 0.0001232 0.0001316 0.0001409 0.00% Castro::check_for_nan() 37 9.917e-05 0.0001088 0.0001387 0.00% Amr::coarseTimeStep() 1 0.000107 0.0001293 0.0001377 0.00% Castro::enforce_speed_limit() 79 0.0001042 0.0001136 0.0001296 0.00% Gravity::test_composite_phi() 1 9.115e-05 0.0001009 0.0001276 0.00% TagBoxArray::mapPRD 2 0.0001048 0.0001119 0.0001197 0.00% Castro::initialize_advance() 1 0.0001006 0.0001045 0.0001186 0.00% Castro::apply_problem_tags() 2 9.205e-05 9.597e-05 0.0001169 0.00% Castro::apply_source_to_state() 37 9.331e-05 0.0001001 0.0001117 0.00% Amr::grid_places() 2 7.704e-05 8.904e-05 0.0001085 0.00% MLLinOp::define() 19 7.627e-05 8.336e-05 0.0001003 0.00% MLPoisson::prepareForSolve() 19 7.641e-05 8.064e-05 8.966e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.946e-05 6.684e-05 8.878e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 3.736e-05 5.915e-05 7.984e-05 0.00% knapsack() 1 5.549e-05 6.006e-05 7.287e-05 0.00% Castro::create_source_corrector() 17 5.279e-05 6.108e-05 6.948e-05 0.00% MultiFab::Swap() 5 6.385e-05 6.613e-05 6.832e-05 0.00% Amr::FinalizeInit() 1 8.558e-06 1.268e-05 6.416e-05 0.00% Castro::expand_state() 20 5.129e-05 5.554e-05 6.217e-05 0.00% Amr::initSubcycle() 1 5.452e-05 5.736e-05 5.995e-05 0.00% MLMG::computeMLResidual() 18 4.012e-05 4.222e-05 4.821e-05 0.00% MLMG::getGradSolution() 18 4.057e-05 4.236e-05 4.68e-05 0.00% Castro::derive() 18 3.941e-05 4.162e-05 4.67e-05 0.00% Gravity::swapTimeLevels() 8 3.336e-05 3.58e-05 4.523e-05 0.00% Castro::construct_old_rotation_source() 20 3.003e-05 3.141e-05 4.337e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.642e-05 2.425e-05 4.237e-05 0.00% MLMG::MLResNormInf() 18 3.341e-05 3.609e-05 3.968e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.104e-05 3.328e-05 3.627e-05 0.00% MLMG::MLRhsNormInf() 18 3.065e-05 3.204e-05 3.599e-05 0.00% Amr::regrid() 1 9.89e-06 1.34e-05 3.475e-05 0.00% Gravity::actual_multilevel_solve() 1 2.594e-05 2.69e-05 2.861e-05 0.00% Castro::post_regrid() 2 1.035e-05 1.205e-05 2.748e-05 0.00% Amr::timeStep() 1 1.213e-05 1.482e-05 2.385e-05 0.00% Castro::construct_new_rotation_source() 17 2.016e-05 2.159e-05 2.29e-05 0.00% Castro::finalize_advance() 1 1.598e-05 1.761e-05 2.02e-05 0.00% Amr::InitializeInit() 1 7.011e-06 8.345e-06 1.585e-05 0.00% Castro::estTimeStep() 10 1.215e-05 1.292e-05 1.52e-05 0.00% Castro::advance() 1 6.567e-06 8.457e-06 1.484e-05 0.00% Castro::post_init() 1 1.185e-05 1.262e-05 1.381e-05 0.00% Amr::bldFineLevels() 1 7.15e-06 7.569e-06 8.331e-06 0.00% Castro::computeInitialDt() 2 6.554e-06 7.129e-06 8.214e-06 0.00% Amr::init() 1 5.985e-06 6.917e-06 7.906e-06 0.00% Castro::post_timestep() 1 5.204e-06 6.149e-06 7.411e-06 0.00% BoxList::parallelComplementIn() 4 6.791e-06 7.042e-06 7.341e-06 0.00% Castro::errorEst() 2 6.115e-06 6.469e-06 7.006e-06 0.00% Gravity::set_mass_offset() 2 4.218e-06 4.833e-06 6.842e-06 0.00% Castro::gwstrain() 2 4.294e-06 4.833e-06 6.776e-06 0.00% BoxList::complementIn 4 6.097e-06 6.256e-06 6.629e-06 0.00% Amr::initialInit() 1 2.96e-06 3.164e-06 3.546e-06 0.00% Castro::FluxRegCrseInit 1 1.659e-06 1.984e-06 2.668e-06 0.00% Castro::FluxRegFineAdd() 1 1.409e-06 1.515e-06 1.609e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.87 14.87 14.87 100.00% Amr::coarseTimeStep() 1 12.34 12.34 12.34 82.98% Amr::timeStep() 1 12.28 12.28 12.28 82.62% Castro::advance() 1 12.22 12.22 12.22 82.21% Castro::subcycle_advance_ctu() 1 12.17 12.17 12.17 81.87% Castro::do_advance_ctu() 20 12.13 12.13 12.14 81.63% Castro::construct_ctu_hydro_source() 20 6.586 6.637 6.721 45.20% Castro::clean_state() 79 3.624 3.802 4.11 27.64% Castro::computeTemp() 80 2.334 2.48 2.767 18.61% Castro::reset_internal_energy(MultiFab) 80 1.456 1.539 1.748 11.76% Gravity::solve_phi_with_mlmg() 19 1.564 1.672 1.731 11.64% Castro::construct_new_gravity() 17 1.488 1.595 1.653 11.12% Amr::InitAmr() 1 1.652 1.652 1.653 11.11% Gravity::solve_for_phi() 17 1.45 1.556 1.615 10.86% Castro::initialize_do_advance() 20 1.395 1.442 1.499 10.08% Gravity::actual_solve_with_mlmg() 19 1.361 1.365 1.37 9.21% MLMG::solve() 18 1.312 1.316 1.317 8.86% Castro::do_old_sources() 20 1.177 1.204 1.219 8.20% MLMG::oneIter() 128 1.159 1.168 1.174 7.90% MLMG::mgVcycle() 128 1.145 1.153 1.16 7.80% FabArray::ParallelCopy() 1429 0.2739 0.8036 1.072 7.21% Castro::do_new_sources() 17 0.9189 0.9728 1.038 6.98% Castro::evaluate_source_change() 196 0.9102 0.9226 0.9563 6.43% Castro::enforce_min_density() 79 0.7646 0.8168 0.9316 6.27% Amr::init() 1 0.8776 0.8776 0.8776 5.90% FabArray::ParallelCopy_finish() 1429 0.05177 0.5819 0.8545 5.75% Amr::initialInit() 1 0.823 0.823 0.8231 5.54% amrex::Copy() 724 0.7647 0.7759 0.8019 5.39% MLCellLinOp::smooth() 3072 0.5986 0.6592 0.7861 5.29% AmrLevel::FillPatch() 147 0.4645 0.6436 0.7854 5.28% FillPatchIterator::Initialize 147 0.2887 0.4678 0.6114 4.11% FillPatchIterator::FillFromLevel0() 147 0.2644 0.4489 0.5946 4.00% FillPatchSingleLevel 147 0.2637 0.4482 0.5939 3.99% Castro::normalize_species() 79 0.5514 0.56 0.5881 3.95% Amr::InitializeInit() 1 0.4328 0.4945 0.5876 3.95% Amr::defBaseLevel() 1 0.4327 0.4945 0.5876 3.95% MultiFab::AddProduct() 3439 0.5328 0.54 0.5598 3.76% Castro::reset_internal_energy(Fab) 160 0.5107 0.52 0.5394 3.63% check_for_negative_density() 20 0.1466 0.3949 0.4665 3.14% MLMG::mgVcycle_up::1 128 0.1083 0.2732 0.4402 2.96% MLCellLinOp::applyBC() 7148 0.3176 0.3702 0.4397 2.96% MLPoisson::Fsmooth() 6144 0.3194 0.3479 0.4215 2.83% Amr::FinalizeInit() 1 0.2354 0.3285 0.3903 2.62% Castro::Castro() 1 0.3547 0.3636 0.3785 2.55% MLMG::addInterpCorrection() 768 0.06132 0.3019 0.3764 2.53% Castro::initMFs() 1 0.3496 0.3585 0.3736 2.51% Gravity::fill_multipole_BCs() 19 0.2003 0.3053 0.3607 2.43% MultiFab::Subtract() 159 0.3343 0.3399 0.3533 2.38% FabArray::setVal() 5013 0.3332 0.339 0.3491 2.35% FabArray::FillBoundary() 6380 0.2611 0.3072 0.3487 2.35% Castro::expand_state() 20 0.176 0.2246 0.2814 1.89% MLMG::mgVcycle_down::0 128 0.2708 0.2737 0.2786 1.87% MLMG::mgVcycle_up::2 128 0.01049 0.1147 0.2735 1.84% FabArray::ParallelCopy_nowait() 1429 0.2029 0.218 0.2367 1.59% Castro::initData() 1 0.0762 0.1293 0.2278 1.53% MLMG::mgVcycle_up::0 128 0.2168 0.2218 0.2259 1.52% FillBoundary_finish() 6380 0.1339 0.1783 0.2043 1.37% MLCellLinOp::apply() 986 0.1559 0.1688 0.2031 1.37% Amr::bldFineLevels() 1 0.046 0.139 0.2003 1.35% FabArray::sum() 3439 0.176 0.1784 0.1848 1.24% MLMG::mgVcycle_up::3 128 0.01039 0.02321 0.1755 1.18% Amr::grid_places() 2 0.002764 0.09582 0.1576 1.06% AmrMesh::MakeNewGrids() 2 0.002681 0.09574 0.1575 1.06% TagBoxArray::mapPRD 2 0.0008571 0.09391 0.156 1.05% Castro::post_init() 1 0.1403 0.1465 0.1492 1.00% MLMG:computeResOfCorrection() 768 0.1171 0.1266 0.1481 1.00% MLCellLinOp::correctionResidual() 768 0.1157 0.1251 0.1466 0.99% FillBoundary_nowait() 6380 0.08917 0.115 0.1443 0.97% MLMG::mgVcycle_down::1 128 0.1252 0.1307 0.1363 0.92% Castro::construct_new_source() 102 0.1214 0.1239 0.1346 0.91% Castro::create_source_corrector() 17 0.04716 0.08482 0.1265 0.85% MLPoisson::Fapply() 986 0.09308 0.09806 0.1124 0.76% Gravity::multilevel_solve_for_new_phi() 1 0.1045 0.1045 0.1045 0.70% Gravity::actual_multilevel_solve() 1 0.1044 0.1044 0.1045 0.70% MLCellLinOp::solutionResidual() 147 0.09251 0.09899 0.1044 0.70% Amr::writePlotFile() 2 0.09846 0.09855 0.09856 0.66% Castro::construct_old_gravity() 20 0.0642 0.07475 0.09488 0.64% Castro::post_regrid() 2 0.08343 0.08607 0.09231 0.62% MLMG::computeResidual() 128 0.07808 0.08193 0.08572 0.58% Castro::construct_old_source() 120 0.07673 0.0779 0.08405 0.57% Gravity::get_old_grav_vector() 20 0.03874 0.06759 0.07886 0.53% Castro::construct_new_gravity_source() 17 0.06845 0.07057 0.07817 0.53% MLMG::mgVcycle_down::2 128 0.01239 0.0424 0.07657 0.51% FabArray::Saxpy() 264 0.06678 0.06802 0.07468 0.50% Castro::derive() 18 0.06788 0.06895 0.07292 0.49% AmrLevel::derive() 18 0.06784 0.06891 0.07287 0.49% MLMG::mgVcycle_bottom 128 0.0003558 0.004771 0.07081 0.48% MLMG::actualBottomSolve() 128 0.000131 0.004538 0.07056 0.47% MLCGSolver::bicgstab 8 0 0.004316 0.06905 0.46% Castro::post_timestep() 1 0.06057 0.0647 0.0688 0.46% FabArray::Xpay() 945 0.05173 0.05458 0.06136 0.41% MLMG::mgVcycle_down::3 128 0.01166 0.01801 0.06046 0.41% amrex::average_down 768 0.03263 0.04008 0.0558 0.38% Castro::initialize_advance() 1 0.04738 0.04869 0.0514 0.35% Castro::construct_old_gravity_source() 20 0.04469 0.04552 0.0501 0.34% Castro::check_for_nan() 37 0.04628 0.04673 0.04864 0.33% MultiFab::contains_nan() 37 0.04618 0.04662 0.04853 0.33% Amr::regrid() 1 0.043 0.04432 0.04803 0.32% Gravity::get_new_grav_vector() 18 0.0344 0.03677 0.03871 0.26% MLPoisson::define() 19 0.02806 0.03276 0.03842 0.26% Castro::retry_advance_ctu() 11 0.03443 0.03506 0.03682 0.25% MLMG::mgVcycle_down::4 128 0.01165 0.01334 0.03471 0.23% StateDataPhysBCFunct::() 147 0.0006808 0.01793 0.03433 0.23% StateData::FillBoundary(geom) 143 0 0.01712 0.03347 0.23% MLMG::ResNormInf() 146 0.01526 0.02421 0.0305 0.21% Castro::apply_source_to_state() 37 0.02727 0.02755 0.02836 0.19% MLMG::mgVcycle_up::4 128 0.01048 0.01175 0.02698 0.18% VisMF::Write(FabArray) 4 0.01204 0.01327 0.02596 0.17% Castro::sum_integrated_quantities() 2 0.02561 0.02575 0.02576 0.17% MLCellLinOp::defineAuxData() 19 0.01824 0.01977 0.02347 0.16% MLMG::prepareForSolve() 18 0.01983 0.02078 0.02292 0.15% MLMG::mgVcycle_down::5 128 0.01158 0.01255 0.02281 0.15% MLMG::computeMLResidual() 18 0.01076 0.01661 0.02136 0.14% Castro::save_data_for_retry() 3 0.01821 0.01852 0.02016 0.14% Castro::problem_post_timestep() 2 0.008899 0.01363 0.01948 0.13% Castro::wd_update() 2 0.008885 0.01361 0.01947 0.13% MLMG::mgVcycle_up::5 128 0.01059 0.01135 0.01941 0.13% FabArray::norminf() 282 0.01082 0.01138 0.01546 0.10% Gravity::test_composite_phi() 1 0.01497 0.01499 0.01501 0.10% amrex::Add() 128 0.014 0.01415 0.01461 0.10% FabArrayBase::getFB() 6380 0.01004 0.01093 0.01418 0.10% FabArrayBase::getCPC() 2005 0.009414 0.01074 0.01391 0.09% Castro::volWgtSum() 46 0.007381 0.007776 0.01198 0.08% FabArray::setDomainBndry() 147 0.0004263 0.006318 0.01182 0.08% MLLinOp::define() 19 0.00371 0.007109 0.0112 0.08% MLLinOp::defineGrids() 19 0.003629 0.007026 0.01111 0.07% Gravity::update_max_rhs() 2 0.001638 0.007899 0.01055 0.07% MLMG::getGradSolution() 18 0.007614 0.008003 0.00972 0.07% MLCellLinOp::compGrad() 18 0.007573 0.007961 0.009674 0.07% MultiFab::max() 2 0.0004219 0.006649 0.009349 0.06% Amr::writeSmallPlotFile() 2 0.008919 0.008924 0.008929 0.06% FabArray::mult() 59 0.007084 0.007308 0.008249 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005069 0.008111 0.05% MLLinOp::makeSubCommunicator() 19 0.0008416 0.004183 0.007856 0.05% MLCellLinOp::defineBC() 19 0.005497 0.005753 0.007238 0.05% FabArrayBase::CPC::define() 576 0.002174 0.00332 0.006347 0.04% amrex::Dot() 142 0 0.0003943 0.006309 0.04% BndryData::define() 19 0.003924 0.004221 0.005602 0.04% Castro::volInBoundary() 14 0.003414 0.003715 0.005535 0.04% MLPoisson::normalize() 79 0 0.0001996 0.003194 0.02% MLPoisson::prepareForSolve() 19 0.001722 0.001847 0.002152 0.01% MLCellLinOp::prepareForSolve() 19 0.001637 0.001767 0.002068 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001326 0.001536 0.001837 0.01% FabArrayBase::FB::FB() 75 0.0002789 0.0006865 0.001441 0.01% AmrLevel::AmrLevel(dm) 1 0.001365 0.001388 0.001421 0.01% StateData::define() 6 0.001332 0.001355 0.001384 0.01% Gravity::swapTimeLevels() 8 0.001105 0.001139 0.00128 0.01% MLMG::MLResNormInf() 18 0.001234 0.001254 0.00127 0.01% MLMG::MLRhsNormInf() 18 0.001215 0.001233 0.001256 0.01% Castro::locWgtSum() 6 0.001157 0.001189 0.001252 0.01% MLMG::compResidual() 1 0.0009648 0.001091 0.00124 0.01% TagBoxArray::collate() 2 0.0001591 0.0005758 0.001069 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009078 0.0009461 0.001065 0.01% Gravity::applyMetricTerms() 2 0.0004748 0.0005211 0.001043 0.01% MLCellLinOp::setLevelBC() 19 0.0005733 0.0006589 0.0008344 0.01% makeSFC 95 0.0005832 0.000613 0.0007016 0.00% Castro::buildMetrics() 1 0.0006311 0.0006484 0.0006682 0.00% Castro::errorEst() 2 0.000505 0.0005697 0.0006534 0.00% Castro::apply_tagging_restrictions() 2 0.0004067 0.0004672 0.0005296 0.00% Castro::swap_state_time_levels() 8 0.0004151 0.0004261 0.0004459 0.00% Castro::volProductSum() 2 0.0003998 0.0004077 0.000414 0.00% Castro::enforce_consistent_e() 1 0.0003703 0.000381 0.0003936 0.00% Castro::finalize_advance() 1 0.000249 0.0002601 0.000327 0.00% DistributionMapping::Distribute() 95 0.0002114 0.0002222 0.0002417 0.00% Castro::finalize_do_advance() 17 0.0001599 0.0001843 0.0002358 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001156 0.0001435 0.0001758 0.00% OwnerMask() 2 0.0001335 0.00015 0.0001673 0.00% Castro::enforce_speed_limit() 79 0.0001042 0.0001136 0.0001296 0.00% Castro::apply_problem_tags() 2 9.205e-05 9.597e-05 0.0001169 0.00% DistributionMapping::LeastUsedCPUs() 1 3.736e-05 5.915e-05 7.984e-05 0.00% knapsack() 1 5.549e-05 6.006e-05 7.287e-05 0.00% MultiFab::Swap() 5 6.385e-05 6.613e-05 6.832e-05 0.00% Amr::initSubcycle() 1 5.452e-05 5.736e-05 5.995e-05 0.00% Castro::construct_old_rotation_source() 20 3.003e-05 3.141e-05 4.337e-05 0.00% Castro::construct_new_rotation_source() 17 2.016e-05 2.159e-05 2.29e-05 0.00% Castro::estTimeStep() 10 1.215e-05 1.292e-05 1.52e-05 0.00% BoxList::parallelComplementIn() 4 1.289e-05 1.33e-05 1.397e-05 0.00% Castro::computeInitialDt() 2 9.539e-06 1.014e-05 1.151e-05 0.00% Gravity::set_mass_offset() 2 4.218e-06 4.833e-06 6.842e-06 0.00% Castro::gwstrain() 2 4.294e-06 4.833e-06 6.776e-06 0.00% BoxList::complementIn 4 6.097e-06 6.256e-06 6.629e-06 0.00% Castro::FluxRegCrseInit 1 1.659e-06 1.984e-06 2.668e-06 0.00% Castro::FluxRegFineAdd() 1 1.409e-06 1.515e-06 1.609e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 13 B 17 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-33-g9e71c2cb9714) finalized