Initializing AMReX (24.02-30-g2ecafcff4013)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.02-30-g2ecafcff4013) initialized Starting run at 08:47:04 UTC on 2024-03-01. Successfully read inputs file ... Castro git describe: 24.02-26-g582f93d7e AMReX git describe: 24.02-30-g2ecafcff4 Microphysics git describe: 24.02-31-ge587300c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.148675185 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000989128 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010292289 Gravity::multilevel_solve_for_new_phi() time = 0.094076691 Gravity::fill_multipole_BCs() time = 0.010369706 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.048025392 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004009622 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002920698 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.063561653 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 , 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003130886 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.062748809 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003892909 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.059255962 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.002714242 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.05867843 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32680846 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014015463 Gravity::solve_for_phi() time = 0.082230681 on level 0 Castro::construct_new_gravity() time = 0.084380944 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.059763606 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002814674 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.05982343 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329385142 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014927475 Gravity::solve_for_phi() time = 0.102040049 on level 0 Castro::construct_new_gravity() time = 0.104614911 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.059756359 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002945735 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058442444 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.350968784 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014539957 Gravity::solve_for_phi() time = 0.082219303 on level 0 Castro::construct_new_gravity() time = 0.084304897 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.062948606 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003484832 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058737848 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327277869 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014461731 Gravity::solve_for_phi() time = 0.081915703 on level 0 Castro::construct_new_gravity() time = 0.084060116 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.059172256 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002647817 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059394663 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33603046 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014641493 Gravity::solve_for_phi() time = 0.082464685 on level 0 Castro::construct_new_gravity() time = 0.084606414 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060102727 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003142467 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.063499132 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334139631 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.021461259 Gravity::solve_for_phi() time = 0.088997309 on level 0 Castro::construct_new_gravity() time = 0.091120197 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.06002767 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002560951 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.063572941 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337441024 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015940984 Gravity::solve_for_phi() time = 0.084369577 on level 0 Castro::construct_new_gravity() time = 0.086489738 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059506218 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002714265 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.060367903 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329341278 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015090712 Gravity::solve_for_phi() time = 0.082640787 on level 0 Castro::construct_new_gravity() time = 0.084703148 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.06097978 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003027053 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058615144 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335327928 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015856674 Gravity::solve_for_phi() time = 0.084341906 on level 0 Castro::construct_new_gravity() time = 0.086491731 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.060670631 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003329431 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059872012 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327025283 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01540417 Gravity::solve_for_phi() time = 0.083560496 on level 0 Castro::construct_new_gravity() time = 0.08568421 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.059150992 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002765153 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058518565 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32864577 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014886326 Gravity::solve_for_phi() time = 0.082220728 on level 0 Castro::construct_new_gravity() time = 0.084348923 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059812445 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002570464 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058433288 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324751531 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015776903 Gravity::solve_for_phi() time = 0.083857403 on level 0 Castro::construct_new_gravity() time = 0.085999529 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.060232 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.00264225 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058819759 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333712848 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015791011 Gravity::solve_for_phi() time = 0.083039754 on level 0 Castro::construct_new_gravity() time = 0.085159189 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.060023232 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003302975 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.05859396 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325073105 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015276227 Gravity::solve_for_phi() time = 0.082723082 on level 0 Castro::construct_new_gravity() time = 0.084845887 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059541085 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002561268 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058905809 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329285507 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015242041 Gravity::solve_for_phi() time = 0.081838976 on level 0 Castro::construct_new_gravity() time = 0.08397618 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059079465 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002559822 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058844613 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324703607 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015564003 Gravity::solve_for_phi() time = 0.082388644 on level 0 Castro::construct_new_gravity() time = 0.084521101 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059572626 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002846681 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058577579 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329795123 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016132516 Gravity::solve_for_phi() time = 0.08325114 on level 0 Castro::construct_new_gravity() time = 0.085388382 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.060679436 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002796368934 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.78270337 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.04891658 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004087998 seconds Ending run at 08:47:18 UTC on 2024-03-01. Run time = 14.23649276 Run time without initialization = 11.83649199 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.24 ... 14.24 ... 14.24 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.4256 5.4654 5.5250 38.81% Amr::InitAmr() 1 1.541 1.541 1.541 10.83% Castro::computeTemp() 80 0.8547 0.959 1.12 7.87% amrex::Copy() 724 0.8285 0.8314 0.8386 5.89% FabArray::ParallelCopy_finish() 1429 0.0515 0.4591 0.6663 4.68% MultiFab::AddProduct() 3439 0.5499 0.551 0.5539 3.89% Castro::normalize_species() 79 0.5391 0.5412 0.5447 3.83% Castro::reset_internal_energy(Fab) 160 0.5218 0.5253 0.5327 3.74% MultiFab::Subtract() 159 0.3413 0.3476 0.4322 3.04% MLPoisson::Fsmooth() 6144 0.3123 0.3373 0.4059 2.85% Castro::initMFs() 1 0.3575 0.3589 0.3609 2.53% FabArray::setVal() 5013 0.3392 0.3415 0.3473 2.44% Gravity::fill_multipole_BCs() 19 0.1959 0.2391 0.2781 1.95% Castro::reset_internal_energy(MultiFab) 80 0.02233 0.06119 0.2154 1.51% FabArray::ParallelCopy_nowait() 1429 0.1827 0.1972 0.215 1.51% FabArray::sum() 3439 0.1889 0.1895 0.1909 1.34% check_for_negative_density() 20 0.1073 0.1367 0.1668 1.17% Castro::initData() 1 0.003272 0.02571 0.1495 1.05% FillBoundary_finish() 6380 0.08055 0.1048 0.1318 0.93% FillBoundary_nowait() 6380 0.07128 0.09445 0.1202 0.84% MLPoisson::Fapply() 986 0.09523 0.09953 0.1135 0.80% MLCellLinOp::applyBC() 7148 0.04583 0.06123 0.1022 0.72% FabArray::Saxpy() 264 0.06769 0.06843 0.07524 0.53% Castro::construct_new_gravity_source() 17 0.06835 0.06962 0.07056 0.50% Castro::do_new_sources() 17 0.0003353 0.01173 0.06716 0.47% FabArray::Xpay() 945 0.05187 0.05434 0.06114 0.43% Castro::enforce_min_density() 79 0.01693 0.02543 0.05932 0.42% Castro::do_old_sources() 20 0.0004664 0.01074 0.05215 0.37% MultiFab::contains_nan() 37 0.04424 0.04478 0.05011 0.35% Castro::construct_old_gravity_source() 20 0.04504 0.04538 0.04627 0.33% MLMG::addInterpCorrection() 768 0.03318 0.03554 0.04196 0.29% AmrLevel::derive() 18 0.04065 0.04099 0.04144 0.29% StateData::FillBoundary(geom) 143 0 0.0169 0.0326 0.23% amrex::average_down 768 0.02414 0.02606 0.03163 0.22% VisMF::Write(FabArray) 4 0.01192 0.01301 0.02372 0.17% Castro::construct_old_gravity() 20 0.0003341 0.00299 0.01694 0.12% MLCellLinOp::defineAuxData() 19 0.01395 0.01474 0.0168 0.12% FabArray::FillBoundary() 6380 0.01331 0.01378 0.0165 0.12% Amr::writePlotFile() 2 0.006376 0.01542 0.01642 0.12% MLCGSolver::bicgstab 8 0 0.001002 0.01603 0.11% Castro::construct_new_source() 102 0.01532 0.01545 0.01577 0.11% FabArray::norminf() 282 0.01091 0.01131 0.01524 0.11% amrex::Add() 128 0.01423 0.01434 0.01492 0.10% Castro::evaluate_source_change() 196 0.01245 0.01271 0.01378 0.10% FillPatchIterator::Initialize 147 0.01225 0.01238 0.01262 0.09% FabArrayBase::getFB() 6380 0.009897 0.01027 0.01254 0.09% MLCellLinOp::smooth() 3072 0.01086 0.0113 0.01247 0.09% Castro::wd_update() 2 0.005022 0.007822 0.01141 0.08% FabArray::setDomainBndry() 147 0.0004431 0.005939 0.01123 0.08% MLMG::prepareForSolve() 18 0.009742 0.009932 0.01047 0.07% Castro::construct_old_source() 120 0.009751 0.009876 0.01004 0.07% Castro::volWgtSum() 46 0.007089 0.00726 0.009202 0.06% Castro::sum_integrated_quantities() 2 0.001856 0.008063 0.008611 0.06% MLMG::ResNormInf() 146 0.004626 0.006758 0.008521 0.06% MLLinOp::makeSubCommunicator() 19 0.0005471 0.004036 0.00785 0.06% Gravity::actual_solve_with_mlmg() 19 0.006554 0.006828 0.007621 0.05% FabArrayBase::getCPC() 2005 0.00696 0.007164 0.007474 0.05% FabArray::mult() 59 0.006918 0.007045 0.007415 0.05% Gravity::get_old_grav_vector() 20 0.006368 0.006436 0.006667 0.05% Gravity::get_new_grav_vector() 18 0.005972 0.006125 0.006469 0.05% FabArrayBase::CPC::define() 576 0.002126 0.003235 0.006152 0.04% amrex::Dot() 142 0 0.0003761 0.006017 0.04% MLMG::solve() 18 0.00144 0.003141 0.005802 0.04% MLCellLinOp::compGrad() 18 0.005646 0.005697 0.005787 0.04% Castro::volInBoundary() 14 0.00337 0.00369 0.005486 0.04% Amr::writeSmallPlotFile() 2 0.003486 0.005051 0.005273 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003129 0.005007 0.04% Castro::initialize_do_advance() 20 0.004303 0.004394 0.004596 0.03% MLCellLinOp::apply() 986 0.001944 0.002171 0.004581 0.03% FabArray::ParallelCopy() 1429 0.003438 0.003541 0.003746 0.03% BndryData::define() 19 0.002994 0.003046 0.003311 0.02% MLPoisson::normalize() 79 0 0.0001978 0.003165 0.02% MLLinOp::defineGrids() 19 0.001693 0.001831 0.002389 0.02% AmrLevel::FillPatch() 147 0.002033 0.002146 0.002373 0.02% Castro::construct_new_gravity() 17 0.0002649 0.0006984 0.002081 0.01% MLCellLinOp::prepareForSolve() 19 0.001645 0.001787 0.002051 0.01% MLCellLinOp::correctionResidual() 768 0.001808 0.001866 0.001946 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001306 0.001525 0.001775 0.01% MLMG::mgVcycle() 128 0.001563 0.001623 0.001742 0.01% MLCellLinOp::defineBC() 19 0.001477 0.001527 0.001634 0.01% MultiFab::max() 2 0.0001444 0.0008613 0.00153 0.01% MLMG:computeResOfCorrection() 768 0.001367 0.00141 0.001505 0.01% FabArrayBase::FB::FB() 75 0.0002695 0.0006578 0.0014 0.01% Gravity::solve_for_phi() 17 0.000731 0.0009111 0.001383 0.01% StateData::define() 6 0.00125 0.00129 0.00134 0.01% Castro::save_data_for_retry() 3 0.001223 0.00126 0.00128 0.01% main() 1 0.0009592 0.001121 0.001246 0.01% TagBoxArray::collate() 2 0.0001181 0.0004849 0.001189 0.01% Castro::locWgtSum() 6 0.00111 0.001127 0.001152 0.01% MLMG::actualBottomSolve() 128 0.0001324 0.0001912 0.001035 0.01% StateDataPhysBCFunct::() 147 0.00064 0.0007811 0.0008782 0.01% MLCellLinOp::setLevelBC() 19 0.0005608 0.0006716 0.0008388 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006676 0.0007064 0.0007647 0.01% MLMG::mgVcycle_down::1 128 0.0006301 0.0006482 0.0007287 0.01% MLMG::mgVcycle_down::0 128 0.00063 0.0006507 0.0007138 0.01% Castro::subcycle_advance_ctu() 1 0.0001773 0.0002224 0.0007091 0.00% MLMG::mgVcycle_down::2 128 0.0006112 0.0006489 0.0006842 0.00% MLMG::mgVcycle_down::3 128 0.0005688 0.0006092 0.0006751 0.00% MLMG::mgVcycle_down::5 128 0.0005719 0.0005925 0.0006491 0.00% MLMG::mgVcycle_down::4 128 0.0005563 0.0005762 0.0006491 0.00% Castro::Castro() 1 0.0004564 0.0005499 0.0006181 0.00% Castro::apply_tagging_restrictions() 2 0.0004312 0.0004899 0.0005893 0.00% Castro::buildMetrics() 1 0.0005268 0.0005389 0.0005694 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002036 0.0002443 0.0005691 0.00% AmrMesh::MakeNewGrids() 2 0.0004963 0.0005044 0.0005286 0.00% FillPatchSingleLevel 147 0.0004683 0.0004842 0.000516 0.00% MLMG::mgVcycle_up::0 128 0.0004428 0.0004589 0.0004989 0.00% MLMG::mgVcycle_up::1 128 0.0004318 0.0004527 0.0004915 0.00% Castro::do_advance_ctu() 20 0.0004066 0.000436 0.0004906 0.00% Gravity::applyMetricTerms() 2 0.0004719 0.0004792 0.0004898 0.00% Castro::clean_state() 79 0.0004113 0.000437 0.0004847 0.00% MLCellLinOp::solutionResidual() 147 0.0004141 0.0004322 0.0004503 0.00% MLMG::mgVcycle_up::2 128 0.0003821 0.0004129 0.0004423 0.00% MLMG::mgVcycle_up::3 128 0.0003796 0.000395 0.0004391 0.00% MLMG::mgVcycle_up::5 128 0.0003956 0.0004048 0.000437 0.00% makeSFC 95 0.0003571 0.0003814 0.0004349 0.00% Castro::swap_state_time_levels() 8 0.0004062 0.0004162 0.0004296 0.00% MLMG::mgVcycle_up::4 128 0.0003863 0.000396 0.0004274 0.00% MLMG::oneIter() 128 0.0003601 0.0003734 0.0004008 0.00% Castro::volProductSum() 2 0.0003864 0.0003912 0.0003977 0.00% Castro::enforce_consistent_e() 1 0.0003616 0.0003668 0.0003762 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003226 0.0003341 0.0003576 0.00% Castro::problem_post_timestep() 2 1.112e-05 3.358e-05 0.00035 0.00% MLMG::computeResidual() 128 0.0002368 0.0002437 0.0002746 0.00% MLMG::mgVcycle_bottom 128 0.0002225 0.0002295 0.0002409 0.00% DistributionMapping::Distribute() 95 0.0002031 0.000212 0.0002292 0.00% Castro::finalize_do_advance() 17 0.0001481 0.0001642 0.0001857 0.00% Gravity::update_max_rhs() 2 0.0001546 0.0001598 0.0001717 0.00% OwnerMask() 2 0.0001303 0.0001517 0.000169 0.00% MLPoisson::define() 19 0.0001221 0.0001366 0.0001684 0.00% MLMG::compResidual() 1 0.0001515 0.0001553 0.0001623 0.00% Amr::defBaseLevel() 1 0.0001204 0.000137 0.0001451 0.00% Gravity::test_composite_phi() 1 9.189e-05 9.94e-05 0.0001319 0.00% Castro::retry_advance_ctu() 11 5.107e-05 5.813e-05 0.0001298 0.00% Amr::coarseTimeStep() 1 0.0001044 0.0001258 0.0001287 0.00% TagBoxArray::mapPRD 2 0.0001073 0.0001154 0.0001236 0.00% Castro::enforce_speed_limit() 79 0.000102 0.0001087 0.0001215 0.00% Castro::check_for_nan() 37 9.761e-05 0.0001053 0.0001189 0.00% Amr::grid_places() 2 7.489e-05 9.053e-05 0.0001181 0.00% Castro::initialize_advance() 1 9.724e-05 0.0001022 0.000116 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.701e-05 7.153e-05 0.0001059 0.00% Castro::apply_source_to_state() 37 9.038e-05 9.723e-05 0.0001053 0.00% MLPoisson::prepareForSolve() 19 7.404e-05 8.041e-05 0.0001036 0.00% Castro::apply_problem_tags() 2 9.41e-05 9.497e-05 9.69e-05 0.00% Amr::FinalizeInit() 1 8.186e-06 2.129e-05 9.297e-05 0.00% MultiFab::Swap() 5 6.477e-05 6.839e-05 8.486e-05 0.00% MLLinOp::define() 19 7.1e-05 7.645e-05 7.935e-05 0.00% Castro::create_source_corrector() 17 5.302e-05 5.848e-05 6.712e-05 0.00% knapsack() 1 5.563e-05 5.88e-05 6.236e-05 0.00% Castro::expand_state() 20 5.005e-05 5.34e-05 6.212e-05 0.00% Amr::initSubcycle() 1 5.691e-05 5.774e-05 6.034e-05 0.00% Castro::derive() 18 3.981e-05 4.221e-05 5.098e-05 0.00% Gravity::swapTimeLevels() 8 3.254e-05 3.484e-05 4.998e-05 0.00% MLMG::computeMLResidual() 18 3.838e-05 4.186e-05 4.611e-05 0.00% MLMG::getGradSolution() 18 3.859e-05 3.989e-05 4.193e-05 0.00% MLMG::MLResNormInf() 18 3.261e-05 3.478e-05 3.976e-05 0.00% Gravity::actual_multilevel_solve() 1 2.596e-05 2.733e-05 3.6e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.651e-05 2.621e-05 3.577e-05 0.00% Castro::finalize_advance() 1 1.618e-05 1.87e-05 3.503e-05 0.00% Castro::construct_old_rotation_source() 20 2.981e-05 3.076e-05 3.502e-05 0.00% MLMG::MLRhsNormInf() 18 3.15e-05 3.206e-05 3.325e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.143e-05 3.237e-05 3.319e-05 0.00% Amr::regrid() 1 1.052e-05 1.238e-05 3.201e-05 0.00% Castro::construct_new_rotation_source() 17 2.039e-05 2.194e-05 2.703e-05 0.00% Castro::computeInitialDt() 2 6.785e-06 8.565e-06 2.525e-05 0.00% Castro::post_regrid() 2 1.04e-05 1.217e-05 2.287e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.663e-05 1.772e-05 2.009e-05 0.00% Amr::InitializeInit() 1 6.652e-06 8.385e-06 1.795e-05 0.00% Amr::timeStep() 1 1.123e-05 1.294e-05 1.673e-05 0.00% Amr::init() 1 5.568e-06 7.099e-06 1.655e-05 0.00% Castro::estTimeStep() 10 1.198e-05 1.266e-05 1.364e-05 0.00% Castro::post_init() 1 1.154e-05 1.215e-05 1.344e-05 0.00% Castro::advance() 1 7.351e-06 8.941e-06 1.218e-05 0.00% Castro::post_timestep() 1 5.194e-06 6.232e-06 9.359e-06 0.00% Amr::bldFineLevels() 1 6.612e-06 7.678e-06 9.327e-06 0.00% BoxList::parallelComplementIn() 4 6.941e-06 7.188e-06 7.447e-06 0.00% Castro::errorEst() 2 6.079e-06 6.375e-06 6.736e-06 0.00% BoxList::complementIn 4 5.832e-06 6.056e-06 6.42e-06 0.00% Castro::gwstrain() 2 4.106e-06 4.734e-06 6.225e-06 0.00% Gravity::set_mass_offset() 2 4.243e-06 4.637e-06 5.206e-06 0.00% Amr::initialInit() 1 2.761e-06 3.052e-06 4.793e-06 0.00% Castro::FluxRegCrseInit 1 1.66e-06 1.968e-06 2.6e-06 0.00% Castro::FluxRegFineAdd() 1 1.424e-06 1.527e-06 1.68e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.24 14.24 14.24 100.00% Amr::coarseTimeStep() 1 11.84 11.84 11.84 83.14% Amr::timeStep() 1 11.78 11.78 11.78 82.76% Castro::advance() 1 11.71 11.72 11.72 82.31% Castro::subcycle_advance_ctu() 1 11.66 11.67 11.67 81.96% Castro::do_advance_ctu() 20 11.63 11.63 11.63 81.70% Castro::construct_ctu_hydro_source() 20 6.351 6.388 6.424 45.12% Castro::clean_state() 79 3.702 3.81 3.953 27.76% Castro::computeTemp() 80 2.408 2.517 2.716 19.08% Castro::reset_internal_energy(MultiFab) 80 1.511 1.558 1.707 11.99% Amr::InitAmr() 1 1.541 1.541 1.541 10.83% Gravity::solve_phi_with_mlmg() 19 1.446 1.491 1.535 10.78% Castro::construct_new_gravity() 17 1.379 1.424 1.467 10.31% Gravity::solve_for_phi() 17 1.342 1.387 1.43 10.05% Castro::initialize_do_advance() 20 1.36 1.384 1.418 9.96% Gravity::actual_solve_with_mlmg() 19 1.245 1.249 1.253 8.80% MLMG::solve() 18 1.197 1.201 1.202 8.44% Castro::do_old_sources() 20 1.145 1.18 1.195 8.39% MLMG::oneIter() 128 1.066 1.068 1.07 7.52% MLMG::mgVcycle() 128 1.052 1.053 1.055 7.41% Castro::do_new_sources() 17 0.9457 0.9837 1.022 7.18% Castro::evaluate_source_change() 196 0.9447 0.9473 0.9543 6.70% FabArray::ParallelCopy() 1429 0.2715 0.6801 0.8849 6.22% Amr::init() 1 0.8582 0.8582 0.8582 6.03% Castro::enforce_min_density() 79 0.7958 0.8084 0.8421 5.91% amrex::Copy() 724 0.8285 0.8314 0.8386 5.89% Amr::initialInit() 1 0.8053 0.8053 0.8054 5.66% MLCellLinOp::smooth() 3072 0.5307 0.5785 0.7009 4.92% FabArray::ParallelCopy_finish() 1429 0.0515 0.4591 0.6663 4.68% AmrLevel::FillPatch() 147 0.4768 0.5448 0.6274 4.41% Amr::InitializeInit() 1 0.4423 0.4956 0.5894 4.14% Amr::defBaseLevel() 1 0.4423 0.4956 0.5894 4.14% MultiFab::AddProduct() 3439 0.5499 0.551 0.5539 3.89% Castro::normalize_species() 79 0.5391 0.5412 0.5447 3.83% Castro::reset_internal_energy(Fab) 160 0.5218 0.5253 0.5327 3.74% FillPatchIterator::Initialize 147 0.288 0.3554 0.4379 3.08% MultiFab::Subtract() 159 0.3413 0.3476 0.4322 3.04% FillPatchIterator::FillFromLevel0() 147 0.2644 0.3371 0.4211 2.96% FillPatchSingleLevel 147 0.2637 0.3364 0.4204 2.95% MLPoisson::Fsmooth() 6144 0.3123 0.3373 0.4059 2.85% MLMG::mgVcycle_up::1 128 0.09118 0.2472 0.4044 2.84% Castro::Castro() 1 0.3628 0.3642 0.3661 2.57% Amr::FinalizeInit() 1 0.2159 0.3097 0.363 2.55% Castro::initMFs() 1 0.3576 0.359 0.3611 2.54% MLMG::addInterpCorrection() 768 0.06128 0.2912 0.3572 2.51% MLCellLinOp::applyBC() 7148 0.2577 0.2851 0.3563 2.50% FabArray::setVal() 5013 0.3392 0.3415 0.3473 2.44% Gravity::fill_multipole_BCs() 19 0.1981 0.2413 0.2803 1.97% MLMG::mgVcycle_up::2 128 0.01063 0.111 0.2643 1.86% FabArray::FillBoundary() 6380 0.2 0.2239 0.2574 1.81% MLMG::mgVcycle_down::0 128 0.2531 0.2543 0.2563 1.80% FabArray::ParallelCopy_nowait() 1429 0.2023 0.2174 0.236 1.66% Castro::initData() 1 0.07783 0.1299 0.2249 1.58% Castro::expand_state() 20 0.1779 0.1846 0.202 1.42% MLMG::mgVcycle_up::0 128 0.1925 0.1936 0.1948 1.37% Amr::bldFineLevels() 1 0.04591 0.1397 0.1927 1.35% FabArray::sum() 3439 0.1889 0.1895 0.1909 1.34% MLCellLinOp::apply() 986 0.146 0.1553 0.1901 1.34% MLMG::mgVcycle_up::3 128 0.01052 0.02295 0.1725 1.21% check_for_negative_density() 20 0.1073 0.1367 0.1668 1.17% Amr::grid_places() 2 0.002575 0.09636 0.1497 1.05% AmrMesh::MakeNewGrids() 2 0.002457 0.09627 0.1496 1.05% TagBoxArray::mapPRD 2 0.0006456 0.09453 0.1478 1.04% MLMG:computeResOfCorrection() 768 0.1112 0.1202 0.1428 1.00% MLCellLinOp::correctionResidual() 768 0.1099 0.1188 0.1413 0.99% FillBoundary_finish() 6380 0.08055 0.1048 0.1318 0.93% FillBoundary_nowait() 6380 0.08147 0.1054 0.1315 0.92% Castro::post_init() 1 0.1261 0.1268 0.1275 0.90% Castro::construct_new_source() 102 0.1218 0.1234 0.1249 0.88% MLMG::mgVcycle_down::1 128 0.1088 0.1115 0.1147 0.81% MLPoisson::Fapply() 986 0.09523 0.09953 0.1135 0.80% Amr::writePlotFile() 2 0.09745 0.09756 0.09757 0.69% MLCellLinOp::solutionResidual() 147 0.08728 0.09165 0.09541 0.67% Gravity::multilevel_solve_for_new_phi() 1 0.09402 0.09406 0.0941 0.66% Gravity::actual_multilevel_solve() 1 0.09396 0.09399 0.09403 0.66% Castro::create_source_corrector() 17 0.0479 0.06959 0.09328 0.66% Castro::post_regrid() 2 0.08579 0.08648 0.0872 0.61% Castro::construct_old_source() 120 0.07743 0.07789 0.07901 0.55% MLMG::computeResidual() 128 0.07595 0.07651 0.07715 0.54% Castro::derive() 18 0.07091 0.07156 0.07643 0.54% AmrLevel::derive() 18 0.07087 0.07152 0.07638 0.54% FabArray::Saxpy() 264 0.06769 0.06843 0.07524 0.53% Castro::construct_new_gravity_source() 17 0.06835 0.06962 0.07056 0.50% MLMG::mgVcycle_bottom 128 0.0003563 0.004743 0.07044 0.49% MLMG::actualBottomSolve() 128 0.0001324 0.004514 0.0702 0.49% MLMG::mgVcycle_down::2 128 0.01236 0.03967 0.07014 0.49% Castro::post_timestep() 1 0.06461 0.06711 0.06961 0.49% MLCGSolver::bicgstab 8 0 0.004292 0.06868 0.48% Castro::construct_old_gravity() 20 0.04076 0.0522 0.06732 0.47% FabArray::Xpay() 945 0.05187 0.05434 0.06114 0.43% MLMG::mgVcycle_down::3 128 0.01171 0.01773 0.05808 0.41% amrex::average_down 768 0.03211 0.03809 0.0534 0.38% Gravity::get_old_grav_vector() 20 0.03868 0.04921 0.05338 0.37% Castro::initialize_advance() 1 0.0484 0.04893 0.05034 0.35% Castro::check_for_nan() 37 0.04434 0.04488 0.05023 0.35% MultiFab::contains_nan() 37 0.04424 0.04478 0.05011 0.35% Castro::construct_old_gravity_source() 20 0.04504 0.04538 0.04627 0.33% Amr::regrid() 1 0.044 0.04429 0.04447 0.31% MLPoisson::define() 19 0.02769 0.03206 0.03772 0.26% Gravity::get_new_grav_vector() 18 0.03522 0.03606 0.03724 0.26% Castro::retry_advance_ctu() 11 0.03603 0.03631 0.03677 0.26% MLMG::mgVcycle_down::4 128 0.01167 0.01332 0.03419 0.24% StateDataPhysBCFunct::() 147 0.00064 0.01768 0.03343 0.23% StateData::FillBoundary(geom) 143 0 0.0169 0.0326 0.23% Castro::apply_source_to_state() 37 0.02758 0.02771 0.02784 0.20% Castro::sum_integrated_quantities() 2 0.02735 0.02758 0.0276 0.19% MLMG::mgVcycle_up::4 128 0.0106 0.01177 0.0266 0.19% VisMF::Write(FabArray) 4 0.01192 0.01301 0.02372 0.17% MLCellLinOp::defineAuxData() 19 0.01791 0.01946 0.02329 0.16% MLMG::prepareForSolve() 18 0.01989 0.02066 0.02279 0.16% MLMG::mgVcycle_down::5 128 0.0117 0.01254 0.02265 0.16% Castro::save_data_for_retry() 3 0.01963 0.01975 0.01997 0.14% MLMG::mgVcycle_up::5 128 0.01068 0.01136 0.01916 0.13% MLMG::computeMLResidual() 18 0.01053 0.0147 0.01823 0.13% MLMG::ResNormInf() 146 0.0143 0.01641 0.01814 0.13% FabArray::norminf() 282 0.01091 0.01131 0.01524 0.11% amrex::Add() 128 0.01423 0.01434 0.01492 0.10% Castro::problem_post_timestep() 2 0.009316 0.01155 0.01486 0.10% Castro::wd_update() 2 0.008966 0.01151 0.01485 0.10% FabArrayBase::getFB() 6380 0.01019 0.01092 0.01394 0.10% Gravity::test_composite_phi() 1 0.01373 0.01376 0.0138 0.10% FabArrayBase::getCPC() 2005 0.009187 0.0104 0.01354 0.10% FabArray::setDomainBndry() 147 0.0004431 0.005939 0.01123 0.08% MLLinOp::define() 19 0.003348 0.006871 0.01102 0.08% MLLinOp::defineGrids() 19 0.003269 0.006795 0.01094 0.08% Castro::volWgtSum() 46 0.007089 0.00726 0.009202 0.06% Amr::writeSmallPlotFile() 2 0.008476 0.008478 0.00848 0.06% MLCGSolver::ParallelAllReduce 227 0 0.000517 0.008272 0.06% MLLinOp::makeSubCommunicator() 19 0.0005471 0.004036 0.00785 0.06% MLMG::getGradSolution() 18 0.007183 0.007364 0.007578 0.05% MLCellLinOp::compGrad() 18 0.007144 0.007325 0.007536 0.05% FabArray::mult() 59 0.006918 0.007045 0.007415 0.05% FabArrayBase::CPC::define() 576 0.002126 0.003235 0.006152 0.04% MLCellLinOp::defineBC() 19 0.005458 0.005596 0.00604 0.04% amrex::Dot() 142 0 0.0003761 0.006017 0.04% Castro::volInBoundary() 14 0.00337 0.00369 0.005486 0.04% BndryData::define() 19 0.003874 0.004068 0.004407 0.03% MLPoisson::normalize() 79 0 0.0001978 0.003165 0.02% Gravity::update_max_rhs() 2 0.001382 0.002091 0.002773 0.02% MLPoisson::prepareForSolve() 19 0.00173 0.001868 0.002126 0.01% MLCellLinOp::prepareForSolve() 19 0.001645 0.001787 0.002051 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001306 0.001525 0.001775 0.01% MultiFab::max() 2 0.0001444 0.0008613 0.00153 0.01% FabArrayBase::FB::FB() 75 0.0002695 0.0006578 0.0014 0.01% AmrLevel::AmrLevel(dm) 1 0.001283 0.001323 0.001373 0.01% MLMG::MLResNormInf() 18 0.001248 0.001271 0.001345 0.01% StateData::define() 6 0.00125 0.00129 0.00134 0.01% MLMG::MLRhsNormInf() 18 0.00122 0.001243 0.001275 0.01% Gravity::swapTimeLevels() 8 0.001122 0.001154 0.001255 0.01% MLMG::compResidual() 1 0.0009368 0.001091 0.001247 0.01% TagBoxArray::collate() 2 0.0001181 0.0004849 0.001189 0.01% Castro::locWgtSum() 6 0.00111 0.001127 0.001152 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0008852 0.0009275 0.00101 0.01% MLCellLinOp::setLevelBC() 19 0.0005608 0.0006716 0.0008388 0.01% Castro::errorEst() 2 0.0005324 0.0005912 0.000691 0.00% makeSFC 95 0.0005608 0.0005934 0.0006569 0.00% Castro::buildMetrics() 1 0.0005848 0.0005971 0.0006283 0.00% Castro::apply_tagging_restrictions() 2 0.0004312 0.0004899 0.0005893 0.00% Gravity::applyMetricTerms() 2 0.0004719 0.0004792 0.0004898 0.00% Castro::swap_state_time_levels() 8 0.0004062 0.0004162 0.0004296 0.00% Castro::volProductSum() 2 0.0003864 0.0003912 0.0003977 0.00% Castro::enforce_consistent_e() 1 0.0003616 0.0003668 0.0003762 0.00% Castro::finalize_advance() 1 0.0002676 0.0002759 0.0002962 0.00% DistributionMapping::Distribute() 95 0.0002031 0.000212 0.0002292 0.00% Castro::finalize_do_advance() 17 0.000158 0.0001739 0.0001955 0.00% OwnerMask() 2 0.0001303 0.0001517 0.000169 0.00% Castro::enforce_speed_limit() 79 0.000102 0.0001087 0.0001215 0.00% DistributionMapping::KnapSackDoIt() 1 9.09e-05 0.0001027 0.0001182 0.00% Castro::apply_problem_tags() 2 9.41e-05 9.497e-05 9.69e-05 0.00% MultiFab::Swap() 5 6.477e-05 6.839e-05 8.486e-05 0.00% knapsack() 1 5.563e-05 5.88e-05 6.236e-05 0.00% Amr::initSubcycle() 1 5.691e-05 5.774e-05 6.034e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.651e-05 2.621e-05 3.577e-05 0.00% Castro::construct_old_rotation_source() 20 2.981e-05 3.076e-05 3.502e-05 0.00% Castro::computeInitialDt() 2 9.797e-06 1.154e-05 2.827e-05 0.00% Castro::construct_new_rotation_source() 17 2.039e-05 2.194e-05 2.703e-05 0.00% BoxList::parallelComplementIn() 4 1.289e-05 1.324e-05 1.377e-05 0.00% Castro::estTimeStep() 10 1.198e-05 1.266e-05 1.364e-05 0.00% BoxList::complementIn 4 5.832e-06 6.056e-06 6.42e-06 0.00% Castro::gwstrain() 2 4.106e-06 4.734e-06 6.225e-06 0.00% Gravity::set_mass_offset() 2 4.243e-06 4.637e-06 5.206e-06 0.00% Castro::FluxRegCrseInit 1 1.66e-06 1.968e-06 2.6e-06 0.00% Castro::FluxRegFineAdd() 1 1.424e-06 1.527e-06 1.68e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 12 B 13 B 16 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.02-30-g2ecafcff4013) finalized