Initializing AMReX (24.04-9-g2a3955a5f5aa)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.04-9-g2a3955a5f5aa) initialized Starting run at 08:09:04 UTC on 2024-04-09. Successfully read inputs file ... Castro git describe: 24.04-11-g2407e8176 AMReX git describe: 24.04-9-g2a3955a5f Microphysics git describe: 24.04-4-ge5fecb7a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.155754701 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001075599 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.011114468 Gravity::multilevel_solve_for_new_phi() time = 0.109584756 Gravity::fill_multipole_BCs() time = 0.010572071 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049701748 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004336263 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002707777 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.062685004 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005156484 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.061874626 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005905147 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.068437826 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004932035 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.057638368 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.31776518 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014063227 Gravity::solve_for_phi() time = 0.084092922 on level 0 Castro::construct_new_gravity() time = 0.086176473 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.059239678 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002640822 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.057679585 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.316967106 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.013763379 Gravity::solve_for_phi() time = 0.082652391 on level 0 Castro::construct_new_gravity() time = 0.084693468 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.058154134 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002635712 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.057438412 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.319587655 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01381726 Gravity::solve_for_phi() time = 0.083438064 on level 0 Castro::construct_new_gravity() time = 0.085860616 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.069304135 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002673637 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.057370967 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323210318 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014741726 Gravity::solve_for_phi() time = 0.084412266 on level 0 Castro::construct_new_gravity() time = 0.08647251 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.060141778 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002772351 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.057461418 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327304784 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014057444 Gravity::solve_for_phi() time = 0.083219344 on level 0 Castro::construct_new_gravity() time = 0.085517717 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.058038414 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002814804 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.057671129 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321564631 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01424491 Gravity::solve_for_phi() time = 0.083205905 on level 0 Castro::construct_new_gravity() time = 0.085263745 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.058154827 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002928771 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.057641934 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327222784 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014307313 Gravity::solve_for_phi() time = 0.083239479 on level 0 Castro::construct_new_gravity() time = 0.085287689 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.058352356 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002619845 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.057475204 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.322930627 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014645359 Gravity::solve_for_phi() time = 0.085037259 on level 0 Castro::construct_new_gravity() time = 0.087087732 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.058969625 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002675612 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.057566108 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332342911 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014934054 Gravity::solve_for_phi() time = 0.08483358 on level 0 Castro::construct_new_gravity() time = 0.086884709 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.0587793 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002740929 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.057508734 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326835355 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014865412 Gravity::solve_for_phi() time = 0.084851233 on level 0 Castro::construct_new_gravity() time = 0.086894659 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.059304495 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002742247 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.057390793 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331457877 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015089496 Gravity::solve_for_phi() time = 0.085247141 on level 0 Castro::construct_new_gravity() time = 0.087309949 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.058943439 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002784709 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.057554415 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327158957 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01544664 Gravity::solve_for_phi() time = 0.08543949 on level 0 Castro::construct_new_gravity() time = 0.087507591 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059006785 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002699915 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.057695079 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33447947 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015276406 Gravity::solve_for_phi() time = 0.09219713 on level 0 Castro::construct_new_gravity() time = 0.094456977 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.066557737 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.011776375 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.065954723 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.347708871 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015424887 Gravity::solve_for_phi() time = 0.0854311 on level 0 Castro::construct_new_gravity() time = 0.087893116 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059245713 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002716179 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.057776788 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328184614 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014848148 Gravity::solve_for_phi() time = 0.083977994 on level 0 Castro::construct_new_gravity() time = 0.086087787 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.058413218 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002565411 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.057393065 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321825646 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01499157 Gravity::solve_for_phi() time = 0.08396691 on level 0 Castro::construct_new_gravity() time = 0.086029989 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.058280037 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002609139 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.057485424 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327241637 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014922245 Gravity::solve_for_phi() time = 0.0837111 on level 0 Castro::construct_new_gravity() time = 0.085834229 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.058425242 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002802883183 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.74788376 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.046625973 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004119784 seconds Ending run at 08:09:18 UTC on 2024-04-09. Run time = 14.38080556 Run time without initialization = 11.79942217 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.38 ... 14.38 ... 14.38 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3339 5.4206 5.5366 38.50% Amr::InitAmr() 1 1.632 1.633 1.633 11.36% Castro::computeTemp() 80 0.8363 0.9377 1.086 7.55% amrex::Copy() 724 0.7627 0.7739 0.7867 5.47% FabArray::ParallelCopy_finish() 1429 0.05781 0.5043 0.7266 5.05% MultiFab::AddProduct() 3439 0.5444 0.5523 0.564 3.92% Castro::normalize_species() 79 0.533 0.5412 0.5485 3.81% Castro::reset_internal_energy(Fab) 160 0.5097 0.5181 0.5279 3.67% MLPoisson::Fsmooth() 6144 0.3097 0.3374 0.4138 2.88% Castro::initMFs() 1 0.3504 0.3607 0.3839 2.67% FabArray::setVal() 5013 0.3497 0.3566 0.3666 2.55% MultiFab::Subtract() 159 0.3393 0.3427 0.3474 2.42% Gravity::fill_multipole_BCs() 19 0.1964 0.2304 0.2687 1.87% check_for_negative_density() 20 0.06033 0.181 0.2642 1.84% FabArray::ParallelCopy_nowait() 1429 0.1831 0.201 0.2233 1.55% FabArray::sum() 3439 0.1849 0.189 0.1928 1.34% Castro::reset_internal_energy(MultiFab) 80 0.02256 0.05458 0.181 1.26% Castro::initData() 1 0.003279 0.02602 0.151 1.05% FillBoundary_finish() 6380 0.09456 0.1174 0.14 0.97% FillBoundary_nowait() 6380 0.07672 0.1026 0.1328 0.92% MLPoisson::Fapply() 986 0.09374 0.09897 0.1145 0.80% MLCellLinOp::applyBC() 7148 0.04667 0.06207 0.1034 0.72% FabArray::Saxpy() 264 0.06783 0.06947 0.07667 0.53% Castro::construct_new_gravity_source() 17 0.06755 0.06918 0.07156 0.50% Castro::sum_integrated_quantities() 2 0.001689 0.0609 0.06532 0.45% Castro::problem_post_timestep() 2 1.183e-05 0.003975 0.06339 0.44% FabArray::Xpay() 945 0.05067 0.05325 0.06067 0.42% Castro::do_new_sources() 17 0.0003609 0.009766 0.05945 0.41% Castro::enforce_min_density() 79 0.01739 0.02794 0.05306 0.37% Castro::construct_old_gravity_source() 20 0.04537 0.04607 0.04705 0.33% MultiFab::contains_nan() 37 0.04408 0.04479 0.04552 0.32% MLMG::addInterpCorrection() 768 0.03289 0.03541 0.0426 0.30% AmrLevel::derive() 18 0.04029 0.04078 0.04176 0.29% StateData::FillBoundary(geom) 143 0 0.01722 0.03357 0.23% amrex::average_down 768 0.02438 0.02645 0.03231 0.22% Castro::do_old_sources() 20 0.0005088 0.006766 0.03112 0.22% VisMF::Write(FabArray) 4 0.01187 0.01318 0.02438 0.17% Amr::writePlotFile() 2 0.00721 0.01693 0.0183 0.13% MLCellLinOp::defineAuxData() 19 0.01459 0.01531 0.01745 0.12% FabArray::FillBoundary() 6380 0.01357 0.0142 0.01734 0.12% Castro::construct_new_source() 102 0.01535 0.01574 0.01692 0.12% MLCGSolver::bicgstab 8 0 0.001018 0.01629 0.11% FabArray::norminf() 282 0.01091 0.01153 0.0156 0.11% amrex::Add() 128 0.01414 0.01432 0.01463 0.10% Castro::evaluate_source_change() 196 0.01232 0.01259 0.01295 0.09% FabArrayBase::getFB() 6380 0.009743 0.01018 0.01291 0.09% FillPatchIterator::Initialize 147 0.01232 0.01259 0.01284 0.09% MultiFab::max() 2 0.0001817 0.009255 0.01267 0.09% MLCellLinOp::smooth() 3072 0.01107 0.01156 0.01242 0.09% MLMG::solve() 18 0.001146 0.006637 0.01182 0.08% FabArray::setDomainBndry() 147 0.0004558 0.006106 0.01149 0.08% MLMG::prepareForSolve() 18 0.01015 0.01042 0.01097 0.08% Castro::wd_update() 2 0.004931 0.007253 0.01028 0.07% Castro::construct_old_source() 120 0.009735 0.009905 0.01022 0.07% MLMG::ResNormInf() 146 0.002168 0.006039 0.008331 0.06% Gravity::actual_solve_with_mlmg() 19 0.006681 0.007042 0.008031 0.06% Castro::volWgtSum() 46 0.007366 0.007429 0.00788 0.05% MLLinOp::makeSubCommunicator() 19 0.0006058 0.004194 0.007869 0.05% FabArray::mult() 59 0.00724 0.007396 0.007602 0.05% FabArrayBase::getCPC() 2005 0.007134 0.007317 0.007588 0.05% Gravity::get_old_grav_vector() 20 0.006405 0.006551 0.007031 0.05% Castro::construct_old_gravity() 20 0.0003569 0.001756 0.006493 0.05% Gravity::get_new_grav_vector() 18 0.005947 0.006122 0.006436 0.04% FabArrayBase::CPC::define() 576 0.002148 0.003293 0.006258 0.04% amrex::Dot() 142 0 0.0003761 0.006017 0.04% MLCellLinOp::compGrad() 18 0.005824 0.005908 0.006014 0.04% TagBoxArray::collate() 2 0.0001325 0.001096 0.005973 0.04% Amr::writeSmallPlotFile() 2 0.003815 0.005478 0.005879 0.04% Castro::volInBoundary() 14 0.003391 0.003675 0.005313 0.04% Castro::initialize_do_advance() 20 0.004394 0.004618 0.005135 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003027 0.004843 0.03% MLCellLinOp::apply() 986 0.001996 0.002207 0.004643 0.03% FabArray::ParallelCopy() 1429 0.003456 0.003646 0.003961 0.03% BndryData::define() 19 0.003083 0.003146 0.003263 0.02% MLPoisson::normalize() 79 0 0.0001983 0.003173 0.02% MLLinOp::defineGrids() 19 0.001753 0.001907 0.002335 0.02% AmrLevel::FillPatch() 147 0.002127 0.002209 0.002303 0.02% MLCellLinOp::prepareForSolve() 19 0.001641 0.0018 0.002112 0.01% MLCellLinOp::correctionResidual() 768 0.001826 0.001885 0.001949 0.01% MLMG::mgVcycle() 128 0.001595 0.001683 0.001896 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001289 0.001549 0.001822 0.01% Castro::construct_new_gravity() 17 0.0003007 0.0005232 0.001757 0.01% main() 1 0.001023 0.001188 0.001717 0.01% MLCellLinOp::defineBC() 19 0.001483 0.001532 0.001644 0.01% StateData::define() 6 0.001312 0.001354 0.001534 0.01% MLMG:computeResOfCorrection() 768 0.001375 0.001424 0.001515 0.01% FabArrayBase::FB::FB() 75 0.0002843 0.0006764 0.001436 0.01% Castro::save_data_for_retry() 3 0.001255 0.001318 0.001424 0.01% Gravity::solve_for_phi() 17 0.0007891 0.0009368 0.001234 0.01% Castro::locWgtSum() 6 0.001113 0.001124 0.001142 0.01% MLMG::actualBottomSolve() 128 0.0001296 0.0001917 0.001059 0.01% StateDataPhysBCFunct::() 147 0.0006771 0.0008078 0.0009835 0.01% MLCellLinOp::setLevelBC() 19 0.0005374 0.0006716 0.000841 0.01% MLMG::mgVcycle_down::2 128 0.0006198 0.0006756 0.000738 0.01% MLMG::mgVcycle_down::3 128 0.0005769 0.0006227 0.0007183 0.00% FillPatchIterator::FillFromLevel0() 147 0.0006728 0.0006955 0.0007149 0.00% Castro::subcycle_advance_ctu() 1 0.000181 0.0002337 0.000708 0.00% MLMG::mgVcycle_down::0 128 0.0006556 0.0006709 0.0006924 0.00% MLMG::mgVcycle_down::1 128 0.0006558 0.0006705 0.0006894 0.00% MLMG::mgVcycle_down::4 128 0.0005606 0.0005872 0.0006885 0.00% Castro::buildMetrics() 1 0.0005821 0.0006003 0.0006867 0.00% MLMG::mgVcycle_down::5 128 0.000585 0.0006026 0.0006712 0.00% AmrMesh::MakeNewGrids() 2 0.0004844 0.0005115 0.0005542 0.00% Castro::apply_tagging_restrictions() 2 0.0004142 0.0004818 0.0005533 0.00% MLMG::mgVcycle_up::1 128 0.0004544 0.0004845 0.000546 0.00% Castro::Castro() 1 0.0004518 0.0004791 0.0005386 0.00% Castro::do_advance_ctu() 20 0.0004111 0.0004509 0.000532 0.00% MLMG::mgVcycle_up::0 128 0.0004637 0.0004787 0.0004945 0.00% Gravity::applyMetricTerms() 2 0.0004691 0.0004813 0.0004927 0.00% FillPatchSingleLevel 147 0.0004594 0.0004777 0.0004918 0.00% Castro::clean_state() 79 0.0004473 0.0004666 0.0004869 0.00% MLMG::mgVcycle_up::2 128 0.0003875 0.0004307 0.0004852 0.00% MLMG::mgVcycle_up::5 128 0.0004016 0.0004138 0.0004707 0.00% MLMG::mgVcycle_up::3 128 0.0003843 0.0004021 0.0004637 0.00% MLCellLinOp::solutionResidual() 147 0.0004204 0.000437 0.000456 0.00% MLMG::mgVcycle_up::4 128 0.0003896 0.0004025 0.0004541 0.00% makeSFC 95 0.000363 0.0003858 0.0004498 0.00% Castro::swap_state_time_levels() 8 0.0004136 0.0004261 0.0004444 0.00% MLMG::oneIter() 128 0.0003854 0.000396 0.0004073 0.00% Castro::volProductSum() 2 0.0003945 0.0003979 0.0004065 0.00% Castro::enforce_consistent_e() 1 0.0003647 0.0003778 0.0003998 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003229 0.0003422 0.0003731 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002167 0.0002338 0.0002607 0.00% MLMG::computeResidual() 128 0.0002396 0.0002442 0.0002555 0.00% DistributionMapping::Distribute() 95 0.0002067 0.0002187 0.0002452 0.00% MLMG::mgVcycle_bottom 128 0.0002244 0.0002314 0.0002448 0.00% Castro::finalize_do_advance() 17 0.0001522 0.0001713 0.0002109 0.00% Gravity::update_max_rhs() 2 0.0001617 0.0001702 0.000181 0.00% OwnerMask() 2 0.000134 0.0001488 0.00017 0.00% MLMG::compResidual() 1 0.0001584 0.0001639 0.00017 0.00% Amr::coarseTimeStep() 1 0.0001054 0.000145 0.0001497 0.00% Castro::retry_advance_ctu() 11 5.976e-05 7.516e-05 0.0001496 0.00% MLPoisson::define() 19 0.0001306 0.0001371 0.0001475 0.00% Amr::defBaseLevel() 1 9.973e-05 0.000112 0.0001259 0.00% DistributionMapping::LeastUsedCPUs() 1 5.834e-05 0.0001051 0.0001248 0.00% Castro::check_for_nan() 37 9.939e-05 0.0001129 0.0001246 0.00% Castro::enforce_speed_limit() 79 0.0001088 0.0001152 0.0001234 0.00% TagBoxArray::mapPRD 2 0.0001103 0.0001153 0.0001203 0.00% Gravity::test_composite_phi() 1 9.083e-05 9.816e-05 0.0001156 0.00% Amr::grid_places() 2 7.279e-05 8.177e-05 0.000112 0.00% Castro::initialize_advance() 1 9.998e-05 0.0001044 0.0001088 0.00% Castro::apply_source_to_state() 37 9.423e-05 9.972e-05 0.0001045 0.00% Castro::apply_problem_tags() 2 9.146e-05 9.395e-05 9.583e-05 0.00% MLPoisson::prepareForSolve() 19 7.311e-05 7.834e-05 8.734e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.183e-05 6.835e-05 8.687e-05 0.00% MultiFab::Swap() 5 6.794e-05 7.288e-05 8.687e-05 0.00% MLLinOp::define() 19 7.421e-05 8.083e-05 8.597e-05 0.00% knapsack() 1 5.842e-05 6.073e-05 6.822e-05 0.00% Castro::create_source_corrector() 17 5.526e-05 6.084e-05 6.693e-05 0.00% Amr::initSubcycle() 1 5.418e-05 5.868e-05 6.494e-05 0.00% Castro::expand_state() 20 5.318e-05 5.542e-05 6.041e-05 0.00% Castro::derive() 18 4.112e-05 4.479e-05 5.641e-05 0.00% MLMG::computeMLResidual() 18 3.996e-05 4.358e-05 4.94e-05 0.00% Amr::FinalizeInit() 1 8.443e-06 1.17e-05 4.938e-05 0.00% MLMG::getGradSolution() 18 3.888e-05 4.051e-05 4.342e-05 0.00% Gravity::swapTimeLevels() 8 3.229e-05 3.469e-05 4.095e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.262e-05 3.566e-05 4.005e-05 0.00% MLMG::MLResNormInf() 18 3.348e-05 3.487e-05 3.636e-05 0.00% MLMG::MLRhsNormInf() 18 3.079e-05 3.19e-05 3.549e-05 0.00% Amr::regrid() 1 1.023e-05 1.278e-05 3.221e-05 0.00% Castro::construct_old_rotation_source() 20 2.956e-05 3.057e-05 3.129e-05 0.00% Gravity::actual_multilevel_solve() 1 2.661e-05 2.765e-05 2.959e-05 0.00% Amr::timeStep() 1 1.193e-05 1.472e-05 2.469e-05 0.00% Castro::construct_new_rotation_source() 17 2.066e-05 2.179e-05 2.422e-05 0.00% Castro::finalize_advance() 1 1.699e-05 1.808e-05 2.255e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.801e-05 1.964e-05 2.048e-05 0.00% Castro::advance() 1 7.294e-06 9.654e-06 1.505e-05 0.00% Castro::post_init() 1 1.212e-05 1.299e-05 1.493e-05 0.00% Castro::estTimeStep() 10 1.218e-05 1.305e-05 1.442e-05 0.00% Amr::InitializeInit() 1 6.563e-06 7.982e-06 1.402e-05 0.00% Castro::post_regrid() 2 1.061e-05 1.153e-05 1.299e-05 0.00% Castro::computeInitialDt() 2 6.571e-06 7.214e-06 9.223e-06 0.00% Amr::init() 1 6.641e-06 7.361e-06 8.302e-06 0.00% Amr::bldFineLevels() 1 6.577e-06 7.231e-06 8.113e-06 0.00% BoxList::parallelComplementIn() 4 6.962e-06 7.267e-06 7.717e-06 0.00% Castro::errorEst() 2 5.94e-06 6.303e-06 6.761e-06 0.00% Castro::post_timestep() 1 5.626e-06 6.062e-06 6.628e-06 0.00% BoxList::complementIn 4 5.948e-06 6.215e-06 6.524e-06 0.00% Castro::gwstrain() 2 4.211e-06 4.714e-06 6.512e-06 0.00% Gravity::set_mass_offset() 2 4.351e-06 4.756e-06 5.234e-06 0.00% Amr::initialInit() 1 2.855e-06 3.106e-06 3.376e-06 0.00% Castro::FluxRegCrseInit 1 1.684e-06 1.878e-06 2.18e-06 0.00% Castro::FluxRegFineAdd() 1 1.38e-06 1.523e-06 1.713e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.38 14.38 14.38 100.00% Amr::coarseTimeStep() 1 11.8 11.8 11.8 82.05% Amr::timeStep() 1 11.75 11.75 11.75 81.69% Castro::advance() 1 11.69 11.69 11.69 81.29% Castro::subcycle_advance_ctu() 1 11.64 11.64 11.64 80.95% Castro::do_advance_ctu() 20 11.6 11.6 11.6 80.69% Castro::construct_ctu_hydro_source() 20 6.338 6.369 6.405 44.54% Castro::clean_state() 79 3.618 3.747 3.91 27.19% Castro::computeTemp() 80 2.329 2.459 2.673 18.58% Castro::reset_internal_energy(MultiFab) 80 1.469 1.521 1.66 11.54% Amr::InitAmr() 1 1.632 1.633 1.633 11.36% Gravity::solve_phi_with_mlmg() 19 1.483 1.519 1.559 10.84% Castro::construct_new_gravity() 17 1.4 1.436 1.475 10.25% Gravity::solve_for_phi() 17 1.363 1.399 1.439 10.00% Castro::initialize_do_advance() 20 1.369 1.401 1.438 10.00% Gravity::actual_solve_with_mlmg() 19 1.282 1.285 1.29 8.97% MLMG::solve() 18 1.232 1.236 1.237 8.60% Castro::do_old_sources() 20 1.148 1.161 1.178 8.19% MLMG::oneIter() 128 1.095 1.097 1.1 7.65% MLMG::mgVcycle() 128 1.08 1.082 1.085 7.54% Castro::do_new_sources() 17 0.9203 0.9676 1.017 7.07% Castro::evaluate_source_change() 196 0.9423 0.9557 0.975 6.78% Amr::init() 1 0.9475 0.9476 0.9476 6.59% FabArray::ParallelCopy() 1429 0.2845 0.7284 0.9462 6.58% Amr::initialInit() 1 0.8927 0.8928 0.8929 6.21% Castro::enforce_min_density() 79 0.78 0.8 0.8312 5.78% amrex::Copy() 724 0.7627 0.7739 0.7867 5.47% FabArray::ParallelCopy_finish() 1429 0.05781 0.5043 0.7266 5.05% MLCellLinOp::smooth() 3072 0.5458 0.5948 0.7214 5.02% AmrLevel::FillPatch() 147 0.4785 0.5715 0.6731 4.68% Amr::InitializeInit() 1 0.4346 0.4949 0.5892 4.10% Amr::defBaseLevel() 1 0.4346 0.4949 0.5892 4.10% MultiFab::AddProduct() 3439 0.5444 0.5523 0.564 3.92% Castro::normalize_species() 79 0.533 0.5412 0.5485 3.81% Castro::reset_internal_energy(Fab) 160 0.5097 0.5181 0.5279 3.67% FillPatchIterator::Initialize 147 0.3008 0.3952 0.499 3.47% FillPatchIterator::FillFromLevel0() 147 0.2766 0.3765 0.4822 3.35% FillPatchSingleLevel 147 0.2758 0.3758 0.4815 3.35% Amr::FinalizeInit() 1 0.3036 0.3979 0.4582 3.19% MLMG::mgVcycle_up::1 128 0.09411 0.2565 0.4193 2.92% MLPoisson::Fsmooth() 6144 0.3097 0.3374 0.4138 2.88% Castro::Castro() 1 0.3558 0.366 0.3894 2.71% Castro::initMFs() 1 0.3506 0.3608 0.3841 2.67% MLCellLinOp::applyBC() 7148 0.2757 0.3072 0.3744 2.60% MLMG::addInterpCorrection() 768 0.06272 0.3 0.3685 2.56% FabArray::setVal() 5013 0.3497 0.3566 0.3666 2.55% MultiFab::Subtract() 159 0.3393 0.3427 0.3474 2.42% MLMG::mgVcycle_up::2 128 0.01064 0.1145 0.2735 1.90% FabArray::FillBoundary() 6380 0.2158 0.2451 0.2728 1.90% Gravity::fill_multipole_BCs() 19 0.1985 0.2324 0.2707 1.88% MLMG::mgVcycle_down::0 128 0.2587 0.2609 0.2645 1.84% check_for_negative_density() 20 0.06033 0.181 0.2642 1.84% Castro::expand_state() 20 0.1829 0.2191 0.2635 1.83% FabArray::ParallelCopy_nowait() 1429 0.2019 0.2204 0.2438 1.70% Castro::initData() 1 0.07622 0.1272 0.2244 1.56% Castro::post_init() 1 0.2051 0.2141 0.2175 1.51% Amr::bldFineLevels() 1 0.04586 0.1408 0.1989 1.38% MLCellLinOp::apply() 986 0.1491 0.1607 0.1969 1.37% MLMG::mgVcycle_up::0 128 0.1946 0.1954 0.1961 1.36% FabArray::sum() 3439 0.1849 0.189 0.1928 1.34% MLMG::mgVcycle_up::3 128 0.01062 0.02328 0.1756 1.22% Amr::grid_places() 2 0.002249 0.09655 0.1569 1.09% AmrMesh::MakeNewGrids() 2 0.002137 0.09647 0.1568 1.09% TagBoxArray::mapPRD 2 0.0007207 0.09411 0.1553 1.08% MLMG:computeResOfCorrection() 768 0.1127 0.1221 0.1457 1.01% FillBoundary_nowait() 6380 0.08705 0.1135 0.1445 1.00% MLCellLinOp::correctionResidual() 768 0.1114 0.1207 0.1442 1.00% FillBoundary_finish() 6380 0.09456 0.1174 0.14 0.97% Castro::construct_new_source() 102 0.1218 0.1245 0.1315 0.91% MLMG::mgVcycle_down::1 128 0.1138 0.1172 0.1216 0.85% MLPoisson::Fapply() 986 0.09374 0.09897 0.1145 0.80% Gravity::multilevel_solve_for_new_phi() 1 0.1095 0.1096 0.1096 0.76% Gravity::actual_multilevel_solve() 1 0.1094 0.1095 0.1095 0.76% MLCellLinOp::solutionResidual() 147 0.08784 0.09404 0.09888 0.69% Amr::writePlotFile() 2 0.09688 0.09695 0.09697 0.67% Castro::post_regrid() 2 0.08381 0.08719 0.09624 0.67% Castro::sum_integrated_quantities() 2 0.02084 0.08018 0.08414 0.59% Castro::construct_old_source() 120 0.07793 0.07901 0.08046 0.56% Castro::create_source_corrector() 17 0.04849 0.06226 0.0798 0.55% MLMG::computeResidual() 128 0.07546 0.07626 0.07701 0.54% FabArray::Saxpy() 264 0.06783 0.06947 0.07667 0.53% Castro::derive() 18 0.06846 0.06946 0.07604 0.53% AmrLevel::derive() 18 0.06842 0.06942 0.07598 0.53% Castro::problem_post_timestep() 2 0.008961 0.0149 0.07223 0.50% Castro::construct_new_gravity_source() 17 0.06755 0.06918 0.07156 0.50% MLMG::mgVcycle_bottom 128 0.0003579 0.004799 0.07132 0.50% MLMG::mgVcycle_down::2 128 0.01247 0.04067 0.07113 0.49% MLMG::actualBottomSolve() 128 0.0001296 0.004568 0.07108 0.49% MLCGSolver::bicgstab 8 0 0.004347 0.06955 0.48% Castro::construct_old_gravity() 20 0.04287 0.05448 0.06248 0.43% Gravity::get_old_grav_vector() 20 0.04084 0.05273 0.06203 0.43% Castro::post_timestep() 1 0.05702 0.05877 0.06124 0.43% FabArray::Xpay() 945 0.05067 0.05325 0.06067 0.42% MLMG::mgVcycle_down::3 128 0.01179 0.01798 0.05953 0.41% amrex::average_down 768 0.03252 0.03906 0.05535 0.38% Amr::regrid() 1 0.04306 0.04534 0.0537 0.37% Castro::initialize_advance() 1 0.04869 0.04919 0.04964 0.35% Castro::construct_old_gravity_source() 20 0.04537 0.04607 0.04705 0.33% Castro::check_for_nan() 37 0.04418 0.04491 0.04565 0.32% MultiFab::contains_nan() 37 0.04408 0.04479 0.04552 0.32% MLPoisson::define() 19 0.02894 0.0331 0.03919 0.27% Castro::retry_advance_ctu() 11 0.03567 0.0367 0.03834 0.27% Gravity::get_new_grav_vector() 18 0.03508 0.03599 0.03704 0.26% MLMG::mgVcycle_down::4 128 0.01171 0.01338 0.03474 0.24% StateDataPhysBCFunct::() 147 0.0006771 0.01803 0.03443 0.24% StateData::FillBoundary(geom) 143 0 0.01722 0.03357 0.23% Castro::apply_source_to_state() 37 0.02762 0.02815 0.02968 0.21% MLMG::mgVcycle_up::4 128 0.01072 0.01188 0.02716 0.19% VisMF::Write(FabArray) 4 0.01187 0.01318 0.02438 0.17% MLCellLinOp::defineAuxData() 19 0.01865 0.0201 0.02409 0.17% MLMG::prepareForSolve() 18 0.02039 0.02144 0.02397 0.17% MLMG::mgVcycle_down::5 128 0.0117 0.01256 0.02288 0.16% MLMG::computeMLResidual() 18 0.01166 0.01732 0.02231 0.16% Castro::save_data_for_retry() 3 0.01832 0.019 0.02096 0.15% MLMG::mgVcycle_up::5 128 0.01079 0.01148 0.01961 0.14% MLMG::ResNormInf() 146 0.01212 0.01587 0.01792 0.12% FabArray::norminf() 282 0.01091 0.01153 0.0156 0.11% amrex::Add() 128 0.01414 0.01432 0.01463 0.10% FabArrayBase::getFB() 6380 0.01003 0.01086 0.01435 0.10% Gravity::test_composite_phi() 1 0.01404 0.01409 0.01412 0.10% Gravity::update_max_rhs() 2 0.001446 0.01051 0.01389 0.10% FabArrayBase::getCPC() 2005 0.009335 0.01061 0.01385 0.10% Castro::wd_update() 2 0.008836 0.01093 0.01367 0.10% MultiFab::max() 2 0.0001817 0.009255 0.01267 0.09% FabArray::setDomainBndry() 147 0.0004558 0.006106 0.01149 0.08% MLLinOp::define() 19 0.003693 0.007128 0.01113 0.08% MLLinOp::defineGrids() 19 0.003609 0.007048 0.01105 0.08% Amr::writeSmallPlotFile() 2 0.008825 0.008836 0.008838 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005078 0.008125 0.06% MLMG::getGradSolution() 18 0.007519 0.007757 0.00808 0.06% MLCellLinOp::compGrad() 18 0.007479 0.007716 0.008039 0.06% Castro::volWgtSum() 46 0.007366 0.007429 0.00788 0.05% MLLinOp::makeSubCommunicator() 19 0.0006058 0.004194 0.007869 0.05% FabArray::mult() 59 0.00724 0.007396 0.007602 0.05% FabArrayBase::CPC::define() 576 0.002148 0.003293 0.006258 0.04% amrex::Dot() 142 0 0.0003761 0.006017 0.04% TagBoxArray::collate() 2 0.0001325 0.001096 0.005973 0.04% MLCellLinOp::defineBC() 19 0.005558 0.005737 0.005968 0.04% Castro::volInBoundary() 14 0.003391 0.003675 0.005313 0.04% BndryData::define() 19 0.004037 0.004206 0.004397 0.03% MLPoisson::normalize() 79 0 0.0001983 0.003173 0.02% MLPoisson::prepareForSolve() 19 0.001729 0.001878 0.002189 0.02% MLCellLinOp::prepareForSolve() 19 0.001641 0.0018 0.002112 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001289 0.001549 0.001822 0.01% MLMG::MLRhsNormInf() 18 0.001199 0.00125 0.001686 0.01% MLMG::MLResNormInf() 18 0.001245 0.001286 0.001591 0.01% AmrLevel::AmrLevel(dm) 1 0.001345 0.00139 0.001574 0.01% StateData::define() 6 0.001312 0.001354 0.001534 0.01% FabArrayBase::FB::FB() 75 0.0002843 0.0006764 0.001436 0.01% MLMG::compResidual() 1 0.0009426 0.001121 0.001261 0.01% Gravity::swapTimeLevels() 8 0.001151 0.001188 0.001242 0.01% Castro::locWgtSum() 6 0.001113 0.001124 0.001142 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0008965 0.0009467 0.001035 0.01% MLCellLinOp::setLevelBC() 19 0.0005374 0.0006716 0.000841 0.01% Castro::buildMetrics() 1 0.0006434 0.0006632 0.0007607 0.01% makeSFC 95 0.0005713 0.0006046 0.000686 0.00% Castro::errorEst() 2 0.0005123 0.0005821 0.0006548 0.00% Castro::apply_tagging_restrictions() 2 0.0004142 0.0004818 0.0005533 0.00% Gravity::applyMetricTerms() 2 0.0004691 0.0004813 0.0004927 0.00% Castro::swap_state_time_levels() 8 0.0004136 0.0004261 0.0004444 0.00% Castro::volProductSum() 2 0.0003945 0.0003979 0.0004065 0.00% Castro::enforce_consistent_e() 1 0.0003647 0.0003778 0.0003998 0.00% Castro::finalize_advance() 1 0.0002516 0.0002588 0.0002699 0.00% DistributionMapping::Distribute() 95 0.0002067 0.0002187 0.0002452 0.00% Castro::finalize_do_advance() 17 0.0001625 0.0001812 0.0002206 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001453 0.0001855 0.0002058 0.00% OwnerMask() 2 0.000134 0.0001488 0.00017 0.00% DistributionMapping::LeastUsedCPUs() 1 5.834e-05 0.0001051 0.0001248 0.00% Castro::enforce_speed_limit() 79 0.0001088 0.0001152 0.0001234 0.00% Castro::apply_problem_tags() 2 9.146e-05 9.395e-05 9.583e-05 0.00% MultiFab::Swap() 5 6.794e-05 7.288e-05 8.687e-05 0.00% knapsack() 1 5.842e-05 6.073e-05 6.822e-05 0.00% Amr::initSubcycle() 1 5.418e-05 5.868e-05 6.494e-05 0.00% Castro::construct_old_rotation_source() 20 2.956e-05 3.057e-05 3.129e-05 0.00% Castro::construct_new_rotation_source() 17 2.066e-05 2.179e-05 2.422e-05 0.00% Castro::estTimeStep() 10 1.218e-05 1.305e-05 1.442e-05 0.00% BoxList::parallelComplementIn() 4 1.294e-05 1.348e-05 1.424e-05 0.00% Castro::computeInitialDt() 2 9.519e-06 1.032e-05 1.378e-05 0.00% BoxList::complementIn 4 5.948e-06 6.215e-06 6.524e-06 0.00% Castro::gwstrain() 2 4.211e-06 4.714e-06 6.512e-06 0.00% Gravity::set_mass_offset() 2 4.351e-06 4.756e-06 5.234e-06 0.00% Castro::FluxRegCrseInit 1 1.684e-06 1.878e-06 2.18e-06 0.00% Castro::FluxRegFineAdd() 1 1.38e-06 1.523e-06 1.713e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 13 B 18 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-9-g2a3955a5f5aa) finalized