Initializing AMReX (24.09-12-g41353f6ab5cb)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.09-12-g41353f6ab5cb) initialized Starting run at 08:04:44 UTC on 2024-09-05. Successfully read inputs file ... Castro git describe: 24.09-2-g97555d411 AMReX git describe: 24.09-12-g41353f6ab Microphysics git describe: 24.09 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data Now regridding at level lbase = 0 grid_places() time: 0.219101062 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 grid_places() time: 0.001192549 new finest: 0 Gravity::fill_multipole_BCs() time = 0.010961277 Gravity::multilevel_solve_for_new_phi() time = 0.114564308 ... norm of composite residual at level 0 1.193955541e-11 Gravity::fill_multipole_BCs() time = 0.010641446 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.050771809 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.00426213 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Castro::construct_old_gravity() time = 0.00419026 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.064113011 on level 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Castro::construct_old_gravity() time = 0.006866311 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.062699108 on level 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Castro::construct_old_gravity() time = 0.004236814 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060038791 on level 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. ... Entering construct_ctu_hydro_source() on level 0 Castro::construct_old_gravity() time = 0.007367922 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060067998 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Castro::construct_ctu_hydro_source() time = 0.31427307 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014065107 Gravity::solve_for_phi() time = 0.091993406 on level 0 Castro::construct_new_gravity() time = 0.094184377 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.05991971 on level 0 Castro::construct_old_gravity() time = 0.00288153 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.062993476 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Castro::construct_ctu_hydro_source() time = 0.337123491 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.022984541 Gravity::solve_for_phi() time = 0.101786229 on level 0 Castro::construct_new_gravity() time = 0.103984506 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.059711441 on level 0 Castro::construct_old_gravity() time = 0.002872249 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.063260138 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Castro::construct_ctu_hydro_source() time = 0.324413982 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014382188 Gravity::solve_for_phi() time = 0.098497555 on level 0 Castro::construct_new_gravity() time = 0.100664703 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.059623404 on level 0 Castro::construct_old_gravity() time = 0.002739992 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.05878684 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 Castro::construct_ctu_hydro_source() time = 0.343526637 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014253559 Gravity::solve_for_phi() time = 0.09246894 on level 0 Castro::construct_new_gravity() time = 0.094634272 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.05918858 on level 0 Castro::construct_old_gravity() time = 0.004848553 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060525023 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 Castro::construct_ctu_hydro_source() time = 0.342522301 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014827217 Gravity::solve_for_phi() time = 0.098942551 on level 0 Castro::construct_new_gravity() time = 0.101255249 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.059128966 on level 0 Castro::construct_old_gravity() time = 0.002855906 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.061412321 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 Castro::construct_ctu_hydro_source() time = 0.327262418 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014570672 Gravity::solve_for_phi() time = 0.092147073 on level 0 Castro::construct_new_gravity() time = 0.094296786 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.059106024 on level 0 Castro::construct_old_gravity() time = 0.003323118 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058760507 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 Castro::construct_ctu_hydro_source() time = 0.3340794 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014217531 Gravity::solve_for_phi() time = 0.093824068 on level 0 Castro::construct_new_gravity() time = 0.096010146 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060117252 on level 0 Castro::construct_old_gravity() time = 0.003308511 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.061450251 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 Castro::construct_ctu_hydro_source() time = 0.331811871 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.024355989 Gravity::solve_for_phi() time = 0.102870455 on level 0 Castro::construct_new_gravity() time = 0.105014952 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.058860952 on level 0 Castro::construct_old_gravity() time = 0.003009749 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058423964 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 Castro::construct_ctu_hydro_source() time = 0.33477817 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014639913 Gravity::solve_for_phi() time = 0.093073888 on level 0 Castro::construct_new_gravity() time = 0.095220147 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.058683454 on level 0 Castro::construct_old_gravity() time = 0.003713454 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058736248 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 Castro::construct_ctu_hydro_source() time = 0.328715149 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.019324595 Gravity::solve_for_phi() time = 0.097827916 on level 0 Castro::construct_new_gravity() time = 0.099974303 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.058766987 on level 0 Castro::construct_old_gravity() time = 0.00324799 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059079422 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 Castro::construct_ctu_hydro_source() time = 0.334881265 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015054278 Gravity::solve_for_phi() time = 0.09341622 on level 0 Castro::construct_new_gravity() time = 0.095691873 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059141009 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003190797 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058853625 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 Castro::construct_ctu_hydro_source() time = 0.325487223 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.019709497 Gravity::solve_for_phi() time = 0.098702827 on level 0 Castro::construct_new_gravity() time = 0.100847783 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.058637163 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003003852 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058158882 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 Castro::construct_ctu_hydro_source() time = 0.330128058 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014651613 Gravity::solve_for_phi() time = 0.092825011 on level 0 Castro::construct_new_gravity() time = 0.094971004 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.058563402 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002743399 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058341479 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 Castro::construct_ctu_hydro_source() time = 0.330393533 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.025961685 Gravity::solve_for_phi() time = 0.104865386 on level 0 Castro::construct_new_gravity() time = 0.107116208 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059006076 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003265838 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.072117012 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 Castro::construct_ctu_hydro_source() time = 0.339614918 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015903294 Gravity::solve_for_phi() time = 0.102014196 on level 0 Castro::construct_new_gravity() time = 0.104176401 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.058949385 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002908711 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059843372 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 Castro::construct_ctu_hydro_source() time = 0.327430477 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015794147 Gravity::solve_for_phi() time = 0.099433961 on level 0 Castro::construct_new_gravity() time = 0.101650021 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.060014324 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.003072177 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.065771939 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 Castro::construct_ctu_hydro_source() time = 0.348084068 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002731362254 [Level 0 step 1] Advanced 32768 cells Gravity::fill_multipole_BCs() time = 0.014932107 Gravity::solve_for_phi() time = 0.093102206 on level 0 Castro::construct_new_gravity() time = 0.095265921 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.058843113 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 STEP = 1 TIME = 0.25 DT = 0.25 [STEP 1] Coarse TimeStep time: 12.05686323 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.048669535 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004336426 seconds Ending run at 08:04:59 UTC on 2024-09-05. Run time = 14.42345207 Run time without initialization = 12.11078573 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.4234 ... 14.4235 ... 14.4235 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.2751 5.3505 5.4622 37.87% Amr::InitAmr() 1 1.355 1.355 1.355 9.39% Castro::computeTemp() 80 0.8536 0.9576 1.107 7.67% amrex::Copy() 724 0.7923 0.8048 0.8216 5.70% FabArray::ParallelCopy_finish() 1429 0.3228 0.5872 0.7959 5.52% Castro::normalize_species() 79 0.549 0.5573 0.5722 3.97% MultiFab::AddProduct() 3439 0.5504 0.5577 0.5722 3.97% Castro::reset_internal_energy(Fab) 160 0.519 0.5283 0.5462 3.79% MLPoisson::Fsmooth() 6144 0.3515 0.3827 0.4558 3.16% Castro::initMFs() 1 0.3564 0.3729 0.424 2.94% FabArray::setVal() 5013 0.3512 0.3563 0.3631 2.52% MultiFab::Subtract() 159 0.3457 0.3503 0.3558 2.47% check_for_negative_density() 20 0.1235 0.2481 0.333 2.31% Gravity::fill_multipole_BCs() 19 0.234 0.2783 0.3046 2.11% FabArray::ParallelCopy_nowait() 1429 0.2052 0.2255 0.2436 1.69% FillBoundary_finish() 6380 0.124 0.1615 0.2011 1.39% FabArray::sum() 3439 0.1832 0.1857 0.1905 1.32% Castro::initData() 1 0.003323 0.02771 0.1621 1.12% FillBoundary_nowait() 6380 0.09087 0.123 0.1562 1.08% TagBoxArray::collate() 2 0.0002435 0.03946 0.1473 1.02% MLCellLinOp::applyBC() 7148 0.06381 0.07999 0.1256 0.87% MLPoisson::Fapply() 986 0.09448 0.09993 0.1126 0.78% FabArray::Saxpy() 264 0.06687 0.06853 0.07476 0.52% Castro::construct_new_gravity_source() 17 0.06855 0.06989 0.07171 0.50% FabArray::Xpay() 945 0.05201 0.05492 0.06116 0.42% Castro::construct_old_gravity_source() 20 0.04505 0.0458 0.04688 0.33% MultiFab::contains_nan() 37 0.04499 0.04566 0.04646 0.32% MLMG::addInterpCorrection() 768 0.03411 0.03705 0.04442 0.31% AmrLevel::derive() 18 0.04059 0.04126 0.04193 0.29% amrex::average_down 768 0.02488 0.02742 0.03389 0.23% StateData::FillBoundary(geom) 143 0 0.0176 0.03331 0.23% VisMF::Write(FabArray) 4 0.01373 0.01514 0.02696 0.19% Castro::reset_internal_energy(MultiFab) 80 0.02354 0.02405 0.02568 0.18% MLCellLinOp::defineAuxData() 19 0.01593 0.01689 0.0202 0.14% Castro::enforce_min_density() 79 0.01882 0.01903 0.01942 0.13% Amr::writePlotFile() 2 0.007205 0.01651 0.01849 0.13% MLCGSolver::bicgstab 8 0 0.001097 0.01755 0.12% Castro::construct_new_source() 102 0.01596 0.01624 0.01735 0.12% FabArray::FillBoundary() 6380 0.01363 0.01432 0.01702 0.12% MLMG::ResNormInf() 146 0.008786 0.01247 0.01647 0.11% FabArray::norminf() 282 0.01091 0.01145 0.01551 0.11% amrex::Add() 128 0.01435 0.01458 0.01526 0.11% Castro::evaluate_source_change() 196 0.01382 0.01427 0.01525 0.11% FabArray::setDomainBndry() 147 0.0004895 0.007893 0.01485 0.10% MLCellLinOp::smooth() 3072 0.01173 0.01239 0.01417 0.10% FabArrayBase::getFB() 6380 0.01091 0.0115 0.01375 0.10% FillPatchIterator::Initialize 147 0.01292 0.01316 0.01362 0.09% MLMG::prepareForSolve() 18 0.01029 0.01063 0.01155 0.08% Castro::construct_old_source() 120 0.01019 0.01037 0.01082 0.08% Castro::wd_update() 2 0.005413 0.007981 0.01056 0.07% Gravity::actual_solve_with_mlmg() 19 0.007459 0.007807 0.009029 0.06% FabArrayBase::getCPC() 2005 0.00769 0.007893 0.008299 0.06% MLMG::solve() 18 0.0009894 0.003768 0.00783 0.05% Gravity::get_old_grav_vector() 20 0.006606 0.006798 0.007215 0.05% Gravity::get_new_grav_vector() 18 0.006154 0.006327 0.00681 0.05% Castro::initialize_do_advance() 20 0.004394 0.004679 0.004944 0.03% MLCellLinOp::apply() 986 0.002034 0.002261 0.004704 0.03% FabArray::ParallelCopy() 1429 0.003497 0.00368 0.003938 0.03% AmrLevel::FillPatch() 147 0.002398 0.002503 0.002694 0.02% Castro::sum_integrated_quantities() 2 0.001726 0.002223 0.00259 0.02% MLLinOp::defineGrids() 19 0.002035 0.002136 0.002454 0.02% MLCellLinOp::correctionResidual() 768 0.001915 0.001995 0.002064 0.01% MLMG::mgVcycle() 128 0.001625 0.001704 0.001848 0.01% MLMG:computeResOfCorrection() 768 0.00153 0.00158 0.001706 0.01% Castro::save_data_for_retry() 3 0.001311 0.00135 0.001406 0.01% Castro::subcycle_advance_ctu() 1 0.0002535 0.0003389 0.001101 0.01% MLMG::actualBottomSolve() 128 0.000131 0.0001946 0.001069 0.01% StateDataPhysBCFunct::() 147 0.0007222 0.0008902 0.000994 0.01% Gravity::solve_for_phi() 17 0.000678 0.0007074 0.0008046 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006926 0.000714 0.0007706 0.01% main() 1 0.0007137 0.0007349 0.0007651 0.01% MLMG::mgVcycle_down::2 128 0.0006448 0.0006986 0.0007632 0.01% MLMG::mgVcycle_down::1 128 0.0006788 0.0006972 0.0007538 0.01% MLMG::mgVcycle_down::0 128 0.0006711 0.0006977 0.000745 0.01% MLMG::mgVcycle_down::3 128 0.0006001 0.0006521 0.0007244 0.01% MLMG::mgVcycle_down::4 128 0.0005821 0.0006165 0.0007154 0.00% MLMG::mgVcycle_down::5 128 0.0006076 0.000628 0.0006876 0.00% AmrMesh::MakeNewGrids() 2 0.0005764 0.000597 0.000632 0.00% Castro::Castro() 1 0.0004673 0.0005167 0.0006075 0.00% MLMG::mgVcycle_up::0 128 0.0005019 0.0005124 0.0005451 0.00% MLMG::mgVcycle_up::1 128 0.0004849 0.0005086 0.0005341 0.00% MLMG::mgVcycle_up::2 128 0.0004211 0.0004609 0.0005079 0.00% Castro::clean_state() 79 0.0004472 0.0004695 0.0005075 0.00% FillPatchSingleLevel 147 0.0004688 0.0004897 0.0005063 0.00% MLMG::mgVcycle_up::4 128 0.000418 0.0004357 0.0004955 0.00% MLCellLinOp::solutionResidual() 147 0.000457 0.0004734 0.0004922 0.00% MLMG::mgVcycle_up::3 128 0.0004161 0.0004353 0.000482 0.00% MLMG::mgVcycle_up::5 128 0.0004094 0.0004254 0.0004803 0.00% MLMG::oneIter() 128 0.0003977 0.0004114 0.0004496 0.00% Castro::do_advance_ctu() 20 0.0003964 0.0004174 0.0004441 0.00% Castro::construct_new_gravity() 17 0.0001635 0.0001798 0.0003158 0.00% Castro::do_old_sources() 20 0.0002831 0.0002948 0.0003055 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002203 0.0002386 0.0002677 0.00% MLMG::computeResidual() 128 0.0002385 0.0002479 0.0002627 0.00% Castro::problem_post_timestep() 2 1.082e-05 2.732e-05 0.0002582 0.00% MLMG::mgVcycle_bottom 128 0.0002302 0.0002396 0.0002521 0.00% Castro::do_new_sources() 17 0.0002111 0.0002199 0.000235 0.00% Amr::defBaseLevel() 1 0.0001227 0.0001342 0.0001775 0.00% Amr::coarseTimeStep() 1 0.0001417 0.0001669 0.0001717 0.00% MLPoisson::define() 19 0.0001283 0.0001447 0.0001634 0.00% Castro::retry_advance_ctu() 11 5.798e-05 7.17e-05 0.0001569 0.00% TagBoxArray::mapPRD 2 0.0001246 0.0001348 0.0001503 0.00% Castro::construct_old_gravity() 20 0.0001082 0.000121 0.0001437 0.00% Castro::check_for_nan() 37 0.0001086 0.0001188 0.0001421 0.00% Gravity::test_composite_phi() 1 0.0001065 0.0001118 0.0001394 0.00% Castro::initialize_advance() 1 0.0001129 0.0001185 0.0001346 0.00% Castro::apply_source_to_state() 37 0.0001003 0.0001052 0.0001125 0.00% Amr::grid_places() 2 5.328e-05 6.268e-05 8.637e-05 0.00% MLLinOp::define() 19 7.427e-05 7.925e-05 8.411e-05 0.00% Castro::create_source_corrector() 17 5.446e-05 6.321e-05 7.403e-05 0.00% Amr::FinalizeInit() 1 1.535e-05 2.416e-05 7.237e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.873e-05 6.136e-05 6.48e-05 0.00% Castro::expand_state() 20 5.09e-05 5.569e-05 6.465e-05 0.00% MLMG::computeMLResidual() 18 4.156e-05 4.628e-05 5.901e-05 0.00% Castro::derive() 18 4.067e-05 4.305e-05 4.672e-05 0.00% Amr::regrid() 1 1.72e-05 2.039e-05 4.236e-05 0.00% Gravity::actual_multilevel_solve() 1 3.107e-05 3.316e-05 3.594e-05 0.00% Amr::timeStep() 1 1.429e-05 1.615e-05 2.368e-05 0.00% Castro::post_regrid() 2 1.152e-05 1.467e-05 2.146e-05 0.00% Amr::InitializeInit() 1 8.19e-06 1.135e-05 2.067e-05 0.00% Castro::post_init() 1 1.203e-05 1.259e-05 1.332e-05 0.00% Castro::advance() 1 6.842e-06 8.477e-06 1.158e-05 0.00% Amr::bldFineLevels() 1 7.198e-06 8.564e-06 1.074e-05 0.00% Amr::init() 1 6.19e-06 8.091e-06 9.604e-06 0.00% Castro::post_timestep() 1 5.513e-06 5.947e-06 7.073e-06 0.00% Amr::initialInit() 1 2.977e-06 3.347e-06 4.172e-06 0.00% Other 2440 0.04844 0.06199 0.09145 0.63% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.42 14.42 14.42 100.00% Amr::coarseTimeStep() 1 12.11 12.11 12.11 83.96% Amr::timeStep() 1 12.06 12.06 12.06 83.59% Castro::advance() 1 11.99 12 12 83.18% Castro::subcycle_advance_ctu() 1 11.94 11.95 11.95 82.84% Castro::do_advance_ctu() 20 11.9 11.91 11.91 82.58% Castro::construct_ctu_hydro_source() 20 6.354 6.384 6.428 44.57% Castro::clean_state() 79 3.719 3.81 3.928 27.23% Castro::computeTemp() 80 2.38 2.476 2.611 18.10% Gravity::solve_phi_with_mlmg() 19 1.692 1.74 1.771 12.28% Castro::construct_new_gravity() 17 1.604 1.653 1.682 11.66% Gravity::solve_for_phi() 17 1.566 1.615 1.645 11.41% Castro::reset_internal_energy(MultiFab) 80 1.498 1.519 1.56 10.82% Gravity::actual_solve_with_mlmg() 19 1.454 1.458 1.462 10.14% Castro::initialize_do_advance() 20 1.384 1.427 1.459 10.11% MLMG::solve() 18 1.398 1.404 1.406 9.74% Amr::InitAmr() 1 1.355 1.355 1.355 9.39% MLMG::oneIter() 128 1.254 1.257 1.26 8.74% MLMG::mgVcycle() 128 1.239 1.242 1.245 8.63% Castro::do_old_sources() 20 1.155 1.185 1.199 8.31% FabArray::ParallelCopy() 1429 0.5709 0.8369 1.043 7.23% Castro::do_new_sources() 17 0.9304 0.9689 1.005 6.97% Castro::evaluate_source_change() 196 0.9461 0.9587 0.9841 6.82% Amr::init() 1 0.9576 0.9576 0.9576 6.64% Amr::initialInit() 1 0.902 0.902 0.9021 6.25% MLCellLinOp::smooth() 3072 0.6507 0.7105 0.8489 5.89% amrex::Copy() 724 0.7923 0.8048 0.8216 5.70% Castro::enforce_min_density() 79 0.7931 0.8038 0.8197 5.68% FabArray::ParallelCopy_finish() 1429 0.3228 0.5872 0.7959 5.52% AmrLevel::FillPatch() 147 0.5586 0.6188 0.6916 4.80% Amr::InitializeInit() 1 0.4417 0.4844 0.6591 4.57% Amr::defBaseLevel() 1 0.4417 0.4844 0.6591 4.57% Castro::normalize_species() 79 0.549 0.5573 0.5722 3.97% MultiFab::AddProduct() 3439 0.5504 0.5577 0.5722 3.97% Castro::reset_internal_energy(Fab) 160 0.519 0.5283 0.5462 3.79% FillPatchIterator::Initialize 147 0.3747 0.436 0.5106 3.54% FillPatchIterator::FillFromLevel0() 147 0.35 0.415 0.4916 3.41% FillPatchSingleLevel 147 0.3493 0.4143 0.4909 3.40% MLCellLinOp::applyBC() 7148 0.3388 0.3911 0.478 3.31% MLMG::mgVcycle_up::1 128 0.1105 0.2898 0.4722 3.27% Amr::FinalizeInit() 1 0.2429 0.4176 0.4603 3.19% MLPoisson::Fsmooth() 6144 0.3515 0.3827 0.4558 3.16% Castro::Castro() 1 0.3622 0.3791 0.4318 2.99% Castro::initMFs() 1 0.3566 0.3731 0.4243 2.94% MLMG::addInterpCorrection() 768 0.06865 0.3282 0.4087 2.83% FabArray::FillBoundary() 6380 0.2603 0.3111 0.3652 2.53% FabArray::setVal() 5013 0.3512 0.3563 0.3631 2.52% MultiFab::Subtract() 159 0.3457 0.3503 0.3558 2.47% check_for_negative_density() 20 0.1235 0.2481 0.333 2.31% Gravity::fill_multipole_BCs() 19 0.2361 0.2806 0.3067 2.13% MLMG::mgVcycle_up::2 128 0.01386 0.1298 0.3057 2.12% MLMG::mgVcycle_down::0 128 0.2853 0.2909 0.2979 2.07% FabArray::ParallelCopy_nowait() 1429 0.2247 0.2459 0.2648 1.84% Amr::bldFineLevels() 1 0.04575 0.2213 0.2644 1.83% Castro::expand_state() 20 0.1986 0.2242 0.2521 1.75% Castro::initData() 1 0.07784 0.1036 0.2366 1.64% MLMG::mgVcycle_up::0 128 0.2179 0.2192 0.2205 1.53% Amr::grid_places() 2 0.002901 0.1775 0.2203 1.53% AmrMesh::MakeNewGrids() 2 0.002848 0.1775 0.2202 1.53% TagBoxArray::mapPRD 2 0.001188 0.1367 0.2166 1.50% MLCellLinOp::apply() 986 0.1634 0.1757 0.2134 1.48% FillBoundary_finish() 6380 0.124 0.1615 0.2011 1.39% MLMG::mgVcycle_up::3 128 0.01378 0.02797 0.1953 1.35% FabArray::sum() 3439 0.1832 0.1857 0.1905 1.32% FillBoundary_nowait() 6380 0.1021 0.1352 0.1689 1.17% MLMG:computeResOfCorrection() 768 0.1231 0.135 0.1591 1.10% MLCellLinOp::correctionResidual() 768 0.1215 0.1334 0.1574 1.09% Castro::post_init() 1 0.1489 0.1528 0.1546 1.07% MLMG::mgVcycle_down::1 128 0.1348 0.1434 0.1505 1.04% TagBoxArray::collate() 2 0.0002435 0.03946 0.1473 1.02% Castro::construct_new_source() 102 0.1233 0.1251 0.1282 0.89% Gravity::multilevel_solve_for_new_phi() 1 0.1145 0.1145 0.1146 0.79% Gravity::actual_multilevel_solve() 1 0.1144 0.1145 0.1145 0.79% MLPoisson::Fapply() 986 0.09448 0.09993 0.1126 0.78% MLCellLinOp::solutionResidual() 147 0.09139 0.09794 0.1029 0.71% Amr::writePlotFile() 2 0.09983 0.09993 0.09994 0.69% Castro::post_regrid() 2 0.08537 0.08716 0.09105 0.63% Castro::create_source_corrector() 17 0.05246 0.06755 0.08652 0.60% MLMG::computeResidual() 128 0.07976 0.0809 0.08535 0.59% MLMG::mgVcycle_down::2 128 0.01615 0.04801 0.08183 0.57% Castro::construct_old_source() 120 0.07791 0.07912 0.08046 0.56% MLMG::mgVcycle_bottom 128 0.0003612 0.005164 0.077 0.53% MLMG::actualBottomSolve() 128 0.000131 0.004925 0.07675 0.53% MLCGSolver::bicgstab 8 0 0.004699 0.07519 0.52% FabArray::Saxpy() 264 0.06687 0.06853 0.07476 0.52% Castro::derive() 18 0.06988 0.07093 0.07237 0.50% AmrLevel::derive() 18 0.06984 0.07089 0.07232 0.50% Castro::construct_new_gravity_source() 17 0.06855 0.06989 0.07171 0.50% MLMG::mgVcycle_down::3 128 0.0154 0.02242 0.06768 0.47% Castro::construct_old_gravity() 20 0.04925 0.05987 0.06717 0.47% Gravity::get_old_grav_vector() 20 0.0491 0.05975 0.06706 0.46% Castro::post_timestep() 1 0.05889 0.06083 0.06305 0.44% FabArray::Xpay() 945 0.05201 0.05492 0.06116 0.42% amrex::average_down 768 0.0339 0.04157 0.06048 0.42% Castro::initialize_advance() 1 0.04896 0.05057 0.05607 0.39% Amr::regrid() 1 0.04403 0.04489 0.04699 0.33% Castro::construct_old_gravity_source() 20 0.04505 0.0458 0.04688 0.33% Castro::check_for_nan() 37 0.0451 0.04578 0.04657 0.32% MultiFab::contains_nan() 37 0.04499 0.04566 0.04646 0.32% MLPoisson::define() 19 0.03143 0.03698 0.04261 0.30% MLMG::mgVcycle_down::4 128 0.01528 0.01724 0.03996 0.28% Castro::retry_advance_ctu() 11 0.03582 0.0368 0.03972 0.28% Gravity::get_new_grav_vector() 18 0.03683 0.03818 0.03954 0.27% StateDataPhysBCFunct::() 147 0.0007222 0.01849 0.03425 0.24% StateData::FillBoundary(geom) 143 0 0.0176 0.03331 0.23% MLMG::mgVcycle_up::4 128 0.01389 0.01533 0.03156 0.22% Castro::apply_source_to_state() 37 0.02723 0.02776 0.02947 0.20% MLMG::mgVcycle_down::5 128 0.01521 0.01642 0.02787 0.19% MLCellLinOp::defineAuxData() 19 0.02016 0.02197 0.02729 0.19% VisMF::Write(FabArray) 4 0.01373 0.01514 0.02696 0.19% MLMG::ResNormInf() 146 0.01855 0.02223 0.02609 0.18% MLMG::prepareForSolve() 18 0.02067 0.02173 0.02424 0.17% MLMG::mgVcycle_up::5 128 0.01398 0.01493 0.02389 0.17% Castro::sum_integrated_quantities() 2 0.02179 0.02196 0.02198 0.15% Castro::save_data_for_retry() 3 0.01895 0.01955 0.02177 0.15% MLMG::computeMLResidual() 18 0.01091 0.01657 0.02147 0.15% FabArray::norminf() 282 0.01091 0.01145 0.01551 0.11% FabArrayBase::getFB() 6380 0.0112 0.01226 0.0154 0.11% amrex::Add() 128 0.01435 0.01458 0.01526 0.11% FabArrayBase::getCPC() 2005 0.009992 0.0115 0.01506 0.10% FabArray::setDomainBndry() 147 0.0004895 0.007893 0.01485 0.10% Gravity::test_composite_phi() 1 0.01435 0.01437 0.01439 0.10% Castro::problem_post_timestep() 2 0.008943 0.0117 0.01399 0.10% Castro::wd_update() 2 0.008931 0.01167 0.01397 0.10% MLLinOp::define() 19 0.004771 0.008307 0.01195 0.08% MLLinOp::defineGrids() 19 0.004692 0.008228 0.01187 0.08% Other 2440 0.07969 0.0973 0.1337 0.93% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 13 B 19 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- Cpu Memory Usage: ------------------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------------------------------- Castro::save_data_for_retry() 416 416 1559 KiB 1560 KiB 1561 KiB 2297 KiB 2297 KiB 2297 KiB Castro::construct_ctu_hydro_source() 6400 6400 385 KiB 391 KiB 399 KiB 1156 KiB 1156 KiB 1156 KiB StateData::define() 192 192 1039 KiB 1040 KiB 1040 KiB 1148 KiB 1148 KiB 1148 KiB Castro::initMFs() 256 256 989 KiB 990 KiB 990 KiB 1093 KiB 1093 KiB 1093 KiB Castro::swap_state_time_levels() 160 160 660 KiB 661 KiB 661 KiB 787 KiB 787 KiB 787 KiB Amr::writePlotFile() 64 64 4320 B 4426 B 4957 B 736 KiB 736 KiB 736 KiB Castro::reset_internal_energy(MultiFab) 5120 5120 50 KiB 51 KiB 52 KiB 640 KiB 640 KiB 640 KiB FillPatchIterator::Initialize 4704 4704 12 KiB 13 KiB 14 KiB 500 KiB 500 KiB 500 KiB Castro::initialize_do_advance() 640 640 413 KiB 413 KiB 413 KiB 500 KiB 500 KiB 500 KiB FabArray::ParallelCopy_nowait() 12704 12704 2251 B 3927 B 5491 B 215 KiB 285 KiB 360 KiB AmrLevel::derive() 1152 1152 1342 B 1362 B 1389 B 336 KiB 336 KiB 336 KiB Castro::enforce_min_density() 2528 2528 17 KiB 17 KiB 18 KiB 320 KiB 320 KiB 320 KiB Castro::initialize_advance() 32 32 131 KiB 131 KiB 131 KiB 157 KiB 157 KiB 157 KiB MLMG::prepareForSolve() 6102 6102 9 KiB 10 KiB 12 KiB 102 KiB 108 KiB 126 KiB Castro::buildMetrics() 160 160 106 KiB 106 KiB 106 KiB 117 KiB 117 KiB 117 KiB Castro::construct_old_source() 640 640 253 B 257 B 265 B 112 KiB 112 KiB 112 KiB Castro::construct_new_source() 544 544 426 B 432 B 446 B 112 KiB 112 KiB 112 KiB Amr::writeSmallPlotFile() 64 64 19 B 21 B 37 B 80 KiB 80 KiB 80 KiB Castro::Castro() 128 128 33 KiB 33 KiB 33 KiB 74 KiB 74 KiB 74 KiB Gravity::test_composite_phi() 96 96 52 B 52 B 52 B 52 KiB 52 KiB 52 KiB Gravity::update_max_rhs() 192 192 3 B 7 B 10 B 49 KiB 49 KiB 49 KiB Gravity::get_new_grav_vector() 576 576 115 B 119 B 124 B 45 KiB 45 KiB 45 KiB Gravity::get_old_grav_vector() 640 640 155 B 189 B 213 B 45 KiB 45 KiB 45 KiB Gravity::multilevel_solve_for_new_phi() 64 64 31 KiB 31 KiB 31 KiB 37 KiB 37 KiB 37 KiB Gravity::fill_multipole_BCs() 2432 2432 236 B 245 B 261 B 17 KiB 17 KiB 17 KiB Castro::evaluate_source_change() 6272 6272 1068 B 1083 B 1112 B 16 KiB 16 KiB 16 KiB Gravity::actual_multilevel_solve() 32 32 129 B 129 B 129 B 16 KiB 16 KiB 16 KiB Gravity::solve_for_phi() 544 544 1778 B 1833 B 1867 B 16 KiB 16 KiB 16 KiB MLMG::compResidual() 32 32 0 B 0 B 1 B 16 KiB 16 KiB 16 KiB MLCellLinOp::defineAuxData() 11704 11704 460 B 513 B 712 B 4608 B 5151 B 7152 B BndryData::define() 4864 4864 478 B 479 B 480 B 4864 B 4864 B 4864 B FillBoundary_nowait() 91296 91296 28 B 39 B 52 B 2592 B 3392 B 4192 B AmrMesh::MakeNewGrids() 128 128 0 B 24 B 39 B 2916 B 2916 B 2916 B OwnerMask() 64 64 0 B 0 B 0 B 2592 B 2592 B 2592 B MLMG::addInterpCorrection() 5632 5632 1 B 16 B 26 B 1024 B 1024 B 1024 B amrex::average_down 5632 5632 0 B 0 B 1 B 1024 B 1024 B 1024 B TagBoxArray::mapPRD 64 64 0 B 7 B 9 B 648 B 648 B 648 B MLCGSolver::bicgstab 640 640 0 B 0 B 2 B 0 B 36 B 576 B MLCellLinOp::applyBC() 114375 114375 0 B 0 B 0 B 8 B 8 B 8 B ------------------------------------------------------------------------------------------------------------------------------- AMReX (24.09-12-g41353f6ab5cb) finalized