Initializing AMReX (24.04-6-g771c439170bf)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.04-6-g771c439170bf) initialized Starting run at 07:14:41 UTC on 2024-04-05. Successfully read inputs file ... Castro git describe: 24.04-3-g0462ceb8e AMReX git describe: 24.04-6-g771c43917 Microphysics git describe: 24.04-3-gd82c8c88 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.166528244 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001077541 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010985371 Gravity::multilevel_solve_for_new_phi() time = 0.099952172 Gravity::fill_multipole_BCs() time = 0.011238789 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.048549374 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.03031313 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002754877 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065043216 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.010144483 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.06416961 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004157305 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.06069853 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005511762 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058404363 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321070251 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015518231 Gravity::solve_for_phi() time = 0.085533462 on level 0 Castro::construct_new_gravity() time = 0.087643304 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.059695475 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002693621 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058215449 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.320710556 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015162284 Gravity::solve_for_phi() time = 0.085047675 on level 0 Castro::construct_new_gravity() time = 0.087150891 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.059959455 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.00268535 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058034234 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325649495 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015489634 Gravity::solve_for_phi() time = 0.087334611 on level 0 Castro::construct_new_gravity() time = 0.089463381 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.060919074 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002979624 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058583818 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327966035 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015571485 Gravity::solve_for_phi() time = 0.086229356 on level 0 Castro::construct_new_gravity() time = 0.088385847 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.060087078 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002783778 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059480851 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334380725 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015829526 Gravity::solve_for_phi() time = 0.08678657 on level 0 Castro::construct_new_gravity() time = 0.088883812 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.059362783 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002618673 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058144223 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327790007 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01569509 Gravity::solve_for_phi() time = 0.085513539 on level 0 Castro::construct_new_gravity() time = 0.087652279 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.05961534 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002684376 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058166553 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333761687 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01571316 Gravity::solve_for_phi() time = 0.085901112 on level 0 Castro::construct_new_gravity() time = 0.088020565 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059541161 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002686066 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058077533 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329224524 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015903382 Gravity::solve_for_phi() time = 0.086023818 on level 0 Castro::construct_new_gravity() time = 0.088143511 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.070122461 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.011798267 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.067937523 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.370989537 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015185261 Gravity::solve_for_phi() time = 0.085133122 on level 0 Castro::construct_new_gravity() time = 0.087168187 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.062160951 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002676921 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.061941481 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329327851 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016148845 Gravity::solve_for_phi() time = 0.087440469 on level 0 Castro::construct_new_gravity() time = 0.089530433 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.060111337 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002729549 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.064655153 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.361072848 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015933414 Gravity::solve_for_phi() time = 0.086712149 on level 0 Castro::construct_new_gravity() time = 0.088788012 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059612003 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002750447 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058684081 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.340092751 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01628308 Gravity::solve_for_phi() time = 0.088438062 on level 0 Castro::construct_new_gravity() time = 0.090510142 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.061269421 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.00270825 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059342379 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.341455513 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018292556 Gravity::solve_for_phi() time = 0.091747125 on level 0 Castro::construct_new_gravity() time = 0.093970948 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059836379 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002751945 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.05902025 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3340018 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016257516 Gravity::solve_for_phi() time = 0.087704687 on level 0 Castro::construct_new_gravity() time = 0.089825996 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.06054682 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002734873 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059937292 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.347915168 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016908084 Gravity::solve_for_phi() time = 0.08995756 on level 0 Castro::construct_new_gravity() time = 0.092008143 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.061819211 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002944655 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.0592172 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333415016 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015547727 Gravity::solve_for_phi() time = 0.086100102 on level 0 Castro::construct_new_gravity() time = 0.088177738 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.061936991 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.004791601 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058764535 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33944108 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01675401 Gravity::solve_for_phi() time = 0.088442816 on level 0 Castro::construct_new_gravity() time = 0.091520045 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.060424643 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002746895487 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.98781167 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.0615556 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.005688262 seconds Ending run at 07:14:55 UTC on 2024-04-05. Run time = 14.47836483 Run time without initialization = 12.05607216 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.48 ... 14.48 ... 14.48 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3429 5.4578 5.5448 38.30% Amr::InitAmr() 1 1.514 1.514 1.514 10.46% Castro::computeTemp() 80 0.8437 0.9524 1.097 7.58% amrex::Copy() 724 0.7756 0.7912 0.8025 5.54% FabArray::ParallelCopy_finish() 1429 0.06627 0.537 0.7633 5.27% Castro::normalize_species() 79 0.548 0.5595 0.601 4.15% MultiFab::AddProduct() 3439 0.5396 0.5485 0.5554 3.84% Castro::reset_internal_energy(Fab) 160 0.5125 0.523 0.5305 3.66% MLPoisson::Fsmooth() 6144 0.3138 0.3434 0.4156 2.87% Castro::initMFs() 1 0.3508 0.3583 0.3737 2.58% check_for_negative_density() 20 0.1504 0.2549 0.3607 2.49% FabArray::setVal() 5013 0.3447 0.352 0.3586 2.48% MultiFab::Subtract() 159 0.3366 0.3426 0.3478 2.40% Gravity::fill_multipole_BCs() 19 0.1993 0.2448 0.2872 1.98% Castro::reset_internal_energy(MultiFab) 80 0.02292 0.0696 0.231 1.60% FabArray::ParallelCopy_nowait() 1429 0.1811 0.1992 0.218 1.51% FabArray::sum() 3439 0.1878 0.1913 0.1945 1.34% Castro::initData() 1 0.003301 0.02633 0.1557 1.08% FillBoundary_finish() 6380 0.09887 0.1211 0.15 1.04% FillBoundary_nowait() 6380 0.07566 0.1028 0.1317 0.91% MLPoisson::Fapply() 986 0.09335 0.09881 0.1134 0.78% MLCellLinOp::applyBC() 7148 0.04602 0.06207 0.1039 0.72% FabArray::Saxpy() 264 0.07136 0.07304 0.0803 0.55% Castro::construct_new_gravity_source() 17 0.06804 0.06957 0.07133 0.49% Castro::enforce_min_density() 79 0.01769 0.03399 0.06684 0.46% FabArray::Xpay() 945 0.05045 0.05325 0.06006 0.41% Castro::do_new_sources() 17 0.0003643 0.0095 0.05947 0.41% Castro::do_old_sources() 20 0.0004881 0.0121 0.04875 0.34% Castro::construct_old_gravity_source() 20 0.04534 0.04619 0.04716 0.33% MultiFab::contains_nan() 37 0.0446 0.04529 0.0459 0.32% MLMG::addInterpCorrection() 768 0.03334 0.0361 0.04282 0.30% AmrLevel::derive() 18 0.03976 0.04033 0.04093 0.28% StateData::FillBoundary(geom) 143 0 0.01735 0.03321 0.23% Amr::writeSmallPlotFile() 2 0.0302 0.03212 0.03246 0.22% amrex::average_down 768 0.02432 0.02649 0.03212 0.22% Amr::writePlotFile() 2 0.01911 0.02984 0.03128 0.22% VisMF::Write(FabArray) 4 0.01368 0.0151 0.02821 0.19% MLCellLinOp::defineAuxData() 19 0.01488 0.01542 0.01736 0.12% Castro::construct_new_source() 102 0.01543 0.01593 0.0168 0.12% FabArray::FillBoundary() 6380 0.01325 0.01377 0.01635 0.11% amrex::Add() 128 0.01417 0.01453 0.01613 0.11% MLCGSolver::bicgstab 8 0 0.001003 0.01606 0.11% FabArray::norminf() 282 0.01091 0.0114 0.01542 0.11% Castro::construct_old_gravity() 20 0.000402 0.003128 0.01437 0.10% FillPatchIterator::Initialize 147 0.01258 0.01282 0.01312 0.09% Castro::evaluate_source_change() 196 0.01213 0.01258 0.01285 0.09% FabArrayBase::getFB() 6380 0.009742 0.01024 0.01268 0.09% MLCellLinOp::smooth() 3072 0.01121 0.01168 0.01267 0.09% Castro::wd_update() 2 0.005164 0.009853 0.01212 0.08% FabArray::setDomainBndry() 147 0.0004397 0.005877 0.01109 0.08% MLMG::prepareForSolve() 18 0.01009 0.01038 0.01096 0.08% MLMG::ResNormInf() 146 0.003454 0.006675 0.01093 0.08% Castro::construct_old_source() 120 0.009768 0.01006 0.01038 0.07% Gravity::actual_solve_with_mlmg() 19 0.006724 0.00712 0.008028 0.06% MLLinOp::makeSubCommunicator() 19 0.000821 0.004106 0.007873 0.05% FabArrayBase::getCPC() 2005 0.007162 0.007352 0.007649 0.05% Castro::volWgtSum() 46 0.007353 0.007436 0.00752 0.05% FabArray::mult() 59 0.00719 0.007294 0.007432 0.05% Gravity::get_new_grav_vector() 18 0.00603 0.00619 0.00697 0.05% Gravity::get_old_grav_vector() 20 0.006335 0.006517 0.006673 0.05% FabArrayBase::CPC::define() 576 0.002185 0.003322 0.006348 0.04% amrex::Dot() 142 0 0.0003747 0.005996 0.04% MLCellLinOp::compGrad() 18 0.005739 0.005871 0.00598 0.04% Castro::volInBoundary() 14 0.003456 0.003723 0.005498 0.04% Castro::initialize_do_advance() 20 0.004519 0.004758 0.005156 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0002974 0.004758 0.03% MLCellLinOp::apply() 986 0.001984 0.002214 0.004648 0.03% MLMG::solve() 18 0.0009045 0.00245 0.004545 0.03% FabArray::ParallelCopy() 1429 0.003431 0.003564 0.003837 0.03% MultiFab::max() 2 0.0001859 0.00178 0.003673 0.03% Castro::sum_integrated_quantities() 2 0.001899 0.002958 0.003285 0.02% BndryData::define() 19 0.003022 0.003101 0.003258 0.02% MLPoisson::normalize() 79 0 0.0001939 0.003102 0.02% AmrLevel::FillPatch() 147 0.002098 0.002225 0.002356 0.02% Castro::construct_new_gravity() 17 0.0002922 0.000727 0.002196 0.02% MLLinOp::defineGrids() 19 0.001809 0.001906 0.002178 0.02% MLCellLinOp::prepareForSolve() 19 0.001687 0.00182 0.002118 0.01% MLCellLinOp::correctionResidual() 768 0.001807 0.001869 0.001936 0.01% Castro::save_data_for_retry() 3 0.001277 0.001412 0.001842 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001282 0.001539 0.001778 0.01% MLMG::mgVcycle() 128 0.001535 0.001612 0.001766 0.01% MLCellLinOp::defineBC() 19 0.001484 0.001538 0.001634 0.01% MLMG:computeResOfCorrection() 768 0.001373 0.001418 0.001498 0.01% FabArrayBase::FB::FB() 75 0.0002776 0.0006766 0.001423 0.01% StateData::define() 6 0.001305 0.001347 0.001406 0.01% main() 1 0.0009718 0.001192 0.001359 0.01% Gravity::solve_for_phi() 17 0.000788 0.000967 0.001347 0.01% Castro::locWgtSum() 6 0.001121 0.001137 0.001153 0.01% MLMG::actualBottomSolve() 128 0.0001322 0.0001954 0.001061 0.01% StateDataPhysBCFunct::() 147 0.0006552 0.0008056 0.0009048 0.01% MLCellLinOp::setLevelBC() 19 0.0005366 0.0006663 0.0008375 0.01% TagBoxArray::collate() 2 0.0001608 0.0004489 0.0007612 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006895 0.0007129 0.0007521 0.01% MLMG::mgVcycle_down::2 128 0.0006026 0.0006646 0.0007519 0.01% Castro::subcycle_advance_ctu() 1 0.0001709 0.000239 0.0007329 0.01% MLMG::mgVcycle_down::3 128 0.0005612 0.0006136 0.0007255 0.01% MLMG::mgVcycle_down::1 128 0.0006524 0.0006746 0.0006985 0.00% MLMG::mgVcycle_down::0 128 0.000654 0.0006719 0.0006964 0.00% MLMG::mgVcycle_down::4 128 0.0005449 0.0005734 0.0006728 0.00% MLMG::mgVcycle_down::5 128 0.0005698 0.0005892 0.0006615 0.00% Castro::buildMetrics() 1 0.000567 0.0005914 0.0006279 0.00% Castro::Castro() 1 0.0004738 0.0005147 0.0005757 0.00% AmrMesh::MakeNewGrids() 2 0.0005002 0.0005207 0.0005532 0.00% Castro::apply_tagging_restrictions() 2 0.0004207 0.0004849 0.0005462 0.00% Castro::do_advance_ctu() 20 0.0004167 0.0004504 0.0005161 0.00% MLMG::mgVcycle_up::1 128 0.0004522 0.0004746 0.000501 0.00% FillPatchSingleLevel 147 0.0004705 0.0004822 0.0004991 0.00% Gravity::applyMetricTerms() 2 0.0004802 0.0004876 0.0004954 0.00% MLMG::mgVcycle_up::0 128 0.0004512 0.00047 0.0004846 0.00% Castro::problem_post_timestep() 2 1.056e-05 4.1e-05 0.0004836 0.00% Castro::clean_state() 79 0.0004366 0.000459 0.0004831 0.00% MLMG::mgVcycle_up::2 128 0.0003822 0.0004245 0.0004787 0.00% makeSFC 95 0.0003704 0.0003955 0.0004754 0.00% MLCellLinOp::solutionResidual() 147 0.0004298 0.0004479 0.0004744 0.00% MLMG::mgVcycle_up::5 128 0.0003924 0.0004068 0.0004536 0.00% Castro::swap_state_time_levels() 8 0.0004274 0.0004386 0.0004509 0.00% MLMG::mgVcycle_up::3 128 0.0003767 0.0003943 0.0004506 0.00% MLMG::mgVcycle_up::4 128 0.0003789 0.0003932 0.0004351 0.00% Castro::volProductSum() 2 0.0003896 0.0003998 0.0004161 0.00% MLMG::oneIter() 128 0.0003822 0.0003958 0.0004089 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003267 0.0003438 0.0004066 0.00% Castro::enforce_consistent_e() 1 0.0003725 0.0003836 0.0004014 0.00% Gravity::solve_phi_with_mlmg() 19 0.000215 0.0002362 0.0003082 0.00% Castro::finalize_do_advance() 17 0.0001648 0.0001839 0.0002737 0.00% DistributionMapping::Distribute() 95 0.0002105 0.0002231 0.0002698 0.00% MLMG::computeResidual() 128 0.000238 0.0002461 0.0002548 0.00% MLMG::mgVcycle_bottom 128 0.00022 0.0002271 0.0002442 0.00% Amr::coarseTimeStep() 1 0.0001544 0.00019 0.0001958 0.00% Gravity::update_max_rhs() 2 0.0001608 0.0001696 0.0001856 0.00% OwnerMask() 2 0.0001313 0.0001526 0.0001721 0.00% MLPoisson::define() 19 0.0001347 0.0001486 0.0001712 0.00% MLMG::compResidual() 1 0.000152 0.0001574 0.000166 0.00% Amr::defBaseLevel() 1 0.000105 0.0001164 0.0001481 0.00% Castro::retry_advance_ctu() 11 5.309e-05 7.208e-05 0.0001427 0.00% Castro::enforce_speed_limit() 79 0.0001044 0.0001129 0.0001339 0.00% Castro::check_for_nan() 37 0.0001012 0.0001099 0.0001245 0.00% Castro::initialize_advance() 1 0.0001035 0.0001113 0.0001236 0.00% Amr::grid_places() 2 7.394e-05 9.162e-05 0.0001233 0.00% TagBoxArray::mapPRD 2 0.0001084 0.0001141 0.0001221 0.00% Gravity::test_composite_phi() 1 9.182e-05 0.0001001 0.0001198 0.00% Castro::apply_source_to_state() 37 9.433e-05 0.0001007 0.0001089 0.00% DistributionMapping::LeastUsedCPUs() 1 4.255e-05 7.208e-05 0.000101 0.00% Castro::apply_problem_tags() 2 9.288e-05 9.407e-05 9.673e-05 0.00% MLLinOp::define() 19 7.752e-05 8.252e-05 8.833e-05 0.00% MultiFab::Swap() 5 6.77e-05 7.129e-05 8.781e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.948e-05 6.817e-05 8.642e-05 0.00% knapsack() 1 5.772e-05 6.448e-05 8.11e-05 0.00% MLPoisson::prepareForSolve() 19 6.447e-05 7.07e-05 7.92e-05 0.00% Castro::create_source_corrector() 17 5.732e-05 6.405e-05 7.559e-05 0.00% Amr::FinalizeInit() 1 8.601e-06 1.63e-05 7.286e-05 0.00% Castro::expand_state() 20 5.156e-05 5.636e-05 7.139e-05 0.00% Amr::initSubcycle() 1 5.549e-05 5.799e-05 5.972e-05 0.00% MLMG::computeMLResidual() 18 3.982e-05 4.325e-05 5.415e-05 0.00% Amr::timeStep() 1 1.197e-05 1.817e-05 4.872e-05 0.00% MLMG::MLResNormInf() 18 3.402e-05 3.639e-05 4.636e-05 0.00% MLMG::getGradSolution() 18 3.925e-05 4.097e-05 4.505e-05 0.00% Gravity::swapTimeLevels() 8 3.24e-05 3.633e-05 4.503e-05 0.00% Castro::derive() 18 4.021e-05 4.217e-05 4.484e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.17e-05 3.417e-05 3.702e-05 0.00% Castro::construct_old_rotation_source() 20 2.851e-05 3.074e-05 3.299e-05 0.00% MLMG::MLRhsNormInf() 18 3.043e-05 3.126e-05 3.19e-05 0.00% Amr::regrid() 1 1.058e-05 1.251e-05 2.891e-05 0.00% Gravity::actual_multilevel_solve() 1 2.666e-05 2.771e-05 2.858e-05 0.00% Castro::advance() 1 6.97e-06 1.034e-05 2.8e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.627e-05 1.839e-05 2.536e-05 0.00% Castro::construct_new_rotation_source() 17 2.131e-05 2.205e-05 2.523e-05 0.00% Castro::finalize_advance() 1 1.679e-05 1.98e-05 2.403e-05 0.00% Castro::estTimeStep() 10 1.18e-05 1.284e-05 1.435e-05 0.00% Castro::post_init() 1 1.186e-05 1.259e-05 1.335e-05 0.00% Amr::InitializeInit() 1 6.815e-06 7.596e-06 1.233e-05 0.00% Castro::post_regrid() 2 1.064e-05 1.14e-05 1.194e-05 0.00% BoxList::parallelComplementIn() 4 6.865e-06 7.454e-06 1.172e-05 0.00% Amr::bldFineLevels() 1 6.83e-06 7.557e-06 9.418e-06 0.00% BoxList::complementIn 4 5.815e-06 6.275e-06 9.315e-06 0.00% Castro::computeInitialDt() 2 6.624e-06 7.218e-06 9.134e-06 0.00% Amr::init() 1 6.177e-06 7.192e-06 8.633e-06 0.00% Castro::post_timestep() 1 5.559e-06 6.269e-06 7.803e-06 0.00% Gravity::set_mass_offset() 2 4.375e-06 5.58e-06 7.65e-06 0.00% Castro::errorEst() 2 6.114e-06 6.442e-06 6.699e-06 0.00% Amr::initialInit() 1 2.93e-06 3.425e-06 6.566e-06 0.00% Castro::gwstrain() 2 4.272e-06 4.693e-06 6.453e-06 0.00% Castro::FluxRegCrseInit 1 1.667e-06 1.941e-06 2.463e-06 0.00% Castro::FluxRegFineAdd() 1 1.424e-06 1.534e-06 1.864e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.48 14.48 14.48 100.00% Amr::coarseTimeStep() 1 12.06 12.06 12.06 83.26% Amr::timeStep() 1 11.99 11.99 11.99 82.80% Castro::advance() 1 11.92 11.92 11.93 82.39% Castro::subcycle_advance_ctu() 1 11.87 11.88 11.88 82.05% Castro::do_advance_ctu() 20 11.83 11.84 11.84 81.78% Castro::construct_ctu_hydro_source() 20 6.455 6.493 6.534 45.13% Castro::clean_state() 79 3.71 3.807 3.984 27.51% Castro::computeTemp() 80 2.386 2.498 2.744 18.95% Castro::reset_internal_energy(MultiFab) 80 1.473 1.546 1.711 11.82% Gravity::solve_phi_with_mlmg() 19 1.493 1.541 1.587 10.96% Amr::InitAmr() 1 1.514 1.514 1.514 10.46% Castro::construct_new_gravity() 17 1.421 1.467 1.511 10.44% Gravity::solve_for_phi() 17 1.382 1.43 1.476 10.19% Castro::initialize_do_advance() 20 1.395 1.433 1.458 10.07% Gravity::actual_solve_with_mlmg() 19 1.289 1.292 1.297 8.96% MLMG::solve() 18 1.239 1.243 1.244 8.59% Castro::do_old_sources() 20 1.162 1.185 1.205 8.32% MLMG::oneIter() 128 1.107 1.109 1.112 7.68% MLMG::mgVcycle() 128 1.092 1.094 1.097 7.58% Castro::do_new_sources() 17 0.9528 0.9809 1.037 7.16% FabArray::ParallelCopy() 1429 0.2908 0.7595 0.9885 6.83% Castro::evaluate_source_change() 196 0.9355 0.9514 0.9631 6.65% Amr::init() 1 0.9079 0.908 0.908 6.27% Castro::enforce_min_density() 79 0.7788 0.808 0.8464 5.85% Amr::initialInit() 1 0.8282 0.8282 0.8283 5.72% amrex::Copy() 724 0.7756 0.7912 0.8025 5.54% FabArray::ParallelCopy_finish() 1429 0.06627 0.537 0.7633 5.27% MLCellLinOp::smooth() 3072 0.5567 0.6054 0.7334 5.07% AmrLevel::FillPatch() 147 0.4852 0.5927 0.6855 4.73% Amr::InitializeInit() 1 0.4391 0.4985 0.604 4.17% Amr::defBaseLevel() 1 0.4391 0.4985 0.604 4.17% Castro::normalize_species() 79 0.548 0.5595 0.601 4.15% MultiFab::AddProduct() 3439 0.5396 0.5485 0.5554 3.84% Castro::reset_internal_energy(Fab) 160 0.5125 0.523 0.5305 3.66% FillPatchIterator::Initialize 147 0.305 0.4131 0.5093 3.52% FillPatchIterator::FillFromLevel0() 147 0.2808 0.3944 0.4926 3.40% FillPatchSingleLevel 147 0.2801 0.3937 0.492 3.40% MLMG::mgVcycle_up::1 128 0.09541 0.2588 0.4225 2.92% MLPoisson::Fsmooth() 6144 0.3138 0.3434 0.4156 2.87% Amr::FinalizeInit() 1 0.2242 0.3298 0.3891 2.69% MLCellLinOp::applyBC() 7148 0.2765 0.3107 0.3834 2.65% Castro::Castro() 1 0.3562 0.3639 0.3791 2.62% Castro::initMFs() 1 0.3509 0.3584 0.3738 2.58% MLMG::addInterpCorrection() 768 0.06376 0.3018 0.3716 2.57% check_for_negative_density() 20 0.1504 0.2549 0.3607 2.49% FabArray::setVal() 5013 0.3447 0.352 0.3586 2.48% MultiFab::Subtract() 159 0.3366 0.3426 0.3478 2.40% Gravity::fill_multipole_BCs() 19 0.2014 0.2469 0.2892 2.00% FabArray::FillBoundary() 6380 0.2176 0.2486 0.2815 1.94% MLMG::mgVcycle_up::2 128 0.01062 0.1153 0.276 1.91% MLMG::mgVcycle_down::0 128 0.2609 0.264 0.2669 1.84% Castro::expand_state() 20 0.1817 0.2201 0.265 1.83% Castro::initData() 1 0.07701 0.1329 0.2457 1.70% FabArray::ParallelCopy_nowait() 1429 0.1999 0.2189 0.2386 1.65% Amr::bldFineLevels() 1 0.04665 0.1519 0.2103 1.45% MLMG::mgVcycle_up::0 128 0.1979 0.199 0.1999 1.38% MLCellLinOp::apply() 986 0.1508 0.1597 0.1947 1.34% FabArray::sum() 3439 0.1878 0.1913 0.1945 1.34% MLMG::mgVcycle_up::3 128 0.01051 0.02329 0.1757 1.21% Amr::grid_places() 2 0.002734 0.1083 0.1676 1.16% AmrMesh::MakeNewGrids() 2 0.002652 0.1082 0.1675 1.16% TagBoxArray::mapPRD 2 0.0008246 0.1065 0.166 1.15% FillBoundary_finish() 6380 0.09887 0.1211 0.15 1.04% MLMG:computeResOfCorrection() 768 0.1128 0.1224 0.146 1.01% MLCellLinOp::correctionResidual() 768 0.1114 0.121 0.1445 1.00% FillBoundary_nowait() 6380 0.08581 0.1137 0.1432 0.99% Castro::post_init() 1 0.133 0.1346 0.1365 0.94% Castro::construct_new_source() 102 0.1232 0.1258 0.1276 0.88% MLMG::mgVcycle_down::1 128 0.1158 0.1196 0.1246 0.86% MLPoisson::Fapply() 986 0.09335 0.09881 0.1134 0.78% Amr::writePlotFile() 2 0.1107 0.1108 0.1108 0.77% Castro::create_source_corrector() 17 0.04838 0.07218 0.1047 0.72% Gravity::multilevel_solve_for_new_phi() 1 0.09992 0.09994 0.09997 0.69% Gravity::actual_multilevel_solve() 1 0.09985 0.09987 0.0999 0.69% MLCellLinOp::solutionResidual() 147 0.08758 0.0927 0.0968 0.67% Castro::post_regrid() 2 0.08495 0.08684 0.08844 0.61% Castro::construct_old_source() 120 0.07851 0.08011 0.0819 0.57% FabArray::Saxpy() 264 0.07136 0.07304 0.0803 0.55% MLMG::computeResidual() 128 0.07506 0.07676 0.0777 0.54% MLMG::mgVcycle_down::2 128 0.0124 0.04062 0.07175 0.50% Castro::construct_new_gravity_source() 17 0.06804 0.06957 0.07133 0.49% Castro::derive() 18 0.06802 0.06912 0.07099 0.49% AmrLevel::derive() 18 0.06798 0.06908 0.07095 0.49% MLMG::mgVcycle_bottom 128 0.0003535 0.004741 0.07041 0.49% MLMG::actualBottomSolve() 128 0.0001322 0.004514 0.07017 0.48% Castro::construct_old_gravity() 20 0.0495 0.05985 0.07006 0.48% Gravity::get_old_grav_vector() 20 0.0436 0.05672 0.06965 0.48% MLCGSolver::bicgstab 8 0 0.004289 0.06863 0.47% Castro::post_timestep() 1 0.05866 0.06313 0.06444 0.45% MLMG::mgVcycle_down::3 128 0.01175 0.01801 0.06034 0.42% FabArray::Xpay() 945 0.05045 0.05325 0.06006 0.41% amrex::average_down 768 0.03248 0.03906 0.05531 0.38% Castro::initialize_advance() 1 0.0481 0.04934 0.05058 0.35% Castro::construct_old_gravity_source() 20 0.04534 0.04619 0.04716 0.33% Castro::check_for_nan() 37 0.0447 0.0454 0.046 0.32% MultiFab::contains_nan() 37 0.0446 0.04529 0.0459 0.32% Amr::regrid() 1 0.04366 0.04466 0.04551 0.31% Castro::retry_advance_ctu() 11 0.03596 0.03747 0.04319 0.30% MLPoisson::define() 19 0.02871 0.03309 0.0387 0.27% Gravity::get_new_grav_vector() 18 0.03486 0.03613 0.03765 0.26% Amr::writeSmallPlotFile() 2 0.03641 0.03641 0.03642 0.25% MLMG::mgVcycle_down::4 128 0.01165 0.01337 0.03468 0.24% StateDataPhysBCFunct::() 147 0.0006552 0.01815 0.03407 0.24% StateData::FillBoundary(geom) 143 0 0.01735 0.03321 0.23% Castro::apply_source_to_state() 37 0.0291 0.02961 0.02998 0.21% VisMF::Write(FabArray) 4 0.01368 0.0151 0.02821 0.19% MLMG::mgVcycle_up::4 128 0.01059 0.01183 0.02701 0.19% Castro::save_data_for_retry() 3 0.01917 0.0201 0.02548 0.18% MLCellLinOp::defineAuxData() 19 0.01893 0.0202 0.02407 0.17% MLMG::prepareForSolve() 18 0.02024 0.02122 0.02349 0.16% MLMG::mgVcycle_down::5 128 0.0116 0.01258 0.02292 0.16% Castro::sum_integrated_quantities() 2 0.02181 0.02217 0.0222 0.15% MLMG::ResNormInf() 146 0.01334 0.01642 0.02056 0.14% MLMG::mgVcycle_up::5 128 0.01073 0.01146 0.0195 0.13% MLMG::computeMLResidual() 18 0.01064 0.0155 0.01892 0.13% amrex::Add() 128 0.01417 0.01453 0.01613 0.11% Castro::problem_post_timestep() 2 0.009488 0.01362 0.01559 0.11% Castro::wd_update() 2 0.009004 0.01358 0.01558 0.11% FabArray::norminf() 282 0.01091 0.0114 0.01542 0.11% Gravity::test_composite_phi() 1 0.0147 0.01472 0.01475 0.10% FabArrayBase::getFB() 6380 0.01007 0.01092 0.0141 0.10% FabArrayBase::getCPC() 2005 0.009388 0.01067 0.014 0.10% MLLinOp::define() 19 0.003768 0.007057 0.01115 0.08% FabArray::setDomainBndry() 147 0.0004397 0.005877 0.01109 0.08% MLLinOp::defineGrids() 19 0.003686 0.006975 0.01107 0.08% MLCGSolver::ParallelAllReduce 227 0 0.0005 0.007999 0.06% MLMG::getGradSolution() 18 0.007432 0.007713 0.00798 0.06% MLCellLinOp::compGrad() 18 0.007393 0.007672 0.00794 0.05% MLLinOp::makeSubCommunicator() 19 0.000821 0.004106 0.007873 0.05% Castro::volWgtSum() 46 0.007353 0.007436 0.00752 0.05% FabArray::mult() 59 0.00719 0.007294 0.007432 0.05% FabArrayBase::CPC::define() 576 0.002185 0.003322 0.006348 0.04% amrex::Dot() 142 0 0.0003747 0.005996 0.04% MLCellLinOp::defineBC() 19 0.005504 0.005681 0.005989 0.04% Castro::volInBoundary() 14 0.003456 0.003723 0.005498 0.04% Gravity::update_max_rhs() 2 0.001441 0.003033 0.004934 0.03% BndryData::define() 19 0.003963 0.004143 0.004379 0.03% MultiFab::max() 2 0.0001859 0.00178 0.003673 0.03% MLPoisson::normalize() 79 0 0.0001939 0.003102 0.02% MLPoisson::prepareForSolve() 19 0.001761 0.001891 0.00219 0.02% MLCellLinOp::prepareForSolve() 19 0.001687 0.00182 0.002118 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001282 0.001539 0.001778 0.01% AmrLevel::AmrLevel(dm) 1 0.001338 0.001381 0.001441 0.01% FabArrayBase::FB::FB() 75 0.0002776 0.0006766 0.001423 0.01% StateData::define() 6 0.001305 0.001347 0.001406 0.01% MLMG::MLResNormInf() 18 0.001249 0.00127 0.001285 0.01% MLMG::MLRhsNormInf() 18 0.001227 0.001257 0.001283 0.01% Gravity::swapTimeLevels() 8 0.00116 0.0012 0.001279 0.01% MLMG::compResidual() 1 0.0009381 0.001104 0.001221 0.01% Castro::locWgtSum() 6 0.001121 0.001137 0.001153 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009096 0.0009624 0.001152 0.01% MLCellLinOp::setLevelBC() 19 0.0005366 0.0006663 0.0008375 0.01% TagBoxArray::collate() 2 0.0001608 0.0004489 0.0007612 0.01% makeSFC 95 0.0005809 0.0006186 0.0007452 0.01% Castro::buildMetrics() 1 0.0006327 0.0006547 0.0006919 0.00% Castro::errorEst() 2 0.0005224 0.0005854 0.0006457 0.00% Castro::apply_tagging_restrictions() 2 0.0004207 0.0004849 0.0005462 0.00% Gravity::applyMetricTerms() 2 0.0004802 0.0004876 0.0004954 0.00% Castro::swap_state_time_levels() 8 0.0004274 0.0004386 0.0004509 0.00% Castro::volProductSum() 2 0.0003896 0.0003998 0.0004161 0.00% Castro::enforce_consistent_e() 1 0.0003725 0.0003836 0.0004014 0.00% Castro::finalize_do_advance() 17 0.0001744 0.0001936 0.0002831 0.00% Castro::finalize_advance() 1 0.0002488 0.0002606 0.0002799 0.00% DistributionMapping::Distribute() 95 0.0002105 0.0002231 0.0002698 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001182 0.0001549 0.0001839 0.00% OwnerMask() 2 0.0001313 0.0001526 0.0001721 0.00% Castro::enforce_speed_limit() 79 0.0001044 0.0001129 0.0001339 0.00% DistributionMapping::LeastUsedCPUs() 1 4.255e-05 7.208e-05 0.000101 0.00% Castro::apply_problem_tags() 2 9.288e-05 9.407e-05 9.673e-05 0.00% MultiFab::Swap() 5 6.77e-05 7.129e-05 8.781e-05 0.00% knapsack() 1 5.772e-05 6.448e-05 8.11e-05 0.00% Amr::initSubcycle() 1 5.549e-05 5.799e-05 5.972e-05 0.00% Castro::construct_old_rotation_source() 20 2.851e-05 3.074e-05 3.299e-05 0.00% Castro::construct_new_rotation_source() 17 2.131e-05 2.205e-05 2.523e-05 0.00% BoxList::parallelComplementIn() 4 1.27e-05 1.373e-05 2.103e-05 0.00% Castro::estTimeStep() 10 1.18e-05 1.284e-05 1.435e-05 0.00% Castro::computeInitialDt() 2 9.472e-06 1.028e-05 1.349e-05 0.00% BoxList::complementIn 4 5.815e-06 6.275e-06 9.315e-06 0.00% Gravity::set_mass_offset() 2 4.375e-06 5.58e-06 7.65e-06 0.00% Castro::gwstrain() 2 4.272e-06 4.693e-06 6.453e-06 0.00% Castro::FluxRegCrseInit 1 1.667e-06 1.941e-06 2.463e-06 0.00% Castro::FluxRegFineAdd() 1 1.424e-06 1.534e-06 1.864e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 13 B 17 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-6-g771c439170bf) finalized