Initializing AMReX (v2024-48-g47347f785f5c)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (v2024-48-g47347f785f5c) initialized Starting run at 08:01:28 UTC on 2024-04-01. Successfully read inputs file ... Castro git describe: 24.03-38-gcd731a3af AMReX git describe: v2024-48-g47347f785 Microphysics git describe: 24.03-23-g3112c13a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.17732936 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001111067 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010648944 Gravity::multilevel_solve_for_new_phi() time = 0.111232537 Gravity::fill_multipole_BCs() time = 0.010659708 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.047882328 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004142557 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002712348 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065011674 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.008373613 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.064219365 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004993955 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060917337 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004831783 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058670623 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32081976 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015604121 Gravity::solve_for_phi() time = 0.086913389 on level 0 Castro::construct_new_gravity() time = 0.089102442 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.061089032 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002821854 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.075017561 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.363303476 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015617673 Gravity::solve_for_phi() time = 0.089562191 on level 0 Castro::construct_new_gravity() time = 0.091714116 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.059784543 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002629972 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058553323 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326820191 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015108869 Gravity::solve_for_phi() time = 0.086810292 on level 0 Castro::construct_new_gravity() time = 0.08897054 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.059241304 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002704983 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058590038 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329490363 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01524034 Gravity::solve_for_phi() time = 0.08850734 on level 0 Castro::construct_new_gravity() time = 0.090704281 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.060496288 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003406837 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058564051 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334959439 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01520024 Gravity::solve_for_phi() time = 0.087335045 on level 0 Castro::construct_new_gravity() time = 0.08952919 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.059571032 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002703114 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.05857624 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.386116374 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015311125 Gravity::solve_for_phi() time = 0.088086232 on level 0 Castro::construct_new_gravity() time = 0.090226219 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.059416963 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003544011 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059378927 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333263797 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015107949 Gravity::solve_for_phi() time = 0.086358214 on level 0 Castro::construct_new_gravity() time = 0.088598303 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060177838 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003235551 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058396314 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329423671 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015532627 Gravity::solve_for_phi() time = 0.086958202 on level 0 Castro::construct_new_gravity() time = 0.089217749 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.05911771 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00273603 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058728495 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333615678 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015360655 Gravity::solve_for_phi() time = 0.086829025 on level 0 Castro::construct_new_gravity() time = 0.088973229 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059420735 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002719708 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059526514 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.392526784 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015508742 Gravity::solve_for_phi() time = 0.133825917 on level 0 Castro::construct_new_gravity() time = 0.136004358 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.069926751 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.004485346 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.069390897 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.371361603 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015667641 Gravity::solve_for_phi() time = 0.087490415 on level 0 Castro::construct_new_gravity() time = 0.089628352 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059735092 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.00272647 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059185095 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335513107 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015981569 Gravity::solve_for_phi() time = 0.088866087 on level 0 Castro::construct_new_gravity() time = 0.091163577 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.060935868 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003003127 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059480041 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33502869 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01564334 Gravity::solve_for_phi() time = 0.086726034 on level 0 Castro::construct_new_gravity() time = 0.088919122 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059643852 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.00298346 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058251217 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329341854 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015497142 Gravity::solve_for_phi() time = 0.089682581 on level 0 Castro::construct_new_gravity() time = 0.092060172 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.060878545 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.004220063 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.05955838 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334452509 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016205732 Gravity::solve_for_phi() time = 0.087435306 on level 0 Castro::construct_new_gravity() time = 0.08958349 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059476714 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002789068 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058573911 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330193784 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016244749 Gravity::solve_for_phi() time = 0.088366143 on level 0 Castro::construct_new_gravity() time = 0.090483622 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059418222 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002774004 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058565859 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334600361 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015703531 Gravity::solve_for_phi() time = 0.087277576 on level 0 Castro::construct_new_gravity() time = 0.089421124 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059433166 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.00270572067 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.1697594 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.048970457 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004174087 seconds Ending run at 08:01:43 UTC on 2024-04-01. Run time = 14.63281584 Run time without initialization = 12.22379236 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.63 ... 14.63 ... 14.63 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3975 5.4945 5.5900 38.20% Amr::InitAmr() 1 1.511 1.511 1.511 10.33% Castro::computeTemp() 80 0.8504 0.9544 1.104 7.55% amrex::Copy() 724 0.779 0.7917 0.8095 5.53% FabArray::ParallelCopy_finish() 1429 0.07416 0.525 0.7955 5.44% MultiFab::AddProduct() 3439 0.5626 0.5705 0.582 3.98% Castro::normalize_species() 79 0.5492 0.5568 0.566 3.87% Castro::reset_internal_energy(Fab) 160 0.5179 0.5271 0.5359 3.66% check_for_negative_density() 20 0.2286 0.3182 0.4158 2.84% MLPoisson::Fsmooth() 6144 0.318 0.3486 0.4132 2.82% FabArray::setVal() 5013 0.3595 0.3664 0.3742 2.56% Castro::initMFs() 1 0.3482 0.3579 0.3695 2.52% MultiFab::Subtract() 159 0.3452 0.35 0.3553 2.43% Gravity::fill_multipole_BCs() 19 0.1966 0.2392 0.2818 1.93% Castro::reset_internal_energy(MultiFab) 80 0.02298 0.07192 0.2433 1.66% FabArray::ParallelCopy_nowait() 1429 0.1875 0.2046 0.2222 1.52% FillBoundary_finish() 6380 0.1497 0.1655 0.2161 1.48% FabArray::sum() 3439 0.1854 0.1879 0.1912 1.31% Castro::initData() 1 0.003319 0.02761 0.1641 1.12% FillBoundary_nowait() 6380 0.07765 0.1051 0.1375 0.94% MLPoisson::Fapply() 986 0.09462 0.1003 0.113 0.77% MLCellLinOp::applyBC() 7148 0.04772 0.0628 0.1025 0.70% FabArray::Saxpy() 264 0.07221 0.0738 0.0798 0.55% Castro::construct_new_gravity_source() 17 0.06935 0.07035 0.07173 0.49% Castro::do_new_sources() 17 0.0003869 0.01074 0.06276 0.43% Castro::enforce_min_density() 79 0.0175 0.03056 0.06253 0.43% FabArray::Xpay() 945 0.05122 0.0543 0.06017 0.41% MultiFab::contains_nan() 37 0.04526 0.0462 0.04687 0.32% Castro::construct_old_gravity_source() 20 0.04426 0.04502 0.04587 0.31% MLMG::addInterpCorrection() 768 0.0336 0.03645 0.04268 0.29% AmrLevel::derive() 18 0.0401 0.04095 0.04255 0.29% Castro::do_old_sources() 20 0.0005274 0.01172 0.03719 0.25% StateData::FillBoundary(geom) 143 0 0.01719 0.03279 0.22% amrex::average_down 768 0.02505 0.02745 0.03252 0.22% VisMF::Write(FabArray) 4 0.01177 0.01311 0.02486 0.17% MLMG::ResNormInf() 146 0.009192 0.01572 0.02082 0.14% Amr::writePlotFile() 2 0.0074 0.01692 0.01893 0.13% MLCellLinOp::defineAuxData() 19 0.01504 0.01567 0.01836 0.13% FabArray::FillBoundary() 6380 0.01328 0.01396 0.01645 0.11% Castro::construct_new_source() 102 0.01585 0.01605 0.0163 0.11% MLCGSolver::bicgstab 8 0 0.001008 0.01614 0.11% amrex::Add() 128 0.01417 0.01453 0.01556 0.11% FabArray::norminf() 282 0.01101 0.01157 0.01555 0.11% MLCellLinOp::smooth() 3072 0.01115 0.01179 0.01378 0.09% Castro::evaluate_source_change() 196 0.01216 0.01263 0.01363 0.09% FillPatchIterator::Initialize 147 0.01239 0.01277 0.01305 0.09% FabArrayBase::getFB() 6380 0.009927 0.01052 0.01277 0.09% FabArray::setDomainBndry() 147 0.0004624 0.006462 0.01236 0.08% MLMG::prepareForSolve() 18 0.01009 0.01047 0.01143 0.08% Castro::wd_update() 2 0.004414 0.007149 0.01078 0.07% Castro::construct_old_source() 120 0.009986 0.01016 0.0103 0.07% Castro::construct_old_gravity() 20 0.000383 0.002979 0.008364 0.06% Gravity::actual_solve_with_mlmg() 19 0.006824 0.007221 0.008279 0.06% FabArray::mult() 59 0.007338 0.007494 0.008225 0.06% MLLinOp::makeSubCommunicator() 19 0.0007302 0.004418 0.008121 0.06% FabArrayBase::getCPC() 2005 0.007307 0.007486 0.008075 0.06% Castro::volWgtSum() 46 0.007263 0.007366 0.007433 0.05% Gravity::get_old_grav_vector() 20 0.00644 0.006566 0.007071 0.05% FabArrayBase::CPC::define() 576 0.002225 0.003393 0.006506 0.04% MLMG::solve() 18 0.0008428 0.001579 0.006389 0.04% Gravity::get_new_grav_vector() 18 0.006126 0.006209 0.006368 0.04% amrex::Dot() 142 0 0.000374 0.005983 0.04% MLCellLinOp::compGrad() 18 0.00583 0.005901 0.005955 0.04% Amr::writeSmallPlotFile() 2 0.003724 0.005329 0.005822 0.04% Castro::volInBoundary() 14 0.00342 0.003747 0.005542 0.04% Castro::initialize_do_advance() 20 0.004554 0.004733 0.00505 0.03% MLCGSolver::ParallelAllReduce 227 0 0.0003004 0.004806 0.03% MLCellLinOp::apply() 986 0.001984 0.00223 0.004702 0.03% FabArray::ParallelCopy() 1429 0.003402 0.003587 0.00409 0.03% MultiFab::max() 2 0.0002189 0.00167 0.00349 0.02% BndryData::define() 19 0.003076 0.00316 0.003396 0.02% Castro::construct_new_gravity() 17 0.0003008 0.0008658 0.003107 0.02% MLPoisson::normalize() 79 0 0.0001911 0.003058 0.02% Castro::sum_integrated_quantities() 2 0.001612 0.002264 0.002629 0.02% AmrLevel::FillPatch() 147 0.002228 0.002287 0.002571 0.02% MLLinOp::defineGrids() 19 0.001775 0.001894 0.002228 0.02% MLCellLinOp::prepareForSolve() 19 0.001665 0.001823 0.002103 0.01% MLCellLinOp::correctionResidual() 768 0.001843 0.001906 0.001989 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001339 0.001591 0.001911 0.01% MLMG::mgVcycle() 128 0.001558 0.001643 0.001796 0.01% MLCellLinOp::defineBC() 19 0.001482 0.001557 0.001756 0.01% Gravity::solve_for_phi() 17 0.0008351 0.001059 0.001734 0.01% MLMG:computeResOfCorrection() 768 0.00139 0.001446 0.001557 0.01% FabArrayBase::FB::FB() 75 0.0002802 0.0006864 0.001439 0.01% Castro::save_data_for_retry() 3 0.001288 0.001318 0.001431 0.01% StateData::define() 6 0.001333 0.001363 0.001386 0.01% main() 1 0.0009931 0.001162 0.001266 0.01% Castro::locWgtSum() 6 0.001114 0.001142 0.001161 0.01% MLMG::actualBottomSolve() 128 0.0001331 0.000198 0.001093 0.01% StateDataPhysBCFunct::() 147 0.000691 0.0008116 0.0009226 0.01% MLMG::mgVcycle_down::1 128 0.0006598 0.0006894 0.0008673 0.01% MLCellLinOp::setLevelBC() 19 0.0005415 0.0006614 0.0008116 0.01% MLMG::mgVcycle_down::3 128 0.0005659 0.0006235 0.0007862 0.01% MLMG::mgVcycle_down::2 128 0.0006101 0.0006735 0.0007827 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006911 0.0007182 0.0007703 0.01% MLMG::mgVcycle_down::0 128 0.0006575 0.0006781 0.0007399 0.01% Castro::subcycle_advance_ctu() 1 0.0001886 0.0002437 0.0007358 0.01% Castro::clean_state() 79 0.0004505 0.0004814 0.0007273 0.00% DistributionMapping::LeastUsedCPUs() 1 0.0003736 0.0004117 0.0007217 0.00% MLMG::mgVcycle_down::4 128 0.0005464 0.0005878 0.0007115 0.00% MLMG::mgVcycle_down::5 128 0.0005703 0.0006015 0.0006648 0.00% MLMG::mgVcycle_up::4 128 0.0003831 0.000411 0.0006336 0.00% Castro::buildMetrics() 1 0.0005747 0.0005884 0.0006068 0.00% TagBoxArray::collate() 2 0.0001149 0.0003739 0.0006013 0.00% Castro::Castro() 1 0.0004725 0.0005188 0.0005828 0.00% Castro::apply_tagging_restrictions() 2 0.0004142 0.0004829 0.0005515 0.00% AmrMesh::MakeNewGrids() 2 0.000497 0.0005085 0.0005372 0.00% FillPatchSingleLevel 147 0.0004766 0.0004927 0.0005285 0.00% MLMG::mgVcycle_up::1 128 0.0004597 0.0004875 0.0005248 0.00% MLMG::mgVcycle_up::2 128 0.0003807 0.0004307 0.0005187 0.00% Castro::do_advance_ctu() 20 0.0004277 0.0004518 0.0005159 0.00% MLMG::mgVcycle_up::0 128 0.0004642 0.0004807 0.0005152 0.00% Gravity::applyMetricTerms() 2 0.0004805 0.00049 0.0005135 0.00% MLMG::mgVcycle_up::3 128 0.0003761 0.0004018 0.0005038 0.00% makeSFC 95 0.0003715 0.0003947 0.0004841 0.00% MLCellLinOp::solutionResidual() 147 0.0004345 0.0004453 0.0004664 0.00% MLMG::oneIter() 128 0.0003898 0.0004036 0.0004542 0.00% MLMG::mgVcycle_up::5 128 0.0003939 0.0004102 0.0004489 0.00% Castro::swap_state_time_levels() 8 0.0004105 0.0004274 0.000445 0.00% Castro::enforce_consistent_e() 1 0.0003642 0.0003771 0.0004112 0.00% Castro::volProductSum() 2 0.0003914 0.0004019 0.0004095 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003284 0.0003404 0.0003771 0.00% Castro::problem_post_timestep() 2 1.133e-05 3.015e-05 0.0002977 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002232 0.0002416 0.0002947 0.00% MLMG::computeResidual() 128 0.0002353 0.0002454 0.0002586 0.00% MLMG::mgVcycle_bottom 128 0.0002251 0.0002323 0.000245 0.00% DistributionMapping::Distribute() 95 0.0002093 0.0002208 0.0002322 0.00% Castro::finalize_do_advance() 17 0.0001633 0.0001841 0.0002279 0.00% Gravity::update_max_rhs() 2 0.0001633 0.000178 0.0002005 0.00% MLPoisson::define() 19 0.0001317 0.0001504 0.000184 0.00% Castro::check_for_nan() 37 0.0001038 0.0001161 0.0001837 0.00% OwnerMask() 2 0.0001429 0.0001574 0.0001764 0.00% MLMG::compResidual() 1 0.0001586 0.0001601 0.0001643 0.00% Amr::coarseTimeStep() 1 0.0001331 0.0001592 0.0001636 0.00% Castro::retry_advance_ctu() 11 6.751e-05 7.976e-05 0.0001485 0.00% Amr::defBaseLevel() 1 0.0001133 0.0001211 0.0001389 0.00% TagBoxArray::mapPRD 2 0.0001099 0.0001186 0.000134 0.00% Amr::grid_places() 2 7.138e-05 9.119e-05 0.0001293 0.00% Gravity::test_composite_phi() 1 9.326e-05 0.0001017 0.0001253 0.00% Castro::initialize_advance() 1 9.974e-05 0.0001104 0.0001239 0.00% Castro::enforce_speed_limit() 79 0.0001073 0.000113 0.0001172 0.00% Castro::apply_source_to_state() 37 9.436e-05 0.0001022 0.0001143 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.081e-05 7.353e-05 0.0001143 0.00% knapsack() 1 5.599e-05 6.218e-05 0.000102 0.00% Castro::apply_problem_tags() 2 9.306e-05 9.537e-05 0.0001009 0.00% MLLinOp::define() 19 7.718e-05 8.306e-05 9.388e-05 0.00% Castro::create_source_corrector() 17 5.87e-05 6.765e-05 8.919e-05 0.00% MultiFab::Swap() 5 6.772e-05 7.113e-05 8.609e-05 0.00% MLPoisson::prepareForSolve() 19 6.875e-05 7.311e-05 8.176e-05 0.00% Castro::expand_state() 20 5.219e-05 5.963e-05 7.382e-05 0.00% Amr::initSubcycle() 1 5.534e-05 6.054e-05 6.735e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.364e-05 3.776e-05 6.535e-05 0.00% MLMG::computeMLResidual() 18 3.893e-05 4.365e-05 5.13e-05 0.00% Amr::FinalizeInit() 1 8.75e-06 1.571e-05 4.856e-05 0.00% Castro::derive() 18 4.095e-05 4.277e-05 4.648e-05 0.00% MLMG::getGradSolution() 18 4.056e-05 4.25e-05 4.54e-05 0.00% MLMG::MLResNormInf() 18 3.425e-05 3.592e-05 3.855e-05 0.00% Gravity::swapTimeLevels() 8 3.199e-05 3.417e-05 3.797e-05 0.00% MLMG::MLRhsNormInf() 18 3.06e-05 3.155e-05 3.396e-05 0.00% Castro::construct_old_rotation_source() 20 3.062e-05 3.171e-05 3.362e-05 0.00% Gravity::actual_multilevel_solve() 1 2.664e-05 2.795e-05 3.023e-05 0.00% Amr::regrid() 1 1.097e-05 1.458e-05 2.945e-05 0.00% Castro::advance() 1 7.042e-06 1.025e-05 2.835e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.667e-05 1.97e-05 2.825e-05 0.00% Castro::finalize_advance() 1 1.672e-05 1.862e-05 2.585e-05 0.00% Castro::construct_new_rotation_source() 17 2.105e-05 2.259e-05 2.565e-05 0.00% Castro::post_regrid() 2 1.131e-05 1.43e-05 2.248e-05 0.00% Amr::timeStep() 1 1.22e-05 1.441e-05 1.834e-05 0.00% Castro::estTimeStep() 10 1.219e-05 1.315e-05 1.495e-05 0.00% Castro::post_init() 1 1.196e-05 1.29e-05 1.368e-05 0.00% Amr::InitializeInit() 1 6.523e-06 8.644e-06 1.321e-05 0.00% BoxList::parallelComplementIn() 4 6.866e-06 7.517e-06 1.188e-05 0.00% Castro::computeInitialDt() 2 6.693e-06 7.458e-06 1.059e-05 0.00% Amr::init() 1 7.042e-06 8.277e-06 1.004e-05 0.00% Amr::bldFineLevels() 1 6.854e-06 8.023e-06 9.963e-06 0.00% BoxList::complementIn 4 5.919e-06 6.36e-06 9.361e-06 0.00% Castro::post_timestep() 1 5.573e-06 6.293e-06 7.566e-06 0.00% Castro::errorEst() 2 6.045e-06 6.471e-06 7.276e-06 0.00% Castro::FluxRegCrseInit 1 1.698e-06 2.226e-06 6.39e-06 0.00% Castro::gwstrain() 2 4.467e-06 4.778e-06 6.176e-06 0.00% Amr::initialInit() 1 2.796e-06 3.222e-06 5.431e-06 0.00% Gravity::set_mass_offset() 2 4.29e-06 4.678e-06 5.016e-06 0.00% Castro::FluxRegFineAdd() 1 1.453e-06 1.568e-06 1.707e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.63 14.63 14.63 100.00% Amr::coarseTimeStep() 1 12.22 12.22 12.22 83.53% Amr::timeStep() 1 12.17 12.17 12.17 83.17% Castro::advance() 1 12.11 12.11 12.11 82.76% Castro::subcycle_advance_ctu() 1 12.06 12.06 12.06 82.42% Castro::do_advance_ctu() 20 12.01 12.02 12.02 82.16% Castro::construct_ctu_hydro_source() 20 6.563 6.601 6.64 45.38% Castro::clean_state() 79 3.707 3.84 3.967 27.11% Castro::computeTemp() 80 2.387 2.522 2.742 18.74% Castro::reset_internal_energy(MultiFab) 80 1.496 1.567 1.722 11.77% Gravity::solve_phi_with_mlmg() 19 1.568 1.611 1.659 11.34% Castro::construct_new_gravity() 17 1.483 1.527 1.574 10.76% Gravity::solve_for_phi() 17 1.446 1.489 1.537 10.51% Amr::InitAmr() 1 1.511 1.511 1.511 10.33% Castro::initialize_do_advance() 20 1.393 1.423 1.46 9.98% Gravity::actual_solve_with_mlmg() 19 1.364 1.368 1.374 9.39% MLMG::solve() 18 1.313 1.318 1.319 9.01% Castro::do_old_sources() 20 1.161 1.187 1.211 8.27% MLMG::oneIter() 128 1.163 1.167 1.171 8.00% MLMG::mgVcycle() 128 1.149 1.152 1.156 7.90% Castro::do_new_sources() 17 0.9492 0.994 1.027 7.02% FabArray::ParallelCopy() 1429 0.3012 0.753 1.019 6.97% Castro::evaluate_source_change() 196 0.964 0.9772 0.997 6.81% Amr::init() 1 0.8974 0.8976 0.8977 6.13% Castro::enforce_min_density() 79 0.7967 0.8202 0.8468 5.79% Amr::initialInit() 1 0.8445 0.8448 0.8449 5.77% amrex::Copy() 724 0.779 0.7917 0.8095 5.53% FabArray::ParallelCopy_finish() 1429 0.07416 0.525 0.7955 5.44% MLCellLinOp::smooth() 3072 0.5904 0.6458 0.7824 5.35% AmrLevel::FillPatch() 147 0.4926 0.5765 0.6923 4.73% Amr::InitializeInit() 1 0.4334 0.5007 0.6092 4.16% Amr::defBaseLevel() 1 0.4334 0.5007 0.6092 4.16% MultiFab::AddProduct() 3439 0.5626 0.5705 0.582 3.98% Castro::normalize_species() 79 0.5492 0.5568 0.566 3.87% Castro::reset_internal_energy(Fab) 160 0.5179 0.5271 0.5359 3.66% FillPatchIterator::Initialize 147 0.3144 0.3954 0.5147 3.52% FillPatchIterator::FillFromLevel0() 147 0.2891 0.3762 0.4977 3.40% FillPatchSingleLevel 147 0.2884 0.3755 0.4969 3.40% MLCellLinOp::applyBC() 7148 0.3202 0.3585 0.4483 3.06% MLMG::mgVcycle_up::1 128 0.1003 0.2696 0.439 3.00% check_for_negative_density() 20 0.2286 0.3182 0.4158 2.84% MLPoisson::Fsmooth() 6144 0.318 0.3486 0.4132 2.82% Amr::FinalizeInit() 1 0.2356 0.344 0.4114 2.81% MLMG::addInterpCorrection() 768 0.06379 0.31 0.3844 2.63% Castro::Castro() 1 0.3537 0.3636 0.3756 2.57% FabArray::setVal() 5013 0.3595 0.3664 0.3742 2.56% Castro::initMFs() 1 0.3483 0.358 0.3696 2.53% MultiFab::Subtract() 159 0.3452 0.35 0.3553 2.43% FabArray::FillBoundary() 6380 0.2669 0.2957 0.3458 2.36% MLMG::mgVcycle_down::0 128 0.2782 0.2811 0.2855 1.95% Gravity::fill_multipole_BCs() 19 0.1988 0.2414 0.2838 1.94% MLMG::mgVcycle_up::2 128 0.01064 0.1178 0.2816 1.92% Castro::expand_state() 20 0.1864 0.2108 0.2552 1.74% Castro::initData() 1 0.0772 0.1351 0.2534 1.73% FabArray::ParallelCopy_nowait() 1429 0.2064 0.2243 0.2431 1.66% Amr::bldFineLevels() 1 0.04664 0.1549 0.2214 1.51% FillBoundary_finish() 6380 0.1497 0.1655 0.2161 1.48% MLMG::mgVcycle_up::0 128 0.2083 0.2107 0.2132 1.46% MLCellLinOp::apply() 986 0.1624 0.1739 0.2078 1.42% FabArray::sum() 3439 0.1854 0.1879 0.1912 1.31% Amr::grid_places() 2 0.002676 0.1111 0.1785 1.22% AmrMesh::MakeNewGrids() 2 0.002588 0.1111 0.1784 1.22% TagBoxArray::mapPRD 2 0.000839 0.1094 0.1768 1.21% MLMG::mgVcycle_up::3 128 0.01056 0.02327 0.1725 1.18% MLMG:computeResOfCorrection() 768 0.1187 0.1292 0.1521 1.04% MLCellLinOp::correctionResidual() 768 0.1173 0.1277 0.1506 1.03% FillBoundary_nowait() 6380 0.08793 0.1163 0.1501 1.03% Castro::post_init() 1 0.1439 0.1453 0.1471 1.01% MLMG::mgVcycle_down::1 128 0.128 0.1323 0.1361 0.93% Castro::construct_new_source() 102 0.1262 0.1278 0.1303 0.89% MLPoisson::Fapply() 986 0.09462 0.1003 0.113 0.77% Gravity::multilevel_solve_for_new_phi() 1 0.1112 0.1112 0.1113 0.76% Gravity::actual_multilevel_solve() 1 0.1111 0.1111 0.1112 0.76% MLCellLinOp::solutionResidual() 147 0.09477 0.1013 0.1055 0.72% Amr::writePlotFile() 2 0.09743 0.09751 0.09752 0.67% Castro::post_regrid() 2 0.08575 0.08754 0.08899 0.61% Castro::create_source_corrector() 17 0.04892 0.06489 0.08637 0.59% MLMG::computeResidual() 128 0.08202 0.08378 0.08589 0.59% Castro::construct_old_source() 120 0.07832 0.07951 0.08064 0.55% FabArray::Saxpy() 264 0.07221 0.0738 0.0798 0.55% MLMG::mgVcycle_down::2 128 0.0124 0.04251 0.07598 0.52% Castro::construct_new_gravity_source() 17 0.06935 0.07035 0.07173 0.49% Castro::derive() 18 0.06844 0.06987 0.07141 0.49% AmrLevel::derive() 18 0.0684 0.06983 0.07137 0.49% MLMG::mgVcycle_bottom 128 0.000359 0.004759 0.0706 0.48% MLMG::actualBottomSolve() 128 0.0001331 0.004527 0.07035 0.48% MLCGSolver::bicgstab 8 0 0.0043 0.0688 0.47% Castro::construct_old_gravity() 20 0.04463 0.05713 0.06468 0.44% Gravity::get_old_grav_vector() 20 0.04138 0.05415 0.06415 0.44% MLMG::mgVcycle_down::3 128 0.01185 0.01854 0.06387 0.44% Castro::post_timestep() 1 0.05908 0.06055 0.06307 0.43% FabArray::Xpay() 945 0.05122 0.0543 0.06017 0.41% amrex::average_down 768 0.03334 0.04081 0.05738 0.39% Castro::initialize_advance() 1 0.04881 0.04989 0.05053 0.35% Castro::check_for_nan() 37 0.04537 0.04632 0.04706 0.32% MultiFab::contains_nan() 37 0.04526 0.0462 0.04687 0.32% Castro::construct_old_gravity_source() 20 0.04426 0.04502 0.04587 0.31% Amr::regrid() 1 0.04404 0.04489 0.04526 0.31% Castro::retry_advance_ctu() 11 0.03675 0.03777 0.043 0.29% MLPoisson::define() 19 0.02882 0.03386 0.04271 0.29% Gravity::get_new_grav_vector() 18 0.03589 0.03669 0.03827 0.26% MLMG::mgVcycle_down::4 128 0.01181 0.01355 0.0345 0.24% StateDataPhysBCFunct::() 147 0.000691 0.01801 0.03371 0.23% StateData::FillBoundary(geom) 143 0 0.01719 0.03279 0.22% MLMG::ResNormInf() 146 0.01957 0.02562 0.03082 0.21% Castro::apply_source_to_state() 37 0.02935 0.0298 0.03011 0.21% MLMG::mgVcycle_up::4 128 0.01062 0.01205 0.02789 0.19% VisMF::Write(FabArray) 4 0.01177 0.01311 0.02486 0.17% MLCellLinOp::defineAuxData() 19 0.01921 0.02058 0.02467 0.17% Castro::save_data_for_retry() 3 0.01866 0.01935 0.02383 0.16% MLMG::prepareForSolve() 18 0.02045 0.02153 0.02366 0.16% MLMG::mgVcycle_down::5 128 0.01171 0.01273 0.02262 0.15% Castro::sum_integrated_quantities() 2 0.02124 0.02144 0.02145 0.15% MLMG::computeMLResidual() 18 0.0106 0.01691 0.01966 0.13% MLMG::mgVcycle_up::5 128 0.01081 0.01163 0.01936 0.13% amrex::Add() 128 0.01417 0.01453 0.01556 0.11% FabArray::norminf() 282 0.01101 0.01157 0.01555 0.11% Gravity::test_composite_phi() 1 0.01428 0.01432 0.01437 0.10% Castro::problem_post_timestep() 2 0.009113 0.01093 0.01421 0.10% FabArrayBase::getFB() 6380 0.01026 0.0112 0.01421 0.10% Castro::wd_update() 2 0.009102 0.0109 0.0142 0.10% FabArrayBase::getCPC() 2005 0.009584 0.01088 0.01416 0.10% FabArray::setDomainBndry() 147 0.0004624 0.006462 0.01236 0.08% MLLinOp::define() 19 0.003576 0.007351 0.01147 0.08% MLLinOp::defineGrids() 19 0.003488 0.007268 0.01139 0.08% Amr::writeSmallPlotFile() 2 0.008706 0.008709 0.008712 0.06% FabArray::mult() 59 0.007338 0.007494 0.008225 0.06% MLLinOp::makeSubCommunicator() 19 0.0007302 0.004418 0.008121 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005037 0.008059 0.06% MLMG::getGradSolution() 18 0.007479 0.007753 0.007966 0.05% MLCellLinOp::compGrad() 18 0.007437 0.00771 0.007925 0.05% Castro::volWgtSum() 46 0.007263 0.007366 0.007433 0.05% FabArrayBase::CPC::define() 576 0.002225 0.003393 0.006506 0.04% MLCellLinOp::defineBC() 19 0.005548 0.005783 0.006385 0.04% amrex::Dot() 142 0 0.000374 0.005983 0.04% Castro::volInBoundary() 14 0.00342 0.003747 0.005542 0.04% Gravity::update_max_rhs() 2 0.00148 0.00294 0.004754 0.03% BndryData::define() 19 0.003965 0.004226 0.004664 0.03% MultiFab::max() 2 0.0002189 0.00167 0.00349 0.02% MLPoisson::normalize() 79 0 0.0001911 0.003058 0.02% MLPoisson::prepareForSolve() 19 0.001746 0.001896 0.002174 0.01% MLCellLinOp::prepareForSolve() 19 0.001665 0.001823 0.002103 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001339 0.001591 0.001911 0.01% AmrLevel::AmrLevel(dm) 1 0.001368 0.001401 0.001451 0.01% FabArrayBase::FB::FB() 75 0.0002802 0.0006864 0.001439 0.01% StateData::define() 6 0.001333 0.001363 0.001386 0.01% MLMG::compResidual() 1 0.0009727 0.001235 0.001345 0.01% Gravity::swapTimeLevels() 8 0.001183 0.001224 0.00132 0.01% MLMG::MLResNormInf() 18 0.001256 0.001289 0.001316 0.01% MLMG::MLRhsNormInf() 18 0.001219 0.001249 0.00128 0.01% Castro::locWgtSum() 6 0.001114 0.001142 0.001161 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009143 0.0009559 0.001087 0.01% MLCellLinOp::setLevelBC() 19 0.0005415 0.0006614 0.0008116 0.01% DistributionMapping::KnapSackDoIt() 1 0.0004571 0.0004935 0.000798 0.01% DistributionMapping::LeastUsedCPUs() 1 0.0003736 0.0004117 0.0007217 0.00% makeSFC 95 0.0005843 0.0006155 0.0007104 0.00% Castro::buildMetrics() 1 0.0006385 0.0006528 0.0006724 0.00% Castro::errorEst() 2 0.0005137 0.0005847 0.0006528 0.00% TagBoxArray::collate() 2 0.0001149 0.0003739 0.0006013 0.00% Castro::apply_tagging_restrictions() 2 0.0004142 0.0004829 0.0005515 0.00% Gravity::applyMetricTerms() 2 0.0004805 0.00049 0.0005135 0.00% Castro::swap_state_time_levels() 8 0.0004105 0.0004274 0.000445 0.00% Castro::enforce_consistent_e() 1 0.0003642 0.0003771 0.0004112 0.00% Castro::volProductSum() 2 0.0003914 0.0004019 0.0004095 0.00% Castro::finalize_advance() 1 0.0002505 0.0002631 0.0002793 0.00% Castro::finalize_do_advance() 17 0.0001728 0.0001941 0.0002385 0.00% DistributionMapping::Distribute() 95 0.0002093 0.0002208 0.0002322 0.00% OwnerMask() 2 0.0001429 0.0001574 0.0001764 0.00% Castro::enforce_speed_limit() 79 0.0001073 0.000113 0.0001172 0.00% knapsack() 1 5.599e-05 6.218e-05 0.000102 0.00% Castro::apply_problem_tags() 2 9.306e-05 9.537e-05 0.0001009 0.00% MultiFab::Swap() 5 6.772e-05 7.113e-05 8.609e-05 0.00% Amr::initSubcycle() 1 5.534e-05 6.054e-05 6.735e-05 0.00% Castro::construct_old_rotation_source() 20 3.062e-05 3.171e-05 3.362e-05 0.00% Castro::construct_new_rotation_source() 17 2.105e-05 2.259e-05 2.565e-05 0.00% BoxList::parallelComplementIn() 4 1.288e-05 1.388e-05 2.124e-05 0.00% Castro::estTimeStep() 10 1.219e-05 1.315e-05 1.495e-05 0.00% Castro::computeInitialDt() 2 9.402e-06 1.061e-05 1.412e-05 0.00% BoxList::complementIn 4 5.919e-06 6.36e-06 9.361e-06 0.00% Castro::FluxRegCrseInit 1 1.698e-06 2.226e-06 6.39e-06 0.00% Castro::gwstrain() 2 4.467e-06 4.778e-06 6.176e-06 0.00% Gravity::set_mass_offset() 2 4.29e-06 4.678e-06 5.016e-06 0.00% Castro::FluxRegFineAdd() 1 1.453e-06 1.568e-06 1.707e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 13 B 16 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-48-g47347f785f5c) finalized