MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.10-8-gfd2dfa282a30) initialized Starting run at 14:20:41 UTC on 2023-10-08. Successfully read inputs file ... Castro git describe: 23.10-15-g80d1947e4 AMReX git describe: 23.10-8-gfd2dfa282 Microphysics git describe: 23.10-6-g657406dc reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.157576499 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.00098187 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.01037886 Gravity::multilevel_solve_for_new_phi() time = 0.101287981 Gravity::fill_multipole_BCs() time = 0.010610708 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.052442772 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.007369586 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.008015154 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.064296391 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.01685329 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.066064833 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.02739549 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.079374857 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.009954038 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.068457492 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.345462349 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034929449 Gravity::solve_for_phi() time = 0.114814545 on level 0 Castro::construct_new_gravity() time = 0.116969132 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.061345376 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.005324527 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.085853259 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326057711 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014109152 Gravity::solve_for_phi() time = 0.087859351 on level 0 Castro::construct_new_gravity() time = 0.089926076 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.588335034e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.060917174 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.003083776 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058841358 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330821334 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014109398 Gravity::solve_for_phi() time = 0.113365617 on level 0 Castro::construct_new_gravity() time = 0.116897721 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.587065898e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.073626539 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002635925 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059346216 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.339287716 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014790857 Gravity::solve_for_phi() time = 0.087002958 on level 0 Castro::construct_new_gravity() time = 0.089858034 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -9.059860097e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.061452057 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003034151 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060159555 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332474701 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014779256 Gravity::solve_for_phi() time = 0.085252895 on level 0 Castro::construct_new_gravity() time = 0.087299715 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -3.751920171e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060009688 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.004245781 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059785964 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331716454 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014731784 Gravity::solve_for_phi() time = 0.084691211 on level 0 Castro::construct_new_gravity() time = 0.086740727 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: -3.291489439e+24 zmom added: 0 eint added: 0 ener added: 5.968491079e+43 Castro::do_new_sources() time = 0.059952018 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.003741075 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059622295 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335694566 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015446678 Gravity::solve_for_phi() time = 0.085706241 on level 0 Castro::construct_new_gravity() time = 0.087879323 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.291567233e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060346919 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003617851 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059481543 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329622543 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015019933 Gravity::solve_for_phi() time = 0.090542217 on level 0 Castro::construct_new_gravity() time = 0.092716347 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: 6.776595903e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060118352 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003118454 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059363464 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333309041 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015383382 Gravity::solve_for_phi() time = 0.085391545 on level 0 Castro::construct_new_gravity() time = 0.087479992 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798245e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: 5.252452121e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059925448 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002967969 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059368 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331629682 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015109055 Gravity::solve_for_phi() time = 0.08647316 on level 0 Castro::construct_new_gravity() time = 0.088626225 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: -4.179294337e+24 zmom added: 0 eint added: 0 ener added: 2.123241033e+43 Castro::do_new_sources() time = 0.060485911 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002838473 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059290071 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336618087 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015266373 Gravity::solve_for_phi() time = 0.08638185 on level 0 Castro::construct_new_gravity() time = 0.088478584 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 1.205384045e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.060409916 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.002716979 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060461274 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334171989 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015134069 Gravity::solve_for_phi() time = 0.086784752 on level 0 Castro::construct_new_gravity() time = 0.088864954 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195608e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -3.296211805e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.060452959 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.002780432 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059535653 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337114557 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015095968 Gravity::solve_for_phi() time = 0.084724642 on level 0 Castro::construct_new_gravity() time = 0.08678548 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -1.986935698e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.060136117 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.004184851 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058837589 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333974337 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015457508 Gravity::solve_for_phi() time = 0.08546479 on level 0 Castro::construct_new_gravity() time = 0.087523581 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 2.991619167e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059952357 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.00362395 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.05949716 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334197345 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016042541 Gravity::solve_for_phi() time = 0.086500813 on level 0 Castro::construct_new_gravity() time = 0.088543847 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: -4.264296934e+24 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059934631 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.003454915 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059220865 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329229838 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015970656 Gravity::solve_for_phi() time = 0.086220767 on level 0 Castro::construct_new_gravity() time = 0.088283208 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762635e+35 ymom added: 4.946678891e+24 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.060223386 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.003097637 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058993028 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334293778 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015415142 Gravity::solve_for_phi() time = 0.085822218 on level 0 Castro::construct_new_gravity() time = 0.087886825 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: -4.247768651e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059836153 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002729114946 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.117748323e+27 ener added: 4.117748323e+27 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.160568787e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.471393084e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 7.282010032e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.55125627e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.06483893 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.049548261 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.006969806 seconds Ending run at 14:20:55 UTC on 2023-10-08. Run time = 14.4605996 Run time without initialization = 12.1222345 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.46 ... 14.46 ... 14.46 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.4635 5.4971 5.5473 38.36% Amr::InitAmr() 1 1.447 1.448 1.448 10.01% Castro::computeTemp() 80 0.8505 0.9711 1.132 7.83% amrex::Copy() 795 0.7843 0.7899 0.7987 5.52% FabArray::ParallelCopy_finish() 1429 0.05203 0.5527 0.7833 5.42% MultiFab::AddProduct() 3439 0.5559 0.5609 0.583 4.03% Castro::normalize_species() 79 0.548 0.5526 0.5663 3.92% Castro::reset_internal_energy(Fab) 160 0.5304 0.5347 0.5459 3.78% MLPoisson::Fsmooth() 6144 0.3144 0.342 0.4325 2.99% Castro::initMFs() 1 0.3592 0.3761 0.4118 2.85% FabArray::setVal() 5021 0.3509 0.3547 0.3762 2.60% MultiFab::Subtract() 159 0.3436 0.3467 0.3532 2.44% Gravity::fill_multipole_BCs() 19 0.1945 0.2515 0.2915 2.02% FabArray::ParallelCopy_nowait() 1429 0.1935 0.2044 0.2211 1.53% Castro::reset_internal_energy(MultiFab) 80 0.02274 0.06648 0.22 1.52% check_for_negative_density() 20 0.1146 0.174 0.218 1.51% FabArray::sum() 3439 0.1872 0.189 0.1963 1.36% FillBoundary_finish() 6388 0.1076 0.1324 0.1473 1.02% Castro::initData() 1 0.003337 0.02472 0.142 0.98% FillBoundary_nowait() 6388 0.07502 0.0991 0.1276 0.88% MLPoisson::Fapply() 994 0.09561 0.1011 0.1158 0.80% MLCellLinOp::applyBC() 7156 0.04805 0.06252 0.1059 0.73% Castro::enforce_min_density() 79 0.01773 0.03328 0.0934 0.65% Castro::do_new_sources() 17 0.0003738 0.01351 0.07653 0.53% Castro::construct_new_gravity_source() 17 0.0706 0.07228 0.07642 0.53% FabArray::Saxpy() 192 0.07108 0.07211 0.07629 0.53% FabArray::Xpay() 953 0.05177 0.05436 0.06197 0.43% Castro::do_old_sources() 20 0.0004976 0.01324 0.05744 0.40% Castro::construct_old_gravity() 20 0.0003565 0.01116 0.04883 0.34% MultiFab::contains_nan() 37 0.04603 0.04651 0.04742 0.33% Castro::construct_old_gravity_source() 20 0.04409 0.04479 0.04739 0.33% MLMG::addInterpCorrection() 768 0.03404 0.03658 0.04351 0.30% AmrLevel::derive() 18 0.04099 0.0417 0.04286 0.30% StateData::FillBoundary(geom) 143 0 0.01772 0.0341 0.24% amrex::average_down 768 0.0253 0.02744 0.03323 0.23% VisMF::Write(FabArray) 4 0.01598 0.01749 0.02669 0.18% MLCGSolver::bicgstab 8 0 0.001379 0.02206 0.15% Amr::writePlotFile() 2 0.00857 0.01955 0.02143 0.15% FabArray::FillBoundary() 6388 0.01439 0.01496 0.01812 0.13% MLCellLinOp::defineAuxData() 19 0.01526 0.01582 0.0177 0.12% Castro::construct_new_source() 102 0.01542 0.01568 0.01642 0.11% FabArray::norminf() 244 0.01066 0.01139 0.01557 0.11% MLMG::ResNormInf() 146 0.0065 0.01198 0.01521 0.11% amrex::Add() 136 0.01426 0.01442 0.01492 0.10% Castro::evaluate_source_change() 196 0.0133 0.01364 0.01491 0.10% MLCellLinOp::smooth() 3072 0.01191 0.01246 0.01364 0.09% FabArrayBase::getFB() 6388 0.01027 0.01072 0.01346 0.09% FillPatchIterator::Initialize 147 0.01263 0.01284 0.01324 0.09% FabArray::setDomainBndry() 147 0.0004595 0.006254 0.01302 0.09% MLMG::prepareForSolve() 18 0.01055 0.01075 0.01118 0.08% Castro::construct_old_source() 120 0.009783 0.009936 0.01053 0.07% Castro::wd_update() 2 0.004664 0.007515 0.01031 0.07% Amr::writeSmallPlotFile() 2 0.006954 0.008682 0.009241 0.06% Gravity::actual_solve_with_mlmg() 19 0.006953 0.007253 0.008126 0.06% FabArrayBase::getCPC() 2005 0.007405 0.007592 0.00794 0.05% MLLinOp::makeSubCommunicator() 19 0.0007939 0.003882 0.007758 0.05% FabArray::mult() 59 0.007339 0.00744 0.007634 0.05% Castro::volWgtSum() 46 0.007141 0.007203 0.007372 0.05% Gravity::get_old_grav_vector() 20 0.006451 0.006592 0.006826 0.05% FabArrayBase::CPC::define() 576 0.002268 0.003444 0.00664 0.05% Gravity::get_new_grav_vector() 18 0.006002 0.006125 0.006391 0.04% amrex::Dot() 142 0 0.0003943 0.006309 0.04% MLCellLinOp::compGrad() 18 0.005872 0.006012 0.006275 0.04% MLMG::solve() 18 0.00105 0.003378 0.00607 0.04% MLCellLinOp::apply() 994 0.002149 0.002411 0.005429 0.04% Castro::initialize_do_advance() 20 0.004669 0.005053 0.005428 0.04% Castro::volInBoundary() 14 0.003373 0.003618 0.005382 0.04% MultiFab::max() 2 0.0001502 0.003753 0.004974 0.03% MLCGSolver::ParallelAllReduce 189 0 0.0002967 0.004747 0.03% TagBoxArray::collate() 2 8.753e-05 0.0008782 0.004648 0.03% FabArray::ParallelCopy() 1429 0.003864 0.00398 0.004169 0.03% FabArray::LinComb() 71 0 0.0002381 0.003809 0.03% BndryData::define() 19 0.003165 0.003213 0.0034 0.02% MLPoisson::normalize() 79 0 0.0002032 0.003251 0.02% AmrLevel::FillPatch() 147 0.002187 0.002298 0.002487 0.02% Gravity::solve_for_phi() 17 0.0008186 0.001159 0.00248 0.02% MLCellLinOp::correctionResidual() 776 0.001931 0.002025 0.002474 0.02% Castro::construct_new_gravity() 17 0.0003052 0.0007888 0.002378 0.02% Castro::sum_integrated_quantities() 2 0.001714 0.002171 0.002336 0.02% MLCellLinOp::prepareForSolve() 19 0.001728 0.001868 0.002202 0.02% MLLinOp::defineGrids() 19 0.001838 0.001948 0.002138 0.01% StateData::define() 6 0.001254 0.001529 0.002007 0.01% MLMG::mgVcycle() 128 0.001689 0.00176 0.001907 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.00136 0.001606 0.00185 0.01% MLCellLinOp::defineBC() 19 0.001596 0.001638 0.001766 0.01% MLMG:computeResOfCorrection() 768 0.001453 0.001509 0.001583 0.01% FabArrayBase::FB::FB() 75 0.0002837 0.0006949 0.001483 0.01% Castro::save_data_for_retry() 3 0.00131 0.001355 0.001382 0.01% main() 1 0.001038 0.001216 0.001313 0.01% MLMG::actualBottomSolve() 128 0.0001371 0.0002107 0.001222 0.01% Castro::locWgtSum() 6 0.001115 0.00112 0.001148 0.01% Castro::buildMetrics() 1 0.0005659 0.0006818 0.001003 0.01% StateDataPhysBCFunct::() 147 0.0006949 0.0008398 0.0009369 0.01% MLCellLinOp::setLevelBC() 19 0.0005485 0.0006959 0.0008954 0.01% Castro::subcycle_advance_ctu() 1 0.0001933 0.0002672 0.0008282 0.01% FillPatchIterator::FillFromLevel0() 147 0.0007476 0.0007764 0.0008137 0.01% MLMG::mgVcycle_down::1 128 0.0006988 0.0007199 0.0007865 0.01% MLMG::mgVcycle_down::0 128 0.0007024 0.000724 0.0007832 0.01% MLMG::mgVcycle_down::2 128 0.0006544 0.0007145 0.0007749 0.01% MLMG::mgVcycle_down::3 128 0.000615 0.0006621 0.0007728 0.01% MLMG::mgVcycle_down::5 128 0.0006229 0.0006422 0.0007332 0.01% MLMG::mgVcycle_down::4 128 0.0005979 0.0006265 0.0007307 0.01% Castro::swap_state_time_levels() 8 0.0006473 0.0006854 0.0007299 0.01% AmrMesh::MakeNewGrids() 2 0.0004826 0.0005156 0.0006744 0.00% Castro::do_advance_ctu() 20 0.0004693 0.0005047 0.0005771 0.00% Castro::apply_tagging_restrictions() 2 0.0004278 0.0004843 0.0005673 0.00% Castro::Castro() 1 0.0004602 0.0004964 0.0005523 0.00% MLMG::mgVcycle_up::0 128 0.0005002 0.0005153 0.0005488 0.00% Castro::clean_state() 79 0.0004617 0.0004967 0.0005462 0.00% MLMG::mgVcycle_up::1 128 0.0004922 0.0005194 0.000543 0.00% FillPatchSingleLevel 147 0.0004929 0.000505 0.0005279 0.00% MLMG::mgVcycle_up::2 128 0.000417 0.0004631 0.0005193 0.00% Gravity::applyMetricTerms() 2 0.0004683 0.0004851 0.0005121 0.00% MLMG::mgVcycle_up::5 128 0.000427 0.0004423 0.0005089 0.00% Castro::problem_post_timestep() 2 1.103e-05 4.345e-05 0.000504 0.00% MLMG::mgVcycle_up::3 128 0.0004113 0.0004304 0.0005 0.00% MLCellLinOp::solutionResidual() 147 0.0004477 0.0004656 0.000489 0.00% MLMG::mgVcycle_up::4 128 0.000416 0.0004328 0.0004825 0.00% makeSFC 95 0.0003973 0.0004245 0.0004812 0.00% MLMG::oneIter() 128 0.0004097 0.0004208 0.0004543 0.00% Castro::enforce_consistent_e() 1 0.0003617 0.0003819 0.0004184 0.00% Castro::volProductSum() 2 0.0003842 0.0003865 0.0003932 0.00% MLLinOp::makeAgglomeratedDMap 19 0.000342 0.0003585 0.0003814 0.00% DistributionMapping::LeastUsedCPUs() 1 2.236e-05 0.0002128 0.0002793 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002341 0.0002496 0.0002729 0.00% MLMG::computeResidual() 128 0.000249 0.0002572 0.0002716 0.00% MLMG::mgVcycle_bottom 128 0.0002437 0.0002509 0.000268 0.00% DistributionMapping::Distribute() 95 0.0002166 0.000226 0.0002397 0.00% Castro::finalize_do_advance() 17 0.0001747 0.0001922 0.0002151 0.00% Amr::coarseTimeStep() 1 0.0001417 0.0001855 0.000197 0.00% Gravity::update_max_rhs() 2 0.0001702 0.0001758 0.0001866 0.00% OwnerMask() 2 0.0001383 0.0001558 0.0001777 0.00% MLMG::compResidual() 1 0.0001594 0.0001632 0.0001669 0.00% Castro::initialize_advance() 1 0.0001304 0.0001445 0.0001642 0.00% Castro::retry_advance_ctu() 11 5.802e-05 6.69e-05 0.0001606 0.00% MLPoisson::define() 19 0.0001337 0.0001404 0.0001516 0.00% Castro::check_for_nan() 37 0.0001085 0.0001187 0.0001346 0.00% Castro::enforce_speed_limit() 79 0.0001089 0.0001164 0.0001296 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.444e-05 8.594e-05 0.0001256 0.00% TagBoxArray::mapPRD 2 0.0001076 0.0001147 0.0001248 0.00% Gravity::test_composite_phi() 1 9.32e-05 0.0001 0.0001201 0.00% Amr::initSubcycle() 1 6.133e-05 7.237e-05 0.0001189 0.00% Amr::grid_places() 2 7.787e-05 9.61e-05 0.0001182 0.00% Castro::apply_source_to_state() 37 9.987e-05 0.000107 0.0001134 0.00% Amr::defBaseLevel() 1 9.19e-05 9.858e-05 0.0001101 0.00% Castro::apply_problem_tags() 2 9.123e-05 9.409e-05 0.0001098 0.00% MLLinOp::define() 19 7.657e-05 8.586e-05 0.000101 0.00% MLPoisson::prepareForSolve() 19 7.821e-05 8.386e-05 9.368e-05 0.00% MultiFab::Swap() 5 7.307e-05 7.712e-05 9.357e-05 0.00% knapsack() 1 6.029e-05 6.742e-05 8.657e-05 0.00% Castro::expand_state() 20 5.85e-05 6.426e-05 7.877e-05 0.00% Castro::create_source_corrector() 17 5.82e-05 6.579e-05 7.51e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.341e-05 3.921e-05 5.465e-05 0.00% MLMG::computeMLResidual() 18 4.204e-05 4.714e-05 5.453e-05 0.00% Gravity::swapTimeLevels() 8 3.493e-05 4.398e-05 5.243e-05 0.00% Castro::derive() 18 4.394e-05 4.595e-05 5.049e-05 0.00% Amr::FinalizeInit() 1 9.143e-06 1.493e-05 5.009e-05 0.00% MLMG::getGradSolution() 18 4.072e-05 4.272e-05 4.644e-05 0.00% Amr::timeStep() 1 1.259e-05 1.786e-05 4.483e-05 0.00% Gravity::actual_multilevel_solve() 1 2.875e-05 3.375e-05 4.054e-05 0.00% MLMG::MLResNormInf() 18 3.564e-05 3.701e-05 3.888e-05 0.00% MLMG::MLRhsNormInf() 18 3.223e-05 3.311e-05 3.395e-05 0.00% Castro::construct_old_rotation_source() 20 3.078e-05 3.15e-05 3.298e-05 0.00% Amr::regrid() 1 1.151e-05 1.438e-05 3.24e-05 0.00% Amr::init() 1 7.094e-06 9.461e-06 2.549e-05 0.00% Castro::construct_new_rotation_source() 17 2.191e-05 2.305e-05 2.484e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.756e-05 1.984e-05 2.478e-05 0.00% Gravity::set_mass_offset() 2 4.631e-06 1.084e-05 2.314e-05 0.00% Castro::finalize_advance() 1 1.775e-05 1.918e-05 2.249e-05 0.00% Castro::post_init() 1 1.231e-05 1.369e-05 1.795e-05 0.00% Castro::post_regrid() 2 1.125e-05 1.304e-05 1.673e-05 0.00% Castro::estTimeStep() 10 1.292e-05 1.423e-05 1.613e-05 0.00% Amr::InitializeInit() 1 6.727e-06 8.23e-06 1.491e-05 0.00% Castro::computeInitialDt() 2 7.984e-06 9.908e-06 1.463e-05 0.00% Amr::bldFineLevels() 1 7.302e-06 8.823e-06 1.267e-05 0.00% Castro::advance() 1 7.805e-06 9.019e-06 1.23e-05 0.00% BoxList::parallelComplementIn() 4 7.166e-06 7.526e-06 9.791e-06 0.00% Amr::initialInit() 1 3.18e-06 3.994e-06 9.139e-06 0.00% Castro::errorEst() 2 6.291e-06 6.92e-06 8.254e-06 0.00% Castro::post_timestep() 1 6.037e-06 6.534e-06 8.117e-06 0.00% BoxList::complementIn 4 6.175e-06 6.478e-06 7.973e-06 0.00% Castro::gwstrain() 2 4.337e-06 4.883e-06 6.85e-06 0.00% Castro::FluxRegCrseInit 1 1.727e-06 2.116e-06 2.714e-06 0.00% Castro::FluxRegFineAdd() 1 1.449e-06 1.611e-06 1.808e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.46 14.46 14.46 100.00% Amr::coarseTimeStep() 1 12.12 12.12 12.12 83.82% Amr::timeStep() 1 12.06 12.06 12.06 83.43% Castro::advance() 1 12 12 12.01 83.03% Castro::subcycle_advance_ctu() 1 11.95 11.95 11.96 82.68% Castro::do_advance_ctu() 20 11.9 11.92 11.92 82.42% Castro::construct_ctu_hydro_source() 20 6.422 6.459 6.498 44.94% Castro::clean_state() 79 3.721 3.843 4.066 28.12% Castro::computeTemp() 80 2.406 2.534 2.781 19.23% Castro::reset_internal_energy(MultiFab) 80 1.509 1.563 1.711 11.83% Gravity::solve_phi_with_mlmg() 19 1.528 1.588 1.632 11.29% Castro::construct_new_gravity() 17 1.456 1.514 1.558 10.78% Gravity::solve_for_phi() 17 1.417 1.476 1.521 10.52% Castro::initialize_do_advance() 20 1.4 1.429 1.456 10.07% Amr::InitAmr() 1 1.447 1.448 1.448 10.01% Gravity::actual_solve_with_mlmg() 19 1.329 1.333 1.337 9.25% MLMG::solve() 18 1.278 1.282 1.283 8.87% Castro::do_old_sources() 20 1.204 1.219 1.245 8.61% MLMG::oneIter() 128 1.139 1.141 1.143 7.90% MLMG::mgVcycle() 128 1.124 1.126 1.128 7.80% Castro::do_new_sources() 17 0.9479 0.9943 1.039 7.19% FabArray::ParallelCopy() 1429 0.2815 0.7808 1.009 6.98% Castro::evaluate_source_change() 196 0.9561 0.9647 1.002 6.93% Amr::init() 1 0.8899 0.8901 0.8901 6.16% Castro::enforce_min_density() 79 0.7937 0.815 0.8693 6.01% Amr::initialInit() 1 0.8292 0.8294 0.8295 5.74% amrex::Copy() 795 0.7843 0.7899 0.7987 5.52% FabArray::ParallelCopy_finish() 1429 0.05203 0.5527 0.7833 5.42% MLCellLinOp::smooth() 3072 0.5629 0.6138 0.7478 5.17% AmrLevel::FillPatch() 147 0.4804 0.619 0.7033 4.86% Amr::InitializeInit() 1 0.446 0.5165 0.6025 4.17% Amr::defBaseLevel() 1 0.446 0.5164 0.6025 4.17% MultiFab::AddProduct() 3439 0.5559 0.5609 0.583 4.03% Castro::normalize_species() 79 0.548 0.5526 0.5663 3.92% Castro::reset_internal_energy(Fab) 160 0.5304 0.5347 0.5459 3.78% FillPatchIterator::Initialize 147 0.2991 0.4394 0.5234 3.62% FillPatchIterator::FillFromLevel0() 147 0.2734 0.4203 0.5061 3.50% FillPatchSingleLevel 147 0.2726 0.4195 0.5053 3.49% MLMG::mgVcycle_up::1 128 0.09622 0.2667 0.4394 3.04% MLPoisson::Fsmooth() 6144 0.3144 0.342 0.4325 2.99% Castro::Castro() 1 0.3645 0.3816 0.418 2.89% Castro::initMFs() 1 0.3594 0.3763 0.4121 2.85% MLMG::addInterpCorrection() 768 0.06381 0.3183 0.3902 2.70% Amr::FinalizeInit() 1 0.227 0.313 0.3834 2.65% MLCellLinOp::applyBC() 7156 0.2879 0.3204 0.3792 2.62% FabArray::setVal() 5021 0.3509 0.3547 0.3762 2.60% MultiFab::Subtract() 159 0.3436 0.3467 0.3532 2.44% Gravity::fill_multipole_BCs() 19 0.1966 0.2536 0.2936 2.03% MLMG::mgVcycle_up::2 128 0.01119 0.1222 0.2924 2.02% FabArray::FillBoundary() 6388 0.2344 0.2579 0.2851 1.97% MLMG::mgVcycle_down::0 128 0.2655 0.2674 0.272 1.88% FabArray::ParallelCopy_nowait() 1429 0.2134 0.2241 0.2402 1.66% Castro::initData() 1 0.07793 0.1328 0.2317 1.60% Castro::expand_state() 20 0.1776 0.2002 0.2208 1.53% check_for_negative_density() 20 0.1146 0.174 0.218 1.51% Amr::bldFineLevels() 1 0.0464 0.1319 0.2027 1.40% MLMG::mgVcycle_up::0 128 0.1986 0.2 0.2013 1.39% MLCellLinOp::apply() 994 0.1532 0.1628 0.1969 1.36% FabArray::sum() 3439 0.1872 0.189 0.1963 1.36% MLMG::mgVcycle_up::3 128 0.01111 0.025 0.194 1.34% Amr::grid_places() 2 0.002145 0.08813 0.1586 1.10% AmrMesh::MakeNewGrids() 2 0.002046 0.08803 0.1585 1.10% TagBoxArray::mapPRD 2 0.000633 0.08589 0.1567 1.08% MLCellLinOp::correctionResidual() 776 0.1145 0.1244 0.149 1.03% FillBoundary_finish() 6388 0.1076 0.1324 0.1473 1.02% MLMG:computeResOfCorrection() 768 0.116 0.1257 0.1462 1.01% FillBoundary_nowait() 6388 0.08565 0.1105 0.1396 0.97% Castro::post_init() 1 0.1338 0.1373 0.1385 0.96% Castro::construct_new_source() 102 0.1261 0.1283 0.1342 0.93% MLMG::mgVcycle_down::1 128 0.1204 0.1249 0.1295 0.90% MLPoisson::Fapply() 994 0.09561 0.1011 0.1158 0.80% Castro::construct_old_gravity() 20 0.04896 0.08422 0.1118 0.77% Amr::writePlotFile() 2 0.1025 0.1026 0.1027 0.71% Castro::create_source_corrector() 17 0.04738 0.0791 0.1018 0.70% Gravity::multilevel_solve_for_new_phi() 1 0.1012 0.1013 0.1013 0.70% Gravity::actual_multilevel_solve() 1 0.1011 0.1012 0.1012 0.70% MLCellLinOp::solutionResidual() 147 0.08673 0.09362 0.0994 0.69% Castro::post_regrid() 2 0.0863 0.0875 0.09101 0.63% Gravity::get_old_grav_vector() 20 0.04068 0.07306 0.09021 0.62% MLMG::mgVcycle_bottom 128 0.0003812 0.005781 0.0866 0.60% MLMG::actualBottomSolve() 128 0.0001371 0.00553 0.08633 0.60% MLCGSolver::bicgstab 8 0 0.005289 0.08462 0.59% Castro::construct_old_source() 120 0.07744 0.07844 0.08248 0.57% MLMG::computeResidual() 128 0.0758 0.07833 0.08226 0.57% Castro::construct_new_gravity_source() 17 0.0706 0.07228 0.07642 0.53% FabArray::Saxpy() 192 0.07108 0.07211 0.07629 0.53% Castro::derive() 18 0.06953 0.07067 0.07412 0.51% AmrLevel::derive() 18 0.06948 0.07063 0.07407 0.51% MLMG::mgVcycle_down::2 128 0.01305 0.04137 0.07301 0.50% Castro::post_timestep() 1 0.05795 0.06002 0.06244 0.43% FabArray::Xpay() 953 0.05177 0.05436 0.06197 0.43% MLMG::mgVcycle_down::3 128 0.0124 0.01878 0.06172 0.43% amrex::average_down 768 0.0338 0.04046 0.05681 0.39% Castro::initialize_advance() 1 0.05002 0.05113 0.05527 0.38% Castro::check_for_nan() 37 0.04614 0.04663 0.04753 0.33% MultiFab::contains_nan() 37 0.04603 0.04651 0.04742 0.33% Castro::construct_old_gravity_source() 20 0.04409 0.04479 0.04739 0.33% Castro::retry_advance_ctu() 11 0.03545 0.03682 0.04584 0.32% Amr::regrid() 1 0.04434 0.04472 0.04523 0.31% MLPoisson::define() 19 0.02946 0.03383 0.03933 0.27% Gravity::get_new_grav_vector() 18 0.03605 0.03707 0.03823 0.26% MLMG::mgVcycle_down::4 128 0.01239 0.0141 0.03563 0.25% StateDataPhysBCFunct::() 147 0.0006949 0.01856 0.03502 0.24% StateData::FillBoundary(geom) 143 0 0.01772 0.0341 0.24% Castro::apply_source_to_state() 37 0.02897 0.02937 0.03017 0.21% MLMG::mgVcycle_up::4 128 0.01125 0.01248 0.02794 0.19% VisMF::Write(FabArray) 4 0.01598 0.01749 0.02669 0.18% MLMG::ResNormInf() 146 0.01791 0.02176 0.02465 0.17% MLCellLinOp::defineAuxData() 19 0.01952 0.02083 0.02465 0.17% MLMG::mgVcycle_down::5 128 0.01241 0.01334 0.02425 0.17% MLMG::prepareForSolve() 18 0.02091 0.02176 0.02402 0.17% Castro::sum_integrated_quantities() 2 0.02078 0.02114 0.02117 0.15% MLMG::mgVcycle_up::5 128 0.01132 0.01209 0.02054 0.14% Castro::save_data_for_retry() 3 0.01882 0.01924 0.02016 0.14% MLMG::computeMLResidual() 18 0.01064 0.01484 0.01865 0.13% FabArray::norminf() 244 0.01066 0.01139 0.01557 0.11% FabArrayBase::getFB() 6388 0.01059 0.01141 0.01494 0.10% amrex::Add() 136 0.01426 0.01442 0.01492 0.10% Amr::writeSmallPlotFile() 2 0.0147 0.01471 0.01471 0.10% FabArrayBase::getCPC() 2005 0.009746 0.01104 0.01449 0.10% Gravity::test_composite_phi() 1 0.01415 0.01419 0.01421 0.10% Castro::problem_post_timestep() 2 0.009175 0.01118 0.01371 0.09% Castro::wd_update() 2 0.008869 0.01113 0.0137 0.09% FabArray::setDomainBndry() 147 0.0004595 0.006254 0.01302 0.09% MLLinOp::define() 19 0.003696 0.006925 0.01098 0.08% MLLinOp::defineGrids() 19 0.003612 0.006839 0.0109 0.08% MLCGSolver::ParallelAllReduce 189 0 0.0005102 0.008164 0.06% MLMG::getGradSolution() 18 0.007553 0.007793 0.008097 0.06% MLCellLinOp::compGrad() 18 0.007509 0.00775 0.008053 0.06% MLLinOp::makeSubCommunicator() 19 0.0007939 0.003882 0.007758 0.05% FabArray::mult() 59 0.007339 0.00744 0.007634 0.05% Castro::volWgtSum() 46 0.007141 0.007203 0.007372 0.05% FabArrayBase::CPC::define() 576 0.002268 0.003444 0.00664 0.05% amrex::Dot() 142 0 0.0003943 0.006309 0.04% MLCellLinOp::defineBC() 19 0.005744 0.005936 0.006263 0.04% Gravity::update_max_rhs() 2 0.001469 0.005008 0.006217 0.04% Castro::volInBoundary() 14 0.003373 0.003618 0.005382 0.04% MultiFab::max() 2 0.0001502 0.003753 0.004974 0.03% TagBoxArray::collate() 2 8.753e-05 0.0008782 0.004648 0.03% BndryData::define() 19 0.004117 0.004297 0.004575 0.03% FabArray::LinComb() 71 0 0.0002381 0.003809 0.03% MLPoisson::normalize() 79 0 0.0002032 0.003251 0.02% MLPoisson::prepareForSolve() 19 0.001821 0.001952 0.002284 0.02% MLCellLinOp::prepareForSolve() 19 0.001728 0.001868 0.002202 0.02% AmrLevel::AmrLevel(dm) 1 0.001287 0.001568 0.002061 0.01% StateData::define() 6 0.001254 0.001529 0.002007 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.00136 0.001606 0.00185 0.01% MLMG::MLResNormInf() 18 0.001224 0.001272 0.001721 0.01% MLMG::MLRhsNormInf() 18 0.001179 0.001228 0.001664 0.01% FabArrayBase::FB::FB() 75 0.0002837 0.0006949 0.001483 0.01% Gravity::swapTimeLevels() 8 0.001166 0.001242 0.001311 0.01% MLMG::compResidual() 1 0.0009612 0.001118 0.001292 0.01% Castro::locWgtSum() 6 0.001115 0.00112 0.001148 0.01% Castro::buildMetrics() 1 0.0006272 0.0007531 0.001097 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009589 0.001009 0.001078 0.01% MLCellLinOp::setLevelBC() 19 0.0005485 0.0006959 0.0008954 0.01% Castro::swap_state_time_levels() 8 0.0006473 0.0006854 0.0007299 0.01% makeSFC 95 0.0006169 0.0006505 0.000711 0.00% Castro::errorEst() 2 0.0005282 0.0005853 0.0006853 0.00% Castro::apply_tagging_restrictions() 2 0.0004278 0.0004843 0.0005673 0.00% Gravity::applyMetricTerms() 2 0.0004683 0.0004851 0.0005121 0.00% Castro::enforce_consistent_e() 1 0.0003617 0.0003819 0.0004184 0.00% Castro::volProductSum() 2 0.0003842 0.0003865 0.0003932 0.00% DistributionMapping::KnapSackDoIt() 1 0.000129 0.0003001 0.0003607 0.00% Castro::finalize_advance() 1 0.0002665 0.0002708 0.0002817 0.00% DistributionMapping::LeastUsedCPUs() 1 2.236e-05 0.0002128 0.0002793 0.00% DistributionMapping::Distribute() 95 0.0002166 0.000226 0.0002397 0.00% Castro::finalize_do_advance() 17 0.0001844 0.0002027 0.0002253 0.00% OwnerMask() 2 0.0001383 0.0001558 0.0001777 0.00% Castro::enforce_speed_limit() 79 0.0001089 0.0001164 0.0001296 0.00% Amr::initSubcycle() 1 6.133e-05 7.237e-05 0.0001189 0.00% Castro::apply_problem_tags() 2 9.123e-05 9.409e-05 0.0001098 0.00% MultiFab::Swap() 5 7.307e-05 7.712e-05 9.357e-05 0.00% knapsack() 1 6.029e-05 6.742e-05 8.657e-05 0.00% Castro::construct_old_rotation_source() 20 3.078e-05 3.15e-05 3.298e-05 0.00% Castro::construct_new_rotation_source() 17 2.191e-05 2.305e-05 2.484e-05 0.00% Gravity::set_mass_offset() 2 4.631e-06 1.084e-05 2.314e-05 0.00% Castro::computeInitialDt() 2 1.124e-05 1.363e-05 1.924e-05 0.00% BoxList::parallelComplementIn() 4 1.338e-05 1.4e-05 1.776e-05 0.00% Castro::estTimeStep() 10 1.292e-05 1.423e-05 1.613e-05 0.00% BoxList::complementIn 4 6.175e-06 6.478e-06 7.973e-06 0.00% Castro::gwstrain() 2 4.337e-06 4.883e-06 6.85e-06 0.00% Castro::FluxRegCrseInit 1 1.727e-06 2.116e-06 2.714e-06 0.00% Castro::FluxRegFineAdd() 1 1.449e-06 1.611e-06 1.808e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 10 B 14 B 20 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-8-gfd2dfa282a30) finalized