Initializing AMReX (v2024-42-g7437aa17d36f)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (v2024-42-g7437aa17d36f) initialized Starting run at 19:10:45 UTC on 2024-03-28. Successfully read inputs file ... Castro git describe: 24.03-37-g6b90dd1c0 AMReX git describe: v2024-42-g7437aa17d Microphysics git describe: 24.03-23-g3112c13a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.157457487 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001063736 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.012562219 Gravity::multilevel_solve_for_new_phi() time = 0.101588797 Gravity::fill_multipole_BCs() time = 0.012487272 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.055343566 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.007539533 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002760016 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065144432 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.008454317 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.064235545 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003244202 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060812379 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006699686 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060411034 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323224321 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016190652 Gravity::solve_for_phi() time = 0.085756633 on level 0 Castro::construct_new_gravity() time = 0.087964842 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.059287012 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.0026928 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058479417 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321272769 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016399989 Gravity::solve_for_phi() time = 0.08622016 on level 0 Castro::construct_new_gravity() time = 0.088435826 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.059320542 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002641299 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058575121 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32195869 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015947292 Gravity::solve_for_phi() time = 0.085506817 on level 0 Castro::construct_new_gravity() time = 0.08779955 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.058799889 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003276273 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058105136 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324841583 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016508018 Gravity::solve_for_phi() time = 0.085708664 on level 0 Castro::construct_new_gravity() time = 0.087867061 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.059045575 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002856059 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058561278 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329318696 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016605907 Gravity::solve_for_phi() time = 0.085908935 on level 0 Castro::construct_new_gravity() time = 0.088050852 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.0589727 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002597503 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058462042 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323220209 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016570535 Gravity::solve_for_phi() time = 0.085808031 on level 0 Castro::construct_new_gravity() time = 0.087975263 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.059045399 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002700033 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058407431 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329317737 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016959907 Gravity::solve_for_phi() time = 0.085955292 on level 0 Castro::construct_new_gravity() time = 0.088191607 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059357189 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002865983 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058861667 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324544564 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016920625 Gravity::solve_for_phi() time = 0.086127804 on level 0 Castro::construct_new_gravity() time = 0.08832635 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.05917047 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.006830408 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058693126 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337014839 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016809835 Gravity::solve_for_phi() time = 0.08861808 on level 0 Castro::construct_new_gravity() time = 0.090802748 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.060336006 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002914602 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.060213919 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334516147 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017087852 Gravity::solve_for_phi() time = 0.088784223 on level 0 Castro::construct_new_gravity() time = 0.091586831 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.060387787 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002741938 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.060440477 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335930465 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016995564 Gravity::solve_for_phi() time = 0.087186207 on level 0 Castro::construct_new_gravity() time = 0.090180176 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.061700099 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002816051 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.061160467 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336845603 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017015944 Gravity::solve_for_phi() time = 0.090624678 on level 0 Castro::construct_new_gravity() time = 0.092795562 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.061014098 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.00262093 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060278272 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.341356692 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017174856 Gravity::solve_for_phi() time = 0.091567411 on level 0 Castro::construct_new_gravity() time = 0.093738289 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.062709413 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003879072 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.061781514 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.342732876 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017317533 Gravity::solve_for_phi() time = 0.090402518 on level 0 Castro::construct_new_gravity() time = 0.092567062 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059803908 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002587886 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059696406 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.350340693 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017279578 Gravity::solve_for_phi() time = 0.089641367 on level 0 Castro::construct_new_gravity() time = 0.091796548 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.061563221 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.003236308 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059912615 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328513117 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017406997 Gravity::solve_for_phi() time = 0.08632241 on level 0 Castro::construct_new_gravity() time = 0.088977282 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059015124 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002899524 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.057927138 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333138495 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017639226 Gravity::solve_for_phi() time = 0.087925908 on level 0 Castro::construct_new_gravity() time = 0.090089882 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059039687 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002761393274 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.92471312 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.048489061 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.00558978 seconds Ending run at 19:10:59 UTC on 2024-03-28. Run time = 14.24284148 Run time without initialization = 11.97976762 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.24 ... 14.24 ... 14.24 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3814 5.4403 5.5386 38.89% Amr::InitAmr() 1 1.369 1.369 1.369 9.61% Castro::computeTemp() 80 0.8309 0.9392 1.098 7.71% amrex::Copy() 724 0.7929 0.7994 0.8205 5.76% FabArray::ParallelCopy_finish() 1429 0.06944 0.533 0.7579 5.32% Castro::normalize_species() 79 0.5456 0.5515 0.5758 4.04% MultiFab::AddProduct() 3439 0.5491 0.5535 0.5646 3.96% Castro::reset_internal_energy(Fab) 160 0.5123 0.5162 0.533 3.74% MLPoisson::Fsmooth() 6144 0.3106 0.3367 0.4045 2.84% Castro::initMFs() 1 0.3595 0.3631 0.3669 2.58% FabArray::setVal() 5013 0.3471 0.3519 0.3584 2.52% MultiFab::Subtract() 159 0.3489 0.3512 0.3572 2.51% Gravity::fill_multipole_BCs() 19 0.222 0.2678 0.3091 2.17% check_for_negative_density() 20 0.07217 0.1969 0.2654 1.86% Castro::reset_internal_energy(MultiFab) 80 0.02265 0.07004 0.2406 1.69% FabArray::ParallelCopy_nowait() 1429 0.1899 0.2028 0.2224 1.56% FabArray::sum() 3439 0.1839 0.1853 0.1888 1.33% FillBoundary_finish() 6380 0.1018 0.1249 0.1575 1.11% Castro::initData() 1 0.003283 0.0257 0.1513 1.06% FillBoundary_nowait() 6380 0.07773 0.1026 0.1305 0.92% MLPoisson::Fapply() 986 0.09504 0.09933 0.1136 0.80% MLCellLinOp::applyBC() 7148 0.04702 0.06232 0.1031 0.72% FabArray::Saxpy() 264 0.07121 0.07222 0.07873 0.55% Castro::do_new_sources() 17 0.0003842 0.01326 0.07564 0.53% Castro::enforce_min_density() 79 0.0178 0.03411 0.07176 0.50% Castro::construct_new_gravity_source() 17 0.06855 0.06924 0.06996 0.49% FabArray::Xpay() 945 0.05175 0.05396 0.06093 0.43% MultiFab::contains_nan() 37 0.04475 0.04506 0.04675 0.33% Castro::construct_old_gravity_source() 20 0.04546 0.04573 0.04663 0.33% AmrLevel::derive() 18 0.0401 0.0408 0.04419 0.31% Castro::do_old_sources() 20 0.0005184 0.009824 0.04169 0.29% MLMG::addInterpCorrection() 768 0.03203 0.03422 0.04057 0.28% StateData::FillBoundary(geom) 143 0 0.01705 0.03311 0.23% amrex::average_down 768 0.025 0.027 0.03243 0.23% VisMF::Write(FabArray) 4 0.01426 0.01563 0.03174 0.22% Amr::writePlotFile() 2 0.009316 0.02238 0.02444 0.17% MLCellLinOp::defineAuxData() 19 0.01426 0.01511 0.01734 0.12% FabArray::FillBoundary() 6380 0.01346 0.0139 0.01647 0.12% Castro::construct_new_source() 102 0.01566 0.01584 0.01619 0.11% MLCGSolver::bicgstab 8 0 0.000989 0.01582 0.11% FabArray::norminf() 282 0.01058 0.01097 0.01498 0.11% amrex::Add() 128 0.01408 0.01418 0.01474 0.10% Castro::evaluate_source_change() 196 0.01234 0.01257 0.0134 0.09% FillPatchIterator::Initialize 147 0.01249 0.01288 0.01335 0.09% FabArrayBase::getFB() 6380 0.009771 0.01025 0.01257 0.09% MLCellLinOp::smooth() 3072 0.01087 0.01131 0.01238 0.09% FabArray::setDomainBndry() 147 0.0004441 0.006216 0.01189 0.08% Castro::wd_update() 2 0.004417 0.007884 0.01065 0.07% MLMG::prepareForSolve() 18 0.009788 0.01006 0.01062 0.07% Castro::construct_old_source() 120 0.01003 0.01008 0.01017 0.07% TagBoxArray::collate() 2 0.0001701 0.001543 0.009654 0.07% Amr::writeSmallPlotFile() 2 0.006894 0.008806 0.009317 0.07% MLMG::ResNormInf() 146 0.0043 0.007313 0.00915 0.06% Castro::construct_old_gravity() 20 0.0004084 0.002985 0.00908 0.06% MLLinOp::makeSubCommunicator() 19 0.001233 0.004549 0.008202 0.06% FabArrayBase::getCPC() 2005 0.007244 0.007518 0.008085 0.06% Castro::volWgtSum() 46 0.00744 0.007533 0.008043 0.06% FabArray::mult() 59 0.007522 0.007628 0.007872 0.06% Gravity::actual_solve_with_mlmg() 19 0.006674 0.006983 0.007805 0.05% MLCellLinOp::compGrad() 18 0.005735 0.005941 0.006865 0.05% Gravity::get_old_grav_vector() 20 0.006455 0.006529 0.006639 0.05% Gravity::get_new_grav_vector() 18 0.005928 0.006131 0.006637 0.05% FabArrayBase::CPC::define() 576 0.002254 0.003345 0.006381 0.04% MLMG::solve() 18 0.0008977 0.003083 0.006212 0.04% amrex::Dot() 142 0 0.0003763 0.006021 0.04% Castro::initialize_do_advance() 20 0.004955 0.005365 0.005652 0.04% Castro::volInBoundary() 14 0.003388 0.003667 0.005401 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003052 0.004883 0.03% MLCellLinOp::apply() 986 0.001981 0.002199 0.00465 0.03% Castro::sum_integrated_quantities() 2 0.001773 0.004197 0.004542 0.03% FabArray::ParallelCopy() 1429 0.003547 0.003675 0.003898 0.03% AmrLevel::FillPatch() 147 0.002147 0.002302 0.003336 0.02% BndryData::define() 19 0.003059 0.003114 0.003304 0.02% Gravity::solve_for_phi() 17 0.0008147 0.001323 0.003299 0.02% MultiFab::max() 2 0.000241 0.001545 0.003259 0.02% MLPoisson::normalize() 79 0 0.0001981 0.003169 0.02% Castro::construct_new_gravity() 17 0.0002991 0.0007374 0.002469 0.02% MLLinOp::defineGrids() 19 0.00178 0.002015 0.002341 0.02% MLCellLinOp::prepareForSolve() 19 0.001633 0.001755 0.00204 0.01% MLCellLinOp::correctionResidual() 768 0.001831 0.001888 0.001974 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001341 0.001565 0.001856 0.01% MLMG::mgVcycle() 128 0.001533 0.001603 0.001764 0.01% MLCellLinOp::defineBC() 19 0.001463 0.001517 0.001661 0.01% StateData::define() 6 0.001347 0.001499 0.001631 0.01% MLMG:computeResOfCorrection() 768 0.001382 0.001434 0.001536 0.01% FabArrayBase::FB::FB() 75 0.0002836 0.0006747 0.001441 0.01% main() 1 0.0009726 0.001223 0.001405 0.01% Castro::save_data_for_retry() 3 0.001274 0.001329 0.00138 0.01% Castro::locWgtSum() 6 0.001112 0.001143 0.001262 0.01% MLMG::actualBottomSolve() 128 0.0001321 0.0001971 0.001064 0.01% StateDataPhysBCFunct::() 147 0.0006853 0.0008167 0.0009804 0.01% MLCellLinOp::setLevelBC() 19 0.0005247 0.0006545 0.0008618 0.01% Castro::subcycle_advance_ctu() 1 0.0002 0.0002751 0.0008449 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006987 0.00073 0.0007844 0.01% MLMG::mgVcycle_down::2 128 0.0006117 0.0006624 0.0007255 0.01% Castro::swap_state_time_levels() 8 0.0006081 0.0006622 0.0007143 0.01% MLMG::mgVcycle_down::3 128 0.0005724 0.0006158 0.0007099 0.00% MLMG::mgVcycle_down::1 128 0.000648 0.0006598 0.0007094 0.00% MLMG::mgVcycle_down::0 128 0.0006501 0.0006664 0.0007086 0.00% Castro::buildMetrics() 1 0.0006013 0.0006242 0.0007022 0.00% MLMG::mgVcycle_down::4 128 0.0005564 0.0005781 0.0006779 0.00% MLMG::mgVcycle_down::5 128 0.0005792 0.0005961 0.000664 0.00% Castro::Castro() 1 0.0004595 0.0005562 0.0006103 0.00% Castro::do_advance_ctu() 20 0.000406 0.0004507 0.0005706 0.00% Castro::clean_state() 79 0.000438 0.0004873 0.0005677 0.00% Castro::apply_tagging_restrictions() 2 0.0004136 0.00048 0.0005373 0.00% Gravity::applyMetricTerms() 2 0.0004773 0.0004839 0.0005301 0.00% AmrMesh::MakeNewGrids() 2 0.0004844 0.0005072 0.0005242 0.00% FillPatchSingleLevel 147 0.0004694 0.0004856 0.0005177 0.00% MLMG::mgVcycle_up::0 128 0.0004573 0.0004758 0.0005161 0.00% MLMG::mgVcycle_up::1 128 0.0004421 0.0004665 0.0004916 0.00% makeSFC 95 0.000364 0.000411 0.0004806 0.00% MLMG::mgVcycle_up::5 128 0.0003949 0.0004072 0.0004722 0.00% MLCellLinOp::solutionResidual() 147 0.00043 0.0004456 0.0004663 0.00% MLMG::mgVcycle_up::2 128 0.0003801 0.0004184 0.0004652 0.00% MLMG::mgVcycle_up::3 128 0.000377 0.0003909 0.0004457 0.00% Castro::volProductSum() 2 0.0003988 0.0004062 0.0004419 0.00% MLMG::mgVcycle_up::4 128 0.000381 0.0003917 0.0004418 0.00% Castro::problem_post_timestep() 2 1.148e-05 4.233e-05 0.0004371 0.00% MLMG::oneIter() 128 0.0003787 0.0003944 0.0004294 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003291 0.0003539 0.0004209 0.00% Castro::enforce_consistent_e() 1 0.0003647 0.0003768 0.00039 0.00% DistributionMapping::Distribute() 95 0.0002098 0.0002273 0.0002653 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002138 0.0002329 0.000261 0.00% MLMG::computeResidual() 128 0.0002363 0.0002421 0.0002567 0.00% MLMG::mgVcycle_bottom 128 0.0002283 0.0002351 0.0002461 0.00% Castro::finalize_do_advance() 17 0.0001629 0.0001854 0.0002194 0.00% Gravity::update_max_rhs() 2 0.0001579 0.0001691 0.0001845 0.00% Castro::initialize_advance() 1 0.0001372 0.0001538 0.0001748 0.00% MLMG::compResidual() 1 0.0001546 0.0001596 0.0001706 0.00% Amr::coarseTimeStep() 1 0.0001265 0.0001584 0.0001672 0.00% OwnerMask() 2 0.0001328 0.0001499 0.0001651 0.00% MLPoisson::define() 19 0.0001341 0.0001404 0.0001531 0.00% Amr::defBaseLevel() 1 0.000106 0.0001215 0.0001451 0.00% Castro::retry_advance_ctu() 11 5.357e-05 6.946e-05 0.0001409 0.00% Castro::check_for_nan() 37 0.0001028 0.0001156 0.0001397 0.00% Castro::enforce_speed_limit() 79 0.0001116 0.0001178 0.0001371 0.00% Castro::apply_source_to_state() 37 9.668e-05 0.0001057 0.00013 0.00% Amr::grid_places() 2 7.822e-05 9.463e-05 0.0001251 0.00% TagBoxArray::mapPRD 2 0.0001093 0.0001144 0.0001207 0.00% Gravity::test_composite_phi() 1 9.107e-05 9.812e-05 0.000117 0.00% DistributionMapping::LeastUsedCPUs() 1 4.473e-05 9.91e-05 0.0001159 0.00% Castro::apply_problem_tags() 2 9.213e-05 9.498e-05 0.0001007 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.036e-05 7.031e-05 0.0001006 0.00% Castro::create_source_corrector() 17 5.557e-05 6.718e-05 9.785e-05 0.00% MLLinOp::define() 19 7.712e-05 8.575e-05 9.58e-05 0.00% MLPoisson::prepareForSolve() 19 7.396e-05 8.106e-05 9.361e-05 0.00% MultiFab::Swap() 5 6.521e-05 6.933e-05 8.64e-05 0.00% knapsack() 1 5.776e-05 6.257e-05 7.734e-05 0.00% Castro::expand_state() 20 5.455e-05 6.085e-05 7.051e-05 0.00% Amr::initSubcycle() 1 5.647e-05 6.071e-05 6.443e-05 0.00% Castro::derive() 18 4.262e-05 4.613e-05 6.173e-05 0.00% Amr::FinalizeInit() 1 9.107e-06 1.789e-05 5.378e-05 0.00% MLMG::computeMLResidual() 18 4.005e-05 4.446e-05 4.884e-05 0.00% Gravity::swapTimeLevels() 8 3.233e-05 4.048e-05 4.792e-05 0.00% MLMG::getGradSolution() 18 3.899e-05 4.136e-05 4.791e-05 0.00% MLMG::MLRhsNormInf() 18 3.079e-05 3.366e-05 4.277e-05 0.00% MLMG::MLResNormInf() 18 3.315e-05 3.539e-05 3.867e-05 0.00% AmrLevel::AmrLevel(dm) 1 2.976e-05 3.249e-05 3.805e-05 0.00% Castro::construct_old_rotation_source() 20 2.974e-05 3.05e-05 3.254e-05 0.00% Gravity::actual_multilevel_solve() 1 2.658e-05 2.88e-05 3.195e-05 0.00% Amr::regrid() 1 1.039e-05 1.278e-05 3.083e-05 0.00% Amr::timeStep() 1 1.3e-05 1.624e-05 3.003e-05 0.00% Castro::finalize_advance() 1 1.679e-05 2.003e-05 2.62e-05 0.00% Castro::advance() 1 7.051e-06 1.285e-05 2.512e-05 0.00% Castro::estTimeStep() 10 1.22e-05 1.384e-05 2.397e-05 0.00% Castro::construct_new_rotation_source() 17 2.09e-05 2.157e-05 2.222e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.717e-05 1.945e-05 2.174e-05 0.00% Amr::init() 1 6.204e-06 9.819e-06 2.11e-05 0.00% Amr::InitializeInit() 1 7.314e-06 1.266e-05 2.057e-05 0.00% Castro::post_regrid() 2 1.062e-05 1.256e-05 1.624e-05 0.00% Castro::post_init() 1 1.174e-05 1.285e-05 1.394e-05 0.00% BoxList::parallelComplementIn() 4 6.975e-06 7.847e-06 1.177e-05 0.00% Amr::bldFineLevels() 1 6.877e-06 9.004e-06 1.119e-05 0.00% Castro::computeInitialDt() 2 7.029e-06 8.075e-06 1.1e-05 0.00% BoxList::complementIn 4 5.83e-06 6.513e-06 1.03e-05 0.00% Amr::initialInit() 1 2.891e-06 3.783e-06 9.713e-06 0.00% Castro::gwstrain() 2 4.582e-06 5.24e-06 9.617e-06 0.00% Gravity::set_mass_offset() 2 4.581e-06 5.904e-06 8.18e-06 0.00% Castro::post_timestep() 1 5.527e-06 6.121e-06 7.365e-06 0.00% Castro::errorEst() 2 5.88e-06 6.255e-06 6.873e-06 0.00% Castro::FluxRegCrseInit 1 1.612e-06 2.05e-06 2.6e-06 0.00% Castro::FluxRegFineAdd() 1 1.407e-06 1.604e-06 1.988e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.24 14.24 14.24 100.00% Amr::coarseTimeStep() 1 11.98 11.98 11.98 84.11% Amr::timeStep() 1 11.92 11.92 11.92 83.72% Castro::advance() 1 11.86 11.86 11.87 83.31% Castro::subcycle_advance_ctu() 1 11.81 11.81 11.82 82.96% Castro::do_advance_ctu() 20 11.77 11.77 11.78 82.69% Castro::construct_ctu_hydro_source() 20 6.381 6.412 6.448 45.27% Castro::clean_state() 79 3.677 3.794 3.968 27.86% Castro::computeTemp() 80 2.365 2.485 2.722 19.11% Castro::reset_internal_energy(MultiFab) 80 1.488 1.546 1.706 11.98% Gravity::solve_phi_with_mlmg() 19 1.508 1.556 1.602 11.25% Castro::construct_new_gravity() 17 1.435 1.482 1.527 10.72% Castro::initialize_do_advance() 20 1.413 1.452 1.495 10.49% Gravity::solve_for_phi() 17 1.396 1.443 1.488 10.45% Amr::InitAmr() 1 1.369 1.369 1.369 9.61% Gravity::actual_solve_with_mlmg() 19 1.281 1.285 1.289 9.05% MLMG::solve() 18 1.23 1.235 1.237 8.68% Castro::do_old_sources() 20 1.153 1.179 1.194 8.38% MLMG::oneIter() 128 1.098 1.1 1.103 7.74% MLMG::mgVcycle() 128 1.084 1.086 1.088 7.64% Castro::do_new_sources() 17 0.9348 0.977 1.018 7.15% FabArray::ParallelCopy() 1429 0.2961 0.7594 0.9806 6.88% Castro::evaluate_source_change() 196 0.9411 0.9488 0.9677 6.79% Amr::init() 1 0.893 0.8931 0.8931 6.27% Castro::enforce_min_density() 79 0.7916 0.8133 0.8458 5.94% Amr::initialInit() 1 0.8293 0.8294 0.8295 5.82% amrex::Copy() 724 0.7929 0.7994 0.8205 5.76% FabArray::ParallelCopy_finish() 1429 0.06944 0.533 0.7579 5.32% MLCellLinOp::smooth() 3072 0.5514 0.6021 0.7264 5.10% AmrLevel::FillPatch() 147 0.4926 0.6075 0.6966 4.89% Amr::InitializeInit() 1 0.4442 0.5014 0.6003 4.21% Amr::defBaseLevel() 1 0.4442 0.5014 0.6002 4.21% Castro::normalize_species() 79 0.5456 0.5515 0.5758 4.04% MultiFab::AddProduct() 3439 0.5491 0.5535 0.5646 3.96% Castro::reset_internal_energy(Fab) 160 0.5123 0.5162 0.533 3.74% FillPatchIterator::Initialize 147 0.3124 0.4258 0.5146 3.61% FillPatchIterator::FillFromLevel0() 147 0.2875 0.4067 0.4975 3.49% FillPatchSingleLevel 147 0.2868 0.406 0.4968 3.49% MLMG::mgVcycle_up::1 128 0.09798 0.2582 0.4196 2.95% MLPoisson::Fsmooth() 6144 0.3106 0.3367 0.4045 2.84% MLCellLinOp::applyBC() 7148 0.2807 0.3147 0.3894 2.73% Amr::FinalizeInit() 1 0.2292 0.328 0.3852 2.70% Castro::Castro() 1 0.3653 0.3693 0.3736 2.62% Castro::initMFs() 1 0.3596 0.3633 0.3671 2.58% MLMG::addInterpCorrection() 768 0.05993 0.295 0.364 2.56% FabArray::setVal() 5013 0.3471 0.3519 0.3584 2.52% MultiFab::Subtract() 159 0.3489 0.3512 0.3572 2.51% Gravity::fill_multipole_BCs() 19 0.2241 0.27 0.3112 2.18% FabArray::FillBoundary() 6380 0.2265 0.2524 0.2886 2.03% MLMG::mgVcycle_up::2 128 0.01055 0.1129 0.2688 1.89% MLMG::mgVcycle_down::0 128 0.2607 0.2634 0.2665 1.87% Castro::expand_state() 20 0.1849 0.2205 0.2662 1.87% check_for_negative_density() 20 0.07217 0.1969 0.2654 1.86% FabArray::ParallelCopy_nowait() 1429 0.2092 0.2227 0.2432 1.71% Castro::initData() 1 0.07711 0.1302 0.232 1.63% Amr::bldFineLevels() 1 0.04662 0.145 0.2014 1.41% MLMG::mgVcycle_up::0 128 0.1946 0.1959 0.1968 1.38% MLCellLinOp::apply() 986 0.1491 0.1603 0.1963 1.38% FabArray::sum() 3439 0.1839 0.1853 0.1888 1.33% MLMG::mgVcycle_up::3 128 0.01048 0.02294 0.1726 1.21% Amr::grid_places() 2 0.002455 0.1013 0.1585 1.11% AmrMesh::MakeNewGrids() 2 0.00233 0.1012 0.1585 1.11% FillBoundary_finish() 6380 0.1018 0.1249 0.1575 1.11% TagBoxArray::mapPRD 2 0.0007288 0.09843 0.1569 1.10% MLMG:computeResOfCorrection() 768 0.1132 0.1232 0.1474 1.03% MLCellLinOp::correctionResidual() 768 0.1118 0.1218 0.1459 1.02% FillBoundary_nowait() 6380 0.08796 0.1135 0.1419 1.00% Castro::post_init() 1 0.1385 0.1397 0.1414 0.99% Castro::construct_new_source() 102 0.1243 0.1252 0.1267 0.89% MLMG::mgVcycle_down::1 128 0.1145 0.1182 0.1232 0.86% Castro::create_source_corrector() 17 0.05073 0.08804 0.1206 0.85% MLPoisson::Fapply() 986 0.09504 0.09933 0.1136 0.80% Amr::writePlotFile() 2 0.1044 0.1045 0.1045 0.73% Gravity::multilevel_solve_for_new_phi() 1 0.1015 0.1016 0.1016 0.71% Gravity::actual_multilevel_solve() 1 0.1015 0.1015 0.1015 0.71% MLCellLinOp::solutionResidual() 147 0.0885 0.09328 0.09796 0.69% Castro::post_regrid() 2 0.08521 0.08692 0.08818 0.62% Castro::construct_old_source() 120 0.07899 0.07937 0.08018 0.56% FabArray::Saxpy() 264 0.07121 0.07222 0.07873 0.55% MLMG::computeResidual() 128 0.07683 0.07747 0.07811 0.55% Castro::derive() 18 0.06911 0.07031 0.07727 0.54% AmrLevel::derive() 18 0.06907 0.07027 0.07722 0.54% MLMG::mgVcycle_down::2 128 0.01239 0.04107 0.07311 0.51% MLMG::mgVcycle_bottom 128 0.0003613 0.00475 0.0704 0.49% MLMG::actualBottomSolve() 128 0.0001321 0.004515 0.07015 0.49% Castro::construct_new_gravity_source() 17 0.06855 0.06924 0.06996 0.49% MLCGSolver::bicgstab 8 0 0.00429 0.06864 0.48% Castro::construct_old_gravity() 20 0.04265 0.05583 0.06668 0.47% Gravity::get_old_grav_vector() 20 0.04219 0.05285 0.06627 0.47% Castro::post_timestep() 1 0.05818 0.06006 0.06234 0.44% FabArray::Xpay() 945 0.05175 0.05396 0.06093 0.43% MLMG::mgVcycle_down::3 128 0.01175 0.01787 0.05816 0.41% amrex::average_down 768 0.03333 0.03986 0.05577 0.39% Castro::initialize_advance() 1 0.04983 0.05078 0.05268 0.37% Castro::check_for_nan() 37 0.04487 0.04518 0.04688 0.33% MultiFab::contains_nan() 37 0.04475 0.04506 0.04675 0.33% Castro::construct_old_gravity_source() 20 0.04546 0.04573 0.04663 0.33% Amr::regrid() 1 0.04393 0.04469 0.0453 0.32% Castro::retry_advance_ctu() 11 0.0362 0.03768 0.04225 0.30% Gravity::get_new_grav_vector() 18 0.03656 0.03798 0.03951 0.28% MLPoisson::define() 19 0.02879 0.03345 0.03943 0.28% MLMG::mgVcycle_down::4 128 0.0117 0.0133 0.03403 0.24% StateDataPhysBCFunct::() 147 0.0006853 0.01786 0.03401 0.24% StateData::FillBoundary(geom) 143 0 0.01705 0.03311 0.23% VisMF::Write(FabArray) 4 0.01426 0.01563 0.03174 0.22% Castro::apply_source_to_state() 37 0.02895 0.02922 0.03066 0.22% MLMG::mgVcycle_up::4 128 0.01054 0.01169 0.02637 0.19% Castro::save_data_for_retry() 3 0.01921 0.0201 0.02489 0.17% MLCellLinOp::defineAuxData() 19 0.01832 0.01998 0.02417 0.17% Castro::sum_integrated_quantities() 2 0.02356 0.02388 0.0239 0.17% MLMG::prepareForSolve() 18 0.02002 0.02085 0.02306 0.16% MLMG::mgVcycle_down::5 128 0.0117 0.01251 0.02247 0.16% MLMG::computeMLResidual() 18 0.01079 0.01534 0.01958 0.14% MLMG::mgVcycle_up::5 128 0.01066 0.01133 0.01913 0.13% MLMG::ResNormInf() 146 0.01377 0.01666 0.01847 0.13% Gravity::test_composite_phi() 1 0.01594 0.01598 0.01601 0.11% FabArray::norminf() 282 0.01058 0.01097 0.01498 0.11% amrex::Add() 128 0.01408 0.01418 0.01474 0.10% FabArrayBase::getCPC() 2005 0.009577 0.01086 0.01418 0.10% Castro::problem_post_timestep() 2 0.009835 0.01159 0.01405 0.10% Castro::wd_update() 2 0.009602 0.01155 0.01403 0.10% FabArrayBase::getFB() 6380 0.0101 0.01093 0.01401 0.10% Amr::writeSmallPlotFile() 2 0.01357 0.01357 0.01358 0.10% FabArray::setDomainBndry() 147 0.0004441 0.006216 0.01189 0.08% MLLinOp::define() 19 0.0042 0.007642 0.01171 0.08% MLLinOp::defineGrids() 19 0.004114 0.007556 0.01162 0.08% TagBoxArray::collate() 2 0.0001701 0.001543 0.009654 0.07% MLMG::getGradSolution() 18 0.007461 0.007756 0.008775 0.06% MLCellLinOp::compGrad() 18 0.007422 0.007715 0.008734 0.06% MLLinOp::makeSubCommunicator() 19 0.001233 0.004549 0.008202 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005078 0.008124 0.06% Castro::volWgtSum() 46 0.00744 0.007533 0.008043 0.06% FabArray::mult() 59 0.007522 0.007628 0.007872 0.06% FabArrayBase::CPC::define() 576 0.002254 0.003345 0.006381 0.04% amrex::Dot() 142 0 0.0003763 0.006021 0.04% MLCellLinOp::defineBC() 19 0.005485 0.00569 0.005901 0.04% Castro::volInBoundary() 14 0.003388 0.003667 0.005401 0.04% Gravity::update_max_rhs() 2 0.00151 0.002798 0.004497 0.03% BndryData::define() 19 0.003979 0.004174 0.004349 0.03% MultiFab::max() 2 0.000241 0.001545 0.003259 0.02% MLPoisson::normalize() 79 0 0.0001981 0.003169 0.02% MLPoisson::prepareForSolve() 19 0.001718 0.001836 0.002122 0.01% MLCellLinOp::prepareForSolve() 19 0.001633 0.001755 0.00204 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001341 0.001565 0.001856 0.01% AmrLevel::AmrLevel(dm) 1 0.001384 0.001532 0.001662 0.01% StateData::define() 6 0.001347 0.001499 0.001631 0.01% FabArrayBase::FB::FB() 75 0.0002836 0.0006747 0.001441 0.01% Gravity::swapTimeLevels() 8 0.001151 0.001238 0.001408 0.01% Castro::locWgtSum() 6 0.001112 0.001143 0.001262 0.01% MLMG::compResidual() 1 0.0009787 0.001122 0.001253 0.01% MLMG::MLResNormInf() 18 0.001216 0.001234 0.001248 0.01% MLMG::MLRhsNormInf() 18 0.001172 0.001187 0.001202 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009096 0.0009921 0.001108 0.01% MLCellLinOp::setLevelBC() 19 0.0005247 0.0006545 0.0008618 0.01% Castro::buildMetrics() 1 0.0006623 0.0006859 0.0007733 0.01% makeSFC 95 0.0005792 0.0006383 0.0007213 0.01% Castro::swap_state_time_levels() 8 0.0006081 0.0006622 0.0007143 0.01% Castro::errorEst() 2 0.0005121 0.0005812 0.0006393 0.00% Castro::apply_tagging_restrictions() 2 0.0004136 0.00048 0.0005373 0.00% Gravity::applyMetricTerms() 2 0.0004773 0.0004839 0.0005301 0.00% Castro::volProductSum() 2 0.0003988 0.0004062 0.0004419 0.00% Castro::enforce_consistent_e() 1 0.0003647 0.0003768 0.00039 0.00% Castro::finalize_advance() 1 0.000255 0.0002692 0.000296 0.00% DistributionMapping::Distribute() 95 0.0002098 0.0002273 0.0002653 0.00% Castro::finalize_do_advance() 17 0.0001729 0.000196 0.0002289 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001308 0.0001811 0.0001945 0.00% OwnerMask() 2 0.0001328 0.0001499 0.0001651 0.00% Castro::enforce_speed_limit() 79 0.0001116 0.0001178 0.0001371 0.00% DistributionMapping::LeastUsedCPUs() 1 4.473e-05 9.91e-05 0.0001159 0.00% Castro::apply_problem_tags() 2 9.213e-05 9.498e-05 0.0001007 0.00% MultiFab::Swap() 5 6.521e-05 6.933e-05 8.64e-05 0.00% knapsack() 1 5.776e-05 6.257e-05 7.734e-05 0.00% Amr::initSubcycle() 1 5.647e-05 6.071e-05 6.443e-05 0.00% Castro::construct_old_rotation_source() 20 2.974e-05 3.05e-05 3.254e-05 0.00% Castro::estTimeStep() 10 1.22e-05 1.384e-05 2.397e-05 0.00% Castro::construct_new_rotation_source() 17 2.09e-05 2.157e-05 2.222e-05 0.00% BoxList::parallelComplementIn() 4 1.286e-05 1.436e-05 2.207e-05 0.00% Castro::computeInitialDt() 2 1.002e-05 1.132e-05 1.466e-05 0.00% BoxList::complementIn 4 5.83e-06 6.513e-06 1.03e-05 0.00% Castro::gwstrain() 2 4.582e-06 5.24e-06 9.617e-06 0.00% Gravity::set_mass_offset() 2 4.581e-06 5.904e-06 8.18e-06 0.00% Castro::FluxRegCrseInit 1 1.612e-06 2.05e-06 2.6e-06 0.00% Castro::FluxRegFineAdd() 1 1.407e-06 1.604e-06 1.988e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 15 B 19 B 24 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-42-g7437aa17d36f) finalized