Initializing AMReX (24.04-15-g7813bb7d6bc6)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.04-15-g7813bb7d6bc6) initialized Starting run at 07:13:27 UTC on 2024-04-15. Successfully read inputs file ... Castro git describe: 24.04-14-g3d76cd5a0 AMReX git describe: 24.04-15-g7813bb7d6 Microphysics git describe: 24.04-7-gd4312a6c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.250136532 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.002069358 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.011452471 Gravity::multilevel_solve_for_new_phi() time = 0.104511026 Gravity::fill_multipole_BCs() time = 0.011500783 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.274673349 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.008093527 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.004650078 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.064491643 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007102689 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.063610185 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007146463 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060236304 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005127058 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059386214 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324364691 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015263687 Gravity::solve_for_phi() time = 0.086755575 on level 0 Castro::construct_new_gravity() time = 0.088932304 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060205916 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002544645 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059985902 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.319313451 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015481624 Gravity::solve_for_phi() time = 0.088877913 on level 0 Castro::construct_new_gravity() time = 0.091002212 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.059744645 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.004182284 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059808571 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325590478 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015615445 Gravity::solve_for_phi() time = 0.086528094 on level 0 Castro::construct_new_gravity() time = 0.089532253 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.060272042 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002560657 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059456697 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330734895 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015858422 Gravity::solve_for_phi() time = 0.089275092 on level 0 Castro::construct_new_gravity() time = 0.092531643 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.060034286 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002801317 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059368402 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334780171 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015935673 Gravity::solve_for_phi() time = 0.089441123 on level 0 Castro::construct_new_gravity() time = 0.092503932 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.059938503 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002547923 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.05991643 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331874241 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015778447 Gravity::solve_for_phi() time = 0.087795195 on level 0 Castro::construct_new_gravity() time = 0.08993135 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.061356641 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002776586 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059317449 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334169913 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015960093 Gravity::solve_for_phi() time = 0.08935244 on level 0 Castro::construct_new_gravity() time = 0.091480455 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059961879 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002697196 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059364508 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331893691 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015981602 Gravity::solve_for_phi() time = 0.087807359 on level 0 Castro::construct_new_gravity() time = 0.08999084 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060621157 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002695037 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059369116 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338778117 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016132151 Gravity::solve_for_phi() time = 0.089606878 on level 0 Castro::construct_new_gravity() time = 0.092526722 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059913547 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002552857 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059186741 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333285241 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015998219 Gravity::solve_for_phi() time = 0.087918873 on level 0 Castro::construct_new_gravity() time = 0.091191245 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.060049501 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002578483 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059417242 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.339648923 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015740124 Gravity::solve_for_phi() time = 0.087764478 on level 0 Castro::construct_new_gravity() time = 0.089889743 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.05997177 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.00390877 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.05947689 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329988852 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015536651 Gravity::solve_for_phi() time = 0.089315969 on level 0 Castro::construct_new_gravity() time = 0.091456864 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059960261 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003226154 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059811827 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.339088043 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015359944 Gravity::solve_for_phi() time = 0.089375278 on level 0 Castro::construct_new_gravity() time = 0.091512035 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059944976 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.004118075 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059207318 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333338306 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015533068 Gravity::solve_for_phi() time = 0.087806821 on level 0 Castro::construct_new_gravity() time = 0.089962866 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059965981 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003302449 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059209674 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.340070796 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015698874 Gravity::solve_for_phi() time = 0.089024345 on level 0 Castro::construct_new_gravity() time = 0.091159475 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.061382153 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002738522 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059615505 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334059241 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015681844 Gravity::solve_for_phi() time = 0.091355837 on level 0 Castro::construct_new_gravity() time = 0.093509967 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.060463758 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002656982 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059271558 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336887763 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015655572 Gravity::solve_for_phi() time = 0.089854275 on level 0 Castro::construct_new_gravity() time = 0.091980516 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.060086049 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002754276459 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.95600794 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.049419728 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.007408999 seconds Ending run at 07:13:42 UTC on 2024-04-15. Run time = 14.85718301 Run time without initialization = 12.01384952 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.86 ... 14.86 ... 14.86 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3157 5.4454 5.6198 37.82% Amr::InitAmr() 1 1.572 1.573 1.573 10.59% Castro::computeTemp() 80 0.8226 0.9473 1.124 7.57% amrex::Copy() 724 0.763 0.7798 0.8031 5.41% FabArray::ParallelCopy_finish() 1429 0.07443 0.5445 0.7649 5.15% Castro::initMFs() 1 0.351 0.3894 0.5912 3.98% MultiFab::AddProduct() 3439 0.5428 0.5555 0.5827 3.92% Castro::normalize_species() 79 0.5312 0.5455 0.5661 3.81% Castro::reset_internal_energy(Fab) 160 0.5092 0.5219 0.5404 3.64% MLPoisson::Fsmooth() 6144 0.3168 0.3457 0.41 2.76% FabArray::setVal() 5013 0.3526 0.3612 0.3845 2.59% Castro::reset_internal_energy(MultiFab) 80 0.02257 0.09356 0.3659 2.46% check_for_negative_density() 20 0.02442 0.2272 0.3598 2.42% MultiFab::Subtract() 159 0.337 0.3441 0.3549 2.39% Gravity::fill_multipole_BCs() 19 0.1997 0.2417 0.287 1.93% Amr::writePlotFile() 2 0.2143 0.2421 0.2466 1.66% FabArray::ParallelCopy_nowait() 1429 0.1923 0.2051 0.2269 1.53% FabArray::sum() 3439 0.1856 0.1897 0.1984 1.34% FillBoundary_finish() 6380 0.1079 0.1558 0.1984 1.34% Castro::initData() 1 0.003281 0.02645 0.1577 1.06% FillBoundary_nowait() 6380 0.08062 0.1034 0.1333 0.90% MLPoisson::Fapply() 986 0.09438 0.09926 0.1117 0.75% MLCellLinOp::applyBC() 7148 0.04805 0.06266 0.1018 0.69% Castro::enforce_min_density() 79 0.01749 0.03636 0.09754 0.66% Castro::do_new_sources() 17 0.0003751 0.01362 0.08428 0.57% FabArray::Saxpy() 264 0.06769 0.06956 0.07494 0.50% Castro::sum_integrated_quantities() 2 0.03162 0.07035 0.07377 0.50% Castro::construct_new_gravity_source() 17 0.06878 0.07007 0.07155 0.48% Castro::do_old_sources() 20 0.0005234 0.01081 0.06174 0.42% FabArray::Xpay() 945 0.05102 0.05378 0.05983 0.40% MultiFab::contains_nan() 37 0.04511 0.04633 0.04821 0.32% Castro::construct_old_gravity_source() 20 0.04374 0.04479 0.04795 0.32% AmrLevel::derive() 18 0.04013 0.04142 0.04704 0.32% Castro::problem_post_timestep() 2 1.133e-05 0.00264 0.04205 0.28% MLMG::addInterpCorrection() 768 0.03254 0.03535 0.04116 0.28% StateData::FillBoundary(geom) 143 0 0.01726 0.03432 0.23% amrex::average_down 768 0.02419 0.02648 0.03157 0.21% VisMF::Write(FabArray) 4 0.01448 0.0168 0.02815 0.19% MLCellLinOp::defineAuxData() 19 0.01506 0.01568 0.01747 0.12% Castro::construct_new_source() 102 0.01543 0.01585 0.01673 0.11% FabArray::FillBoundary() 6380 0.0134 0.01408 0.01654 0.11% MLMG::ResNormInf() 146 0.005084 0.00926 0.01582 0.11% MLCGSolver::bicgstab 8 0 0.0009886 0.01582 0.11% amrex::Add() 128 0.01407 0.01442 0.01537 0.10% FabArray::norminf() 282 0.01083 0.01137 0.01518 0.10% Castro::construct_old_gravity() 20 0.0003787 0.002407 0.0143 0.10% FillPatchIterator::Initialize 147 0.01245 0.01312 0.01429 0.10% Castro::evaluate_source_change() 196 0.01228 0.01274 0.01341 0.09% MLCellLinOp::smooth() 3072 0.01112 0.01159 0.01288 0.09% Castro::volWgtSum() 46 0.007297 0.007772 0.01267 0.09% FabArrayBase::getFB() 6380 0.009774 0.01019 0.01227 0.08% Castro::wd_update() 2 0.004938 0.008247 0.0116 0.08% FabArray::setDomainBndry() 147 0.0004548 0.006151 0.01154 0.08% MLMG::prepareForSolve() 18 0.01012 0.01053 0.01111 0.07% Amr::writeSmallPlotFile() 2 0.007901 0.01021 0.01075 0.07% Castro::construct_old_source() 120 0.009798 0.0101 0.01074 0.07% MLLinOp::makeSubCommunicator() 19 0.001791 0.005041 0.008685 0.06% FabArray::mult() 59 0.007338 0.007532 0.007869 0.05% FabArrayBase::getCPC() 2005 0.00716 0.007462 0.007796 0.05% Gravity::actual_solve_with_mlmg() 19 0.006697 0.007132 0.007778 0.05% MLCellLinOp::compGrad() 18 0.005874 0.006114 0.007056 0.05% Gravity::get_new_grav_vector() 18 0.006128 0.006298 0.006998 0.05% Gravity::get_old_grav_vector() 20 0.006379 0.006631 0.00683 0.05% FabArrayBase::CPC::define() 576 0.002191 0.003333 0.006269 0.04% MultiFab::max() 2 0.000157 0.002929 0.005998 0.04% amrex::Dot() 142 0 0.0003724 0.005959 0.04% Castro::initialize_do_advance() 20 0.004386 0.005134 0.005521 0.04% Castro::volInBoundary() 14 0.00344 0.003805 0.005388 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0002975 0.00476 0.03% MLCellLinOp::apply() 986 0.001999 0.002226 0.004616 0.03% MLMG::solve() 18 0.0008469 0.002015 0.004448 0.03% TagBoxArray::collate() 2 0.0001484 0.0008858 0.004012 0.03% FabArray::ParallelCopy() 1429 0.003455 0.003625 0.003876 0.03% BndryData::define() 19 0.003024 0.003162 0.003378 0.02% Gravity::solve_for_phi() 17 0.000814 0.001314 0.003299 0.02% MLPoisson::normalize() 79 0 0.0002018 0.003229 0.02% Castro::construct_new_gravity() 17 0.0003015 0.000793 0.003 0.02% AmrLevel::FillPatch() 147 0.002181 0.002278 0.002488 0.02% MLLinOp::defineGrids() 19 0.001831 0.001985 0.0024 0.02% StateData::define() 6 0.001331 0.001582 0.002115 0.01% MLCellLinOp::prepareForSolve() 19 0.001676 0.001822 0.00205 0.01% MLCellLinOp::correctionResidual() 768 0.001874 0.001913 0.001973 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.00131 0.001563 0.001835 0.01% MLMG::mgVcycle() 128 0.001552 0.001641 0.001758 0.01% MLCellLinOp::defineBC() 19 0.001471 0.001547 0.001648 0.01% MLMG:computeResOfCorrection() 768 0.001383 0.001426 0.001523 0.01% Castro::save_data_for_retry() 3 0.001247 0.001356 0.001428 0.01% FabArrayBase::FB::FB() 75 0.0002831 0.0006691 0.001399 0.01% main() 1 0.001137 0.001275 0.001348 0.01% Castro::locWgtSum() 6 0.00112 0.001146 0.001165 0.01% Castro::buildMetrics() 1 0.0005773 0.0006639 0.00104 0.01% MLMG::actualBottomSolve() 128 0.0001309 0.0001928 0.001025 0.01% StateDataPhysBCFunct::() 147 0.0007247 0.0008313 0.0009714 0.01% Castro::apply_tagging_restrictions() 2 0.0004228 0.0005133 0.000952 0.01% Castro::subcycle_advance_ctu() 1 0.0001894 0.000266 0.0009063 0.01% MLCellLinOp::setLevelBC() 19 0.0005498 0.0006702 0.0008093 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006885 0.0007154 0.0007506 0.01% MLMG::mgVcycle_down::2 128 0.0006167 0.0006566 0.00075 0.01% Castro::swap_state_time_levels() 8 0.0006041 0.0006894 0.0007423 0.00% MLMG::mgVcycle_down::3 128 0.0005757 0.0006168 0.0007013 0.00% MLMG::mgVcycle_down::0 128 0.0006374 0.0006596 0.0006856 0.00% MLMG::mgVcycle_down::1 128 0.0006366 0.0006563 0.0006853 0.00% MLMG::mgVcycle_down::4 128 0.0005559 0.000578 0.0006486 0.00% MLMG::mgVcycle_down::5 128 0.0005721 0.0005967 0.0006473 0.00% Castro::Castro() 1 0.000452 0.0005063 0.0005592 0.00% AmrMesh::MakeNewGrids() 2 0.0004924 0.0005117 0.0005395 0.00% Castro::do_advance_ctu() 20 0.0004171 0.0004748 0.0005255 0.00% MLMG::mgVcycle_up::1 128 0.0004395 0.0004647 0.0005139 0.00% Castro::clean_state() 79 0.0004341 0.0004706 0.000513 0.00% FillPatchSingleLevel 147 0.000467 0.0004851 0.0005105 0.00% Gravity::applyMetricTerms() 2 0.0004833 0.0004982 0.0005103 0.00% MLMG::mgVcycle_up::0 128 0.0004498 0.0004737 0.0005057 0.00% MLMG::mgVcycle_up::2 128 0.0003802 0.000418 0.0004701 0.00% makeSFC 95 0.0003808 0.0004048 0.0004642 0.00% MLCellLinOp::solutionResidual() 147 0.0004282 0.0004434 0.0004622 0.00% MLMG::mgVcycle_up::5 128 0.0003903 0.0004073 0.0004387 0.00% MLMG::mgVcycle_up::3 128 0.0003702 0.0003891 0.0004382 0.00% MLMG::oneIter() 128 0.0003773 0.000392 0.0004256 0.00% MLMG::mgVcycle_up::4 128 0.0003816 0.0003954 0.0004209 0.00% Castro::volProductSum() 2 0.0003923 0.0004013 0.0004108 0.00% Castro::enforce_consistent_e() 1 0.0003653 0.0003771 0.0003868 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003308 0.0003491 0.0003818 0.00% DistributionMapping::LeastUsedCPUs() 1 6.482e-05 0.0003031 0.0003716 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002143 0.0002357 0.0002666 0.00% MLMG::computeResidual() 128 0.000238 0.0002463 0.0002534 0.00% DistributionMapping::Distribute() 95 0.0002135 0.0002248 0.0002485 0.00% MLMG::mgVcycle_bottom 128 0.0002218 0.0002331 0.0002484 0.00% OwnerMask() 2 0.0001315 0.0001597 0.0002279 0.00% Castro::finalize_do_advance() 17 0.000162 0.0001895 0.0002149 0.00% MLPoisson::define() 19 0.0001415 0.0001794 0.0002131 0.00% Castro::retry_advance_ctu() 11 5.478e-05 7.366e-05 0.0001987 0.00% Gravity::update_max_rhs() 2 0.0001699 0.0001776 0.0001864 0.00% MLMG::compResidual() 1 0.0001556 0.0001636 0.0001733 0.00% Castro::apply_problem_tags() 2 9.454e-05 0.0001043 0.000162 0.00% Castro::initialize_advance() 1 0.0001246 0.000141 0.0001577 0.00% Amr::coarseTimeStep() 1 0.0001221 0.000143 0.000148 0.00% Castro::enforce_speed_limit() 79 0.0001073 0.0001169 0.0001352 0.00% Castro::check_for_nan() 37 0.0001021 0.0001132 0.0001336 0.00% Amr::defBaseLevel() 1 9.633e-05 0.0001152 0.0001277 0.00% TagBoxArray::mapPRD 2 0.0001071 0.0001124 0.0001228 0.00% Amr::grid_places() 2 7.25e-05 8.862e-05 0.0001224 0.00% Amr::initSubcycle() 1 5.968e-05 6.853e-05 0.0001203 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.863e-05 8.37e-05 0.0001175 0.00% Castro::apply_source_to_state() 37 9.384e-05 0.0001038 0.0001129 0.00% Gravity::test_composite_phi() 1 9.397e-05 9.955e-05 0.0001116 0.00% MLLinOp::define() 19 7.999e-05 8.562e-05 9.502e-05 0.00% MultiFab::Swap() 5 6.789e-05 7.19e-05 8.664e-05 0.00% Castro::create_source_corrector() 17 5.781e-05 6.676e-05 8.57e-05 0.00% knapsack() 1 5.672e-05 6.22e-05 8.226e-05 0.00% MLPoisson::prepareForSolve() 19 6.68e-05 7.222e-05 7.845e-05 0.00% Amr::FinalizeInit() 1 8.588e-06 1.336e-05 6.816e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.212e-05 3.963e-05 6.398e-05 0.00% Castro::expand_state() 20 5.017e-05 5.694e-05 6.304e-05 0.00% MLMG::computeMLResidual() 18 3.893e-05 4.371e-05 5.933e-05 0.00% Gravity::swapTimeLevels() 8 3.574e-05 4.285e-05 5.721e-05 0.00% Castro::derive() 18 4.024e-05 4.268e-05 4.685e-05 0.00% MLMG::MLResNormInf() 18 3.408e-05 3.769e-05 4.522e-05 0.00% MLMG::getGradSolution() 18 3.98e-05 4.216e-05 4.457e-05 0.00% MLMG::MLRhsNormInf() 18 3.052e-05 3.2e-05 3.691e-05 0.00% Amr::timeStep() 1 1.277e-05 1.772e-05 3.482e-05 0.00% Castro::construct_old_rotation_source() 20 2.981e-05 3.11e-05 3.337e-05 0.00% Gravity::actual_multilevel_solve() 1 2.681e-05 2.997e-05 3.305e-05 0.00% Castro::estTimeStep() 10 1.256e-05 1.5e-05 2.979e-05 0.00% Amr::regrid() 1 1.026e-05 1.282e-05 2.85e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.648e-05 1.874e-05 2.512e-05 0.00% Castro::construct_new_rotation_source() 17 2.139e-05 2.202e-05 2.352e-05 0.00% Castro::errorEst() 2 6.041e-06 7.591e-06 2.33e-05 0.00% Castro::finalize_advance() 1 1.719e-05 2.037e-05 2.325e-05 0.00% Castro::advance() 1 6.866e-06 9.628e-06 1.598e-05 0.00% Castro::post_init() 1 1.184e-05 1.274e-05 1.437e-05 0.00% Amr::InitializeInit() 1 7.301e-06 8.35e-06 1.322e-05 0.00% Castro::post_regrid() 2 1.072e-05 1.179e-05 1.308e-05 0.00% BoxList::parallelComplementIn() 4 7.012e-06 7.558e-06 1.249e-05 0.00% BoxList::complementIn 4 6.004e-06 6.503e-06 9.89e-06 0.00% Amr::init() 1 7.153e-06 8.141e-06 9.598e-06 0.00% Amr::bldFineLevels() 1 6.629e-06 7.504e-06 8.663e-06 0.00% Gravity::set_mass_offset() 2 4.332e-06 6.05e-06 8.357e-06 0.00% Castro::gwstrain() 2 4.183e-06 4.864e-06 8.134e-06 0.00% Castro::computeInitialDt() 2 6.222e-06 7.011e-06 7.93e-06 0.00% Castro::post_timestep() 1 5.437e-06 6.111e-06 6.91e-06 0.00% Amr::initialInit() 1 2.896e-06 3.334e-06 3.842e-06 0.00% Castro::FluxRegCrseInit 1 1.715e-06 1.964e-06 2.236e-06 0.00% Castro::FluxRegFineAdd() 1 1.414e-06 1.556e-06 1.771e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.86 14.86 14.86 100.00% Amr::coarseTimeStep() 1 12.01 12.01 12.01 80.86% Amr::timeStep() 1 11.96 11.96 11.96 80.47% Castro::advance() 1 11.89 11.89 11.9 80.08% Castro::subcycle_advance_ctu() 1 11.84 11.84 11.85 79.74% Castro::do_advance_ctu() 20 11.8 11.81 11.81 79.48% Castro::construct_ctu_hydro_source() 20 6.422 6.454 6.482 43.63% Castro::clean_state() 79 3.69 3.801 3.975 26.75% Castro::computeTemp() 80 2.38 2.516 2.817 18.96% Castro::reset_internal_energy(MultiFab) 80 1.466 1.569 1.812 12.19% Gravity::solve_phi_with_mlmg() 19 1.53 1.576 1.623 10.92% Amr::InitAmr() 1 1.573 1.573 1.573 10.59% Castro::construct_new_gravity() 17 1.457 1.501 1.548 10.42% Gravity::solve_for_phi() 17 1.415 1.46 1.507 10.14% Castro::initialize_do_advance() 20 1.378 1.413 1.445 9.73% Gravity::actual_solve_with_mlmg() 19 1.327 1.331 1.336 8.99% MLMG::solve() 18 1.276 1.279 1.28 8.62% Amr::init() 1 1.27 1.27 1.27 8.55% Castro::do_old_sources() 20 1.152 1.179 1.198 8.06% MLMG::oneIter() 128 1.136 1.139 1.145 7.71% MLMG::mgVcycle() 128 1.122 1.124 1.129 7.60% Castro::do_new_sources() 17 0.9511 0.9846 1.024 6.89% Castro::evaluate_source_change() 196 0.9408 0.9621 1.008 6.79% FabArray::ParallelCopy() 1429 0.3025 0.7732 0.9972 6.71% Amr::initialInit() 1 0.9858 0.9861 0.9862 6.64% Castro::enforce_min_density() 79 0.7788 0.8138 0.859 5.78% amrex::Copy() 724 0.763 0.7798 0.8031 5.41% FabArray::ParallelCopy_finish() 1429 0.07443 0.5445 0.7649 5.15% MLCellLinOp::smooth() 3072 0.5836 0.6344 0.7583 5.10% Amr::InitializeInit() 1 0.435 0.547 0.6837 4.60% Amr::defBaseLevel() 1 0.435 0.547 0.6836 4.60% AmrLevel::FillPatch() 147 0.4885 0.5782 0.6698 4.51% Castro::Castro() 1 0.3563 0.3949 0.5973 4.02% Castro::initMFs() 1 0.3511 0.3896 0.5915 3.98% MultiFab::AddProduct() 3439 0.5428 0.5555 0.5827 3.92% Castro::normalize_species() 79 0.5312 0.5455 0.5661 3.81% Amr::FinalizeInit() 1 0.3025 0.4391 0.5511 3.71% Castro::reset_internal_energy(Fab) 160 0.5092 0.5219 0.5404 3.64% FillPatchIterator::Initialize 147 0.3137 0.4007 0.4963 3.34% FillPatchIterator::FillFromLevel0() 147 0.2895 0.3815 0.4797 3.23% FillPatchSingleLevel 147 0.2887 0.3807 0.479 3.22% MLCellLinOp::applyBC() 7148 0.2959 0.3468 0.4269 2.87% MLMG::mgVcycle_up::1 128 0.09551 0.2565 0.4182 2.81% MLPoisson::Fsmooth() 6144 0.3168 0.3457 0.41 2.76% FabArray::setVal() 5013 0.3526 0.3612 0.3845 2.59% MLMG::addInterpCorrection() 768 0.06303 0.2957 0.3661 2.46% check_for_negative_density() 20 0.02442 0.2272 0.3598 2.42% MultiFab::Subtract() 159 0.337 0.3441 0.3549 2.39% Castro::initData() 1 0.07632 0.1499 0.3255 2.19% FabArray::FillBoundary() 6380 0.2406 0.2841 0.3251 2.19% Amr::writePlotFile() 2 0.3247 0.3248 0.3248 2.19% Amr::bldFineLevels() 1 0.04571 0.1837 0.2944 1.98% Gravity::fill_multipole_BCs() 19 0.2018 0.2437 0.289 1.95% MLMG::mgVcycle_down::0 128 0.2712 0.2784 0.2858 1.92% MLMG::mgVcycle_up::2 128 0.01067 0.1129 0.2698 1.82% Castro::expand_state() 20 0.1784 0.2163 0.2552 1.72% Amr::grid_places() 2 0.003593 0.1402 0.2522 1.70% AmrMesh::MakeNewGrids() 2 0.003471 0.1401 0.2522 1.70% TagBoxArray::mapPRD 2 0.0008202 0.1379 0.2504 1.69% FabArray::ParallelCopy_nowait() 1429 0.2114 0.225 0.2476 1.67% Castro::post_init() 1 0.2091 0.2118 0.2149 1.45% MLMG::mgVcycle_up::0 128 0.2036 0.2051 0.2084 1.40% MLCellLinOp::apply() 986 0.1563 0.1692 0.2054 1.38% FabArray::sum() 3439 0.1856 0.1897 0.1984 1.34% FillBoundary_finish() 6380 0.1079 0.1558 0.1984 1.34% MLMG::mgVcycle_up::3 128 0.01059 0.02306 0.1709 1.15% MLMG:computeResOfCorrection() 768 0.1189 0.1288 0.1519 1.02% MLCellLinOp::correctionResidual() 768 0.1175 0.1274 0.1504 1.01% FillBoundary_nowait() 6380 0.09095 0.1143 0.1448 0.97% MLMG::mgVcycle_down::1 128 0.126 0.1329 0.1405 0.95% Castro::construct_new_source() 102 0.1231 0.1254 0.1282 0.86% MLPoisson::Fapply() 986 0.09438 0.09926 0.1117 0.75% Gravity::multilevel_solve_for_new_phi() 1 0.1045 0.1045 0.1045 0.70% Gravity::actual_multilevel_solve() 1 0.1044 0.1044 0.1045 0.70% MLCellLinOp::solutionResidual() 147 0.09244 0.0964 0.1005 0.68% Castro::sum_integrated_quantities() 2 0.05055 0.0899 0.09252 0.62% Castro::post_regrid() 2 0.08395 0.087 0.08976 0.60% Castro::create_source_corrector() 17 0.04828 0.063 0.08907 0.60% Castro::construct_old_source() 120 0.0763 0.07815 0.08347 0.56% Castro::derive() 18 0.06819 0.07061 0.08218 0.55% AmrLevel::derive() 18 0.06815 0.07057 0.08213 0.55% MLMG::computeResidual() 128 0.07724 0.08052 0.08194 0.55% FabArray::Saxpy() 264 0.06769 0.06956 0.07494 0.50% MLMG::mgVcycle_down::2 128 0.01257 0.04128 0.07271 0.49% Castro::construct_new_gravity_source() 17 0.06878 0.07007 0.07155 0.48% MLMG::mgVcycle_bottom 128 0.0003528 0.004703 0.0697 0.47% MLMG::actualBottomSolve() 128 0.0001309 0.00447 0.06945 0.47% Castro::construct_old_gravity() 20 0.04173 0.05765 0.06919 0.47% MLCGSolver::bicgstab 8 0 0.004249 0.06798 0.46% Gravity::get_old_grav_vector() 20 0.04111 0.05524 0.06561 0.44% Castro::post_timestep() 1 0.05883 0.06101 0.063 0.42% MLMG::mgVcycle_down::3 128 0.01196 0.01822 0.06052 0.41% FabArray::Xpay() 945 0.05102 0.05378 0.05983 0.40% amrex::average_down 768 0.03233 0.03956 0.05622 0.38% Castro::initialize_advance() 1 0.04848 0.05005 0.0522 0.35% Castro::problem_post_timestep() 2 0.009558 0.01469 0.05177 0.35% Castro::check_for_nan() 37 0.04522 0.04644 0.04832 0.33% MultiFab::contains_nan() 37 0.04511 0.04633 0.04821 0.32% Castro::construct_old_gravity_source() 20 0.04374 0.04479 0.04795 0.32% Amr::regrid() 1 0.04414 0.04551 0.04697 0.32% Gravity::get_new_grav_vector() 18 0.03657 0.03988 0.04116 0.28% MLPoisson::define() 19 0.03007 0.03457 0.04063 0.27% Castro::retry_advance_ctu() 11 0.03581 0.03658 0.03821 0.26% StateDataPhysBCFunct::() 147 0.0007247 0.01809 0.03525 0.24% StateData::FillBoundary(geom) 143 0 0.01726 0.03432 0.23% MLMG::mgVcycle_down::4 128 0.01183 0.01352 0.03402 0.23% Castro::apply_source_to_state() 37 0.02764 0.02823 0.02889 0.19% VisMF::Write(FabArray) 4 0.01448 0.0168 0.02815 0.19% MLMG::mgVcycle_up::4 128 0.01073 0.01201 0.02652 0.18% MLMG::ResNormInf() 146 0.01504 0.01904 0.02546 0.17% MLCellLinOp::defineAuxData() 19 0.01919 0.02053 0.02405 0.16% MLMG::prepareForSolve() 18 0.02033 0.02147 0.02322 0.16% MLMG::mgVcycle_down::5 128 0.01177 0.01274 0.02242 0.15% Castro::save_data_for_retry() 3 0.01856 0.01893 0.01987 0.13% MLMG::mgVcycle_up::5 128 0.01078 0.0116 0.01901 0.13% MLMG::computeMLResidual() 18 0.01104 0.01544 0.01865 0.13% Amr::writeSmallPlotFile() 2 0.01624 0.01625 0.01626 0.11% amrex::Add() 128 0.01407 0.01442 0.01537 0.10% FabArray::norminf() 282 0.01083 0.01137 0.01518 0.10% Castro::wd_update() 2 0.009547 0.01205 0.01504 0.10% Gravity::test_composite_phi() 1 0.01493 0.01496 0.01499 0.10% FabArrayBase::getCPC() 2005 0.009382 0.01079 0.01381 0.09% FabArrayBase::getFB() 6380 0.01006 0.01086 0.01367 0.09% Castro::volWgtSum() 46 0.007297 0.007772 0.01267 0.09% MLLinOp::define() 19 0.004647 0.00809 0.01227 0.08% MLLinOp::defineGrids() 19 0.004564 0.008005 0.01218 0.08% FabArray::setDomainBndry() 147 0.0004548 0.006151 0.01154 0.08% MLMG::getGradSolution() 18 0.007575 0.008101 0.009346 0.06% MLCellLinOp::compGrad() 18 0.007534 0.008059 0.009302 0.06% MLLinOp::makeSubCommunicator() 19 0.001791 0.005041 0.008685 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0004998 0.007997 0.05% FabArray::mult() 59 0.007338 0.007532 0.007869 0.05% Gravity::update_max_rhs() 2 0.001436 0.004203 0.007255 0.05% FabArrayBase::CPC::define() 576 0.002191 0.003333 0.006269 0.04% MLCellLinOp::defineBC() 19 0.005439 0.005771 0.006149 0.04% MultiFab::max() 2 0.000157 0.002929 0.005998 0.04% amrex::Dot() 142 0 0.0003724 0.005959 0.04% Castro::volInBoundary() 14 0.00344 0.003805 0.005388 0.04% BndryData::define() 19 0.00394 0.004225 0.004564 0.03% TagBoxArray::collate() 2 0.0001484 0.0008858 0.004012 0.03% MLPoisson::normalize() 79 0 0.0002018 0.003229 0.02% AmrLevel::AmrLevel(dm) 1 0.001364 0.001622 0.002177 0.01% MLPoisson::prepareForSolve() 19 0.001752 0.001894 0.00212 0.01% StateData::define() 6 0.001331 0.001582 0.002115 0.01% MLCellLinOp::prepareForSolve() 19 0.001676 0.001822 0.00205 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.00131 0.001563 0.001835 0.01% FabArrayBase::FB::FB() 75 0.0002831 0.0006691 0.001399 0.01% Gravity::swapTimeLevels() 8 0.001181 0.001258 0.001337 0.01% MLMG::MLResNormInf() 18 0.001234 0.00127 0.001303 0.01% MLMG::MLRhsNormInf() 18 0.001192 0.001218 0.001267 0.01% MLMG::compResidual() 1 0.000933 0.001107 0.001211 0.01% Castro::locWgtSum() 6 0.00112 0.001146 0.001165 0.01% Castro::buildMetrics() 1 0.0006385 0.0007337 0.00115 0.01% Castro::errorEst() 2 0.0005273 0.0006252 0.001124 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009418 0.0009787 0.001091 0.01% Castro::apply_tagging_restrictions() 2 0.0004228 0.0005133 0.000952 0.01% MLCellLinOp::setLevelBC() 19 0.0005498 0.0006702 0.0008093 0.01% Castro::swap_state_time_levels() 8 0.0006041 0.0006894 0.0007423 0.00% makeSFC 95 0.0005943 0.0006297 0.0007127 0.00% Gravity::applyMetricTerms() 2 0.0004833 0.0004982 0.0005103 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001654 0.0003841 0.0004513 0.00% Castro::volProductSum() 2 0.0003923 0.0004013 0.0004108 0.00% Castro::enforce_consistent_e() 1 0.0003653 0.0003771 0.0003868 0.00% DistributionMapping::LeastUsedCPUs() 1 6.482e-05 0.0003031 0.0003716 0.00% Castro::finalize_advance() 1 0.0002534 0.0002666 0.0002797 0.00% DistributionMapping::Distribute() 95 0.0002135 0.0002248 0.0002485 0.00% OwnerMask() 2 0.0001315 0.0001597 0.0002279 0.00% Castro::finalize_do_advance() 17 0.0001726 0.0002013 0.0002264 0.00% Castro::apply_problem_tags() 2 9.454e-05 0.0001043 0.000162 0.00% Castro::enforce_speed_limit() 79 0.0001073 0.0001169 0.0001352 0.00% Amr::initSubcycle() 1 5.968e-05 6.853e-05 0.0001203 0.00% MultiFab::Swap() 5 6.789e-05 7.19e-05 8.664e-05 0.00% knapsack() 1 5.672e-05 6.22e-05 8.226e-05 0.00% Castro::construct_old_rotation_source() 20 2.981e-05 3.11e-05 3.337e-05 0.00% Castro::estTimeStep() 10 1.256e-05 1.5e-05 2.979e-05 0.00% Castro::construct_new_rotation_source() 17 2.139e-05 2.202e-05 2.352e-05 0.00% BoxList::parallelComplementIn() 4 1.302e-05 1.406e-05 2.238e-05 0.00% Castro::computeInitialDt() 2 9.109e-06 1.016e-05 1.144e-05 0.00% BoxList::complementIn 4 6.004e-06 6.503e-06 9.89e-06 0.00% Gravity::set_mass_offset() 2 4.332e-06 6.05e-06 8.357e-06 0.00% Castro::gwstrain() 2 4.183e-06 4.864e-06 8.134e-06 0.00% Castro::FluxRegCrseInit 1 1.715e-06 1.964e-06 2.236e-06 0.00% Castro::FluxRegFineAdd() 1 1.414e-06 1.556e-06 1.771e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 13 B 14 B 18 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-15-g7813bb7d6bc6) finalized