Initializing AMReX (24.09-21-gc6b4fde07ae1)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.09-21-gc6b4fde07ae1) initialized Starting run at 08:01:51 UTC on 2024-09-09. Successfully read inputs file ... Castro git describe: 24.09-2-g97555d411 AMReX git describe: 24.09-21-gc6b4fde07 Microphysics git describe: 24.09-2-g1e1dc144 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data Now regridding at level lbase = 0 grid_places() time: 0.162438156 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 grid_places() time: 0.004508256 new finest: 0 Gravity::fill_multipole_BCs() time = 0.011857547 Gravity::multilevel_solve_for_new_phi() time = 0.127445299 ... norm of composite residual at level 0 1.193955541e-11 Gravity::fill_multipole_BCs() time = 0.011570022 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049170367 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004408121 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Castro::construct_old_gravity() time = 0.005255932 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.064193698 on level 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Castro::construct_old_gravity() time = 0.006897734 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.104387445 on level 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Castro::construct_old_gravity() time = 0.004492367 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.061853732 on level 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. ... Entering construct_ctu_hydro_source() on level 0 Castro::construct_old_gravity() time = 0.005920843 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.062262907 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Castro::construct_ctu_hydro_source() time = 0.315178873 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.01436505 Gravity::solve_for_phi() time = 0.094267274 on level 0 Castro::construct_new_gravity() time = 0.096465164 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060667548 on level 0 Castro::construct_old_gravity() time = 0.006331026 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060740029 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Castro::construct_ctu_hydro_source() time = 0.362589471 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014006013 Gravity::solve_for_phi() time = 0.095651617 on level 0 Castro::construct_new_gravity() time = 0.097881447 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.064605924 on level 0 Castro::construct_old_gravity() time = 0.004212528 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.05879413 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Castro::construct_ctu_hydro_source() time = 0.316679807 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014789878 Gravity::solve_for_phi() time = 0.094471859 on level 0 Castro::construct_new_gravity() time = 0.096662244 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.059146716 on level 0 Castro::construct_old_gravity() time = 0.002977719 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058828639 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 Castro::construct_ctu_hydro_source() time = 0.323600034 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015671212 Gravity::solve_for_phi() time = 0.094208275 on level 0 Castro::construct_new_gravity() time = 0.096342097 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.059109612 on level 0 Castro::construct_old_gravity() time = 0.003334262 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059226134 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 Castro::construct_ctu_hydro_source() time = 0.322428153 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014867185 Gravity::solve_for_phi() time = 0.09342244 on level 0 Castro::construct_new_gravity() time = 0.095605334 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.059504004 on level 0 Castro::construct_old_gravity() time = 0.003024229 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059273667 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 Castro::construct_ctu_hydro_source() time = 0.317457821 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014653452 Gravity::solve_for_phi() time = 0.093388471 on level 0 Castro::construct_new_gravity() time = 0.09552933 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.059136167 on level 0 Castro::construct_old_gravity() time = 0.002707079 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058912369 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 Castro::construct_ctu_hydro_source() time = 0.322701055 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014576457 Gravity::solve_for_phi() time = 0.093913565 on level 0 Castro::construct_new_gravity() time = 0.096104454 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059214265 on level 0 Castro::construct_old_gravity() time = 0.002948412 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058762266 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 Castro::construct_ctu_hydro_source() time = 0.318786357 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014869781 Gravity::solve_for_phi() time = 0.09425836 on level 0 Castro::construct_new_gravity() time = 0.096402916 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060400672 on level 0 Castro::construct_old_gravity() time = 0.002781921 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058693289 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 Castro::construct_ctu_hydro_source() time = 0.32359312 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.01491087 Gravity::solve_for_phi() time = 0.094109536 on level 0 Castro::construct_new_gravity() time = 0.096257523 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059102151 on level 0 Castro::construct_old_gravity() time = 0.002775093 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058916176 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 Castro::construct_ctu_hydro_source() time = 0.319568594 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015318674 Gravity::solve_for_phi() time = 0.093911163 on level 0 Castro::construct_new_gravity() time = 0.096049025 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.059894074 on level 0 Castro::construct_old_gravity() time = 0.004243305 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058873739 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 Castro::construct_ctu_hydro_source() time = 0.32547556 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.014953185 Gravity::solve_for_phi() time = 0.093452621 on level 0 Castro::construct_new_gravity() time = 0.09558571 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059158075 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003506384 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059102674 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 Castro::construct_ctu_hydro_source() time = 0.338155718 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015206669 Gravity::solve_for_phi() time = 0.094235169 on level 0 Castro::construct_new_gravity() time = 0.096367537 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059451274 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003609226 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059457662 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 Castro::construct_ctu_hydro_source() time = 0.326228296 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015194466 Gravity::solve_for_phi() time = 0.093735537 on level 0 Castro::construct_new_gravity() time = 0.095869871 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.05956917 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003553405 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058869973 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 Castro::construct_ctu_hydro_source() time = 0.321391373 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015775766 Gravity::solve_for_phi() time = 0.094982765 on level 0 Castro::construct_new_gravity() time = 0.097228646 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.060726422 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003776576 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059097005 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 Castro::construct_ctu_hydro_source() time = 0.326115446 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015216394 Gravity::solve_for_phi() time = 0.094018402 on level 0 Castro::construct_new_gravity() time = 0.096208472 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059705344 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.003403534 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059072011 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 Castro::construct_ctu_hydro_source() time = 0.320069304 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. ... Entering construct_ctu_hydro_source() on level 0 Gravity::fill_multipole_BCs() time = 0.015477669 Gravity::solve_for_phi() time = 0.094302213 on level 0 Castro::construct_new_gravity() time = 0.096522715 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059522291 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.003917959 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059314918 on level 0 ... Leaving construct_ctu_hydro_source() on level 0 ... new-time level Poisson gravity solve at level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 Castro::construct_ctu_hydro_source() time = 0.326236779 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002761519911 [Level 0 step 1] Advanced 32768 cells Gravity::fill_multipole_BCs() time = 0.015448456 Gravity::solve_for_phi() time = 0.094376325 on level 0 Castro::construct_new_gravity() time = 0.09658564 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059580013 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 STEP = 1 TIME = 0.25 DT = 0.25 [STEP 1] Coarse TimeStep time: 11.92554537 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.048319534 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.00420975 seconds Ending run at 08:02:06 UTC on 2024-09-09. Run time = 14.27854153 Run time without initialization = 11.97898216 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.2785 ... 14.2786 ... 14.2786 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.2547 5.2964 5.3986 37.81% Amr::InitAmr() 1 1.317 1.317 1.317 9.22% Castro::computeTemp() 80 0.833 0.9494 1.11 7.78% amrex::Copy() 724 0.7923 0.7982 0.8118 5.69% FabArray::ParallelCopy_finish() 1429 0.2378 0.6018 0.8069 5.65% MultiFab::AddProduct() 3439 0.5561 0.5601 0.5776 4.05% Castro::normalize_species() 79 0.5489 0.5525 0.5619 3.94% Castro::reset_internal_energy(Fab) 160 0.5171 0.523 0.5357 3.75% MLPoisson::Fsmooth() 6144 0.3485 0.3773 0.4544 3.18% MultiFab::Subtract() 159 0.3429 0.3517 0.4451 3.12% Castro::initMFs() 1 0.3578 0.3706 0.4076 2.85% FabArray::setVal() 5013 0.3516 0.3566 0.3653 2.56% Gravity::fill_multipole_BCs() 19 0.1988 0.2512 0.2738 1.92% check_for_negative_density() 20 0.09156 0.1947 0.246 1.72% FabArray::ParallelCopy_nowait() 1429 0.2061 0.2234 0.2425 1.70% FabArray::sum() 3439 0.1912 0.1937 0.1992 1.40% FillBoundary_finish() 6380 0.1191 0.1416 0.1709 1.20% Castro::initData() 1 0.003299 0.02808 0.1633 1.14% FillBoundary_nowait() 6380 0.09182 0.1221 0.1562 1.09% MLCellLinOp::applyBC() 7148 0.06954 0.08002 0.1267 0.89% MLPoisson::Fapply() 986 0.09471 0.09926 0.1228 0.86% TagBoxArray::collate() 2 0.0003437 0.02155 0.1103 0.77% FabArray::Saxpy() 264 0.07134 0.07242 0.07922 0.55% MLMG::addInterpCorrection() 768 0.05705 0.06171 0.07476 0.52% Castro::construct_new_gravity_source() 17 0.06838 0.06946 0.07085 0.50% MultiFab::max() 2 0.0001688 0.06127 0.06825 0.48% FabArray::Xpay() 945 0.05043 0.05257 0.05978 0.42% Castro::construct_old_gravity_source() 20 0.045 0.04561 0.04822 0.34% MultiFab::contains_nan() 37 0.04499 0.0453 0.04611 0.32% AmrLevel::derive() 18 0.04023 0.04057 0.04107 0.29% amrex::average_down 768 0.0249 0.02714 0.03387 0.24% StateData::FillBoundary(geom) 143 0 0.01747 0.03377 0.24% Castro::reset_internal_energy(MultiFab) 80 0.02325 0.02369 0.02434 0.17% VisMF::Write(FabArray) 4 0.01366 0.01458 0.02402 0.17% MLCellLinOp::defineAuxData() 19 0.01559 0.01657 0.01991 0.14% Castro::enforce_min_density() 79 0.01869 0.01892 0.01942 0.14% MLCGSolver::bicgstab 8 0 0.001114 0.01782 0.12% FabArray::FillBoundary() 6380 0.0138 0.01441 0.01749 0.12% Amr::writePlotFile() 2 0.007105 0.0161 0.01724 0.12% Castro::construct_new_source() 102 0.01594 0.01608 0.01644 0.12% FabArray::norminf() 282 0.0112 0.0117 0.01604 0.11% amrex::Add() 128 0.01437 0.01448 0.01502 0.11% Castro::evaluate_source_change() 196 0.0136 0.01408 0.01496 0.10% FabArray::setDomainBndry() 147 0.0004753 0.007781 0.01475 0.10% FabArrayBase::getFB() 6380 0.011 0.01155 0.01415 0.10% MLCellLinOp::smooth() 3072 0.01205 0.01255 0.01381 0.10% FillPatchIterator::Initialize 147 0.01281 0.013 0.01337 0.09% MLMG::ResNormInf() 146 0.005833 0.008469 0.01247 0.09% Castro::wd_update() 2 0.00493 0.008283 0.01183 0.08% MLMG::prepareForSolve() 18 0.01016 0.01052 0.01155 0.08% Castro::construct_old_source() 120 0.01009 0.01024 0.01093 0.08% Gravity::actual_solve_with_mlmg() 19 0.007353 0.007712 0.009086 0.06% MLMG::solve() 18 0.0008776 0.004368 0.008122 0.06% FabArrayBase::getCPC() 2005 0.007533 0.00776 0.008115 0.06% Gravity::get_old_grav_vector() 20 0.00656 0.006633 0.006802 0.05% Gravity::get_new_grav_vector() 18 0.006078 0.006171 0.00635 0.04% Castro::initialize_do_advance() 20 0.004364 0.004664 0.005499 0.04% MLCellLinOp::apply() 986 0.002033 0.002253 0.004756 0.03% FabArray::ParallelCopy() 1429 0.003519 0.003689 0.004064 0.03% Castro::sum_integrated_quantities() 2 0.001651 0.002344 0.002675 0.02% AmrLevel::FillPatch() 147 0.002347 0.002482 0.002619 0.02% MLCellLinOp::correctionResidual() 768 0.001879 0.001962 0.002057 0.01% MLMG::mgVcycle() 128 0.001621 0.001698 0.00186 0.01% MLMG:computeResOfCorrection() 768 0.001543 0.001591 0.001689 0.01% AmrMesh::MakeNewGrids() 2 0.0005423 0.0006362 0.0016 0.01% Castro::save_data_for_retry() 3 0.001303 0.001328 0.001409 0.01% Castro::subcycle_advance_ctu() 1 0.0002425 0.0003322 0.001119 0.01% MLMG::actualBottomSolve() 128 0.000131 0.0001943 0.001067 0.01% StateDataPhysBCFunct::() 147 0.0007251 0.0008778 0.0009709 0.01% MLMG::mgVcycle_down::2 128 0.0006459 0.0007252 0.0008639 0.01% Gravity::solve_for_phi() 17 0.0006591 0.0006915 0.0007767 0.01% main() 1 0.0006928 0.0007301 0.0007646 0.01% MLMG::mgVcycle_down::1 128 0.0006762 0.0007006 0.0007618 0.01% MLMG::mgVcycle_down::3 128 0.0006029 0.0006489 0.0007495 0.01% MLMG::mgVcycle_down::0 128 0.0006712 0.000694 0.0007429 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006752 0.0007065 0.0007419 0.01% MLMG::mgVcycle_down::4 128 0.0005864 0.0006108 0.0007077 0.00% MLMG::mgVcycle_down::5 128 0.0006078 0.0006259 0.0007063 0.00% Castro::Castro() 1 0.0004589 0.0005245 0.000637 0.00% MLMG::mgVcycle_up::0 128 0.0004986 0.0005202 0.0005684 0.00% MLMG::mgVcycle_up::1 128 0.0004867 0.0005119 0.0005383 0.00% Castro::clean_state() 79 0.0004485 0.000475 0.0005162 0.00% FillPatchSingleLevel 147 0.000464 0.0004788 0.0005109 0.00% MLMG::mgVcycle_up::2 128 0.0004239 0.0004651 0.0005099 0.00% MLCellLinOp::solutionResidual() 147 0.0004577 0.0004726 0.0005081 0.00% MLMG::mgVcycle_up::3 128 0.0004171 0.0004461 0.0004987 0.00% MLMG::mgVcycle_up::4 128 0.0004259 0.0004399 0.0004934 0.00% MLMG::mgVcycle_up::5 128 0.0004115 0.0004244 0.0004821 0.00% Castro::do_advance_ctu() 20 0.0003938 0.0004192 0.0004558 0.00% MLMG::oneIter() 128 0.0003933 0.0004067 0.0004417 0.00% TagBoxArray::mapPRD 2 0.0001258 0.000152 0.0003957 0.00% Castro::do_old_sources() 20 0.0002778 0.0002933 0.0003136 0.00% Castro::construct_new_gravity() 17 0.0001624 0.0001777 0.0003067 0.00% Castro::problem_post_timestep() 2 1.062e-05 3.098e-05 0.0002865 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002226 0.0002423 0.0002733 0.00% MLMG::computeResidual() 128 0.0002416 0.0002464 0.0002628 0.00% Gravity::update_max_rhs() 2 0.0001929 0.0002151 0.000259 0.00% MLMG::mgVcycle_bottom 128 0.000224 0.0002332 0.0002563 0.00% Castro::do_new_sources() 17 0.0002163 0.0002278 0.000248 0.00% Amr::defBaseLevel() 1 0.0001344 0.0001587 0.0001865 0.00% MLPoisson::define() 19 0.0001344 0.00016 0.0001777 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.073e-05 7.466e-05 0.0001762 0.00% Amr::coarseTimeStep() 1 0.0001295 0.0001554 0.0001739 0.00% Gravity::test_composite_phi() 1 0.0001119 0.0001237 0.0001439 0.00% Castro::apply_source_to_state() 37 9.674e-05 0.0001053 0.0001418 0.00% Castro::retry_advance_ctu() 11 6.059e-05 7.324e-05 0.0001272 0.00% Castro::construct_old_gravity() 20 0.0001117 0.0001167 0.0001269 0.00% Castro::check_for_nan() 37 0.0001035 0.0001138 0.0001246 0.00% Castro::initialize_advance() 1 0.0001036 0.0001112 0.0001231 0.00% Amr::grid_places() 2 5.367e-05 6.531e-05 9.766e-05 0.00% MLLinOp::define() 19 7.355e-05 7.981e-05 8.826e-05 0.00% Amr::FinalizeInit() 1 1.429e-05 2.714e-05 7.143e-05 0.00% Amr::regrid() 1 1.765e-05 2.278e-05 6.848e-05 0.00% Castro::create_source_corrector() 17 5.417e-05 6.014e-05 6.579e-05 0.00% Castro::expand_state() 20 4.876e-05 5.414e-05 6.364e-05 0.00% MLMG::computeMLResidual() 18 4.36e-05 4.579e-05 4.82e-05 0.00% Castro::derive() 18 4.305e-05 4.428e-05 4.716e-05 0.00% Gravity::actual_multilevel_solve() 1 3.218e-05 3.475e-05 3.77e-05 0.00% Amr::timeStep() 1 1.426e-05 2.008e-05 3.76e-05 0.00% Castro::post_regrid() 2 1.17e-05 1.561e-05 3.077e-05 0.00% Castro::advance() 1 6.962e-06 1.315e-05 2.711e-05 0.00% Castro::post_init() 1 1.254e-05 1.611e-05 2.352e-05 0.00% Amr::InitializeInit() 1 7.978e-06 9.581e-06 1.993e-05 0.00% Amr::bldFineLevels() 1 7.622e-06 9.333e-06 1.243e-05 0.00% Castro::post_timestep() 1 5.586e-06 6.216e-06 1.036e-05 0.00% Amr::init() 1 6.632e-06 7.613e-06 8.67e-06 0.00% Amr::initialInit() 1 2.999e-06 3.37e-06 3.846e-06 0.00% Other 2455 0.04924 0.05897 0.08762 0.61% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.28 14.28 14.28 100.00% Amr::coarseTimeStep() 1 11.98 11.98 11.98 83.89% Amr::timeStep() 1 11.93 11.93 11.93 83.52% Castro::advance() 1 11.86 11.86 11.87 83.11% Castro::subcycle_advance_ctu() 1 11.81 11.81 11.82 82.76% Castro::do_advance_ctu() 20 11.77 11.78 11.78 82.50% Castro::construct_ctu_hydro_source() 20 6.246 6.272 6.324 44.29% Castro::clean_state() 79 3.658 3.8 3.95 27.66% Castro::computeTemp() 80 2.335 2.465 2.621 18.36% Gravity::solve_phi_with_mlmg() 19 1.655 1.712 1.738 12.18% Castro::construct_new_gravity() 17 1.554 1.61 1.636 11.46% Gravity::solve_for_phi() 17 1.516 1.572 1.599 11.20% Castro::reset_internal_energy(MultiFab) 80 1.501 1.515 1.568 10.98% Castro::initialize_do_advance() 20 1.393 1.43 1.474 10.32% Gravity::actual_solve_with_mlmg() 19 1.453 1.457 1.461 10.23% MLMG::solve() 18 1.398 1.404 1.405 9.84% Amr::InitAmr() 1 1.317 1.317 1.317 9.22% MLMG::oneIter() 128 1.258 1.262 1.265 8.86% MLMG::mgVcycle() 128 1.244 1.247 1.25 8.75% Castro::do_old_sources() 20 1.189 1.208 1.23 8.62% FabArray::ParallelCopy() 1429 0.4893 0.849 1.05 7.35% Castro::do_new_sources() 17 0.9179 0.9692 1.011 7.08% Castro::evaluate_source_change() 196 0.9634 0.9701 0.9999 7.00% Amr::init() 1 0.9827 0.9827 0.9827 6.88% Amr::initialInit() 1 0.9286 0.9286 0.9287 6.50% Castro::enforce_min_density() 79 0.7988 0.8098 0.858 6.01% MLCellLinOp::smooth() 3072 0.6315 0.6888 0.8272 5.79% amrex::Copy() 724 0.7923 0.7982 0.8118 5.69% FabArray::ParallelCopy_finish() 1429 0.2378 0.6018 0.8069 5.65% AmrLevel::FillPatch() 147 0.554 0.6511 0.7554 5.29% Amr::InitializeInit() 1 0.4462 0.483 0.6064 4.25% Amr::defBaseLevel() 1 0.4462 0.483 0.6064 4.25% MultiFab::AddProduct() 3439 0.5561 0.5601 0.5776 4.05% FillPatchIterator::Initialize 147 0.37 0.4694 0.5745 4.02% Castro::normalize_species() 79 0.5489 0.5525 0.5619 3.94% FillPatchIterator::FillFromLevel0() 147 0.3468 0.4486 0.547 3.83% FillPatchSingleLevel 147 0.3461 0.4479 0.5463 3.83% Castro::reset_internal_energy(Fab) 160 0.5171 0.523 0.5357 3.75% MLMG::mgVcycle_up::1 128 0.1129 0.2978 0.4832 3.38% Amr::FinalizeInit() 1 0.3222 0.4457 0.4824 3.38% MLPoisson::Fsmooth() 6144 0.3485 0.3773 0.4544 3.18% MLCellLinOp::applyBC() 7148 0.3302 0.3704 0.4525 3.17% MultiFab::Subtract() 159 0.3429 0.3517 0.4451 3.12% MLMG::addInterpCorrection() 768 0.09741 0.3611 0.4396 3.08% Castro::Castro() 1 0.3638 0.3768 0.4154 2.91% Castro::initMFs() 1 0.358 0.3708 0.4079 2.86% FabArray::setVal() 5013 0.3516 0.3566 0.3653 2.56% FabArray::FillBoundary() 6380 0.253 0.2904 0.3382 2.37% MLMG::mgVcycle_up::2 128 0.01389 0.133 0.3135 2.20% MLMG::mgVcycle_down::0 128 0.2767 0.2792 0.2815 1.97% Castro::expand_state() 20 0.1986 0.231 0.2765 1.94% Gravity::fill_multipole_BCs() 19 0.2009 0.2533 0.276 1.93% FabArray::ParallelCopy_nowait() 1429 0.2255 0.2435 0.2635 1.85% check_for_negative_density() 20 0.09156 0.1947 0.246 1.72% Castro::initData() 1 0.07754 0.1044 0.2409 1.69% MLMG::mgVcycle_up::0 128 0.2343 0.2353 0.2369 1.66% Castro::post_init() 1 0.1619 0.2229 0.2298 1.61% MLCellLinOp::apply() 986 0.1584 0.171 0.2189 1.53% Amr::bldFineLevels() 1 0.0513 0.1781 0.2189 1.53% MLMG::mgVcycle_up::3 128 0.01388 0.02858 0.2029 1.42% FabArray::sum() 3439 0.1912 0.1937 0.1992 1.40% FillBoundary_finish() 6380 0.1191 0.1416 0.1709 1.20% FillBoundary_nowait() 6380 0.1033 0.1344 0.169 1.18% Amr::grid_places() 2 0.006765 0.1302 0.1669 1.17% AmrMesh::MakeNewGrids() 2 0.006699 0.1301 0.1669 1.17% TagBoxArray::mapPRD 2 0.003756 0.1071 0.1638 1.15% MLMG:computeResOfCorrection() 768 0.1186 0.1293 0.1593 1.12% MLCellLinOp::correctionResidual() 768 0.1171 0.1277 0.1576 1.10% Castro::post_regrid() 2 0.08562 0.09254 0.1536 1.08% MLMG::mgVcycle_down::1 128 0.1288 0.1325 0.1364 0.96% Gravity::multilevel_solve_for_new_phi() 1 0.1273 0.1273 0.1274 0.89% Gravity::actual_multilevel_solve() 1 0.1272 0.1272 0.1274 0.89% Castro::construct_new_source() 102 0.1247 0.1258 0.1271 0.89% MLPoisson::Fapply() 986 0.09471 0.09926 0.1228 0.86% TagBoxArray::collate() 2 0.0003437 0.02155 0.1103 0.77% Amr::regrid() 1 0.04734 0.05242 0.1079 0.76% MLCellLinOp::solutionResidual() 147 0.09132 0.09648 0.1021 0.72% Amr::writePlotFile() 2 0.09786 0.09795 0.09796 0.69% Castro::create_source_corrector() 17 0.05233 0.07023 0.09083 0.64% Castro::construct_old_source() 120 0.0787 0.07973 0.08609 0.60% MLMG::computeResidual() 128 0.07775 0.07975 0.08315 0.58% MLMG::mgVcycle_down::2 128 0.01625 0.04761 0.08185 0.57% FabArray::Saxpy() 264 0.07134 0.07242 0.07922 0.55% MLMG::mgVcycle_bottom 128 0.0003581 0.005229 0.07815 0.55% MLMG::actualBottomSolve() 128 0.000131 0.004996 0.0779 0.55% MLCGSolver::bicgstab 8 0 0.004771 0.07633 0.53% Castro::derive() 18 0.06917 0.06983 0.07108 0.50% AmrLevel::derive() 18 0.06913 0.06979 0.07103 0.50% Castro::construct_new_gravity_source() 17 0.06838 0.06946 0.07085 0.50% Gravity::update_max_rhs() 2 0.001611 0.06268 0.06962 0.49% MLMG::mgVcycle_down::3 128 0.01542 0.02241 0.06902 0.48% MultiFab::max() 2 0.0001688 0.06127 0.06825 0.48% Castro::construct_old_gravity() 20 0.04988 0.06006 0.06563 0.46% Gravity::get_old_grav_vector() 20 0.04977 0.05994 0.06552 0.46% Castro::post_timestep() 1 0.05867 0.06119 0.06427 0.45% FabArray::Xpay() 945 0.05043 0.05257 0.05978 0.42% amrex::average_down 768 0.03376 0.04101 0.05817 0.41% Castro::initialize_advance() 1 0.04895 0.04968 0.05197 0.36% Castro::construct_old_gravity_source() 20 0.045 0.04561 0.04822 0.34% Castro::check_for_nan() 37 0.0451 0.04542 0.04623 0.32% MultiFab::contains_nan() 37 0.04499 0.0453 0.04611 0.32% MLPoisson::define() 19 0.03061 0.03587 0.04138 0.29% MLMG::mgVcycle_down::4 128 0.01538 0.0172 0.04014 0.28% Castro::retry_advance_ctu() 11 0.03572 0.03657 0.0385 0.27% Gravity::get_new_grav_vector() 18 0.03654 0.0369 0.03712 0.26% StateDataPhysBCFunct::() 147 0.0007251 0.01835 0.03471 0.24% StateData::FillBoundary(geom) 143 0 0.01747 0.03377 0.24% MLMG::mgVcycle_up::4 128 0.01392 0.01533 0.03313 0.23% Castro::apply_source_to_state() 37 0.02899 0.02926 0.0301 0.21% MLMG::mgVcycle_down::5 128 0.01533 0.01636 0.02839 0.20% MLCellLinOp::defineAuxData() 19 0.01992 0.02162 0.02707 0.19% MLMG::mgVcycle_up::5 128 0.01404 0.01493 0.02439 0.17% MLMG::prepareForSolve() 18 0.02056 0.02145 0.02427 0.17% VisMF::Write(FabArray) 4 0.01366 0.01458 0.02402 0.17% MLMG::ResNormInf() 146 0.01571 0.01837 0.02227 0.16% Castro::sum_integrated_quantities() 2 0.02172 0.0219 0.02191 0.15% MLMG::computeMLResidual() 18 0.01133 0.01623 0.02137 0.15% Castro::save_data_for_retry() 3 0.01897 0.01922 0.02047 0.14% FabArray::norminf() 282 0.0112 0.0117 0.01604 0.11% FabArrayBase::getFB() 6380 0.01135 0.01229 0.01579 0.11% Gravity::test_composite_phi() 1 0.01532 0.01545 0.0155 0.11% Castro::problem_post_timestep() 2 0.008781 0.01197 0.01529 0.11% Castro::wd_update() 2 0.008758 0.01194 0.01528 0.11% FabArrayBase::getCPC() 2005 0.01 0.01137 0.01521 0.11% amrex::Add() 128 0.01437 0.01448 0.01502 0.11% FabArray::setDomainBndry() 147 0.0004753 0.007781 0.01475 0.10% MLLinOp::define() 19 0.004083 0.007679 0.01134 0.08% Other 2455 0.08112 0.09416 0.1319 0.92% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 14 B 19 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- Cpu Memory Usage: ------------------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------------------------------- Castro::save_data_for_retry() 416 416 1558 KiB 1559 KiB 1559 KiB 2297 KiB 2297 KiB 2297 KiB Castro::construct_ctu_hydro_source() 6400 6400 388 KiB 391 KiB 399 KiB 1156 KiB 1156 KiB 1156 KiB StateData::define() 192 192 1041 KiB 1042 KiB 1042 KiB 1148 KiB 1148 KiB 1148 KiB Castro::initMFs() 256 256 991 KiB 992 KiB 992 KiB 1093 KiB 1093 KiB 1093 KiB Castro::swap_state_time_levels() 160 160 660 KiB 660 KiB 660 KiB 787 KiB 787 KiB 787 KiB Amr::writePlotFile() 64 64 4323 B 4387 B 4910 B 736 KiB 736 KiB 736 KiB Castro::reset_internal_energy(MultiFab) 5120 5120 51 KiB 51 KiB 54 KiB 640 KiB 640 KiB 640 KiB FillPatchIterator::Initialize 4704 4704 12 KiB 14 KiB 16 KiB 500 KiB 500 KiB 500 KiB Castro::initialize_do_advance() 640 640 413 KiB 413 KiB 413 KiB 500 KiB 500 KiB 500 KiB FabArray::ParallelCopy_nowait() 12704 12704 2349 B 4251 B 5614 B 215 KiB 285 KiB 360 KiB AmrLevel::derive() 1152 1152 1342 B 1354 B 1380 B 336 KiB 336 KiB 336 KiB Castro::enforce_min_density() 2528 2528 17 KiB 18 KiB 19 KiB 320 KiB 320 KiB 320 KiB Castro::initialize_advance() 32 32 131 KiB 131 KiB 131 KiB 157 KiB 157 KiB 157 KiB MLMG::prepareForSolve() 6102 6102 10 KiB 10 KiB 12 KiB 102 KiB 108 KiB 126 KiB Castro::buildMetrics() 160 160 106 KiB 106 KiB 106 KiB 117 KiB 117 KiB 117 KiB Castro::construct_old_source() 640 640 263 B 266 B 296 B 112 KiB 112 KiB 112 KiB Castro::construct_new_source() 544 544 444 B 445 B 448 B 112 KiB 112 KiB 112 KiB Amr::writeSmallPlotFile() 64 64 18 B 21 B 37 B 80 KiB 80 KiB 80 KiB Castro::Castro() 128 128 33 KiB 33 KiB 33 KiB 74 KiB 74 KiB 74 KiB Gravity::test_composite_phi() 96 96 56 B 56 B 57 B 52 KiB 52 KiB 52 KiB Gravity::update_max_rhs() 192 192 3 B 73 B 81 B 49 KiB 49 KiB 49 KiB Gravity::get_new_grav_vector() 576 576 115 B 116 B 117 B 45 KiB 45 KiB 45 KiB Gravity::get_old_grav_vector() 640 640 159 B 191 B 210 B 45 KiB 45 KiB 45 KiB Gravity::multilevel_solve_for_new_phi() 64 64 31 KiB 31 KiB 31 KiB 37 KiB 37 KiB 37 KiB Gravity::fill_multipole_BCs() 2432 2432 234 B 241 B 245 B 17 KiB 17 KiB 17 KiB Castro::evaluate_source_change() 6272 6272 1100 B 1107 B 1141 B 16 KiB 16 KiB 16 KiB Gravity::actual_multilevel_solve() 32 32 145 B 145 B 145 B 16 KiB 16 KiB 16 KiB Gravity::solve_for_phi() 544 544 1739 B 1803 B 1834 B 16 KiB 16 KiB 16 KiB MLMG::compResidual() 32 32 0 B 0 B 1 B 16 KiB 16 KiB 16 KiB MLCellLinOp::defineAuxData() 11704 11704 464 B 518 B 720 B 4608 B 5151 B 7152 B BndryData::define() 4864 4864 483 B 484 B 485 B 4864 B 4864 B 4864 B FillBoundary_nowait() 91296 91296 27 B 36 B 47 B 2592 B 3392 B 4192 B AmrMesh::MakeNewGrids() 128 128 0 B 19 B 29 B 2916 B 2916 B 2916 B OwnerMask() 64 64 0 B 0 B 0 B 2592 B 2592 B 2592 B MLMG::addInterpCorrection() 5632 5632 2 B 17 B 27 B 1024 B 1024 B 1024 B amrex::average_down 5632 5632 0 B 0 B 1 B 1024 B 1024 B 1024 B TagBoxArray::mapPRD 64 64 0 B 5 B 7 B 648 B 648 B 648 B MLCGSolver::bicgstab 640 640 0 B 0 B 2 B 0 B 36 B 576 B MLCellLinOp::applyBC() 114375 114375 0 B 0 B 0 B 8 B 8 B 8 B ------------------------------------------------------------------------------------------------------------------------------- AMReX (24.09-21-gc6b4fde07ae1) finalized