Initializing AMReX (24.04-18-ge293ff685199)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.04-18-ge293ff685199) initialized Starting run at 07:53:27 UTC on 2024-04-16. Successfully read inputs file ... Castro git describe: 24.04-14-g3d76cd5a0 AMReX git describe: 24.04-18-ge293ff685 Microphysics git describe: 24.04-7-gd4312a6c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.161327252 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001070674 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010694364 Gravity::multilevel_solve_for_new_phi() time = 0.101765082 Gravity::fill_multipole_BCs() time = 0.010687652 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049016546 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004123023 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.004184551 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.064262913 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004393554 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.063447281 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006365735 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060556025 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007657348 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.05878252 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323308987 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015496282 Gravity::solve_for_phi() time = 0.089933672 on level 0 Castro::construct_new_gravity() time = 0.092133398 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060706994 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.004056208 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059097597 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.320250726 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015328175 Gravity::solve_for_phi() time = 0.088935557 on level 0 Castro::construct_new_gravity() time = 0.091073099 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.05870081 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.003554604 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058567926 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330764641 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015174544 Gravity::solve_for_phi() time = 0.0914302 on level 0 Castro::construct_new_gravity() time = 0.093570371 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.060324133 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002974906 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058938586 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329729077 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015343359 Gravity::solve_for_phi() time = 0.09188498 on level 0 Castro::construct_new_gravity() time = 0.094017242 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.059946514 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.005548435 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.057726561 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.341064989 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015489613 Gravity::solve_for_phi() time = 0.089040325 on level 0 Castro::construct_new_gravity() time = 0.091222277 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.06125649 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002719576 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.060289172 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328531858 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014466617 Gravity::solve_for_phi() time = 0.087560758 on level 0 Castro::construct_new_gravity() time = 0.0897086 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.061636339 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.005710256 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.057915079 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.341507799 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016144107 Gravity::solve_for_phi() time = 0.090748731 on level 0 Castro::construct_new_gravity() time = 0.092821859 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059481795 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.005004843 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.057589068 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.319788578 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014916171 Gravity::solve_for_phi() time = 0.086138051 on level 0 Castro::construct_new_gravity() time = 0.088236208 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.058710407 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002560033 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.057750422 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324417587 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015330366 Gravity::solve_for_phi() time = 0.086037517 on level 0 Castro::construct_new_gravity() time = 0.088129558 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.058759316 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002634928 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.057444483 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326443077 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014831452 Gravity::solve_for_phi() time = 0.086051184 on level 0 Castro::construct_new_gravity() time = 0.088167024 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.058518683 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002736822 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.057600231 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331077776 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01463934 Gravity::solve_for_phi() time = 0.085491602 on level 0 Castro::construct_new_gravity() time = 0.087601774 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.058710277 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002663727 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.057888689 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327690467 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014727789 Gravity::solve_for_phi() time = 0.085462211 on level 0 Castro::construct_new_gravity() time = 0.087683051 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.058838348 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002670777 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.05829467 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334479151 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014986643 Gravity::solve_for_phi() time = 0.106643342 on level 0 Castro::construct_new_gravity() time = 0.108756819 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059152691 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002736565 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.057725748 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327273606 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014862061 Gravity::solve_for_phi() time = 0.085978617 on level 0 Castro::construct_new_gravity() time = 0.088107572 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059027678 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.00269387 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.057320303 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326704974 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01519035 Gravity::solve_for_phi() time = 0.085059406 on level 0 Castro::construct_new_gravity() time = 0.087112491 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.05867196 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002628362 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.057808997 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321138074 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015606585 Gravity::solve_for_phi() time = 0.086605769 on level 0 Castro::construct_new_gravity() time = 0.088664301 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.058725795 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002509096 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.057538778 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325040704 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016013748 Gravity::solve_for_phi() time = 0.08645131 on level 0 Castro::construct_new_gravity() time = 0.088489659 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.058569367 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002783876854 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.82843488 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.047079705 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004139882 seconds Ending run at 07:53:41 UTC on 2024-04-16. Run time = 14.23060139 Run time without initialization = 11.8805135 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.23 ... 14.23 ... 14.23 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3383 5.4277 5.5328 38.88% Amr::InitAmr() 1 1.411 1.411 1.411 9.92% Castro::computeTemp() 80 0.8358 0.9415 1.09 7.66% amrex::Copy() 724 0.7655 0.7752 0.7844 5.51% FabArray::ParallelCopy_finish() 1429 0.06985 0.506 0.6881 4.84% MultiFab::AddProduct() 3439 0.5452 0.5526 0.56 3.94% Castro::normalize_species() 79 0.5322 0.5423 0.5595 3.93% Castro::reset_internal_energy(Fab) 160 0.5101 0.5208 0.5299 3.72% MLPoisson::Fsmooth() 6144 0.3106 0.3396 0.4103 2.88% Castro::initMFs() 1 0.3552 0.3622 0.3775 2.65% FabArray::setVal() 5013 0.3528 0.359 0.3672 2.58% MultiFab::Subtract() 159 0.3385 0.3429 0.3509 2.47% Gravity::fill_multipole_BCs() 19 0.1975 0.2371 0.2704 1.90% check_for_negative_density() 20 0.0775 0.1713 0.2615 1.84% Castro::reset_internal_energy(MultiFab) 80 0.02284 0.06973 0.2532 1.78% FabArray::ParallelCopy_nowait() 1429 0.1857 0.2021 0.222 1.56% FabArray::sum() 3439 0.1862 0.189 0.1928 1.36% FillBoundary_finish() 6380 0.1179 0.1465 0.1701 1.19% Castro::initData() 1 0.003282 0.02626 0.1553 1.09% FillBoundary_nowait() 6380 0.07637 0.1034 0.1327 0.93% MLPoisson::Fapply() 986 0.09331 0.09847 0.1129 0.79% MLCellLinOp::applyBC() 7148 0.04857 0.0627 0.1111 0.78% FabArray::Saxpy() 264 0.06802 0.06958 0.07693 0.54% Castro::enforce_min_density() 79 0.01742 0.03275 0.07284 0.51% Castro::construct_new_gravity_source() 17 0.06865 0.06957 0.07196 0.51% Castro::do_new_sources() 17 0.0003792 0.01164 0.06327 0.44% Castro::sum_integrated_quantities() 2 0.002018 0.05725 0.06118 0.43% FabArray::Xpay() 945 0.0511 0.05371 0.06056 0.43% Castro::problem_post_timestep() 2 1.095e-05 0.003698 0.05898 0.41% MultiFab::contains_nan() 37 0.04534 0.04616 0.0473 0.33% Castro::construct_old_gravity_source() 20 0.04389 0.04467 0.04561 0.32% MLMG::addInterpCorrection() 768 0.0329 0.03554 0.04356 0.31% AmrLevel::derive() 18 0.03967 0.04033 0.04111 0.29% Castro::do_old_sources() 20 0.0005096 0.00837 0.03586 0.25% amrex::average_down 768 0.02413 0.0264 0.0332 0.23% StateData::FillBoundary(geom) 143 0 0.01717 0.03315 0.23% VisMF::Write(FabArray) 4 0.01165 0.01309 0.02511 0.18% Amr::writePlotFile() 2 0.007676 0.01733 0.01954 0.14% MLCellLinOp::defineAuxData() 19 0.01493 0.01554 0.01951 0.14% FabArray::FillBoundary() 6380 0.01335 0.0141 0.0178 0.13% MLCGSolver::bicgstab 8 0 0.001111 0.01778 0.12% Castro::construct_new_source() 102 0.01553 0.01578 0.0162 0.11% FabArray::norminf() 282 0.01091 0.01151 0.01552 0.11% amrex::Add() 128 0.01416 0.01442 0.01509 0.11% MLCellLinOp::smooth() 3072 0.01103 0.01169 0.01405 0.10% Castro::evaluate_source_change() 196 0.01235 0.01274 0.01369 0.10% FabArrayBase::getFB() 6380 0.009652 0.01016 0.01359 0.10% MLMG::ResNormInf() 146 0.003647 0.009448 0.01307 0.09% FillPatchIterator::Initialize 147 0.01234 0.01267 0.01293 0.09% Castro::construct_old_gravity() 20 0.0003695 0.002738 0.01265 0.09% MLMG::prepareForSolve() 18 0.01017 0.01044 0.01177 0.08% FabArray::setDomainBndry() 147 0.000452 0.006209 0.01157 0.08% Castro::construct_old_source() 120 0.009852 0.01013 0.01136 0.08% MLMG::solve() 18 0.000829 0.00548 0.01016 0.07% Castro::wd_update() 2 0.004952 0.007243 0.009315 0.07% MLLinOp::makeSubCommunicator() 19 0.00111 0.005177 0.009268 0.07% Gravity::actual_solve_with_mlmg() 19 0.006702 0.007059 0.008599 0.06% FabArrayBase::getCPC() 2005 0.007182 0.007359 0.008086 0.06% Castro::volWgtSum() 46 0.007382 0.007495 0.007952 0.06% FabArray::mult() 59 0.007348 0.007492 0.007761 0.05% FabArrayBase::CPC::define() 576 0.002184 0.003335 0.006732 0.05% Gravity::get_new_grav_vector() 18 0.006039 0.006156 0.00664 0.05% Gravity::get_old_grav_vector() 20 0.006413 0.00653 0.006634 0.05% amrex::Dot() 142 0 0.0003895 0.006232 0.04% MLCellLinOp::compGrad() 18 0.005811 0.005875 0.005947 0.04% Amr::writeSmallPlotFile() 2 0.003687 0.005329 0.005802 0.04% Castro::volInBoundary() 14 0.003432 0.003724 0.005579 0.04% MultiFab::max() 2 0.0001612 0.002805 0.005371 0.04% MLCellLinOp::apply() 986 0.001989 0.002246 0.005155 0.04% MLCGSolver::ParallelAllReduce 227 0 0.000316 0.005056 0.04% Castro::initialize_do_advance() 20 0.004549 0.004648 0.004847 0.03% FabArray::ParallelCopy() 1429 0.003456 0.003647 0.004227 0.03% MLPoisson::normalize() 79 0 0.0002279 0.003646 0.03% BndryData::define() 19 0.003066 0.003168 0.003413 0.02% AmrLevel::FillPatch() 147 0.002157 0.002226 0.002475 0.02% MLCellLinOp::prepareForSolve() 19 0.001647 0.001788 0.002244 0.02% MLLinOp::defineGrids() 19 0.001776 0.001891 0.002061 0.01% MLCellLinOp::correctionResidual() 768 0.001825 0.001897 0.002026 0.01% Castro::construct_new_gravity() 17 0.0002955 0.0005619 0.00199 0.01% MLMG::mgVcycle() 128 0.001581 0.001654 0.001842 0.01% MLCellLinOp::defineBC() 19 0.001495 0.001534 0.00178 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001285 0.001542 0.001769 0.01% MLMG:computeResOfCorrection() 768 0.001353 0.00142 0.001623 0.01% Gravity::solve_for_phi() 17 0.0008133 0.000997 0.001519 0.01% FabArrayBase::FB::FB() 75 0.0002769 0.0006802 0.001502 0.01% StateData::define() 6 0.001315 0.001343 0.001384 0.01% Castro::save_data_for_retry() 3 0.001276 0.001312 0.001342 0.01% main() 1 0.0009714 0.001113 0.001252 0.01% Castro::locWgtSum() 6 0.001138 0.001157 0.001182 0.01% MLMG::actualBottomSolve() 128 0.0001323 0.0002017 0.001147 0.01% StateDataPhysBCFunct::() 147 0.000672 0.0008139 0.0009756 0.01% Castro::subcycle_advance_ctu() 1 0.0001898 0.0002517 0.0009304 0.01% MLCellLinOp::setLevelBC() 19 0.0005371 0.0006593 0.0008694 0.01% TagBoxArray::collate() 2 0.0001391 0.0004419 0.0007922 0.01% MLMG::mgVcycle_down::3 128 0.0005621 0.0006195 0.0007689 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006843 0.0007116 0.0007682 0.01% MLMG::mgVcycle_down::2 128 0.0006017 0.0006654 0.0007566 0.01% MLMG::mgVcycle_down::4 128 0.0005548 0.0005844 0.0007449 0.01% MLMG::mgVcycle_down::5 128 0.0005696 0.0006015 0.0007201 0.01% MLMG::mgVcycle_down::1 128 0.0006449 0.0006653 0.0007055 0.00% MLMG::mgVcycle_down::0 128 0.0006412 0.0006656 0.0007051 0.00% Castro::buildMetrics() 1 0.0005667 0.0005854 0.0006041 0.00% Castro::Castro() 1 0.0004508 0.000507 0.0005817 0.00% Castro::apply_tagging_restrictions() 2 0.0004283 0.000491 0.0005622 0.00% Castro::do_advance_ctu() 20 0.0004157 0.0004458 0.0005531 0.00% Gravity::applyMetricTerms() 2 0.0004912 0.000504 0.0005229 0.00% MLMG::mgVcycle_up::0 128 0.0004578 0.000479 0.0005212 0.00% AmrMesh::MakeNewGrids() 2 0.0004831 0.0005017 0.0005153 0.00% MLMG::mgVcycle_up::1 128 0.0004409 0.000469 0.0005128 0.00% Castro::clean_state() 79 0.0004285 0.0004552 0.0005097 0.00% FillPatchSingleLevel 147 0.0004684 0.0004799 0.0004966 0.00% MLMG::mgVcycle_up::2 128 0.0003769 0.0004213 0.0004951 0.00% MLMG::mgVcycle_up::5 128 0.0003918 0.0004093 0.0004889 0.00% MLMG::mgVcycle_up::3 128 0.0003735 0.0003961 0.000485 0.00% MLMG::mgVcycle_up::4 128 0.0003781 0.0003953 0.0004694 0.00% MLCellLinOp::solutionResidual() 147 0.0004218 0.0004392 0.0004691 0.00% makeSFC 95 0.0003816 0.0004072 0.0004565 0.00% Castro::swap_state_time_levels() 8 0.0004177 0.0004325 0.0004458 0.00% MLMG::oneIter() 128 0.0003767 0.0003944 0.0004296 0.00% Castro::volProductSum() 2 0.0003996 0.0004098 0.0004207 0.00% Castro::enforce_consistent_e() 1 0.0003653 0.0003762 0.000417 0.00% MLLinOp::makeAgglomeratedDMap 19 0.000328 0.0003439 0.0004154 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002153 0.0002279 0.0002648 0.00% MLMG::mgVcycle_bottom 128 0.0002217 0.0002322 0.0002641 0.00% MLMG::computeResidual() 128 0.000236 0.0002442 0.000254 0.00% DistributionMapping::Distribute() 95 0.0002127 0.0002221 0.000243 0.00% Castro::finalize_do_advance() 17 0.0001522 0.0001742 0.0001981 0.00% MLPoisson::define() 19 0.0001409 0.0001703 0.0001976 0.00% DistributionMapping::LeastUsedCPUs() 1 5.208e-05 0.0001697 0.0001918 0.00% Castro::retry_advance_ctu() 11 6.224e-05 7.586e-05 0.0001902 0.00% Gravity::update_max_rhs() 2 0.0001594 0.0001647 0.000179 0.00% OwnerMask() 2 0.0001359 0.0001543 0.0001708 0.00% MLMG::compResidual() 1 0.0001566 0.0001613 0.0001657 0.00% Amr::coarseTimeStep() 1 0.0001311 0.0001523 0.0001576 0.00% Gravity::test_composite_phi() 1 9.323e-05 0.0001022 0.0001531 0.00% Castro::initialize_advance() 1 0.0001016 0.0001108 0.0001443 0.00% Amr::grid_places() 2 7.471e-05 9.656e-05 0.0001436 0.00% Castro::check_for_nan() 37 0.0001031 0.000111 0.0001332 0.00% Castro::enforce_speed_limit() 79 0.000105 0.0001148 0.0001327 0.00% TagBoxArray::mapPRD 2 0.0001083 0.0001135 0.0001322 0.00% Amr::defBaseLevel() 1 9.632e-05 0.0001111 0.0001235 0.00% Castro::apply_source_to_state() 37 9.702e-05 0.0001025 0.0001179 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.586e-05 7.788e-05 0.0001093 0.00% Castro::apply_problem_tags() 2 9.22e-05 9.503e-05 0.0001052 0.00% Amr::initSubcycle() 1 5.794e-05 6.491e-05 9.824e-05 0.00% MultiFab::Swap() 5 6.805e-05 7.324e-05 8.948e-05 0.00% MLLinOp::define() 19 7.415e-05 8.031e-05 8.809e-05 0.00% Amr::FinalizeInit() 1 8.605e-06 1.614e-05 8.772e-05 0.00% knapsack() 1 5.715e-05 6.061e-05 7.943e-05 0.00% MLPoisson::prepareForSolve() 19 6.648e-05 7.055e-05 7.512e-05 0.00% Castro::create_source_corrector() 17 5.497e-05 6.234e-05 7.445e-05 0.00% Castro::expand_state() 20 5.213e-05 5.549e-05 6.201e-05 0.00% Gravity::swapTimeLevels() 8 3.376e-05 3.696e-05 5.273e-05 0.00% Castro::derive() 18 3.926e-05 4.114e-05 4.527e-05 0.00% MLMG::getGradSolution() 18 3.959e-05 4.146e-05 4.465e-05 0.00% MLMG::computeMLResidual() 18 3.981e-05 4.203e-05 4.415e-05 0.00% Castro::construct_old_rotation_source() 20 2.955e-05 3.146e-05 4.239e-05 0.00% MLMG::MLResNormInf() 18 3.315e-05 3.56e-05 3.902e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.257e-05 3.427e-05 3.563e-05 0.00% MLMG::MLRhsNormInf() 18 3.083e-05 3.162e-05 3.307e-05 0.00% Amr::regrid() 1 1.039e-05 1.261e-05 3.287e-05 0.00% Gravity::actual_multilevel_solve() 1 2.726e-05 2.833e-05 3.011e-05 0.00% Castro::construct_new_rotation_source() 17 2.14e-05 2.241e-05 2.535e-05 0.00% Castro::finalize_advance() 1 1.675e-05 1.828e-05 2.37e-05 0.00% Castro::computeInitialDt() 2 6.178e-06 7.999e-06 2.319e-05 0.00% Amr::timeStep() 1 1.129e-05 1.39e-05 2.022e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.637e-05 1.781e-05 2.01e-05 0.00% Castro::post_init() 1 1.192e-05 1.271e-05 1.638e-05 0.00% Castro::post_regrid() 2 1.05e-05 1.183e-05 1.48e-05 0.00% Castro::estTimeStep() 10 1.227e-05 1.343e-05 1.464e-05 0.00% Castro::advance() 1 7.233e-06 9.305e-06 1.404e-05 0.00% Amr::InitializeInit() 1 7.005e-06 8.109e-06 1.325e-05 0.00% Amr::bldFineLevels() 1 6.702e-06 7.255e-06 8.648e-06 0.00% Amr::init() 1 6.361e-06 7.046e-06 7.942e-06 0.00% BoxList::parallelComplementIn() 4 6.93e-06 7.257e-06 7.728e-06 0.00% Castro::gwstrain() 2 4.23e-06 4.738e-06 7.315e-06 0.00% Castro::post_timestep() 1 5.731e-06 6.111e-06 7.03e-06 0.00% Castro::errorEst() 2 6.082e-06 6.287e-06 6.789e-06 0.00% BoxList::complementIn 4 6.081e-06 6.322e-06 6.709e-06 0.00% Amr::initialInit() 1 2.915e-06 3.309e-06 6.61e-06 0.00% Gravity::set_mass_offset() 2 4.279e-06 4.645e-06 4.93e-06 0.00% Castro::FluxRegCrseInit 1 1.649e-06 1.865e-06 2.134e-06 0.00% Castro::FluxRegFineAdd() 1 1.439e-06 1.571e-06 2.065e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.23 14.23 14.23 100.00% Amr::coarseTimeStep() 1 11.88 11.88 11.88 83.48% Amr::timeStep() 1 11.83 11.83 11.83 83.12% Castro::advance() 1 11.77 11.77 11.77 82.71% Castro::subcycle_advance_ctu() 1 11.72 11.72 11.72 82.37% Castro::do_advance_ctu() 20 11.68 11.68 11.68 82.11% Castro::construct_ctu_hydro_source() 20 6.345 6.374 6.403 45.00% Castro::clean_state() 79 3.676 3.774 3.903 27.43% Castro::computeTemp() 80 2.35 2.48 2.684 18.86% Castro::reset_internal_energy(MultiFab) 80 1.473 1.539 1.7 11.95% Gravity::solve_phi_with_mlmg() 19 1.536 1.578 1.616 11.36% Castro::construct_new_gravity() 17 1.463 1.503 1.54 10.82% Gravity::solve_for_phi() 17 1.424 1.466 1.504 10.57% Castro::initialize_do_advance() 20 1.375 1.4 1.431 10.06% Amr::InitAmr() 1 1.411 1.411 1.411 9.92% Gravity::actual_solve_with_mlmg() 19 1.334 1.338 1.343 9.43% MLMG::solve() 18 1.28 1.287 1.288 9.05% Castro::do_old_sources() 20 1.138 1.159 1.17 8.22% MLMG::oneIter() 128 1.142 1.145 1.149 8.08% MLMG::mgVcycle() 128 1.127 1.13 1.134 7.97% Castro::do_new_sources() 17 0.945 0.975 1.009 7.09% Castro::evaluate_source_change() 196 0.9447 0.9575 0.9713 6.83% Amr::init() 1 0.9381 0.9382 0.9382 6.59% FabArray::ParallelCopy() 1429 0.2961 0.7311 0.9142 6.42% Amr::initialInit() 1 0.8841 0.8842 0.8843 6.21% Castro::enforce_min_density() 79 0.7819 0.8074 0.8377 5.89% amrex::Copy() 724 0.7655 0.7752 0.7844 5.51% MLCellLinOp::smooth() 3072 0.5697 0.6212 0.7539 5.30% FabArray::ParallelCopy_finish() 1429 0.06985 0.506 0.6881 4.84% AmrLevel::FillPatch() 147 0.4847 0.5534 0.613 4.31% Amr::InitializeInit() 1 0.4391 0.5004 0.5986 4.21% Amr::defBaseLevel() 1 0.4391 0.5004 0.5986 4.21% MultiFab::AddProduct() 3439 0.5452 0.5526 0.56 3.94% Castro::normalize_species() 79 0.5322 0.5423 0.5595 3.93% Castro::reset_internal_energy(Fab) 160 0.5101 0.5208 0.5299 3.72% Amr::FinalizeInit() 1 0.2856 0.3838 0.4451 3.13% MLMG::mgVcycle_up::1 128 0.09925 0.2717 0.4449 3.13% FillPatchIterator::Initialize 147 0.3098 0.3767 0.439 3.08% FillPatchIterator::FillFromLevel0() 147 0.2853 0.3578 0.4224 2.97% FillPatchSingleLevel 147 0.2845 0.3571 0.4217 2.96% MLCellLinOp::applyBC() 7148 0.298 0.3376 0.4172 2.93% MLPoisson::Fsmooth() 6144 0.3106 0.3396 0.4103 2.88% MLMG::addInterpCorrection() 768 0.06357 0.3156 0.388 2.73% Castro::Castro() 1 0.3605 0.3678 0.3845 2.70% Castro::initMFs() 1 0.3554 0.3623 0.3777 2.65% FabArray::setVal() 5013 0.3528 0.359 0.3672 2.58% MultiFab::Subtract() 159 0.3385 0.3429 0.3509 2.47% FabArray::FillBoundary() 6380 0.2439 0.2749 0.3091 2.17% MLMG::mgVcycle_up::2 128 0.01067 0.1204 0.2884 2.03% Gravity::fill_multipole_BCs() 19 0.1996 0.2391 0.2724 1.91% MLMG::mgVcycle_down::0 128 0.2645 0.268 0.2716 1.91% check_for_negative_density() 20 0.0775 0.1713 0.2615 1.84% FabArray::ParallelCopy_nowait() 1429 0.2042 0.2215 0.2425 1.70% Castro::expand_state() 20 0.1791 0.209 0.2406 1.69% Castro::initData() 1 0.07681 0.1308 0.2317 1.63% Amr::bldFineLevels() 1 0.04643 0.1445 0.2046 1.44% MLCellLinOp::apply() 986 0.1555 0.1666 0.2042 1.43% MLMG::mgVcycle_up::0 128 0.198 0.1999 0.2015 1.42% Castro::post_init() 1 0.1932 0.1959 0.1984 1.39% FabArray::sum() 3439 0.1862 0.189 0.1928 1.36% MLMG::mgVcycle_up::3 128 0.01062 0.02436 0.1898 1.33% FillBoundary_finish() 6380 0.1179 0.1465 0.1701 1.19% Amr::grid_places() 2 0.002899 0.1011 0.1624 1.14% AmrMesh::MakeNewGrids() 2 0.002813 0.101 0.1623 1.14% TagBoxArray::mapPRD 2 0.0008648 0.09934 0.1609 1.13% MLMG:computeResOfCorrection() 768 0.1167 0.1271 0.1521 1.07% MLCellLinOp::correctionResidual() 768 0.1153 0.1256 0.1505 1.06% FillBoundary_nowait() 6380 0.08632 0.1143 0.1441 1.01% MLMG::mgVcycle_down::1 128 0.124 0.1289 0.1368 0.96% Castro::construct_new_source() 102 0.1232 0.1247 0.1279 0.90% MLPoisson::Fapply() 986 0.09331 0.09847 0.1129 0.79% MLCellLinOp::solutionResidual() 147 0.08911 0.09524 0.1024 0.72% Gravity::multilevel_solve_for_new_phi() 1 0.1017 0.1017 0.1018 0.72% Gravity::actual_multilevel_solve() 1 0.1016 0.1017 0.1017 0.71% Amr::writePlotFile() 2 0.09668 0.09678 0.09679 0.68% Castro::post_regrid() 2 0.08423 0.08678 0.0894 0.63% Castro::create_source_corrector() 17 0.04861 0.06143 0.0803 0.56% Castro::sum_integrated_quantities() 2 0.02122 0.07644 0.08012 0.56% Castro::construct_old_source() 120 0.07658 0.07793 0.07975 0.56% MLMG::computeResidual() 128 0.07699 0.07815 0.07905 0.56% FabArray::Saxpy() 264 0.06802 0.06958 0.07693 0.54% MLMG::mgVcycle_bottom 128 0.000354 0.005138 0.07668 0.54% MLMG::actualBottomSolve() 128 0.0001323 0.004906 0.07641 0.54% Castro::construct_old_gravity() 20 0.04413 0.05644 0.0757 0.53% MLMG::mgVcycle_down::2 128 0.01245 0.04194 0.07498 0.53% MLCGSolver::bicgstab 8 0 0.004673 0.07476 0.53% Castro::construct_new_gravity_source() 17 0.06865 0.06957 0.07196 0.51% Castro::derive() 18 0.06754 0.06871 0.0697 0.49% AmrLevel::derive() 18 0.0675 0.06867 0.06965 0.49% Castro::problem_post_timestep() 2 0.009376 0.01466 0.06817 0.48% Gravity::get_old_grav_vector() 20 0.04271 0.0537 0.06312 0.44% Castro::post_timestep() 1 0.05776 0.05948 0.06141 0.43% MLMG::mgVcycle_down::3 128 0.01184 0.01815 0.06074 0.43% FabArray::Xpay() 945 0.0511 0.05371 0.06056 0.43% amrex::average_down 768 0.03226 0.03984 0.05811 0.41% Castro::initialize_advance() 1 0.04787 0.04967 0.05156 0.36% Castro::check_for_nan() 37 0.04544 0.04627 0.04743 0.33% MultiFab::contains_nan() 37 0.04534 0.04616 0.0473 0.33% Castro::construct_old_gravity_source() 20 0.04389 0.04467 0.04561 0.32% Amr::regrid() 1 0.04321 0.0444 0.0452 0.32% MLPoisson::define() 19 0.0293 0.03437 0.03991 0.28% Castro::retry_advance_ctu() 11 0.03568 0.03656 0.03918 0.28% Gravity::get_new_grav_vector() 18 0.03501 0.03594 0.03907 0.27% MLMG::mgVcycle_down::4 128 0.01174 0.01357 0.03651 0.26% StateDataPhysBCFunct::() 147 0.000672 0.01799 0.03409 0.24% StateData::FillBoundary(geom) 143 0 0.01717 0.03315 0.23% Castro::apply_source_to_state() 37 0.02773 0.02835 0.03086 0.22% MLMG::mgVcycle_up::4 128 0.01068 0.01198 0.02831 0.20% MLCellLinOp::defineAuxData() 19 0.01901 0.02033 0.02672 0.19% VisMF::Write(FabArray) 4 0.01165 0.01309 0.02511 0.18% MLMG::prepareForSolve() 18 0.02048 0.02137 0.02476 0.17% MLMG::mgVcycle_down::5 128 0.01175 0.0128 0.0247 0.17% MLMG::computeMLResidual() 18 0.01073 0.01659 0.02299 0.16% MLMG::ResNormInf() 146 0.01383 0.01919 0.02276 0.16% MLMG::mgVcycle_up::5 128 0.0108 0.01164 0.02104 0.15% Castro::save_data_for_retry() 3 0.01843 0.01875 0.01898 0.13% FabArray::norminf() 282 0.01091 0.01151 0.01552 0.11% FabArrayBase::getFB() 6380 0.009958 0.01084 0.01509 0.11% amrex::Add() 128 0.01416 0.01442 0.01509 0.11% FabArrayBase::getCPC() 2005 0.009366 0.01069 0.01482 0.10% Gravity::test_composite_phi() 1 0.01436 0.01439 0.01443 0.10% Castro::wd_update() 2 0.009194 0.01097 0.01283 0.09% MLLinOp::define() 19 0.00409 0.008121 0.0124 0.09% MLLinOp::defineGrids() 19 0.004004 0.008041 0.01232 0.09% FabArray::setDomainBndry() 147 0.000452 0.006209 0.01157 0.08% MLLinOp::makeSubCommunicator() 19 0.00111 0.005177 0.009268 0.07% Amr::writeSmallPlotFile() 2 0.008672 0.008674 0.008677 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005264 0.008423 0.06% Castro::volWgtSum() 46 0.007382 0.007495 0.007952 0.06% MLMG::getGradSolution() 18 0.007447 0.007702 0.007929 0.06% MLCellLinOp::compGrad() 18 0.007404 0.00766 0.007888 0.06% FabArray::mult() 59 0.007348 0.007492 0.007761 0.05% FabArrayBase::CPC::define() 576 0.002184 0.003335 0.006732 0.05% Gravity::update_max_rhs() 2 0.001426 0.004069 0.006619 0.05% amrex::Dot() 142 0 0.0003895 0.006232 0.04% MLCellLinOp::defineBC() 19 0.005529 0.005744 0.006127 0.04% Castro::volInBoundary() 14 0.003432 0.003724 0.005579 0.04% MultiFab::max() 2 0.0001612 0.002805 0.005371 0.04% BndryData::define() 19 0.004031 0.00421 0.004372 0.03% MLPoisson::normalize() 79 0 0.0002279 0.003646 0.03% MLPoisson::prepareForSolve() 19 0.00172 0.001859 0.002318 0.02% MLCellLinOp::prepareForSolve() 19 0.001647 0.001788 0.002244 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001285 0.001542 0.001769 0.01% FabArrayBase::FB::FB() 75 0.0002769 0.0006802 0.001502 0.01% AmrLevel::AmrLevel(dm) 1 0.001351 0.001377 0.001419 0.01% StateData::define() 6 0.001315 0.001343 0.001384 0.01% MLMG::compResidual() 1 0.000954 0.001151 0.001377 0.01% Gravity::swapTimeLevels() 8 0.001193 0.001217 0.001305 0.01% MLMG::MLResNormInf() 18 0.001242 0.00126 0.001282 0.01% MLMG::MLRhsNormInf() 18 0.00121 0.001222 0.001246 0.01% Castro::locWgtSum() 6 0.001138 0.001157 0.001182 0.01% MLLinOp::makeAgglomeratedDMap 19 0.000929 0.0009732 0.001115 0.01% MLCellLinOp::setLevelBC() 19 0.0005371 0.0006593 0.0008694 0.01% TagBoxArray::collate() 2 0.0001391 0.0004419 0.0007922 0.01% makeSFC 95 0.0005973 0.0006293 0.0006995 0.00% Castro::buildMetrics() 1 0.0006305 0.0006483 0.0006675 0.00% Castro::errorEst() 2 0.0005322 0.0005923 0.0006616 0.00% Castro::apply_tagging_restrictions() 2 0.0004283 0.000491 0.0005622 0.00% Gravity::applyMetricTerms() 2 0.0004912 0.000504 0.0005229 0.00% Castro::swap_state_time_levels() 8 0.0004177 0.0004325 0.0004458 0.00% Castro::volProductSum() 2 0.0003996 0.0004098 0.0004207 0.00% Castro::enforce_consistent_e() 1 0.0003653 0.0003762 0.000417 0.00% Castro::finalize_advance() 1 0.0002522 0.0002615 0.0002763 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001259 0.0002481 0.0002717 0.00% DistributionMapping::Distribute() 95 0.0002127 0.0002221 0.000243 0.00% Castro::finalize_do_advance() 17 0.000162 0.0001846 0.0002095 0.00% DistributionMapping::LeastUsedCPUs() 1 5.208e-05 0.0001697 0.0001918 0.00% OwnerMask() 2 0.0001359 0.0001543 0.0001708 0.00% Castro::enforce_speed_limit() 79 0.000105 0.0001148 0.0001327 0.00% Castro::apply_problem_tags() 2 9.22e-05 9.503e-05 0.0001052 0.00% Amr::initSubcycle() 1 5.794e-05 6.491e-05 9.824e-05 0.00% MultiFab::Swap() 5 6.805e-05 7.324e-05 8.948e-05 0.00% knapsack() 1 5.715e-05 6.061e-05 7.943e-05 0.00% Castro::construct_old_rotation_source() 20 2.955e-05 3.146e-05 4.239e-05 0.00% Castro::computeInitialDt() 2 9.139e-06 1.102e-05 2.71e-05 0.00% Castro::construct_new_rotation_source() 17 2.14e-05 2.241e-05 2.535e-05 0.00% Castro::estTimeStep() 10 1.227e-05 1.343e-05 1.464e-05 0.00% BoxList::parallelComplementIn() 4 1.316e-05 1.358e-05 1.427e-05 0.00% Castro::gwstrain() 2 4.23e-06 4.738e-06 7.315e-06 0.00% BoxList::complementIn 4 6.081e-06 6.322e-06 6.709e-06 0.00% Gravity::set_mass_offset() 2 4.279e-06 4.645e-06 4.93e-06 0.00% Castro::FluxRegCrseInit 1 1.649e-06 1.865e-06 2.134e-06 0.00% Castro::FluxRegFineAdd() 1 1.439e-06 1.571e-06 2.065e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 10 B 13 B 17 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-18-ge293ff685199) finalized