Initializing AMReX (24.04-14-g6c6247554f27)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.04-14-g6c6247554f27) initialized Starting run at 08:10:04 UTC on 2024-04-11. Successfully read inputs file ... Castro git describe: 24.04-13-g88d497647 AMReX git describe: 24.04-14-g6c6247554 Microphysics git describe: 24.04-7-gd4312a6c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.179403601 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001065631 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.011560465 Gravity::multilevel_solve_for_new_phi() time = 0.107912996 Gravity::fill_multipole_BCs() time = 0.0107263 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.052483127 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.00762503 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.00275458 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.06824355 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.008572885 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.065744238 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.00600816 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.062531408 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004859746 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.057810402 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.315145914 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014185356 Gravity::solve_for_phi() time = 0.083966841 on level 0 Castro::construct_new_gravity() time = 0.086164734 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.06362163 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002751381 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.057780152 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.314892203 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.013908985 Gravity::solve_for_phi() time = 0.083583488 on level 0 Castro::construct_new_gravity() time = 0.085724524 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.058416612 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.00255152 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.057518063 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.320082392 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014095504 Gravity::solve_for_phi() time = 0.083425574 on level 0 Castro::construct_new_gravity() time = 0.085469794 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.058249975 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.007365685 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.096155768 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329477626 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015644096 Gravity::solve_for_phi() time = 0.089803768 on level 0 Castro::construct_new_gravity() time = 0.091893529 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.058350506 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002800641 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.05762925 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330581778 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014801818 Gravity::solve_for_phi() time = 0.085605951 on level 0 Castro::construct_new_gravity() time = 0.087728317 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.058722443 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002756247 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.057929334 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324700029 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014435606 Gravity::solve_for_phi() time = 0.084806575 on level 0 Castro::construct_new_gravity() time = 0.086923033 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.058375807 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002728299 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.057840997 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.366768171 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015364795 Gravity::solve_for_phi() time = 0.087580705 on level 0 Castro::construct_new_gravity() time = 0.089810641 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.058976878 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002695868 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058073515 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328443383 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015640218 Gravity::solve_for_phi() time = 0.088215396 on level 0 Castro::construct_new_gravity() time = 0.090338092 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.058923999 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002655305 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.057949338 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335056397 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017338015 Gravity::solve_for_phi() time = 0.087579684 on level 0 Castro::construct_new_gravity() time = 0.089716137 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059702913 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002759602 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058357834 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32677405 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015228436 Gravity::solve_for_phi() time = 0.085461008 on level 0 Castro::construct_new_gravity() time = 0.087518528 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.058646864 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002712453 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058074804 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330863875 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015364574 Gravity::solve_for_phi() time = 0.085214302 on level 0 Castro::construct_new_gravity() time = 0.08726528 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.058107914 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002711135 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058135462 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325310761 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015567038 Gravity::solve_for_phi() time = 0.085448991 on level 0 Castro::construct_new_gravity() time = 0.087561736 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.05882893 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002798146 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058089882 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331571149 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016630515 Gravity::solve_for_phi() time = 0.087816951 on level 0 Castro::construct_new_gravity() time = 0.089865796 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059821266 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003262997 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059548796 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331787729 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016541029 Gravity::solve_for_phi() time = 0.087256152 on level 0 Castro::construct_new_gravity() time = 0.089314457 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.060006376 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.010627052 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.076013984 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.350375961 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016316388 Gravity::solve_for_phi() time = 0.086923688 on level 0 Castro::construct_new_gravity() time = 0.088993812 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.05971987 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.003260599 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059391903 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336462394 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01691937 Gravity::solve_for_phi() time = 0.092222379 on level 0 Castro::construct_new_gravity() time = 0.094345347 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.065621031 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.004176468 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.061818164 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.34788692 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016634591 Gravity::solve_for_phi() time = 0.093727819 on level 0 Castro::construct_new_gravity() time = 0.095799339 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.061522584 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002756911627 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.94795264 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.052807521 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.007064436 seconds Ending run at 08:10:18 UTC on 2024-04-11. Run time = 14.31744763 Run time without initialization = 12.00949486 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.32 ... 14.32 ... 14.32 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3832 5.4476 5.6139 39.21% Amr::InitAmr() 1 1.387 1.387 1.388 9.69% Castro::computeTemp() 80 0.8248 0.9415 1.109 7.75% FabArray::ParallelCopy_finish() 1429 0.07246 0.5973 0.8059 5.63% amrex::Copy() 724 0.7677 0.7765 0.7932 5.54% MultiFab::AddProduct() 3439 0.5465 0.551 0.5628 3.93% Castro::normalize_species() 79 0.5356 0.542 0.5607 3.92% Castro::reset_internal_energy(Fab) 160 0.5123 0.5183 0.53 3.70% MLPoisson::Fsmooth() 6144 0.316 0.3429 0.4196 2.93% Castro::initMFs() 1 0.3557 0.3656 0.3835 2.68% FabArray::setVal() 5013 0.3529 0.3602 0.3739 2.61% MultiFab::Subtract() 159 0.3348 0.3375 0.3444 2.41% Gravity::fill_multipole_BCs() 19 0.1978 0.239 0.2782 1.94% check_for_negative_density() 20 0.08552 0.2136 0.2723 1.90% FabArray::ParallelCopy_nowait() 1429 0.1915 0.204 0.2259 1.58% Castro::reset_internal_energy(MultiFab) 80 0.02268 0.07278 0.2205 1.54% FabArray::sum() 3439 0.1804 0.1818 0.1851 1.29% Castro::initData() 1 0.003286 0.02686 0.1572 1.10% FillBoundary_finish() 6380 0.1085 0.1241 0.1423 0.99% FillBoundary_nowait() 6380 0.07893 0.1031 0.1315 0.92% MLPoisson::Fapply() 986 0.09448 0.09903 0.1161 0.81% MLCellLinOp::applyBC() 7148 0.0466 0.06216 0.1066 0.74% Castro::do_new_sources() 17 0.0003601 0.01391 0.07933 0.55% FabArray::Saxpy() 264 0.06762 0.0693 0.07769 0.54% Castro::enforce_min_density() 79 0.0178 0.03659 0.07673 0.54% Castro::construct_new_gravity_source() 17 0.06799 0.0694 0.07083 0.49% FabArray::Xpay() 945 0.05136 0.05375 0.06225 0.43% Castro::do_old_sources() 20 0.0004941 0.01329 0.06146 0.43% Castro::construct_old_gravity_source() 20 0.04578 0.0464 0.04915 0.34% MultiFab::contains_nan() 37 0.0444 0.04511 0.04696 0.33% MLMG::addInterpCorrection() 768 0.03374 0.0362 0.04483 0.31% AmrLevel::derive() 18 0.04018 0.04087 0.04175 0.29% StateData::FillBoundary(geom) 143 0 0.01733 0.03381 0.24% amrex::average_down 768 0.0243 0.02624 0.03275 0.23% VisMF::Write(FabArray) 4 0.01513 0.01708 0.03156 0.22% Amr::writePlotFile() 2 0.009418 0.02381 0.02687 0.19% Castro::wd_update() 2 0.0069 0.01474 0.0203 0.14% Castro::construct_old_gravity() 20 0.0003976 0.006193 0.01865 0.13% MLCellLinOp::defineAuxData() 19 0.01461 0.01534 0.01833 0.13% FabArray::FillBoundary() 6380 0.01336 0.01396 0.01726 0.12% MLCGSolver::bicgstab 8 0 0.00106 0.01697 0.12% FabArray::norminf() 282 0.01072 0.01123 0.01617 0.11% Castro::construct_new_source() 102 0.01546 0.01567 0.016 0.11% amrex::Add() 128 0.01423 0.01436 0.01476 0.10% FillPatchIterator::Initialize 147 0.01259 0.01309 0.01394 0.10% Castro::evaluate_source_change() 196 0.01248 0.01277 0.01356 0.09% MLCellLinOp::smooth() 3072 0.01135 0.01179 0.0135 0.09% FabArrayBase::getFB() 6380 0.009761 0.01008 0.01281 0.09% MLMG::ResNormInf() 146 0.007846 0.009877 0.01204 0.08% Castro::construct_old_source() 120 0.009813 0.01012 0.01184 0.08% FabArray::setDomainBndry() 147 0.0004572 0.006154 0.01178 0.08% MLMG::prepareForSolve() 18 0.01023 0.01056 0.01159 0.08% Amr::writeSmallPlotFile() 2 0.007121 0.009363 0.009749 0.07% MLLinOp::makeSubCommunicator() 19 0.001392 0.004695 0.008546 0.06% Gravity::actual_solve_with_mlmg() 19 0.006743 0.007102 0.008345 0.06% MLMG::solve() 18 0.0007694 0.004044 0.008029 0.06% FabArrayBase::getCPC() 2005 0.0071 0.007394 0.007901 0.06% FabArray::mult() 59 0.007425 0.00752 0.007718 0.05% Castro::volWgtSum() 46 0.007203 0.007371 0.007617 0.05% Gravity::get_old_grav_vector() 20 0.006349 0.00655 0.006767 0.05% Gravity::get_new_grav_vector() 18 0.005985 0.0061 0.00653 0.05% FabArrayBase::CPC::define() 576 0.002148 0.003304 0.006473 0.05% MLCellLinOp::compGrad() 18 0.005851 0.006001 0.006462 0.05% amrex::Dot() 142 0 0.0003898 0.006236 0.04% Castro::initialize_do_advance() 20 0.004543 0.00517 0.005909 0.04% Castro::volInBoundary() 14 0.003419 0.003738 0.005679 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003151 0.005041 0.04% MLCellLinOp::apply() 986 0.002002 0.002235 0.004981 0.03% MultiFab::max() 2 0.0001666 0.002505 0.00475 0.03% FabArray::ParallelCopy() 1429 0.003444 0.003584 0.004012 0.03% MLPoisson::normalize() 79 0 0.0002133 0.003413 0.02% BndryData::define() 19 0.003053 0.003121 0.003241 0.02% Castro::sum_integrated_quantities() 2 0.001693 0.0023 0.002688 0.02% AmrLevel::FillPatch() 147 0.002095 0.00225 0.002459 0.02% MLLinOp::defineGrids() 19 0.001745 0.001898 0.002241 0.02% MLCellLinOp::prepareForSolve() 19 0.001647 0.001787 0.002164 0.02% main() 1 0.0009883 0.001436 0.002149 0.02% MLCellLinOp::correctionResidual() 768 0.00184 0.001886 0.002043 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001333 0.001552 0.001824 0.01% MLMG::mgVcycle() 128 0.001585 0.001637 0.001807 0.01% Castro::save_data_for_retry() 3 0.001275 0.001439 0.001751 0.01% MLCellLinOp::defineBC() 19 0.001478 0.00153 0.001734 0.01% StateData::define() 6 0.00135 0.001475 0.001609 0.01% MLMG:computeResOfCorrection() 768 0.001383 0.001427 0.001579 0.01% TagBoxArray::collate() 2 0.0001779 0.0007781 0.001527 0.01% Gravity::solve_for_phi() 17 0.0008128 0.001044 0.001523 0.01% Castro::construct_new_gravity() 17 0.0002935 0.000565 0.001507 0.01% FabArrayBase::FB::FB() 75 0.0002796 0.0006711 0.001473 0.01% Castro::locWgtSum() 6 0.001118 0.00114 0.001176 0.01% MLMG::actualBottomSolve() 128 0.0001333 0.0001972 0.001121 0.01% StateDataPhysBCFunct::() 147 0.000668 0.0008409 0.001061 0.01% MLCellLinOp::setLevelBC() 19 0.0005221 0.000663 0.0008774 0.01% Castro::subcycle_advance_ctu() 1 0.0001873 0.0002683 0.0008683 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006848 0.0007194 0.0007517 0.01% MLMG::mgVcycle_down::3 128 0.0005728 0.000618 0.0007321 0.01% MLMG::mgVcycle_down::2 128 0.0006124 0.0006587 0.0007266 0.01% Castro::swap_state_time_levels() 8 0.0005793 0.0006559 0.0007192 0.01% MLMG::mgVcycle_down::5 128 0.00058 0.0005958 0.0006983 0.00% MLMG::mgVcycle_down::4 128 0.0005563 0.0005794 0.000696 0.00% DistributionMapping::LeastUsedCPUs() 1 4.415e-05 0.0006179 0.0006886 0.00% MLMG::mgVcycle_down::0 128 0.0006487 0.0006585 0.0006804 0.00% MLMG::mgVcycle_down::1 128 0.0006417 0.0006504 0.0006751 0.00% Castro::Castro() 1 0.0005012 0.0005583 0.0006631 0.00% Castro::buildMetrics() 1 0.0005885 0.000599 0.000611 0.00% AmrMesh::MakeNewGrids() 2 0.0004936 0.0005118 0.0005423 0.00% Castro::do_advance_ctu() 20 0.0004095 0.0004675 0.0005365 0.00% Castro::apply_tagging_restrictions() 2 0.0004149 0.0004761 0.0005268 0.00% Castro::clean_state() 79 0.0004335 0.0004722 0.0005201 0.00% FillPatchSingleLevel 147 0.000476 0.0004918 0.0005107 0.00% MLMG::mgVcycle_up::1 128 0.0004411 0.0004635 0.0004994 0.00% MLMG::mgVcycle_up::0 128 0.0004555 0.0004685 0.0004925 0.00% Gravity::applyMetricTerms() 2 0.0004773 0.0004828 0.0004886 0.00% MLMG::mgVcycle_up::5 128 0.0003868 0.0004011 0.0004875 0.00% MLMG::mgVcycle_up::3 128 0.0003749 0.0003926 0.0004767 0.00% MLMG::mgVcycle_up::2 128 0.0003806 0.0004151 0.0004763 0.00% MLCellLinOp::solutionResidual() 147 0.0004236 0.000442 0.000471 0.00% makeSFC 95 0.0003697 0.0003986 0.0004603 0.00% MLMG::mgVcycle_up::4 128 0.0003798 0.0003925 0.0004488 0.00% MLMG::oneIter() 128 0.0003853 0.0003995 0.0004255 0.00% Castro::problem_post_timestep() 2 1.129e-05 3.826e-05 0.0004207 0.00% Castro::volProductSum() 2 0.0003944 0.0003996 0.0004057 0.00% Castro::enforce_consistent_e() 1 0.0003652 0.0003741 0.0003853 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003231 0.0003402 0.0003664 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002127 0.0002327 0.0002772 0.00% MLMG::computeResidual() 128 0.0002387 0.0002444 0.0002702 0.00% MLMG::mgVcycle_bottom 128 0.0002236 0.0002331 0.0002567 0.00% DistributionMapping::Distribute() 95 0.000211 0.0002239 0.0002544 0.00% Castro::finalize_do_advance() 17 0.0001604 0.0001814 0.0002242 0.00% Amr::initSubcycle() 1 5.681e-05 7.116e-05 0.0002034 0.00% Gravity::update_max_rhs() 2 0.00016 0.0001706 0.00018 0.00% OwnerMask() 2 0.0001358 0.0001529 0.0001742 0.00% Amr::coarseTimeStep() 1 0.0001272 0.0001612 0.0001684 0.00% MLMG::compResidual() 1 0.0001568 0.00016 0.0001682 0.00% Castro::retry_advance_ctu() 11 5.578e-05 8.344e-05 0.0001669 0.00% Castro::initialize_advance() 1 0.0001305 0.0001533 0.0001651 0.00% Castro::check_for_nan() 37 0.0001031 0.0001174 0.0001634 0.00% MLPoisson::define() 19 0.0001387 0.0001469 0.0001619 0.00% knapsack() 1 5.773e-05 6.583e-05 0.0001372 0.00% Amr::defBaseLevel() 1 9.38e-05 0.0001115 0.0001334 0.00% Castro::enforce_speed_limit() 79 0.0001102 0.000117 0.0001302 0.00% Amr::grid_places() 2 8.11e-05 9.56e-05 0.0001239 0.00% TagBoxArray::mapPRD 2 0.0001083 0.0001152 0.0001216 0.00% Gravity::test_composite_phi() 1 9.191e-05 9.829e-05 0.0001161 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.432e-05 7.789e-05 0.0001142 0.00% Castro::apply_source_to_state() 37 9.615e-05 0.0001063 0.0001139 0.00% Castro::apply_problem_tags() 2 9.09e-05 9.566e-05 0.0001034 0.00% MLLinOp::define() 19 7.721e-05 8.646e-05 9.583e-05 0.00% MLPoisson::prepareForSolve() 19 6.949e-05 7.44e-05 8.405e-05 0.00% MultiFab::Swap() 5 6.756e-05 7.026e-05 7.703e-05 0.00% Castro::create_source_corrector() 17 5.616e-05 6.492e-05 7.64e-05 0.00% Castro::expand_state() 20 5.624e-05 6.199e-05 7.122e-05 0.00% Gravity::swapTimeLevels() 8 3.573e-05 4.181e-05 5.754e-05 0.00% Amr::FinalizeInit() 1 8.105e-06 1.639e-05 5.72e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.208e-05 3.577e-05 5.488e-05 0.00% MLMG::computeMLResidual() 18 4e-05 4.443e-05 5.139e-05 0.00% Castro::derive() 18 4.002e-05 4.239e-05 4.536e-05 0.00% MLMG::getGradSolution() 18 4.001e-05 4.158e-05 4.379e-05 0.00% MLMG::MLResNormInf() 18 3.436e-05 3.761e-05 4.08e-05 0.00% MLMG::MLRhsNormInf() 18 3.212e-05 3.324e-05 3.722e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.65e-05 2.127e-05 3.64e-05 0.00% Gravity::actual_multilevel_solve() 1 2.797e-05 3.155e-05 3.55e-05 0.00% Castro::construct_old_rotation_source() 20 3e-05 3.106e-05 3.445e-05 0.00% Castro::construct_new_rotation_source() 17 2.169e-05 2.312e-05 3.441e-05 0.00% Amr::regrid() 1 1.043e-05 1.29e-05 3.093e-05 0.00% Castro::finalize_advance() 1 1.779e-05 2.202e-05 2.409e-05 0.00% Amr::timeStep() 1 1.181e-05 1.518e-05 2.241e-05 0.00% Castro::advance() 1 6.708e-06 1.098e-05 1.967e-05 0.00% Amr::InitializeInit() 1 6.72e-06 9.53e-06 1.928e-05 0.00% Amr::bldFineLevels() 1 6.672e-06 7.933e-06 1.522e-05 0.00% Castro::post_regrid() 2 1.088e-05 1.26e-05 1.484e-05 0.00% Castro::estTimeStep() 10 1.215e-05 1.318e-05 1.456e-05 0.00% Castro::post_init() 1 1.156e-05 1.237e-05 1.403e-05 0.00% Amr::init() 1 6.035e-06 7.707e-06 1.174e-05 0.00% Gravity::set_mass_offset() 2 4.326e-06 6.484e-06 1.163e-05 0.00% Castro::post_timestep() 1 5.477e-06 6.343e-06 1.066e-05 0.00% Castro::computeInitialDt() 2 6.056e-06 7.281e-06 1.041e-05 0.00% Castro::errorEst() 2 5.978e-06 6.497e-06 8.274e-06 0.00% BoxList::parallelComplementIn() 4 6.899e-06 7.252e-06 7.733e-06 0.00% BoxList::complementIn 4 6.017e-06 6.225e-06 6.659e-06 0.00% Castro::gwstrain() 2 4.363e-06 4.76e-06 6.446e-06 0.00% Amr::initialInit() 1 2.902e-06 3.481e-06 5.517e-06 0.00% Castro::FluxRegCrseInit 1 1.637e-06 2.018e-06 2.646e-06 0.00% Castro::FluxRegFineAdd() 1 1.386e-06 1.542e-06 1.829e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.32 14.32 14.32 100.00% Amr::coarseTimeStep() 1 12.01 12.01 12.01 83.87% Amr::timeStep() 1 11.95 11.95 11.95 83.45% Castro::advance() 1 11.88 11.88 11.89 83.02% Castro::subcycle_advance_ctu() 1 11.83 11.83 11.83 82.65% Castro::do_advance_ctu() 20 11.79 11.79 11.8 82.39% Castro::construct_ctu_hydro_source() 20 6.396 6.43 6.468 45.17% Castro::clean_state() 79 3.671 3.762 3.952 27.61% Castro::computeTemp() 80 2.365 2.475 2.738 19.12% Castro::reset_internal_energy(MultiFab) 80 1.473 1.533 1.7 11.87% Gravity::solve_phi_with_mlmg() 19 1.506 1.55 1.591 11.11% Castro::construct_new_gravity() 17 1.426 1.468 1.509 10.54% Gravity::solve_for_phi() 17 1.388 1.431 1.472 10.28% Castro::initialize_do_advance() 20 1.388 1.424 1.468 10.25% Amr::InitAmr() 1 1.387 1.387 1.388 9.69% Gravity::actual_solve_with_mlmg() 19 1.303 1.307 1.312 9.16% MLMG::solve() 18 1.251 1.257 1.258 8.79% Castro::do_old_sources() 20 1.184 1.215 1.23 8.59% MLMG::oneIter() 128 1.114 1.116 1.118 7.81% MLMG::mgVcycle() 128 1.1 1.102 1.104 7.71% FabArray::ParallelCopy() 1429 0.3037 0.8245 1.035 7.23% Castro::do_new_sources() 17 0.9224 0.9687 1.015 7.09% Castro::evaluate_source_change() 196 0.9409 0.9479 0.9676 6.76% Amr::init() 1 0.9194 0.9199 0.9199 6.43% Amr::initialInit() 1 0.8584 0.8589 0.8589 6.00% Castro::enforce_min_density() 79 0.7797 0.8032 0.8379 5.85% FabArray::ParallelCopy_finish() 1429 0.07246 0.5973 0.8059 5.63% amrex::Copy() 724 0.7677 0.7765 0.7932 5.54% MLCellLinOp::smooth() 3072 0.5558 0.6061 0.7327 5.12% AmrLevel::FillPatch() 147 0.4996 0.6375 0.7062 4.93% Amr::InitializeInit() 1 0.4481 0.5075 0.6254 4.37% Amr::defBaseLevel() 1 0.4481 0.5075 0.6254 4.37% MultiFab::AddProduct() 3439 0.5465 0.551 0.5628 3.93% Castro::normalize_species() 79 0.5356 0.542 0.5607 3.92% Castro::reset_internal_energy(Fab) 160 0.5123 0.5183 0.53 3.70% FillPatchIterator::Initialize 147 0.3212 0.461 0.5296 3.70% FillPatchIterator::FillFromLevel0() 147 0.2959 0.4417 0.5141 3.59% FillPatchSingleLevel 147 0.2952 0.441 0.5134 3.59% MLMG::mgVcycle_up::1 128 0.09652 0.263 0.4294 3.00% MLPoisson::Fsmooth() 6144 0.316 0.3429 0.4196 2.93% Amr::FinalizeInit() 1 0.233 0.3514 0.4108 2.87% Castro::Castro() 1 0.3613 0.3718 0.3911 2.73% Castro::initMFs() 1 0.3559 0.3658 0.3837 2.68% MLCellLinOp::applyBC() 7148 0.2771 0.314 0.3795 2.65% MLMG::addInterpCorrection() 768 0.06489 0.3074 0.3766 2.63% FabArray::setVal() 5013 0.3529 0.3602 0.3739 2.61% MultiFab::Subtract() 159 0.3348 0.3375 0.3444 2.41% MLMG::mgVcycle_up::2 128 0.0107 0.1174 0.2805 1.96% Gravity::fill_multipole_BCs() 19 0.1998 0.241 0.2803 1.96% FabArray::FillBoundary() 6380 0.2179 0.2519 0.2751 1.92% check_for_negative_density() 20 0.08552 0.2136 0.2723 1.90% MLMG::mgVcycle_down::0 128 0.2636 0.2668 0.2694 1.88% Castro::expand_state() 20 0.1852 0.2224 0.2673 1.87% Castro::initData() 1 0.07742 0.1333 0.2546 1.78% FabArray::ParallelCopy_nowait() 1429 0.2107 0.2236 0.2465 1.72% Amr::bldFineLevels() 1 0.04782 0.1646 0.2238 1.56% MLMG::mgVcycle_up::0 128 0.1979 0.1994 0.2008 1.40% MLCellLinOp::apply() 986 0.1504 0.1621 0.1995 1.39% FabArray::sum() 3439 0.1804 0.1818 0.1851 1.29% MLMG::mgVcycle_up::3 128 0.01073 0.02382 0.1831 1.28% Amr::grid_places() 2 0.002609 0.1211 0.1805 1.26% AmrMesh::MakeNewGrids() 2 0.002528 0.121 0.1804 1.26% TagBoxArray::mapPRD 2 0.0008302 0.1189 0.1789 1.25% MLMG:computeResOfCorrection() 768 0.1139 0.1235 0.1481 1.03% MLCellLinOp::correctionResidual() 768 0.1125 0.122 0.1465 1.02% Castro::post_init() 1 0.1417 0.144 0.1462 1.02% FillBoundary_nowait() 6380 0.08908 0.1139 0.1426 1.00% FillBoundary_finish() 6380 0.1085 0.1241 0.1423 0.99% Castro::construct_new_source() 102 0.1223 0.1242 0.1259 0.88% MLMG::mgVcycle_down::1 128 0.1132 0.1164 0.1222 0.85% MLPoisson::Fapply() 986 0.09448 0.09903 0.1161 0.81% Gravity::multilevel_solve_for_new_phi() 1 0.1078 0.1079 0.1079 0.75% Gravity::actual_multilevel_solve() 1 0.1077 0.1078 0.1079 0.75% Amr::writePlotFile() 2 0.1059 0.106 0.106 0.74% MLCellLinOp::solutionResidual() 147 0.08756 0.09452 0.1008 0.70% Castro::create_source_corrector() 17 0.04884 0.07658 0.09382 0.66% Castro::post_regrid() 2 0.08411 0.08634 0.08864 0.62% Castro::construct_old_gravity() 20 0.0611 0.06994 0.0845 0.59% Castro::construct_old_source() 120 0.07837 0.07981 0.08449 0.59% MLMG::computeResidual() 128 0.07584 0.07773 0.08026 0.56% FabArray::Saxpy() 264 0.06762 0.0693 0.07769 0.54% Gravity::get_old_grav_vector() 20 0.05009 0.06375 0.07649 0.53% MLMG::mgVcycle_bottom 128 0.0003574 0.004979 0.07416 0.52% MLMG::actualBottomSolve() 128 0.0001333 0.004746 0.07391 0.52% MLCGSolver::bicgstab 8 0 0.004519 0.07231 0.51% MLMG::mgVcycle_down::2 128 0.01257 0.04041 0.07173 0.50% Castro::construct_new_gravity_source() 17 0.06799 0.0694 0.07083 0.49% Castro::derive() 18 0.06841 0.06956 0.07077 0.49% AmrLevel::derive() 18 0.06837 0.06952 0.07072 0.49% Castro::post_timestep() 1 0.06213 0.06616 0.07033 0.49% FabArray::Xpay() 945 0.05136 0.05375 0.06225 0.43% MLMG::mgVcycle_down::3 128 0.01197 0.01814 0.06062 0.42% amrex::average_down 768 0.03249 0.0386 0.055 0.38% Castro::initialize_advance() 1 0.04867 0.05033 0.05278 0.37% Castro::construct_old_gravity_source() 20 0.04578 0.0464 0.04915 0.34% Castro::check_for_nan() 37 0.0445 0.04523 0.04712 0.33% MultiFab::contains_nan() 37 0.0444 0.04511 0.04696 0.33% Amr::regrid() 1 0.04344 0.04464 0.04643 0.32% Castro::retry_advance_ctu() 11 0.03546 0.03721 0.04171 0.29% MLPoisson::define() 19 0.02954 0.03362 0.03963 0.28% Gravity::get_new_grav_vector() 18 0.0348 0.03569 0.03692 0.26% MLMG::mgVcycle_down::4 128 0.01182 0.01348 0.03572 0.25% StateDataPhysBCFunct::() 147 0.000668 0.01817 0.03487 0.24% StateData::FillBoundary(geom) 143 0 0.01733 0.03381 0.24% Castro::apply_source_to_state() 37 0.02775 0.02826 0.03187 0.22% VisMF::Write(FabArray) 4 0.01513 0.01708 0.03156 0.22% MLMG::mgVcycle_up::4 128 0.01079 0.01194 0.02771 0.19% MLCellLinOp::defineAuxData() 19 0.01862 0.02013 0.02513 0.18% MLMG::prepareForSolve() 18 0.02055 0.02148 0.02452 0.17% Castro::save_data_for_retry() 3 0.01851 0.01944 0.02423 0.17% Castro::problem_post_timestep() 2 0.01166 0.01852 0.02377 0.17% Castro::wd_update() 2 0.01124 0.01848 0.02375 0.17% MLMG::mgVcycle_down::5 128 0.01188 0.01273 0.02375 0.17% MLMG::computeMLResidual() 18 0.01087 0.01632 0.02171 0.15% MLMG::ResNormInf() 146 0.01742 0.01945 0.02165 0.15% Castro::sum_integrated_quantities() 2 0.02105 0.02135 0.02137 0.15% MLMG::mgVcycle_up::5 128 0.01091 0.01157 0.02005 0.14% FabArray::norminf() 282 0.01072 0.01123 0.01617 0.11% Amr::writeSmallPlotFile() 2 0.0151 0.01511 0.01512 0.11% amrex::Add() 128 0.01423 0.01436 0.01476 0.10% FabArrayBase::getCPC() 2005 0.00936 0.0107 0.01437 0.10% FabArrayBase::getFB() 6380 0.0101 0.01075 0.01428 0.10% Gravity::test_composite_phi() 1 0.01417 0.01424 0.01428 0.10% FabArray::setDomainBndry() 147 0.0004572 0.006154 0.01178 0.08% MLLinOp::define() 19 0.004336 0.007642 0.01176 0.08% MLLinOp::defineGrids() 19 0.004254 0.007555 0.01168 0.08% MLLinOp::makeSubCommunicator() 19 0.001392 0.004695 0.008546 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005246 0.008394 0.06% MLMG::getGradSolution() 18 0.007513 0.007826 0.008071 0.06% MLCellLinOp::compGrad() 18 0.007471 0.007785 0.008028 0.06% FabArray::mult() 59 0.007425 0.00752 0.007718 0.05% Castro::volWgtSum() 46 0.007203 0.007371 0.007617 0.05% FabArrayBase::CPC::define() 576 0.002148 0.003304 0.006473 0.05% amrex::Dot() 142 0 0.0003898 0.006236 0.04% Gravity::update_max_rhs() 2 0.001444 0.003768 0.006006 0.04% MLCellLinOp::defineBC() 19 0.005454 0.0057 0.005926 0.04% Castro::volInBoundary() 14 0.003419 0.003738 0.005679 0.04% MultiFab::max() 2 0.0001666 0.002505 0.00475 0.03% BndryData::define() 19 0.003957 0.00417 0.004367 0.03% MLPoisson::normalize() 79 0 0.0002133 0.003413 0.02% MLPoisson::prepareForSolve() 19 0.001728 0.001862 0.002242 0.02% MLCellLinOp::prepareForSolve() 19 0.001647 0.001787 0.002164 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001333 0.001552 0.001824 0.01% AmrLevel::AmrLevel(dm) 1 0.001383 0.001511 0.001641 0.01% StateData::define() 6 0.00135 0.001475 0.001609 0.01% TagBoxArray::collate() 2 0.0001779 0.0007781 0.001527 0.01% FabArrayBase::FB::FB() 75 0.0002796 0.0006711 0.001473 0.01% Gravity::swapTimeLevels() 8 0.001205 0.001283 0.001428 0.01% MLMG::compResidual() 1 0.0009717 0.001124 0.001275 0.01% MLMG::MLResNormInf() 18 0.001236 0.00125 0.001271 0.01% MLMG::MLRhsNormInf() 18 0.00118 0.001202 0.001216 0.01% Castro::locWgtSum() 6 0.001118 0.00114 0.001176 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009067 0.0009628 0.001057 0.01% MLCellLinOp::setLevelBC() 19 0.0005221 0.000663 0.0008774 0.01% DistributionMapping::KnapSackDoIt() 1 0.0002178 0.000705 0.000774 0.01% Castro::swap_state_time_levels() 8 0.0005793 0.0006559 0.0007192 0.01% makeSFC 95 0.0005822 0.0006226 0.0006991 0.00% DistributionMapping::LeastUsedCPUs() 1 4.415e-05 0.0006179 0.0006886 0.00% Castro::buildMetrics() 1 0.0006524 0.0006615 0.0006715 0.00% Castro::errorEst() 2 0.0005148 0.0005782 0.0006239 0.00% Castro::apply_tagging_restrictions() 2 0.0004149 0.0004761 0.0005268 0.00% Gravity::applyMetricTerms() 2 0.0004773 0.0004828 0.0004886 0.00% Castro::volProductSum() 2 0.0003944 0.0003996 0.0004057 0.00% Castro::enforce_consistent_e() 1 0.0003652 0.0003741 0.0003853 0.00% Castro::finalize_advance() 1 0.0002521 0.0002752 0.0002852 0.00% DistributionMapping::Distribute() 95 0.000211 0.0002239 0.0002544 0.00% Castro::finalize_do_advance() 17 0.0001705 0.0001916 0.0002346 0.00% Amr::initSubcycle() 1 5.681e-05 7.116e-05 0.0002034 0.00% OwnerMask() 2 0.0001358 0.0001529 0.0001742 0.00% knapsack() 1 5.773e-05 6.583e-05 0.0001372 0.00% Castro::enforce_speed_limit() 79 0.0001102 0.000117 0.0001302 0.00% Castro::apply_problem_tags() 2 9.09e-05 9.566e-05 0.0001034 0.00% MultiFab::Swap() 5 6.756e-05 7.026e-05 7.703e-05 0.00% Castro::construct_old_rotation_source() 20 3e-05 3.106e-05 3.445e-05 0.00% Castro::construct_new_rotation_source() 17 2.169e-05 2.312e-05 3.441e-05 0.00% Castro::estTimeStep() 10 1.215e-05 1.318e-05 1.456e-05 0.00% BoxList::parallelComplementIn() 4 1.294e-05 1.348e-05 1.439e-05 0.00% Castro::computeInitialDt() 2 8.848e-06 1.028e-05 1.327e-05 0.00% Gravity::set_mass_offset() 2 4.326e-06 6.484e-06 1.163e-05 0.00% BoxList::complementIn 4 6.017e-06 6.225e-06 6.659e-06 0.00% Castro::gwstrain() 2 4.363e-06 4.76e-06 6.446e-06 0.00% Castro::FluxRegCrseInit 1 1.637e-06 2.018e-06 2.646e-06 0.00% Castro::FluxRegFineAdd() 1 1.386e-06 1.542e-06 1.829e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 9 B 13 B 16 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-14-g6c6247554f27) finalized