Initializing AMReX (24.04-3-gd78e241d1ad4)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.04-3-gd78e241d1ad4) initialized Starting run at 07:49:42 UTC on 2024-04-03. Successfully read inputs file ... Castro git describe: 24.04-1-g6930369b2 AMReX git describe: 24.04-3-gd78e241d1 Microphysics git describe: 24.04 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.160562775 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001060007 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.011044244 Gravity::multilevel_solve_for_new_phi() time = 0.100314733 Gravity::fill_multipole_BCs() time = 0.011071616 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.048019198 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004159545 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002672493 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.064802088 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004837119 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.06391577 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003434933 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060942171 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003728937 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.061001635 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323377511 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015472884 Gravity::solve_for_phi() time = 0.085736672 on level 0 Castro::construct_new_gravity() time = 0.087913308 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060695201 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.003069743 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060016597 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.322126239 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015585454 Gravity::solve_for_phi() time = 0.085490068 on level 0 Castro::construct_new_gravity() time = 0.087643052 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.060075199 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.00272857 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060375307 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327802293 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015367034 Gravity::solve_for_phi() time = 0.085244489 on level 0 Castro::construct_new_gravity() time = 0.087414935 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.060620378 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002683492 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.05972515 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329297458 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015738953 Gravity::solve_for_phi() time = 0.087636881 on level 0 Castro::construct_new_gravity() time = 0.089779336 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.060138201 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003049422 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059843132 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336989722 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015593712 Gravity::solve_for_phi() time = 0.086260467 on level 0 Castro::construct_new_gravity() time = 0.088398876 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060274386 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002667536 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059436914 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330940374 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015518054 Gravity::solve_for_phi() time = 0.085124571 on level 0 Castro::construct_new_gravity() time = 0.087261818 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.060398946 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003765853 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.067952231 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335304989 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015278865 Gravity::solve_for_phi() time = 0.086174945 on level 0 Castro::construct_new_gravity() time = 0.088362345 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060275477 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002651248 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059653841 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329441502 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016024109 Gravity::solve_for_phi() time = 0.085978882 on level 0 Castro::construct_new_gravity() time = 0.088104544 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060411129 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002670962 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059487312 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334868386 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01606612 Gravity::solve_for_phi() time = 0.086881539 on level 0 Castro::construct_new_gravity() time = 0.089036062 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.060280057 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002721626 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.05962956 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330271679 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01584461 Gravity::solve_for_phi() time = 0.086278554 on level 0 Castro::construct_new_gravity() time = 0.088417696 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.060232154 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002622042 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059642525 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336123483 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016370207 Gravity::solve_for_phi() time = 0.0872203 on level 0 Castro::construct_new_gravity() time = 0.089352081 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.060313376 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002727719 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059896396 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330672277 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016051265 Gravity::solve_for_phi() time = 0.086216637 on level 0 Castro::construct_new_gravity() time = 0.088384697 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.060403316 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002743363 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059608238 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338323977 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017262468 Gravity::solve_for_phi() time = 0.088351802 on level 0 Castro::construct_new_gravity() time = 0.090495136 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.060612977 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003625471 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.065137943 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.375624378 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016652543 Gravity::solve_for_phi() time = 0.086653606 on level 0 Castro::construct_new_gravity() time = 0.08877309 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.060489622 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002696821 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059588513 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.34991157 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01612409 Gravity::solve_for_phi() time = 0.086006083 on level 0 Castro::construct_new_gravity() time = 0.088147238 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.060279199 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002655607 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059693195 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330932738 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016962406 Gravity::solve_for_phi() time = 0.086888456 on level 0 Castro::construct_new_gravity() time = 0.089009691 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.060235439 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002711624 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059560872 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336555541 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016765186 Gravity::solve_for_phi() time = 0.087235247 on level 0 Castro::construct_new_gravity() time = 0.089350469 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.060358806 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002755356578 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.95127507 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.047384821 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004240351 seconds Ending run at 07:49:56 UTC on 2024-04-03. Run time = 14.50785232 Run time without initialization = 12.00378248 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.51 ... 14.51 ... 14.51 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.4004 5.4940 5.5966 38.58% Amr::InitAmr() 1 1.631 1.632 1.632 11.25% Castro::computeTemp() 80 0.8431 0.9502 1.122 7.74% amrex::Copy() 724 0.785 0.7971 0.8102 5.58% FabArray::ParallelCopy_finish() 1429 0.05253 0.4949 0.6705 4.62% Castro::normalize_species() 79 0.5535 0.5629 0.5845 4.03% MultiFab::AddProduct() 3439 0.5492 0.557 0.5653 3.90% Castro::reset_internal_energy(Fab) 160 0.5151 0.5233 0.5331 3.67% MLPoisson::Fsmooth() 6144 0.3186 0.3455 0.4114 2.84% Castro::initMFs() 1 0.351 0.3562 0.3625 2.50% FabArray::setVal() 5013 0.3504 0.3545 0.3599 2.48% MultiFab::Subtract() 159 0.3357 0.3403 0.3457 2.38% check_for_negative_density() 20 0.08457 0.2042 0.3118 2.15% Gravity::fill_multipole_BCs() 19 0.1984 0.2461 0.2911 2.01% Castro::reset_internal_energy(MultiFab) 80 0.02267 0.06886 0.264 1.82% FabArray::ParallelCopy_nowait() 1429 0.1882 0.2024 0.2195 1.51% FabArray::sum() 3439 0.1838 0.1867 0.1896 1.31% FillBoundary_finish() 6380 0.09319 0.1137 0.1525 1.05% Castro::initData() 1 0.003339 0.02583 0.1514 1.04% FillBoundary_nowait() 6380 0.07962 0.1032 0.1298 0.89% MLPoisson::Fapply() 986 0.09451 0.09952 0.1127 0.78% MLCellLinOp::applyBC() 7148 0.04722 0.06195 0.1014 0.70% Castro::enforce_min_density() 79 0.01736 0.03207 0.08113 0.56% FabArray::Saxpy() 264 0.06919 0.07063 0.07627 0.53% Castro::do_old_sources() 20 0.0005219 0.01561 0.07416 0.51% Castro::construct_new_gravity_source() 17 0.0703 0.07153 0.07349 0.51% Castro::do_new_sources() 17 0.0003775 0.01181 0.06333 0.44% FabArray::Xpay() 945 0.05215 0.05481 0.06111 0.42% MultiFab::contains_nan() 37 0.04509 0.04595 0.04818 0.33% Castro::construct_old_gravity_source() 20 0.04451 0.04515 0.04591 0.32% MLMG::addInterpCorrection() 768 0.03333 0.03608 0.04228 0.29% AmrLevel::derive() 18 0.04044 0.04095 0.04157 0.29% StateData::FillBoundary(geom) 143 0 0.01728 0.03365 0.23% amrex::average_down 768 0.0247 0.02699 0.03229 0.22% VisMF::Write(FabArray) 4 0.01211 0.01337 0.02364 0.16% MLCellLinOp::defineAuxData() 19 0.01482 0.01545 0.01744 0.12% Castro::construct_new_source() 102 0.01557 0.01588 0.01677 0.12% Amr::writePlotFile() 2 0.007501 0.01528 0.0167 0.12% FabArray::FillBoundary() 6380 0.01321 0.01387 0.01636 0.11% MLCGSolver::bicgstab 8 0 0.0009947 0.01591 0.11% TagBoxArray::collate() 2 0.0001566 0.002285 0.01519 0.10% FabArray::norminf() 282 0.01076 0.01122 0.01511 0.10% amrex::Add() 128 0.01412 0.01436 0.01465 0.10% FillPatchIterator::Initialize 147 0.01236 0.0127 0.01316 0.09% Castro::evaluate_source_change() 196 0.0122 0.01257 0.01315 0.09% MLCellLinOp::smooth() 3072 0.01087 0.0114 0.01287 0.09% FabArrayBase::getFB() 6380 0.009783 0.01024 0.01229 0.08% FabArray::setDomainBndry() 147 0.0004348 0.006411 0.01205 0.08% MLMG::prepareForSolve() 18 0.0102 0.01045 0.01129 0.08% Castro::construct_old_gravity() 20 0.0003795 0.002615 0.01123 0.08% Castro::wd_update() 2 0.004654 0.008522 0.01086 0.07% Castro::construct_old_source() 120 0.009963 0.01017 0.01074 0.07% MLMG::ResNormInf() 146 0.002801 0.005886 0.008785 0.06% MLLinOp::makeSubCommunicator() 19 0.0008443 0.004311 0.008152 0.06% Gravity::actual_solve_with_mlmg() 19 0.006856 0.007199 0.007926 0.05% FabArray::mult() 59 0.007367 0.00756 0.007924 0.05% FabArrayBase::getCPC() 2005 0.007229 0.007394 0.007888 0.05% Castro::volWgtSum() 46 0.007269 0.007329 0.007388 0.05% Gravity::get_old_grav_vector() 20 0.006416 0.006583 0.006927 0.05% Gravity::get_new_grav_vector() 18 0.006098 0.006252 0.006693 0.05% FabArrayBase::CPC::define() 576 0.002207 0.003343 0.006347 0.04% MLCellLinOp::compGrad() 18 0.005883 0.005984 0.006082 0.04% amrex::Dot() 142 0 0.0003674 0.005878 0.04% Amr::writeSmallPlotFile() 2 0.003679 0.005366 0.005837 0.04% Castro::volInBoundary() 14 0.003427 0.003712 0.005366 0.04% Castro::initialize_do_advance() 20 0.00452 0.004693 0.005358 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0002949 0.004718 0.03% MLCellLinOp::apply() 986 0.001969 0.002199 0.004581 0.03% MLMG::solve() 18 0.0008405 0.001711 0.00406 0.03% FabArray::ParallelCopy() 1429 0.003411 0.003577 0.003932 0.03% BndryData::define() 19 0.003047 0.003129 0.00337 0.02% MLPoisson::normalize() 79 0 0.0001941 0.003106 0.02% MultiFab::max() 2 0.0001817 0.001252 0.002835 0.02% AmrLevel::FillPatch() 147 0.00214 0.002258 0.002552 0.02% MLLinOp::defineGrids() 19 0.001789 0.001907 0.00217 0.01% MLCellLinOp::prepareForSolve() 19 0.001702 0.001803 0.002071 0.01% Castro::sum_integrated_quantities() 2 0.001581 0.001763 0.002011 0.01% MLCellLinOp::correctionResidual() 768 0.001829 0.001864 0.001908 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001334 0.00158 0.001805 0.01% MLMG::mgVcycle() 128 0.001526 0.001639 0.001767 0.01% MLCellLinOp::defineBC() 19 0.00148 0.001537 0.001639 0.01% Gravity::solve_for_phi() 17 0.0008213 0.001001 0.001507 0.01% MLMG:computeResOfCorrection() 768 0.001368 0.001406 0.001486 0.01% FabArrayBase::FB::FB() 75 0.0002806 0.0006798 0.001427 0.01% StateData::define() 6 0.001329 0.001364 0.001419 0.01% Castro::save_data_for_retry() 3 0.001242 0.001284 0.001296 0.01% main() 1 0.0009806 0.001164 0.001288 0.01% Castro::construct_new_gravity() 17 0.0003032 0.0004467 0.00115 0.01% Castro::locWgtSum() 6 0.001114 0.001128 0.001145 0.01% MLMG::actualBottomSolve() 128 0.0001308 0.0001939 0.001053 0.01% StateDataPhysBCFunct::() 147 0.0006569 0.0007963 0.0008984 0.01% Castro::subcycle_advance_ctu() 1 0.0001934 0.0002478 0.0008811 0.01% MLCellLinOp::setLevelBC() 19 0.0005413 0.0006715 0.0008321 0.01% MLMG::mgVcycle_down::2 128 0.0006065 0.0006592 0.000764 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006864 0.0007095 0.0007481 0.01% MLMG::mgVcycle_down::0 128 0.0006464 0.0006669 0.000711 0.00% MLMG::mgVcycle_down::1 128 0.000629 0.0006511 0.0006992 0.00% MLMG::mgVcycle_down::3 128 0.0005587 0.0006088 0.0006907 0.00% MLMG::mgVcycle_down::4 128 0.0005472 0.0005718 0.0006582 0.00% MLMG::mgVcycle_down::5 128 0.0005647 0.0005895 0.0006392 0.00% Castro::buildMetrics() 1 0.0005794 0.0005928 0.0006086 0.00% Castro::Castro() 1 0.0004659 0.0004975 0.0005676 0.00% Castro::apply_tagging_restrictions() 2 0.0004191 0.0004837 0.000549 0.00% AmrMesh::MakeNewGrids() 2 0.000501 0.0005143 0.0005289 0.00% Gravity::applyMetricTerms() 2 0.0004857 0.0004976 0.0005238 0.00% Castro::do_advance_ctu() 20 0.0004177 0.0004575 0.0005217 0.00% MLMG::mgVcycle_up::1 128 0.0004541 0.0004745 0.000519 0.00% MLMG::mgVcycle_up::0 128 0.0004511 0.0004663 0.0005088 0.00% Castro::clean_state() 79 0.0004387 0.0004588 0.0005055 0.00% FillPatchSingleLevel 147 0.0004621 0.0004759 0.0004978 0.00% MLMG::mgVcycle_up::2 128 0.000379 0.0004213 0.0004877 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003266 0.0003464 0.0004707 0.00% MLCellLinOp::solutionResidual() 147 0.0004423 0.0004522 0.0004696 0.00% makeSFC 95 0.0003708 0.000391 0.0004514 0.00% Castro::swap_state_time_levels() 8 0.0004286 0.0004351 0.000448 0.00% MLMG::mgVcycle_up::5 128 0.0003929 0.0004075 0.0004351 0.00% MLMG::oneIter() 128 0.0003777 0.0003914 0.0004339 0.00% MLMG::mgVcycle_up::3 128 0.0003738 0.0003941 0.0004317 0.00% MLMG::mgVcycle_up::4 128 0.0003786 0.0003925 0.000425 0.00% Castro::volProductSum() 2 0.0004009 0.000406 0.000412 0.00% Castro::enforce_consistent_e() 1 0.0003645 0.0003755 0.0004029 0.00% Castro::problem_post_timestep() 2 1.109e-05 3.616e-05 0.0003991 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002161 0.0002371 0.0002763 0.00% MLMG::computeResidual() 128 0.0002378 0.0002428 0.0002584 0.00% DistributionMapping::LeastUsedCPUs() 1 3.3e-05 0.0002179 0.000253 0.00% Castro::finalize_do_advance() 17 0.000162 0.000179 0.000251 0.00% MLMG::mgVcycle_bottom 128 0.000219 0.000229 0.0002397 0.00% DistributionMapping::Distribute() 95 0.0002109 0.0002219 0.0002389 0.00% Gravity::update_max_rhs() 2 0.0001591 0.0001649 0.0001793 0.00% OwnerMask() 2 0.000135 0.000153 0.0001698 0.00% MLPoisson::define() 19 0.0001302 0.0001473 0.0001677 0.00% Castro::retry_advance_ctu() 11 5.267e-05 7.029e-05 0.0001647 0.00% Amr::coarseTimeStep() 1 0.0001297 0.0001548 0.0001624 0.00% MLMG::compResidual() 1 0.0001535 0.0001577 0.0001603 0.00% Amr::defBaseLevel() 1 9.112e-05 0.0001348 0.0001578 0.00% Gravity::test_composite_phi() 1 9.385e-05 0.0001025 0.0001398 0.00% Castro::check_for_nan() 37 0.0001028 0.0001126 0.0001316 0.00% TagBoxArray::mapPRD 2 0.0001103 0.0001158 0.0001258 0.00% Castro::enforce_speed_limit() 79 0.0001036 0.0001118 0.0001249 0.00% Amr::grid_places() 2 6.793e-05 8.2e-05 0.0001156 0.00% Castro::initialize_advance() 1 0.0001022 0.0001048 0.0001087 0.00% MLLinOp::define() 19 7.634e-05 8.269e-05 0.0001055 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.058e-05 7.01e-05 0.0001033 0.00% Castro::apply_source_to_state() 37 9.043e-05 9.601e-05 0.0001023 0.00% Castro::apply_problem_tags() 2 9.281e-05 9.478e-05 0.0001016 0.00% MultiFab::Swap() 5 6.75e-05 7.201e-05 8.659e-05 0.00% MLPoisson::prepareForSolve() 19 6.697e-05 7.006e-05 7.791e-05 0.00% Castro::create_source_corrector() 17 5.612e-05 6.238e-05 7.204e-05 0.00% Amr::FinalizeInit() 1 8.541e-06 1.287e-05 6.565e-05 0.00% Castro::expand_state() 20 5.171e-05 5.612e-05 6.407e-05 0.00% knapsack() 1 5.655e-05 5.913e-05 6.347e-05 0.00% Amr::initSubcycle() 1 5.714e-05 6.05e-05 6.299e-05 0.00% MLMG::computeMLResidual() 18 4.003e-05 4.335e-05 5.155e-05 0.00% Castro::derive() 18 4.067e-05 4.242e-05 4.731e-05 0.00% MLMG::getGradSolution() 18 3.867e-05 4.147e-05 4.662e-05 0.00% MLMG::MLResNormInf() 18 3.264e-05 3.557e-05 4.292e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.355e-05 3.579e-05 4.035e-05 0.00% Castro::construct_new_rotation_source() 17 2.041e-05 2.226e-05 3.809e-05 0.00% Castro::finalize_advance() 1 1.719e-05 1.944e-05 3.704e-05 0.00% Gravity::swapTimeLevels() 8 3.316e-05 3.481e-05 3.635e-05 0.00% Castro::construct_old_rotation_source() 20 3.011e-05 3.081e-05 3.233e-05 0.00% MLMG::MLRhsNormInf() 18 3.024e-05 3.12e-05 3.215e-05 0.00% Amr::regrid() 1 1.076e-05 1.258e-05 3.039e-05 0.00% Gravity::actual_multilevel_solve() 1 2.619e-05 2.768e-05 3.002e-05 0.00% Castro::post_regrid() 2 1.077e-05 1.235e-05 2.848e-05 0.00% Amr::timeStep() 1 1.132e-05 1.358e-05 2.074e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.66e-05 1.819e-05 2.001e-05 0.00% Castro::advance() 1 7.037e-06 8.317e-06 1.435e-05 0.00% Castro::post_init() 1 1.181e-05 1.262e-05 1.419e-05 0.00% Castro::estTimeStep() 10 1.188e-05 1.266e-05 1.321e-05 0.00% Amr::InitializeInit() 1 6.537e-06 8.135e-06 1.262e-05 0.00% Castro::post_timestep() 1 5.705e-06 6.359e-06 1.104e-05 0.00% Amr::init() 1 6.518e-06 7.384e-06 1.101e-05 0.00% Castro::gwstrain() 2 4.341e-06 5.132e-06 1.007e-05 0.00% Amr::bldFineLevels() 1 6.926e-06 7.487e-06 8.586e-06 0.00% Castro::computeInitialDt() 2 6.577e-06 7.133e-06 7.711e-06 0.00% BoxList::parallelComplementIn() 4 7e-06 7.228e-06 7.561e-06 0.00% BoxList::complementIn 4 6.04e-06 6.262e-06 6.686e-06 0.00% Castro::errorEst() 2 5.974e-06 6.161e-06 6.487e-06 0.00% Gravity::set_mass_offset() 2 4.229e-06 4.493e-06 5.127e-06 0.00% Amr::initialInit() 1 2.948e-06 3.146e-06 3.566e-06 0.00% Castro::FluxRegCrseInit 1 1.665e-06 1.841e-06 2.261e-06 0.00% Castro::FluxRegFineAdd() 1 1.421e-06 1.511e-06 1.657e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.51 14.51 14.51 100.00% Amr::coarseTimeStep() 1 12 12 12 82.74% Amr::timeStep() 1 11.95 11.95 11.95 82.38% Castro::advance() 1 11.89 11.89 11.89 81.97% Castro::subcycle_advance_ctu() 1 11.84 11.84 11.84 81.63% Castro::do_advance_ctu() 20 11.8 11.8 11.8 81.37% Castro::construct_ctu_hydro_source() 20 6.452 6.481 6.525 44.98% Castro::clean_state() 79 3.726 3.814 4.009 27.63% Castro::computeTemp() 80 2.403 2.5 2.71 18.68% Castro::reset_internal_energy(MultiFab) 80 1.483 1.549 1.724 11.88% Amr::InitAmr() 1 1.631 1.632 1.632 11.25% Gravity::solve_phi_with_mlmg() 19 1.48 1.531 1.58 10.89% Castro::construct_new_gravity() 17 1.406 1.457 1.506 10.38% Gravity::solve_for_phi() 17 1.369 1.42 1.469 10.13% Castro::initialize_do_advance() 20 1.377 1.412 1.442 9.94% Gravity::actual_solve_with_mlmg() 19 1.278 1.281 1.286 8.86% MLMG::solve() 18 1.227 1.231 1.233 8.50% Castro::do_old_sources() 20 1.155 1.197 1.219 8.40% MLMG::oneIter() 128 1.097 1.099 1.102 7.59% MLMG::mgVcycle() 128 1.082 1.084 1.087 7.49% Castro::do_new_sources() 17 0.9556 0.9845 1.026 7.07% Castro::evaluate_source_change() 196 0.9422 0.9562 0.9716 6.70% FabArray::ParallelCopy() 1429 0.2756 0.7207 0.8977 6.19% Amr::init() 1 0.8716 0.8718 0.8718 6.01% Castro::enforce_min_density() 79 0.7827 0.8084 0.8467 5.84% Amr::initialInit() 1 0.8185 0.8187 0.8189 5.64% amrex::Copy() 724 0.785 0.7971 0.8102 5.58% MLCellLinOp::smooth() 3072 0.5532 0.6019 0.7275 5.01% FabArray::ParallelCopy_finish() 1429 0.05253 0.4949 0.6705 4.62% AmrLevel::FillPatch() 147 0.471 0.5703 0.631 4.35% Amr::InitializeInit() 1 0.4361 0.4944 0.5952 4.10% Amr::defBaseLevel() 1 0.4361 0.4944 0.5951 4.10% Castro::normalize_species() 79 0.5535 0.5629 0.5845 4.03% MultiFab::AddProduct() 3439 0.5492 0.557 0.5653 3.90% Castro::reset_internal_energy(Fab) 160 0.5151 0.5233 0.5331 3.67% FillPatchIterator::Initialize 147 0.2927 0.3889 0.4509 3.11% FillPatchIterator::FillFromLevel0() 147 0.2683 0.3698 0.4335 2.99% FillPatchSingleLevel 147 0.2676 0.3691 0.4327 2.98% MLMG::mgVcycle_up::1 128 0.09544 0.2547 0.4152 2.86% MLPoisson::Fsmooth() 6144 0.3186 0.3455 0.4114 2.84% Amr::FinalizeInit() 1 0.2236 0.3243 0.3827 2.64% MLCellLinOp::applyBC() 7148 0.2674 0.3037 0.3812 2.63% Castro::Castro() 1 0.3565 0.3616 0.3679 2.54% MLMG::addInterpCorrection() 768 0.06131 0.2944 0.363 2.50% Castro::initMFs() 1 0.3512 0.3563 0.3627 2.50% FabArray::setVal() 5013 0.3504 0.3545 0.3599 2.48% MultiFab::Subtract() 159 0.3357 0.3403 0.3457 2.38% check_for_negative_density() 20 0.08457 0.2042 0.3118 2.15% Gravity::fill_multipole_BCs() 19 0.2005 0.2483 0.2932 2.02% FabArray::FillBoundary() 6380 0.2111 0.2417 0.285 1.96% MLMG::mgVcycle_down::0 128 0.2637 0.2659 0.2689 1.85% MLMG::mgVcycle_up::2 128 0.01052 0.112 0.2675 1.84% Castro::expand_state() 20 0.1775 0.2125 0.2472 1.70% FabArray::ParallelCopy_nowait() 1429 0.2077 0.2222 0.2399 1.65% Castro::initData() 1 0.07765 0.131 0.2365 1.63% Amr::bldFineLevels() 1 0.04673 0.1469 0.2045 1.41% MLMG::mgVcycle_up::0 128 0.1971 0.1977 0.1985 1.37% MLCellLinOp::apply() 986 0.1503 0.1587 0.1928 1.33% FabArray::sum() 3439 0.1838 0.1867 0.1896 1.31% MLMG::mgVcycle_up::3 128 0.01052 0.02304 0.1719 1.18% Amr::grid_places() 2 0.002587 0.1033 0.1616 1.11% AmrMesh::MakeNewGrids() 2 0.002519 0.1032 0.1616 1.11% TagBoxArray::mapPRD 2 0.0007033 0.09967 0.1595 1.10% FillBoundary_finish() 6380 0.09319 0.1137 0.1525 1.05% MLMG:computeResOfCorrection() 768 0.1138 0.1228 0.1454 1.00% MLCellLinOp::correctionResidual() 768 0.1124 0.1214 0.1439 0.99% FillBoundary_nowait() 6380 0.08994 0.1142 0.141 0.97% Castro::post_init() 1 0.133 0.134 0.1356 0.93% Castro::construct_new_source() 102 0.1249 0.1269 0.1296 0.89% MLMG::mgVcycle_down::1 128 0.1129 0.1167 0.1202 0.83% MLPoisson::Fapply() 986 0.09451 0.09952 0.1127 0.78% Gravity::multilevel_solve_for_new_phi() 1 0.1003 0.1003 0.1003 0.69% Gravity::actual_multilevel_solve() 1 0.1002 0.1002 0.1003 0.69% Amr::writePlotFile() 2 0.096 0.09609 0.0961 0.66% MLCellLinOp::solutionResidual() 147 0.08766 0.09282 0.0959 0.66% Castro::post_regrid() 2 0.08536 0.08694 0.08802 0.61% Castro::construct_old_source() 120 0.07763 0.07885 0.08128 0.56% MLMG::computeResidual() 128 0.07585 0.07679 0.0773 0.53% FabArray::Saxpy() 264 0.06919 0.07063 0.07627 0.53% Castro::create_source_corrector() 17 0.04771 0.05791 0.07473 0.52% Castro::construct_new_gravity_source() 17 0.0703 0.07153 0.07349 0.51% MLMG::mgVcycle_down::2 128 0.01235 0.04075 0.07235 0.50% Castro::derive() 18 0.06896 0.06996 0.07095 0.49% AmrLevel::derive() 18 0.06891 0.06992 0.07091 0.49% MLMG::mgVcycle_bottom 128 0.0003538 0.004685 0.06948 0.48% MLMG::actualBottomSolve() 128 0.0001308 0.004455 0.06924 0.48% MLCGSolver::bicgstab 8 0 0.004234 0.06774 0.47% Castro::post_timestep() 1 0.05876 0.06132 0.06301 0.43% FabArray::Xpay() 945 0.05215 0.05481 0.06111 0.42% Castro::construct_old_gravity() 20 0.0421 0.05177 0.05844 0.40% MLMG::mgVcycle_down::3 128 0.01165 0.01785 0.05821 0.40% Gravity::get_old_grav_vector() 20 0.04157 0.04915 0.05796 0.40% amrex::average_down 768 0.03287 0.03944 0.05475 0.38% Castro::initialize_advance() 1 0.04852 0.0494 0.05004 0.34% Castro::check_for_nan() 37 0.04519 0.04607 0.04829 0.33% MultiFab::contains_nan() 37 0.04509 0.04595 0.04818 0.33% Castro::construct_old_gravity_source() 20 0.04451 0.04515 0.04591 0.32% Amr::regrid() 1 0.04386 0.04464 0.0452 0.31% MLPoisson::define() 19 0.02886 0.03341 0.03909 0.27% Castro::retry_advance_ctu() 11 0.03594 0.03682 0.0374 0.26% Gravity::get_new_grav_vector() 18 0.03564 0.0361 0.03688 0.25% StateDataPhysBCFunct::() 147 0.0006569 0.01808 0.03451 0.24% MLMG::mgVcycle_down::4 128 0.01163 0.01336 0.03409 0.23% StateData::FillBoundary(geom) 143 0 0.01728 0.03365 0.23% Castro::apply_source_to_state() 37 0.02814 0.02853 0.02899 0.20% MLMG::mgVcycle_up::4 128 0.01056 0.01184 0.02654 0.18% MLCellLinOp::defineAuxData() 19 0.01886 0.02028 0.02392 0.16% VisMF::Write(FabArray) 4 0.01211 0.01337 0.02364 0.16% MLMG::prepareForSolve() 18 0.02044 0.02135 0.02323 0.16% MLMG::mgVcycle_down::5 128 0.01163 0.01258 0.02232 0.15% Castro::sum_integrated_quantities() 2 0.02066 0.02096 0.02098 0.14% Castro::save_data_for_retry() 3 0.01899 0.01924 0.01954 0.13% MLMG::mgVcycle_up::5 128 0.0107 0.01149 0.01904 0.13% MLMG::ResNormInf() 146 0.01253 0.01553 0.01826 0.13% MLMG::computeMLResidual() 18 0.01066 0.01556 0.01822 0.13% TagBoxArray::collate() 2 0.0001566 0.002285 0.01519 0.10% FabArray::norminf() 282 0.01076 0.01122 0.01511 0.10% amrex::Add() 128 0.01412 0.01436 0.01465 0.10% Gravity::test_composite_phi() 1 0.0145 0.01453 0.01458 0.10% Castro::problem_post_timestep() 2 0.009264 0.01227 0.0143 0.10% Castro::wd_update() 2 0.009251 0.01223 0.01429 0.10% FabArrayBase::getCPC() 2005 0.00952 0.01074 0.0139 0.10% FabArrayBase::getFB() 6380 0.01011 0.01092 0.01371 0.09% FabArray::setDomainBndry() 147 0.0004348 0.006411 0.01205 0.08% MLLinOp::define() 19 0.003702 0.00726 0.01142 0.08% MLLinOp::defineGrids() 19 0.003622 0.007177 0.01134 0.08% Amr::writeSmallPlotFile() 2 0.008807 0.008819 0.008825 0.06% MLLinOp::makeSubCommunicator() 19 0.0008443 0.004311 0.008152 0.06% MLMG::getGradSolution() 18 0.007475 0.007813 0.008079 0.06% MLCellLinOp::compGrad() 18 0.007434 0.007772 0.008037 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0004952 0.007924 0.05% FabArray::mult() 59 0.007367 0.00756 0.007924 0.05% Castro::volWgtSum() 46 0.007269 0.007329 0.007388 0.05% FabArrayBase::CPC::define() 576 0.002207 0.003343 0.006347 0.04% MLCellLinOp::defineBC() 19 0.005525 0.005728 0.006166 0.04% amrex::Dot() 142 0 0.0003674 0.005878 0.04% Castro::volInBoundary() 14 0.003427 0.003712 0.005366 0.04% BndryData::define() 19 0.003926 0.004191 0.004527 0.03% Gravity::update_max_rhs() 2 0.001437 0.002503 0.00408 0.03% MLPoisson::normalize() 79 0 0.0001941 0.003106 0.02% MultiFab::max() 2 0.0001817 0.001252 0.002835 0.02% MLPoisson::prepareForSolve() 19 0.001775 0.001873 0.00214 0.01% MLCellLinOp::prepareForSolve() 19 0.001702 0.001803 0.002071 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001334 0.00158 0.001805 0.01% AmrLevel::AmrLevel(dm) 1 0.001365 0.0014 0.001456 0.01% FabArrayBase::FB::FB() 75 0.0002806 0.0006798 0.001427 0.01% StateData::define() 6 0.001329 0.001364 0.001419 0.01% MLMG::MLResNormInf() 18 0.001227 0.001261 0.001292 0.01% Gravity::swapTimeLevels() 8 0.001153 0.001201 0.001249 0.01% MLMG::MLRhsNormInf() 18 0.00121 0.001225 0.001244 0.01% MLMG::compResidual() 1 0.0009366 0.00113 0.001231 0.01% Castro::locWgtSum() 6 0.001114 0.001128 0.001145 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009196 0.0009593 0.001105 0.01% MLCellLinOp::setLevelBC() 19 0.0005413 0.0006715 0.0008321 0.01% makeSFC 95 0.0005878 0.0006129 0.0006903 0.00% Castro::buildMetrics() 1 0.0006444 0.0006612 0.0006712 0.00% Castro::errorEst() 2 0.000518 0.0005846 0.0006502 0.00% Castro::apply_tagging_restrictions() 2 0.0004191 0.0004837 0.000549 0.00% Gravity::applyMetricTerms() 2 0.0004857 0.0004976 0.0005238 0.00% Castro::swap_state_time_levels() 8 0.0004286 0.0004351 0.000448 0.00% Castro::volProductSum() 2 0.0004009 0.000406 0.000412 0.00% Castro::enforce_consistent_e() 1 0.0003645 0.0003755 0.0004029 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001134 0.0002952 0.0003326 0.00% Castro::finalize_advance() 1 0.0002552 0.0002643 0.0002793 0.00% Castro::finalize_do_advance() 17 0.0001714 0.0001887 0.0002607 0.00% DistributionMapping::LeastUsedCPUs() 1 3.3e-05 0.0002179 0.000253 0.00% DistributionMapping::Distribute() 95 0.0002109 0.0002219 0.0002389 0.00% OwnerMask() 2 0.000135 0.000153 0.0001698 0.00% Castro::enforce_speed_limit() 79 0.0001036 0.0001118 0.0001249 0.00% Castro::apply_problem_tags() 2 9.281e-05 9.478e-05 0.0001016 0.00% MultiFab::Swap() 5 6.75e-05 7.201e-05 8.659e-05 0.00% knapsack() 1 5.655e-05 5.913e-05 6.347e-05 0.00% Amr::initSubcycle() 1 5.714e-05 6.05e-05 6.299e-05 0.00% Castro::construct_new_rotation_source() 17 2.041e-05 2.226e-05 3.809e-05 0.00% Castro::construct_old_rotation_source() 20 3.011e-05 3.081e-05 3.233e-05 0.00% BoxList::parallelComplementIn() 4 1.306e-05 1.349e-05 1.417e-05 0.00% Castro::estTimeStep() 10 1.188e-05 1.266e-05 1.321e-05 0.00% Castro::computeInitialDt() 2 9.647e-06 1.01e-05 1.072e-05 0.00% Castro::gwstrain() 2 4.341e-06 5.132e-06 1.007e-05 0.00% BoxList::complementIn 4 6.04e-06 6.262e-06 6.686e-06 0.00% Gravity::set_mass_offset() 2 4.229e-06 4.493e-06 5.127e-06 0.00% Castro::FluxRegCrseInit 1 1.665e-06 1.841e-06 2.261e-06 0.00% Castro::FluxRegFineAdd() 1 1.421e-06 1.511e-06 1.657e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 12 B 13 B 19 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-3-gd78e241d1ad4) finalized