Initializing AMReX (24.01-2-ge0b77e1fce49)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.01-2-ge0b77e1fce49) initialized Starting run at 08:48:09 UTC on 2024-01-09. Successfully read inputs file ... Castro git describe: 24.01-5-g92138399c AMReX git describe: 24.01-2-ge0b77e1fc Microphysics git describe: 24.01-8-g518b421f reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.155028989 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000963662 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010617163 Gravity::multilevel_solve_for_new_phi() time = 0.099687464 Gravity::fill_multipole_BCs() time = 0.010610441 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049148161 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004049483 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.00293547 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.063609196 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006951626 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.063066365 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006616446 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060159696 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004180491 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058906704 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326507764 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015028746 Gravity::solve_for_phi() time = 0.088222933 on level 0 Castro::construct_new_gravity() time = 0.090257694 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.059826987 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.003838102 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.06013203 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.319681875 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014789192 Gravity::solve_for_phi() time = 0.083106224 on level 0 Castro::construct_new_gravity() time = 0.085128187 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.059269585 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.003624703 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060179108 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.342937171 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014417461 Gravity::solve_for_phi() time = 0.083082356 on level 0 Castro::construct_new_gravity() time = 0.085113993 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.059230519 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003153681 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058139173 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.352907352 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014463707 Gravity::solve_for_phi() time = 0.082047889 on level 0 Castro::construct_new_gravity() time = 0.084079012 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.059427567 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002641694 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.070197069 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338952284 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015186229 Gravity::solve_for_phi() time = 0.081998691 on level 0 Castro::construct_new_gravity() time = 0.084103469 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.058704936 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002917532 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.083489522 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337664216 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01491617 Gravity::solve_for_phi() time = 0.106655026 on level 0 Castro::construct_new_gravity() time = 0.108766714 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.059549455 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002891735 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.067431008 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.384286539 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015084436 Gravity::solve_for_phi() time = 0.082134638 on level 0 Castro::construct_new_gravity() time = 0.084230856 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.058848778 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002878501 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.088286776 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.342840223 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015996348 Gravity::solve_for_phi() time = 0.085491978 on level 0 Castro::construct_new_gravity() time = 0.090639088 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060113386 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.023453605 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.063088701 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33221943 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016636151 Gravity::solve_for_phi() time = 0.086010632 on level 0 Castro::construct_new_gravity() time = 0.08811605 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.058707084 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002565823 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058308082 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324909926 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0152084 Gravity::solve_for_phi() time = 0.082613753 on level 0 Castro::construct_new_gravity() time = 0.084723214 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.058652997 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002696605 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058432597 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329825572 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014650677 Gravity::solve_for_phi() time = 0.081566973 on level 0 Castro::construct_new_gravity() time = 0.08362501 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.058799587 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002553102 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058319373 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324962111 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015604951 Gravity::solve_for_phi() time = 0.082538449 on level 0 Castro::construct_new_gravity() time = 0.084642411 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.058682645 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002579727 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058069252 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328211376 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015345529 Gravity::solve_for_phi() time = 0.083804346 on level 0 Castro::construct_new_gravity() time = 0.085912825 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.058843689 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002530478 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058172566 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325078073 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015770698 Gravity::solve_for_phi() time = 0.082502452 on level 0 Castro::construct_new_gravity() time = 0.084602183 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.058770254 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002563423 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058383038 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329544888 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01555736 Gravity::solve_for_phi() time = 0.082397134 on level 0 Castro::construct_new_gravity() time = 0.084488316 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.058435086 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002565085 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.057931875 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324886885 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015749841 Gravity::solve_for_phi() time = 0.082421252 on level 0 Castro::construct_new_gravity() time = 0.084528142 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.058264372 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002536804 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058625632 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33046761 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015881969 Gravity::solve_for_phi() time = 0.08341411 on level 0 Castro::construct_new_gravity() time = 0.085514942 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.058663704 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002759185646 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.93377442 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.0468682 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004103073 seconds Ending run at 08:48:24 UTC on 2024-01-09. Run time = 14.50769462 Run time without initialization = 11.98565374 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.51 ... 14.51 ... 14.51 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3995 5.4532 5.5659 38.37% Amr::InitAmr() 1 1.649 1.649 1.65 11.37% Castro::computeTemp() 80 0.8487 0.9667 1.121 7.73% amrex::Copy() 724 0.7576 0.7626 0.7753 5.34% FabArray::ParallelCopy_finish() 1429 0.06306 0.5257 0.7491 5.16% MultiFab::AddProduct() 3439 0.5421 0.5459 0.5858 4.04% Castro::normalize_species() 79 0.5506 0.5541 0.5719 3.94% Castro::reset_internal_energy(Fab) 160 0.5225 0.5264 0.5353 3.69% MLPoisson::Fsmooth() 6144 0.3154 0.3411 0.4102 2.83% FabArray::setVal() 5013 0.3534 0.3576 0.3733 2.57% Castro::initMFs() 1 0.3567 0.3644 0.3712 2.56% MultiFab::Subtract() 159 0.3351 0.336 0.3428 2.36% check_for_negative_density() 20 0.1056 0.2519 0.3097 2.13% Gravity::fill_multipole_BCs() 19 0.194 0.2342 0.2758 1.90% Castro::reset_internal_energy(MultiFab) 80 0.02238 0.07233 0.2467 1.70% FabArray::ParallelCopy_nowait() 1429 0.1844 0.2011 0.2192 1.51% FabArray::sum() 3439 0.186 0.1874 0.2008 1.38% Castro::initData() 1 0.003264 0.02634 0.1534 1.06% FillBoundary_finish() 6380 0.0969 0.1178 0.1447 1.00% FillBoundary_nowait() 6380 0.07001 0.0946 0.1211 0.83% Castro::do_old_sources() 20 0.0004765 0.02089 0.1144 0.79% MLPoisson::Fapply() 986 0.09439 0.09864 0.1138 0.78% MLCellLinOp::applyBC() 7148 0.04647 0.06114 0.1014 0.70% FabArray::Saxpy() 264 0.06745 0.0682 0.07509 0.52% Castro::do_new_sources() 17 0.0003359 0.01336 0.07402 0.51% Castro::construct_new_gravity_source() 17 0.06794 0.06894 0.06957 0.48% MultiFab::contains_nan() 37 0.04556 0.0466 0.05878 0.41% FabArray::Xpay() 945 0.04967 0.052 0.05867 0.40% Castro::enforce_min_density() 79 0.01721 0.02553 0.05029 0.35% Castro::construct_old_gravity_source() 20 0.04568 0.04588 0.04625 0.32% MLMG::addInterpCorrection() 768 0.03278 0.03504 0.04144 0.29% AmrLevel::derive() 18 0.04049 0.04091 0.04139 0.29% StateData::FillBoundary(geom) 143 0 0.01773 0.03416 0.24% amrex::average_down 768 0.02429 0.02625 0.03215 0.22% VisMF::Write(FabArray) 4 0.01192 0.01302 0.02404 0.17% Amr::writePlotFile() 2 0.007478 0.01723 0.01873 0.13% MLCellLinOp::defineAuxData() 19 0.01421 0.01482 0.01684 0.12% FabArray::FillBoundary() 6380 0.01347 0.01384 0.01658 0.11% MLCGSolver::bicgstab 8 0 0.0009873 0.0158 0.11% Castro::construct_new_source() 102 0.01536 0.01541 0.01552 0.11% amrex::Add() 128 0.01437 0.01449 0.01533 0.11% FabArray::norminf() 282 0.01069 0.01111 0.01504 0.10% Castro::construct_old_gravity() 20 0.0003505 0.003435 0.01462 0.10% Castro::evaluate_source_change() 196 0.01217 0.01235 0.01287 0.09% FabArrayBase::getFB() 6380 0.00988 0.01028 0.01269 0.09% FillPatchIterator::Initialize 147 0.01224 0.01236 0.01266 0.09% MLCellLinOp::smooth() 3072 0.01093 0.01127 0.01208 0.08% FabArray::setDomainBndry() 147 0.0004312 0.006232 0.01163 0.08% Castro::wd_update() 2 0.004721 0.007583 0.01068 0.07% MLMG::prepareForSolve() 18 0.009726 0.009919 0.01053 0.07% Castro::construct_old_source() 120 0.009758 0.00983 0.009931 0.07% MLMG::ResNormInf() 146 0.004148 0.007113 0.009092 0.06% FabArray::mult() 59 0.007679 0.007811 0.008069 0.06% Castro::volWgtSum() 46 0.00721 0.007368 0.007965 0.05% Gravity::get_new_grav_vector() 18 0.005991 0.006252 0.007872 0.05% MLLinOp::makeSubCommunicator() 19 0.0005532 0.003902 0.007584 0.05% Gravity::actual_solve_with_mlmg() 19 0.00652 0.006775 0.007583 0.05% FabArrayBase::getCPC() 2005 0.00704 0.007196 0.007514 0.05% Gravity::get_old_grav_vector() 20 0.006331 0.006388 0.00649 0.04% MLCellLinOp::compGrad() 18 0.005915 0.006 0.006428 0.04% FabArrayBase::CPC::define() 576 0.002168 0.003275 0.006335 0.04% amrex::Dot() 142 0 0.0003714 0.005943 0.04% MLMG::solve() 18 0.0007281 0.002566 0.005526 0.04% Amr::writeSmallPlotFile() 2 0.003591 0.005199 0.005442 0.04% Castro::volInBoundary() 14 0.003395 0.003666 0.005364 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003168 0.005069 0.03% MultiFab::max() 2 0.0001521 0.002288 0.004826 0.03% Castro::initialize_do_advance() 20 0.004296 0.004411 0.004672 0.03% MLCellLinOp::apply() 986 0.001975 0.002188 0.004631 0.03% FabArray::ParallelCopy() 1429 0.003428 0.003499 0.003728 0.03% Castro::construct_new_gravity() 17 0.0002605 0.000986 0.003658 0.03% BndryData::define() 19 0.003006 0.003116 0.003216 0.02% MLPoisson::normalize() 79 0 0.000187 0.002993 0.02% Castro::sum_integrated_quantities() 2 0.001854 0.002389 0.002675 0.02% MLCellLinOp::prepareForSolve() 19 0.001806 0.00192 0.002283 0.02% AmrLevel::FillPatch() 147 0.002004 0.002095 0.002172 0.01% MLLinOp::defineGrids() 19 0.001729 0.001812 0.002124 0.01% MLCellLinOp::correctionResidual() 768 0.001787 0.001836 0.001912 0.01% Gravity::solve_for_phi() 17 0.0007381 0.0009397 0.001853 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001276 0.001527 0.001767 0.01% MLMG::mgVcycle() 128 0.001526 0.001594 0.001745 0.01% MLCellLinOp::defineBC() 19 0.001487 0.00152 0.001614 0.01% MLMG:computeResOfCorrection() 768 0.001359 0.001395 0.001478 0.01% TagBoxArray::collate() 2 0.0001092 0.0006752 0.00144 0.01% main() 1 0.000982 0.001193 0.001417 0.01% FabArrayBase::FB::FB() 75 0.0002746 0.0006706 0.001415 0.01% StateData::define() 6 0.001232 0.001269 0.001322 0.01% Castro::save_data_for_retry() 3 0.001225 0.001257 0.001276 0.01% Castro::locWgtSum() 6 0.001135 0.001154 0.001172 0.01% MLMG::actualBottomSolve() 128 0.0001323 0.0001956 0.001045 0.01% StateDataPhysBCFunct::() 147 0.0006621 0.0007833 0.0008832 0.01% MLCellLinOp::setLevelBC() 19 0.0005343 0.0006556 0.0008189 0.01% Castro::subcycle_advance_ctu() 1 0.000182 0.00023 0.0008007 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006838 0.0006974 0.0007161 0.00% MLMG::mgVcycle_down::2 128 0.0006097 0.000654 0.0007154 0.00% MLMG::mgVcycle_down::3 128 0.0005687 0.0006092 0.0006944 0.00% MLMG::mgVcycle_down::0 128 0.0006388 0.0006565 0.0006785 0.00% MLMG::mgVcycle_down::1 128 0.0006435 0.0006543 0.0006702 0.00% MLMG::mgVcycle_down::5 128 0.0005764 0.0005876 0.0006585 0.00% MLMG::mgVcycle_down::4 128 0.000554 0.0005748 0.0006519 0.00% Castro::Castro() 1 0.0004547 0.0005672 0.0006475 0.00% Castro::buildMetrics() 1 0.0005486 0.0005652 0.0006095 0.00% AmrMesh::MakeNewGrids() 2 0.0005013 0.0005197 0.0005411 0.00% Castro::apply_tagging_restrictions() 2 0.0003998 0.00047 0.0005315 0.00% Gravity::applyMetricTerms() 2 0.0004934 0.000506 0.000517 0.00% Castro::clean_state() 79 0.0004208 0.0004434 0.0005045 0.00% FillPatchSingleLevel 147 0.0004515 0.0004702 0.0004834 0.00% MLMG::mgVcycle_up::1 128 0.0004401 0.0004549 0.0004807 0.00% MLMG::mgVcycle_up::0 128 0.0004424 0.0004545 0.0004711 0.00% MLMG::mgVcycle_up::2 128 0.0003843 0.0004146 0.0004639 0.00% Castro::do_advance_ctu() 20 0.0004113 0.0004263 0.0004589 0.00% MLCellLinOp::solutionResidual() 147 0.0004163 0.0004302 0.0004503 0.00% MLMG::mgVcycle_up::5 128 0.0003942 0.0004016 0.0004386 0.00% MLMG::mgVcycle_up::3 128 0.0003797 0.000391 0.0004345 0.00% Castro::swap_state_time_levels() 8 0.0004111 0.0004195 0.0004276 0.00% MLMG::mgVcycle_up::4 128 0.0003834 0.0003916 0.0004227 0.00% makeSFC 95 0.0003588 0.000375 0.0004223 0.00% Castro::volProductSum() 2 0.0003994 0.0004055 0.0004106 0.00% MLMG::oneIter() 128 0.0003724 0.0003828 0.0003949 0.00% Castro::enforce_consistent_e() 1 0.0003679 0.0003786 0.0003885 0.00% Castro::problem_post_timestep() 2 1.075e-05 3.342e-05 0.0003616 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003215 0.0003288 0.0003463 0.00% MLMG::computeResidual() 128 0.0002365 0.000242 0.0002632 0.00% MLMG::mgVcycle_bottom 128 0.0002197 0.0002271 0.0002495 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002083 0.0002182 0.0002428 0.00% DistributionMapping::Distribute() 95 0.0002058 0.0002134 0.0002326 0.00% Castro::finalize_do_advance() 17 0.0001484 0.0001621 0.0001795 0.00% Gravity::update_max_rhs() 2 0.0001561 0.0001609 0.000168 0.00% MLMG::compResidual() 1 0.0001573 0.0001607 0.0001677 0.00% OwnerMask() 2 0.0001299 0.0001453 0.0001603 0.00% Amr::coarseTimeStep() 1 0.0001188 0.0001377 0.0001428 0.00% Amr::defBaseLevel() 1 0.0001028 0.0001274 0.0001424 0.00% Castro::retry_advance_ctu() 11 4.981e-05 5.777e-05 0.000138 0.00% MLPoisson::define() 19 0.0001218 0.0001275 0.0001356 0.00% TagBoxArray::mapPRD 2 0.0001043 0.0001171 0.0001315 0.00% AmrLevel::AmrLevel(dm) 1 7.535e-05 0.0001059 0.0001293 0.00% Castro::enforce_speed_limit() 79 9.97e-05 0.0001051 0.0001195 0.00% Gravity::test_composite_phi() 1 8.931e-05 9.851e-05 0.0001184 0.00% Castro::check_for_nan() 37 9.766e-05 0.0001044 0.0001181 0.00% Castro::initialize_advance() 1 9.893e-05 0.0001031 0.0001081 0.00% Castro::apply_source_to_state() 37 9.025e-05 9.404e-05 0.000101 0.00% Castro::apply_problem_tags() 2 9.173e-05 9.456e-05 9.944e-05 0.00% Amr::grid_places() 2 7.221e-05 8.235e-05 9.145e-05 0.00% MultiFab::Swap() 5 6.436e-05 6.933e-05 8.435e-05 0.00% MLLinOp::define() 19 7.539e-05 7.799e-05 8.395e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.567e-05 6.324e-05 8.274e-05 0.00% MLPoisson::prepareForSolve() 19 6.734e-05 7.252e-05 7.959e-05 0.00% Castro::create_source_corrector() 17 5.478e-05 5.852e-05 6.533e-05 0.00% Amr::FinalizeInit() 1 8.094e-06 2.01e-05 6.376e-05 0.00% knapsack() 1 5.422e-05 5.753e-05 6.216e-05 0.00% Amr::initSubcycle() 1 5.848e-05 5.932e-05 6.191e-05 0.00% Castro::expand_state() 20 4.879e-05 5.26e-05 5.787e-05 0.00% MLMG::computeMLResidual() 18 3.955e-05 4.213e-05 4.767e-05 0.00% MLMG::getGradSolution() 18 3.822e-05 4.088e-05 4.627e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.526e-05 2.87e-05 4.443e-05 0.00% Castro::derive() 18 3.867e-05 4.051e-05 4.219e-05 0.00% Castro::construct_old_rotation_source() 20 2.995e-05 3.131e-05 4.189e-05 0.00% Amr::timeStep() 1 1.164e-05 1.448e-05 3.87e-05 0.00% MLMG::MLResNormInf() 18 3.238e-05 3.418e-05 3.553e-05 0.00% Gravity::swapTimeLevels() 8 3.184e-05 3.351e-05 3.546e-05 0.00% Gravity::actual_multilevel_solve() 1 2.574e-05 2.714e-05 3.3e-05 0.00% MLMG::MLRhsNormInf() 18 3.064e-05 3.149e-05 3.232e-05 0.00% Amr::regrid() 1 1.039e-05 1.256e-05 2.952e-05 0.00% Castro::estTimeStep() 10 1.22e-05 1.399e-05 2.936e-05 0.00% Castro::construct_new_rotation_source() 17 2.068e-05 2.181e-05 2.561e-05 0.00% Castro::finalize_advance() 1 1.534e-05 1.7e-05 2.094e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.566e-05 1.692e-05 1.974e-05 0.00% Castro::post_regrid() 2 1.009e-05 1.225e-05 1.453e-05 0.00% Castro::post_init() 1 1.157e-05 1.241e-05 1.41e-05 0.00% Amr::InitializeInit() 1 7.023e-06 8.413e-06 1.256e-05 0.00% Castro::advance() 1 7.168e-06 9.128e-06 1.107e-05 0.00% Castro::computeInitialDt() 2 6.674e-06 7.706e-06 1.015e-05 0.00% Amr::bldFineLevels() 1 6.769e-06 7.527e-06 9.061e-06 0.00% Amr::init() 1 6.708e-06 7.299e-06 7.951e-06 0.00% BoxList::parallelComplementIn() 4 6.731e-06 7.174e-06 7.713e-06 0.00% Castro::errorEst() 2 5.905e-06 6.292e-06 6.658e-06 0.00% BoxList::complementIn 4 6.005e-06 6.164e-06 6.566e-06 0.00% Castro::post_timestep() 1 5.41e-06 5.644e-06 6.52e-06 0.00% Gravity::set_mass_offset() 2 4.015e-06 4.555e-06 6.505e-06 0.00% Castro::gwstrain() 2 4.15e-06 4.538e-06 6.382e-06 0.00% Amr::initialInit() 1 2.74e-06 3.133e-06 3.688e-06 0.00% Castro::FluxRegCrseInit 1 1.703e-06 1.958e-06 3.319e-06 0.00% Castro::FluxRegFineAdd() 1 1.371e-06 1.521e-06 1.656e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.51 14.51 14.51 100.00% Amr::coarseTimeStep() 1 11.99 11.99 11.99 82.61% Amr::timeStep() 1 11.93 11.93 11.93 82.26% Castro::advance() 1 11.87 11.87 11.88 81.86% Castro::subcycle_advance_ctu() 1 11.82 11.82 11.83 81.52% Castro::do_advance_ctu() 20 11.78 11.79 11.79 81.27% Castro::construct_ctu_hydro_source() 20 6.445 6.48 6.523 44.96% Castro::clean_state() 79 3.687 3.788 3.961 27.31% Castro::computeTemp() 80 2.383 2.503 2.73 18.82% Castro::reset_internal_energy(MultiFab) 80 1.477 1.536 1.704 11.75% Amr::InitAmr() 1 1.649 1.649 1.65 11.37% Gravity::solve_phi_with_mlmg() 19 1.46 1.502 1.548 10.67% Castro::construct_new_gravity() 17 1.387 1.43 1.476 10.17% Gravity::solve_for_phi() 17 1.351 1.392 1.437 9.91% Castro::initialize_do_advance() 20 1.362 1.394 1.428 9.84% Gravity::actual_solve_with_mlmg() 19 1.261 1.264 1.268 8.74% Castro::do_old_sources() 20 1.196 1.233 1.26 8.69% MLMG::solve() 18 1.212 1.216 1.217 8.39% MLMG::oneIter() 128 1.082 1.084 1.086 7.48% MLMG::mgVcycle() 128 1.067 1.069 1.071 7.38% Castro::evaluate_source_change() 196 0.9426 0.949 1.017 7.01% Castro::do_new_sources() 17 0.9336 0.9718 1.001 6.90% FabArray::ParallelCopy() 1429 0.2869 0.7493 0.973 6.71% Amr::init() 1 0.8719 0.8719 0.8719 6.01% Amr::initialInit() 1 0.8179 0.818 0.818 5.64% Castro::enforce_min_density() 79 0.7781 0.7889 0.8113 5.59% amrex::Copy() 724 0.7576 0.7626 0.7753 5.34% FabArray::ParallelCopy_finish() 1429 0.06306 0.5257 0.7491 5.16% MLCellLinOp::smooth() 3072 0.5448 0.5929 0.716 4.94% AmrLevel::FillPatch() 147 0.4793 0.6019 0.7056 4.86% Amr::InitializeInit() 1 0.4407 0.5042 0.5946 4.10% Amr::defBaseLevel() 1 0.4407 0.5042 0.5946 4.10% MultiFab::AddProduct() 3439 0.5421 0.5459 0.5858 4.04% Castro::normalize_species() 79 0.5506 0.5541 0.5719 3.94% Castro::reset_internal_energy(Fab) 160 0.5225 0.5264 0.5353 3.69% FillPatchIterator::Initialize 147 0.3057 0.4284 0.5322 3.67% FillPatchIterator::FillFromLevel0() 147 0.2817 0.4098 0.5155 3.55% FillPatchSingleLevel 147 0.281 0.4091 0.5148 3.55% MLPoisson::Fsmooth() 6144 0.3154 0.3411 0.4102 2.83% MLMG::mgVcycle_up::1 128 0.09123 0.2485 0.406 2.80% Amr::FinalizeInit() 1 0.2234 0.3138 0.3772 2.60% Castro::Castro() 1 0.3623 0.3699 0.377 2.60% FabArray::setVal() 5013 0.3534 0.3576 0.3733 2.57% Castro::initMFs() 1 0.3569 0.3645 0.3714 2.56% MLCellLinOp::applyBC() 7148 0.2553 0.2983 0.3698 2.55% MLMG::addInterpCorrection() 768 0.06048 0.2918 0.3581 2.47% MultiFab::Subtract() 159 0.3351 0.336 0.3428 2.36% check_for_negative_density() 20 0.1056 0.2519 0.3097 2.13% Gravity::fill_multipole_BCs() 19 0.196 0.2362 0.2778 1.91% FabArray::FillBoundary() 6380 0.2015 0.2371 0.2683 1.85% MLMG::mgVcycle_up::2 128 0.01053 0.1109 0.2643 1.82% MLMG::mgVcycle_down::0 128 0.2586 0.2609 0.2639 1.82% FabArray::ParallelCopy_nowait() 1429 0.2029 0.2201 0.2391 1.65% Castro::initData() 1 0.07679 0.1326 0.2295 1.58% Castro::expand_state() 20 0.1742 0.1805 0.2008 1.38% FabArray::sum() 3439 0.186 0.1874 0.2008 1.38% Amr::bldFineLevels() 1 0.04588 0.1364 0.1985 1.37% MLMG::mgVcycle_up::0 128 0.1949 0.1957 0.1967 1.36% MLCellLinOp::apply() 986 0.1479 0.1569 0.193 1.33% MLMG::mgVcycle_up::3 128 0.01049 0.02282 0.1724 1.19% Amr::grid_places() 2 0.002079 0.09257 0.156 1.08% AmrMesh::MakeNewGrids() 2 0.001992 0.09249 0.1559 1.07% TagBoxArray::mapPRD 2 0.000624 0.09056 0.1546 1.07% FillBoundary_finish() 6380 0.0969 0.1178 0.1447 1.00% MLMG:computeResOfCorrection() 768 0.111 0.1202 0.1437 0.99% MLCellLinOp::correctionResidual() 768 0.1096 0.1188 0.1422 0.98% Castro::post_init() 1 0.1321 0.1342 0.1367 0.94% FillBoundary_nowait() 6380 0.08033 0.1056 0.1325 0.91% Castro::construct_new_source() 102 0.1223 0.1234 0.124 0.86% MLMG::mgVcycle_down::1 128 0.1129 0.118 0.1224 0.84% MLPoisson::Fapply() 986 0.09439 0.09864 0.1138 0.78% Castro::create_source_corrector() 17 0.04705 0.08139 0.1103 0.76% Gravity::multilevel_solve_for_new_phi() 1 0.09963 0.09966 0.09971 0.69% Gravity::actual_multilevel_solve() 1 0.09957 0.0996 0.09964 0.69% Amr::writePlotFile() 2 0.09652 0.09662 0.09662 0.67% MLCellLinOp::solutionResidual() 147 0.08588 0.09081 0.09512 0.66% Castro::post_regrid() 2 0.08447 0.08699 0.0891 0.61% Castro::construct_old_source() 120 0.07825 0.07871 0.07944 0.55% MLMG::computeResidual() 128 0.07475 0.07563 0.0765 0.53% Castro::construct_old_gravity() 20 0.0455 0.05811 0.07619 0.53% FabArray::Saxpy() 264 0.06745 0.0682 0.07509 0.52% MLMG::mgVcycle_down::2 128 0.0124 0.03997 0.0704 0.49% MLMG::mgVcycle_bottom 128 0.0003543 0.004725 0.07013 0.48% Castro::derive() 18 0.06806 0.0688 0.06998 0.48% AmrLevel::derive() 18 0.06802 0.06876 0.06994 0.48% MLMG::actualBottomSolve() 128 0.0001323 0.004498 0.06989 0.48% Castro::construct_new_gravity_source() 17 0.06794 0.06894 0.06957 0.48% MLCGSolver::bicgstab 8 0 0.004272 0.06836 0.47% Gravity::get_old_grav_vector() 20 0.04187 0.05468 0.06311 0.43% Castro::post_timestep() 1 0.05777 0.05967 0.06207 0.43% Castro::check_for_nan() 37 0.04567 0.0467 0.05889 0.41% MultiFab::contains_nan() 37 0.04556 0.0466 0.05878 0.41% FabArray::Xpay() 945 0.04967 0.052 0.05867 0.40% MLMG::mgVcycle_down::3 128 0.01174 0.01767 0.05863 0.40% amrex::average_down 768 0.03232 0.03838 0.05384 0.37% Castro::initialize_advance() 1 0.04809 0.04957 0.05131 0.35% Amr::regrid() 1 0.04335 0.04477 0.04647 0.32% Castro::construct_old_gravity_source() 20 0.04568 0.04588 0.04625 0.32% Gravity::get_new_grav_vector() 18 0.03524 0.03694 0.03871 0.27% MLPoisson::define() 19 0.02768 0.03203 0.03802 0.26% Castro::retry_advance_ctu() 11 0.03496 0.03567 0.03635 0.25% StateDataPhysBCFunct::() 147 0.0006621 0.01851 0.03501 0.24% MLMG::mgVcycle_down::4 128 0.01167 0.0132 0.03423 0.24% StateData::FillBoundary(geom) 143 0 0.01773 0.03416 0.24% Castro::apply_source_to_state() 37 0.02747 0.02762 0.02781 0.19% MLMG::mgVcycle_up::4 128 0.01058 0.01164 0.02652 0.18% VisMF::Write(FabArray) 4 0.01192 0.01302 0.02404 0.17% MLCellLinOp::defineAuxData() 19 0.01819 0.01953 0.02352 0.16% MLMG::prepareForSolve() 18 0.02019 0.02091 0.02331 0.16% MLMG::mgVcycle_down::5 128 0.01167 0.01241 0.02257 0.16% Castro::sum_integrated_quantities() 2 0.02102 0.02129 0.02131 0.15% Castro::save_data_for_retry() 3 0.01807 0.01846 0.01946 0.13% MLMG::mgVcycle_up::5 128 0.01069 0.01127 0.01907 0.13% MLMG::ResNormInf() 146 0.01411 0.01662 0.01858 0.13% MLMG::computeMLResidual() 18 0.01033 0.01473 0.01849 0.13% amrex::Add() 128 0.01437 0.01449 0.01533 0.11% FabArray::norminf() 282 0.01069 0.01111 0.01504 0.10% Castro::problem_post_timestep() 2 0.009175 0.01128 0.01415 0.10% Castro::wd_update() 2 0.009165 0.01125 0.01414 0.10% FabArrayBase::getFB() 6380 0.01024 0.01095 0.0141 0.10% Gravity::test_composite_phi() 1 0.01399 0.01402 0.01404 0.10% FabArrayBase::getCPC() 2005 0.009328 0.01047 0.01385 0.10% FabArray::setDomainBndry() 147 0.0004312 0.006232 0.01163 0.08% MLLinOp::define() 19 0.0033 0.006708 0.01075 0.07% MLLinOp::defineGrids() 19 0.003222 0.00663 0.01067 0.07% Amr::writeSmallPlotFile() 2 0.008528 0.008529 0.008531 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005186 0.008297 0.06% FabArray::mult() 59 0.007679 0.007811 0.008069 0.06% MLMG::getGradSolution() 18 0.007438 0.007671 0.00805 0.06% MLCellLinOp::compGrad() 18 0.0074 0.00763 0.008004 0.06% Castro::volWgtSum() 46 0.00721 0.007368 0.007965 0.05% MLLinOp::makeSubCommunicator() 19 0.0005532 0.003902 0.007584 0.05% FabArrayBase::CPC::define() 576 0.002168 0.003275 0.006335 0.04% Gravity::update_max_rhs() 2 0.001444 0.003562 0.006075 0.04% amrex::Dot() 142 0 0.0003714 0.005943 0.04% MLCellLinOp::defineBC() 19 0.005487 0.005672 0.005853 0.04% Castro::volInBoundary() 14 0.003395 0.003666 0.005364 0.04% MultiFab::max() 2 0.0001521 0.002288 0.004826 0.03% BndryData::define() 19 0.003873 0.004152 0.004346 0.03% MLPoisson::normalize() 79 0 0.000187 0.002993 0.02% MLPoisson::prepareForSolve() 19 0.001885 0.001993 0.002354 0.02% MLCellLinOp::prepareForSolve() 19 0.001806 0.00192 0.002283 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001276 0.001527 0.001767 0.01% TagBoxArray::collate() 2 0.0001092 0.0006752 0.00144 0.01% AmrLevel::AmrLevel(dm) 1 0.001337 0.001375 0.00144 0.01% FabArrayBase::FB::FB() 75 0.0002746 0.0006706 0.001415 0.01% StateData::define() 6 0.001232 0.001269 0.001322 0.01% MLMG::MLResNormInf() 18 0.001229 0.001245 0.001285 0.01% Gravity::swapTimeLevels() 8 0.001162 0.001193 0.001284 0.01% MLMG::compResidual() 1 0.0009657 0.001106 0.001228 0.01% MLMG::MLRhsNormInf() 18 0.001172 0.001187 0.001201 0.01% Castro::locWgtSum() 6 0.001135 0.001154 0.001172 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0008907 0.0009172 0.0009934 0.01% MLCellLinOp::setLevelBC() 19 0.0005343 0.0006556 0.0008189 0.01% Castro::buildMetrics() 1 0.0006108 0.000628 0.0006734 0.00% makeSFC 95 0.0005647 0.0005884 0.0006488 0.00% Castro::errorEst() 2 0.0004989 0.0005709 0.0006343 0.00% Castro::apply_tagging_restrictions() 2 0.0003998 0.00047 0.0005315 0.00% Gravity::applyMetricTerms() 2 0.0004934 0.000506 0.000517 0.00% Castro::swap_state_time_levels() 8 0.0004111 0.0004195 0.0004276 0.00% Castro::volProductSum() 2 0.0003994 0.0004055 0.0004106 0.00% Castro::enforce_consistent_e() 1 0.0003679 0.0003786 0.0003885 0.00% Castro::finalize_advance() 1 0.000247 0.0002515 0.0002576 0.00% DistributionMapping::Distribute() 95 0.0002058 0.0002134 0.0002326 0.00% Castro::finalize_do_advance() 17 0.0001578 0.000172 0.0001893 0.00% OwnerMask() 2 0.0001299 0.0001453 0.0001603 0.00% DistributionMapping::KnapSackDoIt() 1 8.979e-05 0.0001031 0.0001253 0.00% Castro::enforce_speed_limit() 79 9.97e-05 0.0001051 0.0001195 0.00% Castro::apply_problem_tags() 2 9.173e-05 9.456e-05 9.944e-05 0.00% MultiFab::Swap() 5 6.436e-05 6.933e-05 8.435e-05 0.00% knapsack() 1 5.422e-05 5.753e-05 6.216e-05 0.00% Amr::initSubcycle() 1 5.848e-05 5.932e-05 6.191e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.526e-05 2.87e-05 4.443e-05 0.00% Castro::construct_old_rotation_source() 20 2.995e-05 3.131e-05 4.189e-05 0.00% Castro::estTimeStep() 10 1.22e-05 1.399e-05 2.936e-05 0.00% Castro::computeInitialDt() 2 9.776e-06 1.183e-05 2.71e-05 0.00% Castro::construct_new_rotation_source() 17 2.068e-05 2.181e-05 2.561e-05 0.00% BoxList::parallelComplementIn() 4 1.274e-05 1.334e-05 1.389e-05 0.00% BoxList::complementIn 4 6.005e-06 6.164e-06 6.566e-06 0.00% Gravity::set_mass_offset() 2 4.015e-06 4.555e-06 6.505e-06 0.00% Castro::gwstrain() 2 4.15e-06 4.538e-06 6.382e-06 0.00% Castro::FluxRegCrseInit 1 1.703e-06 1.958e-06 3.319e-06 0.00% Castro::FluxRegFineAdd() 1 1.371e-06 1.521e-06 1.656e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 10 B 12 B 16 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.01-2-ge0b77e1fce49) finalized