Initializing AMReX (24.03-7-g155f1f4c3f4f)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.03-7-g155f1f4c3f4f) initialized Starting run at 08:02:38 UTC on 2024-03-12. Successfully read inputs file ... Castro git describe: 24.03-3-gfbd880fa0 AMReX git describe: 24.03-7-g155f1f4c3 Microphysics git describe: 24.03-6-g95cb860c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.155238755 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001181131 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.01117931 Gravity::multilevel_solve_for_new_phi() time = 0.100610196 Gravity::fill_multipole_BCs() time = 0.010996548 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.053645318 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004141279 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002960719 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.0629917 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007864924 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.062159151 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005821178 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060500996 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006019186 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.05937163 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.319560943 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014706189 Gravity::solve_for_phi() time = 0.085454411 on level 0 Castro::construct_new_gravity() time = 0.087536882 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060915015 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.00293167 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059927924 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.343938306 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.021513899 Gravity::solve_for_phi() time = 0.098228349 on level 0 Castro::construct_new_gravity() time = 0.100396225 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.066641541 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.01186686 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.061084313 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32730217 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01396643 Gravity::solve_for_phi() time = 0.085891482 on level 0 Castro::construct_new_gravity() time = 0.087934124 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.061419987 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002951093 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059668794 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32461554 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015439074 Gravity::solve_for_phi() time = 0.086992455 on level 0 Castro::construct_new_gravity() time = 0.089143893 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.061702283 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002598321 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060100572 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334120205 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01559177 Gravity::solve_for_phi() time = 0.085614867 on level 0 Castro::construct_new_gravity() time = 0.087667984 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.059944314 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002976863 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.060404257 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.325577443 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015049979 Gravity::solve_for_phi() time = 0.084814522 on level 0 Castro::construct_new_gravity() time = 0.086880261 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.06092018 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003032739 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058454007 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329433468 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015100078 Gravity::solve_for_phi() time = 0.084969429 on level 0 Castro::construct_new_gravity() time = 0.087099778 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060808802 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003251753 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059309981 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323373267 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015438659 Gravity::solve_for_phi() time = 0.088139108 on level 0 Castro::construct_new_gravity() time = 0.090280214 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060955877 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00306681 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059591412 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.342804138 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016102175 Gravity::solve_for_phi() time = 0.086324048 on level 0 Castro::construct_new_gravity() time = 0.088446036 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.060971708 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003120697 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.060078887 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.341348915 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.021289341 Gravity::solve_for_phi() time = 0.092606468 on level 0 Castro::construct_new_gravity() time = 0.094644752 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.059140155 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002993279 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059905945 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329540153 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016213751 Gravity::solve_for_phi() time = 0.08589032 on level 0 Castro::construct_new_gravity() time = 0.087998142 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.060221202 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002786125 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060762273 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323930144 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015984249 Gravity::solve_for_phi() time = 0.085504575 on level 0 Castro::construct_new_gravity() time = 0.087551814 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.06036919 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002881054 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059480321 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331401442 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016984919 Gravity::solve_for_phi() time = 0.086769276 on level 0 Castro::construct_new_gravity() time = 0.088858682 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.0604325 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002961006 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059695994 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328720963 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016550184 Gravity::solve_for_phi() time = 0.087306146 on level 0 Castro::construct_new_gravity() time = 0.089380876 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.060529568 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003569744 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059750862 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332472836 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016925315 Gravity::solve_for_phi() time = 0.08897775 on level 0 Castro::construct_new_gravity() time = 0.091021268 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.061685283 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002767373 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.06354517 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335951327 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018270304 Gravity::solve_for_phi() time = 0.093282134 on level 0 Castro::construct_new_gravity() time = 0.095330636 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.061427573 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.00534091 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059650873 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.346744629 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017275926 Gravity::solve_for_phi() time = 0.088895421 on level 0 Castro::construct_new_gravity() time = 0.090939 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.061097829 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002761618344 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.92450015 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.05249039 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004159742 seconds Ending run at 08:02:53 UTC on 2024-03-12. Run time = 14.57056937 Run time without initialization = 11.98199599 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.57 ... 14.57 ... 14.57 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3636 5.4488 5.5870 38.34% Amr::InitAmr() 1 1.701 1.701 1.702 11.68% Castro::computeTemp() 80 0.8565 0.9619 1.116 7.66% amrex::Copy() 724 0.7814 0.808 1.063 7.29% FabArray::ParallelCopy_finish() 1429 0.04767 0.526 0.7896 5.42% Castro::normalize_species() 79 0.5459 0.5532 0.5721 3.93% MultiFab::AddProduct() 3439 0.5301 0.536 0.5504 3.78% Castro::reset_internal_energy(Fab) 160 0.5163 0.5247 0.54 3.71% MLPoisson::Fsmooth() 6144 0.3124 0.3389 0.4121 2.83% Castro::initMFs() 1 0.3578 0.364 0.381 2.62% FabArray::setVal() 5013 0.3477 0.3535 0.3646 2.50% MultiFab::Subtract() 159 0.3334 0.3366 0.3442 2.36% Gravity::fill_multipole_BCs() 19 0.1981 0.2523 0.3008 2.06% Castro::reset_internal_energy(MultiFab) 80 0.02265 0.08061 0.2975 2.04% check_for_negative_density() 20 0.03872 0.1718 0.2813 1.93% FabArray::ParallelCopy_nowait() 1429 0.1836 0.2012 0.2168 1.49% FabArray::sum() 3439 0.1846 0.1868 0.1922 1.32% Castro::initData() 1 0.003396 0.02607 0.1497 1.03% FillBoundary_finish() 6380 0.09983 0.1228 0.1469 1.01% Castro::enforce_min_density() 79 0.0174 0.04273 0.1382 0.95% FillBoundary_nowait() 6380 0.07771 0.103 0.129 0.89% MLPoisson::Fapply() 986 0.09538 0.1001 0.1156 0.79% MLCellLinOp::applyBC() 7148 0.04787 0.06275 0.1052 0.72% FabArray::Saxpy() 264 0.0716 0.0726 0.08008 0.55% Castro::do_new_sources() 17 0.0003819 0.01002 0.07696 0.53% Castro::construct_new_gravity_source() 17 0.06899 0.07049 0.07181 0.49% FabArray::Xpay() 945 0.05059 0.05316 0.06032 0.41% Castro::do_old_sources() 20 0.0005299 0.01045 0.04879 0.33% Castro::construct_old_gravity_source() 20 0.04531 0.0458 0.047 0.32% MultiFab::contains_nan() 37 0.04492 0.04544 0.04597 0.32% AmrLevel::derive() 18 0.04111 0.04143 0.04187 0.29% MLMG::addInterpCorrection() 768 0.03204 0.03469 0.04181 0.29% StateData::FillBoundary(geom) 143 0 0.01713 0.03308 0.23% VisMF::Write(FabArray) 4 0.01194 0.01365 0.03307 0.23% amrex::average_down 768 0.02427 0.02642 0.03245 0.22% Amr::writePlotFile() 2 0.007214 0.02442 0.02673 0.18% Castro::construct_new_source() 102 0.01566 0.01594 0.01761 0.12% MLCellLinOp::defineAuxData() 19 0.01438 0.01518 0.01742 0.12% FabArray::FillBoundary() 6380 0.01344 0.01406 0.01703 0.12% MLCGSolver::bicgstab 8 0 0.001038 0.0166 0.11% FabArray::norminf() 282 0.01084 0.01135 0.01541 0.11% amrex::Add() 128 0.01412 0.01428 0.01451 0.10% Castro::evaluate_source_change() 196 0.01272 0.01302 0.0139 0.10% Castro::wd_update() 2 0.005044 0.009228 0.01331 0.09% FillPatchIterator::Initialize 147 0.0123 0.01264 0.01304 0.09% FabArrayBase::getFB() 6380 0.009957 0.01045 0.01291 0.09% MLCellLinOp::smooth() 3072 0.01116 0.01165 0.0127 0.09% MLMG::ResNormInf() 146 0.004885 0.009477 0.01244 0.09% FabArray::setDomainBndry() 147 0.0004463 0.005915 0.01119 0.08% MLMG::prepareForSolve() 18 0.009902 0.01014 0.01094 0.08% Castro::construct_old_source() 120 0.009909 0.01005 0.01021 0.07% Castro::construct_old_gravity() 20 0.0004128 0.002543 0.009363 0.06% MLLinOp::makeSubCommunicator() 19 0.001114 0.004862 0.008669 0.06% Castro::volWgtSum() 46 0.007218 0.007368 0.008027 0.06% Gravity::actual_solve_with_mlmg() 19 0.00656 0.00693 0.007922 0.05% FabArrayBase::getCPC() 2005 0.007236 0.007484 0.007846 0.05% FabArray::mult() 59 0.006988 0.007176 0.007826 0.05% MLMG::solve() 18 0.00266 0.00478 0.007174 0.05% Gravity::get_old_grav_vector() 20 0.006406 0.006518 0.007014 0.05% MultiFab::max() 2 0.0001594 0.004175 0.00684 0.05% Gravity::get_new_grav_vector() 18 0.005959 0.006122 0.0064 0.04% FabArrayBase::CPC::define() 576 0.002156 0.00332 0.00632 0.04% amrex::Dot() 142 0 0.0003806 0.00609 0.04% MLCellLinOp::compGrad() 18 0.005825 0.005874 0.005952 0.04% Amr::writeSmallPlotFile() 2 0.003661 0.00531 0.005772 0.04% Castro::volInBoundary() 14 0.003425 0.003686 0.00547 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003106 0.004969 0.03% Castro::initialize_do_advance() 20 0.004367 0.004561 0.004792 0.03% MLCellLinOp::apply() 986 0.002009 0.002233 0.004765 0.03% Castro::sum_integrated_quantities() 2 0.002132 0.004099 0.004644 0.03% FabArray::ParallelCopy() 1429 0.003504 0.003683 0.00404 0.03% BndryData::define() 19 0.003058 0.003138 0.003452 0.02% Castro::construct_new_gravity() 17 0.0003101 0.0008808 0.003356 0.02% MLPoisson::normalize() 79 0 0.0001999 0.003198 0.02% AmrLevel::FillPatch() 147 0.00212 0.002247 0.002413 0.02% MLLinOp::defineGrids() 19 0.001764 0.001866 0.002188 0.02% MLCellLinOp::prepareForSolve() 19 0.001629 0.001765 0.002097 0.01% MLCellLinOp::correctionResidual() 768 0.00181 0.001893 0.002014 0.01% MLMG::mgVcycle() 128 0.001521 0.001616 0.001824 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001269 0.001537 0.001775 0.01% MLCellLinOp::defineBC() 19 0.001539 0.001575 0.001717 0.01% Gravity::solve_for_phi() 17 0.0008192 0.001005 0.001577 0.01% MLMG:computeResOfCorrection() 768 0.001376 0.00144 0.001536 0.01% TagBoxArray::collate() 2 0.0002311 0.0008812 0.001504 0.01% FabArrayBase::FB::FB() 75 0.0002729 0.0006691 0.001432 0.01% Castro::save_data_for_retry() 3 0.001243 0.001296 0.001422 0.01% StateData::define() 6 0.001324 0.001351 0.001392 0.01% main() 1 0.0009558 0.001134 0.001213 0.01% Castro::locWgtSum() 6 0.001133 0.001143 0.001164 0.01% MLMG::actualBottomSolve() 128 0.0001322 0.0001956 0.001068 0.01% StateDataPhysBCFunct::() 147 0.0007012 0.0008463 0.0009391 0.01% MLCellLinOp::setLevelBC() 19 0.0005418 0.000659 0.0008242 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006878 0.0007168 0.00075 0.01% MLMG::mgVcycle_down::2 128 0.0006243 0.0006861 0.0007376 0.01% MLMG::mgVcycle_down::3 128 0.0005922 0.0006362 0.0007229 0.00% MLMG::mgVcycle_down::1 128 0.0006621 0.0006866 0.0007223 0.00% Castro::subcycle_advance_ctu() 1 0.0001804 0.0002357 0.0007201 0.00% MLMG::mgVcycle_down::0 128 0.0006707 0.0006854 0.0007162 0.00% MLMG::mgVcycle_down::4 128 0.0005661 0.0006005 0.0006992 0.00% MLMG::mgVcycle_down::5 128 0.0005934 0.0006147 0.0006875 0.00% Castro::buildMetrics() 1 0.0005729 0.0005928 0.0006067 0.00% AmrMesh::MakeNewGrids() 2 0.000497 0.0005168 0.0006046 0.00% Castro::clean_state() 79 0.0004383 0.0004833 0.0005717 0.00% Castro::Castro() 1 0.0004643 0.0005025 0.0005649 0.00% Castro::apply_tagging_restrictions() 2 0.000421 0.0004808 0.000562 0.00% MLMG::mgVcycle_up::0 128 0.0004573 0.0004726 0.0005137 0.00% MLMG::mgVcycle_up::1 128 0.0004558 0.000484 0.0005126 0.00% Castro::do_advance_ctu() 20 0.0004141 0.0004579 0.0005069 0.00% FillPatchSingleLevel 147 0.0004731 0.0004885 0.0005041 0.00% Gravity::applyMetricTerms() 2 0.0004729 0.0004818 0.0004953 0.00% MLMG::mgVcycle_up::2 128 0.0003944 0.0004353 0.000481 0.00% MLMG::mgVcycle_up::3 128 0.000387 0.0004051 0.0004672 0.00% MLMG::mgVcycle_up::5 128 0.0004009 0.0004143 0.0004632 0.00% MLCellLinOp::solutionResidual() 147 0.0004247 0.0004419 0.0004616 0.00% makeSFC 95 0.0003651 0.0003867 0.0004571 0.00% Castro::swap_state_time_levels() 8 0.0004332 0.0004453 0.0004556 0.00% MLMG::mgVcycle_up::4 128 0.0003896 0.0004062 0.0004516 0.00% MLMG::oneIter() 128 0.0003917 0.000411 0.0004447 0.00% Castro::enforce_consistent_e() 1 0.0003627 0.0003848 0.0004365 0.00% Castro::volProductSum() 2 0.0003874 0.0003976 0.0004079 0.00% Castro::problem_post_timestep() 2 1.149e-05 3.594e-05 0.0003837 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003239 0.000337 0.0003727 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002102 0.0002368 0.0002724 0.00% DistributionMapping::Distribute() 95 0.0002113 0.0002212 0.0002583 0.00% MLMG::computeResidual() 128 0.0002401 0.0002475 0.0002547 0.00% MLMG::mgVcycle_bottom 128 0.0002251 0.0002354 0.0002512 0.00% Castro::finalize_do_advance() 17 0.0001552 0.000176 0.0001989 0.00% Gravity::update_max_rhs() 2 0.0001568 0.0001646 0.0001809 0.00% OwnerMask() 2 0.0001332 0.0001504 0.0001777 0.00% MLMG::compResidual() 1 0.0001543 0.0001582 0.0001777 0.00% Amr::defBaseLevel() 1 0.0001144 0.0001279 0.0001719 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.108e-05 8.489e-05 0.0001678 0.00% Amr::coarseTimeStep() 1 0.0001339 0.0001569 0.0001623 0.00% MLPoisson::define() 19 0.0001241 0.0001322 0.0001532 0.00% Castro::retry_advance_ctu() 11 5.606e-05 7.085e-05 0.0001528 0.00% Castro::check_for_nan() 37 0.0001058 0.0001167 0.0001395 0.00% TagBoxArray::mapPRD 2 0.0001081 0.0001184 0.0001326 0.00% Castro::enforce_speed_limit() 79 0.0001102 0.0001179 0.0001259 0.00% Gravity::test_composite_phi() 1 9.354e-05 9.947e-05 0.0001182 0.00% Amr::grid_places() 2 7.006e-05 9.009e-05 0.0001153 0.00% Castro::apply_problem_tags() 2 9.259e-05 9.672e-05 0.0001137 0.00% Castro::initialize_advance() 1 0.0001005 0.0001043 0.0001101 0.00% Castro::apply_source_to_state() 37 9.818e-05 0.0001044 0.0001097 0.00% MLLinOp::define() 19 7.503e-05 8.26e-05 8.934e-05 0.00% MLPoisson::prepareForSolve() 19 7.626e-05 8.013e-05 8.779e-05 0.00% Castro::create_source_corrector() 17 5.792e-05 6.563e-05 8.238e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 4.407e-05 7.113e-05 7.98e-05 0.00% MultiFab::Swap() 5 6.471e-05 6.738e-05 7.894e-05 0.00% knapsack() 1 5.75e-05 6.592e-05 7.707e-05 0.00% Castro::expand_state() 20 5.167e-05 5.548e-05 6.381e-05 0.00% Amr::initSubcycle() 1 5.512e-05 5.766e-05 6.06e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.492e-05 4.264e-05 5.823e-05 0.00% Castro::derive() 18 4.292e-05 4.61e-05 5.511e-05 0.00% Amr::FinalizeInit() 1 8.528e-06 1.175e-05 5.01e-05 0.00% MLMG::getGradSolution() 18 4.134e-05 4.266e-05 4.599e-05 0.00% MLMG::computeMLResidual() 18 3.973e-05 4.305e-05 4.588e-05 0.00% Gravity::swapTimeLevels() 8 3.24e-05 3.526e-05 3.726e-05 0.00% MLMG::MLResNormInf() 18 3.326e-05 3.539e-05 3.722e-05 0.00% Castro::construct_old_rotation_source() 20 2.98e-05 3.089e-05 3.428e-05 0.00% MLMG::MLRhsNormInf() 18 3.17e-05 3.26e-05 3.369e-05 0.00% Gravity::actual_multilevel_solve() 1 2.733e-05 2.808e-05 3.069e-05 0.00% Amr::regrid() 1 1.064e-05 1.288e-05 2.893e-05 0.00% Castro::construct_new_rotation_source() 17 2.067e-05 2.192e-05 2.35e-05 0.00% Castro::finalize_advance() 1 1.706e-05 1.827e-05 2.346e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.707e-05 1.905e-05 2.16e-05 0.00% Amr::timeStep() 1 1.232e-05 1.391e-05 2.012e-05 0.00% Castro::advance() 1 7.215e-06 1.036e-05 1.613e-05 0.00% Castro::post_init() 1 1.224e-05 1.317e-05 1.465e-05 0.00% Castro::estTimeStep() 10 1.166e-05 1.327e-05 1.422e-05 0.00% Castro::post_regrid() 2 1.055e-05 1.114e-05 1.255e-05 0.00% Castro::computeInitialDt() 2 6.741e-06 7.669e-06 1.194e-05 0.00% Amr::InitializeInit() 1 6.624e-06 7.673e-06 1.154e-05 0.00% BoxList::parallelComplementIn() 4 6.957e-06 7.5e-06 8.949e-06 0.00% Amr::bldFineLevels() 1 6.88e-06 7.607e-06 8.447e-06 0.00% Amr::init() 1 5.975e-06 7.03e-06 8.064e-06 0.00% Castro::errorEst() 2 6.459e-06 6.774e-06 7.724e-06 0.00% Castro::post_timestep() 1 5.805e-06 6.189e-06 7.391e-06 0.00% BoxList::complementIn 4 5.915e-06 6.172e-06 7.301e-06 0.00% Castro::gwstrain() 2 4.295e-06 4.835e-06 6.571e-06 0.00% Gravity::set_mass_offset() 2 4.516e-06 4.872e-06 5.496e-06 0.00% Castro::FluxRegCrseInit 1 1.668e-06 2.108e-06 4.17e-06 0.00% Amr::initialInit() 1 2.991e-06 3.251e-06 3.762e-06 0.00% Castro::FluxRegFineAdd() 1 1.4e-06 1.66e-06 3.139e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.57 14.57 14.57 100.00% Amr::coarseTimeStep() 1 11.98 11.98 11.98 82.23% Amr::timeStep() 1 11.92 11.92 11.92 81.84% Castro::advance() 1 11.86 11.86 11.87 81.43% Castro::subcycle_advance_ctu() 1 11.81 11.81 11.81 81.08% Castro::do_advance_ctu() 20 11.77 11.77 11.78 80.82% Castro::construct_ctu_hydro_source() 20 6.365 6.405 6.448 44.26% Castro::clean_state() 79 3.652 3.823 4.055 27.83% Castro::computeTemp() 80 2.358 2.518 2.784 19.11% Castro::reset_internal_energy(MultiFab) 80 1.475 1.557 1.749 12.00% Amr::InitAmr() 1 1.701 1.701 1.702 11.68% Gravity::solve_phi_with_mlmg() 19 1.497 1.554 1.607 11.03% Castro::construct_new_gravity() 17 1.425 1.48 1.53 10.50% Gravity::solve_for_phi() 17 1.386 1.443 1.495 10.26% Castro::initialize_do_advance() 20 1.408 1.446 1.48 10.16% Gravity::actual_solve_with_mlmg() 19 1.294 1.298 1.303 8.94% MLMG::solve() 18 1.244 1.248 1.25 8.58% Castro::do_old_sources() 20 1.154 1.183 1.204 8.27% MLMG::oneIter() 128 1.107 1.11 1.112 7.63% MLMG::mgVcycle() 128 1.093 1.095 1.098 7.53% amrex::Copy() 724 0.7814 0.808 1.063 7.29% Castro::do_new_sources() 17 0.9289 0.9828 1.039 7.13% FabArray::ParallelCopy() 1429 0.2757 0.751 1.01 6.93% Castro::evaluate_source_change() 196 0.9271 0.9372 0.9624 6.61% Castro::enforce_min_density() 79 0.7742 0.8111 0.8957 6.15% Amr::init() 1 0.8865 0.8865 0.8865 6.08% Amr::initialInit() 1 0.8279 0.8279 0.828 5.68% FabArray::ParallelCopy_finish() 1429 0.04767 0.526 0.7896 5.42% MLCellLinOp::smooth() 3072 0.5547 0.6043 0.7324 5.03% AmrLevel::FillPatch() 147 0.4722 0.5999 0.7231 4.96% Amr::InitializeInit() 1 0.4448 0.5063 0.5989 4.11% Amr::defBaseLevel() 1 0.4448 0.5063 0.5989 4.11% Castro::normalize_species() 79 0.5459 0.5532 0.5721 3.93% MultiFab::AddProduct() 3439 0.5301 0.536 0.5504 3.78% FillPatchIterator::Initialize 147 0.2906 0.4159 0.5443 3.74% Castro::reset_internal_energy(Fab) 160 0.5163 0.5247 0.54 3.71% FillPatchIterator::FillFromLevel0() 147 0.2668 0.3974 0.5277 3.62% FillPatchSingleLevel 147 0.266 0.3967 0.527 3.62% MLMG::mgVcycle_up::1 128 0.09574 0.2606 0.4264 2.93% MLPoisson::Fsmooth() 6144 0.3124 0.3389 0.4121 2.83% Castro::Castro() 1 0.3632 0.3694 0.3873 2.66% MLCellLinOp::applyBC() 7148 0.282 0.3138 0.3844 2.64% Amr::FinalizeInit() 1 0.2291 0.3215 0.3831 2.63% Castro::initMFs() 1 0.3579 0.3642 0.3812 2.62% MLMG::addInterpCorrection() 768 0.06312 0.3023 0.373 2.56% FabArray::setVal() 5013 0.3477 0.3535 0.3646 2.50% MultiFab::Subtract() 159 0.3334 0.3366 0.3442 2.36% Gravity::fill_multipole_BCs() 19 0.2003 0.2545 0.3028 2.08% FabArray::FillBoundary() 6380 0.2244 0.251 0.2935 2.01% check_for_negative_density() 20 0.03872 0.1718 0.2813 1.93% MLMG::mgVcycle_up::2 128 0.01062 0.1162 0.2773 1.90% MLMG::mgVcycle_down::0 128 0.2607 0.2636 0.2664 1.83% Castro::expand_state() 20 0.1813 0.219 0.2551 1.75% FabArray::ParallelCopy_nowait() 1429 0.2027 0.2213 0.2373 1.63% Castro::initData() 1 0.07817 0.1352 0.2337 1.60% Amr::bldFineLevels() 1 0.04667 0.1398 0.2002 1.37% MLMG::mgVcycle_up::0 128 0.1945 0.195 0.1958 1.34% MLCellLinOp::apply() 986 0.1482 0.1606 0.1957 1.34% FabArray::sum() 3439 0.1846 0.1868 0.1922 1.32% MLMG::mgVcycle_up::3 128 0.01057 0.02356 0.179 1.23% Amr::grid_places() 2 0.002365 0.09492 0.1564 1.07% AmrMesh::MakeNewGrids() 2 0.00225 0.09483 0.1564 1.07% TagBoxArray::mapPRD 2 0.000729 0.09268 0.1549 1.06% FillBoundary_finish() 6380 0.09983 0.1228 0.1469 1.01% MLMG:computeResOfCorrection() 768 0.1137 0.1234 0.1467 1.01% MLCellLinOp::correctionResidual() 768 0.1123 0.122 0.1451 1.00% Castro::post_init() 1 0.1344 0.1384 0.1411 0.97% FillBoundary_nowait() 6380 0.08795 0.1141 0.1406 0.97% Castro::construct_new_source() 102 0.1243 0.1265 0.1298 0.89% MLMG::mgVcycle_down::1 128 0.1169 0.1204 0.1255 0.86% Castro::create_source_corrector() 17 0.04783 0.08188 0.1212 0.83% MLPoisson::Fapply() 986 0.09538 0.1001 0.1156 0.79% Amr::writePlotFile() 2 0.1067 0.1068 0.1068 0.73% Gravity::multilevel_solve_for_new_phi() 1 0.1005 0.1006 0.1006 0.69% Gravity::actual_multilevel_solve() 1 0.1004 0.1005 0.1006 0.69% MLCellLinOp::solutionResidual() 147 0.08764 0.09249 0.09665 0.66% Castro::post_regrid() 2 0.08554 0.08818 0.09215 0.63% Castro::construct_old_source() 120 0.07869 0.0794 0.08102 0.56% Castro::derive() 18 0.06996 0.07115 0.08029 0.55% AmrLevel::derive() 18 0.06992 0.0711 0.08023 0.55% FabArray::Saxpy() 264 0.0716 0.0726 0.08008 0.55% MLMG::computeResidual() 128 0.076 0.07665 0.07925 0.54% Castro::construct_old_gravity() 20 0.04445 0.06058 0.0787 0.54% Gravity::get_old_grav_vector() 20 0.03996 0.05803 0.07825 0.54% MLMG::mgVcycle_down::2 128 0.0125 0.0414 0.0743 0.51% MLMG::mgVcycle_bottom 128 0.0003573 0.004868 0.0723 0.50% MLMG::actualBottomSolve() 128 0.0001322 0.004632 0.07205 0.49% Castro::construct_new_gravity_source() 17 0.06899 0.07049 0.07181 0.49% MLCGSolver::bicgstab 8 0 0.004407 0.07051 0.48% Castro::post_timestep() 1 0.05894 0.06301 0.06595 0.45% MLMG::mgVcycle_down::3 128 0.01188 0.01814 0.06075 0.42% FabArray::Xpay() 945 0.05059 0.05316 0.06032 0.41% amrex::average_down 768 0.03248 0.0392 0.05482 0.38% Castro::initialize_advance() 1 0.04837 0.04967 0.05156 0.35% Amr::regrid() 1 0.0442 0.04603 0.04977 0.34% Castro::construct_old_gravity_source() 20 0.04531 0.0458 0.047 0.32% Castro::check_for_nan() 37 0.04502 0.04556 0.04609 0.32% MultiFab::contains_nan() 37 0.04492 0.04544 0.04597 0.32% Castro::retry_advance_ctu() 11 0.03578 0.03709 0.04257 0.29% MLPoisson::define() 19 0.0288 0.03366 0.03899 0.27% Gravity::get_new_grav_vector() 18 0.03462 0.03574 0.0379 0.26% MLMG::mgVcycle_down::4 128 0.01182 0.01359 0.03508 0.24% StateDataPhysBCFunct::() 147 0.0007012 0.01797 0.03399 0.23% StateData::FillBoundary(geom) 143 0 0.01713 0.03308 0.23% VisMF::Write(FabArray) 4 0.01194 0.01365 0.03307 0.23% Castro::apply_source_to_state() 37 0.0292 0.02944 0.02973 0.20% MLMG::mgVcycle_up::4 128 0.01063 0.01187 0.02717 0.19% Castro::save_data_for_retry() 3 0.01868 0.01953 0.02515 0.17% MLCellLinOp::defineAuxData() 19 0.01841 0.01999 0.02415 0.17% Castro::sum_integrated_quantities() 2 0.02329 0.02357 0.02359 0.16% MLMG::prepareForSolve() 18 0.02024 0.02105 0.0234 0.16% MLMG::mgVcycle_down::5 128 0.01182 0.01275 0.02311 0.16% MLMG::ResNormInf() 146 0.01525 0.01914 0.02197 0.15% MLMG::computeMLResidual() 18 0.01079 0.01537 0.01976 0.14% MLMG::mgVcycle_up::5 128 0.01076 0.01154 0.01962 0.13% Castro::problem_post_timestep() 2 0.009021 0.01295 0.01675 0.11% Castro::wd_update() 2 0.008916 0.01291 0.01674 0.11% FabArray::norminf() 282 0.01084 0.01135 0.01541 0.11% Gravity::test_composite_phi() 1 0.01447 0.01455 0.01459 0.10% amrex::Add() 128 0.01412 0.01428 0.01451 0.10% FabArrayBase::getFB() 6380 0.01025 0.01112 0.01434 0.10% FabArrayBase::getCPC() 2005 0.009392 0.0108 0.01417 0.10% MLLinOp::define() 19 0.003977 0.007756 0.01192 0.08% MLLinOp::defineGrids() 19 0.00389 0.007673 0.01184 0.08% FabArray::setDomainBndry() 147 0.0004463 0.005915 0.01119 0.08% Amr::writeSmallPlotFile() 2 0.008685 0.008695 0.008709 0.06% MLLinOp::makeSubCommunicator() 19 0.001114 0.004862 0.008669 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005155 0.008249 0.06% Gravity::update_max_rhs() 2 0.001414 0.005407 0.008056 0.06% Castro::volWgtSum() 46 0.007218 0.007368 0.008027 0.06% MLMG::getGradSolution() 18 0.007465 0.007695 0.007912 0.05% MLCellLinOp::compGrad() 18 0.00742 0.007652 0.007869 0.05% FabArray::mult() 59 0.006988 0.007176 0.007826 0.05% MultiFab::max() 2 0.0001594 0.004175 0.00684 0.05% FabArrayBase::CPC::define() 576 0.002156 0.00332 0.00632 0.04% MLCellLinOp::defineBC() 19 0.005586 0.005778 0.006279 0.04% amrex::Dot() 142 0 0.0003806 0.00609 0.04% Castro::volInBoundary() 14 0.003425 0.003686 0.00547 0.04% BndryData::define() 19 0.003998 0.004203 0.004565 0.03% MLPoisson::normalize() 79 0 0.0001999 0.003198 0.02% MLPoisson::prepareForSolve() 19 0.001712 0.001845 0.002177 0.01% MLCellLinOp::prepareForSolve() 19 0.001629 0.001765 0.002097 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001269 0.001537 0.001775 0.01% TagBoxArray::collate() 2 0.0002311 0.0008812 0.001504 0.01% FabArrayBase::FB::FB() 75 0.0002729 0.0006691 0.001432 0.01% AmrLevel::AmrLevel(dm) 1 0.00138 0.001394 0.001432 0.01% StateData::define() 6 0.001324 0.001351 0.001392 0.01% MLMG::MLResNormInf() 18 0.001249 0.001275 0.001367 0.01% MLMG::MLRhsNormInf() 18 0.0012 0.001223 0.001309 0.01% MLMG::compResidual() 1 0.000988 0.001122 0.001297 0.01% Gravity::swapTimeLevels() 8 0.001167 0.001202 0.001261 0.01% Castro::locWgtSum() 6 0.001133 0.001143 0.001164 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009069 0.0009449 0.001088 0.01% MLCellLinOp::setLevelBC() 19 0.0005418 0.000659 0.0008242 0.01% makeSFC 95 0.0005822 0.0006079 0.0007154 0.00% Castro::errorEst() 2 0.0005225 0.0005843 0.0006809 0.00% Castro::buildMetrics() 1 0.0006306 0.0006521 0.0006668 0.00% Castro::apply_tagging_restrictions() 2 0.000421 0.0004808 0.000562 0.00% Gravity::applyMetricTerms() 2 0.0004729 0.0004818 0.0004953 0.00% Castro::swap_state_time_levels() 8 0.0004332 0.0004453 0.0004556 0.00% Castro::enforce_consistent_e() 1 0.0003627 0.0003848 0.0004365 0.00% Castro::volProductSum() 2 0.0003874 0.0003976 0.0004079 0.00% Castro::finalize_advance() 1 0.0002559 0.0002689 0.0003087 0.00% DistributionMapping::Distribute() 95 0.0002113 0.0002212 0.0002583 0.00% Castro::finalize_do_advance() 17 0.000165 0.0001862 0.0002096 0.00% OwnerMask() 2 0.0001332 0.0001504 0.0001777 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001199 0.0001561 0.0001697 0.00% Castro::enforce_speed_limit() 79 0.0001102 0.0001179 0.0001259 0.00% Castro::apply_problem_tags() 2 9.259e-05 9.672e-05 0.0001137 0.00% DistributionMapping::LeastUsedCPUs() 1 4.407e-05 7.113e-05 7.98e-05 0.00% MultiFab::Swap() 5 6.471e-05 6.738e-05 7.894e-05 0.00% knapsack() 1 5.75e-05 6.592e-05 7.707e-05 0.00% Amr::initSubcycle() 1 5.512e-05 5.766e-05 6.06e-05 0.00% Castro::construct_old_rotation_source() 20 2.98e-05 3.089e-05 3.428e-05 0.00% Castro::construct_new_rotation_source() 17 2.067e-05 2.192e-05 2.35e-05 0.00% BoxList::parallelComplementIn() 4 1.293e-05 1.367e-05 1.625e-05 0.00% Castro::computeInitialDt() 2 9.614e-06 1.071e-05 1.481e-05 0.00% Castro::estTimeStep() 10 1.166e-05 1.327e-05 1.422e-05 0.00% BoxList::complementIn 4 5.915e-06 6.172e-06 7.301e-06 0.00% Castro::gwstrain() 2 4.295e-06 4.835e-06 6.571e-06 0.00% Gravity::set_mass_offset() 2 4.516e-06 4.872e-06 5.496e-06 0.00% Castro::FluxRegCrseInit 1 1.668e-06 2.108e-06 4.17e-06 0.00% Castro::FluxRegFineAdd() 1 1.4e-06 1.66e-06 3.139e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 12 B 14 B 19 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.03-7-g155f1f4c3f4f) finalized