MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.08-49-g22908d8ad214) initialized Starting run at 06:59:21 UTC on 2023-08-29. Successfully read inputs file ... Castro git describe: 23.08-7-gf1b93be75 AMReX git describe: 23.08-49-g22908d8ad Microphysics git describe: 23.08-17-g5e610453 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.dtnuc_mode = 1 Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.1403365 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001034329 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010545025 Gravity::multilevel_solve_for_new_phi() time = 0.097823265 Gravity::fill_multipole_BCs() time = 0.010629894 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049795362 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.007202452 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.00266046 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.064145044 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004193256 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.063132232 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.002524442 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.059862011 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.002487214 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059459986 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.318442903 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014313548 Gravity::solve_for_phi() time = 0.084152119 on level 0 Castro::construct_new_gravity() time = 0.086255928 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.059722399 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002780229 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059028789 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.316560999 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014149019 Gravity::solve_for_phi() time = 0.083267148 on level 0 Castro::construct_new_gravity() time = 0.085311662 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.588335034e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.059279959 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002614434 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058636847 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321508097 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014119125 Gravity::solve_for_phi() time = 0.083740284 on level 0 Castro::construct_new_gravity() time = 0.085863424 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.587065898e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.060074974 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002615094 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058757086 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324311214 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01448177 Gravity::solve_for_phi() time = 0.084368731 on level 0 Castro::construct_new_gravity() time = 0.086468927 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -9.059860097e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.059693468 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002748455 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059063319 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328836442 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01440856 Gravity::solve_for_phi() time = 0.084573382 on level 0 Castro::construct_new_gravity() time = 0.086640753 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -3.751920171e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.059498159 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.002549572 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058719966 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323328438 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014403582 Gravity::solve_for_phi() time = 0.08408935 on level 0 Castro::construct_new_gravity() time = 0.08618144 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: -3.291489439e+24 zmom added: 0 eint added: 0 ener added: 5.968491079e+43 Castro::do_new_sources() time = 0.059221894 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.002667868 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.05912819 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.350725037 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.045675328 Gravity::solve_for_phi() time = 0.131007875 on level 0 Castro::construct_new_gravity() time = 0.133156555 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.291567233e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.062827246 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.040910184 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059711292 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.368391808 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015933462 Gravity::solve_for_phi() time = 0.087917304 on level 0 Castro::construct_new_gravity() time = 0.089963549 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: 6.776595903e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.062297011 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.034356551 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.060542009 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.345817984 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016824382 Gravity::solve_for_phi() time = 0.09254254 on level 0 Castro::construct_new_gravity() time = 0.095511611 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798245e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: 5.252452121e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.061683539 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002588677 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.060793408 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337675648 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016097381 Gravity::solve_for_phi() time = 0.088682997 on level 0 Castro::construct_new_gravity() time = 0.090732308 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: -4.179294337e+24 zmom added: 0 eint added: 0 ener added: 2.123241033e+43 Castro::do_new_sources() time = 0.06101491 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.004898486 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059782344 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.342973494 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015536972 Gravity::solve_for_phi() time = 0.088654774 on level 0 Castro::construct_new_gravity() time = 0.090701591 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 1.205384045e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.060948548 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.004506002 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.070446111 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335148632 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016633044 Gravity::solve_for_phi() time = 0.09100508 on level 0 Castro::construct_new_gravity() time = 0.093063411 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195608e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -3.296211805e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.061198542 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.004965685 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060920365 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.342243575 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016279318 Gravity::solve_for_phi() time = 0.089891188 on level 0 Castro::construct_new_gravity() time = 0.09197024 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -1.986935698e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.060042661 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.006789814 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059515153 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336347321 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016338235 Gravity::solve_for_phi() time = 0.087189784 on level 0 Castro::construct_new_gravity() time = 0.089247203 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 2.991619167e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.062542327 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.005402068 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059569401 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.342596056 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015582383 Gravity::solve_for_phi() time = 0.085539799 on level 0 Castro::construct_new_gravity() time = 0.087734177 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: -4.264296934e+24 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059706167 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.00272729 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058703298 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3250961 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015219284 Gravity::solve_for_phi() time = 0.085584205 on level 0 Castro::construct_new_gravity() time = 0.087626983 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762635e+35 ymom added: 4.946678891e+24 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059908519 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.002556813 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058844626 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332542494 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015758981 Gravity::solve_for_phi() time = 0.086140121 on level 0 Castro::construct_new_gravity() time = 0.088189086 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: -4.247768651e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059873669 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002744554556 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.117748323e+27 ener added: 4.117748323e+27 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.160568787e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.471393084e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 7.282010032e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.55125627e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.00005983 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.051276927 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.007493955 seconds Ending run at 06:59:36 UTC on 2023-08-29. Run time = 14.27045478 Run time without initialization = 12.05985282 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.27 ... 14.27 ... 14.27 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3926 5.4447 5.5758 39.07% Amr::InitAmr() 1 1.342 1.342 1.342 9.40% Castro::computeTemp() 80 0.851 0.9704 1.133 7.94% amrex::Copy() 795 0.7758 0.7826 0.7994 5.60% FabArray::ParallelCopy_finish() 1429 0.05139 0.5491 0.7616 5.34% MultiFab::AddProduct() 3439 0.5621 0.5652 0.5778 4.05% Castro::normalize_species() 79 0.5416 0.5467 0.5616 3.94% Castro::reset_internal_energy(Fab) 160 0.5254 0.5306 0.5434 3.81% MLPoisson::Fsmooth() 6144 0.3148 0.3409 0.4132 2.90% Castro::initMFs() 1 0.3584 0.3672 0.3752 2.63% MultiFab::Subtract() 159 0.3474 0.3496 0.3618 2.53% FabArray::setVal() 5021 0.3459 0.3512 0.3573 2.50% Gravity::fill_multipole_BCs() 19 0.2067 0.2638 0.3087 2.16% check_for_negative_density() 20 0.0982 0.204 0.2596 1.82% FabArray::ParallelCopy_nowait() 1429 0.1897 0.2038 0.2212 1.55% Castro::reset_internal_energy(MultiFab) 80 0.02251 0.06359 0.2054 1.44% FabArray::sum() 3439 0.1822 0.1834 0.1871 1.31% FillBoundary_finish() 6388 0.09469 0.1207 0.1407 0.99% Castro::initData() 1 0.003407 0.02253 0.1287 0.90% FillBoundary_nowait() 6388 0.07278 0.09857 0.1277 0.89% MLPoisson::Fapply() 994 0.0946 0.09912 0.1141 0.80% MLCellLinOp::applyBC() 7156 0.04698 0.06229 0.1057 0.74% Castro::do_new_sources() 17 0.0003733 0.01222 0.07969 0.56% Castro::enforce_min_density() 79 0.01753 0.02614 0.07889 0.55% FabArray::Saxpy() 192 0.07117 0.07177 0.07612 0.53% Castro::construct_new_gravity_source() 17 0.06876 0.06972 0.07151 0.50% FabArray::Xpay() 953 0.05064 0.053 0.0602 0.42% Castro::do_old_sources() 20 0.0005216 0.01061 0.05338 0.37% MultiFab::contains_nan() 37 0.04524 0.04572 0.04675 0.33% Castro::construct_old_gravity_source() 20 0.04565 0.04588 0.04673 0.33% MLMG::addInterpCorrection() 768 0.03387 0.03628 0.04311 0.30% AmrLevel::derive() 18 0.04115 0.04159 0.04233 0.30% StateData::FillBoundary(geom) 143 0 0.0177 0.03381 0.24% amrex::average_down 768 0.02509 0.0271 0.03284 0.23% VisMF::Write(FabArray) 4 0.0155 0.01739 0.02862 0.20% Castro::construct_old_gravity() 20 0.000366 0.004256 0.02298 0.16% MLCGSolver::bicgstab 8 0 0.001414 0.02263 0.16% Amr::writePlotFile() 2 0.009511 0.01915 0.02136 0.15% FabArray::FillBoundary() 6388 0.01429 0.01491 0.01863 0.13% MLCellLinOp::defineAuxData() 19 0.01516 0.0161 0.01847 0.13% Castro::construct_new_source() 102 0.01547 0.0156 0.01607 0.11% MLMG::ResNormInf() 146 0.004048 0.009888 0.01513 0.11% TagBoxArray::collate() 2 0.0001214 0.002197 0.0147 0.10% amrex::Add() 136 0.01387 0.01395 0.01435 0.10% Castro::evaluate_source_change() 196 0.01277 0.01318 0.01389 0.10% FabArray::norminf() 244 0.01064 0.01103 0.01387 0.10% FabArrayBase::getFB() 6388 0.01027 0.01075 0.01379 0.10% MLCellLinOp::smooth() 3072 0.01165 0.01214 0.01363 0.10% FillPatchIterator::Initialize 147 0.01249 0.01302 0.01359 0.10% Castro::volWgtSum() 46 0.007302 0.007721 0.01254 0.09% Castro::wd_update() 2 0.005076 0.008319 0.0118 0.08% MLMG::prepareForSolve() 18 0.01045 0.01087 0.01162 0.08% FabArray::setDomainBndry() 147 0.0004637 0.006153 0.01151 0.08% Castro::construct_old_source() 120 0.009856 0.009934 0.01005 0.07% Castro::sum_integrated_quantities() 2 0.003921 0.008563 0.009304 0.07% Amr::writeSmallPlotFile() 2 0.006977 0.008874 0.009218 0.06% MLMG::solve() 18 0.001971 0.004169 0.008431 0.06% Gravity::actual_solve_with_mlmg() 19 0.006877 0.007232 0.008145 0.06% MLLinOp::makeSubCommunicator() 19 0.0007644 0.00419 0.008102 0.06% FabArrayBase::getCPC() 2005 0.007205 0.007473 0.00787 0.06% FabArray::mult() 59 0.007094 0.007218 0.007541 0.05% FabArrayBase::CPC::define() 576 0.002235 0.00346 0.006636 0.05% Gravity::get_old_grav_vector() 20 0.006386 0.006511 0.006616 0.05% Gravity::get_new_grav_vector() 18 0.005945 0.006098 0.006523 0.05% amrex::Dot() 142 0 0.0003904 0.006246 0.04% MLCellLinOp::compGrad() 18 0.005582 0.005704 0.005795 0.04% Castro::initialize_do_advance() 20 0.004665 0.005217 0.005762 0.04% MLCellLinOp::apply() 994 0.002078 0.002343 0.005511 0.04% Castro::volInBoundary() 14 0.003388 0.003665 0.005396 0.04% MLCGSolver::ParallelAllReduce 189 0 0.0002942 0.004707 0.03% FabArray::ParallelCopy() 1429 0.003663 0.003828 0.004266 0.03% FabArray::LinComb() 71 0 0.0002347 0.003755 0.03% BndryData::define() 19 0.003199 0.003299 0.003556 0.02% MLPoisson::normalize() 79 0 0.0002004 0.003207 0.02% MLCellLinOp::correctionResidual() 776 0.001884 0.001961 0.002487 0.02% AmrLevel::FillPatch() 147 0.002241 0.002316 0.00248 0.02% MLLinOp::defineGrids() 19 0.001799 0.001955 0.002173 0.02% MLCellLinOp::prepareForSolve() 19 0.001683 0.001832 0.002146 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001356 0.001622 0.001923 0.01% Castro::construct_new_gravity() 17 0.000288 0.0007773 0.001903 0.01% MLMG::mgVcycle() 128 0.001643 0.0017 0.00186 0.01% MLCellLinOp::defineBC() 19 0.001601 0.001643 0.001803 0.01% MultiFab::max() 2 0.0001674 0.0009954 0.001802 0.01% MLMG:computeResOfCorrection() 768 0.001433 0.001478 0.001582 0.01% StateData::define() 6 0.001266 0.001426 0.001534 0.01% FabArrayBase::FB::FB() 75 0.0002892 0.0007046 0.001502 0.01% Castro::save_data_for_retry() 3 0.001254 0.001314 0.001378 0.01% Gravity::solve_for_phi() 17 0.0008098 0.0009829 0.001348 0.01% main() 1 0.00113 0.001239 0.001341 0.01% Castro::locWgtSum() 6 0.001119 0.001161 0.001223 0.01% MLMG::actualBottomSolve() 128 0.0001334 0.0002031 0.001176 0.01% Castro::subcycle_advance_ctu() 1 0.0001915 0.000272 0.001002 0.01% StateDataPhysBCFunct::() 147 0.0007057 0.0008386 0.0009221 0.01% MLCellLinOp::setLevelBC() 19 0.0005427 0.0006746 0.0008799 0.01% FillPatchIterator::FillFromLevel0() 147 0.0007309 0.0007613 0.0007969 0.01% MLMG::mgVcycle_down::3 128 0.0006062 0.0006504 0.0007723 0.01% MLMG::mgVcycle_down::2 128 0.0006415 0.0006916 0.0007693 0.01% Castro::swap_state_time_levels() 8 0.0005822 0.0006414 0.0007378 0.01% MLMG::mgVcycle_down::0 128 0.0006785 0.0006953 0.0007365 0.01% MLMG::mgVcycle_down::1 128 0.0006772 0.0006951 0.0007297 0.01% MLMG::mgVcycle_down::5 128 0.0006149 0.000634 0.0007287 0.01% MLMG::mgVcycle_down::4 128 0.0005922 0.0006187 0.0007283 0.01% Castro::buildMetrics() 1 0.0005489 0.0005855 0.0006907 0.00% Castro::apply_tagging_restrictions() 2 0.0004162 0.0004844 0.000687 0.00% Castro::do_advance_ctu() 20 0.00045 0.0005059 0.0006368 0.00% Castro::Castro() 1 0.0004719 0.0005081 0.000566 0.00% Castro::clean_state() 79 0.0004506 0.0004962 0.0005593 0.00% AmrMesh::MakeNewGrids() 2 0.0004915 0.0005147 0.0005487 0.00% MLMG::mgVcycle_up::1 128 0.0004771 0.0005016 0.0005458 0.00% MLMG::mgVcycle_up::0 128 0.0004927 0.0005062 0.0005265 0.00% FillPatchSingleLevel 147 0.0004698 0.0004966 0.0005213 0.00% MLMG::mgVcycle_up::2 128 0.0004092 0.0004497 0.0005213 0.00% MLMG::mgVcycle_up::5 128 0.000423 0.0004382 0.0005063 0.00% Gravity::applyMetricTerms() 2 0.0004761 0.000485 0.0005038 0.00% MLMG::mgVcycle_up::3 128 0.0004053 0.0004225 0.0004985 0.00% MLMG::mgVcycle_up::4 128 0.0004125 0.0004258 0.0004889 0.00% Castro::problem_post_timestep() 2 1.05e-05 4.178e-05 0.000485 0.00% makeSFC 95 0.0003975 0.0004285 0.0004799 0.00% MLCellLinOp::solutionResidual() 147 0.000439 0.0004508 0.0004691 0.00% MLMG::oneIter() 128 0.0003997 0.0004155 0.0004383 0.00% Castro::enforce_consistent_e() 1 0.0003598 0.0003746 0.0004065 0.00% Castro::volProductSum() 2 0.0003944 0.000398 0.0004037 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003444 0.0003625 0.0003806 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002304 0.0002504 0.0002822 0.00% MLMG::computeResidual() 128 0.0002483 0.0002543 0.0002721 0.00% MLMG::mgVcycle_bottom 128 0.0002344 0.000243 0.0002677 0.00% DistributionMapping::Distribute() 95 0.0002189 0.0002325 0.0002491 0.00% Castro::finalize_do_advance() 17 0.000154 0.0001927 0.0002255 0.00% Gravity::update_max_rhs() 2 0.0001654 0.0001893 0.0002216 0.00% OwnerMask() 2 0.0001342 0.0001766 0.0002148 0.00% Amr::coarseTimeStep() 1 0.0001449 0.0001834 0.0001937 0.00% Castro::retry_advance_ctu() 11 5.459e-05 6.637e-05 0.0001905 0.00% MLPoisson::define() 19 0.0001429 0.000159 0.0001734 0.00% MLMG::compResidual() 1 0.0001554 0.0001566 0.0001653 0.00% Castro::initialize_advance() 1 0.0001275 0.0001412 0.0001546 0.00% Gravity::test_composite_phi() 1 9.51e-05 0.0001023 0.000154 0.00% Amr::grid_places() 2 7.738e-05 9.536e-05 0.0001455 0.00% TagBoxArray::mapPRD 2 0.0001102 0.00013 0.0001401 0.00% Amr::defBaseLevel() 1 0.0001049 0.0001197 0.0001368 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.293e-05 8.462e-05 0.0001312 0.00% Castro::check_for_nan() 37 0.0001043 0.0001149 0.00013 0.00% Castro::enforce_speed_limit() 79 0.0001001 0.0001075 0.00012 0.00% Castro::apply_source_to_state() 37 9.619e-05 0.0001044 0.0001195 0.00% Castro::create_source_corrector() 17 5.703e-05 6.664e-05 0.0001053 0.00% MLLinOp::define() 19 7.991e-05 8.853e-05 0.0001017 0.00% Amr::FinalizeInit() 1 8.617e-06 1.927e-05 0.0001 0.00% Castro::apply_problem_tags() 2 9.368e-05 9.528e-05 9.974e-05 0.00% MultiFab::Swap() 5 7.049e-05 7.652e-05 8.542e-05 0.00% MLPoisson::prepareForSolve() 19 7.025e-05 7.613e-05 8.439e-05 0.00% Castro::expand_state() 20 5.48e-05 6.272e-05 7.3e-05 0.00% knapsack() 1 5.927e-05 6.105e-05 6.327e-05 0.00% Amr::initSubcycle() 1 5.833e-05 6.197e-05 6.267e-05 0.00% Castro::derive() 18 4.291e-05 4.691e-05 5.658e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.518e-05 3.659e-05 5.407e-05 0.00% MLMG::computeMLResidual() 18 4.129e-05 4.664e-05 5.374e-05 0.00% Gravity::swapTimeLevels() 8 3.557e-05 3.928e-05 4.964e-05 0.00% MLMG::getGradSolution() 18 4.047e-05 4.249e-05 4.64e-05 0.00% Amr::regrid() 1 1.152e-05 1.761e-05 4.545e-05 0.00% Gravity::actual_multilevel_solve() 1 2.874e-05 3.433e-05 4.066e-05 0.00% MLMG::MLResNormInf() 18 3.363e-05 3.644e-05 3.848e-05 0.00% Castro::construct_old_rotation_source() 20 3.074e-05 3.212e-05 3.837e-05 0.00% MLMG::MLRhsNormInf() 18 3.272e-05 3.353e-05 3.549e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.336e-05 3.405e-05 3.479e-05 0.00% Amr::timeStep() 1 1.245e-05 1.81e-05 2.958e-05 0.00% Castro::finalize_advance() 1 1.735e-05 1.997e-05 2.884e-05 0.00% Castro::construct_new_rotation_source() 17 2.143e-05 2.257e-05 2.495e-05 0.00% Castro::post_regrid() 2 1.126e-05 1.576e-05 2.406e-05 0.00% Gravity::set_mass_offset() 2 4.433e-06 9.822e-06 2.152e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.654e-05 1.759e-05 2.047e-05 0.00% Castro::computeInitialDt() 2 7.426e-06 1.025e-05 1.991e-05 0.00% Castro::post_init() 1 1.281e-05 1.355e-05 1.72e-05 0.00% Castro::estTimeStep() 10 1.274e-05 1.466e-05 1.692e-05 0.00% Castro::advance() 1 7.147e-06 8.558e-06 1.562e-05 0.00% Amr::InitializeInit() 1 7.044e-06 8.186e-06 1.523e-05 0.00% Amr::bldFineLevels() 1 7.348e-06 8.554e-06 1.496e-05 0.00% Amr::init() 1 6.849e-06 8.222e-06 1.341e-05 0.00% Castro::errorEst() 2 6.174e-06 8.111e-06 1.232e-05 0.00% BoxList::parallelComplementIn() 4 7.323e-06 7.756e-06 1.089e-05 0.00% BoxList::complementIn 4 6.192e-06 6.477e-06 8.35e-06 0.00% Castro::post_timestep() 1 6.072e-06 6.783e-06 8.157e-06 0.00% Castro::gwstrain() 2 4.221e-06 4.919e-06 7.04e-06 0.00% Amr::initialInit() 1 2.914e-06 3.368e-06 4.648e-06 0.00% Castro::FluxRegCrseInit 1 1.592e-06 2.021e-06 2.594e-06 0.00% Castro::FluxRegFineAdd() 1 1.423e-06 1.615e-06 1.887e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.27 14.27 14.27 100.00% Amr::coarseTimeStep() 1 12.06 12.06 12.06 84.50% Amr::timeStep() 1 12 12 12 84.09% Castro::advance() 1 11.93 11.94 11.94 83.66% Castro::subcycle_advance_ctu() 1 11.88 11.89 11.89 83.31% Castro::do_advance_ctu() 20 11.85 11.85 11.85 83.05% Castro::construct_ctu_hydro_source() 20 6.391 6.435 6.471 45.35% Castro::clean_state() 79 3.711 3.82 4.036 28.28% Castro::computeTemp() 80 2.399 2.522 2.767 19.39% Castro::reset_internal_energy(MultiFab) 80 1.503 1.551 1.706 11.95% Gravity::solve_phi_with_mlmg() 19 1.517 1.577 1.627 11.40% Castro::construct_new_gravity() 17 1.447 1.505 1.554 10.89% Gravity::solve_for_phi() 17 1.409 1.468 1.518 10.64% Castro::initialize_do_advance() 20 1.394 1.455 1.499 10.50% Amr::InitAmr() 1 1.342 1.342 1.342 9.40% Gravity::actual_solve_with_mlmg() 19 1.306 1.309 1.314 9.21% MLMG::solve() 18 1.254 1.258 1.26 8.83% Castro::do_old_sources() 20 1.162 1.187 1.202 8.42% MLMG::oneIter() 128 1.113 1.116 1.122 7.87% MLMG::mgVcycle() 128 1.099 1.102 1.108 7.76% Castro::do_new_sources() 17 0.9427 0.9853 1.03 7.21% FabArray::ParallelCopy() 1429 0.2799 0.7764 0.9845 6.90% Castro::evaluate_source_change() 196 0.9551 0.9606 0.9813 6.88% Amr::init() 1 0.8682 0.8682 0.8682 6.08% Castro::enforce_min_density() 79 0.7928 0.8067 0.8573 6.01% Amr::initialInit() 1 0.8103 0.8103 0.8105 5.68% amrex::Copy() 795 0.7758 0.7826 0.7994 5.60% FabArray::ParallelCopy_finish() 1429 0.05139 0.5491 0.7616 5.34% MLCellLinOp::smooth() 3072 0.5507 0.5992 0.7262 5.09% AmrLevel::FillPatch() 147 0.4759 0.6202 0.7075 4.96% Amr::InitializeInit() 1 0.4451 0.5014 0.5838 4.09% Amr::defBaseLevel() 1 0.4451 0.5014 0.5838 4.09% MultiFab::AddProduct() 3439 0.5621 0.5652 0.5778 4.05% Castro::normalize_species() 79 0.5416 0.5467 0.5616 3.94% Castro::reset_internal_energy(Fab) 160 0.5254 0.5306 0.5434 3.81% FillPatchIterator::Initialize 147 0.2976 0.4423 0.5304 3.72% FillPatchIterator::FillFromLevel0() 147 0.2729 0.4232 0.5131 3.60% FillPatchSingleLevel 147 0.2722 0.4224 0.5124 3.59% MLMG::mgVcycle_up::1 128 0.09739 0.2669 0.4359 3.05% MLPoisson::Fsmooth() 6144 0.3148 0.3409 0.4132 2.90% MLMG::addInterpCorrection() 768 0.06303 0.3157 0.3842 2.69% Castro::Castro() 1 0.3637 0.3726 0.3807 2.67% MLCellLinOp::applyBC() 7156 0.2686 0.3079 0.3783 2.65% Castro::initMFs() 1 0.3586 0.3674 0.3754 2.63% Amr::FinalizeInit() 1 0.2265 0.309 0.3652 2.56% MultiFab::Subtract() 159 0.3474 0.3496 0.3618 2.53% FabArray::setVal() 5021 0.3459 0.3512 0.3573 2.50% Gravity::fill_multipole_BCs() 19 0.2088 0.266 0.3108 2.18% MLMG::mgVcycle_up::2 128 0.0111 0.1207 0.2897 2.03% FabArray::FillBoundary() 6388 0.2077 0.2456 0.2793 1.96% MLMG::mgVcycle_down::0 128 0.2576 0.2592 0.261 1.83% check_for_negative_density() 20 0.0982 0.204 0.2596 1.82% FabArray::ParallelCopy_nowait() 1429 0.2088 0.2235 0.2419 1.70% Castro::initData() 1 0.0783 0.1271 0.2185 1.53% Castro::expand_state() 20 0.1762 0.1895 0.2073 1.45% MLMG::mgVcycle_up::0 128 0.1961 0.1974 0.203 1.42% MLCellLinOp::apply() 994 0.1485 0.1615 0.197 1.38% MLMG::mgVcycle_up::3 128 0.01103 0.02457 0.1899 1.33% FabArray::sum() 3439 0.1822 0.1834 0.1871 1.31% Amr::bldFineLevels() 1 0.04646 0.129 0.1855 1.30% Castro::create_source_corrector() 17 0.04959 0.124 0.1654 1.16% MLCellLinOp::correctionResidual() 776 0.1097 0.119 0.1461 1.02% MLMG:computeResOfCorrection() 768 0.1112 0.1202 0.1433 1.00% Amr::grid_places() 2 0.002635 0.08513 0.1414 0.99% AmrMesh::MakeNewGrids() 2 0.00249 0.08503 0.1413 0.99% FillBoundary_finish() 6388 0.09469 0.1207 0.1407 0.99% FillBoundary_nowait() 6388 0.08343 0.11 0.1401 0.98% TagBoxArray::mapPRD 2 0.0006436 0.08158 0.1396 0.98% Castro::post_init() 1 0.1356 0.1364 0.1372 0.96% Castro::construct_new_source() 102 0.1241 0.1252 0.1277 0.89% MLMG::mgVcycle_down::1 128 0.112 0.1153 0.1189 0.83% MLPoisson::Fapply() 994 0.0946 0.09912 0.1141 0.80% MLCellLinOp::solutionResidual() 147 0.08798 0.09635 0.1027 0.72% Amr::writePlotFile() 2 0.1017 0.1018 0.1018 0.71% Gravity::multilevel_solve_for_new_phi() 1 0.09779 0.09782 0.09786 0.69% Gravity::actual_multilevel_solve() 1 0.09771 0.09773 0.09777 0.69% Castro::construct_old_gravity() 20 0.0456 0.06881 0.09723 0.68% Gravity::get_old_grav_vector() 20 0.03895 0.06455 0.09553 0.67% Castro::post_regrid() 2 0.08657 0.08741 0.08822 0.62% MLMG::mgVcycle_bottom 128 0.0003707 0.005769 0.0866 0.61% MLMG::actualBottomSolve() 128 0.0001334 0.005526 0.08634 0.61% MLCGSolver::bicgstab 8 0 0.005292 0.08468 0.59% MLMG::computeResidual() 128 0.07556 0.07824 0.0821 0.58% Castro::construct_old_source() 120 0.07894 0.07929 0.08023 0.56% FabArray::Saxpy() 192 0.07117 0.07177 0.07612 0.53% Castro::derive() 18 0.06973 0.07052 0.07224 0.51% AmrLevel::derive() 18 0.06968 0.07047 0.07219 0.51% Castro::construct_new_gravity_source() 17 0.06876 0.06972 0.07151 0.50% MLMG::mgVcycle_down::2 128 0.01291 0.04036 0.07035 0.49% Castro::post_timestep() 1 0.06072 0.06325 0.06609 0.46% MLMG::mgVcycle_down::3 128 0.01225 0.01849 0.06119 0.43% FabArray::Xpay() 953 0.05064 0.053 0.0602 0.42% amrex::average_down 768 0.03338 0.03944 0.05533 0.39% Castro::initialize_advance() 1 0.04929 0.05011 0.05109 0.36% Castro::check_for_nan() 37 0.04536 0.04583 0.04688 0.33% MultiFab::contains_nan() 37 0.04524 0.04572 0.04675 0.33% Castro::construct_old_gravity_source() 20 0.04565 0.04588 0.04673 0.33% Amr::regrid() 1 0.04433 0.04494 0.04546 0.32% MLPoisson::define() 19 0.02999 0.03455 0.04136 0.29% Castro::retry_advance_ctu() 11 0.03529 0.03579 0.0382 0.27% Gravity::get_new_grav_vector() 18 0.03468 0.03581 0.03667 0.26% MLMG::mgVcycle_down::4 128 0.01219 0.01385 0.03521 0.25% StateDataPhysBCFunct::() 147 0.0007057 0.01854 0.03472 0.24% StateData::FillBoundary(geom) 143 0 0.0177 0.03381 0.24% Castro::apply_source_to_state() 37 0.02909 0.02925 0.03009 0.21% VisMF::Write(FabArray) 4 0.0155 0.01739 0.02862 0.20% Castro::sum_integrated_quantities() 2 0.02794 0.02827 0.02829 0.20% MLMG::mgVcycle_up::4 128 0.0111 0.01231 0.02767 0.19% MLCellLinOp::defineAuxData() 19 0.01931 0.02111 0.02548 0.18% MLMG::ResNormInf() 146 0.01442 0.01935 0.02455 0.17% MLMG::prepareForSolve() 18 0.02066 0.0217 0.02412 0.17% MLMG::mgVcycle_down::5 128 0.01218 0.01306 0.02363 0.17% MLMG::computeMLResidual() 18 0.01193 0.01767 0.02168 0.15% Castro::save_data_for_retry() 3 0.01854 0.01895 0.02134 0.15% MLMG::mgVcycle_up::5 128 0.0112 0.01191 0.02023 0.14% FabArrayBase::getFB() 6388 0.01061 0.01145 0.01529 0.11% Castro::problem_post_timestep() 2 0.009423 0.01203 0.01528 0.11% Castro::wd_update() 2 0.008938 0.01198 0.01526 0.11% Amr::writeSmallPlotFile() 2 0.01509 0.0151 0.0151 0.11% TagBoxArray::collate() 2 0.0001214 0.002197 0.0147 0.10% FabArrayBase::getCPC() 2005 0.009485 0.01093 0.01448 0.10% amrex::Add() 136 0.01387 0.01395 0.01435 0.10% Gravity::test_composite_phi() 1 0.01412 0.01415 0.01417 0.10% FabArray::norminf() 244 0.01064 0.01103 0.01387 0.10% Castro::volWgtSum() 46 0.007302 0.007721 0.01254 0.09% FabArray::setDomainBndry() 147 0.0004637 0.006153 0.01151 0.08% MLLinOp::define() 19 0.00384 0.007258 0.01144 0.08% MLLinOp::defineGrids() 19 0.003738 0.007169 0.01135 0.08% MLLinOp::makeSubCommunicator() 19 0.0007644 0.00419 0.008102 0.06% MLCGSolver::ParallelAllReduce 189 0 0.0005057 0.008091 0.06% MLMG::getGradSolution() 18 0.007165 0.007431 0.007605 0.05% MLCellLinOp::compGrad() 18 0.007125 0.007388 0.007563 0.05% FabArray::mult() 59 0.007094 0.007218 0.007541 0.05% FabArrayBase::CPC::define() 576 0.002235 0.00346 0.006636 0.05% MLCellLinOp::defineBC() 19 0.005725 0.006029 0.006499 0.05% amrex::Dot() 142 0 0.0003904 0.006246 0.04% Castro::volInBoundary() 14 0.003388 0.003665 0.005396 0.04% BndryData::define() 19 0.004124 0.004386 0.004757 0.03% FabArray::LinComb() 71 0 0.0002347 0.003755 0.03% MLPoisson::normalize() 79 0 0.0002004 0.003207 0.02% Gravity::update_max_rhs() 2 0.001459 0.002252 0.003036 0.02% MLPoisson::prepareForSolve() 19 0.001761 0.001908 0.002222 0.02% MLCellLinOp::prepareForSolve() 19 0.001683 0.001832 0.002146 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001356 0.001622 0.001923 0.01% MultiFab::max() 2 0.0001674 0.0009954 0.001802 0.01% AmrLevel::AmrLevel(dm) 1 0.0013 0.00146 0.001568 0.01% StateData::define() 6 0.001266 0.001426 0.001534 0.01% FabArrayBase::FB::FB() 75 0.0002892 0.0007046 0.001502 0.01% Gravity::swapTimeLevels() 8 0.001159 0.001262 0.001372 0.01% MLMG::MLResNormInf() 18 0.001213 0.001236 0.001291 0.01% MLMG::MLRhsNormInf() 18 0.001194 0.001218 0.001276 0.01% MLMG::compResidual() 1 0.0009391 0.0011 0.00123 0.01% Castro::locWgtSum() 6 0.001119 0.001161 0.001223 0.01% MLLinOp::makeAgglomeratedDMap 19 0.000964 0.001023 0.001102 0.01% MLCellLinOp::setLevelBC() 19 0.0005427 0.0006746 0.0008799 0.01% Castro::errorEst() 2 0.0005182 0.0005878 0.0007913 0.01% Castro::buildMetrics() 1 0.0006088 0.0006464 0.0007597 0.01% Castro::swap_state_time_levels() 8 0.0005822 0.0006414 0.0007378 0.01% makeSFC 95 0.0006196 0.000661 0.0007211 0.01% Castro::apply_tagging_restrictions() 2 0.0004162 0.0004844 0.000687 0.00% Gravity::applyMetricTerms() 2 0.0004761 0.000485 0.0005038 0.00% Castro::enforce_consistent_e() 1 0.0003598 0.0003746 0.0004065 0.00% Castro::volProductSum() 2 0.0003944 0.000398 0.0004037 0.00% Castro::finalize_advance() 1 0.0002589 0.0002748 0.0003045 0.00% DistributionMapping::Distribute() 95 0.0002189 0.0002325 0.0002491 0.00% Castro::finalize_do_advance() 17 0.0001654 0.0002038 0.0002361 0.00% OwnerMask() 2 0.0001342 0.0001766 0.0002148 0.00% DistributionMapping::KnapSackDoIt() 1 9.522e-05 0.0001152 0.0001372 0.00% Castro::enforce_speed_limit() 79 0.0001001 0.0001075 0.00012 0.00% Castro::apply_problem_tags() 2 9.368e-05 9.528e-05 9.974e-05 0.00% MultiFab::Swap() 5 7.049e-05 7.652e-05 8.542e-05 0.00% knapsack() 1 5.927e-05 6.105e-05 6.327e-05 0.00% Amr::initSubcycle() 1 5.833e-05 6.197e-05 6.267e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.518e-05 3.659e-05 5.407e-05 0.00% Castro::construct_old_rotation_source() 20 3.074e-05 3.212e-05 3.837e-05 0.00% Castro::computeInitialDt() 2 1.058e-05 1.378e-05 2.622e-05 0.00% Castro::construct_new_rotation_source() 17 2.143e-05 2.257e-05 2.495e-05 0.00% Gravity::set_mass_offset() 2 4.433e-06 9.822e-06 2.152e-05 0.00% BoxList::parallelComplementIn() 4 1.356e-05 1.423e-05 1.924e-05 0.00% Castro::estTimeStep() 10 1.274e-05 1.466e-05 1.692e-05 0.00% BoxList::complementIn 4 6.192e-06 6.477e-06 8.35e-06 0.00% Castro::gwstrain() 2 4.221e-06 4.919e-06 7.04e-06 0.00% Castro::FluxRegCrseInit 1 1.592e-06 2.021e-06 2.594e-06 0.00% Castro::FluxRegFineAdd() 1 1.423e-06 1.615e-06 1.887e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.dtnuc_mode(nvals = 1) :: [1] [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 13 B 21 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.08-49-g22908d8ad214) finalized