MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.08-49-g22908d8ad214) initialized Starting run at 06:57:50 UTC on 2023-08-30. Successfully read inputs file ... Castro git describe: 23.08-7-gf1b93be75 AMReX git describe: 23.08-49-g22908d8ad Microphysics git describe: 23.08-18-g58259177 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.dtnuc_mode = 1 Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.201728163 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000975875 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010455173 Gravity::multilevel_solve_for_new_phi() time = 0.106580197 Gravity::fill_multipole_BCs() time = 0.010238555 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049361448 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004084438 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.006641449 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065911443 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index , 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.1821503515, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 , 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 69, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007213933 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.067664356 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006925629 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.063262856 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006982266 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060865712 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328512253 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015252355 Gravity::solve_for_phi() time = 0.089926294 on level 0 Castro::construct_new_gravity() time = 0.091963571 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.061424589 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.007158931 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060845465 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330847389 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015151484 Gravity::solve_for_phi() time = 0.088512923 on level 0 Castro::construct_new_gravity() time = 0.090546281 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.588335034e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.062775089 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.005583485 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060867422 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332726839 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014907841 Gravity::solve_for_phi() time = 0.088466261 on level 0 Castro::construct_new_gravity() time = 0.090592503 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.587065898e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.062008501 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.006719 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060957968 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.36597483 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017327245 Gravity::solve_for_phi() time = 0.090982261 on level 0 Castro::construct_new_gravity() time = 0.093101662 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -9.059860097e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.062217156 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.009386062 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059463045 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.342033748 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016062836 Gravity::solve_for_phi() time = 0.089223023 on level 0 Castro::construct_new_gravity() time = 0.091344588 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -3.751920171e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.062227361 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.008064259 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.060817175 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337768935 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016964058 Gravity::solve_for_phi() time = 0.09082025 on level 0 Castro::construct_new_gravity() time = 0.092943016 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: -3.291489439e+24 zmom added: 0 eint added: 0 ener added: 5.968491079e+43 Castro::do_new_sources() time = 0.062388054 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.00630829 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.061057701 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.343522562 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01630456 Gravity::solve_for_phi() time = 0.150561976 on level 0 Castro::construct_new_gravity() time = 0.152809952 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.291567233e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.074027638 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.049216479 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.0648956 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.364005672 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014818859 Gravity::solve_for_phi() time = 0.088812145 on level 0 Castro::construct_new_gravity() time = 0.090917895 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: 6.776595903e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.06100723 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.009294808 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059577818 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338026211 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016088262 Gravity::solve_for_phi() time = 0.08615021 on level 0 Castro::construct_new_gravity() time = 0.08902588 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798245e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: 5.252452121e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.067360646 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.016198581 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.066728526 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328701186 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015753526 Gravity::solve_for_phi() time = 0.084724898 on level 0 Castro::construct_new_gravity() time = 0.086789714 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: -4.179294337e+24 zmom added: 0 eint added: 0 ener added: 2.123241033e+43 Castro::do_new_sources() time = 0.06021074 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002683565 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059634098 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333735858 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01538497 Gravity::solve_for_phi() time = 0.085163874 on level 0 Castro::construct_new_gravity() time = 0.087198146 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 1.205384045e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.060195604 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.00307002 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059448979 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327002171 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01536993 Gravity::solve_for_phi() time = 0.084506059 on level 0 Castro::construct_new_gravity() time = 0.086577486 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195608e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -3.296211805e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.060056172 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.002820691 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.059541073 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333007937 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015706111 Gravity::solve_for_phi() time = 0.085564159 on level 0 Castro::construct_new_gravity() time = 0.087614357 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -1.986935698e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.060138045 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.003210779 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059532932 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328451614 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01507684 Gravity::solve_for_phi() time = 0.084002978 on level 0 Castro::construct_new_gravity() time = 0.086044201 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 2.991619167e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.060261619 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.003063207 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059504911 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332869829 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015852673 Gravity::solve_for_phi() time = 0.085057801 on level 0 Castro::construct_new_gravity() time = 0.087161917 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: -4.264296934e+24 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.060114426 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.003219107 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059487361 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330290329 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018316267 Gravity::solve_for_phi() time = 0.088870118 on level 0 Castro::construct_new_gravity() time = 0.090932248 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762635e+35 ymom added: 4.946678891e+24 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.060086899 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.002753995 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059447226 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332116575 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016215714 Gravity::solve_for_phi() time = 0.085256517 on level 0 Castro::construct_new_gravity() time = 0.087307098 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: -4.247768651e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.060054264 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002702004049 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.117748323e+27 ener added: 4.117748323e+27 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.160568787e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.471393084e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 7.282010032e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.55125627e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.18587497 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.048624645 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004133028 seconds Ending run at 06:58:05 UTC on 2023-08-30. Run time = 14.74976418 Run time without initialization = 12.23954434 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.75 ... 14.75 ... 14.75 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.4003 5.4599 5.5702 37.76% Amr::InitAmr() 1 1.576 1.576 1.576 10.68% Castro::computeTemp() 80 0.8686 0.9724 1.145 7.76% FabArray::ParallelCopy_finish() 1429 0.04963 0.6572 0.9082 6.16% amrex::Copy() 795 0.7759 0.7836 0.8203 5.56% MultiFab::AddProduct() 3439 0.5614 0.5674 0.5818 3.94% Castro::normalize_species() 79 0.5405 0.5457 0.5597 3.79% Castro::reset_internal_energy(Fab) 160 0.5246 0.5325 0.5566 3.77% MLPoisson::Fsmooth() 6144 0.3157 0.3438 0.4282 2.90% Castro::initMFs() 1 0.3605 0.368 0.3797 2.57% FabArray::setVal() 5021 0.3462 0.3513 0.3654 2.48% MultiFab::Subtract() 159 0.3477 0.3514 0.3613 2.45% check_for_negative_density() 20 0.1338 0.2737 0.328 2.22% Gravity::fill_multipole_BCs() 19 0.2003 0.2475 0.2825 1.91% Castro::reset_internal_energy(MultiFab) 80 0.0225 0.06771 0.2446 1.66% FabArray::ParallelCopy_nowait() 1429 0.188 0.2013 0.2188 1.48% FabArray::sum() 3439 0.1821 0.1842 0.1892 1.28% FillBoundary_finish() 6388 0.1284 0.1553 0.1754 1.19% Castro::initData() 1 0.003409 0.02258 0.1303 0.88% FillBoundary_nowait() 6388 0.0754 0.09907 0.1272 0.86% MLPoisson::Fapply() 994 0.09444 0.09964 0.1158 0.79% MLCellLinOp::applyBC() 7156 0.04711 0.06269 0.108 0.73% Castro::do_old_sources() 20 0.000527 0.01762 0.08165 0.55% FabArray::Saxpy() 192 0.07135 0.0722 0.07987 0.54% Castro::do_new_sources() 17 0.0003706 0.01548 0.07853 0.53% Castro::construct_new_gravity_source() 17 0.06875 0.06945 0.07096 0.48% Castro::enforce_min_density() 79 0.01737 0.03094 0.06712 0.46% FabArray::Xpay() 953 0.05076 0.05356 0.06185 0.42% Castro::construct_old_gravity() 20 0.000391 0.01009 0.06102 0.41% TagBoxArray::collate() 2 7.447e-05 0.006397 0.04938 0.33% Castro::construct_old_gravity_source() 20 0.04544 0.04598 0.04815 0.33% MultiFab::contains_nan() 37 0.04515 0.04562 0.04674 0.32% MLMG::addInterpCorrection() 768 0.03391 0.03666 0.04423 0.30% AmrLevel::derive() 18 0.04089 0.04132 0.04234 0.29% StateData::FillBoundary(geom) 143 0 0.01787 0.03562 0.24% amrex::average_down 768 0.02523 0.02731 0.03326 0.23% VisMF::Write(FabArray) 4 0.01289 0.01409 0.02305 0.16% MLMG::ResNormInf() 146 0.008677 0.01584 0.02253 0.15% MLCGSolver::bicgstab 8 0 0.0014 0.0224 0.15% MLCellLinOp::defineAuxData() 19 0.01531 0.01611 0.0192 0.13% Amr::writePlotFile() 2 0.007421 0.01692 0.01835 0.12% FabArray::FillBoundary() 6388 0.01428 0.01494 0.01825 0.12% Castro::construct_new_source() 102 0.01556 0.01568 0.01609 0.11% amrex::Add() 136 0.01387 0.01416 0.01509 0.10% Castro::evaluate_source_change() 196 0.01275 0.01312 0.0148 0.10% FabArray::norminf() 244 0.01068 0.01148 0.01397 0.09% FabArrayBase::getFB() 6388 0.01037 0.0108 0.01372 0.09% MLCellLinOp::smooth() 3072 0.01173 0.01222 0.01337 0.09% FillPatchIterator::Initialize 147 0.01227 0.0125 0.01311 0.09% FabArray::setDomainBndry() 147 0.0004474 0.006161 0.01249 0.08% Castro::wd_update() 2 0.004684 0.008538 0.0118 0.08% MLMG::prepareForSolve() 18 0.01049 0.01074 0.01149 0.08% Castro::construct_old_source() 120 0.009808 0.00991 0.01028 0.07% MLLinOp::makeSubCommunicator() 19 0.0009405 0.005237 0.009411 0.06% Castro::volWgtSum() 46 0.007288 0.007413 0.008592 0.06% MLMG::solve() 18 0.0007963 0.004477 0.00826 0.06% FabArray::mult() 59 0.007106 0.007302 0.008202 0.06% Gravity::actual_solve_with_mlmg() 19 0.006926 0.007211 0.008053 0.05% FabArrayBase::getCPC() 2005 0.007202 0.007426 0.007959 0.05% Gravity::get_new_grav_vector() 18 0.005937 0.006138 0.006751 0.05% FabArrayBase::CPC::define() 576 0.002281 0.003444 0.006716 0.05% Gravity::get_old_grav_vector() 20 0.006339 0.006438 0.006647 0.05% amrex::Dot() 142 0 0.000403 0.006448 0.04% MLCellLinOp::compGrad() 18 0.005528 0.005592 0.005766 0.04% Amr::writeSmallPlotFile() 2 0.003464 0.005132 0.005628 0.04% MLCellLinOp::apply() 994 0.002078 0.002359 0.005418 0.04% Castro::volInBoundary() 14 0.003386 0.003648 0.005417 0.04% MLCGSolver::ParallelAllReduce 189 0 0.0002999 0.004799 0.03% Castro::initialize_do_advance() 20 0.004259 0.004452 0.004795 0.03% MultiFab::max() 2 0.0001628 0.002042 0.004525 0.03% FabArray::ParallelCopy() 1429 0.003656 0.003815 0.004133 0.03% FabArray::LinComb() 71 0 0.0002447 0.003916 0.03% BndryData::define() 19 0.003154 0.003245 0.003483 0.02% MLPoisson::normalize() 79 0 0.0002056 0.003289 0.02% Castro::sum_integrated_quantities() 2 0.001607 0.003041 0.003188 0.02% AmrLevel::FillPatch() 147 0.002212 0.00228 0.002604 0.02% MLCellLinOp::correctionResidual() 776 0.001883 0.00198 0.002424 0.02% MLCellLinOp::prepareForSolve() 19 0.001668 0.001816 0.0021 0.01% MLLinOp::defineGrids() 19 0.001835 0.001928 0.002067 0.01% Castro::construct_new_gravity() 17 0.0002902 0.0007133 0.001952 0.01% MLMG::mgVcycle() 128 0.001656 0.001722 0.001874 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001408 0.001611 0.001843 0.01% MLCellLinOp::defineBC() 19 0.001565 0.001615 0.001763 0.01% MLMG:computeResOfCorrection() 768 0.001439 0.001491 0.001578 0.01% Gravity::solve_for_phi() 17 0.0007934 0.0009463 0.001535 0.01% FabArrayBase::FB::FB() 75 0.000304 0.0006993 0.001522 0.01% main() 1 0.001042 0.001246 0.001485 0.01% Castro::save_data_for_retry() 3 0.001245 0.001284 0.00136 0.01% StateData::define() 6 0.001247 0.001275 0.001303 0.01% MLMG::actualBottomSolve() 128 0.0001337 0.0002031 0.001174 0.01% Castro::locWgtSum() 6 0.001114 0.00112 0.001135 0.01% StateDataPhysBCFunct::() 147 0.0006665 0.0008245 0.0009963 0.01% MLCellLinOp::setLevelBC() 19 0.0005424 0.0006672 0.0008384 0.01% FillPatchIterator::FillFromLevel0() 147 0.0007309 0.0007517 0.0008142 0.01% MLMG::mgVcycle_down::0 128 0.0006821 0.0007015 0.0007757 0.01% MLMG::mgVcycle_down::1 128 0.0006806 0.0007006 0.0007695 0.01% MLMG::mgVcycle_down::2 128 0.000643 0.0006965 0.0007586 0.01% MLMG::mgVcycle_down::3 128 0.0006002 0.0006517 0.0007445 0.01% Castro::subcycle_advance_ctu() 1 0.0001934 0.0002456 0.0007136 0.00% MLMG::mgVcycle_down::4 128 0.0005862 0.0006207 0.000705 0.00% MLMG::mgVcycle_down::5 128 0.0006152 0.0006339 0.0006983 0.00% Castro::Castro() 1 0.0005134 0.0005842 0.0006592 0.00% Castro::do_advance_ctu() 20 0.0004437 0.0004871 0.0006162 0.00% Castro::buildMetrics() 1 0.0005434 0.0005652 0.0005935 0.00% Castro::clean_state() 79 0.0004496 0.0004839 0.0005611 0.00% MLMG::mgVcycle_up::0 128 0.000493 0.0005115 0.0005509 0.00% MLMG::mgVcycle_up::1 128 0.000479 0.0005045 0.0005385 0.00% Castro::apply_tagging_restrictions() 2 0.0004193 0.0004792 0.000528 0.00% AmrMesh::MakeNewGrids() 2 0.0005057 0.0005159 0.0005264 0.00% MLMG::mgVcycle_up::5 128 0.0004218 0.0004408 0.0005202 0.00% MLMG::mgVcycle_up::2 128 0.0004091 0.0004549 0.0005098 0.00% FillPatchSingleLevel 147 0.0004772 0.0004884 0.0005065 0.00% makeSFC 95 0.0004014 0.0004383 0.0004983 0.00% Gravity::applyMetricTerms() 2 0.0004851 0.0004892 0.0004942 0.00% MLMG::mgVcycle_up::4 128 0.0004142 0.0004298 0.000491 0.00% MLMG::mgVcycle_up::3 128 0.0004089 0.0004284 0.0004849 0.00% MLCellLinOp::solutionResidual() 147 0.0004419 0.0004505 0.0004682 0.00% MLMG::oneIter() 128 0.0004031 0.0004154 0.0004566 0.00% Castro::swap_state_time_levels() 8 0.0004092 0.000422 0.0004379 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003471 0.0003693 0.0004225 0.00% Castro::problem_post_timestep() 2 1.116e-05 3.629e-05 0.0004069 0.00% Castro::volProductSum() 2 0.0003933 0.0004001 0.0004044 0.00% Castro::enforce_consistent_e() 1 0.0003584 0.0003684 0.0003805 0.00% DistributionMapping::Distribute() 95 0.0002214 0.0002391 0.0003083 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002297 0.0002498 0.0002889 0.00% MLMG::computeResidual() 128 0.0002477 0.0002576 0.0002758 0.00% MLMG::mgVcycle_bottom 128 0.0002352 0.0002418 0.0002627 0.00% Castro::finalize_do_advance() 17 0.0001601 0.0001799 0.0002306 0.00% Gravity::update_max_rhs() 2 0.0001653 0.0001833 0.0001963 0.00% MLPoisson::define() 19 0.0001422 0.0001573 0.0001746 0.00% OwnerMask() 2 0.0001361 0.0001595 0.0001739 0.00% Amr::coarseTimeStep() 1 0.0001148 0.00014 0.0001609 0.00% MLMG::compResidual() 1 0.0001554 0.000157 0.0001607 0.00% Amr::defBaseLevel() 1 0.0001144 0.0001296 0.0001517 0.00% Castro::check_for_nan() 37 0.0001024 0.0001124 0.000143 0.00% Gravity::test_composite_phi() 1 9.484e-05 0.000102 0.0001351 0.00% Castro::retry_advance_ctu() 11 5.325e-05 6.181e-05 0.000135 0.00% Castro::initialize_advance() 1 0.0001014 0.0001088 0.0001314 0.00% TagBoxArray::mapPRD 2 0.0001129 0.0001234 0.0001314 0.00% Amr::grid_places() 2 7.521e-05 9.617e-05 0.0001259 0.00% Castro::enforce_speed_limit() 79 9.971e-05 0.0001064 0.000112 0.00% MultiFab::Swap() 5 7.002e-05 7.751e-05 0.0001118 0.00% Castro::apply_source_to_state() 37 9.291e-05 9.97e-05 0.0001062 0.00% Castro::apply_problem_tags() 2 9.523e-05 9.668e-05 9.837e-05 0.00% MLLinOp::define() 19 7.884e-05 8.548e-05 9.315e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.992e-05 6.508e-05 8.997e-05 0.00% MLPoisson::prepareForSolve() 19 7.018e-05 7.555e-05 8.607e-05 0.00% knapsack() 1 5.992e-05 6.355e-05 7.861e-05 0.00% Castro::create_source_corrector() 17 5.53e-05 6.148e-05 7.51e-05 0.00% Amr::initSubcycle() 1 6.207e-05 6.295e-05 6.868e-05 0.00% Gravity::swapTimeLevels() 8 3.19e-05 3.608e-05 6.709e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.726e-05 4.517e-05 5.999e-05 0.00% Castro::expand_state() 20 5.12e-05 5.464e-05 5.984e-05 0.00% MLMG::computeMLResidual() 18 4.084e-05 4.388e-05 4.732e-05 0.00% Castro::derive() 18 4.24e-05 4.388e-05 4.719e-05 0.00% MLMG::getGradSolution() 18 4.048e-05 4.216e-05 4.695e-05 0.00% Amr::FinalizeInit() 1 8.771e-06 1.336e-05 4.669e-05 0.00% Amr::timeStep() 1 1.168e-05 1.642e-05 4.365e-05 0.00% MLMG::MLRhsNormInf() 18 3.26e-05 3.44e-05 4.194e-05 0.00% MLMG::MLResNormInf() 18 3.426e-05 3.548e-05 3.779e-05 0.00% Castro::finalize_advance() 1 1.674e-05 1.901e-05 3.574e-05 0.00% Castro::construct_old_rotation_source() 20 3.078e-05 3.184e-05 3.542e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.296e-05 3.411e-05 3.505e-05 0.00% Amr::regrid() 1 1.145e-05 1.425e-05 3.148e-05 0.00% Gravity::actual_multilevel_solve() 1 2.791e-05 2.879e-05 3.134e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.68e-05 1.878e-05 2.802e-05 0.00% Castro::construct_new_rotation_source() 17 2.163e-05 2.265e-05 2.516e-05 0.00% Amr::InitializeInit() 1 7.088e-06 8.885e-06 1.742e-05 0.00% Castro::estTimeStep() 10 1.291e-05 1.425e-05 1.731e-05 0.00% Castro::post_regrid() 2 1.144e-05 1.347e-05 1.598e-05 0.00% Castro::post_init() 1 1.247e-05 1.306e-05 1.533e-05 0.00% Castro::advance() 1 7.002e-06 8.265e-06 1.408e-05 0.00% BoxList::parallelComplementIn() 4 7.467e-06 8.051e-06 1.266e-05 0.00% Castro::post_timestep() 1 5.668e-06 6.766e-06 1.094e-05 0.00% Castro::computeInitialDt() 2 7.095e-06 8.394e-06 1.071e-05 0.00% Amr::bldFineLevels() 1 7.205e-06 8.732e-06 1.05e-05 0.00% BoxList::complementIn 4 6.22e-06 6.743e-06 9.823e-06 0.00% Amr::init() 1 7.007e-06 7.711e-06 9.381e-06 0.00% Castro::errorEst() 2 6.71e-06 6.978e-06 7.328e-06 0.00% Gravity::set_mass_offset() 2 4.098e-06 4.831e-06 6.836e-06 0.00% Castro::gwstrain() 2 4.339e-06 4.854e-06 6.575e-06 0.00% Amr::initialInit() 1 3.004e-06 3.364e-06 4.87e-06 0.00% Castro::FluxRegCrseInit 1 1.628e-06 1.794e-06 2.136e-06 0.00% Castro::FluxRegFineAdd() 1 1.447e-06 1.542e-06 1.664e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.75 14.75 14.75 100.00% Amr::coarseTimeStep() 1 12.24 12.24 12.24 82.98% Amr::timeStep() 1 12.19 12.19 12.19 82.62% Castro::advance() 1 12.12 12.12 12.13 82.22% Castro::subcycle_advance_ctu() 1 12.07 12.08 12.08 81.89% Castro::do_advance_ctu() 20 12.03 12.04 12.04 81.63% Castro::construct_ctu_hydro_source() 20 6.482 6.519 6.562 44.49% Castro::clean_state() 79 3.723 3.828 4.078 27.65% Castro::computeTemp() 80 2.409 2.535 2.821 19.13% Castro::reset_internal_energy(MultiFab) 80 1.502 1.562 1.748 11.85% Gravity::solve_phi_with_mlmg() 19 1.571 1.621 1.657 11.24% Castro::construct_new_gravity() 17 1.494 1.541 1.578 10.70% Amr::InitAmr() 1 1.576 1.576 1.576 10.68% Gravity::solve_for_phi() 17 1.454 1.504 1.54 10.44% Castro::initialize_do_advance() 20 1.39 1.478 1.515 10.27% Gravity::actual_solve_with_mlmg() 19 1.365 1.37 1.374 9.32% MLMG::solve() 18 1.313 1.318 1.319 8.94% Castro::do_old_sources() 20 1.171 1.203 1.214 8.23% MLMG::oneIter() 128 1.164 1.168 1.172 7.95% MLMG::mgVcycle() 128 1.15 1.154 1.157 7.84% FabArray::ParallelCopy() 1429 0.2797 0.8818 1.133 7.68% Castro::do_new_sources() 17 0.9431 0.9908 1.057 7.17% Castro::evaluate_source_change() 196 0.9541 0.9644 0.9906 6.72% Amr::init() 1 0.9337 0.9337 0.9337 6.33% FabArray::ParallelCopy_finish() 1429 0.04963 0.6572 0.9082 6.16% Amr::initialInit() 1 0.8794 0.8794 0.8795 5.96% Castro::enforce_min_density() 79 0.7934 0.8136 0.8744 5.93% amrex::Copy() 795 0.7759 0.7836 0.8203 5.56% MLCellLinOp::smooth() 3072 0.5778 0.6326 0.7705 5.22% AmrLevel::FillPatch() 147 0.482 0.6668 0.7653 5.19% Amr::InitializeInit() 1 0.446 0.5137 0.6467 4.38% Amr::defBaseLevel() 1 0.446 0.5137 0.6467 4.38% FillPatchIterator::Initialize 147 0.2979 0.4891 0.5885 3.99% MultiFab::AddProduct() 3439 0.5614 0.5674 0.5818 3.94% FillPatchIterator::FillFromLevel0() 147 0.2727 0.4704 0.5717 3.88% FillPatchSingleLevel 147 0.272 0.4697 0.571 3.87% Castro::normalize_species() 79 0.5405 0.5457 0.5597 3.79% Castro::reset_internal_energy(Fab) 160 0.5246 0.5325 0.5566 3.77% MLMG::mgVcycle_up::1 128 0.09956 0.2784 0.4576 3.10% Amr::FinalizeInit() 1 0.2329 0.3657 0.4334 2.94% MLPoisson::Fsmooth() 6144 0.3157 0.3438 0.4282 2.90% MLCellLinOp::applyBC() 7156 0.302 0.3435 0.4151 2.81% MLMG::addInterpCorrection() 768 0.06576 0.3276 0.4031 2.73% Castro::Castro() 1 0.3661 0.3736 0.3868 2.62% Castro::initMFs() 1 0.3607 0.3682 0.3799 2.58% FabArray::setVal() 5021 0.3462 0.3513 0.3654 2.48% MultiFab::Subtract() 159 0.3477 0.3514 0.3613 2.45% check_for_negative_density() 20 0.1338 0.2737 0.328 2.22% FabArray::FillBoundary() 6388 0.2415 0.2808 0.319 2.16% MLMG::mgVcycle_up::2 128 0.01111 0.1251 0.2998 2.03% Gravity::fill_multipole_BCs() 19 0.2027 0.2496 0.2845 1.93% Castro::initData() 1 0.07834 0.1385 0.2774 1.88% MLMG::mgVcycle_down::0 128 0.2638 0.2675 0.2712 1.84% Amr::bldFineLevels() 1 0.04647 0.1792 0.2456 1.67% FabArray::ParallelCopy_nowait() 1429 0.2073 0.2208 0.2393 1.62% Castro::expand_state() 20 0.1785 0.2076 0.2356 1.60% MLMG::mgVcycle_up::0 128 0.207 0.209 0.2107 1.43% MLCellLinOp::apply() 994 0.1508 0.1673 0.2057 1.39% Amr::grid_places() 2 0.002104 0.135 0.2027 1.37% AmrMesh::MakeNewGrids() 2 0.001997 0.1349 0.2026 1.37% TagBoxArray::mapPRD 2 0.0006241 0.1273 0.2011 1.36% MLMG::mgVcycle_up::3 128 0.01104 0.02526 0.198 1.34% FabArray::sum() 3439 0.1821 0.1842 0.1892 1.28% FillBoundary_finish() 6388 0.1284 0.1553 0.1754 1.19% Castro::create_source_corrector() 17 0.05023 0.1243 0.1685 1.14% Castro::construct_old_gravity() 20 0.05186 0.09081 0.1557 1.06% MLCellLinOp::correctionResidual() 776 0.1142 0.1242 0.1518 1.03% MLMG:computeResOfCorrection() 768 0.1157 0.1254 0.1492 1.01% Castro::post_init() 1 0.1408 0.1426 0.1451 0.98% FillBoundary_nowait() 6388 0.08705 0.1106 0.1394 0.94% MLMG::mgVcycle_down::1 128 0.1213 0.1273 0.135 0.92% Castro::construct_new_source() 102 0.1244 0.1254 0.1288 0.87% Gravity::get_old_grav_vector() 20 0.03984 0.08072 0.1275 0.86% MLPoisson::Fapply() 994 0.09444 0.09964 0.1158 0.79% Gravity::multilevel_solve_for_new_phi() 1 0.1066 0.1066 0.1066 0.72% Gravity::actual_multilevel_solve() 1 0.1065 0.1065 0.1065 0.72% MLCellLinOp::solutionResidual() 147 0.09012 0.09742 0.1056 0.72% Amr::writePlotFile() 2 0.09853 0.09861 0.09862 0.67% Castro::post_regrid() 2 0.08558 0.08806 0.08991 0.61% MLMG::mgVcycle_bottom 128 0.0003697 0.005853 0.08797 0.60% MLMG::actualBottomSolve() 128 0.0001337 0.005612 0.08771 0.59% MLCGSolver::bicgstab 8 0 0.005378 0.08606 0.58% MLMG::computeResidual() 128 0.07824 0.08071 0.08393 0.57% Castro::construct_old_source() 120 0.07864 0.07936 0.08129 0.55% FabArray::Saxpy() 192 0.07135 0.0722 0.07987 0.54% MLMG::mgVcycle_down::2 128 0.01293 0.04321 0.07692 0.52% Castro::derive() 18 0.06938 0.06994 0.07175 0.49% AmrLevel::derive() 18 0.06934 0.0699 0.07171 0.49% Castro::construct_new_gravity_source() 17 0.06875 0.06945 0.07096 0.48% Castro::post_timestep() 1 0.05849 0.0609 0.06349 0.43% MLMG::mgVcycle_down::3 128 0.01227 0.01875 0.06273 0.43% FabArray::Xpay() 953 0.05076 0.05356 0.06185 0.42% amrex::average_down 768 0.03356 0.04072 0.0561 0.38% Castro::initialize_advance() 1 0.04852 0.04935 0.0525 0.36% TagBoxArray::collate() 2 7.447e-05 0.006397 0.04938 0.33% Castro::construct_old_gravity_source() 20 0.04544 0.04598 0.04815 0.33% Castro::check_for_nan() 37 0.04525 0.04573 0.04687 0.32% MultiFab::contains_nan() 37 0.04515 0.04562 0.04674 0.32% Amr::regrid() 1 0.04386 0.04512 0.04668 0.32% MLPoisson::define() 19 0.03106 0.03547 0.04098 0.28% Gravity::get_new_grav_vector() 18 0.03539 0.03696 0.03864 0.26% Castro::retry_advance_ctu() 11 0.03527 0.0357 0.03811 0.26% StateDataPhysBCFunct::() 147 0.0006665 0.0187 0.03648 0.25% StateData::FillBoundary(geom) 143 0 0.01787 0.03562 0.24% MLMG::mgVcycle_down::4 128 0.01222 0.01392 0.03523 0.24% MLMG::ResNormInf() 146 0.01836 0.02529 0.03188 0.22% Castro::apply_source_to_state() 37 0.02903 0.0293 0.03036 0.21% MLMG::mgVcycle_up::4 128 0.01118 0.01248 0.02914 0.20% MLCellLinOp::defineAuxData() 19 0.01953 0.02109 0.02656 0.18% MLMG::prepareForSolve() 18 0.02065 0.02167 0.02609 0.18% MLMG::mgVcycle_down::5 128 0.01218 0.0131 0.02316 0.16% VisMF::Write(FabArray) 4 0.01289 0.01409 0.02305 0.16% Castro::sum_integrated_quantities() 2 0.02187 0.02217 0.0222 0.15% MLMG::computeMLResidual() 18 0.01039 0.01597 0.02161 0.15% MLMG::mgVcycle_up::5 128 0.0112 0.01204 0.02137 0.14% Castro::save_data_for_retry() 3 0.01854 0.01883 0.02008 0.14% FabArrayBase::getFB() 6388 0.01068 0.0115 0.01524 0.10% Castro::problem_post_timestep() 2 0.009183 0.01222 0.01521 0.10% Castro::wd_update() 2 0.00917 0.01219 0.0152 0.10% amrex::Add() 136 0.01387 0.01416 0.01509 0.10% Gravity::test_composite_phi() 1 0.01469 0.01472 0.01473 0.10% FabArrayBase::getCPC() 2005 0.009583 0.01087 0.01463 0.10% FabArray::norminf() 244 0.01068 0.01148 0.01397 0.09% MLLinOp::define() 19 0.004176 0.008297 0.01255 0.09% FabArray::setDomainBndry() 147 0.0004474 0.006161 0.01249 0.08% MLLinOp::defineGrids() 19 0.004083 0.008211 0.01247 0.08% MLLinOp::makeSubCommunicator() 19 0.0009405 0.005237 0.009411 0.06% Amr::writeSmallPlotFile() 2 0.008588 0.008591 0.008594 0.06% Castro::volWgtSum() 46 0.007288 0.007413 0.008592 0.06% MLCGSolver::ParallelAllReduce 189 0 0.0005178 0.008284 0.06% FabArray::mult() 59 0.007106 0.007302 0.008202 0.06% MLMG::getGradSolution() 18 0.007118 0.007299 0.007608 0.05% MLCellLinOp::compGrad() 18 0.007075 0.007257 0.007561 0.05% FabArrayBase::CPC::define() 576 0.002281 0.003444 0.006716 0.05% amrex::Dot() 142 0 0.000403 0.006448 0.04% MLCellLinOp::defineBC() 19 0.005713 0.005926 0.006193 0.04% Gravity::update_max_rhs() 2 0.001426 0.0033 0.005791 0.04% Castro::volInBoundary() 14 0.003386 0.003648 0.005417 0.04% MultiFab::max() 2 0.0001628 0.002042 0.004525 0.03% BndryData::define() 19 0.004061 0.00431 0.004507 0.03% FabArray::LinComb() 71 0 0.0002447 0.003916 0.03% MLPoisson::normalize() 79 0 0.0002056 0.003289 0.02% MLPoisson::prepareForSolve() 19 0.001752 0.001892 0.002172 0.01% MLCellLinOp::prepareForSolve() 19 0.001668 0.001816 0.0021 0.01% MLMG::compResidual() 1 0.0009333 0.001401 0.002082 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001408 0.001611 0.001843 0.01% FabArrayBase::FB::FB() 75 0.000304 0.0006993 0.001522 0.01% Gravity::swapTimeLevels() 8 0.001143 0.001203 0.001475 0.01% AmrLevel::AmrLevel(dm) 1 0.00128 0.001309 0.001338 0.01% StateData::define() 6 0.001247 0.001275 0.001303 0.01% MLMG::MLResNormInf() 18 0.001218 0.00124 0.001273 0.01% MLMG::MLRhsNormInf() 18 0.001196 0.001209 0.001221 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009698 0.001047 0.001197 0.01% Castro::locWgtSum() 6 0.001114 0.00112 0.001135 0.01% MLCellLinOp::setLevelBC() 19 0.0005424 0.0006672 0.0008384 0.01% makeSFC 95 0.0006228 0.0006774 0.0008066 0.01% Castro::buildMetrics() 1 0.0006079 0.0006299 0.0006545 0.00% Castro::errorEst() 2 0.0005213 0.0005828 0.0006318 0.00% Castro::apply_tagging_restrictions() 2 0.0004193 0.0004792 0.000528 0.00% Gravity::applyMetricTerms() 2 0.0004851 0.0004892 0.0004942 0.00% Castro::swap_state_time_levels() 8 0.0004092 0.000422 0.0004379 0.00% Castro::volProductSum() 2 0.0003933 0.0004001 0.0004044 0.00% Castro::enforce_consistent_e() 1 0.0003584 0.0003684 0.0003805 0.00% DistributionMapping::Distribute() 95 0.0002214 0.0002391 0.0003083 0.00% Castro::finalize_advance() 1 0.0002557 0.0002631 0.0002898 0.00% Castro::finalize_do_advance() 17 0.0001715 0.0001909 0.0002434 0.00% OwnerMask() 2 0.0001361 0.0001595 0.0001739 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001065 0.0001275 0.0001438 0.00% Castro::enforce_speed_limit() 79 9.971e-05 0.0001064 0.000112 0.00% MultiFab::Swap() 5 7.002e-05 7.751e-05 0.0001118 0.00% Castro::apply_problem_tags() 2 9.523e-05 9.668e-05 9.837e-05 0.00% knapsack() 1 5.992e-05 6.355e-05 7.861e-05 0.00% Amr::initSubcycle() 1 6.207e-05 6.295e-05 6.868e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.726e-05 4.517e-05 5.999e-05 0.00% Castro::construct_old_rotation_source() 20 3.078e-05 3.184e-05 3.542e-05 0.00% Castro::construct_new_rotation_source() 17 2.163e-05 2.265e-05 2.516e-05 0.00% BoxList::parallelComplementIn() 4 1.376e-05 1.479e-05 2.249e-05 0.00% Castro::estTimeStep() 10 1.291e-05 1.425e-05 1.731e-05 0.00% Castro::computeInitialDt() 2 1.037e-05 1.161e-05 1.526e-05 0.00% BoxList::complementIn 4 6.22e-06 6.743e-06 9.823e-06 0.00% Gravity::set_mass_offset() 2 4.098e-06 4.831e-06 6.836e-06 0.00% Castro::gwstrain() 2 4.339e-06 4.854e-06 6.575e-06 0.00% Castro::FluxRegCrseInit 1 1.628e-06 1.794e-06 2.136e-06 0.00% Castro::FluxRegFineAdd() 1 1.447e-06 1.542e-06 1.664e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.dtnuc_mode(nvals = 1) :: [1] [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 12 B 13 B 15 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.08-49-g22908d8ad214) finalized