MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.07-18-g2a555f86eb8a) initialized Starting run at 07:48:22 UTC on 2023-07-14. Successfully read inputs file ... Castro git describe: 23.07-14-g10cafd240 AMReX git describe: 23.07-18-g2a555f86e Microphysics git describe: 23.07-25-ge5c0f75c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.dtnuc_mode = 1 Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.174668216 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001109807 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.011470738 Gravity::multilevel_solve_for_new_phi() time = 0.10467718 Gravity::fill_multipole_BCs() time = 0.011437503 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.05047645 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004405446 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.004771827 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.067049587 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006507464 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.064981251 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006868667 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.061494158 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006173818 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060385642 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327199936 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015755049 Gravity::solve_for_phi() time = 0.089706824 on level 0 Castro::construct_new_gravity() time = 0.091754656 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060943084 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.003878931 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060414776 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329093809 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015291669 Gravity::solve_for_phi() time = 0.090659277 on level 0 Castro::construct_new_gravity() time = 0.092741318 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.588335034e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.061034137 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.003999558 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.159865632 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.343265432 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017857666 Gravity::solve_for_phi() time = 0.090550932 on level 0 Castro::construct_new_gravity() time = 0.092595121 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.587065898e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.062265627 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.00308186 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060423432 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.340367754 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015561008 Gravity::solve_for_phi() time = 0.086247348 on level 0 Castro::construct_new_gravity() time = 0.088344181 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -9.059860097e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.06073509 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003967991 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060513245 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337854931 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015995227 Gravity::solve_for_phi() time = 0.086648363 on level 0 Castro::construct_new_gravity() time = 0.08877687 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -3.751920171e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.06103348 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.004326043 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.060530549 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332113207 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015858941 Gravity::solve_for_phi() time = 0.086366815 on level 0 Castro::construct_new_gravity() time = 0.088485028 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: -3.291489439e+24 zmom added: 0 eint added: 0 ener added: 5.968491079e+43 Castro::do_new_sources() time = 0.060874315 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.004182024 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.060491818 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338198465 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016598482 Gravity::solve_for_phi() time = 0.087322435 on level 0 Castro::construct_new_gravity() time = 0.089454659 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.291567233e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060728083 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003705918 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.060493169 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332700041 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015929258 Gravity::solve_for_phi() time = 0.086599972 on level 0 Castro::construct_new_gravity() time = 0.08872584 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: 6.776595903e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060686519 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003818742 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.060363971 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337052217 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016122629 Gravity::solve_for_phi() time = 0.08659236 on level 0 Castro::construct_new_gravity() time = 0.088659584 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798245e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: 5.252452121e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.060672347 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003765127 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.06048124 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333289868 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015698122 Gravity::solve_for_phi() time = 0.086286856 on level 0 Castro::construct_new_gravity() time = 0.088314684 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: -4.179294337e+24 zmom added: 0 eint added: 0 ener added: 2.123241033e+43 Castro::do_new_sources() time = 0.061560729 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.004183754 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.060475807 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.431603931 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018015522 Gravity::solve_for_phi() time = 0.095331879 on level 0 Castro::construct_new_gravity() time = 0.097673192 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 1.205384045e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.061090291 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.008687571 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.065574295 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332378016 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016273104 Gravity::solve_for_phi() time = 0.086793558 on level 0 Castro::construct_new_gravity() time = 0.088833749 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195608e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -3.296211805e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.061018024 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.01105374 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060346801 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338071477 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016350589 Gravity::solve_for_phi() time = 0.086880871 on level 0 Castro::construct_new_gravity() time = 0.088917253 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -1.986935698e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.064382032 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.009455102 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059266015 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337248511 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016309799 Gravity::solve_for_phi() time = 0.088963373 on level 0 Castro::construct_new_gravity() time = 0.092042836 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 2.991619167e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.060903312 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.005474363 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059860399 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3426772 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.020275292 Gravity::solve_for_phi() time = 0.091958053 on level 0 Castro::construct_new_gravity() time = 0.094069472 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: -4.264296934e+24 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.060643531 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.007127359 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059118476 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334357211 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015296466 Gravity::solve_for_phi() time = 0.087976582 on level 0 Castro::construct_new_gravity() time = 0.090091354 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762635e+35 ymom added: 4.946678891e+24 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.060755966 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.003407101 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059029769 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3285207 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015495461 Gravity::solve_for_phi() time = 0.084593003 on level 0 Castro::construct_new_gravity() time = 0.086707504 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: -4.247768651e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059004474 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002696601232 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.117748323e+27 ener added: 4.117748323e+27 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.160568787e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.471393084e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 7.282010032e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.55125627e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.20998569 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.048400118 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004457178 seconds Ending run at 07:48:36 UTC on 2023-07-14. Run time = 14.45965472 Run time without initialization = 12.26365732 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.46 ... 14.46 ... 14.46 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3715 5.4862 5.6005 38.73% Amr::InitAmr() 1 1.291 1.291 1.291 8.93% Castro::computeTemp() 80 0.8512 0.9802 1.158 8.01% FabArray::ParallelCopy_finish() 1429 0.06592 0.6226 0.8626 5.97% amrex::Copy() 795 0.7666 0.7813 0.7986 5.52% MultiFab::AddProduct() 3439 0.5443 0.5532 0.5649 3.91% Castro::normalize_species() 79 0.5444 0.5538 0.5622 3.89% Castro::reset_internal_energy(Fab) 160 0.5219 0.5336 0.5517 3.82% MLPoisson::Fsmooth() 6144 0.3122 0.3419 0.4168 2.88% check_for_negative_density() 20 0.1708 0.3021 0.4105 2.84% Castro::initMFs() 1 0.3583 0.3716 0.3978 2.75% FabArray::setVal() 5021 0.3576 0.3658 0.3747 2.59% MultiFab::Subtract() 159 0.3464 0.353 0.368 2.54% Gravity::fill_multipole_BCs() 19 0.2038 0.2521 0.2939 2.03% Castro::reset_internal_energy(MultiFab) 80 0.02248 0.07019 0.2441 1.69% FabArray::ParallelCopy_nowait() 1429 0.1877 0.2018 0.2211 1.53% FabArray::sum() 3439 0.1763 0.1793 0.1829 1.26% FillBoundary_finish() 6388 0.09981 0.1148 0.1373 0.95% Castro::initData() 1 0.003301 0.02308 0.1324 0.92% FillBoundary_nowait() 6388 0.07461 0.0988 0.1275 0.88% MLPoisson::Fapply() 994 0.09531 0.1006 0.1175 0.81% Castro::do_old_sources() 20 0.0005023 0.0223 0.1087 0.75% Castro::enforce_min_density() 79 0.01724 0.03824 0.1078 0.75% MLCellLinOp::applyBC() 7156 0.04646 0.06289 0.1068 0.74% FabArray::Saxpy() 192 0.07019 0.07206 0.07989 0.55% Castro::do_new_sources() 17 0.0003643 0.01428 0.0785 0.54% Castro::construct_new_gravity_source() 17 0.06814 0.06946 0.07121 0.49% FabArray::Xpay() 953 0.05108 0.05388 0.06193 0.43% Castro::construct_old_gravity_source() 20 0.04459 0.04562 0.05116 0.35% MultiFab::contains_nan() 37 0.04431 0.0453 0.04713 0.33% MLMG::addInterpCorrection() 768 0.03346 0.03633 0.0435 0.30% AmrLevel::derive() 18 0.04108 0.04157 0.04228 0.29% StateData::FillBoundary(geom) 143 0 0.01799 0.03483 0.24% amrex::average_down 768 0.02486 0.02712 0.0334 0.23% VisMF::Write(FabArray) 4 0.01366 0.01492 0.02602 0.18% MLCGSolver::bicgstab 8 0 0.00142 0.02272 0.16% Castro::construct_old_gravity() 20 0.0003862 0.004982 0.01968 0.14% Amr::writePlotFile() 2 0.00745 0.01695 0.01854 0.13% FabArray::FillBoundary() 6388 0.0142 0.01493 0.01823 0.13% MLCellLinOp::defineAuxData() 19 0.01485 0.01569 0.01783 0.12% Castro::construct_new_source() 102 0.01553 0.01576 0.01598 0.11% amrex::Add() 136 0.01438 0.01464 0.01517 0.10% MLCellLinOp::smooth() 3072 0.01197 0.0127 0.01467 0.10% Castro::evaluate_source_change() 196 0.01302 0.01343 0.01452 0.10% FabArray::norminf() 244 0.01047 0.01095 0.01386 0.10% FabArrayBase::getFB() 6388 0.01028 0.01086 0.01373 0.09% FillPatchIterator::Initialize 147 0.01238 0.01262 0.01287 0.09% Castro::construct_old_source() 120 0.009867 0.01017 0.01226 0.08% MLMG::prepareForSolve() 18 0.01041 0.01071 0.01144 0.08% FabArray::setDomainBndry() 147 0.0004577 0.006083 0.01126 0.08% Castro::wd_update() 2 0.00471 0.007787 0.01083 0.07% MLMG::ResNormInf() 146 0.005814 0.008055 0.01068 0.07% MLLinOp::makeSubCommunicator() 19 0.0008268 0.004818 0.008755 0.06% Gravity::actual_solve_with_mlmg() 19 0.006883 0.007213 0.008154 0.06% FabArrayBase::getCPC() 2005 0.007327 0.007569 0.008013 0.06% FabArray::mult() 59 0.007464 0.007609 0.007852 0.05% Castro::volWgtSum() 46 0.007384 0.007469 0.00767 0.05% MLMG::solve() 18 0.001557 0.003393 0.007172 0.05% FabArrayBase::CPC::define() 576 0.002305 0.003468 0.006727 0.05% Gravity::get_old_grav_vector() 20 0.006297 0.006424 0.006578 0.05% MLCGSolver::ParallelAllReduce 189 0 0.0003996 0.006394 0.04% Gravity::get_new_grav_vector() 18 0.005917 0.006057 0.006367 0.04% amrex::Dot() 142 0 0.0003903 0.006244 0.04% MLCellLinOp::compGrad() 18 0.005706 0.005817 0.006192 0.04% Amr::writeSmallPlotFile() 2 0.004012 0.005711 0.006181 0.04% MLCellLinOp::apply() 994 0.002134 0.002445 0.00565 0.04% Castro::volInBoundary() 14 0.003421 0.003672 0.005422 0.04% MultiFab::max() 2 0.0001781 0.002959 0.005264 0.04% Castro::initialize_do_advance() 20 0.004314 0.004435 0.004898 0.03% FabArray::ParallelCopy() 1429 0.003671 0.003863 0.004207 0.03% FabArray::LinComb() 71 0 0.0002406 0.003849 0.03% BndryData::define() 19 0.003099 0.003195 0.003525 0.02% MLPoisson::normalize() 79 0 0.0002011 0.003218 0.02% AmrLevel::FillPatch() 147 0.002184 0.002293 0.00255 0.02% MLCellLinOp::correctionResidual() 776 0.001903 0.001983 0.002446 0.02% MLLinOp::defineGrids() 19 0.001796 0.001938 0.002212 0.02% MLCellLinOp::prepareForSolve() 19 0.001708 0.001843 0.002151 0.01% Castro::sum_integrated_quantities() 2 0.001677 0.001949 0.002134 0.01% MLMG::mgVcycle() 128 0.001692 0.001774 0.001938 0.01% Castro::construct_new_gravity() 17 0.000289 0.0008499 0.001834 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001334 0.001578 0.001813 0.01% MLCellLinOp::defineBC() 19 0.001574 0.001639 0.001788 0.01% StateData::define() 6 0.001371 0.001445 0.001755 0.01% MLMG:computeResOfCorrection() 768 0.001456 0.001521 0.001647 0.01% FabArrayBase::FB::FB() 75 0.0002932 0.0007112 0.001516 0.01% Gravity::solve_for_phi() 17 0.0007977 0.0009472 0.001501 0.01% Castro::save_data_for_retry() 3 0.001254 0.001277 0.001298 0.01% main() 1 0.0009881 0.001141 0.00127 0.01% MLMG::actualBottomSolve() 128 0.0001372 0.0002061 0.001194 0.01% Castro::locWgtSum() 6 0.001141 0.001155 0.001173 0.01% TagBoxArray::collate() 2 9.097e-05 0.0005981 0.001068 0.01% StateDataPhysBCFunct::() 147 0.0006673 0.0008418 0.001001 0.01% Castro::buildMetrics() 1 0.0005653 0.0006245 0.0009116 0.01% MLCellLinOp::setLevelBC() 19 0.0005474 0.0006831 0.0008535 0.01% FillPatchIterator::FillFromLevel0() 147 0.0007539 0.0007743 0.0008195 0.01% MLMG::mgVcycle_down::2 128 0.0006482 0.0007042 0.00081 0.01% MLMG::mgVcycle_down::1 128 0.000687 0.00071 0.0007844 0.01% MLMG::mgVcycle_down::0 128 0.0006941 0.0007147 0.0007704 0.01% MLMG::mgVcycle_down::3 128 0.0006101 0.0006625 0.0007653 0.01% Castro::subcycle_advance_ctu() 1 0.0001938 0.0002429 0.0007414 0.01% MLMG::mgVcycle_down::4 128 0.0005921 0.0006264 0.000729 0.01% MLMG::mgVcycle_down::5 128 0.0006171 0.000639 0.0007165 0.00% AmrMesh::MakeNewGrids() 2 0.0005133 0.0005482 0.0005883 0.00% MLMG::mgVcycle_up::1 128 0.0004809 0.0005096 0.0005645 0.00% Castro::apply_tagging_restrictions() 2 0.0004324 0.0004931 0.0005585 0.00% MLMG::mgVcycle_up::0 128 0.0004897 0.0005062 0.0005575 0.00% Castro::do_advance_ctu() 20 0.0004463 0.0004875 0.0005529 0.00% Castro::Castro() 1 0.0004773 0.0005072 0.0005383 0.00% MLMG::mgVcycle_up::2 128 0.0004249 0.0004671 0.0005354 0.00% FillPatchSingleLevel 147 0.000483 0.0005027 0.0005332 0.00% Castro::clean_state() 79 0.0004437 0.0004741 0.000529 0.00% MLMG::mgVcycle_up::5 128 0.0004282 0.0004436 0.0005021 0.00% MLMG::mgVcycle_up::3 128 0.0004153 0.0004363 0.0004968 0.00% Gravity::applyMetricTerms() 2 0.0004711 0.0004839 0.0004959 0.00% makeSFC 95 0.000403 0.0004328 0.0004849 0.00% MLCellLinOp::solutionResidual() 147 0.000444 0.0004615 0.0004845 0.00% MLMG::mgVcycle_up::4 128 0.0004172 0.0004329 0.0004801 0.00% Castro::enforce_consistent_e() 1 0.0003602 0.0003815 0.0004678 0.00% MLMG::oneIter() 128 0.000401 0.0004128 0.0004551 0.00% Castro::swap_state_time_levels() 8 0.0004152 0.0004336 0.0004479 0.00% Castro::volProductSum() 2 0.0003904 0.0003961 0.0004025 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003394 0.0003582 0.0003878 0.00% Castro::problem_post_timestep() 2 1.075e-05 3.302e-05 0.0003497 0.00% DistributionMapping::LeastUsedCPUs() 1 2.108e-05 0.0002415 0.00028 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002309 0.0002468 0.0002748 0.00% OwnerMask() 2 0.0001382 0.0002011 0.0002714 0.00% MLMG::computeResidual() 128 0.000251 0.0002587 0.0002687 0.00% MLMG::mgVcycle_bottom 128 0.0002405 0.0002475 0.000259 0.00% DistributionMapping::Distribute() 95 0.0002131 0.0002278 0.0002513 0.00% Gravity::update_max_rhs() 2 0.000163 0.0001747 0.000238 0.00% Castro::finalize_do_advance() 17 0.0001549 0.0001726 0.0002082 0.00% TagBoxArray::mapPRD 2 0.0001143 0.0001327 0.0001855 0.00% Amr::grid_places() 2 8.428e-05 0.0001234 0.0001692 0.00% MLMG::compResidual() 1 0.0001525 0.0001578 0.000164 0.00% Amr::coarseTimeStep() 1 0.000121 0.0001441 0.0001534 0.00% MLPoisson::define() 19 0.0001321 0.0001384 0.0001465 0.00% Castro::retry_advance_ctu() 11 5.763e-05 6.662e-05 0.0001404 0.00% Amr::defBaseLevel() 1 9.128e-05 0.0001155 0.000136 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.065e-05 7.239e-05 0.0001331 0.00% Castro::initialize_advance() 1 9.896e-05 0.0001157 0.0001314 0.00% Castro::check_for_nan() 37 0.0001053 0.0001145 0.0001302 0.00% Castro::enforce_speed_limit() 79 0.0001105 0.0001161 0.0001293 0.00% Amr::initSubcycle() 1 5.605e-05 6.461e-05 0.0001214 0.00% Gravity::test_composite_phi() 1 9.486e-05 0.000102 0.0001153 0.00% Castro::apply_source_to_state() 37 9.653e-05 0.0001034 0.0001151 0.00% Castro::apply_problem_tags() 2 9.183e-05 9.501e-05 0.0001075 0.00% MLLinOp::define() 19 8.032e-05 8.428e-05 8.957e-05 0.00% MultiFab::Swap() 5 6.888e-05 7.256e-05 8.878e-05 0.00% knapsack() 1 5.794e-05 6.477e-05 8.814e-05 0.00% MLPoisson::prepareForSolve() 19 7.027e-05 7.464e-05 8.033e-05 0.00% Castro::create_source_corrector() 17 5.624e-05 6.309e-05 7.186e-05 0.00% Castro::expand_state() 20 5.224e-05 5.86e-05 6.849e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.42e-05 3.91e-05 6.293e-05 0.00% MLMG::computeMLResidual() 18 4.836e-05 5.318e-05 6.147e-05 0.00% Amr::FinalizeInit() 1 9.109e-06 1.887e-05 5.027e-05 0.00% Castro::derive() 18 4.392e-05 4.532e-05 4.867e-05 0.00% MLMG::getGradSolution() 18 4.089e-05 4.292e-05 4.643e-05 0.00% Gravity::actual_multilevel_solve() 1 2.803e-05 2.977e-05 4.304e-05 0.00% MLMG::MLResNormInf() 18 3.46e-05 3.62e-05 3.941e-05 0.00% MLMG::MLRhsNormInf() 18 3.27e-05 3.373e-05 3.914e-05 0.00% Gravity::swapTimeLevels() 8 3.174e-05 3.438e-05 3.756e-05 0.00% Castro::construct_old_rotation_source() 20 3.092e-05 3.253e-05 3.612e-05 0.00% Castro::post_regrid() 2 1.156e-05 1.794e-05 3.423e-05 0.00% Amr::regrid() 1 1.193e-05 1.711e-05 3.35e-05 0.00% Amr::initialInit() 1 3.156e-06 7.539e-06 2.957e-05 0.00% Castro::construct_new_rotation_source() 17 2.201e-05 2.34e-05 2.872e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.666e-05 1.883e-05 2.489e-05 0.00% Amr::bldFineLevels() 1 7.76e-06 1.289e-05 2.427e-05 0.00% Castro::finalize_advance() 1 1.653e-05 1.803e-05 2.322e-05 0.00% Amr::InitializeInit() 1 7.024e-06 9.434e-06 2.055e-05 0.00% Castro::estTimeStep() 10 1.296e-05 1.415e-05 2.051e-05 0.00% Amr::timeStep() 1 1.198e-05 1.35e-05 1.931e-05 0.00% Gravity::set_mass_offset() 2 4.22e-06 1.18e-05 1.697e-05 0.00% Castro::computeInitialDt() 2 7.45e-06 1.014e-05 1.638e-05 0.00% Castro::errorEst() 2 6.677e-06 7.509e-06 1.535e-05 0.00% Castro::post_init() 1 1.245e-05 1.358e-05 1.49e-05 0.00% Castro::advance() 1 7.406e-06 8.131e-06 1.183e-05 0.00% Amr::init() 1 7.471e-06 8.449e-06 1.099e-05 0.00% BoxList::parallelComplementIn() 4 7.408e-06 7.908e-06 8.797e-06 0.00% Castro::post_timestep() 1 5.663e-06 6.301e-06 7.603e-06 0.00% BoxList::complementIn 4 6.261e-06 6.534e-06 7.166e-06 0.00% Castro::gwstrain() 2 4.463e-06 4.96e-06 6.761e-06 0.00% Castro::FluxRegCrseInit 1 1.683e-06 1.876e-06 2.177e-06 0.00% Castro::FluxRegFineAdd() 1 1.411e-06 1.525e-06 1.668e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.46 14.46 14.46 100.00% Amr::coarseTimeStep() 1 12.26 12.26 12.26 84.81% Amr::timeStep() 1 12.21 12.21 12.21 84.44% Castro::advance() 1 12.15 12.15 12.15 84.04% Castro::subcycle_advance_ctu() 1 12.1 12.1 12.1 83.69% Castro::do_advance_ctu() 20 12.06 12.06 12.06 83.44% Castro::construct_ctu_hydro_source() 20 6.533 6.575 6.62 45.78% Castro::clean_state() 79 3.656 3.854 4.096 28.32% Castro::computeTemp() 80 2.368 2.54 2.81 19.43% Castro::reset_internal_energy(MultiFab) 80 1.488 1.56 1.743 12.05% Gravity::solve_phi_with_mlmg() 19 1.514 1.565 1.611 11.14% Castro::construct_new_gravity() 17 1.437 1.487 1.531 10.59% Gravity::solve_for_phi() 17 1.399 1.449 1.495 10.34% Castro::initialize_do_advance() 20 1.384 1.428 1.467 10.14% Gravity::actual_solve_with_mlmg() 19 1.306 1.31 1.315 9.09% Castro::do_old_sources() 20 1.261 1.292 1.314 9.09% Amr::InitAmr() 1 1.291 1.291 1.291 8.93% MLMG::solve() 18 1.255 1.259 1.26 8.72% MLMG::oneIter() 128 1.121 1.122 1.124 7.78% MLMG::mgVcycle() 128 1.106 1.107 1.109 7.67% FabArray::ParallelCopy() 1429 0.2924 0.8479 1.092 7.55% Castro::do_new_sources() 17 0.9551 0.9907 1.038 7.18% Castro::evaluate_source_change() 196 0.9382 0.9535 0.9729 6.73% Amr::init() 1 0.9042 0.9044 0.9045 6.26% Castro::enforce_min_density() 79 0.7824 0.8175 0.8841 6.11% FabArray::ParallelCopy_finish() 1429 0.06592 0.6226 0.8626 5.97% Amr::initialInit() 1 0.8486 0.8488 0.8489 5.87% amrex::Copy() 795 0.7666 0.7813 0.7986 5.52% AmrLevel::FillPatch() 147 0.4871 0.6624 0.7551 5.22% MLCellLinOp::smooth() 3072 0.5491 0.5988 0.7223 4.99% Amr::InitializeInit() 1 0.4435 0.509 0.616 4.26% Amr::defBaseLevel() 1 0.4435 0.509 0.616 4.26% FillPatchIterator::Initialize 147 0.3083 0.485 0.5804 4.01% MultiFab::AddProduct() 3439 0.5443 0.5532 0.5649 3.91% FillPatchIterator::FillFromLevel0() 147 0.2845 0.4663 0.5637 3.90% FillPatchSingleLevel 147 0.2837 0.4655 0.563 3.89% Castro::normalize_species() 79 0.5444 0.5538 0.5622 3.89% Castro::reset_internal_energy(Fab) 160 0.5219 0.5336 0.5517 3.82% MLMG::mgVcycle_up::1 128 0.09303 0.2651 0.4373 3.02% MLPoisson::Fsmooth() 6144 0.3122 0.3419 0.4168 2.88% check_for_negative_density() 20 0.1708 0.3021 0.4105 2.84% Amr::FinalizeInit() 1 0.2328 0.3398 0.4053 2.80% Castro::Castro() 1 0.3637 0.3773 0.4039 2.79% Castro::initMFs() 1 0.3585 0.3718 0.3981 2.75% MLMG::addInterpCorrection() 768 0.06538 0.3178 0.3866 2.67% FabArray::setVal() 5021 0.3576 0.3658 0.3747 2.59% MLCellLinOp::applyBC() 7156 0.2661 0.303 0.3691 2.55% MultiFab::Subtract() 159 0.3464 0.353 0.368 2.54% Gravity::fill_multipole_BCs() 19 0.2059 0.2542 0.2959 2.05% MLMG::mgVcycle_up::2 128 0.0111 0.1219 0.294 2.03% FabArray::FillBoundary() 6388 0.2059 0.2401 0.2701 1.87% MLMG::mgVcycle_down::0 128 0.2634 0.2653 0.2679 1.85% FabArray::ParallelCopy_nowait() 1429 0.2069 0.2214 0.2417 1.67% Castro::initData() 1 0.07781 0.1298 0.2365 1.64% Amr::bldFineLevels() 1 0.04745 0.1546 0.2193 1.52% Castro::expand_state() 20 0.1761 0.1915 0.2127 1.47% MLCellLinOp::apply() 994 0.1509 0.1601 0.1991 1.38% MLMG::mgVcycle_up::0 128 0.1955 0.1979 0.1991 1.38% MLMG::mgVcycle_up::3 128 0.01108 0.02506 0.1952 1.35% FabArray::sum() 3439 0.1763 0.1793 0.1829 1.26% Amr::grid_places() 2 0.003236 0.1103 0.1758 1.22% AmrMesh::MakeNewGrids() 2 0.003138 0.1101 0.1757 1.21% TagBoxArray::mapPRD 2 0.000816 0.1082 0.1735 1.20% MLCellLinOp::correctionResidual() 776 0.1113 0.1218 0.1513 1.05% MLMG:computeResOfCorrection() 768 0.1128 0.123 0.1486 1.03% Castro::post_init() 1 0.1384 0.1411 0.1434 0.99% FillBoundary_nowait() 6388 0.08558 0.1104 0.1396 0.97% FillBoundary_finish() 6388 0.09981 0.1148 0.1373 0.95% Castro::construct_new_source() 102 0.1236 0.1257 0.1278 0.88% Castro::construct_old_gravity() 20 0.04997 0.06964 0.1187 0.82% Castro::create_source_corrector() 17 0.05429 0.08992 0.1184 0.82% MLPoisson::Fapply() 994 0.09531 0.1006 0.1175 0.81% MLMG::mgVcycle_down::1 128 0.1099 0.1134 0.1172 0.81% Gravity::multilevel_solve_for_new_phi() 1 0.1046 0.1047 0.1047 0.72% Gravity::actual_multilevel_solve() 1 0.1045 0.1046 0.1046 0.72% Gravity::get_old_grav_vector() 20 0.0435 0.06466 0.1004 0.69% Amr::writePlotFile() 2 0.0994 0.09948 0.09949 0.69% MLCellLinOp::solutionResidual() 147 0.08626 0.09298 0.09691 0.67% Castro::construct_old_source() 120 0.078 0.07998 0.09375 0.65% Castro::post_regrid() 2 0.08611 0.08839 0.09114 0.63% MLMG::mgVcycle_bottom 128 0.0003786 0.005917 0.08887 0.61% MLMG::actualBottomSolve() 128 0.0001372 0.00567 0.08861 0.61% MLCGSolver::bicgstab 8 0 0.005432 0.08692 0.60% FabArray::Saxpy() 192 0.07019 0.07206 0.07989 0.55% MLMG::computeResidual() 128 0.07525 0.07663 0.07822 0.54% Castro::derive() 18 0.06947 0.07021 0.07191 0.50% AmrLevel::derive() 18 0.06942 0.07016 0.07186 0.50% Castro::construct_new_gravity_source() 17 0.06814 0.06946 0.07121 0.49% MLMG::mgVcycle_down::2 128 0.01291 0.0404 0.07081 0.49% Castro::post_timestep() 1 0.05835 0.06009 0.06284 0.43% FabArray::Xpay() 953 0.05108 0.05388 0.06193 0.43% MLMG::mgVcycle_down::3 128 0.01226 0.01867 0.06081 0.42% amrex::average_down 768 0.03323 0.03952 0.05471 0.38% Castro::initialize_advance() 1 0.04886 0.05035 0.05206 0.36% Castro::construct_old_gravity_source() 20 0.04459 0.04562 0.05116 0.35% Castro::check_for_nan() 37 0.04443 0.04541 0.04724 0.33% MultiFab::contains_nan() 37 0.04431 0.0453 0.04713 0.33% Amr::regrid() 1 0.04452 0.04538 0.04668 0.32% MLPoisson::define() 19 0.03029 0.03462 0.04065 0.28% Gravity::get_new_grav_vector() 18 0.03509 0.03637 0.0376 0.26% Castro::retry_advance_ctu() 11 0.03561 0.03642 0.03711 0.26% MLMG::mgVcycle_down::4 128 0.01223 0.01406 0.03575 0.25% StateDataPhysBCFunct::() 147 0.0006673 0.01883 0.03575 0.25% StateData::FillBoundary(geom) 143 0 0.01799 0.03483 0.24% Castro::apply_source_to_state() 37 0.02861 0.02942 0.03333 0.23% MLMG::mgVcycle_up::4 128 0.01119 0.01249 0.02795 0.19% VisMF::Write(FabArray) 4 0.01366 0.01492 0.02602 0.18% MLCellLinOp::defineAuxData() 19 0.01915 0.02071 0.02484 0.17% MLMG::prepareForSolve() 18 0.02082 0.02182 0.02425 0.17% MLMG::mgVcycle_down::5 128 0.0122 0.01325 0.02394 0.17% Castro::sum_integrated_quantities() 2 0.02092 0.02116 0.02119 0.15% MLMG::mgVcycle_up::5 128 0.01117 0.01206 0.02043 0.14% MLMG::ResNormInf() 146 0.01539 0.01746 0.02015 0.14% MLMG::computeMLResidual() 18 0.01073 0.0159 0.02004 0.14% Castro::save_data_for_retry() 3 0.01827 0.01862 0.01902 0.13% FabArrayBase::getFB() 6388 0.01065 0.01157 0.01525 0.11% amrex::Add() 136 0.01438 0.01464 0.01517 0.10% Gravity::test_composite_phi() 1 0.01495 0.01499 0.01501 0.10% FabArrayBase::getCPC() 2005 0.009748 0.01104 0.01467 0.10% Castro::problem_post_timestep() 2 0.009251 0.01149 0.01429 0.10% Castro::wd_update() 2 0.009239 0.01146 0.01428 0.10% FabArray::norminf() 244 0.01047 0.01095 0.01386 0.10% MLLinOp::define() 19 0.003924 0.007859 0.01213 0.08% MLLinOp::defineGrids() 19 0.003834 0.007775 0.01204 0.08% FabArray::setDomainBndry() 147 0.0004577 0.006083 0.01126 0.08% MLCGSolver::ParallelAllReduce 189 0 0.0006111 0.009778 0.07% Amr::writeSmallPlotFile() 2 0.009237 0.009238 0.009239 0.06% MLLinOp::makeSubCommunicator() 19 0.0008268 0.004818 0.008755 0.06% MLMG::getGradSolution() 18 0.00739 0.007549 0.008055 0.06% MLCellLinOp::compGrad() 18 0.007349 0.007506 0.00801 0.06% FabArray::mult() 59 0.007464 0.007609 0.007852 0.05% Castro::volWgtSum() 46 0.007384 0.007469 0.00767 0.05% FabArrayBase::CPC::define() 576 0.002305 0.003468 0.006727 0.05% Gravity::update_max_rhs() 2 0.001448 0.004213 0.006496 0.04% MLCellLinOp::defineBC() 19 0.005593 0.005909 0.00633 0.04% amrex::Dot() 142 0 0.0003903 0.006244 0.04% Castro::volInBoundary() 14 0.003421 0.003672 0.005422 0.04% MultiFab::max() 2 0.0001781 0.002959 0.005264 0.04% BndryData::define() 19 0.004019 0.00427 0.004595 0.03% FabArray::LinComb() 71 0 0.0002406 0.003849 0.03% MLPoisson::normalize() 79 0 0.0002011 0.003218 0.02% MLPoisson::prepareForSolve() 19 0.001788 0.001918 0.002227 0.02% MLCellLinOp::prepareForSolve() 19 0.001708 0.001843 0.002151 0.01% Gravity::swapTimeLevels() 8 0.001173 0.001249 0.001846 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001334 0.001578 0.001813 0.01% AmrLevel::AmrLevel(dm) 1 0.001406 0.001484 0.001809 0.01% StateData::define() 6 0.001371 0.001445 0.001755 0.01% FabArrayBase::FB::FB() 75 0.0002932 0.0007112 0.001516 0.01% MLMG::MLResNormInf() 18 0.001198 0.001222 0.001289 0.01% MLMG::compResidual() 1 0.0009478 0.001121 0.001263 0.01% MLMG::MLRhsNormInf() 18 0.001165 0.001189 0.001216 0.01% Castro::locWgtSum() 6 0.001141 0.001155 0.001173 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009556 0.001019 0.001092 0.01% TagBoxArray::collate() 2 9.097e-05 0.0005981 0.001068 0.01% Castro::buildMetrics() 1 0.0006266 0.0006935 0.001023 0.01% MLCellLinOp::setLevelBC() 19 0.0005474 0.0006831 0.0008535 0.01% makeSFC 95 0.0006161 0.0006606 0.0007165 0.00% Castro::errorEst() 2 0.0005316 0.0005956 0.0006814 0.00% Castro::apply_tagging_restrictions() 2 0.0004324 0.0004931 0.0005585 0.00% Gravity::applyMetricTerms() 2 0.0004711 0.0004839 0.0004959 0.00% Castro::enforce_consistent_e() 1 0.0003602 0.0003815 0.0004678 0.00% Castro::swap_state_time_levels() 8 0.0004152 0.0004336 0.0004479 0.00% Castro::volProductSum() 2 0.0003904 0.0003961 0.0004025 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001318 0.0003251 0.0003638 0.00% Castro::finalize_advance() 1 0.0002509 0.0002577 0.0002959 0.00% DistributionMapping::LeastUsedCPUs() 1 2.108e-05 0.0002415 0.00028 0.00% OwnerMask() 2 0.0001382 0.0002011 0.0002714 0.00% DistributionMapping::Distribute() 95 0.0002131 0.0002278 0.0002513 0.00% Castro::finalize_do_advance() 17 0.0001657 0.0001835 0.0002185 0.00% Castro::enforce_speed_limit() 79 0.0001105 0.0001161 0.0001293 0.00% Amr::initSubcycle() 1 5.605e-05 6.461e-05 0.0001214 0.00% Castro::apply_problem_tags() 2 9.183e-05 9.501e-05 0.0001075 0.00% MultiFab::Swap() 5 6.888e-05 7.256e-05 8.878e-05 0.00% knapsack() 1 5.794e-05 6.477e-05 8.814e-05 0.00% Castro::construct_old_rotation_source() 20 3.092e-05 3.253e-05 3.612e-05 0.00% Castro::construct_new_rotation_source() 17 2.201e-05 2.34e-05 2.872e-05 0.00% Castro::estTimeStep() 10 1.296e-05 1.415e-05 2.051e-05 0.00% Castro::computeInitialDt() 2 1.028e-05 1.34e-05 1.938e-05 0.00% Gravity::set_mass_offset() 2 4.22e-06 1.18e-05 1.697e-05 0.00% BoxList::parallelComplementIn() 4 1.367e-05 1.444e-05 1.596e-05 0.00% BoxList::complementIn 4 6.261e-06 6.534e-06 7.166e-06 0.00% Castro::gwstrain() 2 4.463e-06 4.96e-06 6.761e-06 0.00% Castro::FluxRegCrseInit 1 1.683e-06 1.876e-06 2.177e-06 0.00% Castro::FluxRegFineAdd() 1 1.411e-06 1.525e-06 1.668e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.dtnuc_mode(nvals = 1) :: [1] [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 13 B 14 B 19 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.07-18-g2a555f86eb8a) finalized