Initializing AMReX (23.10-21-g152fdac6aa4c)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.10-21-g152fdac6aa4c) initialized Starting run at 07:12:19 UTC on 2023-10-26. Successfully read inputs file ... Castro git describe: 23.10-46-g13f63f26e AMReX git describe: 23.10-21-g152fdac6a Microphysics git describe: 23.10-18-g5dd1a910 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.142388129 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000964643 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.01062545 Gravity::multilevel_solve_for_new_phi() time = 0.106028974 Gravity::fill_multipole_BCs() time = 0.01100685 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.050736556 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.007011351 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003789163 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065610589 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.008327011 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.064809172 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006942422 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.061076934 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006712738 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.05897979 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328709362 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014214157 Gravity::solve_for_phi() time = 0.084814747 on level 0 Castro::construct_new_gravity() time = 0.086928015 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.059863899 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002768854 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.061446986 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.347446944 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014225294 Gravity::solve_for_phi() time = 0.085630977 on level 0 Castro::construct_new_gravity() time = 0.087668872 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.588335034e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.062247768 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.003306367 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058905834 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334098059 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01431532 Gravity::solve_for_phi() time = 0.08632544 on level 0 Castro::construct_new_gravity() time = 0.088373532 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.587065898e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.061536481 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002722853 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.0591648 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335072519 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015492605 Gravity::solve_for_phi() time = 0.086951166 on level 0 Castro::construct_new_gravity() time = 0.089372273 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -9.059860097e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.06213734 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003228079 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.059075811 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.343138977 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015460856 Gravity::solve_for_phi() time = 0.088624689 on level 0 Castro::construct_new_gravity() time = 0.090665284 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -3.751920171e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.06006884 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.002996915 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.05904908 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330254785 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014635333 Gravity::solve_for_phi() time = 0.084502389 on level 0 Castro::construct_new_gravity() time = 0.086535897 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: -3.291489439e+24 zmom added: 0 eint added: 0 ener added: 5.968491079e+43 Castro::do_new_sources() time = 0.0602421 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.002693081 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059031202 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337476454 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015327883 Gravity::solve_for_phi() time = 0.085729874 on level 0 Castro::construct_new_gravity() time = 0.087863483 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.291567233e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060553232 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002612278 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059173356 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332411771 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015278825 Gravity::solve_for_phi() time = 0.085301845 on level 0 Castro::construct_new_gravity() time = 0.087400351 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: 6.776595903e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060093357 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00265448 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059302434 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337266314 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015512185 Gravity::solve_for_phi() time = 0.085823432 on level 0 Castro::construct_new_gravity() time = 0.087866542 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798245e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: 5.252452121e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.065332134 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.004490788 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059034701 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332549798 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015139161 Gravity::solve_for_phi() time = 0.084885064 on level 0 Castro::construct_new_gravity() time = 0.086908303 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: -4.179294337e+24 zmom added: 0 eint added: 0 ener added: 2.123241033e+43 Castro::do_new_sources() time = 0.060759959 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003215441 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058771392 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337752265 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015234314 Gravity::solve_for_phi() time = 0.084882509 on level 0 Castro::construct_new_gravity() time = 0.086941197 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 1.205384045e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059982287 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.003215478 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058912667 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333367803 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015407565 Gravity::solve_for_phi() time = 0.085872542 on level 0 Castro::construct_new_gravity() time = 0.087992739 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195608e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -3.296211805e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.060368415 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.003352832 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058801778 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338622562 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015294257 Gravity::solve_for_phi() time = 0.085318422 on level 0 Castro::construct_new_gravity() time = 0.087372601 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -1.986935698e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.060122757 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.002730588 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058725336 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33307826 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015717855 Gravity::solve_for_phi() time = 0.085544164 on level 0 Castro::construct_new_gravity() time = 0.087660226 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 2.991619167e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.06022243 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.002683645 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058999715 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337977238 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015447964 Gravity::solve_for_phi() time = 0.085278809 on level 0 Castro::construct_new_gravity() time = 0.087403557 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: -4.264296934e+24 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.060307532 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.002641999 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059194249 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33348227 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015725788 Gravity::solve_for_phi() time = 0.085958579 on level 0 Castro::construct_new_gravity() time = 0.08807699 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762635e+35 ymom added: 4.946678891e+24 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.060115633 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.002776725 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059317469 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3371625 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015584359 Gravity::solve_for_phi() time = 0.085394122 on level 0 Castro::construct_new_gravity() time = 0.087438867 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: -4.247768651e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.060121815 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002752174967 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.117748323e+27 ener added: 4.117748323e+27 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.160568787e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.471393084e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 7.282010032e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.55125627e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.29823144 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.223221908 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.007591837 seconds Ending run at 07:12:34 UTC on 2023-10-26. Run time = 14.89749749 Run time without initialization = 12.53007907 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.9 ... 14.9 ... 14.9 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.4418 5.5396 5.6346 37.82% Amr::InitAmr() 1 1.486 1.486 1.486 9.97% Castro::computeTemp() 80 0.8706 0.9802 1.138 7.64% amrex::Copy() 795 0.7681 0.7835 0.7965 5.35% FabArray::ParallelCopy_finish() 1429 0.04875 0.4836 0.7161 4.81% MultiFab::AddProduct() 3439 0.5474 0.5604 0.6284 4.22% Castro::normalize_species() 79 0.5613 0.569 0.5785 3.88% Castro::reset_internal_energy(Fab) 160 0.5278 0.5368 0.5427 3.64% MLPoisson::Fsmooth() 6144 0.3208 0.3504 0.4255 2.86% Castro::initMFs() 1 0.3604 0.3675 0.3832 2.57% FabArray::setVal() 5021 0.3429 0.3492 0.3575 2.40% MultiFab::Subtract() 159 0.3361 0.3407 0.3451 2.32% Castro::sum_integrated_quantities() 2 0.00906 0.3141 0.336 2.26% Castro::problem_post_timestep() 2 1.056e-05 0.02042 0.3265 2.19% check_for_negative_density() 20 0.1076 0.1852 0.2827 1.90% Gravity::fill_multipole_BCs() 19 0.2005 0.235 0.2766 1.86% FabArray::ParallelCopy_nowait() 1429 0.1846 0.2024 0.221 1.48% Amr::writePlotFile() 2 0.1528 0.1846 0.1929 1.29% FabArray::sum() 3439 0.1845 0.1871 0.189 1.27% Castro::reset_internal_energy(MultiFab) 80 0.02277 0.05521 0.1722 1.16% FillBoundary_finish() 6388 0.09577 0.1138 0.135 0.91% Castro::initData() 1 0.003345 0.02336 0.1344 0.90% FillBoundary_nowait() 6388 0.06958 0.09517 0.1232 0.83% MLPoisson::Fapply() 994 0.09376 0.09892 0.115 0.77% MLCellLinOp::applyBC() 7156 0.04609 0.0622 0.1048 0.70% FabArray::Saxpy() 192 0.07262 0.07385 0.07885 0.53% Castro::construct_new_gravity_source() 17 0.06908 0.07022 0.0725 0.49% FabArray::Xpay() 953 0.05201 0.05469 0.06257 0.42% Castro::do_new_sources() 17 0.0003359 0.009849 0.06195 0.42% AmrLevel::derive() 18 0.04088 0.0446 0.05957 0.40% MultiFab::contains_nan() 37 0.04698 0.04756 0.04852 0.33% Castro::enforce_min_density() 79 0.01775 0.026 0.04737 0.32% Castro::construct_old_gravity_source() 20 0.04447 0.04526 0.04711 0.32% MLMG::addInterpCorrection() 768 0.03293 0.0357 0.04267 0.29% StateData::FillBoundary(geom) 143 0 0.0182 0.03524 0.24% VisMF::Write(FabArray) 4 0.01548 0.01753 0.03294 0.22% amrex::average_down 768 0.02404 0.02629 0.03232 0.22% Castro::do_old_sources() 20 0.0004362 0.007113 0.02988 0.20% MLCGSolver::bicgstab 8 0 0.001273 0.02036 0.14% Castro::construct_old_gravity() 20 0.0003455 0.004698 0.02016 0.14% FabArray::FillBoundary() 6388 0.01339 0.01402 0.01712 0.11% Castro::construct_new_source() 102 0.01555 0.0158 0.01692 0.11% MLCellLinOp::defineAuxData() 19 0.01422 0.01482 0.01667 0.11% amrex::Add() 136 0.014 0.01423 0.01481 0.10% FabArray::norminf() 244 0.01101 0.01142 0.01454 0.10% Castro::volWgtSum() 46 0.007361 0.007968 0.01366 0.09% Castro::evaluate_source_change() 196 0.01217 0.01256 0.01323 0.09% FabArrayBase::getFB() 6388 0.009971 0.01042 0.013 0.09% FillPatchIterator::Initialize 147 0.01254 0.01274 0.01292 0.09% MLCellLinOp::smooth() 3072 0.01093 0.01144 0.01245 0.08% FabArray::setDomainBndry() 147 0.0004306 0.006174 0.01164 0.08% Castro::wd_update() 2 0.004886 0.007357 0.01153 0.08% MLMG::prepareForSolve() 18 0.009901 0.01014 0.01139 0.08% Castro::construct_old_source() 120 0.009832 0.01 0.0105 0.07% Amr::writeSmallPlotFile() 2 0.007198 0.009558 0.01004 0.07% MLLinOp::makeSubCommunicator() 19 0.0007831 0.004457 0.008464 0.06% MLMG::ResNormInf() 146 0.004021 0.005935 0.008324 0.06% FabArray::mult() 59 0.007652 0.007797 0.007984 0.05% Gravity::actual_solve_with_mlmg() 19 0.006526 0.006849 0.007786 0.05% FabArrayBase::getCPC() 2005 0.007227 0.007405 0.007782 0.05% MultiFab::max() 2 0.000169 0.004622 0.007433 0.05% Gravity::get_old_grav_vector() 20 0.006559 0.006614 0.006834 0.05% Gravity::get_new_grav_vector() 18 0.005975 0.006139 0.00673 0.05% FabArrayBase::CPC::define() 576 0.002147 0.003298 0.006318 0.04% amrex::Dot() 142 0 0.0003866 0.006186 0.04% MLMG::solve() 18 0.0007488 0.002681 0.005957 0.04% MLCellLinOp::compGrad() 18 0.005823 0.005882 0.005945 0.04% Castro::initialize_do_advance() 20 0.004559 0.004944 0.005574 0.04% Castro::volInBoundary() 14 0.003501 0.003763 0.005517 0.04% MLCellLinOp::apply() 994 0.001963 0.002215 0.00495 0.03% MLCGSolver::ParallelAllReduce 189 0 0.0002859 0.004575 0.03% FabArray::ParallelCopy() 1429 0.003441 0.003591 0.003833 0.03% FabArray::LinComb() 71 0 0.0002345 0.003752 0.03% BndryData::define() 19 0.003052 0.003105 0.003282 0.02% MLPoisson::normalize() 79 0 0.0001972 0.003156 0.02% AmrLevel::FillPatch() 147 0.001985 0.002162 0.002403 0.02% MLCellLinOp::correctionResidual() 776 0.001805 0.001894 0.002321 0.02% MLLinOp::defineGrids() 19 0.001758 0.001869 0.002198 0.01% MLCellLinOp::prepareForSolve() 19 0.001632 0.001774 0.002106 0.01% Castro::construct_new_gravity() 17 0.0002688 0.0005176 0.001935 0.01% MLMG::mgVcycle() 128 0.001535 0.001626 0.001797 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001291 0.001559 0.001795 0.01% MLCellLinOp::defineBC() 19 0.001487 0.001528 0.00163 0.01% MLMG:computeResOfCorrection() 768 0.001419 0.001475 0.001552 0.01% main() 1 0.0009987 0.001249 0.001444 0.01% FabArrayBase::FB::FB() 75 0.000276 0.0006702 0.001436 0.01% StateData::define() 6 0.001259 0.001301 0.001371 0.01% Castro::save_data_for_retry() 3 0.001249 0.001291 0.001308 0.01% TagBoxArray::collate() 2 9.596e-05 0.0005851 0.001261 0.01% Castro::locWgtSum() 6 0.001124 0.001149 0.00117 0.01% MLMG::actualBottomSolve() 128 0.000134 0.0001984 0.00107 0.01% Gravity::solve_for_phi() 17 0.0007357 0.0008464 0.001023 0.01% StateDataPhysBCFunct::() 147 0.0006592 0.0008019 0.0009474 0.01% MLCellLinOp::setLevelBC() 19 0.0005333 0.0006642 0.0008509 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006942 0.0007178 0.0007429 0.00% MLMG::mgVcycle_down::2 128 0.000597 0.0006529 0.0007382 0.00% Castro::swap_state_time_levels() 8 0.0006213 0.0006826 0.00072 0.00% Castro::subcycle_advance_ctu() 1 0.0001785 0.0002311 0.0007091 0.00% MLMG::mgVcycle_down::0 128 0.0006446 0.0006621 0.0007039 0.00% MLMG::mgVcycle_down::3 128 0.0005742 0.0006131 0.0006948 0.00% MLMG::mgVcycle_down::1 128 0.0006385 0.0006555 0.0006919 0.00% MLMG::mgVcycle_down::4 128 0.0005481 0.000577 0.000664 0.00% MLMG::mgVcycle_down::5 128 0.0005712 0.0005959 0.0006587 0.00% Castro::buildMetrics() 1 0.000539 0.0005573 0.0005771 0.00% Castro::Castro() 1 0.0004647 0.0004916 0.0005652 0.00% AmrMesh::MakeNewGrids() 2 0.0004856 0.0005068 0.0005524 0.00% Castro::apply_tagging_restrictions() 2 0.0004142 0.0004769 0.0005411 0.00% Castro::clean_state() 79 0.0004244 0.0004563 0.0005295 0.00% Gravity::applyMetricTerms() 2 0.0004912 0.0005034 0.0005167 0.00% Castro::do_advance_ctu() 20 0.0004273 0.0004593 0.000515 0.00% MLMG::mgVcycle_up::1 128 0.0004428 0.0004684 0.0005119 0.00% MLMG::mgVcycle_up::0 128 0.0004483 0.0004643 0.0005101 0.00% MLMG::mgVcycle_up::2 128 0.000382 0.0004233 0.0004988 0.00% FillPatchSingleLevel 147 0.0004603 0.0004805 0.0004984 0.00% MLMG::mgVcycle_up::5 128 0.0003974 0.0004101 0.0004597 0.00% MLCellLinOp::solutionResidual() 147 0.0004294 0.000441 0.0004581 0.00% MLMG::mgVcycle_up::3 128 0.0003801 0.0003965 0.0004464 0.00% Castro::volProductSum() 2 0.000396 0.0004156 0.0004434 0.00% MLMG::mgVcycle_up::4 128 0.0003812 0.0003957 0.0004344 0.00% makeSFC 95 0.0003609 0.0003832 0.0004304 0.00% MLMG::oneIter() 128 0.000373 0.0003887 0.0004251 0.00% Castro::enforce_consistent_e() 1 0.0003716 0.0003822 0.0003909 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003252 0.0003337 0.0003525 0.00% MLMG::computeResidual() 128 0.0002395 0.0002461 0.0002571 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002114 0.000226 0.0002523 0.00% MLMG::mgVcycle_bottom 128 0.0002245 0.000233 0.0002512 0.00% Castro::finalize_do_advance() 17 0.0001644 0.0001824 0.0002334 0.00% DistributionMapping::Distribute() 95 0.0002084 0.0002187 0.0002277 0.00% Gravity::update_max_rhs() 2 0.0001598 0.0001667 0.0001739 0.00% MLMG::compResidual() 1 0.0001543 0.0001584 0.0001619 0.00% Castro::initialize_advance() 1 0.0001219 0.0001409 0.0001609 0.00% OwnerMask() 2 0.0001336 0.0001483 0.0001606 0.00% Castro::retry_advance_ctu() 11 5.133e-05 6.087e-05 0.0001503 0.00% Amr::defBaseLevel() 1 9.472e-05 0.0001159 0.0001444 0.00% Amr::coarseTimeStep() 1 0.0001127 0.0001343 0.0001401 0.00% MLPoisson::define() 19 0.0001181 0.0001283 0.0001373 0.00% Castro::check_for_nan() 37 0.0001028 0.000111 0.0001282 0.00% TagBoxArray::mapPRD 2 0.0001042 0.0001093 0.0001255 0.00% Gravity::test_composite_phi() 1 9.492e-05 0.0001005 0.0001163 0.00% Castro::enforce_speed_limit() 79 0.0001038 0.0001108 0.0001161 0.00% Castro::apply_source_to_state() 37 9.537e-05 0.0001021 0.0001125 0.00% Castro::apply_problem_tags() 2 9.169e-05 9.508e-05 0.0001108 0.00% Amr::grid_places() 2 7.407e-05 8.601e-05 0.0001052 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.937e-05 7.554e-05 0.0001039 0.00% MultiFab::Swap() 5 6.523e-05 7.089e-05 9.761e-05 0.00% MLLinOp::define() 19 7.478e-05 8.173e-05 8.931e-05 0.00% MLPoisson::prepareForSolve() 19 7.32e-05 7.827e-05 8.7e-05 0.00% Castro::create_source_corrector() 17 5.701e-05 6.376e-05 7.778e-05 0.00% knapsack() 1 5.639e-05 5.896e-05 6.594e-05 0.00% Amr::FinalizeInit() 1 8.426e-06 1.556e-05 6.543e-05 0.00% Gravity::swapTimeLevels() 8 3.356e-05 3.958e-05 6.061e-05 0.00% Amr::initSubcycle() 1 5.553e-05 5.734e-05 5.894e-05 0.00% Castro::expand_state() 20 5.1e-05 5.553e-05 5.8e-05 0.00% Castro::derive() 18 4.178e-05 4.675e-05 5.611e-05 0.00% MLMG::computeMLResidual() 18 4.127e-05 4.691e-05 5.469e-05 0.00% MLMG::getGradSolution() 18 4.088e-05 4.335e-05 4.74e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.715e-05 3.645e-05 4.417e-05 0.00% MLMG::MLResNormInf() 18 3.394e-05 3.609e-05 3.911e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.216e-05 3.358e-05 3.858e-05 0.00% Gravity::actual_multilevel_solve() 1 2.652e-05 3.151e-05 3.796e-05 0.00% MLMG::MLRhsNormInf() 18 3.248e-05 3.337e-05 3.492e-05 0.00% Castro::construct_old_rotation_source() 20 2.923e-05 3.102e-05 3.292e-05 0.00% Castro::finalize_advance() 1 1.651e-05 1.885e-05 3.062e-05 0.00% Amr::regrid() 1 1.019e-05 1.304e-05 2.997e-05 0.00% Castro::construct_new_rotation_source() 17 2.18e-05 2.249e-05 2.348e-05 0.00% Castro::advance() 1 7.093e-06 1.053e-05 2.186e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.646e-05 1.777e-05 2.106e-05 0.00% Amr::timeStep() 1 1.241e-05 1.509e-05 1.85e-05 0.00% Gravity::set_mass_offset() 2 4.451e-06 7.64e-06 1.732e-05 0.00% Castro::post_regrid() 2 1.039e-05 1.23e-05 1.649e-05 0.00% Castro::estTimeStep() 10 1.301e-05 1.353e-05 1.526e-05 0.00% Castro::post_init() 1 1.139e-05 1.257e-05 1.444e-05 0.00% Amr::InitializeInit() 1 6.439e-06 7.997e-06 1.416e-05 0.00% Castro::computeInitialDt() 2 7.217e-06 8.809e-06 1.231e-05 0.00% Amr::bldFineLevels() 1 6.948e-06 7.982e-06 1.135e-05 0.00% Amr::init() 1 6.706e-06 7.814e-06 9.423e-06 0.00% Castro::post_timestep() 1 5.567e-06 6.666e-06 9.317e-06 0.00% BoxList::parallelComplementIn() 4 6.906e-06 7.172e-06 7.587e-06 0.00% Castro::errorEst() 2 5.932e-06 6.25e-06 6.636e-06 0.00% BoxList::complementIn 4 5.907e-06 6.149e-06 6.399e-06 0.00% Castro::gwstrain() 2 4.199e-06 4.848e-06 6.072e-06 0.00% Amr::initialInit() 1 2.871e-06 3.18e-06 4.668e-06 0.00% Castro::FluxRegFineAdd() 1 1.406e-06 1.646e-06 3.081e-06 0.00% Castro::FluxRegCrseInit 1 1.765e-06 2.078e-06 2.848e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.9 14.9 14.9 100.00% Amr::coarseTimeStep() 1 12.53 12.53 12.53 84.10% Amr::timeStep() 1 12.3 12.3 12.3 82.55% Castro::advance() 1 11.9 11.9 11.91 79.92% Castro::subcycle_advance_ctu() 1 11.85 11.85 11.86 79.58% Castro::do_advance_ctu() 20 11.81 11.82 11.82 79.34% Castro::construct_ctu_hydro_source() 20 6.48 6.513 6.552 43.98% Castro::clean_state() 79 3.71 3.839 3.995 26.81% Castro::computeTemp() 80 2.388 2.523 2.724 18.28% Castro::reset_internal_energy(MultiFab) 80 1.489 1.543 1.667 11.19% Gravity::solve_phi_with_mlmg() 19 1.493 1.53 1.574 10.56% Castro::construct_new_gravity() 17 1.412 1.449 1.492 10.02% Amr::InitAmr() 1 1.486 1.486 1.486 9.97% Gravity::solve_for_phi() 17 1.376 1.413 1.456 9.78% Castro::initialize_do_advance() 20 1.379 1.41 1.444 9.69% Gravity::actual_solve_with_mlmg() 19 1.288 1.292 1.297 8.70% MLMG::solve() 18 1.239 1.243 1.244 8.35% Castro::do_old_sources() 20 1.161 1.178 1.192 8.00% MLMG::oneIter() 128 1.11 1.112 1.114 7.48% MLMG::mgVcycle() 128 1.095 1.097 1.099 7.38% Castro::do_new_sources() 17 0.9454 0.9903 1.035 6.94% Castro::evaluate_source_change() 196 0.9394 0.9582 1.021 6.85% FabArray::ParallelCopy() 1429 0.2777 0.71 0.9381 6.30% Amr::init() 1 0.8809 0.8809 0.8809 5.91% Castro::enforce_min_density() 79 0.7789 0.8003 0.8433 5.66% Amr::initialInit() 1 0.8223 0.8223 0.8224 5.52% amrex::Copy() 795 0.7681 0.7835 0.7965 5.35% MLCellLinOp::smooth() 3072 0.5533 0.6023 0.728 4.89% FabArray::ParallelCopy_finish() 1429 0.04875 0.4836 0.7161 4.81% AmrLevel::FillPatch() 147 0.478 0.5534 0.6541 4.39% MultiFab::AddProduct() 3439 0.5474 0.5604 0.6284 4.22% Amr::InitializeInit() 1 0.4461 0.4995 0.5867 3.94% Amr::defBaseLevel() 1 0.4461 0.4995 0.5867 3.94% Castro::normalize_species() 79 0.5613 0.569 0.5785 3.88% Castro::reset_internal_energy(Fab) 160 0.5278 0.5368 0.5427 3.64% FillPatchIterator::Initialize 147 0.2973 0.3757 0.4788 3.21% FillPatchIterator::FillFromLevel0() 147 0.2731 0.3568 0.4616 3.10% FillPatchSingleLevel 147 0.2724 0.3561 0.4609 3.09% MLMG::mgVcycle_up::1 128 0.09495 0.2622 0.429 2.88% MLPoisson::Fsmooth() 6144 0.3208 0.3504 0.4255 2.86% Castro::post_timestep() 1 0.392 0.394 0.3967 2.66% Castro::Castro() 1 0.3656 0.3728 0.3884 2.61% Castro::initMFs() 1 0.3606 0.3677 0.3834 2.57% MLMG::addInterpCorrection() 768 0.06186 0.3091 0.378 2.54% Amr::FinalizeInit() 1 0.2357 0.3228 0.3762 2.53% MLCellLinOp::applyBC() 7156 0.2638 0.2963 0.3649 2.45% FabArray::setVal() 5021 0.3429 0.3492 0.3575 2.40% Castro::sum_integrated_quantities() 2 0.02846 0.3344 0.3548 2.38% MultiFab::Subtract() 159 0.3361 0.3407 0.3451 2.32% Castro::problem_post_timestep() 2 0.00926 0.03154 0.3356 2.25% check_for_negative_density() 20 0.1076 0.1852 0.2827 1.90% MLMG::mgVcycle_up::2 128 0.01066 0.1175 0.2818 1.89% Gravity::fill_multipole_BCs() 19 0.2025 0.237 0.2786 1.87% Amr::writePlotFile() 2 0.2745 0.2746 0.2746 1.84% MLMG::mgVcycle_down::0 128 0.2601 0.2627 0.2648 1.78% FabArray::FillBoundary() 6388 0.2091 0.2341 0.2601 1.75% FabArray::ParallelCopy_nowait() 1429 0.2125 0.2228 0.2416 1.62% Castro::initData() 1 0.07874 0.1251 0.219 1.47% Castro::expand_state() 20 0.1778 0.187 0.2065 1.39% MLMG::mgVcycle_up::0 128 0.1997 0.2011 0.2023 1.36% MLCellLinOp::apply() 994 0.1439 0.1554 0.193 1.30% FabArray::sum() 3439 0.1845 0.1871 0.189 1.27% MLMG::mgVcycle_up::3 128 0.01057 0.02406 0.1876 1.26% Amr::bldFineLevels() 1 0.04697 0.134 0.1862 1.25% Castro::post_init() 1 0.1403 0.1447 0.1475 0.99% MLCellLinOp::correctionResidual() 776 0.1081 0.1197 0.1464 0.98% MLMG:computeResOfCorrection() 768 0.1095 0.1209 0.1438 0.97% Amr::grid_places() 2 0.002746 0.09 0.1434 0.96% AmrMesh::MakeNewGrids() 2 0.002641 0.08991 0.1433 0.96% TagBoxArray::mapPRD 2 0.0006866 0.08808 0.1413 0.95% FillBoundary_finish() 6388 0.09577 0.1138 0.135 0.91% FillBoundary_nowait() 6388 0.07999 0.1063 0.1347 0.90% Castro::construct_new_source() 102 0.1249 0.1267 0.1297 0.87% MLMG::mgVcycle_down::1 128 0.1107 0.1144 0.1189 0.80% MLPoisson::Fapply() 994 0.09376 0.09892 0.115 0.77% Castro::create_source_corrector() 17 0.04802 0.07579 0.1092 0.73% Gravity::multilevel_solve_for_new_phi() 1 0.106 0.106 0.106 0.71% Gravity::actual_multilevel_solve() 1 0.1059 0.1059 0.106 0.71% MLCellLinOp::solutionResidual() 147 0.0866 0.09114 0.09534 0.64% Castro::derive() 18 0.06896 0.07494 0.09324 0.63% AmrLevel::derive() 18 0.06892 0.07489 0.09318 0.63% Castro::post_regrid() 2 0.08527 0.08806 0.09253 0.62% MLMG::mgVcycle_bottom 128 0.0003615 0.005515 0.08265 0.55% MLMG::actualBottomSolve() 128 0.000134 0.005282 0.08241 0.55% Castro::construct_old_source() 120 0.0779 0.07919 0.08121 0.55% MLCGSolver::bicgstab 8 0 0.005054 0.08087 0.54% FabArray::Saxpy() 192 0.07262 0.07385 0.07885 0.53% Castro::construct_old_gravity() 20 0.04415 0.06415 0.0772 0.52% MLMG::computeResidual() 128 0.07405 0.07553 0.07711 0.52% Castro::construct_new_gravity_source() 17 0.06908 0.07022 0.0725 0.49% MLMG::mgVcycle_down::2 128 0.01241 0.04023 0.07167 0.48% Gravity::get_old_grav_vector() 20 0.03909 0.05945 0.07104 0.48% FabArray::Xpay() 953 0.05201 0.05469 0.06257 0.42% MLMG::mgVcycle_down::3 128 0.01177 0.01798 0.05891 0.40% amrex::average_down 768 0.03218 0.03849 0.05412 0.36% Castro::initialize_advance() 1 0.04881 0.04996 0.05201 0.35% Castro::check_for_nan() 37 0.0471 0.04767 0.04862 0.33% MultiFab::contains_nan() 37 0.04698 0.04756 0.04852 0.33% Castro::construct_old_gravity_source() 20 0.04447 0.04526 0.04711 0.32% Amr::regrid() 1 0.04375 0.04501 0.04677 0.31% MLPoisson::define() 19 0.02827 0.03274 0.03869 0.26% Gravity::get_new_grav_vector() 18 0.03478 0.03553 0.0374 0.25% Castro::retry_advance_ctu() 11 0.03482 0.03552 0.03637 0.24% StateDataPhysBCFunct::() 147 0.0006592 0.019 0.03608 0.24% StateData::FillBoundary(geom) 143 0 0.0182 0.03524 0.24% MLMG::mgVcycle_down::4 128 0.01172 0.01348 0.03504 0.24% VisMF::Write(FabArray) 4 0.01548 0.01753 0.03294 0.22% Castro::apply_source_to_state() 37 0.0296 0.03002 0.03034 0.20% MLMG::mgVcycle_up::4 128 0.01069 0.01195 0.02736 0.18% MLCellLinOp::defineAuxData() 19 0.01824 0.01959 0.02325 0.16% MLMG::prepareForSolve() 18 0.02002 0.02092 0.02311 0.16% MLMG::mgVcycle_down::5 128 0.01183 0.01274 0.0231 0.16% MLMG::mgVcycle_up::5 128 0.01079 0.01157 0.01969 0.13% Castro::save_data_for_retry() 3 0.0183 0.01877 0.01966 0.13% MLMG::computeMLResidual() 18 0.01111 0.01516 0.0189 0.13% MLMG::ResNormInf() 146 0.01391 0.01575 0.01803 0.12% Castro::wd_update() 2 0.009136 0.01112 0.01511 0.10% Amr::writeSmallPlotFile() 2 0.01499 0.015 0.015 0.10% amrex::Add() 136 0.014 0.01423 0.01481 0.10% Gravity::test_composite_phi() 1 0.01469 0.01472 0.01474 0.10% FabArray::norminf() 244 0.01101 0.01142 0.01454 0.10% FabArrayBase::getFB() 6388 0.01029 0.01109 0.01444 0.10% FabArrayBase::getCPC() 2005 0.009488 0.0107 0.01398 0.09% Castro::volWgtSum() 46 0.007361 0.007968 0.01366 0.09% FabArray::setDomainBndry() 147 0.0004306 0.006174 0.01164 0.08% MLLinOp::define() 19 0.003869 0.007343 0.01164 0.08% MLLinOp::defineGrids() 19 0.003788 0.007262 0.01156 0.08% Gravity::update_max_rhs() 2 0.001413 0.005877 0.008671 0.06% MLLinOp::makeSubCommunicator() 19 0.0007831 0.004457 0.008464 0.06% FabArray::mult() 59 0.007652 0.007797 0.007984 0.05% MLCGSolver::ParallelAllReduce 189 0 0.0004958 0.007932 0.05% MLMG::getGradSolution() 18 0.007416 0.007562 0.007698 0.05% MLCellLinOp::compGrad() 18 0.007371 0.007519 0.007656 0.05% MultiFab::max() 2 0.000169 0.004622 0.007433 0.05% FabArrayBase::CPC::define() 576 0.002147 0.003298 0.006318 0.04% amrex::Dot() 142 0 0.0003866 0.006186 0.04% MLCellLinOp::defineBC() 19 0.005496 0.005683 0.005908 0.04% Castro::volInBoundary() 14 0.003501 0.003763 0.005517 0.04% BndryData::define() 19 0.003952 0.004156 0.004304 0.03% FabArray::LinComb() 71 0 0.0002345 0.003752 0.03% MLPoisson::normalize() 79 0 0.0001972 0.003156 0.02% MLPoisson::prepareForSolve() 19 0.001718 0.001852 0.002188 0.01% MLCellLinOp::prepareForSolve() 19 0.001632 0.001774 0.002106 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001291 0.001559 0.001795 0.01% FabArrayBase::FB::FB() 75 0.000276 0.0006702 0.001436 0.01% AmrLevel::AmrLevel(dm) 1 0.001294 0.001335 0.001405 0.01% StateData::define() 6 0.001259 0.001301 0.001371 0.01% MLMG::MLResNormInf() 18 0.001253 0.001282 0.00136 0.01% Gravity::swapTimeLevels() 8 0.001179 0.001246 0.001325 0.01% Castro::finalize_advance() 1 0.0002528 0.0003315 0.001323 0.01% MLMG::MLRhsNormInf() 18 0.001219 0.001245 0.001268 0.01% MLMG::compResidual() 1 0.0009633 0.001109 0.001261 0.01% TagBoxArray::collate() 2 9.596e-05 0.0005851 0.001261 0.01% Castro::locWgtSum() 6 0.001124 0.001149 0.00117 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009084 0.0009356 0.001011 0.01% MLCellLinOp::setLevelBC() 19 0.0005333 0.0006642 0.0008509 0.01% Castro::swap_state_time_levels() 8 0.0006213 0.0006826 0.00072 0.00% makeSFC 95 0.000582 0.0006019 0.0006582 0.00% Castro::errorEst() 2 0.0005164 0.0005783 0.0006435 0.00% Castro::buildMetrics() 1 0.0005973 0.0006168 0.0006355 0.00% Castro::apply_tagging_restrictions() 2 0.0004142 0.0004769 0.0005411 0.00% Gravity::applyMetricTerms() 2 0.0004912 0.0005034 0.0005167 0.00% Castro::volProductSum() 2 0.000396 0.0004156 0.0004434 0.00% Castro::enforce_consistent_e() 1 0.0003716 0.0003822 0.0003909 0.00% Castro::finalize_do_advance() 17 0.0001744 0.0001926 0.0002438 0.00% DistributionMapping::Distribute() 95 0.0002084 0.0002187 0.0002277 0.00% OwnerMask() 2 0.0001336 0.0001483 0.0001606 0.00% DistributionMapping::KnapSackDoIt() 1 9.143e-05 0.0001132 0.0001306 0.00% Castro::enforce_speed_limit() 79 0.0001038 0.0001108 0.0001161 0.00% Castro::apply_problem_tags() 2 9.169e-05 9.508e-05 0.0001108 0.00% MultiFab::Swap() 5 6.523e-05 7.089e-05 9.761e-05 0.00% knapsack() 1 5.639e-05 5.896e-05 6.594e-05 0.00% Amr::initSubcycle() 1 5.553e-05 5.734e-05 5.894e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.715e-05 3.645e-05 4.417e-05 0.00% Castro::construct_old_rotation_source() 20 2.923e-05 3.102e-05 3.292e-05 0.00% Castro::construct_new_rotation_source() 17 2.18e-05 2.249e-05 2.348e-05 0.00% Gravity::set_mass_offset() 2 4.451e-06 7.64e-06 1.732e-05 0.00% Castro::computeInitialDt() 2 1.035e-05 1.211e-05 1.543e-05 0.00% Castro::estTimeStep() 10 1.301e-05 1.353e-05 1.526e-05 0.00% BoxList::parallelComplementIn() 4 1.281e-05 1.332e-05 1.394e-05 0.00% BoxList::complementIn 4 5.907e-06 6.149e-06 6.399e-06 0.00% Castro::gwstrain() 2 4.199e-06 4.848e-06 6.072e-06 0.00% Castro::FluxRegFineAdd() 1 1.406e-06 1.646e-06 3.081e-06 0.00% Castro::FluxRegCrseInit 1 1.765e-06 2.078e-06 2.848e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 12 B 15 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-21-g152fdac6aa4c) finalized