MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.10-13-gecaa14456e3f) initialized Starting run at 07:33:07 UTC on 2023-10-16. Successfully read inputs file ... Castro git describe: 23.10-36-g466e5a562 AMReX git describe: 23.10-13-gecaa14456 Microphysics git describe: 23.10-10-g8b2c4854 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.176720896 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.002317834 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.011610581 Gravity::multilevel_solve_for_new_phi() time = 0.101934296 Gravity::fill_multipole_BCs() time = 0.010274834 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.051708303 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.007357849 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.006175859 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.066761472 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.010278005 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.065944708 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.023713817 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.071327465 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.016622044 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.065172192 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326155807 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017617061 Gravity::solve_for_phi() time = 0.087912175 on level 0 Castro::construct_new_gravity() time = 0.090109401 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.065496213 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.009354322 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.065052383 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32468048 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017678255 Gravity::solve_for_phi() time = 0.089427884 on level 0 Castro::construct_new_gravity() time = 0.091632419 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.588335034e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.065298266 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.009179516 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.064992064 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330802631 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017685432 Gravity::solve_for_phi() time = 0.087866738 on level 0 Castro::construct_new_gravity() time = 0.089991883 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.587065898e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.065502324 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.009126034 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.065060327 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.373080695 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0184576 Gravity::solve_for_phi() time = 0.089164419 on level 0 Castro::construct_new_gravity() time = 0.091364373 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -9.059860097e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.065410718 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.009255576 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.065128072 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338924622 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017904989 Gravity::solve_for_phi() time = 0.088469786 on level 0 Castro::construct_new_gravity() time = 0.090597756 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -3.751920171e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.065682943 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.009296704 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.065113366 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333517745 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018135497 Gravity::solve_for_phi() time = 0.087943564 on level 0 Castro::construct_new_gravity() time = 0.090067554 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: -3.291489439e+24 zmom added: 0 eint added: 0 ener added: 5.968491079e+43 Castro::do_new_sources() time = 0.063764716 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.007929549 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.062918268 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333652126 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018137502 Gravity::solve_for_phi() time = 0.087885432 on level 0 Castro::construct_new_gravity() time = 0.090791997 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.291567233e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.063708808 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.008018268 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.063115496 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32917373 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018151356 Gravity::solve_for_phi() time = 0.087991185 on level 0 Castro::construct_new_gravity() time = 0.090177569 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: 6.776595903e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.063857743 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.008193381 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.064609342 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.339020711 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018531259 Gravity::solve_for_phi() time = 0.089195848 on level 0 Castro::construct_new_gravity() time = 0.091293159 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798245e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: 5.252452121e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.063826714 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.007823846 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.062826993 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332523251 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018537932 Gravity::solve_for_phi() time = 0.089725994 on level 0 Castro::construct_new_gravity() time = 0.091890667 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: -4.179294337e+24 zmom added: 0 eint added: 0 ener added: 2.123241033e+43 Castro::do_new_sources() time = 0.06402479 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.005612384 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.063045132 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.34646325 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01849876 Gravity::solve_for_phi() time = 0.090309375 on level 0 Castro::construct_new_gravity() time = 0.092438884 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 1.205384045e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.063702641 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.009227189 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.064504238 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33467355 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018455195 Gravity::solve_for_phi() time = 0.088145394 on level 0 Castro::construct_new_gravity() time = 0.09033963 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195608e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -3.296211805e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.063704676 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.007795911 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.062985528 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33414754 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018899731 Gravity::solve_for_phi() time = 0.089074726 on level 0 Castro::construct_new_gravity() time = 0.091289661 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -1.986935698e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.064039718 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.007607582 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.06306917 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330572439 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018908951 Gravity::solve_for_phi() time = 0.088549911 on level 0 Castro::construct_new_gravity() time = 0.090735253 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 2.991619167e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.063636522 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.00716971 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.063204561 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33487815 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.019064689 Gravity::solve_for_phi() time = 0.089549536 on level 0 Castro::construct_new_gravity() time = 0.091671864 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: -4.264296934e+24 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.063424806 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.008108619 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.063141382 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330549785 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.018913359 Gravity::solve_for_phi() time = 0.088842538 on level 0 Castro::construct_new_gravity() time = 0.09093986 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762635e+35 ymom added: 4.946678891e+24 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.063771899 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.007318263 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.063220712 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336745363 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.019364155 Gravity::solve_for_phi() time = 0.089333256 on level 0 Castro::construct_new_gravity() time = 0.091458055 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: -4.247768651e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.063722482 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002682044545 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.117748323e+27 ener added: 4.117748323e+27 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.160568787e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.471393084e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 7.282010032e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.55125627e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.2808053 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.050305608 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.007378377 seconds Ending run at 07:33:22 UTC on 2023-10-16. Run time = 14.76942203 Run time without initialization = 12.33935711 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.77 ... 14.77 ... 14.77 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.4623 5.5110 5.6160 38.02% Amr::InitAmr() 1 1.512 1.512 1.513 10.24% Castro::computeTemp() 80 0.855 0.9716 1.14 7.72% MultiFab::AddProduct() 3439 0.5552 0.5891 1.024 6.93% FabArray::ParallelCopy_finish() 1429 0.06648 0.6708 0.9668 6.55% amrex::Copy() 795 0.7849 0.7903 0.8015 5.43% Castro::normalize_species() 79 0.5481 0.5524 0.5645 3.82% Castro::reset_internal_energy(Fab) 160 0.5263 0.533 0.5393 3.65% MLPoisson::Fsmooth() 6144 0.317 0.3429 0.4146 2.81% Castro::initMFs() 1 0.3606 0.3635 0.3866 2.62% Castro::reset_internal_energy(MultiFab) 80 0.02253 0.09903 0.3788 2.56% FabArray::setVal() 5021 0.351 0.3553 0.3598 2.44% MultiFab::Subtract() 159 0.342 0.3442 0.3508 2.38% Gravity::fill_multipole_BCs() 19 0.1953 0.2751 0.3307 2.24% check_for_negative_density() 20 0.1069 0.2215 0.2686 1.82% FabArray::ParallelCopy_nowait() 1429 0.1885 0.2062 0.2502 1.69% Castro::enforce_min_density() 79 0.01755 0.06318 0.2287 1.55% FabArray::sum() 3439 0.1881 0.1894 0.1923 1.30% Castro::initData() 1 0.00333 0.02446 0.1454 0.98% FillBoundary_finish() 6388 0.07675 0.09891 0.1254 0.85% FillBoundary_nowait() 6388 0.07399 0.09878 0.1254 0.85% Castro::do_old_sources() 20 0.0005117 0.01504 0.1195 0.81% MLPoisson::Fapply() 994 0.09492 0.09919 0.1147 0.78% MLCellLinOp::applyBC() 7156 0.04704 0.06231 0.1054 0.71% FabArray::Saxpy() 192 0.06737 0.06902 0.0824 0.56% Castro::do_new_sources() 17 0.00038 0.01378 0.07434 0.50% Castro::construct_new_gravity_source() 17 0.07013 0.07076 0.07132 0.48% FabArray::Xpay() 953 0.05152 0.05409 0.06131 0.42% MultiFab::contains_nan() 37 0.04581 0.04619 0.04764 0.32% Castro::construct_old_gravity_source() 20 0.04662 0.04688 0.04719 0.32% MLMG::addInterpCorrection() 768 0.03385 0.03619 0.04285 0.29% AmrLevel::derive() 18 0.0409 0.0414 0.04197 0.28% StateData::FillBoundary(geom) 143 0 0.01801 0.03505 0.24% Castro::construct_old_gravity() 20 0.0003737 0.005759 0.03408 0.23% amrex::average_down 768 0.02527 0.02719 0.03286 0.22% VisMF::Write(FabArray) 4 0.01645 0.01836 0.03063 0.21% MLCGSolver::bicgstab 8 0 0.001356 0.02169 0.15% Amr::writePlotFile() 2 0.008666 0.01934 0.02084 0.14% Castro::wd_update() 2 0.006375 0.01492 0.01981 0.13% MLCellLinOp::defineAuxData() 19 0.01541 0.01611 0.01805 0.12% FabArray::FillBoundary() 6388 0.01425 0.01485 0.01768 0.12% Castro::construct_new_source() 102 0.01573 0.01581 0.01609 0.11% amrex::Add() 136 0.01424 0.01437 0.01476 0.10% Castro::evaluate_source_change() 196 0.01306 0.01347 0.01442 0.10% FabArray::norminf() 244 0.01085 0.01126 0.01402 0.09% MLCellLinOp::smooth() 3072 0.01196 0.01248 0.01357 0.09% FillPatchIterator::Initialize 147 0.01262 0.01292 0.01325 0.09% FabArrayBase::getFB() 6388 0.01011 0.01045 0.013 0.09% FabArray::setDomainBndry() 147 0.0004502 0.006166 0.0116 0.08% MLMG::prepareForSolve() 18 0.01047 0.01072 0.01112 0.08% Castro::construct_old_source() 120 0.00994 0.01011 0.01092 0.07% MultiFab::max() 2 0.0001451 0.007031 0.01071 0.07% Amr::writeSmallPlotFile() 2 0.007182 0.008805 0.009059 0.06% MLMG::ResNormInf() 146 0.004863 0.006811 0.008338 0.06% Gravity::actual_solve_with_mlmg() 19 0.007018 0.007283 0.008177 0.06% Castro::volWgtSum() 46 0.007215 0.007347 0.007926 0.05% FabArray::mult() 59 0.007145 0.007261 0.007922 0.05% FabArrayBase::getCPC() 2005 0.007471 0.007614 0.00792 0.05% MLLinOp::makeSubCommunicator() 19 0.0006068 0.004026 0.007705 0.05% Gravity::get_old_grav_vector() 20 0.00653 0.006702 0.007037 0.05% Castro::volInBoundary() 14 0.003364 0.003754 0.006871 0.05% FabArrayBase::CPC::define() 576 0.002293 0.003489 0.006687 0.05% Gravity::get_new_grav_vector() 18 0.00607 0.006179 0.006412 0.04% MLCellLinOp::compGrad() 18 0.005857 0.005976 0.006307 0.04% amrex::Dot() 142 0 0.0003902 0.006244 0.04% MLMG::solve() 18 0.0008828 0.002903 0.005388 0.04% MLCellLinOp::apply() 994 0.002146 0.002397 0.005354 0.04% Castro::initialize_do_advance() 20 0.004429 0.004856 0.005241 0.04% MLCGSolver::ParallelAllReduce 189 0 0.0002898 0.004636 0.03% FabArray::ParallelCopy() 1429 0.003704 0.003841 0.004103 0.03% FabArray::LinComb() 71 0 0.0002336 0.003737 0.03% BndryData::define() 19 0.003185 0.003258 0.003427 0.02% MLPoisson::normalize() 79 0 0.0001998 0.003197 0.02% Castro::sum_integrated_quantities() 2 0.001617 0.002494 0.002676 0.02% AmrLevel::FillPatch() 147 0.002164 0.002294 0.002471 0.02% MLCellLinOp::correctionResidual() 776 0.001911 0.001989 0.002462 0.02% TagBoxArray::collate() 2 5.589e-05 0.001066 0.002328 0.02% MLLinOp::defineGrids() 19 0.001869 0.001965 0.002269 0.02% MLCellLinOp::prepareForSolve() 19 0.001734 0.001861 0.002172 0.01% MLMG::mgVcycle() 128 0.001727 0.001783 0.001931 0.01% Castro::buildMetrics() 1 0.0005698 0.000663 0.001865 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001331 0.001596 0.001842 0.01% MLCellLinOp::defineBC() 19 0.001581 0.001614 0.001738 0.01% Castro::construct_new_gravity() 17 0.0002936 0.0008393 0.001704 0.01% Gravity::solve_for_phi() 17 0.0007939 0.001006 0.001664 0.01% MLMG:computeResOfCorrection() 768 0.001427 0.001487 0.001582 0.01% StateData::define() 6 0.001298 0.00142 0.001518 0.01% FabArrayBase::FB::FB() 75 0.0002863 0.0006992 0.001477 0.01% Castro::save_data_for_retry() 3 0.001236 0.001338 0.001426 0.01% AmrMesh::MakeNewGrids() 2 0.0004954 0.0005686 0.001399 0.01% main() 1 0.0009391 0.001188 0.001335 0.01% Castro::locWgtSum() 6 0.001126 0.001144 0.001164 0.01% MLMG::actualBottomSolve() 128 0.0001368 0.0002025 0.001145 0.01% StateDataPhysBCFunct::() 147 0.0006656 0.0008413 0.0009514 0.01% Castro::apply_tagging_restrictions() 2 0.0004092 0.000503 0.0008538 0.01% MLCellLinOp::setLevelBC() 19 0.0005433 0.0006833 0.0008526 0.01% FillPatchIterator::FillFromLevel0() 147 0.0007412 0.0007653 0.0007979 0.01% MLMG::mgVcycle_down::1 128 0.0006987 0.0007175 0.0007675 0.01% MLMG::mgVcycle_down::0 128 0.0006863 0.0007122 0.0007662 0.01% MLMG::mgVcycle_down::2 128 0.0006585 0.0007128 0.0007659 0.01% MLMG::mgVcycle_down::3 128 0.0006049 0.000659 0.0007614 0.01% MLMG::mgVcycle_down::5 128 0.0006107 0.0006342 0.0007411 0.01% Castro::subcycle_advance_ctu() 1 0.0001928 0.0002612 0.0007379 0.00% MLMG::mgVcycle_down::4 128 0.0005899 0.0006192 0.0007265 0.00% Castro::swap_state_time_levels() 8 0.0006231 0.0006908 0.0007215 0.00% Castro::Castro() 1 0.0004616 0.0005433 0.0006338 0.00% Castro::do_advance_ctu() 20 0.0004672 0.0005101 0.0005861 0.00% MLMG::mgVcycle_up::0 128 0.0005016 0.0005159 0.0005484 0.00% MLMG::mgVcycle_up::2 128 0.0004127 0.00046 0.0005387 0.00% Castro::clean_state() 79 0.0004592 0.0004953 0.0005339 0.00% MLMG::mgVcycle_up::1 128 0.0004886 0.0005124 0.0005305 0.00% FillPatchSingleLevel 147 0.0004783 0.0004992 0.0005301 0.00% makeSFC 95 0.0004034 0.0004306 0.000522 0.00% Gravity::applyMetricTerms() 2 0.0004821 0.0004901 0.0005019 0.00% MLMG::mgVcycle_up::5 128 0.0004206 0.000433 0.0004966 0.00% MLMG::mgVcycle_up::3 128 0.0004096 0.0004274 0.000489 0.00% MLCellLinOp::solutionResidual() 147 0.0004549 0.000464 0.000486 0.00% MLMG::mgVcycle_up::4 128 0.0004111 0.0004225 0.0004715 0.00% MLMG::oneIter() 128 0.0003981 0.0004078 0.0004318 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003496 0.0003672 0.0004245 0.00% Castro::volProductSum() 2 0.000391 0.0003978 0.0004138 0.00% Castro::problem_post_timestep() 2 1.131e-05 3.787e-05 0.0004109 0.00% Castro::enforce_consistent_e() 1 0.0003635 0.0003699 0.0004041 0.00% DistributionMapping::Distribute() 95 0.000221 0.0002407 0.0003398 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002374 0.0002478 0.0002695 0.00% MLMG::computeResidual() 128 0.0002444 0.0002513 0.0002579 0.00% MLMG::mgVcycle_bottom 128 0.0002333 0.0002387 0.000257 0.00% Castro::finalize_do_advance() 17 0.0001633 0.0001865 0.0002116 0.00% Gravity::update_max_rhs() 2 0.0001654 0.0001723 0.0001855 0.00% DistributionMapping::LeastUsedCPUs() 1 1.671e-05 0.0001596 0.0001717 0.00% OwnerMask() 2 0.0001342 0.000156 0.0001717 0.00% MLMG::compResidual() 1 0.0001537 0.0001559 0.0001632 0.00% Castro::initialize_advance() 1 0.0001214 0.0001406 0.0001584 0.00% Amr::defBaseLevel() 1 9.775e-05 0.0001399 0.000158 0.00% MLPoisson::define() 19 0.0001273 0.0001396 0.0001545 0.00% Amr::coarseTimeStep() 1 0.0001107 0.0001346 0.0001413 0.00% Castro::retry_advance_ctu() 11 5.276e-05 6.507e-05 0.0001386 0.00% Castro::enforce_speed_limit() 79 0.0001043 0.0001138 0.0001348 0.00% Castro::check_for_nan() 37 0.0001068 0.0001174 0.0001321 0.00% TagBoxArray::mapPRD 2 0.0001079 0.0001165 0.0001225 0.00% Amr::grid_places() 2 8.04e-05 9.079e-05 0.0001152 0.00% Castro::apply_source_to_state() 37 9.621e-05 0.0001042 0.0001111 0.00% Gravity::test_composite_phi() 1 9.302e-05 9.784e-05 0.0001105 0.00% MLLinOp::define() 19 7.972e-05 8.654e-05 0.000104 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.049e-05 7.177e-05 9.914e-05 0.00% Castro::apply_problem_tags() 2 9.17e-05 9.349e-05 9.554e-05 0.00% MLPoisson::prepareForSolve() 19 7.89e-05 8.41e-05 9.124e-05 0.00% MultiFab::Swap() 5 6.944e-05 7.346e-05 7.822e-05 0.00% Castro::create_source_corrector() 17 5.659e-05 6.666e-05 7.389e-05 0.00% Amr::initSubcycle() 1 5.702e-05 6.847e-05 7.251e-05 0.00% Castro::expand_state() 20 5.411e-05 6.216e-05 7e-05 0.00% knapsack() 1 5.882e-05 6.084e-05 6.469e-05 0.00% MLMG::computeMLResidual() 18 4.097e-05 4.584e-05 5.148e-05 0.00% Castro::derive() 18 4.217e-05 4.456e-05 4.797e-05 0.00% Amr::FinalizeInit() 1 8.855e-06 1.395e-05 4.782e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.482e-05 3.643e-05 4.723e-05 0.00% MLMG::getGradSolution() 18 4.07e-05 4.261e-05 4.63e-05 0.00% Gravity::swapTimeLevels() 8 3.576e-05 3.823e-05 4.309e-05 0.00% MLMG::MLResNormInf() 18 3.507e-05 3.727e-05 4.205e-05 0.00% MLMG::MLRhsNormInf() 18 3.245e-05 3.402e-05 4.144e-05 0.00% Castro::construct_old_rotation_source() 20 3.072e-05 3.141e-05 3.241e-05 0.00% Gravity::actual_multilevel_solve() 1 2.784e-05 2.933e-05 3.122e-05 0.00% Amr::regrid() 1 1.217e-05 1.39e-05 3.097e-05 0.00% Amr::timeStep() 1 1.277e-05 1.78e-05 3.087e-05 0.00% BoxList::parallelComplementIn() 4 7.173e-06 1.01e-05 2.398e-05 0.00% Castro::construct_new_rotation_source() 17 2.188e-05 2.256e-05 2.379e-05 0.00% Castro::finalize_advance() 1 1.664e-05 1.87e-05 2.272e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.643e-05 1.785e-05 2.013e-05 0.00% Castro::advance() 1 7.626e-06 9.258e-06 1.759e-05 0.00% Castro::estTimeStep() 10 1.271e-05 1.39e-05 1.659e-05 0.00% Castro::post_regrid() 2 1.119e-05 1.336e-05 1.512e-05 0.00% Castro::post_init() 1 1.267e-05 1.348e-05 1.461e-05 0.00% Amr::InitializeInit() 1 6.71e-06 8.392e-06 1.243e-05 0.00% Amr::bldFineLevels() 1 7.408e-06 9.004e-06 1.136e-05 0.00% Amr::init() 1 7.59e-06 8.406e-06 9.771e-06 0.00% Castro::computeInitialDt() 2 7.571e-06 8.275e-06 9.384e-06 0.00% BoxList::complementIn 4 6.262e-06 6.56e-06 8.381e-06 0.00% Castro::errorEst() 2 6.509e-06 6.963e-06 7.875e-06 0.00% Castro::gwstrain() 2 4.437e-06 5.04e-06 7.789e-06 0.00% Castro::post_timestep() 1 5.959e-06 6.484e-06 7.554e-06 0.00% Gravity::set_mass_offset() 2 4.263e-06 5.937e-06 7.458e-06 0.00% Castro::FluxRegCrseInit 1 1.676e-06 2.191e-06 3.959e-06 0.00% Amr::initialInit() 1 2.935e-06 3.22e-06 3.481e-06 0.00% Castro::FluxRegFineAdd() 1 1.434e-06 1.597e-06 1.886e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.77 14.77 14.77 100.00% Amr::coarseTimeStep() 1 12.34 12.34 12.34 83.54% Amr::timeStep() 1 12.28 12.28 12.28 83.15% Castro::advance() 1 12.21 12.21 12.22 82.72% Castro::subcycle_advance_ctu() 1 12.16 12.16 12.16 82.35% Castro::do_advance_ctu() 20 12.12 12.12 12.13 82.10% Castro::construct_ctu_hydro_source() 20 6.485 6.54 6.598 44.67% Castro::clean_state() 79 3.732 3.929 4.306 29.16% Castro::computeTemp() 80 2.411 2.577 2.92 19.77% Castro::reset_internal_energy(MultiFab) 80 1.509 1.605 1.872 12.67% Gravity::solve_phi_with_mlmg() 19 1.478 1.561 1.621 10.97% Castro::initialize_do_advance() 20 1.424 1.525 1.575 10.67% Castro::construct_new_gravity() 17 1.406 1.486 1.545 10.46% Amr::InitAmr() 1 1.512 1.512 1.513 10.24% Gravity::solve_for_phi() 17 1.367 1.449 1.509 10.21% Castro::evaluate_source_change() 196 0.9582 0.9941 1.428 9.67% Castro::do_old_sources() 20 1.253 1.263 1.288 8.72% Gravity::actual_solve_with_mlmg() 19 1.279 1.282 1.287 8.71% MLMG::solve() 18 1.227 1.231 1.233 8.35% FabArray::ParallelCopy() 1429 0.2907 0.9006 1.217 8.24% MLMG::oneIter() 128 1.097 1.099 1.1 7.45% Castro::do_new_sources() 17 0.9478 1.01 1.092 7.39% MLMG::mgVcycle() 128 1.083 1.084 1.085 7.35% MultiFab::AddProduct() 3439 0.5552 0.5891 1.024 6.93% Castro::enforce_min_density() 79 0.796 0.8578 1.011 6.85% FabArray::ParallelCopy_finish() 1429 0.06648 0.6708 0.9668 6.55% Amr::init() 1 0.9167 0.9169 0.917 6.21% AmrLevel::FillPatch() 147 0.486 0.7146 0.8986 6.08% Amr::initialInit() 1 0.8569 0.8571 0.8572 5.80% amrex::Copy() 795 0.7849 0.7903 0.8015 5.43% FillPatchIterator::Initialize 147 0.3065 0.5348 0.7196 4.87% MLCellLinOp::smooth() 3072 0.539 0.5862 0.7117 4.82% FillPatchIterator::FillFromLevel0() 147 0.2833 0.5157 0.7024 4.76% FillPatchSingleLevel 147 0.2825 0.515 0.7016 4.75% Amr::InitializeInit() 1 0.4461 0.5035 0.6209 4.20% Amr::defBaseLevel() 1 0.4461 0.5035 0.6209 4.20% Castro::normalize_species() 79 0.5481 0.5524 0.5645 3.82% Castro::reset_internal_energy(Fab) 160 0.5263 0.533 0.5393 3.65% MLMG::mgVcycle_up::1 128 0.09194 0.258 0.4247 2.88% MLPoisson::Fsmooth() 6144 0.317 0.3429 0.4146 2.81% Amr::FinalizeInit() 1 0.2361 0.3536 0.411 2.78% Castro::Castro() 1 0.3659 0.3695 0.3931 2.66% Castro::initMFs() 1 0.3608 0.3637 0.3867 2.62% MLMG::addInterpCorrection() 768 0.06262 0.3101 0.3772 2.55% FabArray::setVal() 5021 0.351 0.3553 0.3598 2.44% MLCellLinOp::applyBC() 7156 0.2581 0.286 0.3595 2.43% MultiFab::Subtract() 159 0.342 0.3442 0.3508 2.38% Gravity::fill_multipole_BCs() 19 0.1974 0.2772 0.3328 2.25% MLMG::mgVcycle_up::2 128 0.01123 0.1193 0.2848 1.93% Castro::expand_state() 20 0.1762 0.2254 0.2799 1.90% FabArray::ParallelCopy_nowait() 1429 0.2075 0.226 0.271 1.83% check_for_negative_density() 20 0.1069 0.2215 0.2686 1.82% MLMG::mgVcycle_down::0 128 0.256 0.2576 0.26 1.76% FabArray::FillBoundary() 6388 0.1992 0.2237 0.2578 1.75% Castro::initData() 1 0.07796 0.1321 0.2531 1.71% Amr::bldFineLevels() 1 0.04901 0.1665 0.2223 1.51% Castro::construct_old_gravity() 20 0.04687 0.08362 0.1952 1.32% MLCellLinOp::apply() 994 0.1458 0.155 0.1942 1.31% MLMG::mgVcycle_up::0 128 0.193 0.1935 0.1941 1.31% FabArray::sum() 3439 0.1881 0.1894 0.1923 1.30% MLMG::mgVcycle_up::3 128 0.01116 0.02472 0.1906 1.29% Amr::grid_places() 2 0.004196 0.1217 0.1791 1.21% AmrMesh::MakeNewGrids() 2 0.004114 0.1216 0.179 1.21% TagBoxArray::mapPRD 2 0.000728 0.1192 0.1775 1.20% Castro::create_source_corrector() 17 0.04763 0.1252 0.1666 1.13% Gravity::get_old_grav_vector() 20 0.0464 0.07787 0.1611 1.09% MLCellLinOp::correctionResidual() 776 0.11 0.1194 0.1461 0.99% Castro::post_init() 1 0.1354 0.1423 0.1459 0.99% MLMG:computeResOfCorrection() 768 0.1115 0.1206 0.1434 0.97% FillBoundary_nowait() 6388 0.08441 0.1099 0.1369 0.93% Castro::construct_new_source() 102 0.1249 0.1257 0.1304 0.88% FillBoundary_finish() 6388 0.07675 0.09891 0.1254 0.85% MLMG::mgVcycle_down::1 128 0.1093 0.1131 0.1157 0.78% MLPoisson::Fapply() 994 0.09492 0.09919 0.1147 0.78% Amr::writePlotFile() 2 0.1025 0.1026 0.1026 0.69% Gravity::multilevel_solve_for_new_phi() 1 0.1019 0.1019 0.102 0.69% Gravity::actual_multilevel_solve() 1 0.1018 0.1019 0.1019 0.69% Castro::post_regrid() 2 0.08596 0.08962 0.09647 0.65% MLCellLinOp::solutionResidual() 147 0.08642 0.0906 0.09506 0.64% MLMG::mgVcycle_bottom 128 0.0003703 0.005671 0.08509 0.58% MLMG::actualBottomSolve() 128 0.0001368 0.005433 0.08483 0.57% MLCGSolver::bicgstab 8 0 0.005201 0.08321 0.56% Castro::construct_old_source() 120 0.07925 0.0801 0.08266 0.56% FabArray::Saxpy() 192 0.06737 0.06902 0.0824 0.56% MLMG::computeResidual() 128 0.07493 0.07559 0.0775 0.52% Castro::derive() 18 0.06966 0.07034 0.07242 0.49% AmrLevel::derive() 18 0.06961 0.07029 0.07237 0.49% Castro::post_timestep() 1 0.06322 0.0681 0.07161 0.48% Castro::construct_new_gravity_source() 17 0.07013 0.07076 0.07132 0.48% MLMG::mgVcycle_down::2 128 0.01303 0.04012 0.06974 0.47% FabArray::Xpay() 953 0.05152 0.05409 0.06131 0.42% MLMG::mgVcycle_down::3 128 0.01237 0.01849 0.0595 0.40% Castro::initialize_advance() 1 0.04907 0.05115 0.05526 0.37% amrex::average_down 768 0.03372 0.03947 0.05432 0.37% Amr::regrid() 1 0.04546 0.04714 0.05074 0.34% Castro::check_for_nan() 37 0.04593 0.04631 0.04777 0.32% MultiFab::contains_nan() 37 0.04581 0.04619 0.04764 0.32% Castro::construct_old_gravity_source() 20 0.04662 0.04688 0.04719 0.32% MLPoisson::define() 19 0.02991 0.0344 0.04007 0.27% Castro::retry_advance_ctu() 11 0.03531 0.0362 0.03784 0.26% Gravity::get_new_grav_vector() 18 0.03502 0.03639 0.03766 0.25% StateDataPhysBCFunct::() 147 0.0006656 0.01885 0.036 0.24% MLMG::mgVcycle_down::4 128 0.0123 0.01399 0.03537 0.24% StateData::FillBoundary(geom) 143 0 0.01801 0.03505 0.24% Castro::apply_source_to_state() 37 0.02756 0.02818 0.03496 0.24% VisMF::Write(FabArray) 4 0.01645 0.01836 0.03063 0.21% MLMG::mgVcycle_up::4 128 0.01123 0.0124 0.02759 0.19% MLCellLinOp::defineAuxData() 19 0.01968 0.02119 0.02514 0.17% MLMG::prepareForSolve() 18 0.02097 0.02175 0.0238 0.16% MLMG::mgVcycle_down::5 128 0.0123 0.01319 0.02371 0.16% Castro::problem_post_timestep() 2 0.01055 0.01872 0.02329 0.16% Castro::wd_update() 2 0.0102 0.01868 0.02328 0.16% Castro::sum_integrated_quantities() 2 0.02141 0.02171 0.02173 0.15% MLMG::mgVcycle_up::5 128 0.01129 0.01201 0.02016 0.14% Castro::save_data_for_retry() 3 0.01883 0.01919 0.0195 0.13% MLMG::computeMLResidual() 18 0.01055 0.01458 0.01836 0.12% MLMG::ResNormInf() 146 0.01437 0.01648 0.0179 0.12% Amr::writeSmallPlotFile() 2 0.0151 0.01511 0.01512 0.10% amrex::Add() 136 0.01424 0.01437 0.01476 0.10% FabArrayBase::getCPC() 2005 0.009763 0.0111 0.01455 0.10% FabArrayBase::getFB() 6388 0.01042 0.01115 0.01448 0.10% FabArray::norminf() 244 0.01085 0.01126 0.01402 0.09% Gravity::test_composite_phi() 1 0.01377 0.01379 0.01383 0.09% Gravity::update_max_rhs() 2 0.001402 0.008279 0.01195 0.08% FabArray::setDomainBndry() 147 0.0004502 0.006166 0.0116 0.08% MLLinOp::define() 19 0.00367 0.007116 0.01118 0.08% MLLinOp::defineGrids() 19 0.003589 0.007029 0.01109 0.08% MultiFab::max() 2 0.0001451 0.007031 0.01071 0.07% MLMG::getGradSolution() 18 0.007451 0.007699 0.008071 0.05% MLCellLinOp::compGrad() 18 0.007409 0.007656 0.008027 0.05% MLCGSolver::ParallelAllReduce 189 0 0.0005 0.008 0.05% Castro::volWgtSum() 46 0.007215 0.007347 0.007926 0.05% FabArray::mult() 59 0.007145 0.007261 0.007922 0.05% MLLinOp::makeSubCommunicator() 19 0.0006068 0.004026 0.007705 0.05% Castro::volInBoundary() 14 0.003364 0.003754 0.006871 0.05% FabArrayBase::CPC::define() 576 0.002293 0.003489 0.006687 0.05% amrex::Dot() 142 0 0.0003902 0.006244 0.04% MLCellLinOp::defineBC() 19 0.005768 0.005956 0.006225 0.04% BndryData::define() 19 0.00409 0.004342 0.004568 0.03% FabArray::LinComb() 71 0 0.0002336 0.003737 0.03% MLPoisson::normalize() 79 0 0.0001998 0.003197 0.02% TagBoxArray::collate() 2 5.589e-05 0.001066 0.002328 0.02% MLPoisson::prepareForSolve() 19 0.001825 0.001945 0.002256 0.02% MLCellLinOp::prepareForSolve() 19 0.001734 0.001861 0.002172 0.01% Castro::buildMetrics() 1 0.0006308 0.0007249 0.001927 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001331 0.001596 0.001842 0.01% AmrLevel::AmrLevel(dm) 1 0.001333 0.001456 0.001554 0.01% StateData::define() 6 0.001298 0.00142 0.001518 0.01% FabArrayBase::FB::FB() 75 0.0002863 0.0006992 0.001477 0.01% MLMG::MLResNormInf() 18 0.001248 0.001269 0.001357 0.01% MLMG::MLRhsNormInf() 18 0.001214 0.001236 0.001332 0.01% Gravity::swapTimeLevels() 8 0.001153 0.001218 0.001304 0.01% MLMG::compResidual() 1 0.0009411 0.001088 0.001246 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009795 0.001039 0.001171 0.01% Castro::locWgtSum() 6 0.001126 0.001144 0.001164 0.01% Castro::errorEst() 2 0.0005077 0.0006035 0.0009569 0.01% Castro::apply_tagging_restrictions() 2 0.0004092 0.000503 0.0008538 0.01% MLCellLinOp::setLevelBC() 19 0.0005433 0.0006833 0.0008526 0.01% makeSFC 95 0.0006252 0.0006713 0.000779 0.01% Castro::swap_state_time_levels() 8 0.0006231 0.0006908 0.0007215 0.00% Gravity::applyMetricTerms() 2 0.0004821 0.0004901 0.0005019 0.00% Castro::volProductSum() 2 0.000391 0.0003978 0.0004138 0.00% Castro::enforce_consistent_e() 1 0.0003635 0.0003699 0.0004041 0.00% DistributionMapping::Distribute() 95 0.000221 0.0002407 0.0003398 0.00% Castro::finalize_advance() 1 0.0002561 0.000267 0.000291 0.00% DistributionMapping::KnapSackDoIt() 1 9.196e-05 0.0002383 0.0002554 0.00% Castro::finalize_do_advance() 17 0.0001727 0.0001969 0.0002217 0.00% DistributionMapping::LeastUsedCPUs() 1 1.671e-05 0.0001596 0.0001717 0.00% OwnerMask() 2 0.0001342 0.000156 0.0001717 0.00% Castro::enforce_speed_limit() 79 0.0001043 0.0001138 0.0001348 0.00% Castro::apply_problem_tags() 2 9.17e-05 9.349e-05 9.554e-05 0.00% MultiFab::Swap() 5 6.944e-05 7.346e-05 7.822e-05 0.00% Amr::initSubcycle() 1 5.702e-05 6.847e-05 7.251e-05 0.00% knapsack() 1 5.882e-05 6.084e-05 6.469e-05 0.00% Castro::construct_old_rotation_source() 20 3.072e-05 3.141e-05 3.241e-05 0.00% BoxList::parallelComplementIn() 4 1.35e-05 1.666e-05 3.045e-05 0.00% Castro::construct_new_rotation_source() 17 2.188e-05 2.256e-05 2.379e-05 0.00% Castro::estTimeStep() 10 1.271e-05 1.39e-05 1.659e-05 0.00% Castro::computeInitialDt() 2 1.086e-05 1.172e-05 1.293e-05 0.00% BoxList::complementIn 4 6.262e-06 6.56e-06 8.381e-06 0.00% Castro::gwstrain() 2 4.437e-06 5.04e-06 7.789e-06 0.00% Gravity::set_mass_offset() 2 4.263e-06 5.937e-06 7.458e-06 0.00% Castro::FluxRegCrseInit 1 1.676e-06 2.191e-06 3.959e-06 0.00% Castro::FluxRegFineAdd() 1 1.434e-06 1.597e-06 1.886e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 12 B 18 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-13-gecaa14456e3f) finalized