MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.10-8-gfd2dfa282a30) initialized Starting run at 22:26:51 UTC on 2023-10-06. Successfully read inputs file ... Castro git describe: 23.10-11-g778bb934c AMReX git describe: 23.10-8-gfd2dfa282 Microphysics git describe: 23.10-6-g657406dc reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.141912982 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001003838 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010503252 Gravity::multilevel_solve_for_new_phi() time = 0.102462118 Gravity::fill_multipole_BCs() time = 0.010555679 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.050035059 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004279706 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003212752 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.498822529e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.06583319 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005913977 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.249411264e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.065615257 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.00549232 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.624705632e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.061478781 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006868643 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.061866321 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327019938 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014293096 Gravity::solve_for_phi() time = 0.088521393 on level 0 Castro::construct_new_gravity() time = 0.090733193 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.586520465e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.062571093 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002734931 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060617165 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32580717 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014404691 Gravity::solve_for_phi() time = 0.090500031 on level 0 Castro::construct_new_gravity() time = 0.093678626 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.588335034e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.064923802 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.003769633 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.123528161e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060669239 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.347194176 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026526348 Gravity::solve_for_phi() time = 0.099848015 on level 0 Castro::construct_new_gravity() time = 0.103017616 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.587065898e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.068775448 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002872494 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060538495 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.355222062 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014816189 Gravity::solve_for_phi() time = 0.08818712 on level 0 Castro::construct_new_gravity() time = 0.090327418 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -9.059860097e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.062620337 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.013710346 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.489312105e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060751756 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.35723977 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.020018884 Gravity::solve_for_phi() time = 0.092609832 on level 0 Castro::construct_new_gravity() time = 0.094792924 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -3.751920171e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.062686614 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.004255733 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.072315991 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337428438 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014773089 Gravity::solve_for_phi() time = 0.110765526 on level 0 Castro::construct_new_gravity() time = 0.112902013 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: -3.291489439e+24 zmom added: 0 eint added: 0 ener added: 5.968491079e+43 Castro::do_new_sources() time = 0.062600895 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.881810984e+29 ener added: 1.881810984e+29 Castro::construct_old_gravity() time = 0.004662846 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.41450982e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.061198645 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.356631832 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015256887 Gravity::solve_for_phi() time = 0.09032632 on level 0 Castro::construct_new_gravity() time = 0.092386418 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.291567233e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.061725853 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003957825 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.06099564 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.362330819 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015167361 Gravity::solve_for_phi() time = 0.089688195 on level 0 Castro::construct_new_gravity() time = 0.092779144 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: 6.776595903e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.066331865 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.015991021 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.44246623e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.060541298 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.361626571 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015593017 Gravity::solve_for_phi() time = 0.091110988 on level 0 Castro::construct_new_gravity() time = 0.09328218 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798245e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: 5.252452121e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.061508416 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.005114832 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.076073186 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.34627117 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025325447 Gravity::solve_for_phi() time = 0.100144698 on level 0 Castro::construct_new_gravity() time = 0.102320237 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: -4.179294337e+24 zmom added: 0 eint added: 0 ener added: 2.123241033e+43 Castro::do_new_sources() time = 0.061560641 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00385213 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.540691453e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.06026155 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.343066171 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015387978 Gravity::solve_for_phi() time = 0.090192982 on level 0 Castro::construct_new_gravity() time = 0.093311314 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 1.205384045e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.061283626 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.002939472 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.061811249 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33844745 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015430954 Gravity::solve_for_phi() time = 0.09023023 on level 0 Castro::construct_new_gravity() time = 0.092362497 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195608e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -3.296211805e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.061730931 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.908356001e+29 ener added: 4.908356001e+29 Castro::construct_old_gravity() time = 0.003713818 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.586026171e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060417235 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.340406746 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015412001 Gravity::solve_for_phi() time = 0.091267533 on level 0 Castro::construct_new_gravity() time = 0.093414295 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -1.986935698e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.061503379 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.00447754 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.061106544 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.339523855 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015588028 Gravity::solve_for_phi() time = 0.088064088 on level 0 Castro::construct_new_gravity() time = 0.090211109 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 2.991619167e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.061953773 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.009461182e+29 ener added: 2.009461182e+29 Castro::construct_old_gravity() time = 0.002701099 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.502912521e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.060516662 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.340977182 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015422148 Gravity::solve_for_phi() time = 0.089987333 on level 0 Castro::construct_new_gravity() time = 0.092104436 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: -4.264296934e+24 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.061698155 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.003224032 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.060368846 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337873603 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015873802 Gravity::solve_for_phi() time = 0.093314724 on level 0 Castro::construct_new_gravity() time = 0.095436988 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762635e+35 ymom added: 4.946678891e+24 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.061559041 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.20728525e+29 ener added: 9.20728525e+29 Castro::construct_old_gravity() time = 0.003452372 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.435666022e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.060465052 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.344764713 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016017751 Gravity::solve_for_phi() time = 0.08935255 on level 0 Castro::construct_new_gravity() time = 0.091479798 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: -4.247768651e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.061661394 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002667691218 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.117748323e+27 ener added: 4.117748323e+27 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.160568787e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.471393084e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 7.282010032e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.55125627e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.34330562 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.049372099 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004331913 seconds Ending run at 22:27:06 UTC on 2023-10-06. Run time = 15.20651373 Run time without initialization = 12.39772393 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 15.21 ... 15.21 ... 15.21 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.4008 5.5448 5.7030 37.50% Amr::InitAmr() 1 1.924 1.924 1.924 12.66% Castro::computeTemp() 80 0.8446 0.977 1.157 7.61% amrex::Copy() 795 0.7785 0.7978 0.8384 5.51% FabArray::ParallelCopy_finish() 1429 0.05478 0.5584 0.77 5.06% MultiFab::AddProduct() 3439 0.557 0.5705 0.5955 3.92% Castro::normalize_species() 79 0.5438 0.5562 0.5711 3.76% Castro::reset_internal_energy(Fab) 160 0.524 0.5388 0.5648 3.71% check_for_negative_density() 20 0.1206 0.2879 0.4296 2.82% MLPoisson::Fsmooth() 6144 0.3159 0.3485 0.4251 2.80% Castro::initMFs() 1 0.3588 0.3665 0.3804 2.50% FabArray::setVal() 5021 0.3439 0.3537 0.3663 2.41% MultiFab::Subtract() 159 0.3345 0.3427 0.3548 2.33% Castro::reset_internal_energy(MultiFab) 80 0.02287 0.09946 0.3116 2.05% FabArray::sum() 3439 0.1849 0.1972 0.3092 2.03% Gravity::fill_multipole_BCs() 19 0.1978 0.2568 0.3023 1.99% FabArray::ParallelCopy_nowait() 1429 0.1884 0.2011 0.2233 1.47% FillBoundary_finish() 6388 0.1142 0.1609 0.1886 1.24% Castro::initData() 1 0.003331 0.02445 0.1421 0.93% FillBoundary_nowait() 6388 0.07525 0.1001 0.1302 0.86% MLPoisson::Fapply() 994 0.09331 0.09965 0.1188 0.78% Castro::enforce_min_density() 79 0.01733 0.04812 0.1185 0.78% MLCellLinOp::applyBC() 7156 0.04914 0.06288 0.1064 0.70% Castro::do_new_sources() 17 0.0003939 0.01583 0.08689 0.57% FabArray::Saxpy() 192 0.07044 0.0723 0.07761 0.51% Castro::construct_new_gravity_source() 17 0.0689 0.07098 0.07388 0.49% Castro::do_old_sources() 20 0.0005119 0.01275 0.06575 0.43% FabArray::Xpay() 953 0.05082 0.05462 0.06229 0.41% MultiFab::contains_nan() 37 0.04686 0.04821 0.05144 0.34% Castro::construct_old_gravity_source() 20 0.04526 0.04613 0.04739 0.31% AmrLevel::derive() 18 0.04108 0.04197 0.04433 0.29% MLMG::addInterpCorrection() 768 0.03352 0.03668 0.04429 0.29% StateData::FillBoundary(geom) 143 0 0.01787 0.03535 0.23% amrex::average_down 768 0.02512 0.02754 0.03389 0.22% VisMF::Write(FabArray) 4 0.01245 0.01394 0.02597 0.17% MLCGSolver::bicgstab 8 0 0.001428 0.02286 0.15% Castro::construct_old_gravity() 20 0.0003838 0.003683 0.02196 0.14% Amr::writePlotFile() 2 0.006673 0.01732 0.01943 0.13% TagBoxArray::collate() 2 0.0001226 0.002811 0.01839 0.12% FabArray::FillBoundary() 6388 0.01397 0.0149 0.01821 0.12% MLCellLinOp::defineAuxData() 19 0.015 0.01579 0.01818 0.12% MLMG::ResNormInf() 146 0.006342 0.0122 0.01794 0.12% Castro::construct_new_source() 102 0.01549 0.01594 0.01754 0.12% amrex::Add() 136 0.01416 0.01454 0.0157 0.10% Castro::evaluate_source_change() 196 0.01269 0.01332 0.0149 0.10% FabArray::norminf() 244 0.01099 0.01156 0.01461 0.10% MLCellLinOp::smooth() 3072 0.0115 0.01225 0.01415 0.09% FabArrayBase::getFB() 6388 0.01016 0.01077 0.01366 0.09% FillPatchIterator::Initialize 147 0.01216 0.0125 0.01282 0.08% FabArray::setDomainBndry() 147 0.0004697 0.006186 0.01212 0.08% Castro::construct_old_source() 120 0.009862 0.01021 0.01207 0.08% MLMG::prepareForSolve() 18 0.01035 0.01076 0.01148 0.08% Castro::wd_update() 2 0.004729 0.007983 0.0114 0.07% MLMG::solve() 18 0.00126 0.005762 0.009513 0.06% FabArray::mult() 59 0.00728 0.007565 0.009265 0.06% Castro::volWgtSum() 46 0.007369 0.007656 0.008584 0.06% Gravity::actual_solve_with_mlmg() 19 0.006892 0.007266 0.008308 0.05% FabArrayBase::getCPC() 2005 0.007249 0.007543 0.008045 0.05% MLLinOp::makeSubCommunicator() 19 0.0008088 0.004322 0.007994 0.05% Gravity::get_new_grav_vector() 18 0.005908 0.006203 0.007903 0.05% MLCellLinOp::compGrad() 18 0.005697 0.005916 0.007088 0.05% FabArrayBase::CPC::define() 576 0.002222 0.003434 0.006755 0.04% Gravity::get_old_grav_vector() 20 0.00634 0.006504 0.006664 0.04% amrex::Dot() 142 0 0.0003999 0.006398 0.04% Amr::writeSmallPlotFile() 2 0.003826 0.005479 0.005935 0.04% MLCellLinOp::apply() 994 0.002088 0.002387 0.005463 0.04% Castro::volInBoundary() 14 0.003378 0.003673 0.005374 0.04% Castro::construct_new_gravity() 17 0.0002931 0.001242 0.005284 0.03% MultiFab::max() 2 0.00016 0.002472 0.005192 0.03% MLCGSolver::ParallelAllReduce 189 0 0.0002982 0.004772 0.03% Castro::initialize_do_advance() 20 0.004255 0.004393 0.004666 0.03% Castro::sum_integrated_quantities() 2 0.002873 0.003915 0.004447 0.03% FabArray::ParallelCopy() 1429 0.003657 0.003881 0.004189 0.03% FabArray::LinComb() 71 0 0.0002422 0.003876 0.03% BndryData::define() 19 0.003142 0.003234 0.003414 0.02% MLPoisson::normalize() 79 0 0.0002028 0.003245 0.02% Gravity::solve_for_phi() 17 0.0008186 0.001258 0.002696 0.02% MLCellLinOp::correctionResidual() 776 0.001882 0.001993 0.002529 0.02% AmrLevel::FillPatch() 147 0.002146 0.002264 0.002507 0.02% MLLinOp::defineGrids() 19 0.001791 0.001938 0.002392 0.02% MLCellLinOp::prepareForSolve() 19 0.001691 0.001864 0.002251 0.01% MLMG::mgVcycle() 128 0.001662 0.001768 0.001972 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001359 0.001584 0.00187 0.01% MLCellLinOp::defineBC() 19 0.001564 0.001636 0.001839 0.01% MLMG:computeResOfCorrection() 768 0.001432 0.001497 0.001593 0.01% FabArrayBase::FB::FB() 75 0.0003023 0.0007063 0.001536 0.01% StateData::define() 6 0.001252 0.001328 0.001431 0.01% Castro::save_data_for_retry() 3 0.001245 0.001276 0.001304 0.01% MLMG::actualBottomSolve() 128 0.0001379 0.0002095 0.001199 0.01% Castro::locWgtSum() 6 0.001125 0.001151 0.001173 0.01% main() 1 0.000931 0.001114 0.001172 0.01% StateDataPhysBCFunct::() 147 0.0007024 0.0008259 0.001009 0.01% MLCellLinOp::setLevelBC() 19 0.0005484 0.000688 0.0008695 0.01% FillPatchIterator::FillFromLevel0() 147 0.0007362 0.0007782 0.000834 0.01% MLMG::mgVcycle_down::2 128 0.0006365 0.0007102 0.0008276 0.01% MLMG::mgVcycle_down::0 128 0.000688 0.0007159 0.0007843 0.01% MLMG::mgVcycle_down::3 128 0.0005962 0.0006593 0.0007813 0.01% MLMG::mgVcycle_down::1 128 0.0006818 0.0007102 0.0007737 0.01% MLMG::mgVcycle_down::4 128 0.0005831 0.0006201 0.0007356 0.00% MLMG::mgVcycle_down::5 128 0.0006006 0.000634 0.0007273 0.00% Castro::subcycle_advance_ctu() 1 0.000187 0.000235 0.0007185 0.00% Castro::buildMetrics() 1 0.0005752 0.0006087 0.0006583 0.00% Castro::clean_state() 79 0.0004435 0.0004833 0.0005597 0.00% MLMG::mgVcycle_up::1 128 0.0004706 0.0005045 0.0005495 0.00% Castro::do_advance_ctu() 20 0.0004388 0.0004771 0.0005481 0.00% MLMG::mgVcycle_up::0 128 0.0004782 0.0005007 0.0005442 0.00% AmrMesh::MakeNewGrids() 2 0.0005003 0.0005143 0.0005394 0.00% makeSFC 95 0.0003919 0.0004236 0.0005354 0.00% Castro::Castro() 1 0.0004625 0.0004928 0.0005342 0.00% MLMG::mgVcycle_up::2 128 0.0004023 0.0004535 0.0005245 0.00% Castro::apply_tagging_restrictions() 2 0.0004075 0.0004708 0.0005171 0.00% MLMG::mgVcycle_up::5 128 0.0004176 0.0004387 0.0005164 0.00% FillPatchSingleLevel 147 0.0004766 0.0004973 0.0005155 0.00% Gravity::applyMetricTerms() 2 0.0004798 0.0004923 0.0005046 0.00% MLMG::mgVcycle_up::3 128 0.000399 0.0004232 0.0004874 0.00% MLCellLinOp::solutionResidual() 147 0.0004353 0.0004552 0.000485 0.00% MLMG::mgVcycle_up::4 128 0.0004012 0.0004204 0.0004798 0.00% MLMG::oneIter() 128 0.0003935 0.0004094 0.0004491 0.00% Castro::swap_state_time_levels() 8 0.0004093 0.0004241 0.000442 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003392 0.0003571 0.0004179 0.00% Castro::volProductSum() 2 0.000389 0.0003976 0.0004086 0.00% Castro::enforce_consistent_e() 1 0.0003644 0.0003736 0.000408 0.00% Castro::problem_post_timestep() 2 1.08e-05 3.516e-05 0.0003819 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002301 0.0002497 0.0002882 0.00% DistributionMapping::Distribute() 95 0.0002108 0.0002255 0.000277 0.00% MLMG::mgVcycle_bottom 128 0.0002291 0.0002406 0.0002654 0.00% MLMG::computeResidual() 128 0.0002454 0.0002543 0.0002617 0.00% Castro::finalize_do_advance() 17 0.0001683 0.0001831 0.0002113 0.00% Gravity::update_max_rhs() 2 0.0001618 0.0001687 0.0001822 0.00% OwnerMask() 2 0.0001418 0.0001543 0.0001788 0.00% MLMG::compResidual() 1 0.0001562 0.00016 0.0001636 0.00% Amr::defBaseLevel() 1 8.814e-05 0.0001232 0.0001607 0.00% MLPoisson::define() 19 0.0001257 0.0001356 0.0001444 0.00% Castro::check_for_nan() 37 0.0001035 0.0001168 0.000143 0.00% Castro::retry_advance_ctu() 11 5.325e-05 6.12e-05 0.0001357 0.00% Amr::coarseTimeStep() 1 9.975e-05 0.0001247 0.0001282 0.00% Castro::enforce_speed_limit() 79 0.0001109 0.0001173 0.0001254 0.00% TagBoxArray::mapPRD 2 0.0001092 0.0001147 0.0001211 0.00% Gravity::test_composite_phi() 1 9.251e-05 9.851e-05 0.0001147 0.00% Castro::apply_source_to_state() 37 9.209e-05 0.0001009 0.0001095 0.00% Castro::initialize_advance() 1 9.854e-05 0.0001036 0.0001066 0.00% Castro::apply_problem_tags() 2 9.18e-05 9.445e-05 0.0001034 0.00% Amr::grid_places() 2 7.713e-05 8.248e-05 9.738e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.07e-05 7.205e-05 9.54e-05 0.00% MLPoisson::prepareForSolve() 19 7.68e-05 8.153e-05 9.343e-05 0.00% MLLinOp::define() 19 7.707e-05 8.199e-05 9.185e-05 0.00% Castro::create_source_corrector() 17 5.789e-05 6.586e-05 7.707e-05 0.00% knapsack() 1 5.67e-05 6.138e-05 7.558e-05 0.00% MultiFab::Swap() 5 7.039e-05 7.261e-05 7.529e-05 0.00% Castro::expand_state() 20 5.175e-05 5.699e-05 6.8e-05 0.00% Amr::initSubcycle() 1 5.647e-05 6.106e-05 6.566e-05 0.00% Gravity::swapTimeLevels() 8 3.213e-05 3.675e-05 5.797e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 2.452e-05 4.568e-05 5.707e-05 0.00% Amr::FinalizeInit() 1 8.617e-06 1.201e-05 5.135e-05 0.00% MLMG::computeMLResidual() 18 4.21e-05 4.404e-05 4.911e-05 0.00% Castro::derive() 18 4.21e-05 4.459e-05 4.777e-05 0.00% MLMG::getGradSolution() 18 4.073e-05 4.254e-05 4.428e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.153e-05 3.578e-05 4.063e-05 0.00% MLMG::MLResNormInf() 18 3.435e-05 3.591e-05 3.95e-05 0.00% MLMG::MLRhsNormInf() 18 3.152e-05 3.277e-05 3.391e-05 0.00% Castro::construct_old_rotation_source() 20 3.03e-05 3.124e-05 3.227e-05 0.00% Castro::estTimeStep() 10 1.255e-05 1.439e-05 3.081e-05 0.00% Gravity::actual_multilevel_solve() 1 2.712e-05 2.854e-05 3.042e-05 0.00% Amr::regrid() 1 1.234e-05 1.385e-05 2.919e-05 0.00% Castro::construct_new_rotation_source() 17 2.152e-05 2.252e-05 2.426e-05 0.00% Castro::finalize_advance() 1 1.655e-05 1.795e-05 2.052e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.622e-05 1.728e-05 1.963e-05 0.00% Amr::timeStep() 1 1.207e-05 1.304e-05 1.604e-05 0.00% Castro::post_init() 1 1.217e-05 1.313e-05 1.495e-05 0.00% Castro::post_regrid() 2 1.115e-05 1.176e-05 1.275e-05 0.00% Amr::InitializeInit() 1 7.069e-06 7.939e-06 1.154e-05 0.00% Castro::advance() 1 6.93e-06 7.631e-06 9.595e-06 0.00% Amr::init() 1 6.72e-06 7.633e-06 8.614e-06 0.00% Castro::errorEst() 2 6.348e-06 6.845e-06 8.614e-06 0.00% Castro::computeInitialDt() 2 7.216e-06 7.795e-06 8.419e-06 0.00% Amr::bldFineLevels() 1 7.173e-06 7.6e-06 8.387e-06 0.00% BoxList::parallelComplementIn() 4 7.016e-06 7.321e-06 7.78e-06 0.00% Amr::initialInit() 1 2.939e-06 3.427e-06 7.695e-06 0.00% Castro::post_timestep() 1 5.599e-06 6.24e-06 7.267e-06 0.00% BoxList::complementIn 4 6.137e-06 6.392e-06 6.944e-06 0.00% Castro::gwstrain() 2 4.528e-06 4.99e-06 6.478e-06 0.00% Gravity::set_mass_offset() 2 4.362e-06 4.741e-06 5.238e-06 0.00% Castro::FluxRegCrseInit 1 1.645e-06 1.875e-06 2.122e-06 0.00% Castro::FluxRegFineAdd() 1 1.455e-06 1.563e-06 1.832e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 15.21 15.21 15.21 100.00% Amr::coarseTimeStep() 1 12.4 12.4 12.4 81.53% Amr::timeStep() 1 12.34 12.34 12.34 81.17% Castro::advance() 1 12.28 12.28 12.28 80.78% Castro::subcycle_advance_ctu() 1 12.23 12.23 12.23 80.44% Castro::do_advance_ctu() 20 12.19 12.19 12.2 80.20% Castro::construct_ctu_hydro_source() 20 6.611 6.644 6.685 43.96% Castro::clean_state() 79 3.756 3.924 4.149 27.28% Castro::computeTemp() 80 2.447 2.588 2.842 18.69% Amr::InitAmr() 1 1.924 1.924 1.925 12.66% Castro::reset_internal_energy(MultiFab) 80 1.504 1.611 1.785 11.74% Gravity::solve_phi_with_mlmg() 19 1.576 1.637 1.685 11.08% Castro::construct_new_gravity() 17 1.505 1.564 1.612 10.60% Gravity::solve_for_phi() 17 1.464 1.524 1.571 10.33% Castro::initialize_do_advance() 20 1.415 1.463 1.503 9.89% Gravity::actual_solve_with_mlmg() 19 1.373 1.377 1.382 9.09% MLMG::solve() 18 1.321 1.326 1.327 8.73% Castro::do_old_sources() 20 1.215 1.232 1.248 8.20% MLMG::oneIter() 128 1.171 1.177 1.182 7.78% MLMG::mgVcycle() 128 1.156 1.162 1.166 7.67% Castro::evaluate_source_change() 196 0.9522 0.9833 1.102 7.25% Castro::do_new_sources() 17 0.968 1.014 1.067 7.02% FabArray::ParallelCopy() 1429 0.2825 0.7835 0.9977 6.56% Castro::enforce_min_density() 79 0.7915 0.8391 0.8881 5.84% Amr::init() 1 0.8838 0.8838 0.8838 5.81% amrex::Copy() 795 0.7785 0.7978 0.8384 5.51% Amr::initialInit() 1 0.8286 0.8286 0.8288 5.45% MLCellLinOp::smooth() 3072 0.59 0.6432 0.7743 5.09% FabArray::ParallelCopy_finish() 1429 0.05478 0.5584 0.77 5.06% AmrLevel::FillPatch() 147 0.4813 0.6127 0.7051 4.64% Amr::InitializeInit() 1 0.4576 0.5069 0.5977 3.93% Amr::defBaseLevel() 1 0.4576 0.5069 0.5977 3.93% MultiFab::AddProduct() 3439 0.557 0.5705 0.5955 3.92% Castro::normalize_species() 79 0.5438 0.5562 0.5711 3.76% Castro::reset_internal_energy(Fab) 160 0.524 0.5388 0.5648 3.71% FillPatchIterator::Initialize 147 0.2988 0.4324 0.5278 3.47% FillPatchIterator::FillFromLevel0() 147 0.2744 0.4138 0.5115 3.36% FillPatchSingleLevel 147 0.2736 0.413 0.5107 3.36% MLMG::mgVcycle_up::1 128 0.1037 0.2817 0.4587 3.02% check_for_negative_density() 20 0.1206 0.2879 0.4296 2.82% MLPoisson::Fsmooth() 6144 0.3159 0.3485 0.4251 2.80% MLCellLinOp::applyBC() 7156 0.3014 0.3503 0.4217 2.77% MLMG::addInterpCorrection() 768 0.06525 0.3243 0.3993 2.63% Castro::Castro() 1 0.3641 0.3719 0.3871 2.55% Castro::initMFs() 1 0.359 0.3667 0.3806 2.50% Amr::FinalizeInit() 1 0.2309 0.3217 0.371 2.44% FabArray::setVal() 5021 0.3439 0.3537 0.3663 2.41% MultiFab::Subtract() 159 0.3345 0.3427 0.3548 2.33% FabArray::FillBoundary() 6388 0.2502 0.2874 0.3211 2.11% FabArray::sum() 3439 0.1849 0.1972 0.3092 2.03% Gravity::fill_multipole_BCs() 19 0.2 0.2589 0.3045 2.00% MLMG::mgVcycle_up::2 128 0.01102 0.1243 0.2995 1.97% MLMG::mgVcycle_down::0 128 0.2698 0.2749 0.2785 1.83% FabArray::ParallelCopy_nowait() 1429 0.2076 0.2212 0.2445 1.61% Castro::initData() 1 0.08029 0.1334 0.2316 1.52% Castro::expand_state() 20 0.1757 0.198 0.2284 1.50% MLMG::mgVcycle_up::0 128 0.2094 0.2127 0.216 1.42% MLCellLinOp::apply() 994 0.1552 0.1681 0.2088 1.37% MLMG::mgVcycle_up::3 128 0.01099 0.02512 0.196 1.29% FillBoundary_finish() 6388 0.1142 0.1609 0.1886 1.24% Amr::bldFineLevels() 1 0.04741 0.1382 0.1873 1.23% MLCellLinOp::correctionResidual() 776 0.1132 0.1249 0.1542 1.01% MLMG:computeResOfCorrection() 768 0.1147 0.1261 0.1514 1.00% Amr::grid_places() 2 0.002856 0.09367 0.1429 0.94% AmrMesh::MakeNewGrids() 2 0.002771 0.09359 0.1429 0.94% FillBoundary_nowait() 6388 0.08602 0.1115 0.1424 0.94% Castro::post_init() 1 0.1365 0.1388 0.1415 0.93% TagBoxArray::mapPRD 2 0.0006353 0.08952 0.1404 0.92% Castro::create_source_corrector() 17 0.04856 0.09564 0.1393 0.92% Castro::construct_new_source() 102 0.1241 0.1274 0.1331 0.88% MLMG::mgVcycle_down::1 128 0.1188 0.123 0.1311 0.86% MLPoisson::Fapply() 994 0.09331 0.09965 0.1188 0.78% MLCellLinOp::solutionResidual() 147 0.09371 0.09868 0.106 0.70% Gravity::multilevel_solve_for_new_phi() 1 0.1024 0.1024 0.1025 0.67% Gravity::actual_multilevel_solve() 1 0.1023 0.1024 0.1024 0.67% Amr::writePlotFile() 2 0.09992 0.1 0.1 0.66% Castro::post_regrid() 2 0.08651 0.08924 0.09151 0.60% Castro::construct_old_gravity() 20 0.04556 0.06216 0.09107 0.60% MLMG::mgVcycle_bottom 128 0.000367 0.00585 0.08786 0.58% MLMG::actualBottomSolve() 128 0.0001379 0.005609 0.08759 0.58% MLCGSolver::bicgstab 8 0 0.005368 0.08589 0.56% MLMG::computeResidual() 128 0.07894 0.08113 0.08413 0.55% Castro::construct_old_source() 120 0.07847 0.08012 0.08175 0.54% Gravity::get_old_grav_vector() 20 0.04238 0.05848 0.08017 0.53% FabArray::Saxpy() 192 0.07044 0.0723 0.07761 0.51% Castro::derive() 18 0.06993 0.07132 0.07536 0.50% AmrLevel::derive() 18 0.06989 0.07127 0.07531 0.50% MLMG::mgVcycle_down::2 128 0.01289 0.04173 0.07398 0.49% Castro::construct_new_gravity_source() 17 0.0689 0.07098 0.07388 0.49% Castro::post_timestep() 1 0.05999 0.06234 0.06479 0.43% FabArray::Xpay() 953 0.05082 0.05462 0.06229 0.41% MLMG::mgVcycle_down::3 128 0.0122 0.01873 0.06104 0.40% amrex::average_down 768 0.0334 0.04041 0.05714 0.38% Castro::check_for_nan() 37 0.04697 0.04833 0.05156 0.34% Castro::initialize_advance() 1 0.04927 0.05036 0.05154 0.34% MultiFab::contains_nan() 37 0.04686 0.04821 0.05144 0.34% Castro::construct_old_gravity_source() 20 0.04526 0.04613 0.04739 0.31% Amr::regrid() 1 0.04427 0.04557 0.04681 0.31% Gravity::get_new_grav_vector() 18 0.03484 0.0385 0.04082 0.27% MLPoisson::define() 19 0.02934 0.03419 0.04045 0.27% Castro::retry_advance_ctu() 11 0.03515 0.03627 0.03927 0.26% StateDataPhysBCFunct::() 147 0.0007024 0.0187 0.03628 0.24% MLMG::mgVcycle_down::4 128 0.01217 0.01411 0.0362 0.24% StateData::FillBoundary(geom) 143 0 0.01787 0.03535 0.23% Castro::apply_source_to_state() 37 0.02867 0.0294 0.03141 0.21% MLMG::mgVcycle_up::4 128 0.01106 0.01244 0.02829 0.19% MLMG::ResNormInf() 146 0.01685 0.02214 0.0276 0.18% VisMF::Write(FabArray) 4 0.01245 0.01394 0.02597 0.17% MLCellLinOp::defineAuxData() 19 0.01918 0.02075 0.02523 0.17% MLMG::prepareForSolve() 18 0.02067 0.02187 0.02454 0.16% MLMG::mgVcycle_down::5 128 0.01217 0.01332 0.02416 0.16% Castro::sum_integrated_quantities() 2 0.02321 0.02346 0.0235 0.15% MLMG::computeMLResidual() 18 0.01165 0.01683 0.02286 0.15% Castro::save_data_for_retry() 3 0.01862 0.0194 0.02236 0.15% MLMG::mgVcycle_up::5 128 0.01115 0.01208 0.02069 0.14% TagBoxArray::collate() 2 0.0001226 0.002811 0.01839 0.12% amrex::Add() 136 0.01416 0.01454 0.0157 0.10% FabArrayBase::getFB() 6388 0.01048 0.01148 0.01519 0.10% Castro::problem_post_timestep() 2 0.009241 0.01169 0.01479 0.10% Castro::wd_update() 2 0.008859 0.01166 0.01478 0.10% FabArrayBase::getCPC() 2005 0.009589 0.01098 0.01474 0.10% FabArray::norminf() 244 0.01099 0.01156 0.01461 0.10% Gravity::test_composite_phi() 1 0.01442 0.01445 0.01448 0.10% FabArray::setDomainBndry() 147 0.0004697 0.006186 0.01212 0.08% MLLinOp::define() 19 0.004056 0.007348 0.01136 0.07% MLLinOp::defineGrids() 19 0.003974 0.007266 0.01127 0.07% FabArray::mult() 59 0.00728 0.007565 0.009265 0.06% Amr::writeSmallPlotFile() 2 0.008998 0.009 0.009001 0.06% MLMG::getGradSolution() 18 0.007306 0.007668 0.008959 0.06% MLCellLinOp::compGrad() 18 0.007264 0.007626 0.008917 0.06% Castro::volWgtSum() 46 0.007369 0.007656 0.008584 0.06% MLCGSolver::ParallelAllReduce 189 0 0.000516 0.008257 0.05% MLLinOp::makeSubCommunicator() 19 0.0008088 0.004322 0.007994 0.05% FabArrayBase::CPC::define() 576 0.002222 0.003434 0.006755 0.04% Gravity::update_max_rhs() 2 0.001435 0.003731 0.006451 0.04% amrex::Dot() 142 0 0.0003999 0.006398 0.04% MLCellLinOp::defineBC() 19 0.005662 0.005952 0.00623 0.04% Castro::volInBoundary() 14 0.003378 0.003673 0.005374 0.04% MultiFab::max() 2 0.00016 0.002472 0.005192 0.03% BndryData::define() 19 0.004094 0.004316 0.004533 0.03% FabArray::LinComb() 71 0 0.0002422 0.003876 0.03% MLPoisson::normalize() 79 0 0.0002028 0.003245 0.02% MLPoisson::prepareForSolve() 19 0.001778 0.001945 0.002335 0.02% MLCellLinOp::prepareForSolve() 19 0.001691 0.001864 0.002251 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001359 0.001584 0.00187 0.01% MLMG::compResidual() 1 0.0009404 0.001384 0.001625 0.01% FabArrayBase::FB::FB() 75 0.0003023 0.0007063 0.001536 0.01% AmrLevel::AmrLevel(dm) 1 0.001286 0.001363 0.001471 0.01% StateData::define() 6 0.001252 0.001328 0.001431 0.01% MLMG::MLResNormInf() 18 0.00126 0.001291 0.001326 0.01% MLMG::MLRhsNormInf() 18 0.001208 0.001238 0.001266 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009443 0.001006 0.00123 0.01% Gravity::swapTimeLevels() 8 0.00113 0.001167 0.00122 0.01% Castro::locWgtSum() 6 0.001125 0.001151 0.001173 0.01% MLCellLinOp::setLevelBC() 19 0.0005484 0.000688 0.0008695 0.01% makeSFC 95 0.0006042 0.0006491 0.0008125 0.01% Castro::buildMetrics() 1 0.0006361 0.0006707 0.0007214 0.00% Castro::errorEst() 2 0.0005065 0.0005721 0.0006171 0.00% Castro::apply_tagging_restrictions() 2 0.0004075 0.0004708 0.0005171 0.00% Gravity::applyMetricTerms() 2 0.0004798 0.0004923 0.0005046 0.00% Castro::swap_state_time_levels() 8 0.0004093 0.0004241 0.000442 0.00% Castro::volProductSum() 2 0.000389 0.0003976 0.0004086 0.00% Castro::enforce_consistent_e() 1 0.0003644 0.0003736 0.000408 0.00% DistributionMapping::Distribute() 95 0.0002108 0.0002255 0.000277 0.00% Castro::finalize_advance() 1 0.0002563 0.0002624 0.0002678 0.00% Castro::finalize_do_advance() 17 0.0001789 0.0001931 0.0002214 0.00% OwnerMask() 2 0.0001418 0.0001543 0.0001788 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001018 0.0001243 0.0001402 0.00% Castro::enforce_speed_limit() 79 0.0001109 0.0001173 0.0001254 0.00% Castro::apply_problem_tags() 2 9.18e-05 9.445e-05 0.0001034 0.00% knapsack() 1 5.67e-05 6.138e-05 7.558e-05 0.00% MultiFab::Swap() 5 7.039e-05 7.261e-05 7.529e-05 0.00% Amr::initSubcycle() 1 5.647e-05 6.106e-05 6.566e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 2.452e-05 4.568e-05 5.707e-05 0.00% Castro::construct_old_rotation_source() 20 3.03e-05 3.124e-05 3.227e-05 0.00% Castro::estTimeStep() 10 1.255e-05 1.439e-05 3.081e-05 0.00% Castro::computeInitialDt() 2 1.033e-05 1.21e-05 2.724e-05 0.00% Castro::construct_new_rotation_source() 17 2.152e-05 2.252e-05 2.426e-05 0.00% BoxList::parallelComplementIn() 4 1.315e-05 1.371e-05 1.472e-05 0.00% BoxList::complementIn 4 6.137e-06 6.392e-06 6.944e-06 0.00% Castro::gwstrain() 2 4.528e-06 4.99e-06 6.478e-06 0.00% Gravity::set_mass_offset() 2 4.362e-06 4.741e-06 5.238e-06 0.00% Castro::FluxRegCrseInit 1 1.645e-06 1.875e-06 2.122e-06 0.00% Castro::FluxRegFineAdd() 1 1.455e-06 1.563e-06 1.832e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 12 B 14 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-8-gfd2dfa282a30) finalized