Initializing AMReX (23.12-24-g75571e2dcbf2)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.12-24-g75571e2dcbf2) initialized Starting run at 08:11:58 UTC on 2023-12-28. Successfully read inputs file ... Castro git describe: 23.12-18-gc3509d44c AMReX git describe: 23.12-24-g75571e2dc Microphysics git describe: 23.12-13-ga38a1eea reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.171283931 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000975352 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010439721 Gravity::multilevel_solve_for_new_phi() time = 0.099768303 Gravity::fill_multipole_BCs() time = 0.010512944 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049603031 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.007082014 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003581989 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065428976 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.008678652 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.063190458 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005710515 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.061122234 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.006909952 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060343513 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332265808 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015390584 Gravity::solve_for_phi() time = 0.086994474 on level 0 Castro::construct_new_gravity() time = 0.089146035 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.061197952 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002945512 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060388035 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331522324 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015588465 Gravity::solve_for_phi() time = 0.089460603 on level 0 Castro::construct_new_gravity() time = 0.0915034 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.061052332 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002648182 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060219629 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331892116 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015244151 Gravity::solve_for_phi() time = 0.08926773 on level 0 Castro::construct_new_gravity() time = 0.091317861 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.060581691 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003551953 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060282429 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333985219 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016057209 Gravity::solve_for_phi() time = 0.085488437 on level 0 Castro::construct_new_gravity() time = 0.087639229 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.061248288 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002695006 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060014413 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337362899 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015981535 Gravity::solve_for_phi() time = 0.088711269 on level 0 Castro::construct_new_gravity() time = 0.09076388 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060615342 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003393322 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.061069487 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335542535 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016106056 Gravity::solve_for_phi() time = 0.089308577 on level 0 Castro::construct_new_gravity() time = 0.091398682 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.061140164 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002672205 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.061098013 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3402312 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016061019 Gravity::solve_for_phi() time = 0.090249814 on level 0 Castro::construct_new_gravity() time = 0.092711614 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.061665688 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002678937 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.060166724 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336132572 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016330612 Gravity::solve_for_phi() time = 0.08921807 on level 0 Castro::construct_new_gravity() time = 0.091360824 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.060782446 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002699382 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.060071616 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.343518562 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016464404 Gravity::solve_for_phi() time = 0.090454446 on level 0 Castro::construct_new_gravity() time = 0.092500572 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.06102298 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002584253 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.061241689 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332837718 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016519243 Gravity::solve_for_phi() time = 0.090265154 on level 0 Castro::construct_new_gravity() time = 0.092321568 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.061090911 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003162999 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.060835941 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338800009 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016490174 Gravity::solve_for_phi() time = 0.090452654 on level 0 Castro::construct_new_gravity() time = 0.092514136 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.061051755 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002605096 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060160196 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337428519 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016828522 Gravity::solve_for_phi() time = 0.087886435 on level 0 Castro::construct_new_gravity() time = 0.089945921 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.06238858 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002686112 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060214132 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.341210322 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016348814 Gravity::solve_for_phi() time = 0.08881248 on level 0 Castro::construct_new_gravity() time = 0.090971618 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.061134217 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002692064 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.061115649 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.34234268 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016480064 Gravity::solve_for_phi() time = 0.087223843 on level 0 Castro::construct_new_gravity() time = 0.08928855 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.061039534 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003180121 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.05989745 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.342066503 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016728312 Gravity::solve_for_phi() time = 0.088099622 on level 0 Castro::construct_new_gravity() time = 0.091268569 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.060918259 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002629997 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.061166276 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.338163509 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017122919 Gravity::solve_for_phi() time = 0.089971417 on level 0 Castro::construct_new_gravity() time = 0.092071442 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.061025641 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.003864339 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.060124926 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.347633823 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01699261 Gravity::solve_for_phi() time = 0.091089759 on level 0 Castro::construct_new_gravity() time = 0.093168499 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.061229287 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002727429787 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.07479021 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.050829242 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.006771425 seconds Ending run at 08:12:12 UTC on 2023-12-28. Run time = 14.37783332 Run time without initialization = 12.13325157 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.38 ... 14.38 ... 14.38 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.4320 5.5353 5.6423 39.24% Amr::InitAmr() 1 1.341 1.341 1.341 9.33% Castro::computeTemp() 80 0.8415 0.9699 1.145 7.97% amrex::Copy() 724 0.7716 0.7861 0.8155 5.67% FabArray::ParallelCopy_finish() 1429 0.04711 0.5104 0.7007 4.87% MultiFab::AddProduct() 3439 0.5509 0.5617 0.5757 4.00% Castro::normalize_species() 79 0.5396 0.5508 0.5715 3.97% Castro::reset_internal_energy(Fab) 160 0.5227 0.5348 0.5533 3.85% MLPoisson::Fsmooth() 6144 0.3131 0.3447 0.421 2.93% Castro::initMFs() 1 0.3607 0.3657 0.3858 2.68% FabArray::setVal() 5013 0.3584 0.3643 0.373 2.59% MultiFab::Subtract() 159 0.3423 0.349 0.3578 2.49% check_for_negative_density() 20 0.1029 0.2113 0.3224 2.24% Gravity::fill_multipole_BCs() 19 0.1976 0.2419 0.2856 1.99% Castro::reset_internal_energy(MultiFab) 80 0.02276 0.08216 0.2236 1.55% FabArray::ParallelCopy_nowait() 1429 0.1892 0.2045 0.2216 1.54% FabArray::sum() 3439 0.1833 0.1871 0.1917 1.33% FillBoundary_finish() 6380 0.113 0.1422 0.1734 1.21% Castro::initData() 1 0.003363 0.02717 0.1588 1.10% MLPoisson::Fapply() 986 0.09497 0.1018 0.1229 0.85% FillBoundary_nowait() 6380 0.07133 0.09494 0.1211 0.84% MLCellLinOp::applyBC() 7148 0.0506 0.06186 0.1035 0.72% Castro::enforce_min_density() 79 0.01779 0.03416 0.09243 0.64% Castro::do_new_sources() 17 0.0003275 0.0128 0.0788 0.55% FabArray::Saxpy() 264 0.06791 0.06964 0.07741 0.54% Castro::construct_new_gravity_source() 17 0.06942 0.07066 0.07318 0.51% FabArray::Xpay() 945 0.05222 0.05539 0.063 0.44% MultiFab::contains_nan() 37 0.04409 0.04494 0.04814 0.33% Castro::construct_old_gravity_source() 20 0.04542 0.04637 0.04805 0.33% MLMG::addInterpCorrection() 768 0.03298 0.03592 0.04292 0.30% AmrLevel::derive() 18 0.04099 0.0418 0.04251 0.30% Castro::do_old_sources() 20 0.0004497 0.00848 0.04018 0.28% StateData::FillBoundary(geom) 143 0 0.01802 0.03508 0.24% amrex::average_down 768 0.024 0.02628 0.0323 0.22% VisMF::Write(FabArray) 4 0.01615 0.01769 0.02795 0.19% MLMG::ResNormInf() 146 0.004912 0.01668 0.02402 0.17% Amr::writePlotFile() 2 0.008313 0.0175 0.01867 0.13% MLCellLinOp::defineAuxData() 19 0.01427 0.01498 0.01683 0.12% FabArray::FillBoundary() 6380 0.01328 0.01398 0.01676 0.12% Castro::construct_new_source() 102 0.01544 0.01578 0.01673 0.12% MLCGSolver::bicgstab 8 0 0.001011 0.01618 0.11% FabArray::norminf() 282 0.01095 0.01157 0.01586 0.11% amrex::Add() 128 0.01377 0.01413 0.01561 0.11% Castro::wd_update() 2 0.006211 0.009841 0.01418 0.10% Castro::evaluate_source_change() 196 0.01245 0.01272 0.01345 0.09% FillPatchIterator::Initialize 147 0.01258 0.01285 0.01311 0.09% FabArrayBase::getFB() 6380 0.009824 0.01027 0.01279 0.09% Castro::construct_old_gravity() 20 0.0003297 0.003373 0.01277 0.09% MLCellLinOp::smooth() 3072 0.01088 0.01143 0.01238 0.09% FabArray::setDomainBndry() 147 0.0004368 0.005983 0.01123 0.08% MLMG::prepareForSolve() 18 0.009922 0.01013 0.01065 0.07% Castro::construct_old_source() 120 0.009764 0.009967 0.01054 0.07% MLMG::solve() 18 0.00304 0.005156 0.009283 0.06% Amr::writeSmallPlotFile() 2 0.006802 0.008445 0.008914 0.06% FabArray::mult() 59 0.007063 0.007293 0.008043 0.06% Castro::volWgtSum() 46 0.007408 0.007565 0.00797 0.06% Gravity::actual_solve_with_mlmg() 19 0.006605 0.006884 0.007734 0.05% FabArrayBase::getCPC() 2005 0.007185 0.00729 0.007507 0.05% MLLinOp::makeSubCommunicator() 19 0.000774 0.003834 0.007466 0.05% Gravity::get_old_grav_vector() 20 0.006566 0.006649 0.007109 0.05% Gravity::get_new_grav_vector() 18 0.006069 0.006212 0.006636 0.05% FabArrayBase::CPC::define() 576 0.002167 0.003296 0.006316 0.04% MLCellLinOp::compGrad() 18 0.005919 0.005995 0.006266 0.04% amrex::Dot() 142 0 0.0003829 0.006127 0.04% Castro::volInBoundary() 14 0.00344 0.003744 0.005622 0.04% Castro::initialize_do_advance() 20 0.004651 0.005105 0.00556 0.04% MultiFab::max() 2 0.0001651 0.003112 0.005534 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003223 0.005156 0.04% MLCellLinOp::apply() 986 0.002003 0.00222 0.004715 0.03% FabArray::ParallelCopy() 1429 0.00341 0.003573 0.003808 0.03% Castro::sum_integrated_quantities() 2 0.002071 0.002911 0.003327 0.02% BndryData::define() 19 0.003035 0.003071 0.003237 0.02% MLPoisson::normalize() 79 0 0.0001942 0.003107 0.02% AmrLevel::FillPatch() 147 0.002077 0.002151 0.002363 0.02% MLLinOp::defineGrids() 19 0.00174 0.001883 0.002242 0.02% MLCellLinOp::prepareForSolve() 19 0.001631 0.001768 0.002064 0.01% MLCellLinOp::correctionResidual() 768 0.001798 0.001875 0.001978 0.01% Castro::construct_new_gravity() 17 0.0002662 0.0006078 0.001865 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001288 0.001538 0.001864 0.01% MLMG::mgVcycle() 128 0.001552 0.00161 0.001768 0.01% Gravity::solve_for_phi() 17 0.0007454 0.001022 0.001734 0.01% MLCellLinOp::defineBC() 19 0.001487 0.001532 0.001639 0.01% StateData::define() 6 0.001259 0.001436 0.001575 0.01% MLMG:computeResOfCorrection() 768 0.001395 0.001451 0.001544 0.01% Castro::buildMetrics() 1 0.0005422 0.0006283 0.001539 0.01% FabArrayBase::FB::FB() 75 0.000279 0.0006793 0.001451 0.01% Castro::save_data_for_retry() 3 0.001231 0.001302 0.001359 0.01% main() 1 0.0009992 0.001219 0.001331 0.01% Castro::locWgtSum() 6 0.001115 0.001144 0.001178 0.01% MLMG::actualBottomSolve() 128 0.0001284 0.0001937 0.001069 0.01% TagBoxArray::collate() 2 6.097e-05 0.0005056 0.001064 0.01% StateDataPhysBCFunct::() 147 0.0006793 0.0007954 0.000898 0.01% MLCellLinOp::setLevelBC() 19 0.0005542 0.0006665 0.0008335 0.01% Castro::swap_state_time_levels() 8 0.0006317 0.0006871 0.000803 0.01% Castro::subcycle_advance_ctu() 1 0.0001923 0.0002585 0.0007847 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006702 0.0007062 0.0007376 0.01% MLMG::mgVcycle_down::3 128 0.0005676 0.0006154 0.000714 0.00% MLMG::mgVcycle_down::1 128 0.0006404 0.0006678 0.0007119 0.00% MLMG::mgVcycle_down::2 128 0.0006012 0.000654 0.0007074 0.00% MLMG::mgVcycle_down::0 128 0.0006454 0.0006662 0.0006965 0.00% MLMG::mgVcycle_down::4 128 0.0005497 0.0005787 0.0006532 0.00% MLMG::mgVcycle_down::5 128 0.0005747 0.0006016 0.0006511 0.00% Castro::Castro() 1 0.0004615 0.0004931 0.0005365 0.00% Castro::problem_post_timestep() 2 1.039e-05 4.481e-05 0.0005323 0.00% Castro::apply_tagging_restrictions() 2 0.0004144 0.0004758 0.0005276 0.00% AmrMesh::MakeNewGrids() 2 0.000498 0.0005095 0.0005247 0.00% FillPatchSingleLevel 147 0.0004698 0.0004895 0.0005204 0.00% Castro::do_advance_ctu() 20 0.0004435 0.0004694 0.000515 0.00% Gravity::applyMetricTerms() 2 0.0004718 0.0004876 0.0005149 0.00% Castro::clean_state() 79 0.000422 0.0004537 0.000503 0.00% MLMG::mgVcycle_up::0 128 0.0004583 0.0004726 0.0005024 0.00% MLMG::mgVcycle_up::1 128 0.0004434 0.0004682 0.0004882 0.00% MLMG::mgVcycle_up::2 128 0.0003865 0.000424 0.0004779 0.00% MLCellLinOp::solutionResidual() 147 0.0004305 0.0004403 0.0004662 0.00% makeSFC 95 0.0003591 0.0003843 0.0004534 0.00% MLMG::mgVcycle_up::3 128 0.0003812 0.0004002 0.0004466 0.00% Castro::enforce_consistent_e() 1 0.0003645 0.0003783 0.0004418 0.00% MLMG::mgVcycle_up::5 128 0.0003955 0.0004107 0.0004372 0.00% MLMG::mgVcycle_up::4 128 0.000387 0.0004016 0.0004305 0.00% MLMG::oneIter() 128 0.0003932 0.0004011 0.0004304 0.00% Castro::volProductSum() 2 0.0003899 0.0003962 0.0004034 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003279 0.0003392 0.0003636 0.00% Gravity::solve_phi_with_mlmg() 19 0.000212 0.000226 0.000286 0.00% MLMG::computeResidual() 128 0.0002395 0.0002441 0.0002514 0.00% MLMG::mgVcycle_bottom 128 0.0002217 0.0002286 0.0002403 0.00% DistributionMapping::Distribute() 95 0.0002078 0.0002184 0.0002317 0.00% OwnerMask() 2 0.0001346 0.0001734 0.0002215 0.00% Gravity::update_max_rhs() 2 0.0001605 0.000181 0.0002197 0.00% Castro::finalize_do_advance() 17 0.0001648 0.0001857 0.000207 0.00% MLMG::compResidual() 1 0.0001526 0.0001595 0.0001667 0.00% Castro::initialize_advance() 1 0.0001272 0.000146 0.000163 0.00% MLPoisson::define() 19 0.0001206 0.0001347 0.0001559 0.00% TagBoxArray::mapPRD 2 0.0001051 0.0001164 0.0001326 0.00% Castro::retry_advance_ctu() 11 5.188e-05 5.994e-05 0.0001258 0.00% Amr::defBaseLevel() 1 9.684e-05 0.0001042 0.0001257 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.788e-05 8.137e-05 0.0001224 0.00% Castro::check_for_nan() 37 0.0001005 0.0001097 0.000122 0.00% Amr::coarseTimeStep() 1 9.574e-05 0.0001133 0.0001175 0.00% Castro::enforce_speed_limit() 79 0.0001006 0.0001064 0.0001144 0.00% Gravity::test_composite_phi() 1 9.03e-05 9.545e-05 0.0001102 0.00% MLLinOp::define() 19 7.93e-05 8.682e-05 0.0001098 0.00% Castro::apply_source_to_state() 37 9.241e-05 9.893e-05 0.0001073 0.00% Amr::grid_places() 2 7.262e-05 8.984e-05 0.0001049 0.00% Castro::apply_problem_tags() 2 9.222e-05 9.491e-05 9.924e-05 0.00% MLPoisson::prepareForSolve() 19 7.514e-05 8.105e-05 9.434e-05 0.00% MultiFab::Swap() 5 6.696e-05 7.001e-05 7.748e-05 0.00% Castro::create_source_corrector() 17 5.307e-05 5.92e-05 6.819e-05 0.00% MLMG::getGradSolution() 18 4.079e-05 4.356e-05 6.779e-05 0.00% Castro::expand_state() 20 5.158e-05 5.769e-05 6.389e-05 0.00% knapsack() 1 5.642e-05 5.948e-05 6.117e-05 0.00% Amr::initSubcycle() 1 5.724e-05 5.827e-05 5.95e-05 0.00% MLMG::computeMLResidual() 18 4.242e-05 4.649e-05 5.197e-05 0.00% Amr::FinalizeInit() 1 8.83e-06 1.463e-05 4.785e-05 0.00% Castro::derive() 18 4.072e-05 4.259e-05 4.701e-05 0.00% Gravity::swapTimeLevels() 8 3.519e-05 3.816e-05 4.433e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.259e-05 3.392e-05 3.943e-05 0.00% Gravity::actual_multilevel_solve() 1 2.596e-05 3.19e-05 3.833e-05 0.00% MLMG::MLResNormInf() 18 3.288e-05 3.52e-05 3.754e-05 0.00% MLMG::MLRhsNormInf() 18 3.261e-05 3.37e-05 3.468e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.656e-05 2.718e-05 3.39e-05 0.00% Castro::construct_old_rotation_source() 20 2.995e-05 3.079e-05 3.115e-05 0.00% Amr::timeStep() 1 1.371e-05 1.918e-05 3.043e-05 0.00% Amr::regrid() 1 1.053e-05 1.417e-05 3.034e-05 0.00% Castro::post_regrid() 2 1.051e-05 1.455e-05 2.827e-05 0.00% Castro::advance() 1 7.582e-06 1.232e-05 2.639e-05 0.00% Castro::finalize_advance() 1 1.601e-05 1.886e-05 2.511e-05 0.00% Castro::construct_new_rotation_source() 17 2.076e-05 2.203e-05 2.487e-05 0.00% Castro::estTimeStep() 10 1.291e-05 1.434e-05 2.005e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.719e-05 1.856e-05 1.976e-05 0.00% Castro::post_init() 1 1.156e-05 1.292e-05 1.761e-05 0.00% Castro::computeInitialDt() 2 7.186e-06 1.021e-05 1.652e-05 0.00% Amr::bldFineLevels() 1 6.845e-06 9.159e-06 1.433e-05 0.00% Amr::InitializeInit() 1 7.153e-06 8.351e-06 1.363e-05 0.00% Gravity::set_mass_offset() 2 4.038e-06 7.752e-06 1.124e-05 0.00% BoxList::parallelComplementIn() 4 7.068e-06 7.527e-06 1.011e-05 0.00% Castro::errorEst() 2 6.081e-06 7.494e-06 9.86e-06 0.00% Amr::init() 1 6.859e-06 7.884e-06 8.877e-06 0.00% BoxList::complementIn 4 5.863e-06 6.381e-06 8.847e-06 0.00% Castro::post_timestep() 1 5.531e-06 6.084e-06 7.315e-06 0.00% Amr::initialInit() 1 2.879e-06 3.337e-06 6.262e-06 0.00% Castro::gwstrain() 2 4.014e-06 4.639e-06 6.133e-06 0.00% Castro::FluxRegCrseInit 1 1.711e-06 2.053e-06 4.06e-06 0.00% Castro::FluxRegFineAdd() 1 1.438e-06 1.606e-06 1.924e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.38 14.38 14.38 100.00% Amr::coarseTimeStep() 1 12.13 12.13 12.13 84.38% Amr::timeStep() 1 12.07 12.07 12.07 83.98% Castro::advance() 1 12.01 12.01 12.01 83.56% Castro::subcycle_advance_ctu() 1 11.95 11.96 11.96 83.20% Castro::do_advance_ctu() 20 11.91 11.92 11.93 82.94% Castro::construct_ctu_hydro_source() 20 6.49 6.537 6.577 45.74% Castro::clean_state() 79 3.646 3.856 4.033 28.05% Castro::computeTemp() 80 2.369 2.55 2.792 19.42% Castro::reset_internal_energy(MultiFab) 80 1.496 1.58 1.738 12.09% Gravity::solve_phi_with_mlmg() 19 1.52 1.567 1.615 11.23% Castro::construct_new_gravity() 17 1.448 1.494 1.542 10.72% Gravity::solve_for_phi() 17 1.41 1.457 1.505 10.46% Castro::initialize_do_advance() 20 1.387 1.423 1.453 10.11% Amr::InitAmr() 1 1.341 1.341 1.341 9.33% Gravity::actual_solve_with_mlmg() 19 1.318 1.321 1.326 9.22% MLMG::solve() 18 1.269 1.273 1.274 8.86% Castro::do_old_sources() 20 1.169 1.197 1.214 8.44% MLMG::oneIter() 128 1.114 1.12 1.125 7.83% MLMG::mgVcycle() 128 1.099 1.105 1.111 7.72% Castro::do_new_sources() 17 0.9687 0.9957 1.039 7.22% Castro::evaluate_source_change() 196 0.9496 0.9683 0.9928 6.91% FabArray::ParallelCopy() 1429 0.2743 0.7379 0.9374 6.52% Amr::init() 1 0.903 0.903 0.903 6.28% Castro::enforce_min_density() 79 0.788 0.8188 0.8625 6.00% Amr::initialInit() 1 0.8456 0.8456 0.8457 5.88% amrex::Copy() 724 0.7716 0.7861 0.8155 5.67% MLCellLinOp::smooth() 3072 0.5664 0.6153 0.736 5.12% FabArray::ParallelCopy_finish() 1429 0.04711 0.5104 0.7007 4.87% AmrLevel::FillPatch() 147 0.4726 0.5727 0.6587 4.58% Amr::InitializeInit() 1 0.4484 0.5123 0.6178 4.30% Amr::defBaseLevel() 1 0.4484 0.5123 0.6178 4.30% MultiFab::AddProduct() 3439 0.5509 0.5617 0.5757 4.00% Castro::normalize_species() 79 0.5396 0.5508 0.5715 3.97% Castro::reset_internal_energy(Fab) 160 0.5227 0.5348 0.5533 3.85% FillPatchIterator::Initialize 147 0.2934 0.3944 0.4831 3.36% FillPatchIterator::FillFromLevel0() 147 0.2696 0.3756 0.459 3.19% FillPatchSingleLevel 147 0.2689 0.3749 0.4583 3.19% MLMG::mgVcycle_up::1 128 0.0959 0.258 0.4222 2.94% MLPoisson::Fsmooth() 6144 0.3131 0.3447 0.421 2.93% Amr::FinalizeInit() 1 0.2279 0.3333 0.3972 2.76% Castro::Castro() 1 0.3662 0.3713 0.3921 2.73% Castro::initMFs() 1 0.3609 0.3659 0.386 2.68% MLCellLinOp::applyBC() 7148 0.2821 0.3239 0.3817 2.65% FabArray::setVal() 5013 0.3584 0.3643 0.373 2.59% MLMG::addInterpCorrection() 768 0.06193 0.2997 0.3688 2.56% MultiFab::Subtract() 159 0.3423 0.349 0.3578 2.49% check_for_negative_density() 20 0.1029 0.2113 0.3224 2.24% FabArray::FillBoundary() 6380 0.229 0.2621 0.2956 2.06% Gravity::fill_multipole_BCs() 19 0.1997 0.244 0.2877 2.00% MLMG::mgVcycle_down::0 128 0.2634 0.2691 0.2736 1.90% MLMG::mgVcycle_up::2 128 0.01051 0.1139 0.2723 1.89% Castro::initData() 1 0.07785 0.1393 0.2499 1.74% FabArray::ParallelCopy_nowait() 1429 0.2082 0.2239 0.2425 1.69% Amr::bldFineLevels() 1 0.04705 0.1527 0.2164 1.50% MLMG::mgVcycle_up::0 128 0.2049 0.2092 0.214 1.49% MLCellLinOp::apply() 986 0.1549 0.1671 0.2051 1.43% Castro::expand_state() 20 0.1784 0.1864 0.2034 1.41% FabArray::sum() 3439 0.1833 0.1871 0.1917 1.33% MLMG::mgVcycle_up::3 128 0.01044 0.02341 0.1782 1.24% FillBoundary_finish() 6380 0.113 0.1422 0.1734 1.21% Amr::grid_places() 2 0.002858 0.1084 0.1723 1.20% AmrMesh::MakeNewGrids() 2 0.002768 0.1083 0.1722 1.20% TagBoxArray::mapPRD 2 0.0007146 0.1065 0.1706 1.19% MLMG:computeResOfCorrection() 768 0.1134 0.1252 0.15 1.04% MLCellLinOp::correctionResidual() 768 0.112 0.1237 0.1484 1.03% Castro::post_init() 1 0.1336 0.1365 0.139 0.97% FillBoundary_nowait() 6380 0.08166 0.1059 0.1326 0.92% Castro::construct_new_source() 102 0.1243 0.1263 0.1291 0.90% MLMG::mgVcycle_down::1 128 0.1116 0.1173 0.1251 0.87% MLPoisson::Fapply() 986 0.09497 0.1018 0.1229 0.85% Castro::create_source_corrector() 17 0.048 0.08646 0.1183 0.82% MLCellLinOp::solutionResidual() 147 0.09329 0.09953 0.1078 0.75% Amr::writePlotFile() 2 0.1009 0.101 0.101 0.70% Gravity::multilevel_solve_for_new_phi() 1 0.09973 0.09975 0.09979 0.69% Gravity::actual_multilevel_solve() 1 0.09963 0.09967 0.09972 0.69% Castro::post_regrid() 2 0.08592 0.08838 0.09132 0.64% MLMG::computeResidual() 128 0.08022 0.08289 0.0888 0.62% Castro::construct_old_source() 120 0.07813 0.07959 0.08093 0.56% FabArray::Saxpy() 264 0.06791 0.06964 0.07741 0.54% Castro::construct_old_gravity() 20 0.04387 0.06093 0.07433 0.52% Castro::construct_new_gravity_source() 17 0.06942 0.07066 0.07318 0.51% Castro::derive() 18 0.06915 0.07061 0.07259 0.50% AmrLevel::derive() 18 0.06911 0.07056 0.07254 0.50% MLMG::mgVcycle_bottom 128 0.0003549 0.004851 0.07216 0.50% MLMG::actualBottomSolve() 128 0.0001284 0.004622 0.07192 0.50% MLMG::mgVcycle_down::2 128 0.01226 0.04051 0.07126 0.50% MLCGSolver::bicgstab 8 0 0.004399 0.07038 0.49% Gravity::get_old_grav_vector() 20 0.03932 0.05756 0.06735 0.47% Castro::post_timestep() 1 0.0605 0.06343 0.06701 0.47% FabArray::Xpay() 945 0.05222 0.05539 0.063 0.44% MLMG::mgVcycle_down::3 128 0.01167 0.01798 0.0599 0.42% Castro::initialize_advance() 1 0.05001 0.05119 0.05405 0.38% amrex::average_down 768 0.032 0.03864 0.05391 0.37% Castro::check_for_nan() 37 0.0442 0.04505 0.04826 0.34% MultiFab::contains_nan() 37 0.04409 0.04494 0.04814 0.33% Castro::construct_old_gravity_source() 20 0.04542 0.04637 0.04805 0.33% Amr::regrid() 1 0.04426 0.04525 0.04629 0.32% MLPoisson::define() 19 0.0278 0.03227 0.03874 0.27% Castro::retry_advance_ctu() 11 0.03582 0.03627 0.03847 0.27% Gravity::get_new_grav_vector() 18 0.03545 0.03733 0.03832 0.27% StateDataPhysBCFunct::() 147 0.0006793 0.01882 0.03594 0.25% MLMG::mgVcycle_down::4 128 0.01163 0.01344 0.03517 0.24% StateData::FillBoundary(geom) 143 0 0.01802 0.03508 0.24% MLMG::ResNormInf() 146 0.01489 0.02653 0.03362 0.23% Castro::apply_source_to_state() 37 0.02767 0.02825 0.02914 0.20% VisMF::Write(FabArray) 4 0.01615 0.01769 0.02795 0.19% MLMG::mgVcycle_up::4 128 0.01051 0.01181 0.02712 0.19% MLMG::prepareForSolve() 18 0.02017 0.02117 0.02354 0.16% MLCellLinOp::defineAuxData() 19 0.01835 0.01974 0.02339 0.16% MLMG::mgVcycle_down::5 128 0.0116 0.01262 0.02307 0.16% Castro::sum_integrated_quantities() 2 0.02187 0.02229 0.02233 0.16% MLMG::computeMLResidual() 18 0.0111 0.01619 0.02016 0.14% Castro::save_data_for_retry() 3 0.01857 0.0188 0.01993 0.14% MLMG::mgVcycle_up::5 128 0.01059 0.01141 0.01948 0.14% Castro::problem_post_timestep() 2 0.009678 0.01363 0.01764 0.12% Castro::wd_update() 2 0.009666 0.01359 0.01762 0.12% FabArray::norminf() 282 0.01095 0.01157 0.01586 0.11% amrex::Add() 128 0.01377 0.01413 0.01561 0.11% FabArrayBase::getFB() 6380 0.01013 0.01095 0.01424 0.10% Amr::writeSmallPlotFile() 2 0.01422 0.01422 0.01422 0.10% Gravity::test_composite_phi() 1 0.01396 0.01399 0.01401 0.10% FabArrayBase::getCPC() 2005 0.009353 0.01059 0.01382 0.10% FabArray::setDomainBndry() 147 0.0004368 0.005983 0.01123 0.08% MLLinOp::define() 19 0.003551 0.006746 0.0108 0.08% MLLinOp::defineGrids() 19 0.003465 0.006659 0.01071 0.07% MLCGSolver::ParallelAllReduce 227 0 0.0005296 0.008473 0.06% FabArray::mult() 59 0.007063 0.007293 0.008043 0.06% Castro::volWgtSum() 46 0.007408 0.007565 0.00797 0.06% MLMG::getGradSolution() 18 0.007479 0.007687 0.007964 0.06% MLCellLinOp::compGrad() 18 0.007438 0.007644 0.007921 0.06% MLLinOp::makeSubCommunicator() 19 0.000774 0.003834 0.007466 0.05% Gravity::update_max_rhs() 2 0.001419 0.004375 0.006823 0.05% FabArrayBase::CPC::define() 576 0.002167 0.003296 0.006316 0.04% amrex::Dot() 142 0 0.0003829 0.006127 0.04% MLCellLinOp::defineBC() 19 0.00546 0.005646 0.006046 0.04% Castro::volInBoundary() 14 0.00344 0.003744 0.005622 0.04% MultiFab::max() 2 0.0001651 0.003112 0.005534 0.04% BndryData::define() 19 0.00393 0.004114 0.004474 0.03% MLPoisson::normalize() 79 0 0.0001942 0.003107 0.02% MLPoisson::prepareForSolve() 19 0.001725 0.001849 0.002143 0.01% MLCellLinOp::prepareForSolve() 19 0.001631 0.001768 0.002064 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001288 0.001538 0.001864 0.01% AmrLevel::AmrLevel(dm) 1 0.001292 0.00147 0.001609 0.01% Castro::buildMetrics() 1 0.0006035 0.0006914 0.001604 0.01% StateData::define() 6 0.001259 0.001436 0.001575 0.01% FabArrayBase::FB::FB() 75 0.000279 0.0006793 0.001451 0.01% Gravity::swapTimeLevels() 8 0.001209 0.001289 0.001368 0.01% MLMG::MLResNormInf() 18 0.001248 0.001282 0.001311 0.01% MLMG::compResidual() 1 0.0009511 0.001101 0.001287 0.01% MLMG::MLRhsNormInf() 18 0.001222 0.001246 0.001279 0.01% Castro::locWgtSum() 6 0.001115 0.001144 0.001178 0.01% TagBoxArray::collate() 2 6.097e-05 0.0005056 0.001064 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009024 0.0009419 0.001047 0.01% MLCellLinOp::setLevelBC() 19 0.0005542 0.0006665 0.0008335 0.01% Castro::swap_state_time_levels() 8 0.0006317 0.0006871 0.000803 0.01% makeSFC 95 0.0005699 0.0006027 0.0006834 0.00% Castro::errorEst() 2 0.000516 0.0005782 0.0006294 0.00% Castro::apply_tagging_restrictions() 2 0.0004144 0.0004758 0.0005276 0.00% Gravity::applyMetricTerms() 2 0.0004718 0.0004876 0.0005149 0.00% Castro::enforce_consistent_e() 1 0.0003645 0.0003783 0.0004418 0.00% Castro::volProductSum() 2 0.0003899 0.0003962 0.0004034 0.00% Castro::finalize_advance() 1 0.0002583 0.0002667 0.0002887 0.00% DistributionMapping::Distribute() 95 0.0002078 0.0002184 0.0002317 0.00% OwnerMask() 2 0.0001346 0.0001734 0.0002215 0.00% Castro::finalize_do_advance() 17 0.0001754 0.0001962 0.0002174 0.00% Castro::enforce_speed_limit() 79 0.0001006 0.0001064 0.0001144 0.00% DistributionMapping::KnapSackDoIt() 1 9.022e-05 0.0001052 0.0001116 0.00% Castro::apply_problem_tags() 2 9.222e-05 9.491e-05 9.924e-05 0.00% MultiFab::Swap() 5 6.696e-05 7.001e-05 7.748e-05 0.00% knapsack() 1 5.642e-05 5.948e-05 6.117e-05 0.00% Amr::initSubcycle() 1 5.724e-05 5.827e-05 5.95e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.656e-05 2.718e-05 3.39e-05 0.00% Castro::construct_old_rotation_source() 20 2.995e-05 3.079e-05 3.115e-05 0.00% Castro::construct_new_rotation_source() 17 2.076e-05 2.203e-05 2.487e-05 0.00% Castro::computeInitialDt() 2 1.023e-05 1.407e-05 2.027e-05 0.00% Castro::estTimeStep() 10 1.291e-05 1.434e-05 2.005e-05 0.00% BoxList::parallelComplementIn() 4 1.303e-05 1.391e-05 1.896e-05 0.00% Gravity::set_mass_offset() 2 4.038e-06 7.752e-06 1.124e-05 0.00% BoxList::complementIn 4 5.863e-06 6.381e-06 8.847e-06 0.00% Castro::gwstrain() 2 4.014e-06 4.639e-06 6.133e-06 0.00% Castro::FluxRegCrseInit 1 1.711e-06 2.053e-06 4.06e-06 0.00% Castro::FluxRegFineAdd() 1 1.438e-06 1.606e-06 1.924e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 14 B 17 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.12-24-g75571e2dcbf2) finalized