Initializing AMReX (24.04-8-g2cd72a3bbaeb)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.04-8-g2cd72a3bbaeb) initialized Starting run at 07:27:12 UTC on 2024-04-08. Successfully read inputs file ... Castro git describe: 24.04-11-g2407e8176 AMReX git describe: 24.04-8-g2cd72a3bb Microphysics git describe: 24.04-4-ge5fecb7a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.153194144 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001080161 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010493863 Gravity::multilevel_solve_for_new_phi() time = 0.099291946 Gravity::fill_multipole_BCs() time = 0.011335115 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.049653729 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.007833153 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.00273923 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.064830515 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007600347 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.06382867 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.004197539 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060511921 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005302356 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059276217 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.319677867 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015224966 Gravity::solve_for_phi() time = 0.085100856 on level 0 Castro::construct_new_gravity() time = 0.087290113 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.058887402 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002684673 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058035738 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.317152181 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014469179 Gravity::solve_for_phi() time = 0.084410824 on level 0 Castro::construct_new_gravity() time = 0.086601962 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.05855822 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002650229 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.057950358 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.31996508 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015247409 Gravity::solve_for_phi() time = 0.090831607 on level 0 Castro::construct_new_gravity() time = 0.093029741 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.058413616 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002835548 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058187498 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.322453057 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014419749 Gravity::solve_for_phi() time = 0.084707266 on level 0 Castro::construct_new_gravity() time = 0.086975384 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.058535518 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002699619 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.057959245 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328908484 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014627601 Gravity::solve_for_phi() time = 0.084789544 on level 0 Castro::construct_new_gravity() time = 0.086984914 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.058666913 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002615952 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.057734111 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324455377 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015085805 Gravity::solve_for_phi() time = 0.084452857 on level 0 Castro::construct_new_gravity() time = 0.086651921 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.058969392 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002773103 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.057845541 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329576457 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0155145 Gravity::solve_for_phi() time = 0.085618346 on level 0 Castro::construct_new_gravity() time = 0.087812824 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.05945436 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002548574 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058083723 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324403212 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014997622 Gravity::solve_for_phi() time = 0.084906499 on level 0 Castro::construct_new_gravity() time = 0.08711078 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.058463484 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002622455 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.057762884 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327913147 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014817697 Gravity::solve_for_phi() time = 0.085260676 on level 0 Castro::construct_new_gravity() time = 0.087462413 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.05854501 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002554725 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.057986825 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329502447 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01992522 Gravity::solve_for_phi() time = 0.099997224 on level 0 Castro::construct_new_gravity() time = 0.102380374 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.067430057 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.006312499 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.099522044 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.393996321 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.021981119 Gravity::solve_for_phi() time = 0.094589197 on level 0 Castro::construct_new_gravity() time = 0.096744116 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059209207 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002723487 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.05819449 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331509411 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015339557 Gravity::solve_for_phi() time = 0.085552131 on level 0 Castro::construct_new_gravity() time = 0.087758331 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059096558 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002720168 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058489045 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330566684 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015052484 Gravity::solve_for_phi() time = 0.08556608 on level 0 Castro::construct_new_gravity() time = 0.087754649 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.05916676 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002536404 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058357875 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.328370642 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01522407 Gravity::solve_for_phi() time = 0.084903902 on level 0 Castro::construct_new_gravity() time = 0.087102518 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.059318293 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002594439 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.057978375 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330604662 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015353621 Gravity::solve_for_phi() time = 0.085962284 on level 0 Castro::construct_new_gravity() time = 0.088153901 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.058771961 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002669679 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058432844 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32556412 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01568376 Gravity::solve_for_phi() time = 0.086020886 on level 0 Castro::construct_new_gravity() time = 0.088220328 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059264015 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.00265855 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058663501 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.367888025 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016232602 Gravity::solve_for_phi() time = 0.087922559 on level 0 Castro::construct_new_gravity() time = 0.090116228 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059981041 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002769411291 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.89009619 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.049917354 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.007316666 seconds Ending run at 07:27:27 UTC on 2024-04-08. Run time = 14.16154485 Run time without initialization = 11.9484386 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.16 ... 14.16 ... 14.16 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3459 5.4432 5.5865 39.45% Amr::InitAmr() 1 1.331 1.331 1.332 9.41% Castro::computeTemp() 80 0.8263 0.9436 1.103 7.79% amrex::Copy() 724 0.7941 0.8025 0.8164 5.76% FabArray::ParallelCopy_finish() 1429 0.06737 0.505 0.7464 5.27% Castro::normalize_species() 79 0.547 0.5557 0.5728 4.04% MultiFab::AddProduct() 3439 0.5373 0.5425 0.5494 3.88% Castro::reset_internal_energy(Fab) 160 0.5129 0.5207 0.5316 3.75% MLPoisson::Fsmooth() 6144 0.3171 0.3446 0.4124 2.91% Castro::initMFs() 1 0.3592 0.3679 0.4023 2.84% MultiFab::Subtract() 159 0.3442 0.3482 0.3548 2.51% FabArray::setVal() 5013 0.3393 0.3431 0.3504 2.47% check_for_negative_density() 20 0.09764 0.202 0.2954 2.09% Gravity::fill_multipole_BCs() 19 0.1971 0.2458 0.288 2.03% FabArray::ParallelCopy_nowait() 1429 0.1917 0.2069 0.2291 1.62% Castro::reset_internal_energy(MultiFab) 80 0.02304 0.0691 0.2258 1.59% FabArray::sum() 3439 0.1813 0.1836 0.1869 1.32% Castro::initData() 1 0.003342 0.02655 0.1565 1.10% FillBoundary_finish() 6380 0.0949 0.124 0.1549 1.09% FillBoundary_nowait() 6380 0.07757 0.1032 0.1308 0.92% MLPoisson::Fapply() 986 0.09396 0.09884 0.1128 0.80% MLCellLinOp::applyBC() 7148 0.04725 0.06194 0.1032 0.73% Castro::do_old_sources() 20 0.0005352 0.01299 0.08785 0.62% Castro::do_new_sources() 17 0.0003811 0.01327 0.07598 0.54% FabArray::Saxpy() 264 0.06774 0.06903 0.07512 0.53% Castro::construct_new_gravity_source() 17 0.06927 0.07023 0.07128 0.50% FabArray::Xpay() 945 0.0515 0.05402 0.06054 0.43% Castro::enforce_min_density() 79 0.01764 0.02952 0.05768 0.41% Castro::construct_old_gravity_source() 20 0.04504 0.04578 0.04812 0.34% MultiFab::contains_nan() 37 0.04421 0.04464 0.04559 0.32% AmrLevel::derive() 18 0.03982 0.04068 0.0417 0.29% MLMG::addInterpCorrection() 768 0.03287 0.03535 0.04168 0.29% StateData::FillBoundary(geom) 143 0 0.01724 0.03314 0.23% amrex::average_down 768 0.02425 0.02635 0.03169 0.22% VisMF::Write(FabArray) 4 0.01631 0.01754 0.02884 0.20% Amr::writePlotFile() 2 0.009475 0.01756 0.01898 0.13% MLCellLinOp::defineAuxData() 19 0.01449 0.01523 0.01731 0.12% FabArray::FillBoundary() 6380 0.01311 0.0137 0.01639 0.12% Castro::construct_new_source() 102 0.01543 0.01567 0.0159 0.11% MLCGSolver::bicgstab 8 0 0.0009885 0.01582 0.11% FabArray::norminf() 282 0.01074 0.01115 0.01527 0.11% amrex::Add() 128 0.01434 0.01449 0.01504 0.11% FillPatchIterator::Initialize 147 0.0126 0.01294 0.0136 0.10% Castro::evaluate_source_change() 196 0.01241 0.01265 0.01338 0.09% FabArrayBase::getFB() 6380 0.009753 0.01015 0.01258 0.09% MLCellLinOp::smooth() 3072 0.01098 0.01143 0.01221 0.09% MLMG::ResNormInf() 146 0.005509 0.008582 0.01213 0.09% FabArray::setDomainBndry() 147 0.000451 0.006405 0.01207 0.09% MLMG::prepareForSolve() 18 0.01005 0.01031 0.01087 0.08% Castro::construct_old_source() 120 0.009788 0.00996 0.01042 0.07% Amr::writeSmallPlotFile() 2 0.007417 0.00972 0.01025 0.07% Castro::wd_update() 2 0.004506 0.007023 0.009487 0.07% Castro::construct_old_gravity() 20 0.0003978 0.002167 0.008935 0.06% MLLinOp::makeSubCommunicator() 19 0.00118 0.004827 0.008685 0.06% FabArray::mult() 59 0.007395 0.00755 0.008324 0.06% Gravity::actual_solve_with_mlmg() 19 0.006779 0.007066 0.007939 0.06% FabArrayBase::getCPC() 2005 0.007296 0.007479 0.007797 0.06% Castro::volWgtSum() 46 0.007395 0.007484 0.00758 0.05% Gravity::get_new_grav_vector() 18 0.006087 0.006198 0.006916 0.05% Gravity::get_old_grav_vector() 20 0.006497 0.006599 0.006906 0.05% FabArrayBase::CPC::define() 576 0.00223 0.00334 0.00641 0.05% MLCellLinOp::compGrad() 18 0.00612 0.006176 0.006246 0.04% Castro::initialize_do_advance() 20 0.004829 0.005315 0.006139 0.04% amrex::Dot() 142 0 0.0003762 0.006019 0.04% MLMG::solve() 18 0.001027 0.002862 0.005975 0.04% Castro::volInBoundary() 14 0.003326 0.003634 0.005475 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003006 0.00481 0.03% MLCellLinOp::apply() 986 0.001957 0.002184 0.004579 0.03% FabArray::ParallelCopy() 1429 0.003515 0.00367 0.003957 0.03% MultiFab::max() 2 0.0002053 0.001319 0.003334 0.02% BndryData::define() 19 0.003041 0.003088 0.00325 0.02% MLPoisson::normalize() 79 0 0.0001995 0.003193 0.02% AmrLevel::FillPatch() 147 0.002182 0.002287 0.002533 0.02% Castro::sum_integrated_quantities() 2 0.001821 0.002114 0.002433 0.02% MLLinOp::defineGrids() 19 0.001761 0.001893 0.002212 0.02% MLCellLinOp::prepareForSolve() 19 0.001632 0.001767 0.002055 0.01% Castro::buildMetrics() 1 0.0005797 0.0006954 0.001949 0.01% MLCellLinOp::correctionResidual() 768 0.001744 0.001801 0.001877 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001356 0.001566 0.001842 0.01% MLMG::mgVcycle() 128 0.001596 0.001663 0.001842 0.01% StateData::define() 6 0.001359 0.001505 0.001634 0.01% MLCellLinOp::defineBC() 19 0.00148 0.00152 0.001626 0.01% MLMG:computeResOfCorrection() 768 0.001352 0.00141 0.001479 0.01% FabArrayBase::FB::FB() 75 0.0002727 0.00068 0.001457 0.01% Gravity::solve_for_phi() 17 0.0008225 0.001014 0.001445 0.01% Castro::save_data_for_retry() 3 0.001303 0.001354 0.001432 0.01% main() 1 0.0009749 0.001226 0.001374 0.01% Castro::construct_new_gravity() 17 0.0003081 0.0005155 0.001186 0.01% Castro::locWgtSum() 6 0.001122 0.001148 0.001174 0.01% Castro::subcycle_advance_ctu() 1 0.0002092 0.0002866 0.001076 0.01% MLMG::actualBottomSolve() 128 0.0001285 0.0001908 0.001071 0.01% StateDataPhysBCFunct::() 147 0.0006892 0.0008203 0.000929 0.01% MLCellLinOp::setLevelBC() 19 0.0005408 0.000671 0.0009068 0.01% Castro::swap_state_time_levels() 8 0.0005987 0.0006754 0.0007668 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006959 0.0007169 0.0007607 0.01% DistributionMapping::LeastUsedCPUs() 1 4.076e-05 0.0006684 0.0007298 0.01% MLMG::mgVcycle_down::2 128 0.0005944 0.0006542 0.0007164 0.01% Castro::do_advance_ctu() 20 0.0004236 0.0004877 0.0007071 0.00% MLMG::mgVcycle_down::3 128 0.0005553 0.0006029 0.0007028 0.00% MLMG::mgVcycle_down::0 128 0.0006395 0.0006551 0.0006923 0.00% MLMG::mgVcycle_down::1 128 0.0006343 0.00065 0.000679 0.00% Castro::Castro() 1 0.0005135 0.0005665 0.000672 0.00% MLMG::mgVcycle_down::4 128 0.0005343 0.0005631 0.0006655 0.00% MLMG::mgVcycle_down::5 128 0.0005603 0.0005776 0.0006382 0.00% TagBoxArray::collate() 2 0.0001737 0.0003491 0.000557 0.00% Castro::apply_tagging_restrictions() 2 0.0004188 0.0004795 0.0005388 0.00% AmrMesh::MakeNewGrids() 2 0.0004981 0.000509 0.0005368 0.00% Castro::clean_state() 79 0.0004624 0.0004912 0.0005284 0.00% MLMG::mgVcycle_up::1 128 0.0004411 0.0004654 0.0005082 0.00% Gravity::applyMetricTerms() 2 0.0004873 0.0004942 0.0005016 0.00% FillPatchSingleLevel 147 0.0004721 0.0004828 0.0004917 0.00% MLMG::mgVcycle_up::0 128 0.0004448 0.0004598 0.0004806 0.00% MLMG::mgVcycle_up::2 128 0.0003791 0.0004184 0.0004552 0.00% makeSFC 95 0.0003683 0.0003928 0.0004539 0.00% MLCellLinOp::solutionResidual() 147 0.0004234 0.0004313 0.0004487 0.00% MLMG::mgVcycle_up::5 128 0.0003893 0.0004014 0.0004389 0.00% MLMG::mgVcycle_up::3 128 0.0003761 0.0003907 0.0004309 0.00% MLMG::mgVcycle_up::4 128 0.0003777 0.0003905 0.0004264 0.00% Castro::enforce_consistent_e() 1 0.0003689 0.000381 0.0004257 0.00% Castro::problem_post_timestep() 2 1.095e-05 3.693e-05 0.0004114 0.00% MLMG::oneIter() 128 0.0003728 0.0003866 0.0004098 0.00% Castro::volProductSum() 2 0.0003883 0.0003978 0.0004036 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003246 0.000335 0.0003612 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002251 0.0002436 0.0002736 0.00% MLMG::computeResidual() 128 0.0002419 0.0002486 0.0002647 0.00% MLMG::mgVcycle_bottom 128 0.0002222 0.0002314 0.0002506 0.00% DistributionMapping::Distribute() 95 0.000212 0.0002228 0.000236 0.00% Castro::finalize_do_advance() 17 0.0001622 0.000187 0.0002344 0.00% Amr::grid_places() 2 7.812e-05 9.988e-05 0.0002069 0.00% MLPoisson::define() 19 0.0001387 0.0001682 0.0001963 0.00% Castro::retry_advance_ctu() 11 5.384e-05 7.124e-05 0.00019 0.00% Amr::coarseTimeStep() 1 0.0001443 0.0001794 0.0001868 0.00% Gravity::update_max_rhs() 2 0.000162 0.0001695 0.0001834 0.00% Castro::initialize_advance() 1 0.0001348 0.000161 0.0001787 0.00% OwnerMask() 2 0.0001325 0.000151 0.0001674 0.00% Castro::check_for_nan() 37 0.0001047 0.000124 0.0001631 0.00% Amr::initSubcycle() 1 5.52e-05 6.638e-05 0.0001624 0.00% Gravity::test_composite_phi() 1 9.256e-05 0.0001014 0.0001623 0.00% MLMG::compResidual() 1 0.0001538 0.0001577 0.0001613 0.00% Amr::defBaseLevel() 1 0.0001033 0.0001247 0.0001406 0.00% Castro::enforce_speed_limit() 79 0.0001146 0.0001201 0.0001331 0.00% TagBoxArray::mapPRD 2 0.0001114 0.0001155 0.0001223 0.00% Amr::timeStep() 1 1.193e-05 2.417e-05 0.0001172 0.00% Castro::apply_source_to_state() 37 9.916e-05 0.0001055 0.0001147 0.00% knapsack() 1 5.584e-05 6.257e-05 0.0001112 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.193e-05 7.313e-05 0.0001008 0.00% MLLinOp::define() 19 8.15e-05 8.763e-05 9.98e-05 0.00% Castro::apply_problem_tags() 2 9.339e-05 9.446e-05 9.552e-05 0.00% Amr::FinalizeInit() 1 1.073e-05 1.89e-05 9.088e-05 0.00% MultiFab::Swap() 5 6.903e-05 7.472e-05 8.333e-05 0.00% Castro::create_source_corrector() 17 5.881e-05 6.693e-05 8.031e-05 0.00% MLPoisson::prepareForSolve() 19 6.831e-05 7.243e-05 7.81e-05 0.00% Castro::expand_state() 20 5.554e-05 6.155e-05 6.963e-05 0.00% Gravity::swapTimeLevels() 8 3.623e-05 4.181e-05 6.644e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.351e-05 3.724e-05 5.315e-05 0.00% MLMG::computeMLResidual() 18 4.141e-05 4.551e-05 5.29e-05 0.00% Castro::derive() 18 4.201e-05 4.479e-05 4.797e-05 0.00% MLMG::getGradSolution() 18 3.993e-05 4.14e-05 4.581e-05 0.00% Amr::regrid() 1 1.066e-05 1.328e-05 4.257e-05 0.00% MLMG::MLResNormInf() 18 3.412e-05 3.595e-05 3.86e-05 0.00% MLMG::MLRhsNormInf() 18 3.05e-05 3.167e-05 3.711e-05 0.00% Castro::construct_old_rotation_source() 20 3.03e-05 3.184e-05 3.607e-05 0.00% Gravity::actual_multilevel_solve() 1 2.84e-05 3.174e-05 3.521e-05 0.00% Castro::finalize_advance() 1 1.729e-05 2.158e-05 3.041e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.616e-05 1.887e-05 2.833e-05 0.00% Castro::construct_new_rotation_source() 17 2.149e-05 2.244e-05 2.79e-05 0.00% Castro::post_timestep() 1 5.735e-06 7.696e-06 2.524e-05 0.00% Castro::post_regrid() 2 1.11e-05 1.353e-05 2.368e-05 0.00% Castro::advance() 1 7.195e-06 1.121e-05 1.789e-05 0.00% Castro::estTimeStep() 10 1.217e-05 1.365e-05 1.69e-05 0.00% Amr::InitializeInit() 1 7.119e-06 8.965e-06 1.685e-05 0.00% Castro::post_init() 1 1.207e-05 1.289e-05 1.618e-05 0.00% Castro::computeInitialDt() 2 6.568e-06 7.97e-06 1.472e-05 0.00% Amr::bldFineLevels() 1 6.985e-06 8.68e-06 1.331e-05 0.00% Amr::init() 1 6.036e-06 7.963e-06 1.126e-05 0.00% Gravity::set_mass_offset() 2 4.583e-06 6.594e-06 9.127e-06 0.00% Castro::gwstrain() 2 4.494e-06 5.169e-06 8.132e-06 0.00% BoxList::parallelComplementIn() 4 6.872e-06 7.168e-06 7.71e-06 0.00% Castro::errorEst() 2 6.085e-06 6.516e-06 7.093e-06 0.00% BoxList::complementIn 4 5.771e-06 6.078e-06 6.332e-06 0.00% Amr::initialInit() 1 2.906e-06 3.429e-06 6.001e-06 0.00% Castro::FluxRegCrseInit 1 1.747e-06 2.108e-06 2.571e-06 0.00% Castro::FluxRegFineAdd() 1 1.36e-06 1.566e-06 1.807e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.16 14.16 14.16 100.00% Amr::coarseTimeStep() 1 11.95 11.95 11.95 84.37% Amr::timeStep() 1 11.89 11.89 11.89 83.96% Castro::advance() 1 11.83 11.83 11.83 83.55% Castro::subcycle_advance_ctu() 1 11.78 11.78 11.78 83.19% Castro::do_advance_ctu() 20 11.73 11.74 11.74 82.93% Castro::construct_ctu_hydro_source() 20 6.388 6.42 6.46 45.61% Castro::clean_state() 79 3.656 3.779 3.939 27.82% Castro::computeTemp() 80 2.353 2.484 2.703 19.09% Castro::reset_internal_energy(MultiFab) 80 1.479 1.541 1.687 11.91% Gravity::solve_phi_with_mlmg() 19 1.493 1.545 1.591 11.24% Castro::construct_new_gravity() 17 1.422 1.471 1.518 10.72% Gravity::solve_for_phi() 17 1.383 1.434 1.481 10.46% Castro::initialize_do_advance() 20 1.379 1.409 1.443 10.19% Amr::InitAmr() 1 1.331 1.331 1.332 9.41% Gravity::actual_solve_with_mlmg() 19 1.292 1.295 1.3 9.18% MLMG::solve() 18 1.24 1.245 1.246 8.80% Castro::do_old_sources() 20 1.171 1.199 1.213 8.56% MLMG::oneIter() 128 1.105 1.108 1.111 7.84% MLMG::mgVcycle() 128 1.091 1.093 1.096 7.74% Castro::do_new_sources() 17 0.9303 0.9732 1.011 7.14% FabArray::ParallelCopy() 1429 0.2978 0.7355 0.9777 6.90% Castro::evaluate_source_change() 196 0.921 0.9307 0.9433 6.66% Amr::init() 1 0.8805 0.8811 0.8811 6.22% Castro::enforce_min_density() 79 0.7795 0.7989 0.8241 5.82% Amr::initialInit() 1 0.8222 0.8226 0.8227 5.81% amrex::Copy() 724 0.7941 0.8025 0.8164 5.76% FabArray::ParallelCopy_finish() 1429 0.06737 0.505 0.7464 5.27% MLCellLinOp::smooth() 3072 0.5583 0.6075 0.7327 5.17% AmrLevel::FillPatch() 147 0.4955 0.5922 0.6979 4.93% Amr::InitializeInit() 1 0.4479 0.5107 0.5996 4.23% Amr::defBaseLevel() 1 0.4479 0.5107 0.5996 4.23% Castro::normalize_species() 79 0.547 0.5557 0.5728 4.04% MultiFab::AddProduct() 3439 0.5373 0.5425 0.5494 3.88% Castro::reset_internal_energy(Fab) 160 0.5129 0.5207 0.5316 3.75% FillPatchIterator::Initialize 147 0.3139 0.4095 0.5166 3.65% FillPatchIterator::FillFromLevel0() 147 0.2886 0.3901 0.499 3.52% FillPatchSingleLevel 147 0.2878 0.3894 0.4983 3.52% MLMG::mgVcycle_up::1 128 0.09598 0.2575 0.4207 2.97% MLPoisson::Fsmooth() 6144 0.3171 0.3446 0.4124 2.91% Castro::Castro() 1 0.365 0.3742 0.4082 2.88% Castro::initMFs() 1 0.3594 0.3681 0.4025 2.84% MLCellLinOp::applyBC() 7148 0.2698 0.3137 0.3878 2.74% Amr::FinalizeInit() 1 0.223 0.312 0.3747 2.65% MLMG::addInterpCorrection() 768 0.06155 0.2976 0.3679 2.60% MultiFab::Subtract() 159 0.3442 0.3482 0.3548 2.51% FabArray::setVal() 5013 0.3393 0.3431 0.3504 2.47% check_for_negative_density() 20 0.09764 0.202 0.2954 2.09% FabArray::FillBoundary() 6380 0.2165 0.2517 0.2938 2.07% Gravity::fill_multipole_BCs() 19 0.1992 0.2479 0.2901 2.05% MLMG::mgVcycle_up::2 128 0.0105 0.1136 0.2706 1.91% MLMG::mgVcycle_down::0 128 0.2623 0.2656 0.2682 1.89% Castro::expand_state() 20 0.1871 0.2202 0.2658 1.88% FabArray::ParallelCopy_nowait() 1429 0.2108 0.2268 0.25 1.77% Castro::initData() 1 0.07696 0.1341 0.2323 1.64% MLMG::mgVcycle_up::0 128 0.1985 0.2 0.2027 1.43% Amr::bldFineLevels() 1 0.04646 0.1349 0.1981 1.40% MLCellLinOp::apply() 986 0.1507 0.1614 0.1956 1.38% FabArray::sum() 3439 0.1813 0.1836 0.1869 1.32% MLMG::mgVcycle_up::3 128 0.01055 0.02311 0.1744 1.23% FillBoundary_finish() 6380 0.0949 0.124 0.1549 1.09% Amr::grid_places() 2 0.002617 0.09152 0.1543 1.09% AmrMesh::MakeNewGrids() 2 0.002527 0.09143 0.1542 1.09% TagBoxArray::mapPRD 2 0.0008237 0.08981 0.1527 1.08% MLMG:computeResOfCorrection() 768 0.1131 0.1236 0.1466 1.04% MLCellLinOp::correctionResidual() 768 0.1117 0.1222 0.1451 1.02% FillBoundary_nowait() 6380 0.08772 0.114 0.1421 1.00% Castro::post_init() 1 0.1327 0.1338 0.1358 0.96% Castro::construct_new_source() 102 0.1229 0.1244 0.1258 0.89% MLMG::mgVcycle_down::1 128 0.1145 0.1189 0.1231 0.87% MLPoisson::Fapply() 986 0.09396 0.09884 0.1128 0.80% Amr::writePlotFile() 2 0.1002 0.1003 0.1004 0.71% Gravity::multilevel_solve_for_new_phi() 1 0.09926 0.0993 0.09932 0.70% Gravity::actual_multilevel_solve() 1 0.0992 0.09922 0.09924 0.70% MLCellLinOp::solutionResidual() 147 0.08816 0.09386 0.09802 0.69% Castro::post_regrid() 2 0.08456 0.08659 0.08772 0.62% Castro::construct_old_source() 120 0.07721 0.07851 0.08209 0.58% MLMG::computeResidual() 128 0.07676 0.07788 0.07887 0.56% FabArray::Saxpy() 264 0.06774 0.06903 0.07512 0.53% MLMG::mgVcycle_down::2 128 0.01231 0.04133 0.07302 0.52% Castro::derive() 18 0.06873 0.07013 0.0715 0.50% AmrLevel::derive() 18 0.06868 0.07008 0.07145 0.50% Castro::construct_new_gravity_source() 17 0.06927 0.07023 0.07128 0.50% MLMG::mgVcycle_bottom 128 0.0003531 0.004747 0.07051 0.50% Castro::create_source_corrector() 17 0.0491 0.05969 0.0704 0.50% MLMG::actualBottomSolve() 128 0.0001285 0.004515 0.07026 0.50% MLCGSolver::bicgstab 8 0 0.004296 0.06874 0.49% Castro::post_timestep() 1 0.05791 0.05991 0.06179 0.44% Castro::construct_old_gravity() 20 0.04319 0.05244 0.06065 0.43% FabArray::Xpay() 945 0.0515 0.05402 0.06054 0.43% Gravity::get_old_grav_vector() 20 0.04219 0.05028 0.05989 0.42% MLMG::mgVcycle_down::3 128 0.01169 0.01781 0.05855 0.41% amrex::average_down 768 0.03248 0.03916 0.05537 0.39% Castro::initialize_advance() 1 0.04913 0.05008 0.0507 0.36% Castro::construct_old_gravity_source() 20 0.04504 0.04578 0.04812 0.34% Castro::check_for_nan() 37 0.04431 0.04477 0.04571 0.32% MultiFab::contains_nan() 37 0.04421 0.04464 0.04559 0.32% Amr::regrid() 1 0.04348 0.04449 0.04506 0.32% Castro::retry_advance_ctu() 11 0.03552 0.03698 0.04287 0.30% MLPoisson::define() 19 0.02935 0.03371 0.03974 0.28% Gravity::get_new_grav_vector() 18 0.03544 0.03616 0.03704 0.26% MLMG::mgVcycle_down::4 128 0.01159 0.0133 0.03439 0.24% StateDataPhysBCFunct::() 147 0.0006892 0.01806 0.03403 0.24% StateData::FillBoundary(geom) 143 0 0.01724 0.03314 0.23% VisMF::Write(FabArray) 4 0.01631 0.01754 0.02884 0.20% Castro::apply_source_to_state() 37 0.02765 0.02802 0.0287 0.20% MLMG::mgVcycle_up::4 128 0.01055 0.01179 0.02682 0.19% Castro::save_data_for_retry() 3 0.01915 0.02019 0.02558 0.18% MLCellLinOp::defineAuxData() 19 0.01858 0.02012 0.02411 0.17% MLMG::prepareForSolve() 18 0.02009 0.02093 0.02315 0.16% MLMG::mgVcycle_down::5 128 0.01159 0.01251 0.02267 0.16% MLMG::ResNormInf() 146 0.01537 0.01811 0.02167 0.15% Castro::sum_integrated_quantities() 2 0.02131 0.0216 0.02162 0.15% MLMG::computeMLResidual() 18 0.01077 0.01556 0.01955 0.14% MLMG::mgVcycle_up::5 128 0.01069 0.01138 0.01926 0.14% Amr::writeSmallPlotFile() 2 0.01563 0.01564 0.01565 0.11% FabArray::norminf() 282 0.01074 0.01115 0.01527 0.11% amrex::Add() 128 0.01434 0.01449 0.01504 0.11% Gravity::test_composite_phi() 1 0.01479 0.01481 0.01484 0.10% FabArrayBase::getCPC() 2005 0.009545 0.01082 0.01421 0.10% FabArrayBase::getFB() 6380 0.01008 0.01083 0.01404 0.10% Castro::problem_post_timestep() 2 0.009158 0.01069 0.01283 0.09% Castro::wd_update() 2 0.009146 0.01066 0.01282 0.09% FabArray::setDomainBndry() 147 0.000451 0.006405 0.01207 0.09% MLLinOp::define() 19 0.004139 0.007758 0.01192 0.08% MLLinOp::defineGrids() 19 0.004039 0.007671 0.01183 0.08% MLLinOp::makeSubCommunicator() 19 0.00118 0.004827 0.008685 0.06% FabArray::mult() 59 0.007395 0.00755 0.008324 0.06% MLMG::getGradSolution() 18 0.007788 0.008007 0.008221 0.06% MLCellLinOp::compGrad() 18 0.007748 0.007965 0.008179 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005054 0.008087 0.06% Castro::volWgtSum() 46 0.007395 0.007484 0.00758 0.05% FabArrayBase::CPC::define() 576 0.00223 0.00334 0.00641 0.05% amrex::Dot() 142 0 0.0003762 0.006019 0.04% MLCellLinOp::defineBC() 19 0.005506 0.005666 0.00587 0.04% Castro::volInBoundary() 14 0.003326 0.003634 0.005475 0.04% Gravity::update_max_rhs() 2 0.001461 0.002578 0.004612 0.03% BndryData::define() 19 0.003933 0.004146 0.004312 0.03% MultiFab::max() 2 0.0002053 0.001319 0.003334 0.02% MLPoisson::normalize() 79 0 0.0001995 0.003193 0.02% Castro::buildMetrics() 1 0.0006399 0.0007741 0.002273 0.02% MLPoisson::prepareForSolve() 19 0.00171 0.00184 0.002126 0.02% MLCellLinOp::prepareForSolve() 19 0.001632 0.001767 0.002055 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001356 0.001566 0.001842 0.01% AmrLevel::AmrLevel(dm) 1 0.001396 0.001542 0.001687 0.01% StateData::define() 6 0.001359 0.001505 0.001634 0.01% FabArrayBase::FB::FB() 75 0.0002727 0.00068 0.001457 0.01% Gravity::swapTimeLevels() 8 0.001127 0.001212 0.001333 0.01% MLMG::MLResNormInf() 18 0.001237 0.001245 0.001254 0.01% MLMG::MLRhsNormInf() 18 0.001188 0.001205 0.001226 0.01% MLMG::compResidual() 1 0.0009385 0.001079 0.001222 0.01% Castro::locWgtSum() 6 0.001122 0.001148 0.001174 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009193 0.0009506 0.001045 0.01% MLCellLinOp::setLevelBC() 19 0.0005408 0.000671 0.0009068 0.01% DistributionMapping::KnapSackDoIt() 1 0.0001803 0.0007498 0.0008104 0.01% Castro::swap_state_time_levels() 8 0.0005987 0.0006754 0.0007668 0.01% DistributionMapping::LeastUsedCPUs() 1 4.076e-05 0.0006684 0.0007298 0.01% makeSFC 95 0.0005945 0.0006155 0.0006899 0.00% Castro::errorEst() 2 0.0005205 0.0005805 0.0006393 0.00% TagBoxArray::collate() 2 0.0001737 0.0003491 0.000557 0.00% Castro::apply_tagging_restrictions() 2 0.0004188 0.0004795 0.0005388 0.00% Gravity::applyMetricTerms() 2 0.0004873 0.0004942 0.0005016 0.00% Castro::enforce_consistent_e() 1 0.0003689 0.000381 0.0004257 0.00% Castro::volProductSum() 2 0.0003883 0.0003978 0.0004036 0.00% Castro::finalize_advance() 1 0.0002624 0.0002802 0.0003122 0.00% Castro::finalize_do_advance() 17 0.0001721 0.0001974 0.000245 0.00% DistributionMapping::Distribute() 95 0.000212 0.0002228 0.000236 0.00% OwnerMask() 2 0.0001325 0.000151 0.0001674 0.00% Amr::initSubcycle() 1 5.52e-05 6.638e-05 0.0001624 0.00% Castro::enforce_speed_limit() 79 0.0001146 0.0001201 0.0001331 0.00% knapsack() 1 5.584e-05 6.257e-05 0.0001112 0.00% Castro::apply_problem_tags() 2 9.339e-05 9.446e-05 9.552e-05 0.00% MultiFab::Swap() 5 6.903e-05 7.472e-05 8.333e-05 0.00% Castro::construct_old_rotation_source() 20 3.03e-05 3.184e-05 3.607e-05 0.00% Castro::construct_new_rotation_source() 17 2.149e-05 2.244e-05 2.79e-05 0.00% Castro::computeInitialDt() 2 9.62e-06 1.12e-05 1.98e-05 0.00% Castro::estTimeStep() 10 1.217e-05 1.365e-05 1.69e-05 0.00% BoxList::parallelComplementIn() 4 1.267e-05 1.325e-05 1.394e-05 0.00% Gravity::set_mass_offset() 2 4.583e-06 6.594e-06 9.127e-06 0.00% Castro::gwstrain() 2 4.494e-06 5.169e-06 8.132e-06 0.00% BoxList::complementIn 4 5.771e-06 6.078e-06 6.332e-06 0.00% Castro::FluxRegCrseInit 1 1.747e-06 2.108e-06 2.571e-06 0.00% Castro::FluxRegFineAdd() 1 1.36e-06 1.566e-06 1.807e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 14 B 19 B 25 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-8-g2cd72a3bbaeb) finalized