Initializing AMReX (24.02-12-g68244ec91d11)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.02-12-g68244ec91d11) initialized Starting run at 09:16:16 UTC on 2024-02-12. Successfully read inputs file ... Castro git describe: 24.02-16-g08d58b44f AMReX git describe: 24.02-12-g68244ec91 Microphysics git describe: 24.02-11-g348ca2f5 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.1775772 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001048813 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.01025758 Gravity::multilevel_solve_for_new_phi() time = 0.099943721 Gravity::fill_multipole_BCs() time = 0.010389978 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.050175145 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.003997703 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002776588 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.063575761 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 1850 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index , 0 Invalid density = -859.0333271 at index 13, 186, 0 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149-859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007974214 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.062796914 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.007920214 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.059237789 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.008038688 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.06076124 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327725826 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015208467 Gravity::solve_for_phi() time = 0.08690461 on level 0 Castro::construct_new_gravity() time = 0.088947753 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060592784 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002551305 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060596712 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324329993 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015251786 Gravity::solve_for_phi() time = 0.087863191 on level 0 Castro::construct_new_gravity() time = 0.089984651 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.061505795 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002811302 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059933476 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329045894 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015480586 Gravity::solve_for_phi() time = 0.087478226 on level 0 Castro::construct_new_gravity() time = 0.08952597 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.061101587 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003432699 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060514664 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329885626 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01582657 Gravity::solve_for_phi() time = 0.087871165 on level 0 Castro::construct_new_gravity() time = 0.089975406 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.060135624 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003360834 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.05905292 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334091585 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015323012 Gravity::solve_for_phi() time = 0.085242255 on level 0 Castro::construct_new_gravity() time = 0.087264183 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.06088942 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002678524 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.059237855 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3296465 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015312639 Gravity::solve_for_phi() time = 0.085316366 on level 0 Castro::construct_new_gravity() time = 0.087430076 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.060816244 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003069729 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.060976391 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.336151785 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015500386 Gravity::solve_for_phi() time = 0.085370129 on level 0 Castro::construct_new_gravity() time = 0.087407048 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060114428 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002627274 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059462134 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330138146 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015266287 Gravity::solve_for_phi() time = 0.085172682 on level 0 Castro::construct_new_gravity() time = 0.087286014 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.059982032 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003009404 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058514033 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332315401 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015797585 Gravity::solve_for_phi() time = 0.085624271 on level 0 Castro::construct_new_gravity() time = 0.087749675 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059156744 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002648233 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058668317 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32674961 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015913283 Gravity::solve_for_phi() time = 0.085571439 on level 0 Castro::construct_new_gravity() time = 0.08767238 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.060441048 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002538459 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.058750232 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330314553 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015231105 Gravity::solve_for_phi() time = 0.084486618 on level 0 Castro::construct_new_gravity() time = 0.086605483 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.058926314 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002620129 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058165977 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.322840296 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01486233 Gravity::solve_for_phi() time = 0.083526002 on level 0 Castro::construct_new_gravity() time = 0.085565193 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059082268 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002515352 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058453044 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327003188 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014844318 Gravity::solve_for_phi() time = 0.083352476 on level 0 Castro::construct_new_gravity() time = 0.085353246 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.059187028 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002553282 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.057856308 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323877445 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014950739 Gravity::solve_for_phi() time = 0.083645804 on level 0 Castro::construct_new_gravity() time = 0.085678053 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.058738972 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.002619049 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058380058 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327669879 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015087511 Gravity::solve_for_phi() time = 0.083563193 on level 0 Castro::construct_new_gravity() time = 0.085666048 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.05891764 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002580626 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058139883 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323161806 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015346738 Gravity::solve_for_phi() time = 0.084102781 on level 0 Castro::construct_new_gravity() time = 0.086204302 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.064499794 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.003025615 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058200456 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327801319 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015334901 Gravity::solve_for_phi() time = 0.084162309 on level 0 Castro::construct_new_gravity() time = 0.086273237 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059331915 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002795578805 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 11.77889987 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.046200882 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.00404222 seconds Ending run at 09:16:30 UTC on 2024-02-12. Run time = 14.02656706 Run time without initialization = 11.82992978 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.03 ... 14.03 ... 14.03 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.4104 5.4373 5.4951 39.18% Amr::InitAmr() 1 1.294 1.295 1.295 9.23% Castro::computeTemp() 80 0.8516 0.9628 1.129 8.05% amrex::Copy() 724 0.7771 0.78 0.7933 5.66% FabArray::ParallelCopy_finish() 1429 0.04162 0.49 0.6941 4.95% MultiFab::AddProduct() 3439 0.5482 0.5598 0.651 4.64% Castro::normalize_species() 79 0.5456 0.5514 0.5782 4.12% Castro::reset_internal_energy(Fab) 160 0.5242 0.5266 0.5337 3.80% MLPoisson::Fsmooth() 6144 0.3161 0.3408 0.4104 2.93% Castro::initMFs() 1 0.3568 0.3702 0.3889 2.77% FabArray::setVal() 5013 0.3417 0.3452 0.3545 2.53% MultiFab::Subtract() 159 0.3338 0.335 0.3417 2.44% Gravity::fill_multipole_BCs() 19 0.1948 0.2355 0.2762 1.97% Castro::reset_internal_energy(MultiFab) 80 0.02233 0.0724 0.2467 1.76% FabArray::ParallelCopy_nowait() 1429 0.1856 0.2014 0.2178 1.55% FabArray::sum() 3439 0.1879 0.1886 0.1933 1.38% check_for_negative_density() 20 0.08105 0.1547 0.1802 1.28% Castro::initData() 1 0.003313 0.0262 0.1536 1.10% FillBoundary_finish() 6380 0.0845 0.1069 0.1339 0.95% FillBoundary_nowait() 6380 0.07134 0.09468 0.1197 0.85% MLPoisson::Fapply() 986 0.09277 0.09694 0.1109 0.79% MLCellLinOp::applyBC() 7148 0.04789 0.0627 0.1039 0.74% FabArray::Saxpy() 264 0.06889 0.07061 0.08173 0.58% Castro::enforce_min_density() 79 0.01727 0.03312 0.08 0.57% Castro::construct_new_gravity_source() 17 0.06941 0.07012 0.07103 0.51% Castro::do_new_sources() 17 0.000344 0.01161 0.06754 0.48% MLMG::addInterpCorrection() 768 0.04915 0.05261 0.06253 0.45% FabArray::Xpay() 945 0.05034 0.05242 0.05946 0.42% Castro::construct_old_gravity_source() 20 0.04473 0.04503 0.0475 0.34% MultiFab::contains_nan() 37 0.04341 0.0438 0.04617 0.33% AmrLevel::derive() 18 0.04048 0.04086 0.04161 0.30% Castro::do_old_sources() 20 0.0004511 0.008639 0.04035 0.29% StateData::FillBoundary(geom) 143 0 0.01688 0.03267 0.23% amrex::average_down 768 0.02463 0.0266 0.03224 0.23% VisMF::Write(FabArray) 4 0.01181 0.01304 0.02567 0.18% Amr::writePlotFile() 2 0.006363 0.01708 0.01848 0.13% Castro::construct_new_source() 102 0.01552 0.01585 0.01781 0.13% MLCellLinOp::defineAuxData() 19 0.01441 0.01514 0.01715 0.12% FabArray::FillBoundary() 6380 0.01365 0.01421 0.01697 0.12% MLCGSolver::bicgstab 8 0 0.0009844 0.01575 0.11% FabArray::norminf() 282 0.01074 0.01117 0.01521 0.11% amrex::Add() 128 0.01393 0.01403 0.01458 0.10% Castro::evaluate_source_change() 196 0.01201 0.01222 0.01303 0.09% MLCellLinOp::smooth() 3072 0.01105 0.01146 0.01259 0.09% FillPatchIterator::Initialize 147 0.01216 0.01232 0.01255 0.09% FabArrayBase::getFB() 6380 0.009826 0.01016 0.01225 0.09% Castro::construct_old_gravity() 20 0.0003408 0.0032 0.01222 0.09% FabArray::setDomainBndry() 147 0.000433 0.006014 0.01137 0.08% Castro::wd_update() 2 0.004855 0.007319 0.0108 0.08% MLMG::prepareForSolve() 18 0.009796 0.01007 0.01074 0.08% Castro::construct_old_source() 120 0.009791 0.009961 0.01043 0.07% MultiFab::max() 2 0.000215 0.006639 0.009297 0.07% MLLinOp::makeSubCommunicator() 19 0.0005738 0.004024 0.007991 0.06% Gravity::actual_solve_with_mlmg() 19 0.006614 0.006868 0.0077 0.05% FabArray::mult() 59 0.007182 0.007301 0.007683 0.05% FabArrayBase::getCPC() 2005 0.00724 0.007389 0.00764 0.05% Castro::volWgtSum() 46 0.007204 0.007232 0.007284 0.05% MLMG::ResNormInf() 146 0.002631 0.004771 0.006734 0.05% Gravity::get_old_grav_vector() 20 0.006339 0.006402 0.00664 0.05% MLMG::solve() 18 0.002095 0.004053 0.00656 0.05% Gravity::get_new_grav_vector() 18 0.005945 0.006122 0.006464 0.05% FabArrayBase::CPC::define() 576 0.002147 0.003247 0.006218 0.04% amrex::Dot() 142 0 0.0003806 0.006089 0.04% MLCellLinOp::compGrad() 18 0.005713 0.005758 0.005852 0.04% Amr::writeSmallPlotFile() 2 0.003539 0.005121 0.005536 0.04% Castro::volInBoundary() 14 0.003407 0.003654 0.005438 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003216 0.005146 0.04% Castro::initialize_do_advance() 20 0.004294 0.004408 0.004568 0.03% MLCellLinOp::apply() 986 0.001997 0.002187 0.004554 0.03% FabArray::ParallelCopy() 1429 0.003442 0.003581 0.003769 0.03% BndryData::define() 19 0.003079 0.003125 0.003419 0.02% MLPoisson::normalize() 79 0 0.0001956 0.00313 0.02% AmrLevel::FillPatch() 147 0.002062 0.002138 0.002396 0.02% Castro::sum_integrated_quantities() 2 0.001862 0.002191 0.002312 0.02% MLLinOp::defineGrids() 19 0.001765 0.001874 0.002189 0.02% MLCellLinOp::prepareForSolve() 19 0.00165 0.001789 0.002107 0.02% MLCellLinOp::correctionResidual() 768 0.001812 0.001849 0.001933 0.01% Castro::construct_new_gravity() 17 0.000266 0.0006298 0.001798 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001329 0.001558 0.00177 0.01% MLMG::mgVcycle() 128 0.001551 0.001617 0.001763 0.01% MLCellLinOp::defineBC() 19 0.001496 0.00155 0.001687 0.01% StateData::define() 6 0.001258 0.00133 0.001654 0.01% MLMG:computeResOfCorrection() 768 0.001426 0.001471 0.001578 0.01% main() 1 0.0009472 0.001129 0.001517 0.01% Gravity::solve_for_phi() 17 0.0007378 0.0009486 0.001412 0.01% FabArrayBase::FB::FB() 75 0.0002711 0.0006621 0.001407 0.01% Castro::save_data_for_retry() 3 0.001224 0.001289 0.001321 0.01% Castro::locWgtSum() 6 0.001115 0.001132 0.001219 0.01% MLMG::actualBottomSolve() 128 0.0001315 0.0001944 0.00107 0.01% Castro::buildMetrics() 1 0.0005496 0.0006132 0.0009459 0.01% StateDataPhysBCFunct::() 147 0.000675 0.0007981 0.0008826 0.01% TagBoxArray::collate() 2 6.231e-05 0.0004259 0.0008671 0.01% MLCellLinOp::setLevelBC() 19 0.0005394 0.0006605 0.000812 0.01% Castro::apply_tagging_restrictions() 2 0.0004256 0.0005032 0.0008008 0.01% Castro::subcycle_advance_ctu() 1 0.0001768 0.0002301 0.0007977 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006824 0.0007038 0.0007619 0.01% Castro::volProductSum() 2 0.0003974 0.0004211 0.0007333 0.01% MLMG::mgVcycle_down::0 128 0.0006636 0.00068 0.0007252 0.01% MLMG::mgVcycle_down::1 128 0.0006504 0.0006643 0.0007129 0.01% MLMG::mgVcycle_down::2 128 0.0006091 0.0006596 0.0006926 0.00% MLMG::mgVcycle_down::3 128 0.0005886 0.0006215 0.0006924 0.00% MLMG::mgVcycle_down::4 128 0.0005748 0.0005971 0.0006698 0.00% MLMG::mgVcycle_down::5 128 0.0005949 0.0006131 0.0006694 0.00% AmrMesh::MakeNewGrids() 2 0.0004897 0.0005187 0.0005667 0.00% Castro::Castro() 1 0.0004499 0.0004778 0.000539 0.00% MLMG::mgVcycle_up::0 128 0.0004676 0.0004799 0.0005252 0.00% MLMG::mgVcycle_up::1 128 0.0004446 0.0004713 0.0005022 0.00% FillPatchSingleLevel 147 0.0004688 0.0004807 0.0004978 0.00% Castro::clean_state() 79 0.0004151 0.0004351 0.0004794 0.00% Gravity::applyMetricTerms() 2 0.0004654 0.0004711 0.0004765 0.00% Castro::do_advance_ctu() 20 0.0004193 0.0004428 0.0004733 0.00% MLMG::mgVcycle_up::4 128 0.0003903 0.0004028 0.0004699 0.00% MLMG::mgVcycle_up::2 128 0.0003899 0.0004221 0.0004675 0.00% MLMG::mgVcycle_up::3 128 0.0003839 0.0004034 0.0004604 0.00% MLMG::mgVcycle_up::5 128 0.0004029 0.0004128 0.0004516 0.00% MLCellLinOp::solutionResidual() 147 0.0004208 0.000432 0.0004511 0.00% makeSFC 95 0.0003703 0.0003862 0.0004394 0.00% MLMG::oneIter() 128 0.0003823 0.0003979 0.0004355 0.00% Castro::swap_state_time_levels() 8 0.0004112 0.0004195 0.0004331 0.00% MLLinOp::makeAgglomeratedDMap 19 0.000329 0.0003426 0.0004154 0.00% Castro::enforce_consistent_e() 1 0.000367 0.0003773 0.0004004 0.00% Castro::problem_post_timestep() 2 1.068e-05 3.371e-05 0.0003571 0.00% DistributionMapping::LeastUsedCPUs() 1 2.357e-05 0.0002381 0.0002787 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002117 0.0002263 0.0002637 0.00% MLMG::computeResidual() 128 0.0002446 0.0002501 0.0002582 0.00% OwnerMask() 2 0.0001309 0.0001857 0.0002516 0.00% MLMG::mgVcycle_bottom 128 0.0002222 0.0002331 0.000251 0.00% DistributionMapping::Distribute() 95 0.0002092 0.0002174 0.0002319 0.00% Castro::finalize_do_advance() 17 0.0001476 0.0001655 0.0001899 0.00% Castro::retry_advance_ctu() 11 5.163e-05 6.267e-05 0.0001854 0.00% Gravity::update_max_rhs() 2 0.000155 0.0001612 0.0001727 0.00% MLMG::compResidual() 1 0.0001554 0.0001598 0.0001654 0.00% Castro::apply_problem_tags() 2 9.167e-05 9.968e-05 0.0001581 0.00% Amr::grid_places() 2 7.613e-05 0.0001157 0.000149 0.00% MLPoisson::define() 19 0.000119 0.0001268 0.0001378 0.00% Amr::defBaseLevel() 1 9.267e-05 0.0001196 0.0001353 0.00% TagBoxArray::mapPRD 2 0.0001075 0.0001183 0.0001344 0.00% Amr::coarseTimeStep() 1 0.0001106 0.0001309 0.0001336 0.00% Gravity::test_composite_phi() 1 8.943e-05 9.665e-05 0.0001275 0.00% Castro::initialize_advance() 1 9.601e-05 0.0001041 0.0001222 0.00% Castro::check_for_nan() 37 0.0001 0.000108 0.000122 0.00% Amr::initSubcycle() 1 5.614e-05 6.571e-05 0.0001218 0.00% Castro::enforce_speed_limit() 79 0.0001043 0.000108 0.0001154 0.00% Castro::apply_source_to_state() 37 9.24e-05 9.687e-05 0.0001051 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.679e-05 7.028e-05 9.949e-05 0.00% knapsack() 1 5.442e-05 6.172e-05 9.265e-05 0.00% MLLinOp::define() 19 7.665e-05 8.186e-05 8.614e-05 0.00% MultiFab::Swap() 5 6.435e-05 6.89e-05 8.464e-05 0.00% AmrLevel::AmrLevel(dm) 1 4.37e-05 6.343e-05 8.356e-05 0.00% MLPoisson::prepareForSolve() 19 6.666e-05 7.198e-05 8.009e-05 0.00% Castro::create_source_corrector() 17 5.369e-05 5.876e-05 6.914e-05 0.00% Amr::FinalizeInit() 1 8.083e-06 2.177e-05 6.488e-05 0.00% Castro::expand_state() 20 4.984e-05 5.359e-05 5.625e-05 0.00% MLMG::computeMLResidual() 18 4.748e-05 4.948e-05 5.543e-05 0.00% Castro::derive() 18 4.016e-05 4.186e-05 4.667e-05 0.00% MLMG::getGradSolution() 18 3.91e-05 4.088e-05 4.373e-05 0.00% Amr::bldFineLevels() 1 6.713e-06 1.342e-05 3.985e-05 0.00% Gravity::actual_multilevel_solve() 1 2.528e-05 2.718e-05 3.94e-05 0.00% MLMG::MLResNormInf() 18 3.363e-05 3.554e-05 3.822e-05 0.00% MLMG::MLRhsNormInf() 18 3.199e-05 3.31e-05 3.811e-05 0.00% Gravity::swapTimeLevels() 8 3.244e-05 3.373e-05 3.554e-05 0.00% Castro::construct_old_rotation_source() 20 2.925e-05 3.046e-05 3.118e-05 0.00% Amr::regrid() 1 1.053e-05 1.445e-05 3.069e-05 0.00% Castro::post_regrid() 2 1.03e-05 1.781e-05 2.836e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.597e-05 1.879e-05 2.421e-05 0.00% BoxList::parallelComplementIn() 4 7.083e-06 8.919e-06 2.377e-05 0.00% Castro::construct_new_rotation_source() 17 2.136e-05 2.232e-05 2.373e-05 0.00% Castro::finalize_advance() 1 1.618e-05 1.735e-05 2.096e-05 0.00% Gravity::set_mass_offset() 2 4.168e-06 1.144e-05 1.981e-05 0.00% Amr::timeStep() 1 1.108e-05 1.263e-05 1.742e-05 0.00% Amr::InitializeInit() 1 6.611e-06 8.514e-06 1.735e-05 0.00% Castro::estTimeStep() 10 1.252e-05 1.33e-05 1.572e-05 0.00% Castro::post_init() 1 1.173e-05 1.272e-05 1.568e-05 0.00% Castro::computeInitialDt() 2 6.595e-06 7.905e-06 1.335e-05 0.00% Castro::errorEst() 2 6.123e-06 7.103e-06 1.242e-05 0.00% Amr::initialInit() 1 2.796e-06 4.12e-06 1.217e-05 0.00% Castro::advance() 1 7.161e-06 8.858e-06 1.095e-05 0.00% BoxList::complementIn 4 5.983e-06 6.691e-06 1.077e-05 0.00% Amr::init() 1 6.48e-06 7.365e-06 8.958e-06 0.00% Castro::gwstrain() 2 4.099e-06 4.727e-06 6.841e-06 0.00% Castro::post_timestep() 1 5.372e-06 5.791e-06 6.609e-06 0.00% Castro::FluxRegCrseInit 1 1.669e-06 1.87e-06 2.162e-06 0.00% Castro::FluxRegFineAdd() 1 1.398e-06 1.551e-06 1.78e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.03 14.03 14.03 100.00% Amr::coarseTimeStep() 1 11.83 11.83 11.83 84.34% Amr::timeStep() 1 11.78 11.78 11.78 83.97% Castro::advance() 1 11.72 11.72 11.72 83.56% Castro::subcycle_advance_ctu() 1 11.67 11.67 11.67 83.21% Castro::do_advance_ctu() 20 11.63 11.63 11.63 82.95% Castro::construct_ctu_hydro_source() 20 6.337 6.374 6.407 45.68% Castro::clean_state() 79 3.701 3.803 3.977 28.35% Castro::computeTemp() 80 2.391 2.508 2.712 19.33% Castro::reset_internal_energy(MultiFab) 80 1.487 1.545 1.713 12.21% Gravity::solve_phi_with_mlmg() 19 1.469 1.513 1.558 11.10% Castro::construct_new_gravity() 17 1.397 1.439 1.482 10.57% Gravity::solve_for_phi() 17 1.359 1.402 1.447 10.32% Castro::initialize_do_advance() 20 1.368 1.392 1.423 10.14% Amr::InitAmr() 1 1.294 1.295 1.295 9.23% Gravity::actual_solve_with_mlmg() 19 1.27 1.274 1.278 9.11% MLMG::solve() 18 1.221 1.225 1.226 8.74% Castro::do_old_sources() 20 1.149 1.171 1.186 8.45% MLMG::oneIter() 128 1.093 1.095 1.098 7.83% MLMG::mgVcycle() 128 1.079 1.081 1.083 7.72% Castro::evaluate_source_change() 196 0.943 0.9557 1.056 7.53% Castro::do_new_sources() 17 0.9438 0.9836 1.024 7.30% FabArray::ParallelCopy() 1429 0.2646 0.7144 0.9166 6.53% Amr::init() 1 0.9009 0.9011 0.9012 6.42% Amr::initialInit() 1 0.8459 0.8461 0.8462 6.03% Castro::enforce_min_density() 79 0.7821 0.8044 0.845 6.02% amrex::Copy() 724 0.7771 0.78 0.7933 5.66% MLCellLinOp::smooth() 3072 0.5384 0.5863 0.7089 5.05% FabArray::ParallelCopy_finish() 1429 0.04162 0.49 0.6941 4.95% MultiFab::AddProduct() 3439 0.5482 0.5598 0.651 4.64% AmrLevel::FillPatch() 147 0.4589 0.5524 0.6398 4.56% Amr::InitializeInit() 1 0.4409 0.5126 0.6168 4.40% Amr::defBaseLevel() 1 0.4409 0.5126 0.6168 4.40% Castro::normalize_species() 79 0.5456 0.5514 0.5782 4.12% Castro::reset_internal_energy(Fab) 160 0.5242 0.5266 0.5337 3.80% FillPatchIterator::Initialize 147 0.2822 0.3752 0.4628 3.30% FillPatchIterator::FillFromLevel0() 147 0.2585 0.3568 0.4462 3.18% FillPatchSingleLevel 147 0.2578 0.3561 0.4454 3.18% MLMG::mgVcycle_up::1 128 0.09261 0.251 0.4106 2.93% MLPoisson::Fsmooth() 6144 0.3161 0.3408 0.4104 2.93% Amr::FinalizeInit() 1 0.2294 0.3335 0.4052 2.89% Castro::Castro() 1 0.3621 0.3756 0.3946 2.81% Castro::initMFs() 1 0.357 0.3704 0.3892 2.77% MLMG::addInterpCorrection() 768 0.08192 0.3123 0.3782 2.70% MLCellLinOp::applyBC() 7148 0.2575 0.2893 0.3595 2.56% FabArray::setVal() 5013 0.3417 0.3452 0.3545 2.53% MultiFab::Subtract() 159 0.3338 0.335 0.3417 2.44% Gravity::fill_multipole_BCs() 19 0.1969 0.2376 0.2783 1.98% MLMG::mgVcycle_up::2 128 0.01072 0.1136 0.2703 1.93% MLMG::mgVcycle_down::0 128 0.2583 0.2598 0.2631 1.88% FabArray::FillBoundary() 6380 0.2034 0.2266 0.2611 1.86% Castro::initData() 1 0.07702 0.1352 0.2409 1.72% FabArray::ParallelCopy_nowait() 1429 0.2044 0.2208 0.2379 1.70% Amr::bldFineLevels() 1 0.04539 0.1507 0.2212 1.58% Castro::expand_state() 20 0.1757 0.1865 0.2056 1.47% MLMG::mgVcycle_up::0 128 0.2035 0.2046 0.2052 1.46% FabArray::sum() 3439 0.1879 0.1886 0.1933 1.38% MLCellLinOp::apply() 986 0.1425 0.1528 0.1873 1.34% check_for_negative_density() 20 0.08105 0.1547 0.1802 1.28% Amr::grid_places() 2 0.002747 0.1069 0.1786 1.27% AmrMesh::MakeNewGrids() 2 0.002604 0.1068 0.1785 1.27% MLMG::mgVcycle_up::3 128 0.01062 0.0235 0.1774 1.26% TagBoxArray::mapPRD 2 0.0007627 0.1051 0.177 1.26% Castro::post_init() 1 0.1327 0.1392 0.1418 1.01% MLMG:computeResOfCorrection() 768 0.1092 0.118 0.1409 1.00% MLCellLinOp::correctionResidual() 768 0.1078 0.1166 0.1393 0.99% FillBoundary_finish() 6380 0.0845 0.1069 0.1339 0.95% Castro::construct_new_source() 102 0.1241 0.1256 0.1319 0.94% FillBoundary_nowait() 6380 0.08153 0.1055 0.131 0.93% MLMG::mgVcycle_down::1 128 0.111 0.1153 0.1184 0.84% MLPoisson::Fapply() 986 0.09277 0.09694 0.1109 0.79% Gravity::multilevel_solve_for_new_phi() 1 0.09992 0.09994 0.09996 0.71% Gravity::actual_multilevel_solve() 1 0.09982 0.09987 0.09989 0.71% Castro::create_source_corrector() 17 0.04707 0.07435 0.09825 0.70% Amr::writePlotFile() 2 0.09693 0.09702 0.09703 0.69% Castro::post_regrid() 2 0.08474 0.08738 0.09383 0.67% MLCellLinOp::solutionResidual() 147 0.08429 0.08929 0.09335 0.67% FabArray::Saxpy() 264 0.06889 0.07061 0.08173 0.58% Castro::construct_old_source() 120 0.07733 0.07798 0.08039 0.57% MLMG::computeResidual() 128 0.07361 0.07397 0.07444 0.53% Castro::construct_old_gravity() 20 0.04558 0.06235 0.07356 0.52% MLMG::mgVcycle_bottom 128 0.0003573 0.004797 0.07122 0.51% Castro::construct_new_gravity_source() 17 0.06941 0.07012 0.07103 0.51% MLMG::actualBottomSolve() 128 0.0001315 0.004564 0.07098 0.51% Castro::derive() 18 0.06873 0.06924 0.07038 0.50% AmrLevel::derive() 18 0.06869 0.0692 0.07034 0.50% MLCGSolver::bicgstab 8 0 0.00434 0.06943 0.50% MLMG::mgVcycle_down::2 128 0.01258 0.03937 0.06831 0.49% Gravity::get_old_grav_vector() 20 0.03811 0.05915 0.06749 0.48% Castro::post_timestep() 1 0.0575 0.05963 0.06183 0.44% FabArray::Xpay() 945 0.05034 0.05242 0.05946 0.42% MLMG::mgVcycle_down::3 128 0.01192 0.01788 0.05809 0.41% Castro::initialize_advance() 1 0.048 0.04928 0.0527 0.38% amrex::average_down 768 0.03273 0.03857 0.05267 0.38% Amr::regrid() 1 0.04352 0.04479 0.04757 0.34% Castro::construct_old_gravity_source() 20 0.04473 0.04503 0.0475 0.34% Castro::check_for_nan() 37 0.04352 0.0439 0.04627 0.33% MultiFab::contains_nan() 37 0.04341 0.0438 0.04617 0.33% MLPoisson::define() 19 0.02844 0.03275 0.03802 0.27% Gravity::get_new_grav_vector() 18 0.03489 0.03615 0.03741 0.27% Castro::retry_advance_ctu() 11 0.03499 0.03529 0.03643 0.26% MLMG::mgVcycle_down::4 128 0.01188 0.01349 0.03444 0.25% Castro::apply_source_to_state() 37 0.02803 0.02853 0.03362 0.24% StateDataPhysBCFunct::() 147 0.000675 0.01768 0.03355 0.24% StateData::FillBoundary(geom) 143 0 0.01688 0.03267 0.23% MLMG::mgVcycle_up::4 128 0.01073 0.01194 0.02782 0.20% VisMF::Write(FabArray) 4 0.01181 0.01304 0.02567 0.18% MLCellLinOp::defineAuxData() 19 0.01856 0.01997 0.02375 0.17% MLMG::prepareForSolve() 18 0.01997 0.02089 0.02292 0.16% MLMG::mgVcycle_down::5 128 0.01183 0.01268 0.02285 0.16% Castro::sum_integrated_quantities() 2 0.02083 0.02109 0.02111 0.15% MLMG::mgVcycle_up::5 128 0.0108 0.01152 0.01963 0.14% Castro::save_data_for_retry() 3 0.01842 0.01862 0.01886 0.13% MLMG::computeMLResidual() 18 0.01022 0.01491 0.01877 0.13% MLMG::ResNormInf() 146 0.01216 0.01431 0.01626 0.12% FabArray::norminf() 282 0.01074 0.01117 0.01521 0.11% amrex::Add() 128 0.01393 0.01403 0.01458 0.10% Castro::problem_post_timestep() 2 0.009369 0.01101 0.01422 0.10% Castro::wd_update() 2 0.009357 0.01097 0.01421 0.10% Gravity::test_composite_phi() 1 0.01382 0.01384 0.01386 0.10% FabArrayBase::getCPC() 2005 0.009458 0.01064 0.01383 0.10% FabArrayBase::getFB() 6380 0.01012 0.01082 0.01366 0.10% FabArray::setDomainBndry() 147 0.000433 0.006014 0.01137 0.08% MLLinOp::define() 19 0.003472 0.006926 0.01114 0.08% MLLinOp::defineGrids() 19 0.003391 0.006844 0.01105 0.08% Gravity::update_max_rhs() 2 0.001416 0.007859 0.0105 0.07% MultiFab::max() 2 0.000215 0.006639 0.009297 0.07% Amr::writeSmallPlotFile() 2 0.008469 0.008469 0.00847 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005273 0.008437 0.06% MLLinOp::makeSubCommunicator() 19 0.0005738 0.004024 0.007991 0.06% FabArray::mult() 59 0.007182 0.007301 0.007683 0.05% MLMG::getGradSolution() 18 0.007307 0.007437 0.00761 0.05% MLCellLinOp::compGrad() 18 0.007266 0.007397 0.007567 0.05% Castro::volWgtSum() 46 0.007204 0.007232 0.007284 0.05% MLCellLinOp::defineBC() 19 0.005477 0.005723 0.006256 0.04% FabArrayBase::CPC::define() 576 0.002147 0.003247 0.006218 0.04% amrex::Dot() 142 0 0.0003806 0.006089 0.04% Castro::volInBoundary() 14 0.003407 0.003654 0.005438 0.04% BndryData::define() 19 0.00397 0.004173 0.004568 0.03% MLPoisson::normalize() 79 0 0.0001956 0.00313 0.02% MLPoisson::prepareForSolve() 19 0.00173 0.001861 0.002178 0.02% MLCellLinOp::prepareForSolve() 19 0.00165 0.001789 0.002107 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001329 0.001558 0.00177 0.01% AmrLevel::AmrLevel(dm) 1 0.001318 0.001393 0.001738 0.01% StateData::define() 6 0.001258 0.00133 0.001654 0.01% FabArrayBase::FB::FB() 75 0.0002711 0.0006621 0.001407 0.01% MLMG::MLResNormInf() 18 0.001244 0.001254 0.001272 0.01% MLMG::compResidual() 1 0.0009314 0.00107 0.001257 0.01% Gravity::swapTimeLevels() 8 0.001144 0.001171 0.001227 0.01% Castro::locWgtSum() 6 0.001115 0.001132 0.001219 0.01% MLMG::MLRhsNormInf() 18 0.001189 0.001201 0.001215 0.01% Castro::buildMetrics() 1 0.0006079 0.0006826 0.001048 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009137 0.0009461 0.001018 0.01% Castro::errorEst() 2 0.0005253 0.00061 0.0009692 0.01% TagBoxArray::collate() 2 6.231e-05 0.0004259 0.0008671 0.01% MLCellLinOp::setLevelBC() 19 0.0005394 0.0006605 0.000812 0.01% Castro::apply_tagging_restrictions() 2 0.0004256 0.0005032 0.0008008 0.01% Castro::volProductSum() 2 0.0003974 0.0004211 0.0007333 0.01% makeSFC 95 0.0005816 0.0006035 0.0006642 0.00% Gravity::applyMetricTerms() 2 0.0004654 0.0004711 0.0004765 0.00% Castro::swap_state_time_levels() 8 0.0004112 0.0004195 0.0004331 0.00% Castro::enforce_consistent_e() 1 0.000367 0.0003773 0.0004004 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001251 0.0003186 0.0003586 0.00% DistributionMapping::LeastUsedCPUs() 1 2.357e-05 0.0002381 0.0002787 0.00% Castro::finalize_advance() 1 0.0002544 0.0002629 0.0002772 0.00% OwnerMask() 2 0.0001309 0.0001857 0.0002516 0.00% DistributionMapping::Distribute() 95 0.0002092 0.0002174 0.0002319 0.00% Castro::finalize_do_advance() 17 0.0001575 0.0001757 0.0001997 0.00% Castro::apply_problem_tags() 2 9.167e-05 9.968e-05 0.0001581 0.00% Amr::initSubcycle() 1 5.614e-05 6.571e-05 0.0001218 0.00% Castro::enforce_speed_limit() 79 0.0001043 0.000108 0.0001154 0.00% knapsack() 1 5.442e-05 6.172e-05 9.265e-05 0.00% MultiFab::Swap() 5 6.435e-05 6.89e-05 8.464e-05 0.00% Castro::construct_old_rotation_source() 20 2.925e-05 3.046e-05 3.118e-05 0.00% BoxList::parallelComplementIn() 4 1.307e-05 1.561e-05 2.987e-05 0.00% Castro::construct_new_rotation_source() 17 2.136e-05 2.232e-05 2.373e-05 0.00% Gravity::set_mass_offset() 2 4.168e-06 1.144e-05 1.981e-05 0.00% Castro::computeInitialDt() 2 9.452e-06 1.11e-05 1.797e-05 0.00% Castro::estTimeStep() 10 1.252e-05 1.33e-05 1.572e-05 0.00% BoxList::complementIn 4 5.983e-06 6.691e-06 1.077e-05 0.00% Castro::gwstrain() 2 4.099e-06 4.727e-06 6.841e-06 0.00% Castro::FluxRegCrseInit 1 1.669e-06 1.87e-06 2.162e-06 0.00% Castro::FluxRegFineAdd() 1 1.398e-06 1.551e-06 1.78e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 11 B 12 B 14 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.02-12-g68244ec91d11) finalized