Initializing AMReX (24.04-2-gf2536be82d98)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.04-2-gf2536be82d98) initialized Starting run at 08:08:15 UTC on 2024-04-02. Successfully read inputs file ... Castro git describe: 24.04 AMReX git describe: 24.04-2-gf2536be82 Microphysics git describe: 24.04 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.5and O = 0.5 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.168907071 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001057565 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.010743428 Gravity::multilevel_solve_for_new_phi() time = 0.10281241 Gravity::fill_multipole_BCs() time = 0.010680438 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.051486206 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004169453 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003406843 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065336066 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = Invalid density = -8.076810125 at index 20, 174, 0 -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = Invalid density = -108.2035501 at index 19, 78, 0 -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.008547945 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.064211841 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.005087761 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.061568018 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 78, 0 Invalid density = -0.1060744788 at index 20, 177, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.00685171 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059948955 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.320899236 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015962477 Gravity::solve_for_phi() time = 0.090974475 on level 0 Castro::construct_new_gravity() time = 0.093063235 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060870477 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.003061917 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.0608009 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32211802 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015862566 Gravity::solve_for_phi() time = 0.088958153 on level 0 Castro::construct_new_gravity() time = 0.0910109 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.060891819 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.003973977 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060851048 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.327431902 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015875172 Gravity::solve_for_phi() time = 0.086586071 on level 0 Castro::construct_new_gravity() time = 0.088621015 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.062333255 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.0027305 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060538637 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33637044 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016320149 Gravity::solve_for_phi() time = 0.092941792 on level 0 Castro::construct_new_gravity() time = 0.094984363 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.061152006 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.00276201 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.060463133 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.335527027 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017285474 Gravity::solve_for_phi() time = 0.090219903 on level 0 Castro::construct_new_gravity() time = 0.092314775 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.063165774 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002761057 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.060226497 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330990992 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01665556 Gravity::solve_for_phi() time = 0.093016706 on level 0 Castro::construct_new_gravity() time = 0.095076934 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.060666925 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002701551 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.061519594 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.339435279 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01684562 Gravity::solve_for_phi() time = 0.087055266 on level 0 Castro::construct_new_gravity() time = 0.089119679 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.060461976 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002819664 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.059880235 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.337780633 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.057963948 Gravity::solve_for_phi() time = 0.146717589 on level 0 Castro::construct_new_gravity() time = 0.148824917 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.06118721 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.004152539 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.05944392 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.342037418 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016420401 Gravity::solve_for_phi() time = 0.093208145 on level 0 Castro::construct_new_gravity() time = 0.095344163 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.081593587 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.005192841 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.061089269 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.332752335 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016787896 Gravity::solve_for_phi() time = 0.089957932 on level 0 Castro::construct_new_gravity() time = 0.092088633 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.060072401 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003820972 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.059136298 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.399842196 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016313842 Gravity::solve_for_phi() time = 0.089955768 on level 0 Castro::construct_new_gravity() time = 0.092119838 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.062275696 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003187552 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.061436787 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3305606 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015851625 Gravity::solve_for_phi() time = 0.089281282 on level 0 Castro::construct_new_gravity() time = 0.09142889 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.066006755 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.004138145 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.060746373 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.342417352 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01781374 Gravity::solve_for_phi() time = 0.088391819 on level 0 Castro::construct_new_gravity() time = 0.094220499 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.064953972 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.004169585 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.059767487 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.333993872 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01821597 Gravity::solve_for_phi() time = 0.093797473 on level 0 Castro::construct_new_gravity() time = 0.095933007 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.062298731 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.007724187 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058266907 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.334443719 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015400945 Gravity::solve_for_phi() time = 0.087297524 on level 0 Castro::construct_new_gravity() time = 0.093052716 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.064660382 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002597184 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.06068782 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329467584 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015718242 Gravity::solve_for_phi() time = 0.087528747 on level 0 Castro::construct_new_gravity() time = 0.089600836 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059480757 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.006934762 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.059843304 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33347932 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01571941 Gravity::solve_for_phi() time = 0.088244093 on level 0 Castro::construct_new_gravity() time = 0.090355077 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.062180409 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.002702891054 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.18350066 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.050250662 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004141485 seconds Ending run at 08:08:29 UTC on 2024-04-02. Run time = 14.44868336 Run time without initialization = 12.23873975 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.45 ... 14.45 ... 14.45 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.3519 5.4431 5.5811 38.63% Amr::InitAmr() 1 1.313 1.314 1.314 9.09% Castro::computeTemp() 80 0.8413 0.9477 1.113 7.71% amrex::Copy() 724 0.7748 0.7942 0.8848 6.12% FabArray::ParallelCopy_finish() 1429 0.06006 0.5928 0.8788 6.08% MultiFab::AddProduct() 3439 0.5596 0.567 0.594 4.11% Castro::normalize_species() 79 0.5469 0.5546 0.5681 3.93% Castro::reset_internal_energy(Fab) 160 0.515 0.5231 0.5376 3.72% MLPoisson::Fsmooth() 6144 0.3154 0.3443 0.422 2.92% Castro::initMFs() 1 0.3572 0.3614 0.3817 2.64% FabArray::setVal() 5013 0.3568 0.3639 0.3811 2.64% MultiFab::Subtract() 159 0.3435 0.3477 0.3567 2.47% check_for_negative_density() 20 0.1064 0.2681 0.3566 2.47% Gravity::fill_multipole_BCs() 19 0.2369 0.2882 0.3359 2.33% Castro::reset_internal_energy(MultiFab) 80 0.02273 0.07641 0.2276 1.57% FabArray::ParallelCopy_nowait() 1429 0.1883 0.2011 0.2213 1.53% FabArray::sum() 3439 0.1843 0.1868 0.1959 1.36% FillBoundary_finish() 6380 0.1307 0.1504 0.1775 1.23% Castro::initData() 1 0.003314 0.02817 0.1647 1.14% FillBoundary_nowait() 6380 0.07979 0.1039 0.134 0.93% MLPoisson::Fapply() 986 0.09474 0.1004 0.1168 0.81% Castro::enforce_min_density() 79 0.01744 0.04222 0.1081 0.75% MLCellLinOp::applyBC() 7148 0.04584 0.0618 0.1048 0.73% Castro::do_new_sources() 17 0.0003871 0.01545 0.08499 0.59% FabArray::Saxpy() 264 0.07166 0.073 0.0804 0.56% Castro::construct_new_gravity_source() 17 0.06882 0.07053 0.07924 0.55% Castro::do_old_sources() 20 0.0005329 0.01336 0.07082 0.49% FabArray::Xpay() 945 0.05122 0.05415 0.06159 0.43% MultiFab::contains_nan() 37 0.04538 0.04625 0.05142 0.36% Castro::construct_old_gravity_source() 20 0.04396 0.04446 0.04605 0.32% MLMG::addInterpCorrection() 768 0.03339 0.03595 0.04315 0.30% AmrLevel::derive() 18 0.04046 0.04082 0.04135 0.29% amrex::average_down 768 0.02503 0.02722 0.03353 0.23% StateData::FillBoundary(geom) 143 0 0.01712 0.03352 0.23% VisMF::Write(FabArray) 4 0.012 0.01357 0.02868 0.20% Castro::construct_old_gravity() 20 0.0003939 0.005823 0.02826 0.20% Castro::construct_new_source() 102 0.01568 0.01647 0.02317 0.16% Amr::writePlotFile() 2 0.007467 0.02087 0.02294 0.16% MLMG::ResNormInf() 146 0.006545 0.01601 0.0183 0.13% MLCellLinOp::defineAuxData() 19 0.01461 0.0153 0.0175 0.12% FabArray::FillBoundary() 6380 0.01325 0.01378 0.01669 0.12% MLCGSolver::bicgstab 8 0 0.001006 0.0161 0.11% FabArray::norminf() 282 0.01102 0.01155 0.01564 0.11% MLMG::solve() 18 0.001189 0.007657 0.0145 0.10% Castro::wd_update() 2 0.005569 0.01026 0.01442 0.10% amrex::Add() 128 0.01408 0.01422 0.0144 0.10% Castro::evaluate_source_change() 196 0.01214 0.01254 0.01318 0.09% FabArrayBase::getFB() 6380 0.009789 0.01034 0.01282 0.09% FillPatchIterator::Initialize 147 0.01218 0.01254 0.0128 0.09% FabArray::setDomainBndry() 147 0.0004405 0.006365 0.01249 0.09% MLCellLinOp::smooth() 3072 0.01105 0.01163 0.01238 0.09% Castro::construct_old_source() 120 0.009869 0.01008 0.01128 0.08% MLMG::prepareForSolve() 18 0.01013 0.01035 0.0111 0.08% Castro::construct_new_gravity() 17 0.0003031 0.002812 0.009772 0.07% FabArray::mult() 59 0.007256 0.007508 0.009054 0.06% Gravity::get_new_grav_vector() 18 0.005973 0.006267 0.009029 0.06% MLLinOp::makeSubCommunicator() 19 0.001433 0.004818 0.008656 0.06% Gravity::actual_solve_with_mlmg() 19 0.006884 0.007147 0.008133 0.06% FabArrayBase::getCPC() 2005 0.007133 0.007344 0.007665 0.05% Castro::volWgtSum() 46 0.007225 0.007356 0.007562 0.05% Gravity::get_old_grav_vector() 20 0.006314 0.006446 0.006929 0.05% FabArrayBase::CPC::define() 576 0.002145 0.003295 0.006389 0.04% amrex::Dot() 142 0 0.0003812 0.0061 0.04% MLCellLinOp::compGrad() 18 0.005767 0.005839 0.005912 0.04% MultiFab::max() 2 0.0001643 0.003654 0.005873 0.04% Amr::writeSmallPlotFile() 2 0.003671 0.005285 0.00574 0.04% Castro::volInBoundary() 14 0.003468 0.003722 0.005484 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003095 0.004953 0.03% Castro::initialize_do_advance() 20 0.004348 0.004462 0.004824 0.03% MLCellLinOp::apply() 986 0.001985 0.002218 0.004665 0.03% FabArray::ParallelCopy() 1429 0.003358 0.003522 0.003838 0.03% BndryData::define() 19 0.003039 0.003118 0.003364 0.02% MLPoisson::normalize() 79 0 0.0001969 0.00315 0.02% Castro::sum_integrated_quantities() 2 0.001885 0.002488 0.002828 0.02% AmrLevel::FillPatch() 147 0.002171 0.002244 0.002333 0.02% MLLinOp::defineGrids() 19 0.001738 0.001865 0.002178 0.02% MLCellLinOp::prepareForSolve() 19 0.001647 0.001802 0.002143 0.01% MLCellLinOp::correctionResidual() 768 0.001816 0.00188 0.001944 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001361 0.001578 0.001885 0.01% MLMG::mgVcycle() 128 0.001563 0.001646 0.001822 0.01% MLCellLinOp::defineBC() 19 0.001477 0.001517 0.001611 0.01% MLMG:computeResOfCorrection() 768 0.001375 0.001431 0.001529 0.01% FabArrayBase::FB::FB() 75 0.0002823 0.0006797 0.001445 0.01% Castro::save_data_for_retry() 3 0.001247 0.0013 0.001421 0.01% Gravity::solve_for_phi() 17 0.0008381 0.000987 0.001382 0.01% StateData::define() 6 0.001341 0.00136 0.001376 0.01% main() 1 0.0009744 0.001139 0.001301 0.01% Castro::locWgtSum() 6 0.001119 0.001135 0.001197 0.01% MLMG::actualBottomSolve() 128 0.000132 0.0001979 0.001104 0.01% TagBoxArray::collate() 2 0.0001434 0.0005403 0.001045 0.01% StateDataPhysBCFunct::() 147 0.0006806 0.0008052 0.000888 0.01% MLCellLinOp::setLevelBC() 19 0.0005288 0.0006529 0.0008212 0.01% Castro::subcycle_advance_ctu() 1 0.000185 0.0002389 0.0008183 0.01% FillPatchIterator::FillFromLevel0() 147 0.0006948 0.0007173 0.0007522 0.01% MLMG::mgVcycle_down::3 128 0.0005639 0.0006135 0.000715 0.00% MLMG::mgVcycle_down::2 128 0.0006113 0.0006608 0.0007143 0.00% MLMG::mgVcycle_down::1 128 0.0006496 0.000669 0.0007002 0.00% MLMG::mgVcycle_down::0 128 0.0006522 0.0006737 0.0006931 0.00% MLMG::mgVcycle_down::4 128 0.0005459 0.0005717 0.0006792 0.00% MLMG::mgVcycle_down::5 128 0.0005699 0.0005904 0.0006724 0.00% Castro::Castro() 1 0.0005225 0.0005689 0.0006407 0.00% Castro::buildMetrics() 1 0.0005744 0.0005893 0.0006049 0.00% Castro::apply_tagging_restrictions() 2 0.0004322 0.0004933 0.0005564 0.00% AmrMesh::MakeNewGrids() 2 0.0004906 0.000508 0.0005321 0.00% Castro::clean_state() 79 0.0004475 0.0004751 0.0005281 0.00% FillPatchSingleLevel 147 0.0004653 0.0004841 0.0005064 0.00% MLMG::mgVcycle_up::1 128 0.0004583 0.0004791 0.0005058 0.00% Gravity::applyMetricTerms() 2 0.0004789 0.0004866 0.0004924 0.00% MLMG::mgVcycle_up::0 128 0.0004629 0.0004744 0.0004837 0.00% MLMG::mgVcycle_up::2 128 0.0003825 0.0004257 0.0004745 0.00% Castro::do_advance_ctu() 20 0.0004238 0.0004391 0.0004583 0.00% MLCellLinOp::solutionResidual() 147 0.0004265 0.0004401 0.0004582 0.00% MLMG::mgVcycle_up::3 128 0.0003794 0.0003949 0.0004577 0.00% MLMG::mgVcycle_up::5 128 0.000391 0.0004027 0.0004521 0.00% makeSFC 95 0.0003672 0.0003945 0.0004435 0.00% MLMG::mgVcycle_up::4 128 0.000381 0.0003926 0.0004393 0.00% MLMG::oneIter() 128 0.0003857 0.0004043 0.0004375 0.00% Castro::swap_state_time_levels() 8 0.0004152 0.0004256 0.000436 0.00% Castro::volProductSum() 2 0.0003991 0.0004113 0.0004313 0.00% Castro::enforce_consistent_e() 1 0.0003632 0.0003762 0.0003985 0.00% Castro::finalize_do_advance() 17 0.0001586 0.0001835 0.0003873 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003224 0.0003412 0.0003851 0.00% Castro::problem_post_timestep() 2 1.109e-05 3.386e-05 0.0003528 0.00% DistributionMapping::Distribute() 95 0.0002127 0.0002228 0.0002667 0.00% Gravity::solve_phi_with_mlmg() 19 0.0002172 0.0002351 0.0002657 0.00% MLMG::computeResidual() 128 0.000235 0.0002418 0.0002502 0.00% MLMG::mgVcycle_bottom 128 0.0002196 0.0002273 0.0002463 0.00% Gravity::update_max_rhs() 2 0.0001609 0.0001652 0.000179 0.00% Amr::coarseTimeStep() 1 0.0001296 0.0001607 0.0001785 0.00% OwnerMask() 2 0.0001382 0.000153 0.000169 0.00% MLMG::compResidual() 1 0.0001537 0.0001574 0.0001614 0.00% MLPoisson::define() 19 0.0001309 0.0001383 0.0001509 0.00% Amr::defBaseLevel() 1 0.0001181 0.0001267 0.0001371 0.00% Castro::initialize_advance() 1 0.0001111 0.0001171 0.0001365 0.00% Castro::retry_advance_ctu() 11 5.2e-05 6.66e-05 0.0001317 0.00% Castro::check_for_nan() 37 0.0001009 0.0001072 0.0001242 0.00% TagBoxArray::mapPRD 2 0.0001122 0.0001178 0.0001241 0.00% Amr::grid_places() 2 7.849e-05 9.767e-05 0.0001208 0.00% Castro::enforce_speed_limit() 79 0.0001044 0.0001103 0.0001182 0.00% Gravity::test_composite_phi() 1 9.053e-05 9.709e-05 0.000114 0.00% Castro::apply_source_to_state() 37 9.39e-05 9.749e-05 0.0001031 0.00% Castro::apply_problem_tags() 2 9.318e-05 9.478e-05 9.934e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.062e-05 6.81e-05 8.914e-05 0.00% MLLinOp::define() 19 7.481e-05 8.182e-05 8.745e-05 0.00% MLPoisson::prepareForSolve() 19 6.663e-05 7.194e-05 8.172e-05 0.00% MultiFab::Swap() 5 6.82e-05 7.175e-05 8e-05 0.00% Castro::create_source_corrector() 17 5.567e-05 6.135e-05 6.837e-05 0.00% knapsack() 1 5.698e-05 5.828e-05 6.145e-05 0.00% Castro::expand_state() 20 5.237e-05 5.61e-05 6.139e-05 0.00% Castro::derive() 18 4.224e-05 4.474e-05 6.058e-05 0.00% Amr::initSubcycle() 1 5.545e-05 5.894e-05 6.017e-05 0.00% Amr::FinalizeInit() 1 1.111e-05 1.864e-05 5.949e-05 0.00% MLMG::computeMLResidual() 18 3.791e-05 4.306e-05 5.056e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 2.999e-05 4.049e-05 4.832e-05 0.00% MLMG::getGradSolution() 18 4.012e-05 4.176e-05 4.603e-05 0.00% MLMG::MLResNormInf() 18 3.298e-05 3.59e-05 4.11e-05 0.00% Gravity::swapTimeLevels() 8 3.157e-05 3.404e-05 3.674e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.128e-05 3.461e-05 3.607e-05 0.00% MLMG::MLRhsNormInf() 18 3.006e-05 3.144e-05 3.541e-05 0.00% Castro::construct_old_rotation_source() 20 2.963e-05 3.107e-05 3.218e-05 0.00% Amr::regrid() 1 1.089e-05 1.261e-05 3.021e-05 0.00% Castro::estTimeStep() 10 1.204e-05 1.704e-05 2.97e-05 0.00% Gravity::actual_multilevel_solve() 1 2.643e-05 2.755e-05 2.848e-05 0.00% Castro::finalize_advance() 1 1.664e-05 1.848e-05 2.439e-05 0.00% Castro::computeInitialDt() 2 6.702e-06 8.109e-06 2.384e-05 0.00% Castro::construct_new_rotation_source() 17 2.144e-05 2.199e-05 2.268e-05 0.00% Amr::timeStep() 1 1.218e-05 1.553e-05 2.073e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.639e-05 1.767e-05 1.984e-05 0.00% Amr::InitializeInit() 1 7.081e-06 9.605e-06 1.925e-05 0.00% Castro::post_init() 1 1.214e-05 1.294e-05 1.415e-05 0.00% Castro::post_regrid() 2 1.067e-05 1.148e-05 1.348e-05 0.00% Castro::advance() 1 6.949e-06 8.095e-06 1.284e-05 0.00% Castro::post_timestep() 1 5.823e-06 6.89e-06 1.13e-05 0.00% Amr::init() 1 6.985e-06 7.631e-06 1.019e-05 0.00% Amr::bldFineLevels() 1 6.956e-06 8.005e-06 9.633e-06 0.00% Castro::gwstrain() 2 4.41e-06 4.963e-06 8.094e-06 0.00% BoxList::parallelComplementIn() 4 6.956e-06 7.178e-06 7.501e-06 0.00% Castro::errorEst() 2 6.203e-06 6.422e-06 6.657e-06 0.00% BoxList::complementIn 4 6.005e-06 6.157e-06 6.459e-06 0.00% Gravity::set_mass_offset() 2 4.386e-06 4.732e-06 5.225e-06 0.00% Amr::initialInit() 1 2.844e-06 3.08e-06 3.378e-06 0.00% Castro::FluxRegCrseInit 1 1.599e-06 2.03e-06 2.511e-06 0.00% Castro::FluxRegFineAdd() 1 1.452e-06 1.619e-06 2.161e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.45 14.45 14.45 100.00% Amr::coarseTimeStep() 1 12.24 12.24 12.24 84.70% Amr::timeStep() 1 12.18 12.18 12.18 84.32% Castro::advance() 1 12.12 12.12 12.12 83.91% Castro::subcycle_advance_ctu() 1 12.07 12.07 12.07 83.54% Castro::do_advance_ctu() 20 12.03 12.03 12.03 83.27% Castro::construct_ctu_hydro_source() 20 6.456 6.499 6.53 45.20% Castro::clean_state() 79 3.679 3.835 4.05 28.03% Castro::computeTemp() 80 2.361 2.513 2.768 19.16% Castro::reset_internal_energy(MultiFab) 80 1.487 1.565 1.723 11.92% Gravity::solve_phi_with_mlmg() 19 1.589 1.643 1.693 11.72% Castro::construct_new_gravity() 17 1.529 1.573 1.622 11.23% Gravity::solve_for_phi() 17 1.477 1.53 1.579 10.93% Castro::initialize_do_advance() 20 1.423 1.484 1.531 10.60% Gravity::actual_solve_with_mlmg() 19 1.348 1.351 1.356 9.38% Amr::InitAmr() 1 1.313 1.314 1.314 9.09% MLMG::solve() 18 1.297 1.301 1.302 9.01% Castro::do_old_sources() 20 1.167 1.196 1.208 8.36% MLMG::oneIter() 128 1.145 1.147 1.15 7.96% MLMG::mgVcycle() 128 1.13 1.133 1.135 7.86% FabArray::ParallelCopy() 1429 0.2901 0.8172 1.098 7.60% Castro::do_new_sources() 17 0.9391 0.997 1.073 7.43% Castro::evaluate_source_change() 196 0.9586 0.9712 1.018 7.05% Amr::init() 1 0.8957 0.8957 0.8957 6.20% Castro::enforce_min_density() 79 0.7937 0.8298 0.8952 6.20% amrex::Copy() 724 0.7748 0.7942 0.8848 6.12% FabArray::ParallelCopy_finish() 1429 0.06006 0.5928 0.8788 6.08% Amr::initialInit() 1 0.8392 0.8393 0.8393 5.81% AmrLevel::FillPatch() 147 0.4863 0.6466 0.7796 5.40% MLCellLinOp::smooth() 3072 0.5779 0.6297 0.7649 5.29% Amr::InitializeInit() 1 0.4425 0.5082 0.6099 4.22% Amr::defBaseLevel() 1 0.4425 0.5082 0.6099 4.22% FillPatchIterator::Initialize 147 0.3048 0.4659 0.6033 4.18% MultiFab::AddProduct() 3439 0.5596 0.567 0.594 4.11% FillPatchIterator::FillFromLevel0() 147 0.2797 0.447 0.5863 4.06% FillPatchSingleLevel 147 0.279 0.4462 0.5855 4.05% Castro::normalize_species() 79 0.5469 0.5546 0.5681 3.93% Castro::reset_internal_energy(Fab) 160 0.515 0.5231 0.5376 3.72% MLMG::mgVcycle_up::1 128 0.09867 0.2687 0.4383 3.03% MLPoisson::Fsmooth() 6144 0.3154 0.3443 0.422 2.92% MLCellLinOp::applyBC() 7148 0.3026 0.3409 0.4151 2.87% Amr::FinalizeInit() 1 0.2294 0.3311 0.3968 2.75% Castro::Castro() 1 0.3632 0.3677 0.389 2.69% MLMG::addInterpCorrection() 768 0.06557 0.3101 0.3839 2.66% Castro::initMFs() 1 0.3574 0.3616 0.3819 2.64% FabArray::setVal() 5013 0.3568 0.3639 0.3811 2.64% MultiFab::Subtract() 159 0.3435 0.3477 0.3567 2.47% check_for_negative_density() 20 0.1064 0.2681 0.3566 2.47% Gravity::fill_multipole_BCs() 19 0.2391 0.2903 0.338 2.34% FabArray::FillBoundary() 6380 0.244 0.2791 0.3177 2.20% Castro::expand_state() 20 0.1826 0.2498 0.3041 2.10% MLMG::mgVcycle_down::0 128 0.2707 0.2739 0.2834 1.96% MLMG::mgVcycle_up::2 128 0.01068 0.1185 0.2824 1.95% Castro::initData() 1 0.07744 0.1388 0.2436 1.69% FabArray::ParallelCopy_nowait() 1429 0.2075 0.2209 0.242 1.67% Amr::bldFineLevels() 1 0.04688 0.1486 0.213 1.47% MLMG::mgVcycle_up::0 128 0.2008 0.2022 0.2036 1.41% MLCellLinOp::apply() 986 0.1532 0.168 0.2031 1.41% FabArray::sum() 3439 0.1843 0.1868 0.1959 1.36% MLMG::mgVcycle_up::3 128 0.01055 0.0235 0.1785 1.24% FillBoundary_finish() 6380 0.1307 0.1504 0.1775 1.23% Amr::grid_places() 2 0.002548 0.1043 0.17 1.18% AmrMesh::MakeNewGrids() 2 0.002427 0.1042 0.1699 1.18% TagBoxArray::mapPRD 2 0.0008157 0.1024 0.1684 1.17% MLMG:computeResOfCorrection() 768 0.1149 0.1265 0.1501 1.04% MLCellLinOp::correctionResidual() 768 0.1135 0.1251 0.1486 1.03% FillBoundary_nowait() 6380 0.09017 0.1149 0.1464 1.01% Castro::post_init() 1 0.1355 0.139 0.1412 0.98% MLMG::mgVcycle_down::1 128 0.1255 0.1304 0.1366 0.95% Castro::construct_new_source() 102 0.1252 0.1281 0.1366 0.95% Castro::create_source_corrector() 17 0.0486 0.0871 0.122 0.84% MLPoisson::Fapply() 986 0.09474 0.1004 0.1168 0.81% MLCellLinOp::solutionResidual() 147 0.09158 0.09773 0.1118 0.77% Gravity::multilevel_solve_for_new_phi() 1 0.1027 0.1028 0.1028 0.71% Gravity::actual_multilevel_solve() 1 0.1027 0.1027 0.1028 0.71% Amr::writePlotFile() 2 0.1023 0.1024 0.1024 0.71% Castro::post_regrid() 2 0.08555 0.08774 0.09125 0.63% MLMG::computeResidual() 128 0.07648 0.07839 0.08776 0.61% FabArray::Saxpy() 264 0.07166 0.073 0.0804 0.56% Castro::construct_old_source() 120 0.07753 0.07852 0.08006 0.55% Castro::construct_old_gravity() 20 0.05056 0.06674 0.07981 0.55% Castro::construct_new_gravity_source() 17 0.06882 0.07053 0.07924 0.55% MLMG::mgVcycle_down::2 128 0.01235 0.04205 0.0753 0.52% Castro::derive() 18 0.06907 0.07013 0.07472 0.52% AmrLevel::derive() 18 0.06902 0.07009 0.07467 0.52% Gravity::get_old_grav_vector() 20 0.04134 0.06092 0.07441 0.51% MLMG::mgVcycle_bottom 128 0.0003545 0.004816 0.0716 0.50% MLMG::actualBottomSolve() 128 0.000132 0.004589 0.07136 0.49% MLCGSolver::bicgstab 8 0 0.004361 0.06978 0.48% Castro::post_timestep() 1 0.06014 0.06373 0.06728 0.47% MLMG::mgVcycle_down::3 128 0.01169 0.01811 0.0619 0.43% FabArray::Xpay() 945 0.05122 0.05415 0.06159 0.43% amrex::average_down 768 0.03325 0.04033 0.05656 0.39% Castro::initialize_advance() 1 0.04904 0.05047 0.05238 0.36% Castro::check_for_nan() 37 0.04548 0.04636 0.05153 0.36% MultiFab::contains_nan() 37 0.04538 0.04625 0.05142 0.36% Gravity::get_new_grav_vector() 18 0.03515 0.03957 0.04904 0.34% Amr::regrid() 1 0.04409 0.04535 0.04746 0.33% Castro::construct_old_gravity_source() 20 0.04396 0.04446 0.04605 0.32% Castro::retry_advance_ctu() 11 0.03589 0.03715 0.0413 0.29% MLPoisson::define() 19 0.02965 0.03365 0.03985 0.28% MLMG::mgVcycle_down::4 128 0.01162 0.01337 0.03513 0.24% StateDataPhysBCFunct::() 147 0.0006806 0.01792 0.0344 0.24% StateData::FillBoundary(geom) 143 0 0.01712 0.03352 0.23% Castro::apply_source_to_state() 37 0.02903 0.02943 0.02982 0.21% VisMF::Write(FabArray) 4 0.012 0.01357 0.02868 0.20% MLMG::ResNormInf() 146 0.01716 0.02584 0.02798 0.19% MLMG::mgVcycle_up::4 128 0.0106 0.0118 0.02733 0.19% MLMG::prepareForSolve() 18 0.02041 0.02149 0.02483 0.17% MLMG::computeMLResidual() 18 0.01312 0.01887 0.02456 0.17% MLCellLinOp::defineAuxData() 19 0.01865 0.02009 0.02419 0.17% Castro::save_data_for_retry() 3 0.01851 0.01923 0.0235 0.16% MLMG::mgVcycle_down::5 128 0.01161 0.01254 0.02314 0.16% Castro::sum_integrated_quantities() 2 0.02137 0.02162 0.02164 0.15% MLMG::mgVcycle_up::5 128 0.01069 0.01144 0.01958 0.14% Castro::problem_post_timestep() 2 0.009214 0.01401 0.01791 0.12% Castro::wd_update() 2 0.009199 0.01398 0.0179 0.12% FabArray::norminf() 282 0.01102 0.01155 0.01564 0.11% amrex::Add() 128 0.01408 0.01422 0.0144 0.10% FabArrayBase::getFB() 6380 0.01014 0.01102 0.01427 0.10% Gravity::test_composite_phi() 1 0.01415 0.01418 0.01421 0.10% FabArrayBase::getCPC() 2005 0.009358 0.01064 0.01405 0.10% FabArray::setDomainBndry() 147 0.0004405 0.006365 0.01249 0.09% MLLinOp::define() 19 0.004253 0.007724 0.0119 0.08% MLLinOp::defineGrids() 19 0.004175 0.007642 0.01181 0.08% FabArray::mult() 59 0.007256 0.007508 0.009054 0.06% Amr::writeSmallPlotFile() 2 0.008712 0.008716 0.008724 0.06% MLLinOp::makeSubCommunicator() 19 0.001433 0.004818 0.008656 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005173 0.008276 0.06% MLMG::getGradSolution() 18 0.007493 0.007678 0.007964 0.06% MLCellLinOp::compGrad() 18 0.007451 0.007636 0.007923 0.05% Castro::volWgtSum() 46 0.007225 0.007356 0.007562 0.05% Gravity::update_max_rhs() 2 0.0014 0.004905 0.007115 0.05% FabArrayBase::CPC::define() 576 0.002145 0.003295 0.006389 0.04% MLCellLinOp::defineBC() 19 0.005565 0.005696 0.006166 0.04% amrex::Dot() 142 0 0.0003812 0.0061 0.04% MultiFab::max() 2 0.0001643 0.003654 0.005873 0.04% Castro::volInBoundary() 14 0.003468 0.003722 0.005484 0.04% BndryData::define() 19 0.004003 0.004179 0.004583 0.03% MLPoisson::normalize() 79 0 0.0001969 0.00315 0.02% MLPoisson::prepareForSolve() 19 0.001729 0.001874 0.002219 0.02% MLCellLinOp::prepareForSolve() 19 0.001647 0.001802 0.002143 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001361 0.001578 0.001885 0.01% MLMG::MLResNormInf() 18 0.001263 0.001301 0.00163 0.01% MLMG::MLRhsNormInf() 18 0.00123 0.001268 0.001592 0.01% FabArrayBase::FB::FB() 75 0.0002823 0.0006797 0.001445 0.01% AmrLevel::AmrLevel(dm) 1 0.001377 0.001395 0.00141 0.01% StateData::define() 6 0.001341 0.00136 0.001376 0.01% Gravity::swapTimeLevels() 8 0.001196 0.001234 0.001338 0.01% MLMG::compResidual() 1 0.0009721 0.001115 0.001262 0.01% Castro::locWgtSum() 6 0.001119 0.001135 0.001197 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0009065 0.0009585 0.001094 0.01% TagBoxArray::collate() 2 0.0001434 0.0005403 0.001045 0.01% MLCellLinOp::setLevelBC() 19 0.0005288 0.0006529 0.0008212 0.01% makeSFC 95 0.0005841 0.0006173 0.0007084 0.00% Castro::buildMetrics() 1 0.0006375 0.0006535 0.0006706 0.00% Castro::errorEst() 2 0.0005325 0.0005945 0.0006571 0.00% Castro::apply_tagging_restrictions() 2 0.0004322 0.0004933 0.0005564 0.00% Gravity::applyMetricTerms() 2 0.0004789 0.0004866 0.0004924 0.00% Castro::swap_state_time_levels() 8 0.0004152 0.0004256 0.000436 0.00% Castro::volProductSum() 2 0.0003991 0.0004113 0.0004313 0.00% Castro::enforce_consistent_e() 1 0.0003632 0.0003762 0.0003985 0.00% Castro::finalize_do_advance() 17 0.000168 0.0001933 0.0003968 0.00% Castro::finalize_advance() 1 0.0002533 0.0002695 0.0003468 0.00% DistributionMapping::Distribute() 95 0.0002127 0.0002228 0.0002667 0.00% OwnerMask() 2 0.0001382 0.000153 0.000169 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001043 0.0001164 0.0001275 0.00% Castro::enforce_speed_limit() 79 0.0001044 0.0001103 0.0001182 0.00% Castro::apply_problem_tags() 2 9.318e-05 9.478e-05 9.934e-05 0.00% MultiFab::Swap() 5 6.82e-05 7.175e-05 8e-05 0.00% knapsack() 1 5.698e-05 5.828e-05 6.145e-05 0.00% Amr::initSubcycle() 1 5.545e-05 5.894e-05 6.017e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 2.999e-05 4.049e-05 4.832e-05 0.00% Castro::construct_old_rotation_source() 20 2.963e-05 3.107e-05 3.218e-05 0.00% Castro::estTimeStep() 10 1.204e-05 1.704e-05 2.97e-05 0.00% Castro::computeInitialDt() 2 9.763e-06 1.531e-05 2.759e-05 0.00% Castro::construct_new_rotation_source() 17 2.144e-05 2.199e-05 2.268e-05 0.00% BoxList::parallelComplementIn() 4 1.297e-05 1.334e-05 1.396e-05 0.00% Castro::gwstrain() 2 4.41e-06 4.963e-06 8.094e-06 0.00% BoxList::complementIn 4 6.005e-06 6.157e-06 6.459e-06 0.00% Gravity::set_mass_offset() 2 4.386e-06 4.732e-06 5.225e-06 0.00% Castro::FluxRegCrseInit 1 1.599e-06 2.03e-06 2.511e-06 0.00% Castro::FluxRegFineAdd() 1 1.452e-06 1.619e-06 2.161e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 12 B 13 B 17 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-2-gf2536be82d98) finalized