Initializing AMReX (24.01-31-gab99ea69089f)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (24.01-31-gab99ea69089f) initialized Starting run at 08:48:21 UTC on 2024-01-30. Successfully read inputs file ... Castro git describe: 24.01-24-g6d8abef7c AMReX git describe: 24.01-31-gab99ea690 Microphysics git describe: 24.01-19-g6d5a4e1a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Generated initial model for secondary WD of mass 0.64 solar masses, central density 4.500e+06 g cm**-3, and radius 8.734e+08 cm. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data grid_places() time: 0.168740474 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.000998071 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.011478577 Gravity::multilevel_solve_for_new_phi() time = 0.101114597 Gravity::fill_multipole_BCs() time = 0.011547264 ... norm of composite residual at level 0 1.193955541e-11 TIME= 0 MASS = 2.549996568e+33 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = -3.115378115e+34 TIME= 0 RHO*e = 1.325915365e+50 TIME= 0 RHO*K = 3.09960185e+49 TIME= 0 RHO*E = 1.63587555e+50 TIME= 0 RHO*PHI = -5.434813569e+50 TIME= 0 TOTAL ENERGY= -1.081531234e+50 TIME= 0 CENTER OF MASS X-LOC = 316439254.4 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = -4.854673355e-07 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 0 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 10000000 TIME= 0 MAXIMUM DENSITY = 4476474 TIME= 0 MAXIMUM T_S / T_E = 0 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_retry-SDC_plt00000 Write plotfile time = 0.047614029 seconds SMALL PLOTFILE: file = smallplt00000 Write small plotfile time = 0.004682974 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.25  Beginning subcycle 1 starting at time 0 with dt = 0.25 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003223489 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.111789233e+47 ener added: 3.959219145e+48 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.174137392e+41 ymom added: 6.491992098e+28 zmom added: 0 eint added: 0 ener added: 6.931398274e+47 Castro::do_old_sources() time = 0.065066587 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -9.947567811e-05 at index 0, 62, 0 Invalid density = -1.942940124 at index 0, 63, 0 Invalid density = -1.164962232 at index 1, 63, 0 Invalid density = -0.767071355 at index 2, 63, 0 Invalid density = -0.08878802337 at index 3, 63, 0 Invalid density = -0.01174181879 at index 4, 63, 0 Invalid density = -0.0008017363671 at index 5, 63, 0 Invalid density = -1.942940124 at index 0, 192, 0 Invalid density = -1.164962232 at index 1, 192, 0 Invalid density = -0.767071355 at index 2, 192, 0 Invalid density = -0.08878802337 at index 3, 192, 0 Invalid density = -0.01174181879 at index 4, 192, 0 Invalid density = -0.0008017363671 at index 5, 192, 0 Invalid density = -9.947567811e-05 at index 0, 193, 0 Invalid density = -8.076810125 at index 20, 174, 0 Invalid density = -15.15828486 at index 20, 175, 0 Invalid density = -108.2035501 at index 19, 177, 0 Invalid density = -61.58489855 at index 19, 178, 0 Invalid density = -80.16477042 at index 18, 179, 0 Invalid density = -160.2179808 at index 18, 180, 0 Invalid density = -552.7694089 at index 17, 181, 0 Invalid density = -415.2911996 at index 16, 183, 0 Invalid density = -764.1508347 at index 15, 184, 0 Invalid density = -908.1731819 at index 14, 185, 0 Invalid density = -859.0333271 at index 13, 186, 0 Invalid density = -606.7538937 at index 12, 187, 0 Invalid density = -907.0826581 at index 10, 188, 0 Invalid density = -241.113047 at index 11, 188, 0 Invalid density = -820.8014889 at index 8, 189, 0 Invalid density = -456.4708539 at index 9, 189, 0 Invalid density = -6.239071149 at index 10, 189, 0 Invalid density = -625.0368072 at index 5, 190, 0 Invalid density = -691.1269281 at index 6, 190, 0 Invalid density = -318.5467376 at index 7, 190, 0 Invalid density = -11.08517908 at index 8, 190, 0 Invalid density = -618.7284155 at index 0, 191, 0 Invalid density = -540.6137805 at index 1, 191, 0 Invalid density = -443.905673 at index 2, 191, 0 Invalid density = -302.5298758 at index 3, 191, 0 Invalid density = -167.9940382 at index 4, 191, 0 Invalid density = -55.18215035 at index 5, 191, 0 Invalid density = -1.089487306 at index 6, 191, 0 Invalid density = -618.7284155 at index 0, 64, 0 Invalid density = -540.6137805 at index 1, 64, 0 Invalid density = -443.905673 at index 2, 64, 0 Invalid density = -302.5298758 at index 3, 64, 0 Invalid density = -167.9940382 at index 4, 64, 0 Invalid density = -55.18215035 at index 5, 64, 0 Invalid density = -1.089487306 at index 6, 64, 0 Invalid density = -625.0368072 at index 5, 65, 0 Invalid density = -691.1269281 at index 6, 65, 0 Invalid density = -318.5467376 at index 7, 65, 0 Invalid density = -11.08517908 at index 8, 65, 0 Invalid density = -820.8014889 at index 8, 66, 0 Invalid density = -456.4708539 at index 9, 66, 0 Invalid density = -6.239071149 at index 10, 66, 0 Invalid density = -907.0826581 at index 10, 67, 0 Invalid density = -241.113047 at index 11, 67, 0 Invalid density = -606.7538937 at index 12, 68, 0 Invalid density = -859.0333271 at index 13, 69, 0 Invalid density = -908.1731819 at index 14, 70, 0 Invalid density = -764.1508347 at index 15, 71, 0 Invalid density = -415.2911996 at index 16, 72, 0 Invalid density = -552.7694089 at index 17, 74, 0 Invalid density = -160.2179808 at index 18, 75, 0 Invalid density = -80.16477042 at index 18, 76, 0 Invalid density = -61.58489855 at index 19, 77, 0 Invalid density = -108.2035501 at index 19, 78, 0 Invalid density = -15.15828486 at index 20, 80, 0 Invalid density = -8.076810125 at index 20, 81, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.25 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.125   Beginning subcycle 1 starting at time 0 with dt = 0.125 Estimated number of subcycles remaining: 2 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003562094 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.024842118e+47 ener added: 6.151153052e+47 Contributions to the state from old-time sources: mass added: 0 xmom added: -5.870686959e+40 ymom added: 3.245996049e+28 zmom added: 0 eint added: 0 ener added: 3.465699137e+47 Castro::do_old_sources() time = 0.064121874 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.02612720466 at index 21, 173, 0 Invalid density = -1.592544331 at index 20, 176, 0 Invalid density = -1.592544331 at index 20, 79, 0 Invalid density = -0.02612720466 at index 21, 82, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.125 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.0625   Beginning subcycle 1 starting at time 0 with dt = 0.0625 Estimated number of subcycles remaining: 4 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003772889 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -2.93534348e+40 ymom added: 1.622998024e+28 zmom added: 0 eint added: 0 ener added: 1.732849568e+47 Castro::do_old_sources() time = 0.060604466 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Invalid density = -0.1060744788 at index 20, 177, 0 Invalid density = -0.1060744788 at index 20, 78, 0 Advance was unsuccessful with reason: invalid density; proceeding to a retry.  Subcycle completed  Timestep 0.0625 rejected at level 0. Performing a retry, with subcycled timesteps of maximum length dt = 0.03125   Beginning subcycle 1 starting at time 0 with dt = 0.03125 Estimated number of subcycles remaining: 8 Adding an SDC iteration due to the retry. Beginning SDC iteration 1 of 3. Castro::construct_old_gravity() time = 0.003615732 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.060081763 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323333678 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015450087 Gravity::solve_for_phi() time = 0.083141646 on level 0 Castro::construct_new_gravity() time = 0.085304626 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.674192048e+44 ener added: 3.847280946e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.752957884e+35 ymom added: -3.579871373e+27 zmom added: 0 eint added: 0 ener added: 6.209484931e+43 Castro::do_new_sources() time = 0.060329136 on level 0 Ending SDC iteration 1 of 3. Beginning SDC iteration 2 of 3. Castro::construct_old_gravity() time = 0.002691408 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.059967812 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323047505 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015416407 Gravity::solve_for_phi() time = 0.083121572 on level 0 Castro::construct_new_gravity() time = 0.085251462 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838148647e+44 ener added: 3.819761762e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742583287e+35 ymom added: -3.583821633e+27 zmom added: 0 eint added: 0 ener added: 4.570264853e+43 Castro::do_new_sources() time = 0.060286381 on level 0 Ending SDC iteration 2 of 3. Beginning SDC iteration 3 of 3. Castro::construct_old_gravity() time = 0.002586426 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46767174e+40 ymom added: 8.114990122e+27 zmom added: 0 eint added: 0 ener added: 8.664247842e+46 Castro::do_old_sources() time = 0.058305565 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.371708098 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.023533436 Gravity::solve_for_phi() time = 0.090333744 on level 0 Castro::construct_new_gravity() time = 0.092368397 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.838245244e+44 ener added: 3.819942812e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.742573524e+35 ymom added: -3.577296503e+27 zmom added: 0 eint added: 0 ener added: 4.569279535e+43 Castro::do_new_sources() time = 0.058794165 on level 0 Ending SDC iteration 3 of 3.  Subcycle completed  Beginning subcycle 2 starting at time 0.03125 with dt = 0.03125 Estimated number of subcycles remaining: 7 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002581504 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058279037 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985598081e+46 ener added: 2.745852676e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32864845 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017231825 Gravity::solve_for_phi() time = 0.086827649 on level 0 Castro::construct_new_gravity() time = 0.088951962 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.274072206e+44 ener added: 4.891864863e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.763054894e+35 ymom added: -3.010508633e+24 zmom added: 0 eint added: 0 ener added: 5.968608016e+43 Castro::do_new_sources() time = 0.120322907 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.003384747 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.985021785e+46 ener added: 5.435221686e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467706591e+40 ymom added: 9.60340448e+26 zmom added: 0 eint added: 0 ener added: 8.721813579e+46 Castro::do_old_sources() time = 0.058204476 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.986297782e+46 ener added: 2.752525031e+42 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329268918 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.016145539 Gravity::solve_for_phi() time = 0.084909051 on level 0 Castro::construct_new_gravity() time = 0.086962214 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.347573489e+44 ener added: 4.888153391e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.756949739e+35 ymom added: -4.309159416e+24 zmom added: 0 eint added: 0 ener added: 5.2374099e+43 Castro::do_new_sources() time = 0.060455596 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 3 starting at time 0.0625 with dt = 0.03125 Estimated number of subcycles remaining: 6 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.005137272 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.062222954 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98733239e+46 ener added: 2.180535114e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.321587196 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014330615 Gravity::solve_for_phi() time = 0.084568067 on level 0 Castro::construct_new_gravity() time = 0.086601943 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.058042977e+43 ener added: 1.184398423e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.782398841e+35 ymom added: 1.223092919e+24 zmom added: 0 eint added: 0 ener added: 5.96849108e+43 Castro::do_new_sources() time = 0.059191458 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002554322 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.984353173e+46 ener added: 6.990361455e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.46774173e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.780735352e+46 Castro::do_old_sources() time = 0.058392662 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.988039066e+46 ener added: 2.185480971e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.33220612 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.014589603 Gravity::solve_for_phi() time = 0.083343249 on level 0 Castro::construct_new_gravity() time = 0.085374748 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.800848844e+43 ener added: 1.183591058e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.776272322e+35 ymom added: 1.448585919e+24 zmom added: 0 eint added: 0 ener added: 5.233809214e+43 Castro::do_new_sources() time = 0.059562805 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 4 starting at time 0.09375 with dt = 0.03125 Estimated number of subcycles remaining: 5 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.003972954 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058278666 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.98498831e+46 ener added: 2.292089986e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.364540211 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015694778 Gravity::solve_for_phi() time = 0.082525371 on level 0 Castro::construct_new_gravity() time = 0.08466013 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.614759295e+43 ener added: 1.488589688e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.803591267e+35 ymom added: -6.871043233e+23 zmom added: 0 eint added: 0 ener added: 4.637081169e+43 Castro::do_new_sources() time = 0.059174411 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.002662595 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983917922e+46 ener added: 1.154265495e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467777256e+40 ymom added: 9.528602194e+26 zmom added: 0 eint added: 0 ener added: 8.841018465e+46 Castro::do_old_sources() time = 0.058406092 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.985698801e+46 ener added: 2.298024982e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.329899984 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.01520026 Gravity::solve_for_phi() time = 0.082295052 on level 0 Castro::construct_new_gravity() time = 0.084390562 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.359798244e+43 ener added: 1.487684259e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.797448342e+35 ymom added: -5.254813304e+24 zmom added: 0 eint added: 0 ener added: 3.901081726e+43 Castro::do_new_sources() time = 0.059321485 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 5 starting at time 0.125 with dt = 0.03125 Estimated number of subcycles remaining: 4 Beginning SDC iteration 1 of 2. Castro::construct_old_gravity() time = 0.002597805 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.068015002 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.992363162e+46 ener added: 2.321339475e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330274425 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.017923464 Gravity::solve_for_phi() time = 0.085096236 on level 0 Castro::construct_new_gravity() time = 0.087216087 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.068921344e+43 ener added: 1.620777103e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.829776437e+35 ymom added: 5.133212367e+24 zmom added: 0 eint added: 0 ener added: 2.123241032e+43 Castro::do_new_sources() time = 0.059516279 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Castro::construct_old_gravity() time = 0.004059851 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.98356532e+46 ener added: 1.521222674e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467813205e+40 ymom added: 9.429621393e+26 zmom added: 0 eint added: 0 ener added: 8.902573838e+46 Castro::do_old_sources() time = 0.062211545 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993083003e+46 ener added: 2.326773931e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.363598156 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015608875 Gravity::solve_for_phi() time = 0.084167191 on level 0 Castro::construct_new_gravity() time = 0.086195203 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.821028634e+43 ener added: 1.619931887e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.823603759e+35 ymom added: 8.029203612e+24 zmom added: 0 eint added: 0 ener added: 1.379533843e+43 Castro::do_new_sources() time = 0.059043672 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 6 starting at time 0.15625 with dt = 0.03125 Estimated number of subcycles remaining: 3 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.003272986 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058558655 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.000609588e+46 ener added: 2.406064512e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324050615 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015718631 Gravity::solve_for_phi() time = 0.084150715 on level 0 Castro::construct_new_gravity() time = 0.086168956 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.854195607e+43 ener added: 1.71395957e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.848617495e+35 ymom added: -5.170991299e+24 zmom added: 0 eint added: 0 ener added: -1.366537222e+43 Castro::do_new_sources() time = 0.059059295 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.920709246e+29 ener added: 4.920709246e+29 Castro::construct_old_gravity() time = 0.002714009 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.983073759e+46 ener added: 2.019352467e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467849677e+40 ymom added: 9.585270592e+26 zmom added: 0 eint added: 0 ener added: 8.96490842e+46 Castro::do_old_sources() time = 0.058181645 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 7.001333674e+46 ener added: 2.41251015e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.330881336 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015742535 Gravity::solve_for_phi() time = 0.084363461 on level 0 Castro::construct_new_gravity() time = 0.086383859 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.610031177e+43 ener added: 1.713054017e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.842414694e+35 ymom added: -7.880449068e+24 zmom added: 0 eint added: 0 ener added: -2.113374984e+43 Castro::do_new_sources() time = 0.062700363 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 7 starting at time 0.1875 with dt = 0.03125 Estimated number of subcycles remaining: 2 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.004549962 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.060577744 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993854135e+46 ener added: 2.676087223e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.371101054 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.066850062 Gravity::solve_for_phi() time = 0.143440091 on level 0 Castro::construct_new_gravity() time = 0.145817689 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.152849071e+44 ener added: 1.743211419e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.877263956e+35 ymom added: 7.059937892e+24 zmom added: 0 eint added: 0 ener added: -4.049549507e+43 Castro::do_new_sources() time = 0.06831666 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.075345155e+29 ener added: 2.075345155e+29 Castro::construct_old_gravity() time = 0.003813346 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982914566e+46 ener added: 2.174746794e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467886525e+40 ymom added: 9.439443915e+26 zmom added: 0 eint added: 0 ener added: 9.027789929e+46 Castro::do_old_sources() time = 0.058351172 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994586452e+46 ener added: 2.682600444e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.374134853 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015499514 Gravity::solve_for_phi() time = 0.084203236 on level 0 Castro::construct_new_gravity() time = 0.086215236 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.229235664e+44 ener added: 1.74231031e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.871026436e+35 ymom added: 8.771795742e+23 zmom added: 0 eint added: 0 ener added: -4.804462625e+43 Castro::do_new_sources() time = 0.059038884 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed  Beginning subcycle 8 starting at time 0.21875 with dt = 0.03125 Estimated number of subcycles remaining: 1 Beginning SDC iteration 1 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.002835394 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058486773 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.993555556e+46 ener added: 2.937230463e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324663306 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015816836 Gravity::solve_for_phi() time = 0.084294867 on level 0 Castro::construct_new_gravity() time = 0.086314048 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.731399969e+43 ener added: 1.766195089e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.939762636e+35 ymom added: 1.676440101e+23 zmom added: 0 eint added: 0 ener added: -1.225922477e+43 Castro::do_new_sources() time = 0.059537794 on level 0 Ending SDC iteration 1 of 2. Beginning SDC iteration 2 of 2. Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.383563436e+30 ener added: 1.383563436e+30 Castro::construct_old_gravity() time = 0.003517274 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.982548267e+46 ener added: 2.529322566e+43 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.467923946e+40 ymom added: 9.471933797e+26 zmom added: 0 eint added: 0 ener added: 9.091353867e+46 Castro::do_old_sources() time = 0.058209632 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.994288712e+46 ener added: 2.943682879e+43 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3290771 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.015949785 Gravity::solve_for_phi() time = 0.084197771 on level 0 Castro::construct_new_gravity() time = 0.086237148 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.496809054e+43 ener added: 1.76531212e+44 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.933525523e+35 ymom added: 5.748300601e+24 zmom added: 0 eint added: 0 ener added: -1.982551467e+43 Castro::do_new_sources() time = 0.059176654 on level 0 Ending SDC iteration 2 of 2.  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.00273962264 [Level 0 step 1] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.037844726e+29 ener added: 8.037844726e+29 TIME= 0.25 MASS = 2.549996568e+33 TIME= 0.25 XMOM = -4.340632835e+38 TIME= 0.25 YMOM = 1.156700224e+28 TIME= 0.25 ZMOM = 0 TIME= 0.25 ANG MOM X = 0 TIME= 0.25 ANG MOM Y = 0 TIME= 0.25 ANG MOM Z = -1.469523857e+38 TIME= 0.25 RHO*e = 1.325894499e+50 TIME= 0.25 RHO*K = 3.170941995e+49 TIME= 0.25 RHO*E = 1.642988698e+50 TIME= 0.25 RHO*PHI = -5.449011351e+50 TIME= 0.25 TOTAL ENERGY= -1.081516977e+50 TIME= 0.25 CENTER OF MASS X-LOC = 316424375.9 TIME= 0.25 CENTER OF MASS X-VEL = -170221.1246 TIME= 0.25 CENTER OF MASS Y-LOC = 1.213668339e-07 TIME= 0.25 CENTER OF MASS Y-VEL = 4.536085416e-06 TIME= 0.25 CENTER OF MASS Z-LOC = 0 TIME= 0.25 CENTER OF MASS Z-VEL = 0 TIME= 0.25 MAXIMUM TEMPERATURE = 58251090.19 TIME= 0.25 MAXIMUM DENSITY = 4458791.937 TIME= 0.25 MAXIMUM T_S / T_E = 0 [STEP 1] Coarse TimeStep time: 12.01977131 [STEP 1] FAB kilobyte spread across MPI nodes: [6973 ... 6973] STEP = 1 TIME = 0.25 DT = 0.25 PLOTFILE: file = wdmerger_retry-SDC_plt00001 Write plotfile time = 0.049098104 seconds SMALL PLOTFILE: file = smallplt00001 Write small plotfile time = 0.004068201 seconds Ending run at 08:48:36 UTC on 2024-01-30. Run time = 14.62649381 Run time without initialization = 12.07401172 Average number of zones advanced per microsecond: 0.003 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 14.63 ... 14.63 ... 14.63 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 20 5.4000 5.4705 5.5511 37.95% Amr::InitAmr() 1 1.663 1.663 1.663 11.37% Castro::computeTemp() 80 0.8441 0.9639 1.133 7.74% amrex::Copy() 724 0.7614 0.7683 0.7856 5.37% FabArray::ParallelCopy_finish() 1429 0.05433 0.5388 0.7652 5.23% Castro::normalize_species() 79 0.5458 0.5523 0.5998 4.10% MultiFab::AddProduct() 3439 0.5484 0.5522 0.5605 3.83% Castro::reset_internal_energy(Fab) 160 0.5214 0.5268 0.5358 3.66% MLPoisson::Fsmooth() 6144 0.3151 0.3388 0.4183 2.86% Castro::initMFs() 1 0.3575 0.3653 0.3775 2.58% FabArray::setVal() 5013 0.3476 0.3503 0.3606 2.47% MultiFab::Subtract() 159 0.3411 0.3433 0.3465 2.37% Gravity::fill_multipole_BCs() 19 0.2129 0.295 0.3422 2.34% check_for_negative_density() 20 0.1716 0.2604 0.3186 2.18% Castro::reset_internal_energy(MultiFab) 80 0.02236 0.07246 0.2559 1.75% FabArray::ParallelCopy_nowait() 1429 0.1871 0.2005 0.2172 1.49% FabArray::sum() 3439 0.1877 0.189 0.1919 1.31% Castro::initData() 1 0.003359 0.02668 0.1571 1.07% FillBoundary_nowait() 6380 0.07004 0.09321 0.1188 0.81% MLPoisson::Fapply() 986 0.09573 0.09958 0.1151 0.79% FillBoundary_finish() 6380 0.08721 0.101 0.1141 0.78% Castro::enforce_min_density() 79 0.0173 0.03717 0.1108 0.76% MLCellLinOp::applyBC() 7148 0.04613 0.06067 0.1052 0.72% FabArray::Saxpy() 264 0.07116 0.07205 0.07879 0.54% Castro::construct_new_gravity_source() 17 0.06844 0.06944 0.07607 0.52% Castro::do_new_sources() 17 0.0003482 0.01331 0.07299 0.50% Castro::do_old_sources() 20 0.0004655 0.01185 0.06709 0.46% FabArray::Xpay() 945 0.05073 0.05293 0.06007 0.41% MultiFab::contains_nan() 37 0.04702 0.0479 0.05373 0.37% Castro::construct_old_gravity_source() 20 0.04532 0.04576 0.04694 0.32% MLMG::addInterpCorrection() 768 0.03332 0.03548 0.04297 0.29% AmrLevel::derive() 18 0.04031 0.04093 0.04184 0.29% StateData::FillBoundary(geom) 143 0 0.01704 0.033 0.23% amrex::average_down 768 0.02448 0.02632 0.03247 0.22% VisMF::Write(FabArray) 4 0.01204 0.0131 0.02499 0.17% Castro::construct_old_gravity() 20 0.0003245 0.003924 0.02209 0.15% Amr::writePlotFile() 2 0.008591 0.01759 0.01939 0.13% TagBoxArray::collate() 2 9.787e-05 0.002709 0.01848 0.13% MLCellLinOp::defineAuxData() 19 0.01414 0.0147 0.0177 0.12% MLCGSolver::bicgstab 8 0 0.001052 0.01683 0.12% FabArray::FillBoundary() 6380 0.01332 0.01368 0.01672 0.11% Castro::construct_new_source() 102 0.01566 0.01577 0.01622 0.11% FabArray::norminf() 282 0.01055 0.01091 0.01512 0.10% amrex::Add() 128 0.01439 0.01452 0.01472 0.10% FillPatchIterator::Initialize 147 0.01212 0.0124 0.01365 0.09% FabArrayBase::getFB() 6380 0.009949 0.01027 0.01325 0.09% MLCellLinOp::smooth() 3072 0.01103 0.01141 0.01319 0.09% Castro::evaluate_source_change() 196 0.01222 0.01256 0.01301 0.09% Castro::wd_update() 2 0.00499 0.008996 0.01181 0.08% FabArray::setDomainBndry() 147 0.0004414 0.005945 0.01126 0.08% MLMG::prepareForSolve() 18 0.009769 0.01 0.01106 0.08% Castro::construct_old_source() 120 0.009938 0.01003 0.01035 0.07% MLMG::solve() 18 0.0007263 0.004416 0.008674 0.06% MLLinOp::makeSubCommunicator() 19 0.0007865 0.004509 0.008549 0.06% MLMG::ResNormInf() 146 0.005356 0.006682 0.008176 0.06% Gravity::actual_solve_with_mlmg() 19 0.0065 0.006722 0.007833 0.05% FabArray::mult() 59 0.007541 0.007612 0.007822 0.05% FabArrayBase::getCPC() 2005 0.007054 0.007206 0.00779 0.05% Castro::volWgtSum() 46 0.007228 0.007332 0.007785 0.05% Gravity::get_new_grav_vector() 18 0.006036 0.006182 0.006744 0.05% Gravity::get_old_grav_vector() 20 0.006412 0.006483 0.00659 0.05% FabArrayBase::CPC::define() 576 0.002124 0.003248 0.006377 0.04% Amr::writeSmallPlotFile() 2 0.003693 0.005756 0.006243 0.04% amrex::Dot() 142 0 0.0003847 0.006155 0.04% MLCellLinOp::compGrad() 18 0.005748 0.005861 0.006081 0.04% Castro::initialize_do_advance() 20 0.004271 0.004597 0.005784 0.04% Castro::volInBoundary() 14 0.003413 0.003716 0.0056 0.04% MLCGSolver::ParallelAllReduce 227 0 0.0003305 0.005288 0.04% MLCellLinOp::apply() 986 0.001983 0.002186 0.004807 0.03% MultiFab::max() 2 0.0001688 0.002029 0.004537 0.03% FabArray::ParallelCopy() 1429 0.003469 0.003559 0.003902 0.03% MLPoisson::normalize() 79 0 0.0002035 0.003257 0.02% BndryData::define() 19 0.002971 0.003037 0.003177 0.02% Castro::construct_new_gravity() 17 0.0002626 0.0007168 0.002875 0.02% Castro::sum_integrated_quantities() 2 0.001837 0.002155 0.002439 0.02% AmrLevel::FillPatch() 147 0.002048 0.002118 0.002287 0.02% MLCellLinOp::prepareForSolve() 19 0.001672 0.001819 0.002215 0.02% MLLinOp::defineGrids() 19 0.00173 0.001867 0.002114 0.01% MLCellLinOp::correctionResidual() 768 0.0018 0.001845 0.001975 0.01% MLMG::mgVcycle() 128 0.001574 0.001629 0.001853 0.01% MLCellLinOp::defineBC() 19 0.001489 0.001539 0.001797 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001315 0.001523 0.001775 0.01% MLMG:computeResOfCorrection() 768 0.00137 0.001416 0.001536 0.01% FabArrayBase::FB::FB() 75 0.000279 0.0006732 0.001467 0.01% StateData::define() 6 0.001231 0.001279 0.001443 0.01% main() 1 0.0009138 0.001191 0.001417 0.01% Gravity::solve_for_phi() 17 0.0007351 0.000892 0.001306 0.01% Castro::save_data_for_retry() 3 0.001222 0.001282 0.0013 0.01% Castro::locWgtSum() 6 0.001115 0.001132 0.00116 0.01% MLMG::actualBottomSolve() 128 0.0001337 0.0001991 0.001128 0.01% Castro::subcycle_advance_ctu() 1 0.0001769 0.0002401 0.000939 0.01% StateDataPhysBCFunct::() 147 0.0006524 0.0007709 0.0009223 0.01% MLCellLinOp::setLevelBC() 19 0.000527 0.00066 0.0008509 0.01% MLMG::mgVcycle_down::3 128 0.000569 0.0006083 0.000754 0.01% MLMG::mgVcycle_down::2 128 0.0006059 0.0006556 0.0007248 0.00% MLMG::mgVcycle_down::4 128 0.0005494 0.0005733 0.0007204 0.00% MLMG::mgVcycle_down::5 128 0.000576 0.0005932 0.0007204 0.00% FillPatchIterator::FillFromLevel0() 147 0.0006577 0.000686 0.0007135 0.00% MLMG::mgVcycle_down::0 128 0.0006535 0.0006638 0.0006941 0.00% MLMG::mgVcycle_down::1 128 0.0006475 0.0006606 0.0006885 0.00% Castro::buildMetrics() 1 0.0005411 0.0005612 0.0006436 0.00% Castro::Castro() 1 0.0004492 0.0005507 0.0006214 0.00% Castro::clean_state() 79 0.0004156 0.0004627 0.0005896 0.00% AmrMesh::MakeNewGrids() 2 0.0005112 0.0005299 0.0005642 0.00% Castro::do_advance_ctu() 20 0.0004114 0.0004404 0.0005551 0.00% Castro::apply_tagging_restrictions() 2 0.000422 0.0004751 0.0005217 0.00% Gravity::applyMetricTerms() 2 0.0004859 0.0004943 0.0005028 0.00% MLMG::mgVcycle_up::0 128 0.0004667 0.0004806 0.0005018 0.00% MLMG::mgVcycle_up::1 128 0.0004462 0.0004653 0.0004941 0.00% FillPatchSingleLevel 147 0.0004663 0.0004764 0.0004922 0.00% MLMG::mgVcycle_up::2 128 0.0003902 0.0004228 0.0004884 0.00% Castro::problem_post_timestep() 2 1.087e-05 4.588e-05 0.0004865 0.00% MLMG::mgVcycle_up::3 128 0.0003845 0.0003988 0.0004822 0.00% MLMG::mgVcycle_up::5 128 0.0003976 0.0004095 0.0004755 0.00% MLMG::mgVcycle_up::4 128 0.0003859 0.0003993 0.0004641 0.00% MLCellLinOp::solutionResidual() 147 0.000421 0.000429 0.0004422 0.00% Castro::swap_state_time_levels() 8 0.0004069 0.0004216 0.0004417 0.00% makeSFC 95 0.0003595 0.0003777 0.0004033 0.00% MLMG::oneIter() 128 0.0003697 0.0003761 0.0003973 0.00% Castro::volProductSum() 2 0.0003837 0.0003887 0.0003938 0.00% Castro::enforce_consistent_e() 1 0.0003646 0.0003784 0.0003853 0.00% MLLinOp::makeAgglomeratedDMap 19 0.0003244 0.0003357 0.0003538 0.00% Gravity::solve_phi_with_mlmg() 19 0.000211 0.0002252 0.0002641 0.00% Castro::finalize_do_advance() 17 0.0001542 0.0001799 0.0002548 0.00% MLMG::mgVcycle_bottom 128 0.0002239 0.0002307 0.0002445 0.00% MLMG::computeResidual() 128 0.0002345 0.0002389 0.000244 0.00% DistributionMapping::Distribute() 95 0.0002111 0.00022 0.0002385 0.00% Amr::coarseTimeStep() 1 0.0001518 0.0001762 0.0001806 0.00% Gravity::update_max_rhs() 2 0.0001587 0.000164 0.0001741 0.00% OwnerMask() 2 0.0001302 0.0001491 0.0001665 0.00% MLMG::compResidual() 1 0.0001513 0.0001544 0.000164 0.00% Castro::retry_advance_ctu() 11 5.255e-05 6.159e-05 0.0001529 0.00% MLPoisson::define() 19 0.0001249 0.0001328 0.0001413 0.00% Amr::defBaseLevel() 1 8.035e-05 0.0001176 0.0001365 0.00% Castro::check_for_nan() 37 9.815e-05 0.0001069 0.0001311 0.00% Amr::grid_places() 2 7.123e-05 8.63e-05 0.0001301 0.00% TagBoxArray::mapPRD 2 0.0001075 0.0001151 0.0001242 0.00% Castro::enforce_speed_limit() 79 0.0001012 0.0001073 0.0001216 0.00% AmrLevel::AmrLevel(dm) 1 6.904e-05 9.28e-05 0.0001163 0.00% Castro::initialize_advance() 1 0.0001008 0.0001056 0.0001161 0.00% Gravity::test_composite_phi() 1 9.194e-05 9.511e-05 0.0001071 0.00% Castro::apply_source_to_state() 37 8.921e-05 9.499e-05 0.0001048 0.00% MLLinOp::define() 19 7.493e-05 8.051e-05 9.84e-05 0.00% Castro::apply_problem_tags() 2 9.18e-05 9.351e-05 9.566e-05 0.00% MultiFab::Swap() 5 6.448e-05 7.076e-05 9.04e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.292e-05 6.98e-05 8.94e-05 0.00% MLPoisson::prepareForSolve() 19 6.769e-05 7.321e-05 8.469e-05 0.00% Castro::create_source_corrector() 17 5.321e-05 5.943e-05 8.382e-05 0.00% Amr::FinalizeInit() 1 8.397e-06 2.05e-05 7.37e-05 0.00% knapsack() 1 5.57e-05 5.859e-05 6.606e-05 0.00% Amr::initSubcycle() 1 5.926e-05 6.01e-05 6.372e-05 0.00% Castro::expand_state() 20 4.955e-05 5.44e-05 5.845e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.703e-05 4.146e-05 5.512e-05 0.00% MLMG::computeMLResidual() 18 3.893e-05 4.234e-05 4.935e-05 0.00% Gravity::swapTimeLevels() 8 3.287e-05 3.641e-05 4.747e-05 0.00% Castro::derive() 18 3.949e-05 4.091e-05 4.417e-05 0.00% MLMG::MLResNormInf() 18 3.294e-05 3.542e-05 4.286e-05 0.00% MLMG::getGradSolution() 18 3.814e-05 3.961e-05 4.124e-05 0.00% MLMG::MLRhsNormInf() 18 3.1e-05 3.211e-05 3.591e-05 0.00% Castro::construct_old_rotation_source() 20 3.008e-05 3.097e-05 3.524e-05 0.00% Castro::finalize_advance() 1 1.605e-05 1.806e-05 2.969e-05 0.00% Amr::regrid() 1 1.074e-05 1.255e-05 2.911e-05 0.00% Gravity::actual_multilevel_solve() 1 2.552e-05 2.686e-05 2.791e-05 0.00% Castro::construct_new_rotation_source() 17 2.061e-05 2.158e-05 2.25e-05 0.00% DistributionMapping::KnapSackDoIt() 1 1.613e-05 1.779e-05 1.971e-05 0.00% Castro::estTimeStep() 10 1.203e-05 1.335e-05 1.898e-05 0.00% Castro::computeInitialDt() 2 6.947e-06 8.453e-06 1.869e-05 0.00% Castro::post_timestep() 1 5.479e-06 6.575e-06 1.855e-05 0.00% Amr::timeStep() 1 1.152e-05 1.289e-05 1.701e-05 0.00% Castro::post_regrid() 2 1.011e-05 1.171e-05 1.543e-05 0.00% Castro::advance() 1 7.284e-06 9.356e-06 1.506e-05 0.00% Castro::post_init() 1 1.157e-05 1.253e-05 1.434e-05 0.00% Amr::initialInit() 1 2.8e-06 3.876e-06 1.403e-05 0.00% Amr::InitializeInit() 1 7.114e-06 8.018e-06 1.348e-05 0.00% BoxList::complementIn 4 5.77e-06 6.613e-06 1.235e-05 0.00% BoxList::parallelComplementIn() 4 6.969e-06 7.449e-06 1.119e-05 0.00% Amr::init() 1 6.623e-06 7.345e-06 9.316e-06 0.00% Gravity::set_mass_offset() 2 4.047e-06 4.708e-06 9.191e-06 0.00% Amr::bldFineLevels() 1 6.667e-06 7.378e-06 8.888e-06 0.00% Castro::errorEst() 2 6.063e-06 6.423e-06 7.07e-06 0.00% Castro::gwstrain() 2 4.124e-06 4.654e-06 6.767e-06 0.00% Castro::FluxRegCrseInit 1 1.656e-06 2.016e-06 4.138e-06 0.00% Castro::FluxRegFineAdd() 1 1.39e-06 1.64e-06 3.37e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 14.63 14.63 14.63 100.00% Amr::coarseTimeStep() 1 12.07 12.07 12.07 82.54% Amr::timeStep() 1 12.02 12.02 12.02 82.18% Castro::advance() 1 11.96 11.96 11.96 81.77% Castro::subcycle_advance_ctu() 1 11.91 11.91 11.91 81.43% Castro::do_advance_ctu() 20 11.87 11.87 11.87 81.17% Castro::construct_ctu_hydro_source() 20 6.471 6.513 6.575 44.95% Castro::clean_state() 79 3.7 3.806 3.992 27.29% Castro::computeTemp() 80 2.389 2.507 2.768 18.92% Castro::reset_internal_energy(MultiFab) 80 1.481 1.544 1.735 11.86% Amr::InitAmr() 1 1.663 1.663 1.663 11.37% Gravity::solve_phi_with_mlmg() 19 1.468 1.552 1.604 10.97% Castro::construct_new_gravity() 17 1.395 1.477 1.526 10.43% Castro::initialize_do_advance() 20 1.364 1.445 1.493 10.21% Gravity::solve_for_phi() 17 1.356 1.44 1.491 10.20% Gravity::actual_solve_with_mlmg() 19 1.25 1.254 1.258 8.60% MLMG::solve() 18 1.2 1.205 1.206 8.25% Castro::do_old_sources() 20 1.159 1.181 1.201 8.21% Castro::do_new_sources() 17 0.9385 0.9899 1.084 7.41% MLMG::oneIter() 128 1.07 1.072 1.073 7.34% MLMG::mgVcycle() 128 1.055 1.057 1.058 7.23% FabArray::ParallelCopy() 1429 0.2793 0.762 0.9884 6.76% Castro::evaluate_source_change() 196 0.9451 0.9516 0.9654 6.60% Amr::init() 1 0.8889 0.889 0.889 6.08% Castro::enforce_min_density() 79 0.7835 0.8078 0.876 5.99% Amr::initialInit() 1 0.8358 0.8359 0.836 5.72% amrex::Copy() 724 0.7614 0.7683 0.7856 5.37% FabArray::ParallelCopy_finish() 1429 0.05433 0.5388 0.7652 5.23% AmrLevel::FillPatch() 147 0.47 0.5986 0.71 4.85% MLCellLinOp::smooth() 3072 0.53 0.5748 0.7001 4.79% Amr::InitializeInit() 1 0.4425 0.5092 0.6094 4.17% Amr::defBaseLevel() 1 0.4424 0.5092 0.6094 4.17% Castro::normalize_species() 79 0.5458 0.5523 0.5998 4.10% MultiFab::AddProduct() 3439 0.5484 0.5522 0.5605 3.83% FillPatchIterator::Initialize 147 0.2963 0.4249 0.5375 3.67% Castro::reset_internal_energy(Fab) 160 0.5214 0.5268 0.5358 3.66% FillPatchIterator::FillFromLevel0() 147 0.2725 0.4066 0.521 3.56% FillPatchSingleLevel 147 0.2718 0.4059 0.5203 3.56% MLPoisson::Fsmooth() 6144 0.3151 0.3388 0.4183 2.86% MLMG::mgVcycle_up::1 128 0.0898 0.2498 0.4099 2.80% Amr::FinalizeInit() 1 0.2264 0.3267 0.3934 2.69% Castro::Castro() 1 0.3632 0.3709 0.3841 2.63% Castro::initMFs() 1 0.3577 0.3655 0.3777 2.58% MLMG::addInterpCorrection() 768 0.0619 0.2992 0.3642 2.49% FabArray::setVal() 5013 0.3476 0.3503 0.3606 2.47% MultiFab::Subtract() 159 0.3411 0.3433 0.3465 2.37% Gravity::fill_multipole_BCs() 19 0.215 0.2971 0.3442 2.35% MLCellLinOp::applyBC() 7148 0.2512 0.2795 0.3404 2.33% check_for_negative_density() 20 0.1716 0.2604 0.3186 2.18% Castro::expand_state() 20 0.1743 0.2357 0.2835 1.94% MLMG::mgVcycle_up::2 128 0.01062 0.1142 0.2731 1.87% MLMG::mgVcycle_down::0 128 0.2536 0.2555 0.2575 1.76% FabArray::FillBoundary() 6380 0.1932 0.2188 0.249 1.70% Castro::initData() 1 0.07741 0.1366 0.244 1.67% FabArray::ParallelCopy_nowait() 1429 0.2058 0.2197 0.2376 1.62% Amr::bldFineLevels() 1 0.04686 0.1467 0.2124 1.45% MLMG::mgVcycle_up::0 128 0.1909 0.1917 0.1923 1.31% FabArray::sum() 3439 0.1877 0.189 0.1919 1.31% MLCellLinOp::apply() 986 0.144 0.1551 0.1902 1.30% MLMG::mgVcycle_up::3 128 0.01051 0.02354 0.182 1.24% Amr::grid_places() 2 0.00276 0.103 0.1698 1.16% AmrMesh::MakeNewGrids() 2 0.002677 0.1029 0.1697 1.16% TagBoxArray::mapPRD 2 0.0006093 0.09894 0.1677 1.15% MLMG:computeResOfCorrection() 768 0.1099 0.1189 0.1423 0.97% MLCellLinOp::correctionResidual() 768 0.1085 0.1175 0.1407 0.96% Castro::post_init() 1 0.1343 0.1361 0.1386 0.95% Castro::construct_new_source() 102 0.124 0.1252 0.1327 0.91% FillBoundary_nowait() 6380 0.08039 0.1041 0.1302 0.89% MLPoisson::Fapply() 986 0.09573 0.09958 0.1151 0.79% MLMG::mgVcycle_down::1 128 0.1082 0.1109 0.115 0.79% FillBoundary_finish() 6380 0.08721 0.101 0.1141 0.78% Gravity::multilevel_solve_for_new_phi() 1 0.1011 0.1011 0.1011 0.69% Gravity::actual_multilevel_solve() 1 0.101 0.101 0.1011 0.69% MLCellLinOp::solutionResidual() 147 0.08565 0.09121 0.09737 0.67% Amr::writePlotFile() 2 0.09724 0.09733 0.09734 0.67% Castro::create_source_corrector() 17 0.04729 0.07061 0.0948 0.65% Castro::post_regrid() 2 0.08498 0.0875 0.08934 0.61% Castro::construct_old_source() 120 0.07872 0.07942 0.08087 0.55% FabArray::Saxpy() 264 0.07116 0.07205 0.07879 0.54% Castro::construct_old_gravity() 20 0.04343 0.05469 0.0766 0.52% Castro::construct_new_gravity_source() 17 0.06844 0.06944 0.07607 0.52% MLMG::computeResidual() 128 0.07447 0.0751 0.07606 0.52% MLMG::mgVcycle_bottom 128 0.0003576 0.004938 0.0735 0.50% MLMG::actualBottomSolve() 128 0.0001337 0.004707 0.07325 0.50% MLCGSolver::bicgstab 8 0 0.004478 0.07164 0.49% Castro::derive() 18 0.06802 0.0691 0.07032 0.48% AmrLevel::derive() 18 0.06798 0.06906 0.07028 0.48% MLMG::mgVcycle_down::2 128 0.01236 0.03847 0.06727 0.46% Castro::post_timestep() 1 0.05896 0.06114 0.06346 0.43% FabArray::Xpay() 945 0.05073 0.05293 0.06007 0.41% Gravity::get_old_grav_vector() 20 0.039 0.05077 0.059 0.40% MLMG::mgVcycle_down::3 128 0.01169 0.01767 0.05863 0.40% amrex::average_down 768 0.03254 0.03839 0.05443 0.37% Castro::check_for_nan() 37 0.04712 0.04801 0.05384 0.37% MultiFab::contains_nan() 37 0.04702 0.0479 0.05373 0.37% Castro::initialize_advance() 1 0.0481 0.04943 0.05101 0.35% Castro::construct_old_gravity_source() 20 0.04532 0.04576 0.04694 0.32% Amr::regrid() 1 0.04358 0.04468 0.04524 0.31% MLPoisson::define() 19 0.02816 0.03253 0.03824 0.26% Gravity::get_new_grav_vector() 18 0.03461 0.03588 0.03744 0.26% Castro::retry_advance_ctu() 11 0.03548 0.03603 0.03661 0.25% MLMG::mgVcycle_down::4 128 0.01167 0.01327 0.03545 0.24% StateDataPhysBCFunct::() 147 0.0006524 0.01781 0.03384 0.23% StateData::FillBoundary(geom) 143 0 0.01704 0.033 0.23% Castro::apply_source_to_state() 37 0.02899 0.02916 0.02936 0.20% MLMG::mgVcycle_up::4 128 0.0106 0.01176 0.02783 0.19% VisMF::Write(FabArray) 4 0.01204 0.0131 0.02499 0.17% MLCellLinOp::defineAuxData() 19 0.01818 0.0194 0.02453 0.17% MLMG::prepareForSolve() 18 0.01999 0.02074 0.02383 0.16% MLMG::mgVcycle_down::5 128 0.01165 0.0125 0.02368 0.16% Castro::sum_integrated_quantities() 2 0.02077 0.02114 0.02117 0.14% MLMG::computeMLResidual() 18 0.0106 0.01567 0.02109 0.14% MLMG::mgVcycle_up::5 128 0.01064 0.01131 0.02005 0.14% Castro::save_data_for_retry() 3 0.01858 0.01879 0.01921 0.13% TagBoxArray::collate() 2 9.787e-05 0.002709 0.01848 0.13% MLMG::ResNormInf() 146 0.01468 0.01601 0.01749 0.12% Castro::problem_post_timestep() 2 0.009677 0.01276 0.01529 0.10% Castro::wd_update() 2 0.009606 0.01271 0.01527 0.10% FabArray::norminf() 282 0.01055 0.01091 0.01512 0.10% Gravity::test_composite_phi() 1 0.01484 0.01487 0.01488 0.10% amrex::Add() 128 0.01439 0.01452 0.01472 0.10% FabArrayBase::getFB() 6380 0.01027 0.01094 0.01471 0.10% FabArrayBase::getCPC() 2005 0.009271 0.01045 0.01417 0.10% MLLinOp::define() 19 0.003937 0.00739 0.01155 0.08% MLLinOp::defineGrids() 19 0.003839 0.007309 0.01147 0.08% FabArray::setDomainBndry() 147 0.0004414 0.005945 0.01126 0.08% Amr::writeSmallPlotFile() 2 0.009138 0.009139 0.009141 0.06% MLCGSolver::ParallelAllReduce 227 0 0.0005391 0.008626 0.06% MLLinOp::makeSubCommunicator() 19 0.0007865 0.004509 0.008549 0.06% FabArray::mult() 59 0.007541 0.007612 0.007822 0.05% Castro::volWgtSum() 46 0.007228 0.007332 0.007785 0.05% MLMG::getGradSolution() 18 0.007336 0.007503 0.007663 0.05% MLCellLinOp::compGrad() 18 0.007297 0.007464 0.007624 0.05% FabArrayBase::CPC::define() 576 0.002124 0.003248 0.006377 0.04% amrex::Dot() 142 0 0.0003847 0.006155 0.04% MLCellLinOp::defineBC() 19 0.005477 0.005607 0.005874 0.04% Gravity::update_max_rhs() 2 0.001426 0.003286 0.005786 0.04% Castro::volInBoundary() 14 0.003413 0.003716 0.0056 0.04% MultiFab::max() 2 0.0001688 0.002029 0.004537 0.03% BndryData::define() 19 0.003937 0.004068 0.00426 0.03% MLPoisson::normalize() 79 0 0.0002035 0.003257 0.02% MLPoisson::prepareForSolve() 19 0.00175 0.001892 0.002292 0.02% MLCellLinOp::prepareForSolve() 19 0.001672 0.001819 0.002215 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 608 0.001315 0.001523 0.001775 0.01% AmrLevel::AmrLevel(dm) 1 0.001322 0.001372 0.001555 0.01% FabArrayBase::FB::FB() 75 0.000279 0.0006732 0.001467 0.01% StateData::define() 6 0.001231 0.001279 0.001443 0.01% Gravity::swapTimeLevels() 8 0.001144 0.001199 0.001397 0.01% MLMG::MLResNormInf() 18 0.001216 0.001225 0.001248 0.01% MLMG::MLRhsNormInf() 18 0.001179 0.001195 0.001233 0.01% MLMG::compResidual() 1 0.0009284 0.001078 0.001175 0.01% Castro::locWgtSum() 6 0.001115 0.001132 0.00116 0.01% MLLinOp::makeAgglomeratedDMap 19 0.0008983 0.0009333 0.0009904 0.01% MLCellLinOp::setLevelBC() 19 0.000527 0.00066 0.0008509 0.01% Castro::buildMetrics() 1 0.0006004 0.0006222 0.0007143 0.00% makeSFC 95 0.0005718 0.0005976 0.0006413 0.00% Castro::errorEst() 2 0.0005202 0.000575 0.0006211 0.00% Castro::apply_tagging_restrictions() 2 0.000422 0.0004751 0.0005217 0.00% Gravity::applyMetricTerms() 2 0.0004859 0.0004943 0.0005028 0.00% Castro::swap_state_time_levels() 8 0.0004069 0.0004216 0.0004417 0.00% Castro::volProductSum() 2 0.0003837 0.0003887 0.0003938 0.00% Castro::enforce_consistent_e() 1 0.0003646 0.0003784 0.0003853 0.00% Castro::finalize_advance() 1 0.000248 0.0002583 0.0002818 0.00% Castro::finalize_do_advance() 17 0.0001647 0.0001901 0.0002655 0.00% DistributionMapping::Distribute() 95 0.0002111 0.00022 0.0002385 0.00% OwnerMask() 2 0.0001302 0.0001491 0.0001665 0.00% DistributionMapping::KnapSackDoIt() 1 0.0001023 0.0001178 0.0001364 0.00% Castro::enforce_speed_limit() 79 0.0001012 0.0001073 0.0001216 0.00% Castro::apply_problem_tags() 2 9.18e-05 9.351e-05 9.566e-05 0.00% MultiFab::Swap() 5 6.448e-05 7.076e-05 9.04e-05 0.00% knapsack() 1 5.57e-05 5.859e-05 6.606e-05 0.00% Amr::initSubcycle() 1 5.926e-05 6.01e-05 6.372e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 1.703e-05 4.146e-05 5.512e-05 0.00% Castro::construct_old_rotation_source() 20 3.008e-05 3.097e-05 3.524e-05 0.00% Castro::construct_new_rotation_source() 17 2.061e-05 2.158e-05 2.25e-05 0.00% Castro::computeInitialDt() 2 9.855e-06 1.156e-05 2.192e-05 0.00% BoxList::parallelComplementIn() 4 1.281e-05 1.406e-05 1.956e-05 0.00% Castro::estTimeStep() 10 1.203e-05 1.335e-05 1.898e-05 0.00% BoxList::complementIn 4 5.77e-06 6.613e-06 1.235e-05 0.00% Gravity::set_mass_offset() 2 4.047e-06 4.708e-06 9.191e-06 0.00% Castro::gwstrain() 2 4.124e-06 4.654e-06 6.767e-06 0.00% Castro::FluxRegCrseInit 1 1.656e-06 2.016e-06 4.138e-06 0.00% Castro::FluxRegFineAdd() 1 1.39e-06 1.64e-06 3.37e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [0] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 12 B 12 B 15 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.01-31-gab99ea69089f) finalized