Initializing AMReX (24.04-9-g2a3955a5f5aa)... MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (24.04-9-g2a3955a5f5aa) initialized Starting run at 06:56:18 UTC on 2024-04-10. Successfully read inputs file ... Castro git describe: 24.04-11-g2407e8176 AMReX git describe: 24.04-9-g2a3955a5f Microphysics git describe: 24.04-5-g43dc7a53 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.046603223 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.045706376 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.366052388 Gravity::multilevel_solve_for_new_phi() time = 1.798567763 Gravity::fill_multipole_BCs() time = 0.361081958 ... norm of composite residual at level 0 3.509358608e-10 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.804270653 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.520604299 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.287624606e+47 ener added: 6.129070894e+49 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.44936293e+25 ymom added: -1.046793351e+26 zmom added: -4.133074948e+24 eint added: 0 ener added: -1.270533196e+50 Castro::do_old_sources() time = 2.727276486 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.00547245e+47 ener added: 1.651139801e+46 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.28634719 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.670283864 Gravity::multilevel_solve_for_new_phi() time = 1.865779846 Castro::construct_new_gravity() time = 2.021618976 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.440206272e+49 ener added: 2.911791643e+45 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.451207933e+26 ymom added: 1.108730196e+26 zmom added: -5.613112907e+26 eint added: 0 ener added: 1.260457978e+50 Castro::do_new_sources() time = 2.371746185 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.00947637e+27 ener added: 2.068773556e+27 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.02423439638 [Level 0 step 1] Advanced 884736 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.191111111e+26 ener added: 6.213783704e+26 Updating the rotational period from 30.54368673 s to 30.45939751 s. [STEP 1] Coarse TimeStep time: 38.65149791 [STEP 1] FAB kilobyte spread across MPI nodes: [679617 ... 761594] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.032380971 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.412303221 Gravity::multilevel_solve_for_new_phi() time = 1.981080722 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.306135866e+46 ener added: 9.211440366e+51 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135286e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (87,103,92) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135286e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.849559407e+31 ener added: 2.785926976e+31  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135286e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.553834651 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.200514105e+40 ener added: 6.433158322e+33 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.533896722e+24 ymom added: 4.756222074e+26 zmom added: -2.8670017e+23 eint added: 0 ener added: -1.721443002e+45 Castro::do_old_sources() time = 2.350605312 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.48422969 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.147330623e+31 ener added: 1.147330701e+31 Castro::construct_old_gravity() time = 0.032898934 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503703704e+23 ener added: 6.281481481e+23 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.197253778e+40 ener added: 1.791685121e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.57264177e+22 ymom added: 1.564283897e+22 zmom added: 6.441804792e+21 eint added: 0 ener added: -2.586789965e+47 Castro::do_old_sources() time = 0.195402936 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.204912576e+51 ener added: 6.747117479e+48 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.805917435 on level 1 Castro::reflux() at level 0 : time = 2.272664563 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.418276744 Gravity::multilevel_solve_for_new_phi() time = 1.372374763 Castro::construct_new_gravity() time = 1.483624802 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.46375568e+41 ener added: 7.485558923e+35 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.861679586e+21 ymom added: -6.245616015e+21 zmom added: -1.245900444e+20 eint added: 0 ener added: -3.223710603e+41 Castro::do_new_sources() time = 1.986506781 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.149299259e+26 ener added: 4.592592593e+21 ...estimated hydro-limited timestep at level 0: 0.05461716025 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716025 Castro::construct_new_gravity() time = 0.02987289 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.564837764e+47 ener added: 4.559472528e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.765060194e+18 ymom added: -1.361438167e+19 zmom added: -8.219114448e+19 eint added: 0 ener added: 2.564611685e+47 Castro::do_new_sources() time = 0.143047691 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.281889991e+29 ener added: 3.281888214e+29 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02282730794 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.057555556e+24 ener added: 5.917703704e+24 Updating the rotational period from 30.45939751 s to 30.52749735 s. [STEP 2] Coarse TimeStep time: 49.73079357 [STEP 2] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 2 TIME = 0.005426075163 DT = 2.526135286e-09 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008131491259 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.287037368e-07 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Now regridding at level lbase = 0 grid_places() time: 0.031618398 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.401878806 Gravity::multilevel_solve_for_new_phi() time = 0.531195772 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778748814e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.414384584 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.083120164e+24 ymom added: 5.231862796e+26 zmom added: -3.157856713e+23 eint added: 0 ener added: -1.937110674e+45 Castro::do_old_sources() time = 2.355153369 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.49491064 on level 0 Castro::construct_old_gravity() time = 0.032857527 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.818691374e+40 ener added: 1.212217725e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 8.442606501e+22 ymom added: 4.427218578e+21 zmom added: 7.103005275e+21 eint added: 0 ener added: -2.344787748e+45 Castro::do_old_sources() time = 0.197740628 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.83673455e+48 ener added: 2.077900047e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.85661504 on level 1 Castro::reflux() at level 0 : time = 2.320581529 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.41717063 Gravity::multilevel_solve_for_new_phi() time = 0.978550161 Castro::construct_new_gravity() time = 1.086568255 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.106550538e+21 ymom added: -7.896156836e+21 zmom added: 1.108336323e+20 eint added: 0 ener added: -3.427512073e+41 Castro::do_new_sources() time = 2.004031507 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008131520194 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131520194 Castro::construct_new_gravity() time = 0.030086867 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.244373444e+43 ener added: 1.74625952e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: -6.821284239e+17 ymom added: 2.353130805e+19 zmom added: 9.539392597e+19 eint added: 0 ener added: 5.303047905e+43 Castro::do_new_sources() time = 0.144785591 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.490463796e+26 ener added: 1.495539352e+26 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02311071546 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.281481481e+24 ener added: 6.674962963e+24 Updating the rotational period from 30.52749735 s to 30.52751553 s. [STEP 3] Coarse TimeStep time: 47.22035601 [STEP 3] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 3 TIME = 0.005426077942 DT = 2.778748814e-09 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008130329735 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.564309766e-07 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Now regridding at level lbase = 0 grid_places() time: 0.031715052 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.402925105 Gravity::multilevel_solve_for_new_phi() time = 0.532839084 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056623695e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.41692231 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.694655893e+24 ymom added: 5.755038681e+26 zmom added: -3.471622784e+23 eint added: 0 ener added: -2.130751807e+45 Castro::do_old_sources() time = 2.316414003 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.48923033 on level 0 Castro::construct_old_gravity() time = 0.033148402 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.150425349e+40 ener added: 1.373884257e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 9.201776263e+22 ymom added: 1.180591621e+22 zmom added: 8.023757211e+21 eint added: 0 ener added: -2.520808161e+45 Castro::do_old_sources() time = 0.197733302 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.318881554e+48 ener added: 1.675623034e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.872674088 on level 1 Castro::reflux() at level 0 : time = 2.245199327 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.418385441 Gravity::multilevel_solve_for_new_phi() time = 0.978381253 Castro::construct_new_gravity() time = 1.091144841 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.405071347e+21 ymom added: -9.735495453e+21 zmom added: -7.674479504e+18 eint added: 0 ener added: -3.723007452e+41 Castro::do_new_sources() time = 1.986975777 on level 0 ...estimated hydro-limited timestep at level 0: 0.000813036171 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000813036171 Castro::construct_new_gravity() time = 0.030009054 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.983601425e+43 ener added: 1.617265925e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.598693397e+18 ymom added: -2.568853227e+19 zmom added: -1.336958324e+19 eint added: 0 ener added: 4.042918443e+43 Castro::do_new_sources() time = 0.145175988 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.942862037e+25 ener added: 2.885587963e+25 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02318734908 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.365462963e+23 ener added: 4.62962963e+19 Updating the rotational period from 30.52751553 s to 30.52751552 s. [STEP 4] Coarse TimeStep time: 47.10198739 [STEP 4] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 4 TIME = 0.005426080998 DT = 3.056623696e-09 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002506596503 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.863488975e-07 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Now regridding at level lbase = 0 grid_places() time: 0.03236554 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.401989281 Gravity::multilevel_solve_for_new_phi() time = 0.532758797 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286065e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.426514768 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.366517551e+24 ymom added: 6.330531998e+26 zmom added: -3.819056992e+23 eint added: 0 ener added: -2.343742535e+45 Castro::do_old_sources() time = 2.316586203 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.43976916 on level 0 Castro::construct_old_gravity() time = 0.032618548 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.560109532e+40 ener added: 1.662186973e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.013626193e+23 ymom added: 1.888946593e+22 zmom added: 8.796070504e+21 eint added: 0 ener added: -2.728291723e+45 Castro::do_old_sources() time = 0.195089578 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.05099824e+48 ener added: 1.448876286e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.874324113 on level 1 Castro::reflux() at level 0 : time = 2.252354918 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.420489639 Gravity::multilevel_solve_for_new_phi() time = 0.990526923 Castro::construct_new_gravity() time = 1.103808504 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.799171515e+21 ymom added: -1.177853541e+22 zmom added: -4.924059364e+18 eint added: 0 ener added: -4.148475158e+41 Castro::do_new_sources() time = 1.998143379 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006828000901 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006828000901 Castro::construct_new_gravity() time = 0.029958953 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.326552265e+43 ener added: 1.577214716e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.72682201e+18 ymom added: -2.54093091e+19 zmom added: -1.252337559e+19 eint added: 0 ener added: 3.390623254e+43 Castro::do_new_sources() time = 0.142509997 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.819509259e+24 ener added: 4.717583333e+24 ...estimated hydro-limited timestep at level 1: 7.169281148e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.169281148e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02320584884 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.94814634e+22 ener added: 2.962962963e+20 Updating the rotational period from 30.52751552 s to 30.52751551 s. [STEP 5] Coarse TimeStep time: 47.08513692 [STEP 5] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 5 TIME = 0.005426084361 DT = 3.362286065e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.527787083 seconds Ending run at 07:00:21 UTC on 2024-04-10. Run time = 242.3944606 Run time without initialization = 230.3195401 Average number of zones advanced per microsecond: 0.021 Average number of zones advanced per microsecond per rank: 0.005 TinyProfiler total time across processes [min...avg...max]: 242.4 ... 242.4 ... 242.4 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 9 92.0968 103.5123 108.3350 44.69% Castro::computeTemp() 88 14.64 16.47 17.3 7.14% check_for_negative_density() 9 0.2196 5.128 16.6 6.85% amrex::Copy() 679 12.52 14.09 14.87 6.13% Castro::normalize_species() 87 9.982 11.35 12.27 5.06% MultiFab::AddProduct() 4205 10.25 11.45 11.91 4.91% FabArray::ParallelCopy_finish() 830 1.405 4.755 11.48 4.73% Castro::reset_internal_energy(Fab) 1476 8.489 9.319 9.734 4.02% Castro::estTimeStep() 26 4.088 5.746 9.303 3.84% FabArray::setVal() 5070 7.152 8.034 8.39 3.46% MultiFab::Subtract() 175 6.449 7.231 7.577 3.13% Gravity::fill_multipole_BCs() 11 4.214 4.378 4.621 1.91% Castro::reset_internal_energy(MultiFab) 88 3.23 3.885 4.204 1.73% FabArray::sum() 4205 3.484 3.886 4.04 1.67% FluxRegister::Reflux() 24 2.899 3.277 3.436 1.42% FabArray::ParallelCopy_nowait() 830 2.044 2.247 2.671 1.10% MLPoisson::Fsmooth() 1376 2.086 2.379 2.63 1.09% Castro::enforce_min_density() 87 1.471 1.75 1.978 0.82% Castro::wd_update() 6 0.4584 0.8995 1.774 0.73% Castro::reflux() 4 1.462 1.666 1.751 0.72% Castro::FluxRegCrseInit 9 1.451 1.645 1.725 0.71% FillPatchInterp(MF) 30 1.234 1.358 1.476 0.61% Amr::InitAmr() 1 1.272 1.272 1.272 0.52% Castro::construct_old_gravity_source() 18 0.9818 1.08 1.23 0.51% amrex::Add() 136 1.013 1.137 1.191 0.49% FillBoundary_finish() 1553 0.3138 0.7087 1.172 0.48% Castro::initMFs() 5 1.105 1.129 1.162 0.48% Castro::problem_post_timestep() 10 0.7077 0.9176 1.157 0.48% MLPoisson::Fapply() 318 0.9796 1.06 1.118 0.46% Castro::construct_new_gravity_source() 9 0.8618 0.9559 1.096 0.45% FillPatchIterator::Initialize 62 0.7348 0.8297 0.8782 0.36% FabArray::Saxpy() 182 0.7028 0.7906 0.8262 0.34% Castro::volInBoundary() 42 0.5739 0.675 0.7254 0.30% VisMF::Write(FabArray) 3 0.5855 0.6543 0.6895 0.28% StateData::FillBoundary(geom) 50 0.5788 0.5946 0.6181 0.26% Castro::construct_new_source() 63 0.4774 0.5329 0.5552 0.23% Amr::writePlotFile() 2 0.08545 0.3466 0.5117 0.21% MultiFab::max() 18 0.02107 0.2162 0.5032 0.21% MultiFab::contains_nan() 18 0.3869 0.4337 0.4604 0.19% MLCellLinOp::applyBC() 1742 0.3526 0.4181 0.4436 0.18% FillBoundary_nowait() 1553 0.302 0.3601 0.4173 0.17% FabArray::Xpay() 283 0.3376 0.3841 0.4079 0.17% Castro::initialize_do_advance() 9 0.227 0.2612 0.281 0.12% FabArray::setDomainBndry() 92 0.2021 0.2268 0.2446 0.10% Castro::construct_old_source() 63 0.1997 0.2247 0.2337 0.10% amrex::average_down 233 0.192 0.2051 0.22 0.09% Castro::fill_hybrid_hydro_source() 27 0.1815 0.1899 0.1967 0.08% MLCellLinOp::defineAuxData() 11 0.1505 0.1649 0.1724 0.07% Castro::initData() 1 0.1291 0.1449 0.1688 0.07% MLPoisson::FFlux() 150 0.004701 0.04222 0.1547 0.06% MLCellLinOp::compGrad() 18 0.1254 0.1403 0.1461 0.06% StateData::define() 25 0.1055 0.121 0.138 0.06% FabArray::mult() 56 0.1224 0.1322 0.136 0.06% MLMG::addInterpCorrection() 155 0.1103 0.1243 0.1327 0.05% Castro::evaluate_source_change() 193 0.09848 0.1098 0.1158 0.05% Gravity::get_new_grav_vector() 10 0.0874 0.09565 0.09944 0.04% Castro::swap_state_time_levels() 9 0.08354 0.08892 0.09346 0.04% Gravity::get_old_grav_vector() 9 0.07672 0.08618 0.09178 0.04% Castro::initialize_advance() 9 0.06935 0.07767 0.08173 0.03% MLMG::prepareForSolve() 10 0.05942 0.06667 0.07075 0.03% MLMG::solve() 10 0.001902 0.04472 0.06987 0.03% MLCellLinOp::updateSolBC() 25 0.06682 0.06742 0.06775 0.03% Castro::apply_tagging_restrictions() 6 0.05476 0.05821 0.06559 0.03% FabArray::norminf(mask) 21 0.05397 0.06084 0.06337 0.03% AmrLevel::FillPatch() 62 0.04946 0.05546 0.05936 0.02% AmrMesh::MakeNewGrids() 6 0.04645 0.05 0.05247 0.02% MLMG::ResNormInf() 54 0.005914 0.0218 0.04632 0.02% MLCellLinOp::updateCorBC() 17 0.04551 0.04583 0.04617 0.02% BndryData::define() 27 0.04182 0.04317 0.04431 0.02% FabArray::norminf() 147 0.03584 0.03857 0.04148 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.02755 0.03149 0.03651 0.02% MLMG::MLResNormInf() 15 0.0001172 0.02462 0.0358 0.01% MLCellLinOp::reflux() 30 0.004237 0.01181 0.03435 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.01841 0.02242 0.0297 0.01% Castro::FluxRegFineAdd() 9 0.02563 0.02601 0.02689 0.01% MLCellLinOp::defineBC() 11 0.02587 0.02591 0.02595 0.01% StateDataPhysBCFunct::() 95 0.001944 0.008781 0.02522 0.01% MultiFab::Multiply() 8 0.0211 0.02385 0.0248 0.01% MLLinOp::makeSubCommunicator() 11 0.0007612 0.01045 0.01999 0.01% Castro::build_fine_mask() 44 0.01656 0.01789 0.01971 0.01% Castro::buildMetrics() 5 0.01449 0.01687 0.01966 0.01% Castro::Castro() 5 0.01411 0.01636 0.01892 0.01% MLMG::interpCorrection_1 17 0.0182 0.0184 0.01859 0.01% FabArrayBase::CPC::define() 416 0.01318 0.0148 0.01839 0.01% Castro::linear_to_hybrid_momentum() 1 0.01475 0.01565 0.01604 0.01% FillPatchTwoLevels 31 0.0124 0.01299 0.01362 0.01% AMRErrorTag::operator() 6 0.009893 0.01099 0.01275 0.01% MLCellLinOp::prepareForSolve() 11 0.01135 0.01153 0.01197 0.00% FabArrayBase::getCPC() 1440 0.009476 0.01016 0.0112 0.00% Castro::enforce_consistent_e() 1 0.009142 0.01031 0.01084 0.00% Gravity::actual_solve_with_mlmg() 11 0.009213 0.009745 0.01048 0.00% Castro::do_old_sources() 9 0.0005958 0.003343 0.0102 0.00% Gravity::actual_multilevel_solve() 10 0.007499 0.008706 0.009717 0.00% Castro::apply_problem_tags() 6 0.007752 0.008138 0.008664 0.00% Gravity::update_max_rhs() 10 0.007346 0.008069 0.008422 0.00% Castro::finalize_do_advance() 9 0.006078 0.007394 0.008319 0.00% average_down_faces 48 0.005679 0.005695 0.005729 0.00% MLCellLinOp::setLevelBC() 19 0.00366 0.004626 0.005231 0.00% FabArray::FillBoundary() 1553 0.00414 0.00433 0.004853 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0001267 0.003016 0.004716 0.00% AmrLevel::derive() 6 0.003687 0.004232 0.004494 0.00% MLCGSolver::bicgstab 7 0 0.001011 0.004043 0.00% MLCellLinOp::smooth() 688 0.003577 0.003712 0.004028 0.00% FabArrayBase::getFB() 1553 0.003059 0.003235 0.003676 0.00% amrex::Dot() 115 0 0.000892 0.003568 0.00% FabArrayBase::FB::FB() 19 0.002495 0.002813 0.003097 0.00% FabArray::ParallelCopy() 830 0.002877 0.002969 0.00309 0.00% Gravity::test_composite_phi() 1 0.002125 0.002445 0.002663 0.00% main() 1 0.001446 0.001622 0.001832 0.00% Amr::regrid() 5 0.000922 0.001134 0.001565 0.00% MLLinOp::defineGrids() 11 0.001247 0.001384 0.001513 0.00% MLCellLinOp::apply() 318 0.0008305 0.001005 0.001497 0.00% Castro::clean_state() 87 0.001137 0.001274 0.001386 0.00% Castro::do_new_sources() 9 0.0005507 0.0007813 0.001334 0.00% TagBoxArray::collate() 6 0.0008142 0.001123 0.001294 0.00% Amr::coarseTimeStep() 5 0.0005481 0.001044 0.001216 0.00% MLCGSolver::ParallelAllReduce 183 0 0.0002913 0.001165 0.00% AmrLevel::FillCoarsePatch() 5 0.0009036 0.0009498 0.0009964 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0009233 0.0009362 0.0009614 0.00% OwnerMask() 6 0.0008205 0.0008521 0.0008973 0.00% Castro::construct_old_gravity() 9 0.00039 0.0006016 0.0008692 0.00% MLCellLinOp::correctionResidual() 189 0.0006596 0.00069 0.0007489 0.00% Castro::construct_new_gravity() 9 0.0004548 0.0005302 0.0007345 0.00% MLMG::mgVcycle() 65 0.0005967 0.0006219 0.0006622 0.00% FillPatchSingleLevel 92 0.0005008 0.0005442 0.0005886 0.00% Castro::do_advance_ctu() 5 0.0005046 0.0005369 0.0005659 0.00% Amr::grid_places() 6 0.0003875 0.0004922 0.0005459 0.00% TagBoxArray::mapPRD 6 0.0004542 0.0004703 0.000494 0.00% Castro::finalize_advance() 9 0.0002519 0.0003777 0.0004896 0.00% FillPatchIterator::FillFromLevel0() 31 0.0003763 0.0004178 0.0004808 0.00% MLMG:computeResOfCorrection() 155 0.0003658 0.0003868 0.0004202 0.00% MLMG::actualBottomSolve() 31 3.927e-05 0.0001318 0.0003959 0.00% Castro::subcycle_advance_ctu() 5 6.664e-05 0.0001607 0.000383 0.00% MLCellLinOp::solutionResidual() 72 0.000329 0.0003561 0.0003807 0.00% MLMG::oneIter() 31 0.0003201 0.0003419 0.0003628 0.00% Castro::computeNewDt() 8 0.0001092 0.0001757 0.0003463 0.00% FillPatchIterator::FillFromTwoLevels() 31 0.0002848 0.0003093 0.0003321 0.00% MLMG::mgVcycle_down::0 31 0.000267 0.0002911 0.0003241 0.00% Amr::timeStep() 9 0.0001855 0.0002226 0.0002961 0.00% Castro::enforce_speed_limit() 87 0.0002341 0.0002663 0.000293 0.00% MLMG::mgVcycle_down::1 31 0.0002261 0.0002487 0.0002921 0.00% Amr::defBaseLevel() 1 0.0002546 0.0002602 0.0002667 0.00% Gravity::solve_phi_with_mlmg() 11 0.0002167 0.0002414 0.0002595 0.00% Castro::post_regrid() 10 0.0001842 0.0002089 0.0002408 0.00% MLMG::mgVcycle_bottom 65 0.0002175 0.0002231 0.0002283 0.00% MLMG::mgVcycle_down::2 31 0.0001871 0.0001954 0.0002117 0.00% MLMG::mgVcycle_up::0 31 0.000175 0.0001908 0.0002087 0.00% MLMG::mgVcycle_down::3 31 0.0001888 0.0001943 0.0002008 0.00% AmrLevel::AmrLevel(dm) 5 0.0001828 0.0001894 0.0001941 0.00% FabArrayBase::TheFPinfo() 25 0.0001553 0.0001705 0.000191 0.00% makeSFC 33 0.0001496 0.0001676 0.0001884 0.00% MLMG::mgVcycle_down::4 31 0.0001636 0.0001725 0.0001863 0.00% Amr::FinalizeInit() 1 2.852e-05 7.384e-05 0.0001753 0.00% MLMG::mgVcycle_up::1 31 0.0001374 0.0001444 0.0001592 0.00% Castro::check_for_nan() 18 0.000123 0.0001376 0.000156 0.00% Amr::writeSmallPlotFile() 1 9.133e-05 0.000116 0.0001532 0.00% MLMG::mgVcycle_up::2 31 0.0001273 0.0001311 0.0001366 0.00% MLMG::mgVcycle_up::4 31 0.0001148 0.0001241 0.0001365 0.00% MLMG::computeResWithCrseSolFineCor() 17 0.0001263 0.0001301 0.0001344 0.00% FPinfo::FPinfo() 3 0.0001078 0.0001183 0.0001341 0.00% MLMG::mgVcycle_up::3 31 0.0001216 0.0001271 0.0001325 0.00% Castro::expand_state() 13 0.0001098 0.0001178 0.000131 0.00% Castro::react_state() 18 0.0001037 0.0001133 0.0001305 0.00% Castro::apply_source_to_state() 18 9.701e-05 0.0001097 0.0001274 0.00% FabArray::RecvLayoutMask() 8 9.178e-05 9.916e-05 0.0001209 0.00% MLLinOp::makeAgglomeratedDMap 11 0.000105 0.0001113 0.0001191 0.00% DistributionMapping::Distribute() 35 0.0001052 0.0001095 0.0001163 0.00% MLPoisson::define() 11 9.879e-05 0.0001059 0.0001147 0.00% Castro::errorEst() 6 0.0001033 0.0001076 0.0001144 0.00% Castro::advance() 5 8.075e-05 9.179e-05 0.0001132 0.00% MLMG::computeResidual() 31 8.09e-05 8.872e-05 9.68e-05 0.00% Gravity::swapTimeLevels() 9 8.43e-05 9.099e-05 9.382e-05 0.00% ClusterList::intersect() 1 0 2.292e-05 9.168e-05 0.00% Castro::post_timestep() 9 7.54e-05 8.219e-05 8.886e-05 0.00% MLMG::computeMLResidual() 15 7.474e-05 8.102e-05 8.652e-05 0.00% MLMG::miniCycle() 34 6.617e-05 7.394e-05 8.506e-05 0.00% Castro::avgDown(state_indx) 20 6.653e-05 7.309e-05 8.247e-05 0.00% Castro::create_source_corrector() 9 5.337e-05 6.422e-05 7.717e-05 0.00% knapsack() 3 6.486e-05 6.815e-05 7.207e-05 0.00% MLLinOp::define() 11 5.561e-05 6.248e-05 6.959e-05 0.00% MLMG::getGradSolution() 10 5.542e-05 6.132e-05 6.681e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 5.949e-05 6.25e-05 6.65e-05 0.00% Amr::initSubcycle() 1 5.067e-05 5.388e-05 6.242e-05 0.00% amrex::average_down_w_geom 20 4.985e-05 5.352e-05 5.992e-05 0.00% Castro::construct_new_hybrid_source() 9 4.583e-05 4.893e-05 5.533e-05 0.00% Castro::init(old) 3 4.478e-05 4.839e-05 5.116e-05 0.00% MLPoisson::prepareForSolve() 11 4.275e-05 4.634e-05 4.919e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 4.05e-05 4.485e-05 4.901e-05 0.00% Gravity::set_mass_offset() 6 3.242e-05 3.885e-05 4.461e-05 0.00% Castro::post_init() 1 2.309e-05 3.479e-05 4.315e-05 0.00% AmrMesh-cluster 1 0 1.043e-05 4.173e-05 0.00% Amr::bldFineLevels() 1 1.745e-05 2.484e-05 3.871e-05 0.00% Castro::construct_old_hybrid_source() 9 3.373e-05 3.638e-05 3.866e-05 0.00% Castro::avgDown() 4 3.055e-05 3.287e-05 3.65e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.901e-05 3.157e-05 3.441e-05 0.00% BoxList::parallelComplementIn() 12 2.552e-05 2.836e-05 3.293e-05 0.00% Castro::construct_new_rotation_source() 9 2.218e-05 2.53e-05 3.196e-05 0.00% MLMG::MLRhsNormInf() 10 2.945e-05 3.031e-05 3.158e-05 0.00% MLMG::compResidual() 1 2.777e-05 2.842e-05 2.989e-05 0.00% BoxList::complementIn 12 2.267e-05 2.495e-05 2.966e-05 0.00% Castro::retry_advance_ctu() 5 2.052e-05 2.323e-05 2.713e-05 0.00% Castro::construct_old_rotation_source() 9 2.035e-05 2.235e-05 2.449e-05 0.00% Castro::init() 1 1.6e-05 1.838e-05 2.363e-05 0.00% Castro::computeInitialDt() 2 1.552e-05 1.866e-05 2.181e-05 0.00% Castro::derive() 6 1.825e-05 1.97e-05 2.17e-05 0.00% Amr::InitializeInit() 1 6.595e-06 1.093e-05 1.818e-05 0.00% ClusterList::chop() 1 0 3.465e-06 1.386e-05 0.00% Amr::init() 1 6.737e-06 7.161e-06 7.497e-06 0.00% Amr::initialInit() 1 4.478e-06 6.056e-06 6.887e-06 0.00% knapsack()swap 1 3.652e-06 4.031e-06 4.608e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 242.4 242.4 242.4 100.00% Amr::coarseTimeStep() 5 229.8 229.8 229.8 94.80% Amr::timeStep() 9 228.4 228.4 228.4 94.24% Castro::advance() 5 201.2 201.2 201.2 83.00% Castro::subcycle_advance_ctu() 5 192.7 193.1 193.9 80.01% Castro::do_advance_ctu() 5 192.7 193.1 193.9 80.01% Castro::construct_ctu_hydro_source() 9 118.3 118.4 118.5 48.88% Castro::clean_state() 87 70.31 79.14 83.42 34.42% Castro::computeTemp() 88 44.8 50.33 52.77 21.77% Castro::reset_internal_energy(MultiFab) 88 30.15 33.86 35.48 14.64% Castro::evaluate_source_change() 193 17.54 19.58 20.37 8.40% Castro::enforce_min_density() 87 16.33 18.38 19.39 8.00% Castro::post_regrid() 10 15.71 17.18 17.9 7.38% Amr::regrid() 5 15.67 16.98 17.6 7.26% check_for_negative_density() 9 0.2196 5.128 16.6 6.85% Castro::initialize_do_advance() 9 14.72 14.98 15.25 6.29% amrex::Copy() 679 12.52 14.09 14.87 6.13% AmrLevel::FillPatch() 62 8.145 10.03 14.38 5.93% FabArray::ParallelCopy() 830 4.145 7.067 13.65 5.63% FillPatchIterator::Initialize 62 6.437 8.41 12.95 5.34% Castro::do_old_sources() 9 11.1 11.62 12.85 5.30% Castro::normalize_species() 87 9.982 11.35 12.27 5.06% MultiFab::AddProduct() 4205 10.25 11.45 11.91 4.91% Gravity::solve_phi_with_mlmg() 11 11.46 11.62 11.86 4.89% Gravity::multilevel_solve_for_new_phi() 10 11.17 11.33 11.56 4.77% Gravity::actual_multilevel_solve() 10 11.14 11.3 11.53 4.76% FabArray::ParallelCopy_finish() 830 1.405 4.755 11.48 4.73% FillPatchSingleLevel 92 4.198 6.228 10.94 4.51% Castro::do_new_sources() 9 9.214 10.37 10.91 4.50% Amr::init() 1 10.8 10.8 10.8 4.46% FillPatchIterator::FillFromLevel0() 31 3.842 5.838 10.48 4.33% Amr::initialInit() 1 9.986 10.06 10.27 4.24% Castro::post_timestep() 9 10.06 10.06 10.06 4.15% Castro::reset_internal_energy(Fab) 1476 8.489 9.319 9.734 4.02% Castro::estTimeStep() 26 4.088 5.746 9.303 3.84% Castro::reflux() 4 9.027 9.065 9.089 3.75% Castro::initialize_advance() 9 7.251 8.122 8.513 3.51% FabArray::setVal() 5070 7.152 8.034 8.39 3.46% MultiFab::Subtract() 175 6.449 7.231 7.577 3.13% Gravity::actual_solve_with_mlmg() 11 7.144 7.151 7.158 2.95% Castro::construct_new_gravity() 9 6.565 6.694 6.907 2.85% MLMG::solve() 10 6.632 6.647 6.668 2.75% Castro::expand_state() 13 5.202 5.637 6.577 2.71% Amr::FinalizeInit() 1 5.757 6.053 6.347 2.62% MLMG::oneIter() 31 5.39 5.413 5.439 2.24% Gravity::fill_multipole_BCs() 11 4.294 4.454 4.689 1.93% MLMG::mgVcycle() 65 4.536 4.57 4.603 1.90% FluxRegister::Reflux() 24 4.388 4.398 4.407 1.82% Castro::finalize_do_advance() 9 1.352 2.273 4.268 1.76% Amr::InitializeInit() 1 3.639 4.005 4.23 1.74% Amr::defBaseLevel() 1 3.639 4.005 4.23 1.74% FabArray::sum() 4205 3.484 3.886 4.04 1.67% Castro::problem_post_timestep() 10 2.96 3.26 3.963 1.63% Castro::computeNewDt() 8 2.172 2.692 3.889 1.60% MLCellLinOp::smooth() 688 3.448 3.473 3.494 1.44% Castro::post_init() 1 2.66 2.776 2.984 1.23% Castro::initData() 1 2.272 2.574 2.793 1.15% Castro::FluxRegCrseInit 9 1.77 2.107 2.772 1.14% FabArray::ParallelCopy_nowait() 830 2.107 2.309 2.736 1.13% MLPoisson::Fsmooth() 1376 2.086 2.379 2.63 1.09% Castro::construct_old_gravity() 9 0.6813 1.339 2.46 1.01% Gravity::get_old_grav_vector() 9 0.6805 1.339 2.46 1.01% Castro::wd_update() 6 1.17 1.575 2.348 0.97% Castro::construct_new_source() 63 1.893 2.098 2.282 0.94% MLMG::mgVcycle_down::0 31 1.99 2.057 2.121 0.87% MLCellLinOp::applyBC() 1742 1.181 1.497 1.928 0.80% FabArray::FillBoundary() 1553 0.7426 1.079 1.575 0.65% Amr::bldFineLevels() 1 1.319 1.433 1.532 0.63% FillPatchIterator::FillFromTwoLevels() 31 1.49 1.516 1.528 0.63% FillPatchTwoLevels 31 1.489 1.516 1.528 0.63% MLMG::mgVcycle_up::0 31 1.435 1.466 1.492 0.62% FillPatchInterp(MF) 30 1.234 1.358 1.476 0.61% Castro::Castro() 5 1.337 1.384 1.454 0.60% MLCellLinOp::apply() 318 1.368 1.397 1.429 0.59% Amr::writePlotFile() 2 1.059 1.273 1.344 0.55% Amr::InitAmr() 1 1.272 1.272 1.272 0.52% Castro::construct_old_gravity_source() 18 0.9818 1.08 1.23 0.51% amrex::Add() 136 1.013 1.137 1.191 0.49% Castro::initMFs() 5 1.11 1.136 1.176 0.49% FillBoundary_finish() 1553 0.3138 0.7087 1.172 0.48% Castro::computeInitialDt() 2 0.5628 0.7879 1.154 0.48% MLPoisson::Fapply() 318 0.9796 1.06 1.118 0.46% MLCellLinOp::solutionResidual() 72 1.025 1.055 1.104 0.46% Castro::construct_new_gravity_source() 9 0.8618 0.9559 1.096 0.45% Castro::construct_old_source() 63 0.9218 1.035 1.087 0.45% MLCellLinOp::correctionResidual() 189 0.8352 0.86 0.8859 0.37% Gravity::get_new_grav_vector() 10 0.8097 0.8253 0.8585 0.35% FabArray::Saxpy() 182 0.7028 0.7906 0.8262 0.34% MLMG:computeResOfCorrection() 155 0.7045 0.7307 0.7603 0.31% Castro::volInBoundary() 42 0.5739 0.675 0.7255 0.30% VisMF::Write(FabArray) 3 0.5855 0.6543 0.6895 0.28% StateDataPhysBCFunct::() 95 0.581 0.6033 0.6239 0.26% StateData::FillBoundary(geom) 50 0.5788 0.5946 0.6181 0.26% MLMG::computeResWithCrseSolFineCor() 17 0.5887 0.5891 0.59 0.24% Gravity::update_max_rhs() 10 0.08073 0.2734 0.5546 0.23% MultiFab::max() 18 0.02107 0.2162 0.5032 0.21% MLMG::computeMLResidual() 15 0.4244 0.4484 0.5028 0.21% Castro::init() 1 0.4962 0.498 0.5006 0.21% AmrLevel::FillCoarsePatch() 5 0.4962 0.4979 0.5005 0.21% MLMG::mgVcycle_down::1 31 0.3497 0.4077 0.4688 0.19% Castro::check_for_nan() 18 0.3871 0.4339 0.4605 0.19% MultiFab::contains_nan() 18 0.3869 0.4337 0.4604 0.19% FillBoundary_nowait() 1553 0.3076 0.3662 0.4239 0.17% FabArray::Xpay() 283 0.3376 0.3841 0.4079 0.17% Gravity::test_composite_phi() 1 0.4035 0.4043 0.4056 0.17% amrex::average_down 233 0.2826 0.3623 0.405 0.17% MLMG::computeResidual() 31 0.3585 0.3764 0.3921 0.16% MLCellLinOp::reflux() 30 0.1774 0.2364 0.378 0.16% Castro::init(old) 3 0.3598 0.3605 0.3613 0.15% Castro::apply_source_to_state() 18 0.2808 0.3172 0.3315 0.14% MLPoisson::define() 11 0.2833 0.2934 0.3023 0.12% Castro::react_state() 18 0.2127 0.2411 0.2576 0.11% FabArray::setDomainBndry() 92 0.2021 0.2268 0.2446 0.10% MLMG::mgVcycle_up::1 31 0.2268 0.2294 0.2337 0.10% MLMG::prepareForSolve() 10 0.2171 0.2224 0.225 0.09% Amr::grid_places() 6 0.2203 0.2204 0.2205 0.09% AmrMesh::MakeNewGrids() 6 0.2198 0.2199 0.22 0.09% MLCellLinOp::defineAuxData() 11 0.1768 0.1943 0.2069 0.09% Castro::fill_hybrid_hydro_source() 27 0.1815 0.1899 0.1967 0.08% MLMG::addInterpCorrection() 155 0.1381 0.172 0.1886 0.08% MLMG::mgVcycle_bottom 65 0.1505 0.1588 0.1821 0.08% MLMG::getGradSolution() 10 0.172 0.1751 0.1766 0.07% MLCellLinOp::compGrad() 18 0.1719 0.175 0.1765 0.07% MLPoisson::FFlux() 150 0.004701 0.04222 0.1547 0.06% MLMG::miniCycle() 34 0.1506 0.1516 0.1534 0.06% Castro::errorEst() 6 0.1185 0.1269 0.1441 0.06% AmrLevel::AmrLevel(dm) 5 0.1057 0.1212 0.1382 0.06% StateData::define() 25 0.1055 0.121 0.138 0.06% FabArray::mult() 56 0.1224 0.1322 0.136 0.06% Castro::construct_new_hybrid_source() 9 0.1214 0.1271 0.1328 0.05% Castro::avgDown() 4 0.1219 0.1229 0.1242 0.05% Castro::avgDown(state_indx) 20 0.1219 0.1229 0.1241 0.05% amrex::average_down_w_geom 20 0.1218 0.1228 0.1241 0.05% MLMG::ResNormInf() 54 0.07639 0.09018 0.1074 0.04% MLCellLinOp::updateSolBC() 25 0.07754 0.08557 0.09862 0.04% Castro::swap_state_time_levels() 9 0.08354 0.08892 0.09346 0.04% MLCellLinOp::defineBC() 11 0.08455 0.08678 0.0904 0.04% MLMG::computeResWithCrseCorFineCor() 17 0.08502 0.08634 0.08807 0.04% MLMG::mgVcycle_down::2 31 0.07331 0.08041 0.08608 0.04% MLMG::mgVcycle_up::3 31 0.02676 0.06764 0.08168 0.03% MLMG::MLResNormInf() 15 0.04424 0.06695 0.0751 0.03% MLMG::interpCorrection_1 17 0.02649 0.04506 0.0702 0.03% Gravity::swapTimeLevels() 9 0.0303 0.04194 0.06591 0.03% Castro::apply_tagging_restrictions() 6 0.05476 0.05821 0.06559 0.03% Castro::construct_old_hybrid_source() 9 0.06022 0.06294 0.06396 0.03% FabArray::norminf(mask) 21 0.05397 0.06084 0.06337 0.03% BndryData::define() 27 0.05738 0.05964 0.06327 0.03% Castro::derive() 6 0.04567 0.04949 0.05699 0.02% AmrLevel::derive() 6 0.04565 0.04947 0.05697 0.02% MLMG::mgVcycle_up::2 31 0.05476 0.05492 0.05526 0.02% MLCellLinOp::updateCorBC() 17 0.04932 0.05013 0.05182 0.02% Castro::buildMetrics() 5 0.04136 0.04403 0.04982 0.02% TagBoxArray::mapPRD 6 0.01017 0.02994 0.04236 0.02% FabArray::norminf() 147 0.03584 0.03857 0.04148 0.02% MLMG::mgVcycle_down::3 31 0.03193 0.0329 0.03538 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.01841 0.02242 0.0297 0.01% FabArrayBase::getCPC() 1440 0.02304 0.02495 0.02959 0.01% MLMG::actualBottomSolve() 31 3.927e-05 0.007225 0.02877 0.01% MLMG::MLRhsNormInf() 10 0.02477 0.02767 0.02875 0.01% MLCGSolver::bicgstab 7 0 0.007002 0.02801 0.01% Castro::FluxRegFineAdd() 9 0.02563 0.02601 0.02689 0.01% MultiFab::Multiply() 8 0.0211 0.02385 0.0248 0.01% MLMG::compResidual() 1 0.01979 0.02083 0.02227 0.01% MLLinOp::define() 11 0.002568 0.01227 0.02184 0.01% MLLinOp::defineGrids() 11 0.002498 0.01221 0.02178 0.01% Gravity::average_fine_ec_onto_crse_ec() 8 0.0196 0.02013 0.0217 0.01% MLLinOp::makeSubCommunicator() 11 0.0007612 0.01045 0.01999 0.01% Castro::build_fine_mask() 44 0.01656 0.01789 0.01971 0.01% MLMG::mgVcycle_down::4 31 0.005186 0.008732 0.019 0.01% FabArrayBase::CPC::define() 416 0.01318 0.0148 0.01839 0.01% Castro::linear_to_hybrid_momentum() 1 0.01475 0.01565 0.01604 0.01% MLMG::mgVcycle_up::4 31 0.004374 0.006918 0.01433 0.01% AMRErrorTag::operator() 6 0.009893 0.01099 0.01275 0.01% MLPoisson::prepareForSolve() 11 0.01139 0.01158 0.01202 0.00% MLCellLinOp::prepareForSolve() 11 0.01135 0.01153 0.01197 0.00% Castro::enforce_consistent_e() 1 0.009142 0.01031 0.01084 0.00% average_down_faces 48 0.008942 0.009224 0.009532 0.00% Castro::apply_problem_tags() 6 0.007752 0.008138 0.008664 0.00% FabArrayBase::getFB() 1553 0.005617 0.006049 0.006619 0.00% MLCellLinOp::setLevelBC() 19 0.00366 0.004626 0.005231 0.00% FabArrayBase::TheFPinfo() 25 0.0004568 0.003351 0.005059 0.00% FPinfo::FPinfo() 3 0.00029 0.00318 0.004868 0.00% DistributionMapping::KnapSackDoIt() 3 0.0001822 0.003062 0.004734 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0001267 0.003016 0.004716 0.00% amrex::Dot() 115 0 0.000892 0.003568 0.00% FabArrayBase::FB::FB() 19 0.002495 0.002813 0.003097 0.00% MLCGSolver::ParallelAllReduce 183 0 0.0007686 0.003074 0.00% TagBoxArray::collate() 6 0.0008142 0.001123 0.001294 0.00% OwnerMask() 6 0.0008205 0.0008521 0.0008973 0.00% Castro::finalize_advance() 9 0.0002519 0.0003777 0.0004896 0.00% MLLinOp::makeAgglomeratedDMap 11 0.0003488 0.0003776 0.0004124 0.00% makeSFC 33 0.0002438 0.0002664 0.0002934 0.00% Castro::enforce_speed_limit() 87 0.0002341 0.0002663 0.000293 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 9.285e-05 0.0001132 0.0001533 0.00% Amr::writeSmallPlotFile() 1 9.133e-05 0.000116 0.0001532 0.00% AmrMesh-cluster 1 0 3.682e-05 0.0001473 0.00% FabArray::RecvLayoutMask() 8 9.178e-05 9.916e-05 0.0001209 0.00% DistributionMapping::Distribute() 35 0.0001052 0.0001095 0.0001163 0.00% ClusterList::intersect() 1 0 2.292e-05 9.168e-05 0.00% Castro::create_source_corrector() 9 5.337e-05 6.422e-05 7.717e-05 0.00% knapsack() 3 6.851e-05 7.218e-05 7.59e-05 0.00% Amr::initSubcycle() 1 5.067e-05 5.388e-05 6.242e-05 0.00% BoxList::parallelComplementIn() 12 5.037e-05 5.332e-05 5.707e-05 0.00% Gravity::set_mass_offset() 6 3.242e-05 3.885e-05 4.461e-05 0.00% Castro::construct_new_rotation_source() 9 2.218e-05 2.53e-05 3.196e-05 0.00% BoxList::complementIn 12 2.267e-05 2.495e-05 2.966e-05 0.00% Castro::retry_advance_ctu() 5 2.052e-05 2.323e-05 2.713e-05 0.00% Castro::construct_old_rotation_source() 9 2.035e-05 2.235e-05 2.449e-05 0.00% ClusterList::chop() 1 0 3.465e-06 1.386e-05 0.00% knapsack()swap 1 3.652e-06 4.031e-06 4.608e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 4 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-9-g2a3955a5f5aa) finalized