Initializing AMReX (24.04-9-g2a3955a5f5aa)... MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (24.04-9-g2a3955a5f5aa) initialized Starting run at 07:50:33 UTC on 2024-04-09. Successfully read inputs file ... Castro git describe: 24.04-11-g2407e8176 AMReX git describe: 24.04-9-g2a3955a5f Microphysics git describe: 24.04-4-ge5fecb7a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.03160163 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.034553663 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.357947173 Gravity::multilevel_solve_for_new_phi() time = 1.723248973 Gravity::fill_multipole_BCs() time = 0.363656811 ... norm of composite residual at level 0 3.509358608e-10 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.592053706 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.480101354 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.287624606e+47 ener added: 6.129070894e+49 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.449362815e+25 ymom added: -1.046793351e+26 zmom added: -4.133074948e+24 eint added: 0 ener added: -1.270533196e+50 Castro::do_old_sources() time = 2.722375693 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.00547245e+47 ener added: 1.651139801e+46 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 20.90785833 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.643974631 Gravity::multilevel_solve_for_new_phi() time = 1.672364636 Castro::construct_new_gravity() time = 1.78696122 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.440206272e+49 ener added: 2.911791643e+45 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.451207933e+26 ymom added: 1.108730191e+26 zmom added: -5.613112907e+26 eint added: 0 ener added: 1.260457978e+50 Castro::do_new_sources() time = 2.272874773 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.00947637e+27 ener added: 2.068773556e+27 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.02486838494 [Level 0 step 1] Advanced 884736 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.191111111e+26 ener added: 6.213783704e+26 Updating the rotational period from 30.54368673 s to 30.45939751 s. [STEP 1] Coarse TimeStep time: 37.67259334 [STEP 1] FAB kilobyte spread across MPI nodes: [679617 ... 761594] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.03124229 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.404387228 Gravity::multilevel_solve_for_new_phi() time = 1.911748443 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.306135866e+46 ener added: 9.211440366e+51 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135286e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (87,103,92) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135286e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.849559407e+31 ener added: 2.785926976e+31  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135286e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.484200335 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.200514105e+40 ener added: 6.433158322e+33 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.533896722e+24 ymom added: 4.756222074e+26 zmom added: -2.8670017e+23 eint added: 0 ener added: -1.721443002e+45 Castro::do_old_sources() time = 2.294481356 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.53846206 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.147330623e+31 ener added: 1.147330701e+31 Castro::construct_old_gravity() time = 0.033273927 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503703704e+23 ener added: 6.281481481e+23 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.197253778e+40 ener added: 1.791685121e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.572524451e+22 ymom added: 1.564283897e+22 zmom added: 6.441804792e+21 eint added: 0 ener added: -2.586789965e+47 Castro::do_old_sources() time = 0.194317356 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.204912576e+51 ener added: 6.747117479e+48 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.788955558 on level 1 Castro::reflux() at level 0 : time = 2.248142284 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.419162154 Gravity::multilevel_solve_for_new_phi() time = 1.36393038 Castro::construct_new_gravity() time = 1.476493004 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.46375568e+41 ener added: 7.485558923e+35 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.861679586e+21 ymom added: -6.245616015e+21 zmom added: -1.245900444e+20 eint added: 0 ener added: -3.223710603e+41 Castro::do_new_sources() time = 1.961448577 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.149299259e+26 ener added: 4.592592593e+21 ...estimated hydro-limited timestep at level 0: 0.05461716025 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716025 Castro::construct_new_gravity() time = 0.030322466 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.564837764e+47 ener added: 4.559472528e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.764827561e+18 ymom added: -1.361438167e+19 zmom added: -8.219114372e+19 eint added: 0 ener added: 2.564611685e+47 Castro::do_new_sources() time = 0.140829059 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.281889991e+29 ener added: 3.281888214e+29 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02293011013 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.057555556e+24 ener added: 5.917703704e+24 Updating the rotational period from 30.45939751 s to 30.52749735 s. [STEP 2] Coarse TimeStep time: 49.43333705 [STEP 2] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 2 TIME = 0.005426075163 DT = 2.526135286e-09 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008131491259 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.287037368e-07 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Now regridding at level lbase = 0 grid_places() time: 0.031516919 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.421184316 Gravity::multilevel_solve_for_new_phi() time = 0.551605987 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778748814e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.412994203 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.083120164e+24 ymom added: 5.231862796e+26 zmom added: -3.157856713e+23 eint added: 0 ener added: -1.937110674e+45 Castro::do_old_sources() time = 2.319696258 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.15767985 on level 0 Castro::construct_old_gravity() time = 0.030738856 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.818691374e+40 ener added: 1.212217725e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 8.444283416e+22 ymom added: 4.427218578e+21 zmom added: 7.103293505e+21 eint added: 0 ener added: -2.344787748e+45 Castro::do_old_sources() time = 0.193522462 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.83673455e+48 ener added: 2.077900047e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.765404966 on level 1 Castro::reflux() at level 0 : time = 2.24346757 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.424291821 Gravity::multilevel_solve_for_new_phi() time = 0.969113807 Castro::construct_new_gravity() time = 1.078979346 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.106550538e+21 ymom added: -7.896156836e+21 zmom added: 1.108336323e+20 eint added: 0 ener added: -3.427512073e+41 Castro::do_new_sources() time = 1.96971619 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008131520194 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131520194 Castro::construct_new_gravity() time = 0.029359138 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.244373444e+43 ener added: 1.74625952e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: -6.818134826e+17 ymom added: 2.352230085e+19 zmom added: 9.539391937e+19 eint added: 0 ener added: 5.303047905e+43 Castro::do_new_sources() time = 0.140320584 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.490463796e+26 ener added: 1.495539352e+26 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02345056768 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.281481481e+24 ener added: 6.674962963e+24 Updating the rotational period from 30.52749735 s to 30.52751553 s. [STEP 3] Coarse TimeStep time: 46.59111393 [STEP 3] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 3 TIME = 0.005426077942 DT = 2.778748814e-09 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008130329735 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.564309766e-07 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Now regridding at level lbase = 0 grid_places() time: 0.031736114 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.404702936 Gravity::multilevel_solve_for_new_phi() time = 0.534096988 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056623695e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.420951243 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.694655893e+24 ymom added: 5.755038681e+26 zmom added: -3.471622784e+23 eint added: 0 ener added: -2.130751807e+45 Castro::do_old_sources() time = 2.29715524 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.19576441 on level 0 Castro::construct_old_gravity() time = 0.030233966 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.150425349e+40 ener added: 1.373884257e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 9.198796457e+22 ymom added: 1.239621202e+22 zmom added: 8.023757211e+21 eint added: 0 ener added: -2.520808161e+45 Castro::do_old_sources() time = 0.192718746 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.318881554e+48 ener added: 1.675623034e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.853528041 on level 1 Castro::reflux() at level 0 : time = 2.233009945 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.43213211 Gravity::multilevel_solve_for_new_phi() time = 0.976710849 Castro::construct_new_gravity() time = 1.085659965 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.405071346e+21 ymom added: -9.735495453e+21 zmom added: -7.674479504e+18 eint added: 0 ener added: -3.723007452e+41 Castro::do_new_sources() time = 1.931566352 on level 0 ...estimated hydro-limited timestep at level 0: 0.000813036171 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000813036171 Castro::construct_new_gravity() time = 0.02943046 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.983601425e+43 ener added: 1.617265925e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.59849131e+18 ymom added: -2.567952508e+19 zmom added: -1.336956483e+19 eint added: 0 ener added: 4.042918443e+43 Castro::do_new_sources() time = 0.140577056 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.942862037e+25 ener added: 2.885587963e+25 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02345075599 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.365462963e+23 ener added: 4.62962963e+19 Updating the rotational period from 30.52751553 s to 30.52751552 s. [STEP 4] Coarse TimeStep time: 46.61353008 [STEP 4] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 4 TIME = 0.005426080998 DT = 3.056623696e-09 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002506596503 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.863488975e-07 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Now regridding at level lbase = 0 grid_places() time: 0.031606211 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.403230389 Gravity::multilevel_solve_for_new_phi() time = 0.531771054 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286065e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.389136451 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.366517551e+24 ymom added: 6.330531998e+26 zmom added: -3.819056992e+23 eint added: 0 ener added: -2.343742535e+45 Castro::do_old_sources() time = 2.305103798 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.71873675 on level 0 Castro::construct_old_gravity() time = 0.029040594 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.560109532e+40 ener added: 1.662186973e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.013693826e+23 ymom added: 1.770887431e+22 zmom added: 8.796070504e+21 eint added: 0 ener added: -2.728291723e+45 Castro::do_old_sources() time = 0.191552807 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.05099824e+48 ener added: 1.448876286e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.839619682 on level 1 Castro::reflux() at level 0 : time = 2.2241642 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.421297548 Gravity::multilevel_solve_for_new_phi() time = 0.968196181 Castro::construct_new_gravity() time = 1.078040631 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.799171515e+21 ymom added: -1.177853541e+22 zmom added: -4.924059364e+18 eint added: 0 ener added: -4.148475158e+41 Castro::do_new_sources() time = 1.949122818 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006828000901 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006828000901 Castro::construct_new_gravity() time = 0.028884805 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.326552265e+43 ener added: 1.577214716e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.726742622e+18 ymom added: -2.54093091e+19 zmom added: -1.25233826e+19 eint added: 0 ener added: 3.390623254e+43 Castro::do_new_sources() time = 0.136584802 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.819509259e+24 ener added: 4.717583333e+24 ...estimated hydro-limited timestep at level 1: 7.169281148e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.169281148e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02316946966 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.94814634e+22 ener added: 2.962962963e+20 Updating the rotational period from 30.52751552 s to 30.52751551 s. [STEP 5] Coarse TimeStep time: 47.03470009 [STEP 5] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 5 TIME = 0.005426084361 DT = 3.362286065e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.5332296 seconds Ending run at 07:54:32 UTC on 2024-04-09. Run time = 239.3136351 Run time without initialization = 227.8802529 Average number of zones advanced per microsecond: 0.022 Average number of zones advanced per microsecond per rank: 0.005 TinyProfiler total time across processes [min...avg...max]: 239.3 ... 239.3 ... 239.3 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 9 91.6100 102.5141 107.3827 44.87% Castro::computeTemp() 88 14.52 16.42 17.15 7.17% check_for_negative_density() 9 0.5434 5.396 16.33 6.82% amrex::Copy() 679 12.51 14.09 14.78 6.18% MultiFab::AddProduct() 4205 10.22 11.45 11.91 4.98% Castro::normalize_species() 87 9.92 11.23 11.78 4.92% FabArray::ParallelCopy_finish() 830 1.354 4.182 10.81 4.52% Castro::reset_internal_energy(Fab) 1476 8.227 9.121 9.506 3.97% Castro::estTimeStep() 26 3.977 5.257 8.653 3.62% FabArray::setVal() 5070 7.174 8.024 8.387 3.50% MultiFab::Subtract() 175 6.454 7.235 7.545 3.15% Gravity::fill_multipole_BCs() 11 4.247 4.373 4.626 1.93% Castro::reset_internal_energy(MultiFab) 88 3.249 3.823 4.353 1.82% FabArray::sum() 4205 3.483 3.887 4.025 1.68% FluxRegister::Reflux() 24 2.9 3.265 3.411 1.43% FabArray::ParallelCopy_nowait() 830 2.026 2.237 2.605 1.09% MLPoisson::Fsmooth() 1376 2.083 2.326 2.411 1.01% Castro::enforce_min_density() 87 1.48 1.841 2.338 0.98% Castro::wd_update() 6 0.533 0.8996 1.767 0.74% Castro::FluxRegCrseInit 9 1.452 1.628 1.741 0.73% Castro::reflux() 4 1.463 1.652 1.722 0.72% FillPatchInterp(MF) 30 1.228 1.344 1.453 0.61% amrex::Add() 136 1.014 1.134 1.183 0.49% Amr::InitAmr() 1 1.156 1.156 1.156 0.48% Castro::initMFs() 5 1.075 1.111 1.128 0.47% MLPoisson::Fapply() 318 0.9043 1.026 1.122 0.47% Castro::construct_old_gravity_source() 18 0.871 0.9904 1.04 0.43% Castro::construct_new_gravity_source() 9 0.7561 0.8526 0.9117 0.38% FabArray::Saxpy() 182 0.8155 0.8375 0.8981 0.38% Castro::problem_post_timestep() 10 0.7696 0.8009 0.8759 0.37% FillBoundary_finish() 1553 0.2896 0.4675 0.8745 0.37% FillPatchIterator::Initialize 62 0.7429 0.8201 0.8566 0.36% Castro::volInBoundary() 42 0.6561 0.7322 0.8065 0.34% VisMF::Write(FabArray) 3 0.5895 0.6656 0.707 0.30% StateData::FillBoundary(geom) 50 0.5793 0.5911 0.6075 0.25% MultiFab::max() 18 0.02445 0.2244 0.5636 0.24% Castro::construct_new_source() 63 0.4734 0.5279 0.5499 0.23% MultiFab::contains_nan() 18 0.384 0.4346 0.4599 0.19% MLCellLinOp::applyBC() 1742 0.3569 0.4128 0.4383 0.18% FillBoundary_nowait() 1553 0.3184 0.3639 0.4073 0.17% FabArray::Xpay() 283 0.3396 0.3782 0.3934 0.16% Amr::writePlotFile() 2 0.09421 0.1673 0.2846 0.12% Castro::initialize_do_advance() 9 0.2299 0.26 0.2741 0.11% FabArray::setDomainBndry() 92 0.2033 0.2248 0.2358 0.10% Castro::construct_old_source() 63 0.2016 0.2201 0.2337 0.10% amrex::average_down 233 0.1934 0.2029 0.211 0.09% Castro::fill_hybrid_hydro_source() 27 0.1639 0.1851 0.1936 0.08% MLCellLinOp::defineAuxData() 11 0.1504 0.1647 0.1713 0.07% Castro::initData() 1 0.1244 0.1426 0.1535 0.06% MLPoisson::FFlux() 150 0.00467 0.04188 0.1534 0.06% MLCellLinOp::compGrad() 18 0.1264 0.1416 0.1481 0.06% FabArray::mult() 56 0.1153 0.1303 0.1358 0.06% MLMG::addInterpCorrection() 155 0.1122 0.1236 0.1279 0.05% StateData::define() 25 0.1057 0.1181 0.1261 0.05% Castro::evaluate_source_change() 193 0.1014 0.1103 0.1165 0.05% Castro::swap_state_time_levels() 9 0.09425 0.09836 0.1065 0.04% Gravity::get_new_grav_vector() 10 0.08545 0.09448 0.09851 0.04% Gravity::get_old_grav_vector() 9 0.07721 0.08702 0.09157 0.04% Castro::initialize_advance() 9 0.08251 0.0853 0.09109 0.04% MLMG::prepareForSolve() 10 0.05999 0.06604 0.06958 0.03% MLMG::solve() 10 0.002172 0.04319 0.06813 0.03% MLCellLinOp::updateSolBC() 25 0.0673 0.06761 0.0679 0.03% FabArray::norminf(mask) 21 0.0564 0.06136 0.06366 0.03% AmrLevel::FillPatch() 62 0.05023 0.05301 0.05705 0.02% Castro::apply_tagging_restrictions() 6 0.04752 0.05327 0.05542 0.02% MLMG::ResNormInf() 54 0.0006509 0.02045 0.05379 0.02% AmrMesh::MakeNewGrids() 6 0.0468 0.04826 0.0524 0.02% MLCellLinOp::updateCorBC() 17 0.04561 0.0457 0.04588 0.02% BndryData::define() 27 0.04167 0.04329 0.04518 0.02% FabArray::norminf() 147 0.03712 0.03913 0.04183 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.02758 0.03308 0.04025 0.02% MLMG::MLResNormInf() 15 0.000111 0.02392 0.0341 0.01% MLCellLinOp::reflux() 30 0.004214 0.01168 0.0336 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.01872 0.02235 0.02812 0.01% MLCellLinOp::defineBC() 11 0.02586 0.02598 0.02613 0.01% Castro::FluxRegFineAdd() 9 0.02542 0.0256 0.0258 0.01% MultiFab::Multiply() 8 0.0211 0.02375 0.02476 0.01% Castro::build_fine_mask() 44 0.01648 0.01834 0.01993 0.01% StateDataPhysBCFunct::() 95 0.002098 0.007388 0.01985 0.01% MLLinOp::makeSubCommunicator() 11 0.0006085 0.008329 0.01919 0.01% MLMG::interpCorrection_1 17 0.0182 0.01851 0.01909 0.01% Castro::do_old_sources() 9 0.0006663 0.006173 0.01819 0.01% FabArrayBase::CPC::define() 416 0.01299 0.01472 0.01782 0.01% Castro::Castro() 5 0.01447 0.01642 0.0173 0.01% Castro::linear_to_hybrid_momentum() 1 0.01391 0.01588 0.0169 0.01% Castro::buildMetrics() 5 0.01503 0.01634 0.01689 0.01% FillPatchTwoLevels 31 0.0121 0.01325 0.01427 0.01% MLCellLinOp::prepareForSolve() 11 0.01139 0.0115 0.01172 0.00% Castro::enforce_consistent_e() 1 0.009173 0.01041 0.0109 0.00% FabArrayBase::getCPC() 1440 0.009615 0.009982 0.01065 0.00% AMRErrorTag::operator() 6 0.008513 0.0096 0.01007 0.00% Gravity::actual_multilevel_solve() 10 0.007851 0.008902 0.009974 0.00% Gravity::actual_solve_with_mlmg() 11 0.009396 0.00965 0.009934 0.00% Castro::finalize_do_advance() 9 0.007187 0.008305 0.008891 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0006935 0.004781 0.008835 0.00% Gravity::update_max_rhs() 10 0.007795 0.008257 0.008586 0.00% Castro::apply_problem_tags() 6 0.006914 0.007796 0.008098 0.00% Castro::do_new_sources() 9 0.0005841 0.002312 0.006661 0.00% average_down_faces 48 0.005629 0.005642 0.005666 0.00% MLCellLinOp::setLevelBC() 19 0.003659 0.004529 0.005257 0.00% FabArray::FillBoundary() 1553 0.004091 0.004293 0.004636 0.00% AmrLevel::derive() 6 0.003724 0.004162 0.00434 0.00% MLCellLinOp::smooth() 688 0.003527 0.003666 0.003834 0.00% MLCGSolver::bicgstab 7 0 0.0009569 0.003828 0.00% Gravity::test_composite_phi() 1 0.002133 0.002849 0.003765 0.00% FabArrayBase::getFB() 1553 0.003026 0.003219 0.003615 0.00% amrex::Dot() 115 0 0.000819 0.003276 0.00% FabArrayBase::FB::FB() 19 0.002525 0.002835 0.003159 0.00% FabArray::ParallelCopy() 830 0.00292 0.002969 0.003041 0.00% main() 1 0.001484 0.001512 0.001577 0.00% MLLinOp::defineGrids() 11 0.00127 0.001394 0.001529 0.00% Amr::regrid() 5 0.0009345 0.001112 0.001455 0.00% MLCellLinOp::apply() 318 0.0008234 0.0009946 0.001427 0.00% Castro::construct_old_gravity() 9 0.0004372 0.0008365 0.00134 0.00% Castro::clean_state() 87 0.001247 0.00127 0.001331 0.00% TagBoxArray::collate() 6 0.0003494 0.0009867 0.001296 0.00% Amr::coarseTimeStep() 5 0.0005247 0.0009953 0.001155 0.00% MLCGSolver::ParallelAllReduce 183 0 0.0002694 0.001078 0.00% AmrLevel::FillCoarsePatch() 5 0.0008961 0.000951 0.001006 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0009085 0.0009205 0.0009323 0.00% OwnerMask() 6 0.0007311 0.0008274 0.0008947 0.00% Castro::construct_new_gravity() 9 0.0004266 0.0005508 0.0007401 0.00% MLCellLinOp::correctionResidual() 189 0.0006478 0.0006829 0.0007024 0.00% MLMG::mgVcycle() 65 0.0005794 0.0006091 0.0006251 0.00% Amr::grid_places() 6 0.000438 0.0004894 0.000555 0.00% Castro::do_advance_ctu() 5 0.0004722 0.0005082 0.0005541 0.00% FillPatchSingleLevel 92 0.0005142 0.0005303 0.0005361 0.00% FillPatchIterator::FillFromLevel0() 31 0.000371 0.0004198 0.0004688 0.00% TagBoxArray::mapPRD 6 0.0004327 0.000441 0.0004465 0.00% Castro::subcycle_advance_ctu() 5 8.83e-05 0.0001994 0.0004442 0.00% Castro::finalize_advance() 9 0.0003241 0.0003587 0.0004135 0.00% MLMG:computeResOfCorrection() 155 0.000363 0.0003823 0.000403 0.00% MLCellLinOp::solutionResidual() 72 0.0003231 0.0003484 0.0003682 0.00% MLMG::oneIter() 31 0.0003274 0.0003466 0.0003546 0.00% MLMG::actualBottomSolve() 31 3.983e-05 0.0001182 0.0003493 0.00% FillPatchIterator::FillFromTwoLevels() 31 0.0002907 0.0003051 0.0003442 0.00% MLMG::mgVcycle_down::0 31 0.0002703 0.0002854 0.0003009 0.00% Castro::computeNewDt() 8 0.0001088 0.0001568 0.0002841 0.00% Castro::enforce_speed_limit() 87 0.0002547 0.000262 0.0002775 0.00% MLMG::mgVcycle_down::1 31 0.0002335 0.00025 0.0002698 0.00% Gravity::solve_phi_with_mlmg() 11 0.0002238 0.0002394 0.0002587 0.00% Amr::defBaseLevel() 1 0.0002246 0.0002441 0.0002569 0.00% Castro::post_regrid() 10 0.0001909 0.0002137 0.0002551 0.00% Amr::timeStep() 9 0.000201 0.0002164 0.0002472 0.00% Amr::FinalizeInit() 1 2.905e-05 8.123e-05 0.0002198 0.00% MLMG::mgVcycle_bottom 65 0.0002125 0.0002167 0.0002192 0.00% AmrLevel::AmrLevel(dm) 5 0.0001843 0.0001915 0.0002018 0.00% MLMG::mgVcycle_up::0 31 0.0001806 0.0001919 0.0002016 0.00% MLMG::mgVcycle_down::2 31 0.0001887 0.0001953 0.0002013 0.00% MLMG::mgVcycle_down::3 31 0.0001875 0.000191 0.0001946 0.00% makeSFC 33 0.0001573 0.0001721 0.0001892 0.00% FabArrayBase::TheFPinfo() 25 0.0001593 0.0001724 0.0001805 0.00% MLMG::mgVcycle_down::4 31 0.0001636 0.0001692 0.0001789 0.00% Castro::check_for_nan() 18 0.0001267 0.0001376 0.0001581 0.00% MLMG::mgVcycle_up::1 31 0.0001364 0.0001409 0.0001508 0.00% FPinfo::FPinfo() 3 0.00011 0.0001219 0.0001451 0.00% Castro::react_state() 18 0.0001061 0.0001215 0.0001428 0.00% MLMG::computeResWithCrseSolFineCor() 17 0.000125 0.0001316 0.0001357 0.00% MLMG::mgVcycle_up::2 31 0.0001266 0.0001283 0.00013 0.00% MLMG::mgVcycle_up::4 31 0.0001151 0.0001194 0.0001281 0.00% MLMG::mgVcycle_up::3 31 0.0001206 0.0001239 0.0001278 0.00% Castro::expand_state() 13 0.0001045 0.0001159 0.0001256 0.00% Amr::writeSmallPlotFile() 1 9.278e-05 0.0001056 0.0001225 0.00% DistributionMapping::Distribute() 35 0.0001022 0.0001117 0.0001219 0.00% MLLinOp::makeAgglomeratedDMap 11 0.0001057 0.0001114 0.0001194 0.00% Castro::apply_source_to_state() 18 0.0001029 0.0001079 0.0001157 0.00% MLPoisson::define() 11 0.0001021 0.0001085 0.0001131 0.00% Castro::errorEst() 6 0.0001034 0.0001058 0.0001106 0.00% Castro::advance() 5 8.178e-05 9.139e-05 0.0001105 0.00% FabArray::RecvLayoutMask() 8 9.151e-05 9.876e-05 0.0001101 0.00% Gravity::swapTimeLevels() 9 8.19e-05 9.002e-05 0.0001051 0.00% MLMG::computeResidual() 31 8.102e-05 8.464e-05 9.27e-05 0.00% Castro::post_timestep() 9 7.599e-05 8.416e-05 9.232e-05 0.00% MLMG::computeMLResidual() 15 7.508e-05 7.979e-05 8.426e-05 0.00% ClusterList::intersect() 1 0 2.042e-05 8.168e-05 0.00% knapsack() 3 6.398e-05 6.969e-05 7.543e-05 0.00% MLMG::miniCycle() 34 6.739e-05 6.963e-05 7.431e-05 0.00% Castro::avgDown(state_indx) 20 6.51e-05 7.014e-05 7.396e-05 0.00% Castro::create_source_corrector() 9 5.296e-05 6.168e-05 7.32e-05 0.00% MLLinOp::define() 11 5.832e-05 6.119e-05 6.599e-05 0.00% MLMG::getGradSolution() 10 5.771e-05 6.064e-05 6.369e-05 0.00% amrex::average_down_w_geom 20 5.006e-05 5.621e-05 6.289e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 6.072e-05 6.144e-05 6.246e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 4.608e-05 5.66e-05 6.122e-05 0.00% Amr::initSubcycle() 1 5.075e-05 5.183e-05 5.235e-05 0.00% Castro::construct_new_hybrid_source() 9 4.56e-05 4.767e-05 5.052e-05 0.00% MLPoisson::prepareForSolve() 11 4.445e-05 4.688e-05 5.022e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.94e-05 3.613e-05 4.815e-05 0.00% Castro::init(old) 3 4.379e-05 4.56e-05 4.728e-05 0.00% Castro::retry_advance_ctu() 5 2.559e-05 3.19e-05 4.684e-05 0.00% Gravity::set_mass_offset() 6 3.244e-05 3.513e-05 3.92e-05 0.00% Castro::construct_old_hybrid_source() 9 3.533e-05 3.649e-05 3.817e-05 0.00% Amr::bldFineLevels() 1 2.135e-05 2.975e-05 3.682e-05 0.00% Castro::computeInitialDt() 2 1.663e-05 2.601e-05 3.61e-05 0.00% MLMG::compResidual() 1 2.667e-05 2.936e-05 3.593e-05 0.00% AmrMesh-cluster 1 0 8.946e-06 3.579e-05 0.00% BoxList::parallelComplementIn() 12 2.502e-05 2.87e-05 3.431e-05 0.00% Castro::avgDown() 4 2.913e-05 3.214e-05 3.429e-05 0.00% MLMG::MLRhsNormInf() 10 2.915e-05 3.161e-05 3.423e-05 0.00% Castro::post_init() 1 2.326e-05 2.694e-05 2.991e-05 0.00% BoxList::complementIn 12 2.323e-05 2.495e-05 2.789e-05 0.00% Castro::construct_new_rotation_source() 9 1.966e-05 2.225e-05 2.672e-05 0.00% Castro::construct_old_rotation_source() 9 2.224e-05 2.324e-05 2.452e-05 0.00% Castro::derive() 6 1.812e-05 1.97e-05 2.149e-05 0.00% Castro::init() 1 1.567e-05 1.626e-05 1.712e-05 0.00% Amr::InitializeInit() 1 8.473e-06 1.021e-05 1.116e-05 0.00% ClusterList::chop() 1 0 2.637e-06 1.055e-05 0.00% Amr::init() 1 6.747e-06 7.362e-06 9.022e-06 0.00% Amr::initialInit() 1 5.011e-06 6.125e-06 7.554e-06 0.00% knapsack()swap 1 3.498e-06 3.749e-06 3.889e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 239.3 239.3 239.3 100.00% Amr::coarseTimeStep() 5 227.3 227.3 227.3 95.00% Amr::timeStep() 9 226 226 226 94.45% Castro::advance() 5 199.1 199.1 199.1 83.19% Castro::subcycle_advance_ctu() 5 190.6 191 191.8 80.13% Castro::do_advance_ctu() 5 190.6 191 191.8 80.13% Castro::construct_ctu_hydro_source() 9 117.5 117.7 117.7 49.19% Castro::clean_state() 87 69.84 78.81 82.5 34.47% Castro::computeTemp() 88 44.35 49.98 52.35 21.87% Castro::reset_internal_energy(MultiFab) 88 29.83 33.56 35.2 14.71% Castro::evaluate_source_change() 193 17.5 19.58 20.34 8.50% Castro::enforce_min_density() 87 16.35 18.48 19.51 8.15% Castro::post_regrid() 10 15.61 17.11 17.74 7.41% Amr::regrid() 5 15.55 16.9 17.47 7.30% check_for_negative_density() 9 0.5434 5.396 16.33 6.82% Castro::initialize_do_advance() 9 14.49 14.84 15.03 6.28% amrex::Copy() 679 12.51 14.09 14.78 6.18% AmrLevel::FillPatch() 62 7.946 9.472 13.8 5.77% FabArray::ParallelCopy() 830 4.028 6.482 12.98 5.43% Castro::do_old_sources() 9 10.97 11.43 12.71 5.31% FillPatchIterator::Initialize 62 6.288 7.857 12.35 5.16% MultiFab::AddProduct() 4205 10.22 11.45 11.91 4.98% Castro::normalize_species() 87 9.92 11.23 11.78 4.92% Gravity::solve_phi_with_mlmg() 11 11.13 11.25 11.5 4.81% Gravity::multilevel_solve_for_new_phi() 10 10.84 10.96 11.2 4.68% Gravity::actual_multilevel_solve() 10 10.81 10.93 11.17 4.67% FabArray::ParallelCopy_finish() 830 1.354 4.182 10.81 4.52% Castro::do_new_sources() 9 9.156 10.23 10.64 4.45% FillPatchSingleLevel 92 4.049 5.685 10.3 4.31% Amr::init() 1 10.28 10.28 10.28 4.29% Castro::post_timestep() 9 9.93 9.93 9.931 4.15% FillPatchIterator::FillFromLevel0() 31 3.716 5.318 9.89 4.13% Amr::initialInit() 1 9.684 9.684 9.684 4.05% Castro::reset_internal_energy(Fab) 1476 8.227 9.121 9.506 3.97% Castro::reflux() 4 8.881 8.928 8.948 3.74% Castro::estTimeStep() 26 3.977 5.257 8.653 3.62% Castro::initialize_advance() 9 7.322 8.124 8.438 3.53% FabArray::setVal() 5070 7.174 8.024 8.387 3.50% MultiFab::Subtract() 175 6.454 7.235 7.545 3.15% Gravity::actual_solve_with_mlmg() 11 6.779 6.786 6.793 2.84% Castro::construct_new_gravity() 9 6.282 6.398 6.624 2.77% Castro::expand_state() 13 5.094 5.463 6.336 2.65% MLMG::solve() 10 6.273 6.286 6.306 2.63% Amr::FinalizeInit() 1 5.655 5.781 6.094 2.55% MLMG::oneIter() 31 5.07 5.088 5.095 2.13% Gravity::fill_multipole_BCs() 11 4.327 4.449 4.694 1.96% FluxRegister::Reflux() 24 4.333 4.349 4.357 1.82% MLMG::mgVcycle() 65 4.233 4.262 4.273 1.79% Amr::InitializeInit() 1 3.589 3.903 4.029 1.68% Amr::defBaseLevel() 1 3.589 3.903 4.029 1.68% FabArray::sum() 4205 3.483 3.887 4.025 1.68% Castro::finalize_do_advance() 9 1.332 2.052 3.973 1.66% Castro::problem_post_timestep() 10 2.744 3.117 3.908 1.63% Castro::computeNewDt() 8 2.148 2.58 3.741 1.56% MLCellLinOp::smooth() 688 3.187 3.221 3.251 1.36% Castro::post_init() 1 2.48 2.68 3.012 1.26% Castro::FluxRegCrseInit 9 1.786 2.123 2.828 1.18% FabArray::ParallelCopy_nowait() 830 2.084 2.297 2.671 1.12% Castro::initData() 1 2.193 2.488 2.649 1.11% Castro::wd_update() 6 1.257 1.632 2.423 1.01% MLPoisson::Fsmooth() 1376 2.083 2.326 2.411 1.01% Castro::construct_old_gravity() 9 0.6749 1.172 2.311 0.97% Gravity::get_old_grav_vector() 9 0.6735 1.171 2.31 0.97% Castro::construct_new_source() 63 1.848 2.005 2.082 0.87% MLMG::mgVcycle_down::0 31 1.864 1.936 1.976 0.83% MLCellLinOp::applyBC() 1742 1.081 1.254 1.649 0.69% Amr::bldFineLevels() 1 1.233 1.418 1.553 0.65% FillPatchIterator::FillFromTwoLevels() 31 1.477 1.495 1.509 0.63% FillPatchTwoLevels 31 1.476 1.495 1.509 0.63% FillPatchInterp(MF) 30 1.228 1.344 1.453 0.61% Castro::Castro() 5 1.337 1.373 1.41 0.59% MLMG::mgVcycle_up::0 31 1.351 1.377 1.386 0.58% MLCellLinOp::apply() 318 1.275 1.319 1.374 0.57% FabArray::FillBoundary() 1553 0.6439 0.8417 1.292 0.54% amrex::Add() 136 1.014 1.134 1.183 0.49% Amr::InitAmr() 1 1.156 1.156 1.156 0.48% Castro::initMFs() 5 1.082 1.117 1.134 0.47% Amr::writePlotFile() 2 1.126 1.126 1.126 0.47% MLPoisson::Fapply() 318 0.9043 1.026 1.122 0.47% Castro::construct_old_source() 63 0.9484 1.035 1.07 0.45% MLCellLinOp::solutionResidual() 72 0.9571 1.017 1.07 0.45% Castro::construct_old_gravity_source() 18 0.871 0.9904 1.04 0.43% Castro::computeInitialDt() 2 0.5065 0.6327 0.9464 0.40% Castro::construct_new_gravity_source() 9 0.7561 0.8526 0.9117 0.38% FabArray::Saxpy() 182 0.8155 0.8375 0.8981 0.38% FillBoundary_finish() 1553 0.2896 0.4675 0.8745 0.37% MLCellLinOp::correctionResidual() 189 0.805 0.8133 0.8265 0.35% Castro::volInBoundary() 42 0.6562 0.7323 0.8065 0.34% Gravity::get_new_grav_vector() 10 0.7651 0.7739 0.7839 0.33% MLMG:computeResOfCorrection() 155 0.6441 0.6819 0.7145 0.30% VisMF::Write(FabArray) 3 0.5895 0.6656 0.707 0.30% Gravity::update_max_rhs() 10 0.08331 0.282 0.6154 0.26% StateDataPhysBCFunct::() 95 0.5814 0.5984 0.6128 0.26% StateData::FillBoundary(geom) 50 0.5793 0.5911 0.6075 0.25% MLMG::computeResWithCrseSolFineCor() 17 0.5837 0.5843 0.5856 0.24% MultiFab::max() 18 0.02445 0.2244 0.5636 0.24% MLMG::computeMLResidual() 15 0.4169 0.4429 0.4997 0.21% Castro::init() 1 0.4869 0.488 0.4889 0.20% AmrLevel::FillCoarsePatch() 5 0.4869 0.488 0.4889 0.20% Castro::check_for_nan() 18 0.3841 0.4347 0.4601 0.19% MultiFab::contains_nan() 18 0.384 0.4346 0.4599 0.19% FillBoundary_nowait() 1553 0.3241 0.3699 0.4135 0.17% MLMG::mgVcycle_down::1 31 0.3077 0.3425 0.4078 0.17% Gravity::test_composite_phi() 1 0.4031 0.4043 0.4075 0.17% amrex::average_down 233 0.2761 0.3547 0.3995 0.17% FabArray::Xpay() 283 0.3396 0.3782 0.3934 0.16% MLCellLinOp::reflux() 30 0.1767 0.2374 0.3751 0.16% MLMG::computeResidual() 31 0.3391 0.3515 0.3658 0.15% Castro::init(old) 3 0.3585 0.3622 0.3646 0.15% Castro::apply_source_to_state() 18 0.3254 0.3348 0.3585 0.15% MLPoisson::define() 11 0.2834 0.2913 0.3013 0.13% Castro::react_state() 18 0.2137 0.2448 0.2646 0.11% FabArray::setDomainBndry() 92 0.2033 0.2248 0.2358 0.10% MLMG::prepareForSolve() 10 0.2129 0.219 0.2222 0.09% MLMG::mgVcycle_up::1 31 0.2148 0.2183 0.22 0.09% MLCellLinOp::defineAuxData() 11 0.1767 0.1941 0.2053 0.09% Castro::fill_hybrid_hydro_source() 27 0.1639 0.1851 0.1936 0.08% Amr::grid_places() 6 0.1922 0.1923 0.1924 0.08% AmrMesh::MakeNewGrids() 6 0.1918 0.1918 0.1919 0.08% MLMG::addInterpCorrection() 155 0.133 0.1683 0.1852 0.08% MLMG::getGradSolution() 10 0.171 0.1754 0.1781 0.07% MLCellLinOp::compGrad() 18 0.1709 0.1754 0.178 0.07% MLMG::mgVcycle_bottom 65 0.1475 0.1551 0.1761 0.07% MLPoisson::FFlux() 150 0.00467 0.04188 0.1534 0.06% MLMG::miniCycle() 34 0.1475 0.1484 0.1493 0.06% FabArray::mult() 56 0.1153 0.1303 0.1358 0.06% Castro::construct_new_hybrid_source() 9 0.1094 0.1235 0.1292 0.05% AmrLevel::AmrLevel(dm) 5 0.1059 0.1183 0.1263 0.05% StateData::define() 25 0.1057 0.1181 0.1261 0.05% Castro::avgDown() 4 0.117 0.1225 0.125 0.05% Castro::avgDown(state_indx) 20 0.117 0.1224 0.1249 0.05% amrex::average_down_w_geom 20 0.1169 0.1224 0.1249 0.05% Castro::errorEst() 6 0.1042 0.1166 0.1233 0.05% MLMG::ResNormInf() 54 0.07145 0.08965 0.1175 0.05% Castro::swap_state_time_levels() 9 0.09425 0.09836 0.1065 0.04% MLCellLinOp::updateSolBC() 25 0.07725 0.08452 0.0965 0.04% MLCellLinOp::defineBC() 11 0.08501 0.08699 0.08905 0.04% MLMG::computeResWithCrseCorFineCor() 17 0.08442 0.08598 0.08816 0.04% MLMG::mgVcycle_down::2 31 0.06625 0.07138 0.07829 0.03% MLMG::mgVcycle_up::3 31 0.02526 0.06352 0.07635 0.03% MLMG::MLResNormInf() 15 0.04385 0.06683 0.07461 0.03% Castro::construct_old_hybrid_source() 9 0.05459 0.06168 0.06532 0.03% FabArray::norminf(mask) 21 0.0564 0.06136 0.06366 0.03% BndryData::define() 27 0.05729 0.05956 0.06168 0.03% MLMG::interpCorrection_1 17 0.02607 0.03688 0.06002 0.03% Castro::apply_tagging_restrictions() 6 0.04752 0.05327 0.05542 0.02% MLMG::mgVcycle_up::2 31 0.05082 0.05171 0.05265 0.02% MLCellLinOp::updateCorBC() 17 0.04949 0.04996 0.05115 0.02% Castro::buildMetrics() 5 0.0436 0.04711 0.05024 0.02% Castro::derive() 6 0.04113 0.04586 0.0498 0.02% AmrLevel::derive() 6 0.04111 0.04584 0.04977 0.02% FabArray::norminf() 147 0.03712 0.03913 0.04183 0.02% Gravity::swapTimeLevels() 9 0.03116 0.03562 0.03981 0.02% MLMG::mgVcycle_down::3 31 0.03003 0.03121 0.03395 0.01% TagBoxArray::mapPRD 6 0.003958 0.01474 0.02947 0.01% MLMG::MLRhsNormInf() 10 0.02456 0.02762 0.02904 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.01872 0.02235 0.02812 0.01% FabArrayBase::getCPC() 1440 0.02314 0.0247 0.02769 0.01% MLMG::actualBottomSolve() 31 3.983e-05 0.006757 0.02691 0.01% MLCGSolver::bicgstab 7 0 0.006555 0.02622 0.01% Castro::FluxRegFineAdd() 9 0.02542 0.0256 0.0258 0.01% MultiFab::Multiply() 8 0.0211 0.02375 0.02476 0.01% Gravity::average_fine_ec_onto_crse_ec() 8 0.01922 0.01998 0.02137 0.01% MLLinOp::define() 11 0.00235 0.01017 0.02119 0.01% MLLinOp::defineGrids() 11 0.002291 0.01011 0.02113 0.01% MLMG::compResidual() 1 0.01768 0.01954 0.02077 0.01% Castro::build_fine_mask() 44 0.01648 0.01834 0.01993 0.01% MLLinOp::makeSubCommunicator() 11 0.0006085 0.008329 0.01919 0.01% MLMG::mgVcycle_down::4 31 0.005349 0.008587 0.01815 0.01% FabArrayBase::CPC::define() 416 0.01299 0.01472 0.01782 0.01% Castro::linear_to_hybrid_momentum() 1 0.01391 0.01588 0.0169 0.01% MLMG::mgVcycle_up::4 31 0.004429 0.006771 0.01368 0.01% MLPoisson::prepareForSolve() 11 0.01144 0.01155 0.01177 0.00% MLCellLinOp::prepareForSolve() 11 0.01139 0.0115 0.01172 0.00% Castro::enforce_consistent_e() 1 0.009173 0.01041 0.0109 0.00% AMRErrorTag::operator() 6 0.008513 0.0096 0.01007 0.00% average_down_faces 48 0.008876 0.009323 0.009768 0.00% FabArrayBase::TheFPinfo() 25 0.0006393 0.004754 0.00884 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0006935 0.004781 0.008835 0.00% FPinfo::FPinfo() 3 0.0004672 0.004581 0.00866 0.00% DistributionMapping::KnapSackDoIt() 3 0.0003486 0.004459 0.008515 0.00% Castro::apply_problem_tags() 6 0.006914 0.007796 0.008098 0.00% FabArrayBase::getFB() 1553 0.005687 0.006054 0.006586 0.00% MLCellLinOp::setLevelBC() 19 0.003659 0.004529 0.005257 0.00% amrex::Dot() 115 0 0.000819 0.003276 0.00% FabArrayBase::FB::FB() 19 0.002525 0.002835 0.003159 0.00% MLCGSolver::ParallelAllReduce 183 0 0.0007062 0.002825 0.00% TagBoxArray::collate() 6 0.0003494 0.0009867 0.001296 0.00% OwnerMask() 6 0.0007311 0.0008274 0.0008947 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 0.0004634 0.0004983 0.0005234 0.00% Castro::finalize_advance() 9 0.0003241 0.0003587 0.0004135 0.00% MLLinOp::makeAgglomeratedDMap 11 0.0003565 0.0003843 0.0004098 0.00% makeSFC 33 0.0002493 0.0002729 0.0002904 0.00% Castro::enforce_speed_limit() 87 0.0002547 0.000262 0.0002775 0.00% AmrMesh-cluster 1 0 3.2e-05 0.000128 0.00% Amr::writeSmallPlotFile() 1 9.278e-05 0.0001056 0.0001225 0.00% DistributionMapping::Distribute() 35 0.0001022 0.0001117 0.0001219 0.00% FabArray::RecvLayoutMask() 8 9.151e-05 9.876e-05 0.0001101 0.00% ClusterList::intersect() 1 0 2.042e-05 8.168e-05 0.00% knapsack() 3 6.747e-05 7.344e-05 7.923e-05 0.00% Castro::create_source_corrector() 9 5.296e-05 6.168e-05 7.32e-05 0.00% BoxList::parallelComplementIn() 12 4.912e-05 5.365e-05 5.754e-05 0.00% Amr::initSubcycle() 1 5.075e-05 5.183e-05 5.235e-05 0.00% Castro::retry_advance_ctu() 5 2.559e-05 3.19e-05 4.684e-05 0.00% Gravity::set_mass_offset() 6 3.244e-05 3.513e-05 3.92e-05 0.00% BoxList::complementIn 12 2.323e-05 2.495e-05 2.789e-05 0.00% Castro::construct_new_rotation_source() 9 1.966e-05 2.225e-05 2.672e-05 0.00% Castro::construct_old_rotation_source() 9 2.224e-05 2.324e-05 2.452e-05 0.00% ClusterList::chop() 1 0 2.637e-06 1.055e-05 0.00% knapsack()swap 1 3.498e-06 3.749e-06 3.889e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 4 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-9-g2a3955a5f5aa) finalized