Initializing AMReX (24.02-19-gf692e78ac94a)...
Initializing CUDA...
CUDA initialized with 1 device.
AMReX (24.02-19-gf692e78ac94a) initialized

Starting run at 10:55:19 UTC on 2024-02-15.
Successfully read inputs file ... 

Castro git describe: 24.02-20-g73aacc436
AMReX git describe: 24.02-19-gf692e78ac
Microphysics git describe: 24.02-16-g53d26219

reading extern runtime parameters ...
13 Species: 
He4  C12  O16  Ne20  Mg24  Si28  S32  Ar36  Ca40  Ti44  Cr48  Fe52  Ni56  
Successfully read inputs file ... 

Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm.

Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm.

Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU.
The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU.
The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU.
The initial orbital period is 30.543687 s.
The initial orbital speed of the primary is -1.831e+08 cm/s.
The initial orbital speed of the secondary is 1.831e+08 cm/s.

Castro::numpts_1d at level  0 is 174
Setting the gravity type to PoissonGrav
Initializing the data at level 0
Done initializing the level 0 data 
...estimated hydro-limited timestep at level 0: 0.05426072637
...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05426072637

grid_places() time: 0.003575927 new finest: 0
Now regridding at level lbase = 0
grid_places() time: 0.001918853 new finest: 0
STEP = 0 TIME = 0 : REGRID  with lbase = 0

Gravity::fill_multipole_BCs() time = 0.009315121

Gravity::multilevel_solve_for_new_phi() time = 0.053914892

INITIAL GRIDS 
  Level 0   27 grids  884736 cells  100 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

PLOTFILE: file = wdmerger_3D_plt00000
Write plotfile time = 0.148620442  seconds

...estimated hydro-limited timestep at level 0: 0.05426072637
...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05426072637

[Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637

  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637
  Estimated number of subcycles remaining: 1

Castro::construct_old_gravity() time = 0.003406983 on level 0

Castro::do_old_sources() time = 0.008655815 on level 0

... Entering construct_ctu_hydro_source() on level 0

... Leaving construct_ctu_hydro_source() on level 0

Castro::construct_ctu_hydro_source() time = 0.127526386 on level 0


... new-time composite Poisson gravity solve from level 0 to level 0

Gravity::fill_multipole_BCs() time = 0.00634522

Gravity::multilevel_solve_for_new_phi() time = 0.048093494

Castro::construct_new_gravity() time = 0.051780338 on level 0

Castro::do_new_sources() time = 0.007112941 on level 0

...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05461684804

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 4.023283582

[Level 0 step 1] Advanced 884736 cells

  Updating the rotational period from 30.54368673 s to 30.46017574 s.


[STEP 1] Coarse TimeStep time: 0.229104283
[STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477]

STEP = 1 TIME = 0.005426072637 DT = 0.005426072637

...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05461684804

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.05461684804
 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637
Now regridding at level lbase = 0
grid_places() time: 0.001948941 new finest: 1
Castro::numpts_1d at level  1 is 340
Gravity::fill_multipole_BCs() time = 0.007090419

Gravity::multilevel_solve_for_new_phi() time = 0.06001189

STEP = 1 TIME = 0.005426072637 : REGRID  with lbase = 0
  Level 1   2 grids  65536 cells  0.9259259259 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05461684804

...estimated hydro-limited timestep at level 1: 2.526135647e-09
...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 2.526135647e-09

[Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09

  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09
  Estimated number of subcycles remaining: 1

Castro::construct_old_gravity() time = 0.003614227 on level 0

Castro::do_old_sources() time = 0.006154823 on level 0

... Entering construct_ctu_hydro_source() on level 0

... Leaving construct_ctu_hydro_source() on level 0

Castro::construct_ctu_hydro_source() time = 0.108698151 on level 0

Castro::construct_old_gravity() time = 0.000403615 on level 1

Castro::do_old_sources() time = 0.002359879 on level 1

... Entering construct_ctu_hydro_source() on level 1

... Leaving construct_ctu_hydro_source() on level 1

Castro::construct_ctu_hydro_source() time = 0.013458372 on level 1

Castro::reflux() at level 0 : time = 0.02185358

... new-time composite Poisson gravity solve from level 0 to level 1

Gravity::fill_multipole_BCs() time = 0.006925125

Gravity::multilevel_solve_for_new_phi() time = 0.041339346

Castro::construct_new_gravity() time = 0.044907051 on level 0

Castro::do_new_sources() time = 0.010217123 on level 0

...estimated hydro-limited timestep at level 0: 0.05461716053
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05461716053

Castro::construct_new_gravity() time = 0.000445082 on level 1

Castro::do_new_sources() time = 0.001437496 on level 1

...estimated hydro-limited timestep at level 1: 6.697001619e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.697001619e-07

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond from level 0 to level 1: 3.922846

[Level 0 step 2] Advanced 884736 cells
[Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09

  Advance at this level has already been completed.

[Level 1 step 2] Advanced 65536 cells

  Updating the rotational period from 30.46017574 s to 30.52759479 s.


[STEP 2] Coarse TimeStep time: 0.329279695
[STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545]

STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09

...estimated hydro-limited timestep at level 0: 0.0008044208529
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0008044208529

...estimated hydro-limited timestep at level 1: 6.697001619e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.697001619e-07

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.0008044208529
 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09
Castro::compute_new_dt : limiting dt at level 1
 ... new dt computed: 6.697001619e-07
 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09
Now regridding at level lbase = 0
grid_places() time: 0.003364187 new finest: 1
Castro::numpts_1d at level  1 is 340
Gravity::fill_multipole_BCs() time = 0.00679914

Gravity::multilevel_solve_for_new_phi() time = 0.014829491

STEP = 2 TIME = 0.005426075163 : REGRID  with lbase = 0
  Level 1   2 grids  65536 cells  0.9259259259 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

...estimated hydro-limited timestep at level 0: 0.0008044208529
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0008044208529

...estimated hydro-limited timestep at level 1: 6.697001619e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.697001619e-07

[Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09

  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09
  Estimated number of subcycles remaining: 1

Castro::construct_old_gravity() time = 0.003450264 on level 0

Castro::do_old_sources() time = 0.006414807 on level 0

... Entering construct_ctu_hydro_source() on level 0

... Leaving construct_ctu_hydro_source() on level 0

Castro::construct_ctu_hydro_source() time = 0.12765383 on level 0

Castro::construct_old_gravity() time = 0.000414791 on level 1

Castro::do_old_sources() time = 0.001808929 on level 1

... Entering construct_ctu_hydro_source() on level 1

... Leaving construct_ctu_hydro_source() on level 1

Castro::construct_ctu_hydro_source() time = 0.010080857 on level 1

Castro::reflux() at level 0 : time = 0.01824907

... new-time composite Poisson gravity solve from level 0 to level 1

Gravity::fill_multipole_BCs() time = 0.006855549

Gravity::multilevel_solve_for_new_phi() time = 0.028717721

Castro::construct_new_gravity() time = 0.032275567 on level 0

Castro::do_new_sources() time = 0.006193944 on level 0

...estimated hydro-limited timestep at level 0: 0.0008044237461
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0008044237461

Castro::construct_new_gravity() time = 0.000456886 on level 1

Castro::do_new_sources() time = 0.003037606 on level 1

...estimated hydro-limited timestep at level 1: 6.965184638e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.965184638e-07

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond from level 0 to level 1: 3.999962638

[Level 0 step 3] Advanced 884736 cells
[Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09

  Advance at this level has already been completed.

[Level 1 step 3] Advanced 65536 cells

  Updating the rotational period from 30.52759479 s to 30.52761298 s.


[STEP 3] Coarse TimeStep time: 0.289714227
[STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545]

STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09

...estimated hydro-limited timestep at level 0: 0.000804308035
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.000804308035

...estimated hydro-limited timestep at level 1: 6.965184638e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.965184638e-07

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.000804308035
 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09
Castro::compute_new_dt : limiting dt at level 1
 ... new dt computed: 6.965184638e-07
 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09
Now regridding at level lbase = 0
grid_places() time: 0.002034952 new finest: 1
Castro::numpts_1d at level  1 is 340
Gravity::fill_multipole_BCs() time = 0.006810553

Gravity::multilevel_solve_for_new_phi() time = 0.015037322

STEP = 3 TIME = 0.005426077942 : REGRID  with lbase = 0
  Level 1   2 grids  65536 cells  0.9259259259 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

...estimated hydro-limited timestep at level 0: 0.000804308035
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.000804308035

...estimated hydro-limited timestep at level 1: 6.965184638e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.965184638e-07

[Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09

  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09
  Estimated number of subcycles remaining: 1

Castro::construct_old_gravity() time = 0.003473637 on level 0

Castro::do_old_sources() time = 0.01054665 on level 0

... Entering construct_ctu_hydro_source() on level 0

... Leaving construct_ctu_hydro_source() on level 0

Castro::construct_ctu_hydro_source() time = 0.167517788 on level 0

Castro::construct_old_gravity() time = 0.00038935 on level 1

Castro::do_old_sources() time = 0.001816281 on level 1

... Entering construct_ctu_hydro_source() on level 1

... Leaving construct_ctu_hydro_source() on level 1

Castro::construct_ctu_hydro_source() time = 0.007391692 on level 1

Castro::reflux() at level 0 : time = 0.017835705

... new-time composite Poisson gravity solve from level 0 to level 1

Gravity::fill_multipole_BCs() time = 0.006922287

Gravity::multilevel_solve_for_new_phi() time = 0.028655608

Castro::construct_new_gravity() time = 0.032183994 on level 0

Castro::do_new_sources() time = 0.006033178 on level 0

...estimated hydro-limited timestep at level 0: 0.0008043112215
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0008043112215

Castro::construct_new_gravity() time = 0.000461493 on level 1

Castro::do_new_sources() time = 0.001879718 on level 1

...estimated hydro-limited timestep at level 1: 7.255166705e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 7.255166705e-07

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond from level 0 to level 1: 3.336960109

[Level 0 step 4] Advanced 884736 cells
[Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09

  Advance at this level has already been completed.

[Level 1 step 4] Advanced 65536 cells

  Updating the rotational period from 30.52761298 s to 30.52761297 s.


[STEP 4] Coarse TimeStep time: 0.32176082
[STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545]

STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09

...estimated hydro-limited timestep at level 0: 0.0002497928903
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0002497928903

...estimated hydro-limited timestep at level 1: 7.255166705e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 7.255166705e-07

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.0002497928903
 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09
Castro::compute_new_dt : limiting dt at level 1
 ... new dt computed: 7.255166705e-07
 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09
Now regridding at level lbase = 0
grid_places() time: 0.002101339 new finest: 1
Castro::numpts_1d at level  1 is 340
Gravity::fill_multipole_BCs() time = 0.006793056

Gravity::multilevel_solve_for_new_phi() time = 0.014962532

STEP = 4 TIME = 0.005426080998 : REGRID  with lbase = 0
  Level 1   2 grids  65536 cells  0.9259259259 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

...estimated hydro-limited timestep at level 0: 0.0002497928903
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0002497928903

...estimated hydro-limited timestep at level 1: 7.255166705e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 7.255166705e-07

[Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09

  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09
  Estimated number of subcycles remaining: 1

Castro::construct_old_gravity() time = 0.003421145 on level 0

Castro::do_old_sources() time = 0.006386991 on level 0

... Entering construct_ctu_hydro_source() on level 0

... Leaving construct_ctu_hydro_source() on level 0

Castro::construct_ctu_hydro_source() time = 0.154405584 on level 0

Castro::construct_old_gravity() time = 0.000382724 on level 1

Castro::do_old_sources() time = 0.001642657 on level 1

... Entering construct_ctu_hydro_source() on level 1

... Leaving construct_ctu_hydro_source() on level 1

Castro::construct_ctu_hydro_source() time = 0.010600978 on level 1

Castro::reflux() at level 0 : time = 0.018171255

... new-time composite Poisson gravity solve from level 0 to level 1

Gravity::fill_multipole_BCs() time = 0.006922404

Gravity::multilevel_solve_for_new_phi() time = 0.029197354

Castro::construct_new_gravity() time = 0.032764437 on level 0

Castro::do_new_sources() time = 0.006159009 on level 0

...estimated hydro-limited timestep at level 0: 0.0006805523364
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0006805523364

Castro::construct_new_gravity() time = 0.000436583 on level 1

Castro::do_new_sources() time = 0.002469823 on level 1

...estimated hydro-limited timestep at level 1: 7.553385904e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 7.553385904e-07

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond from level 0 to level 1: 3.66124767

[Level 0 step 5] Advanced 884736 cells
[Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09

  Advance at this level has already been completed.

[Level 1 step 5] Advanced 65536 cells

  Updating the rotational period from 30.52761297 s to 30.52761296 s.


[STEP 5] Coarse TimeStep time: 0.297020112
[STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545]

STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09

PLOTFILE: file = wdmerger_3D_plt00005
Write plotfile time = 0.388410877  seconds


Ending run at 10:55:23 UTC on 2024-02-15.
Run time = 3.390684176
Run time without initialization = 1.856163401

  Average number of zones advanced per microsecond: 2.666
  Average number of zones advanced per microsecond per rank: 2.666

CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9481961472


TinyProfiler total time across processes [min...avg...max]: 3.391 ... 3.391 ... 3.391

--------------------------------------------------------------------------------------------
Name                                         NCalls  Excl. Min  Excl. Avg  Excl. Max   Max %
--------------------------------------------------------------------------------------------
Amr::InitAmr()                                    1     1.1399     1.1399     1.1399  33.62%
Castro::construct_ctu_hydro_source()              9     0.6949     0.6949     0.6949  20.49%
VisMF::Write(FabArray)                            3     0.3014     0.3014     0.3014   8.89%
Amr::writePlotFile()                              2     0.2334     0.2334     0.2334   6.88%
Castro::initMFs()                                 5     0.1573     0.1573     0.1573   4.64%
Castro::computeTemp()                            88    0.07533    0.07533    0.07533   2.22%
Gravity::fill_multipole_BCs()                    10    0.06879    0.06879    0.06879   2.03%
Castro::normalize_species()                      87     0.0669     0.0669     0.0669   1.97%
MLCellLinOp::applyBC()                         1917    0.04777    0.04777    0.04777   1.41%
FillBoundary_nowait()                          1728    0.04319    0.04319    0.04319   1.27%
FabArray::setVal()                              920    0.03839    0.03839    0.03839   1.13%
StateData::FillBoundary(geom)                   650    0.03571    0.03571    0.03571   1.05%
amrex::Copy()                                   441    0.03357    0.03357    0.03357   0.99%
FabArray::ParallelCopy_nowait()                 954    0.02989    0.02989    0.02989   0.88%
Castro::volInBoundary()                          42    0.02872    0.02872    0.02872   0.85%
Castro::reset_internal_energy(MultiFab)          88    0.02304    0.02304    0.02304   0.68%
FluxRegister::Reflux()                           24    0.02213    0.02213    0.02213   0.65%
MLCellLinOp::defineAuxData()                     10     0.0216     0.0216     0.0216   0.64%
Castro::enforce_min_density()                    87     0.0194     0.0194     0.0194   0.57%
Castro::estTimeStep()                            26    0.01834    0.01834    0.01834   0.54%
amrex::Add()                                    136    0.01738    0.01738    0.01738   0.51%
FabArray::Saxpy()                               604    0.01583    0.01583    0.01583   0.47%
Castro::reflux()                                  4    0.01546    0.01546    0.01546   0.46%
StateDataPhysBCFunct::()                         95    0.01392    0.01392    0.01392   0.41%
BndryData::define()                              26    0.01341    0.01341    0.01341   0.40%
MLPoisson::Fsmooth()                           1376    0.01259    0.01259    0.01259   0.37%
Castro::problem_post_timestep()                  10     0.0104     0.0104     0.0104   0.31%
Castro::construct_new_source()                   63   0.009813   0.009813   0.009813   0.29%
MLCellLinOp::reflux()                            30   0.009757   0.009757   0.009757   0.29%
amrex::Dot()                                    466   0.009171   0.009171   0.009171   0.27%
FabArray::norminf()                             439   0.008793   0.008793   0.008793   0.26%
Castro::FluxRegCrseInit                           9    0.00799    0.00799    0.00799   0.24%
Castro::construct_old_gravity_source()           18   0.007976   0.007976   0.007976   0.24%
Castro::initData()                                1   0.007004   0.007004   0.007004   0.21%
MLPoisson::Fapply()                             493   0.006797   0.006797   0.006797   0.20%
FabArray::Xpay()                                353   0.006437   0.006437   0.006437   0.19%
amrex::average_down                             233   0.006185   0.006185   0.006185   0.18%
Castro::reset_internal_energy(Fab)             1476   0.006046   0.006046   0.006046   0.18%
AmrMesh::MakeNewGrids()                           6   0.005687   0.005687   0.005687   0.17%
Castro::construct_new_gravity_source()            9   0.005248   0.005248   0.005248   0.15%
MLMG::addInterpCorrection()                     155   0.004533   0.004533   0.004533   0.13%
Castro::enforce_speed_limit()                    87   0.004328   0.004328   0.004328   0.13%
Castro::wd_update()                               6   0.004301   0.004301   0.004301   0.13%
Gravity::actual_solve_with_mlmg()                10   0.003991   0.003991   0.003991   0.12%
FabArrayBase::CPC::define()                     534   0.003854   0.003854   0.003854   0.11%
FillPatchInterp(MF)                              30   0.003722   0.003722   0.003722   0.11%
FabArray::setVal(val, thecmd, scomp, ncomp)     580   0.003671   0.003671   0.003671   0.11%
FabArray::setDomainBndry()                       92   0.003371   0.003371   0.003371   0.10%
MultiFab::contains_nan()                         18   0.003242   0.003242   0.003242   0.10%
Castro::construct_old_source()                   63   0.003158   0.003158   0.003158   0.09%
Castro::apply_tagging_restrictions()              6   0.003144   0.003144   0.003144   0.09%
MLCellLinOp::compGrad()                          18    0.00288    0.00288    0.00288   0.08%
MLCellLinOp::defineBC()                          10   0.002777   0.002777   0.002777   0.08%
FabArray::mult()                                 55   0.002569   0.002569   0.002569   0.08%
MLCellLinOp::setLevelBC()                        18   0.002533   0.002533   0.002533   0.07%
check_for_negative_density()                      9   0.002415   0.002415   0.002415   0.07%
MLCellLinOp::prepareForSolve()                   10   0.002102   0.002102   0.002102   0.06%
MLMG::prepareForSolve()                          10   0.001975   0.001975   0.001975   0.06%
Castro::clean_state()                            87   0.001793   0.001793   0.001793   0.05%
Castro::fill_hybrid_hydro_source()               27   0.001658   0.001658   0.001658   0.05%
MLPoisson::FFlux()                              150   0.001559   0.001559   0.001559   0.05%
Gravity::get_new_grav_vector()                   10   0.001454   0.001454   0.001454   0.04%
MLCellLinOp::updateSolBC()                       25   0.001409   0.001409   0.001409   0.04%
TagBoxArray::mapPRD                               6   0.001375   0.001375   0.001375   0.04%
FabArray::norminf(mask)                          21   0.001259   0.001259   0.001259   0.04%
Gravity::get_old_grav_vector()                    9   0.001201   0.001201   0.001201   0.04%
FabArrayBase::getCPC()                         1522   0.001125   0.001125   0.001125   0.03%
MLCellLinOp::updateCorBC()                       17   0.001029   0.001029   0.001029   0.03%
Castro::build_fine_mask()                        44   0.001017   0.001017   0.001017   0.03%
OwnerMask()                                       6   0.001008   0.001008   0.001008   0.03%
average_down_faces                               48  0.0009024  0.0009024  0.0009024   0.03%
Castro::advance()                                 5  0.0008823  0.0008823  0.0008823   0.03%
Gravity::multilevel_solve_for_new_phi()          10  0.0008084  0.0008084  0.0008084   0.02%
TagBoxArray::collate()                            6  0.0008011  0.0008011  0.0008011   0.02%
FillPatchTwoLevels                               31  0.0007713  0.0007713  0.0007713   0.02%
MLCGSolver::bicgstab                             31  0.0007299  0.0007299  0.0007299   0.02%
main()                                            1  0.0006754  0.0006754  0.0006754   0.02%
Castro::FluxRegFineAdd()                          9  0.0006679  0.0006679  0.0006679   0.02%
AmrLevel::FillPatch()                            62  0.0006428  0.0006428  0.0006428   0.02%
FillPatchIterator::Initialize                    62  0.0006339  0.0006339  0.0006339   0.02%
MultiFab::max()                                  18  0.0006163  0.0006163  0.0006163   0.02%
MultiFab::Multiply()                              8  0.0005155  0.0005155  0.0005155   0.02%
Castro::apply_problem_tags()                      6  0.0005057  0.0005057  0.0005057   0.01%
MLCellLinOp::smooth()                           688  0.0005005  0.0005005  0.0005005   0.01%
FabArrayBase::FB::FB()                           37  0.0004923  0.0004923  0.0004923   0.01%
Gravity::actual_multilevel_solve()               10  0.0004322  0.0004322  0.0004322   0.01%
FabArray::FillBoundary()                       1728   0.000425   0.000425   0.000425   0.01%
MLMG::interpCorrection_1                         17  0.0004057  0.0004057  0.0004057   0.01%
Castro::linear_to_hybrid_momentum()               1  0.0003886  0.0003886  0.0003886   0.01%
Castro::initialize_advance()                      9  0.0003836  0.0003836  0.0003836   0.01%
Amr::regrid()                                     5  0.0003699  0.0003699  0.0003699   0.01%
Castro::initialize_do_advance()                   9   0.000361   0.000361   0.000361   0.01%
Castro::subcycle_advance_ctu()                    5  0.0003397  0.0003397  0.0003397   0.01%
FabArray::ParallelCopy()                        954   0.000313   0.000313   0.000313   0.01%
Castro::Castro()                                  5  0.0003117  0.0003117  0.0003117   0.01%
FabArrayBase::getFB()                          1728  0.0003036  0.0003036  0.0003036   0.01%
Amr::coarseTimeStep()                             5  0.0002909  0.0002909  0.0002909   0.01%
Castro::do_new_sources()                          9  0.0002664  0.0002664  0.0002664   0.01%
Castro::finalize_do_advance()                     9   0.000263   0.000263   0.000263   0.01%
Gravity::update_max_rhs()                        10  0.0002575  0.0002575  0.0002575   0.01%
AMRErrorTag::operator()                           6  0.0002405  0.0002405  0.0002405   0.01%
Castro::do_advance_ctu()                          5  0.0002344  0.0002344  0.0002344   0.01%
Castro::post_timestep()                           9  0.0002287  0.0002287  0.0002287   0.01%
Castro::react_state()                            18  0.0002227  0.0002227  0.0002227   0.01%
MLCellLinOp::apply()                            493  0.0002148  0.0002148  0.0002148   0.01%
Castro::construct_old_rotation_source()           9   0.000211   0.000211   0.000211   0.01%
MLLinOp::defineGrids()                           10  0.0002084  0.0002084  0.0002084   0.01%
Castro::construct_new_rotation_source()           9  0.0001999  0.0001999  0.0001999   0.01%
Castro::do_old_sources()                          9  0.0001854  0.0001854  0.0001854   0.01%
Castro::construct_new_gravity()                   9  0.0001746  0.0001746  0.0001746   0.01%
Castro::construct_old_gravity()                   9  0.0001736  0.0001736  0.0001736   0.01%
Castro::enforce_consistent_e()                    1  0.0001648  0.0001648  0.0001648   0.00%
StateData::define()                              25  0.0001593  0.0001593  0.0001593   0.00%
MLCGSolver::ParallelAllReduce                   745  0.0001405  0.0001405  0.0001405   0.00%
Gravity::average_fine_ec_onto_crse_ec()           8  0.0001329  0.0001329  0.0001329   0.00%
Castro::swap_state_time_levels()                  9  0.0001302  0.0001302  0.0001302   0.00%
Castro::post_regrid()                            10  0.0001214  0.0001214  0.0001214   0.00%
MLMG::mgVcycle()                                 65   0.000119   0.000119   0.000119   0.00%
Amr::grid_places()                                6  0.0001056  0.0001056  0.0001056   0.00%
Castro::buildMetrics()                            5  0.0001035  0.0001035  0.0001035   0.00%
MLCellLinOp::correctionResidual()               189  0.0001006  0.0001006  0.0001006   0.00%
Castro::finalize_advance()                        9  9.424e-05  9.424e-05  9.424e-05   0.00%
AmrLevel::derive()                                6  8.631e-05  8.631e-05  8.631e-05   0.00%
Castro::create_source_corrector()                 9  8.035e-05  8.035e-05  8.035e-05   0.00%
Amr::timeStep()                                   9  7.602e-05  7.602e-05  7.602e-05   0.00%
MLMG::oneIter()                                  31  5.726e-05  5.726e-05  5.726e-05   0.00%
FillPatchSingleLevel                             92  5.552e-05  5.552e-05  5.552e-05   0.00%
MLMG:computeResOfCorrection()                   155  5.519e-05  5.519e-05  5.519e-05   0.00%
Castro::errorEst()                                6  5.318e-05  5.318e-05  5.318e-05   0.00%
FabArray::RecvLayoutMask()                        8  5.077e-05  5.077e-05  5.077e-05   0.00%
MLCellLinOp::solutionResidual()                  71  4.628e-05  4.628e-05  4.628e-05   0.00%
MLMG::solve()                                    10  4.354e-05  4.354e-05  4.354e-05   0.00%
Amr::defBaseLevel()                               1  4.298e-05  4.298e-05  4.298e-05   0.00%
AmrLevel::AmrLevel(dm)                            5  4.096e-05  4.096e-05  4.096e-05   0.00%
MLMG::actualBottomSolve()                        31  4.055e-05  4.055e-05  4.055e-05   0.00%
AmrLevel::FillCoarsePatch()                       5  4.008e-05  4.008e-05  4.008e-05   0.00%
MLMG::mgVcycle_bottom                            65  3.865e-05  3.865e-05  3.865e-05   0.00%
MLMG::mgVcycle_down::0                           31   3.77e-05   3.77e-05   3.77e-05   0.00%
Amr::writeSmallPlotFile()                         1  3.697e-05  3.697e-05  3.697e-05   0.00%
FillPatchIterator::FillFromLevel0()              31  3.681e-05  3.681e-05  3.681e-05   0.00%
MLPoisson::define()                              10  3.335e-05  3.335e-05  3.335e-05   0.00%
Gravity::solve_phi_with_mlmg()                   10  3.263e-05  3.263e-05  3.263e-05   0.00%
MLMG::mgVcycle_down::1                           31  3.227e-05  3.227e-05  3.227e-05   0.00%
MLMG::mgVcycle_down::3                           31  3.202e-05  3.202e-05  3.202e-05   0.00%
MLMG::mgVcycle_down::2                           31   3.08e-05   3.08e-05   3.08e-05   0.00%
FillPatchIterator::FillFromTwoLevels()           31  2.998e-05  2.998e-05  2.998e-05   0.00%
MLMG::mgVcycle_down::4                           31  2.901e-05  2.901e-05  2.901e-05   0.00%
MLMG::ResNormInf()                               54  2.763e-05  2.763e-05  2.763e-05   0.00%
makeSFC                                          50  2.758e-05  2.758e-05  2.758e-05   0.00%
MLMG::mgVcycle_up::4                             31  2.596e-05  2.596e-05  2.596e-05   0.00%
Castro::computeNewDt()                            8  2.514e-05  2.514e-05  2.514e-05   0.00%
MLMG::computeResWithCrseSolFineCor()             17  2.492e-05  2.492e-05  2.492e-05   0.00%
MLMG::mgVcycle_up::3                             31  2.233e-05  2.233e-05  2.233e-05   0.00%
MLMG::mgVcycle_up::0                             31  2.115e-05  2.115e-05  2.115e-05   0.00%
DistributionMapping::Distribute()                52  2.114e-05  2.114e-05  2.114e-05   0.00%
FabArrayBase::TheFPinfo()                        25  2.069e-05  2.069e-05  2.069e-05   0.00%
MLMG::mgVcycle_up::1                             31  2.053e-05  2.053e-05  2.053e-05   0.00%
FPinfo::FPinfo()                                  3  1.963e-05  1.963e-05  1.963e-05   0.00%
MLMG::mgVcycle_up::2                             31  1.949e-05  1.949e-05  1.949e-05   0.00%
MLLinOp::makeAgglomeratedDMap                    10  1.529e-05  1.529e-05  1.529e-05   0.00%
MLMG::computeResidual()                          31  1.466e-05  1.466e-05  1.466e-05   0.00%
MLMG::computeMLResidual()                        15  1.397e-05  1.397e-05  1.397e-05   0.00%
Amr::FinalizeInit()                               1  1.325e-05  1.325e-05  1.325e-05   0.00%
MLLinOp::define()                                10  1.323e-05  1.323e-05  1.323e-05   0.00%
MLMG::computeResWithCrseCorFineCor()             17  1.274e-05  1.274e-05  1.274e-05   0.00%
MLMG::miniCycle()                                34  1.269e-05  1.269e-05  1.269e-05   0.00%
ClusterList::intersect()                          4  1.238e-05  1.238e-05  1.238e-05   0.00%
Amr::initSubcycle()                               1  1.215e-05  1.215e-05  1.215e-05   0.00%
Castro::check_for_nan()                          18  1.025e-05  1.025e-05  1.025e-05   0.00%
Castro::post_init()                               1  1.001e-05  1.001e-05  1.001e-05   0.00%
Castro::apply_source_to_state()                  18  9.076e-06  9.076e-06  9.076e-06   0.00%
Castro::expand_state()                           13  9.071e-06  9.071e-06  9.071e-06   0.00%
MLPoisson::prepareForSolve()                     10  9.034e-06  9.034e-06  9.034e-06   0.00%
MLMG::getGradSolution()                          10  8.195e-06  8.195e-06  8.195e-06   0.00%
Gravity::swapTimeLevels()                         9  8.002e-06  8.002e-06  8.002e-06   0.00%
Castro::construct_new_hybrid_source()             9  7.991e-06  7.991e-06  7.991e-06   0.00%
Castro::avgDown(state_indx)                      20  7.597e-06  7.597e-06  7.597e-06   0.00%
BoxList::parallelComplementIn()                  12  7.428e-06  7.428e-06  7.428e-06   0.00%
MLMG::MLResNormInf()                             15  7.271e-06  7.271e-06  7.271e-06   0.00%
amrex::average_down_w_geom                       20  6.986e-06  6.986e-06  6.986e-06   0.00%
Castro::construct_old_hybrid_source()             9  6.156e-06  6.156e-06  6.156e-06   0.00%
DistributionMapping::SFCProcessorMapDoIt()        2  6.028e-06  6.028e-06  6.028e-06   0.00%
AmrMesh-cluster                                   4  5.981e-06  5.981e-06  5.981e-06   0.00%
MLMG::MLRhsNormInf()                             10  5.309e-06  5.309e-06  5.309e-06   0.00%
Amr::InitializeInit()                             1  5.294e-06  5.294e-06  5.294e-06   0.00%
Castro::init(old)                                 3  5.125e-06  5.125e-06  5.125e-06   0.00%
Castro::derive()                                  6  3.868e-06  3.868e-06  3.868e-06   0.00%
Castro::avgDown()                                 4  3.755e-06  3.755e-06  3.755e-06   0.00%
BoxList::complementIn                            12  3.441e-06  3.441e-06  3.441e-06   0.00%
Castro::computeInitialDt()                        2  3.424e-06  3.424e-06  3.424e-06   0.00%
Gravity::set_mass_offset()                        6  3.342e-06  3.342e-06  3.342e-06   0.00%
Castro::retry_advance_ctu()                       5  2.806e-06  2.806e-06  2.806e-06   0.00%
Amr::bldFineLevels()                              1   2.26e-06   2.26e-06   2.26e-06   0.00%
Castro::init()                                    1  2.209e-06  2.209e-06  2.209e-06   0.00%
Amr::init()                                       1  1.878e-06  1.878e-06  1.878e-06   0.00%
MLLinOp::makeSubCommunicator()                   10  1.702e-06  1.702e-06  1.702e-06   0.00%
ClusterList::chop()                               4  1.507e-06  1.507e-06  1.507e-06   0.00%
Amr::initialInit()                                1  1.039e-06  1.039e-06  1.039e-06   0.00%
--------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------
Name                                         NCalls  Incl. Min  Incl. Avg  Incl. Max   Max %
--------------------------------------------------------------------------------------------
main()                                            1      3.391      3.391      3.391 100.00%
Amr::coarseTimeStep()                             5      1.467      1.467      1.467  43.27%
Amr::timeStep()                                   9      1.462      1.462      1.462  43.10%
Castro::advance()                                 5      1.244      1.244      1.244  36.69%
Castro::subcycle_advance_ctu()                    5      1.217      1.217      1.217  35.88%
Castro::do_advance_ctu()                          5      1.216      1.216      1.216  35.87%
Amr::InitAmr()                                    1       1.14       1.14       1.14  33.62%
Castro::construct_ctu_hydro_source()              9     0.7274     0.7274     0.7274  21.45%
Amr::writePlotFile()                              2     0.5372     0.5372     0.5372  15.84%
Amr::init()                                       1     0.3944     0.3944     0.3944  11.63%
Gravity::multilevel_solve_for_new_phi()          10     0.3349     0.3349     0.3349   9.88%
Gravity::actual_multilevel_solve()               10     0.3341     0.3341     0.3341   9.85%
Gravity::solve_phi_with_mlmg()                   10     0.3307     0.3307     0.3307   9.75%
VisMF::Write(FabArray)                            3     0.3014     0.3014     0.3014   8.89%
Gravity::actual_solve_with_mlmg()                10     0.2593     0.2593     0.2593   7.65%
Amr::initialInit()                                1     0.2457     0.2457     0.2457   7.25%
MLMG::solve()                                    10     0.2047     0.2047     0.2047   6.04%
Castro::construct_new_gravity()                   9     0.1958     0.1958     0.1958   5.77%
Castro::clean_state()                            87     0.1951     0.1951     0.1951   5.75%
MLMG::oneIter()                                  31      0.174      0.174      0.174   5.13%
Amr::InitializeInit()                             1     0.1718     0.1718     0.1718   5.07%
Amr::defBaseLevel()                               1     0.1718     0.1718     0.1718   5.07%
Castro::Castro()                                  5     0.1613     0.1613     0.1613   4.76%
Castro::initMFs()                                 5     0.1573     0.1573     0.1573   4.64%
Amr::regrid()                                     5     0.1524     0.1524     0.1524   4.50%
MLMG::mgVcycle()                                 65     0.1504     0.1504     0.1504   4.44%
Castro::post_regrid()                            10     0.1367     0.1367     0.1367   4.03%
Castro::computeTemp()                            88     0.1044     0.1044     0.1044   3.08%
MLCellLinOp::applyBC()                         1917    0.09218    0.09218    0.09218   2.72%
AmrLevel::FillPatch()                            62    0.09153    0.09153    0.09153   2.70%
MLCellLinOp::smooth()                           688    0.08183    0.08183    0.08183   2.41%
FillPatchIterator::Initialize                    62    0.07704    0.07704    0.07704   2.27%
Castro::reflux()                                  4    0.07614    0.07614    0.07614   2.25%
Amr::FinalizeInit()                               1    0.07385    0.07385    0.07385   2.18%
Gravity::fill_multipole_BCs()                    10     0.0709     0.0709     0.0709   2.09%
FillPatchSingleLevel                             92    0.06835    0.06835    0.06835   2.02%
Castro::normalize_species()                      87     0.0669     0.0669     0.0669   1.97%
FillPatchIterator::FillFromLevel0()              31    0.06578    0.06578    0.06578   1.94%
Castro::post_timestep()                           9    0.06432    0.06432    0.06432   1.90%
Castro::post_init()                               1    0.06274    0.06274    0.06274   1.85%
Castro::initialize_do_advance()                   9    0.05351    0.05351    0.05351   1.58%
StateDataPhysBCFunct::()                         95    0.04963    0.04963    0.04963   1.46%
Castro::problem_post_timestep()                  10    0.04892    0.04892    0.04892   1.44%
Castro::do_old_sources()                          9    0.04587    0.04587    0.04587   1.35%
MLMG::mgVcycle_bottom                            65    0.04564    0.04564    0.04564   1.35%
Castro::do_new_sources()                          9    0.04462    0.04462    0.04462   1.32%
FabArray::FillBoundary()                       1728    0.04441    0.04441    0.04441   1.31%
FillBoundary_nowait()                          1728    0.04399    0.04399    0.04399   1.30%
MLPoisson::define()                              10    0.04376    0.04376    0.04376   1.29%
Castro::expand_state()                           13    0.04095    0.04095    0.04095   1.21%
MLMG::actualBottomSolve()                        31    0.03854    0.03854    0.03854   1.14%
FabArray::setVal()                              920    0.03839    0.03839    0.03839   1.13%
MLCGSolver::bicgstab                             31    0.03825    0.03825    0.03825   1.13%
StateData::FillBoundary(geom)                   650    0.03571    0.03571    0.03571   1.05%
FabArray::ParallelCopy()                        954    0.03425    0.03425    0.03425   1.01%
FabArray::ParallelCopy_nowait()                 954    0.03393    0.03393    0.03393   1.00%
amrex::Copy()                                   441    0.03357    0.03357    0.03357   0.99%
Castro::wd_update()                               6    0.03303    0.03303    0.03303   0.97%
FluxRegister::Reflux()                           24     0.0297     0.0297     0.0297   0.88%
MLMG::mgVcycle_down::0                           31    0.02925    0.02925    0.02925   0.86%
Castro::reset_internal_energy(MultiFab)          88    0.02908    0.02908    0.02908   0.86%
Castro::volInBoundary()                          42    0.02872    0.02872    0.02872   0.85%
MLCellLinOp::apply()                            493     0.0279     0.0279     0.0279   0.82%
Castro::initialize_advance()                      9    0.02641    0.02641    0.02641   0.78%
MLCellLinOp::defineAuxData()                     10    0.02499    0.02499    0.02499   0.74%
Gravity::get_new_grav_vector()                   10    0.02366    0.02366    0.02366   0.70%
Castro::construct_new_source()                   63    0.02228    0.02228    0.02228   0.66%
MLMG::mgVcycle_up::0                             31    0.02192    0.02192    0.02192   0.65%
Castro::enforce_min_density()                    87     0.0194     0.0194     0.0194   0.57%
Castro::construct_old_gravity()                   9    0.01905    0.01905    0.01905   0.56%
Gravity::get_old_grav_vector()                    9    0.01888    0.01888    0.01888   0.56%
MLCellLinOp::defineBC()                          10    0.01846    0.01846    0.01846   0.54%
Castro::estTimeStep()                            26    0.01834    0.01834    0.01834   0.54%
MLCellLinOp::correctionResidual()               189    0.01825    0.01825    0.01825   0.54%
amrex::Add()                                    136    0.01738    0.01738    0.01738   0.51%
MLCellLinOp::reflux()                            30    0.01593    0.01593    0.01593   0.47%
FabArray::Saxpy()                               604    0.01583    0.01583    0.01583   0.47%
BndryData::define()                              26    0.01554    0.01554    0.01554   0.46%
Amr::grid_places()                                6    0.01501    0.01501    0.01501   0.44%
AmrMesh::MakeNewGrids()                           6     0.0149     0.0149     0.0149   0.44%
MLCellLinOp::solutionResidual()                  71    0.01465    0.01465    0.01465   0.43%
MLMG:computeResOfCorrection()                   155    0.01397    0.01397    0.01397   0.41%
MLMG::computeResWithCrseSolFineCor()             17    0.01355    0.01355    0.01355   0.40%
MLMG::computeMLResidual()                        15    0.01302    0.01302    0.01302   0.38%
MLPoisson::Fsmooth()                           1376    0.01259    0.01259    0.01259   0.37%
Castro::initData()                                1    0.01244    0.01244    0.01244   0.37%
MLMG::mgVcycle_down::1                           31    0.01156    0.01156    0.01156   0.34%
Castro::construct_old_source()                   63    0.01117    0.01117    0.01117   0.33%
amrex::average_down                             233   0.009894   0.009894   0.009894   0.29%
amrex::Dot()                                    466   0.009171   0.009171   0.009171   0.27%
Castro::FluxRegCrseInit                           9   0.009016   0.009016   0.009016   0.27%
MLMG::prepareForSolve()                          10    0.00901    0.00901    0.00901   0.27%
FabArray::norminf()                             439   0.008793   0.008793   0.008793   0.26%
MLMG::mgVcycle_up::1                             31   0.008443   0.008443   0.008443   0.25%
Castro::computeNewDt()                            8   0.008327   0.008327   0.008327   0.25%
Castro::construct_old_gravity_source()           18   0.007976   0.007976   0.007976   0.24%
Amr::bldFineLevels()                              1   0.007583   0.007583   0.007583   0.22%
FillPatchIterator::FillFromTwoLevels()           31   0.007434   0.007434   0.007434   0.22%
FillPatchTwoLevels                               31   0.007404   0.007404   0.007404   0.22%
Castro::finalize_do_advance()                     9   0.007379   0.007379   0.007379   0.22%
MLMG::miniCycle()                                34   0.007109   0.007109   0.007109   0.21%
MLMG::addInterpCorrection()                     155   0.006928   0.006928   0.006928   0.20%
MLPoisson::Fapply()                             493   0.006797   0.006797   0.006797   0.20%
MLMG::mgVcycle_down::2                           31    0.00679    0.00679    0.00679   0.20%
FabArray::Xpay()                                353   0.006437   0.006437   0.006437   0.19%
MLMG::mgVcycle_down::3                           31   0.006214   0.006214   0.006214   0.18%
MLMG::mgVcycle_down::4                           31    0.00608    0.00608    0.00608   0.18%
Castro::reset_internal_energy(Fab)             1476   0.006046   0.006046   0.006046   0.18%
MLMG::computeResidual()                          31   0.005911   0.005911   0.005911   0.17%
Castro::construct_new_gravity_source()            9   0.005248   0.005248   0.005248   0.15%
MLCGSolver::ParallelAllReduce                   745   0.005242   0.005242   0.005242   0.15%
FabArrayBase::getCPC()                         1522   0.004979   0.004979   0.004979   0.15%
MLMG::mgVcycle_up::4                             31   0.004924   0.004924   0.004924   0.15%
Castro::errorEst()                                6   0.004894   0.004894   0.004894   0.14%
MLMG::mgVcycle_up::2                             31   0.004742   0.004742   0.004742   0.14%
MLMG::mgVcycle_up::3                             31   0.004731   0.004731   0.004731   0.14%
Castro::enforce_speed_limit()                    87   0.004328   0.004328   0.004328   0.13%
MLMG::getGradSolution()                          10   0.004324   0.004324   0.004324   0.13%
MLCellLinOp::compGrad()                          18   0.004316   0.004316   0.004316   0.13%
Castro::apply_source_to_state()                  18   0.004179   0.004179   0.004179   0.12%
FabArrayBase::CPC::define()                     534   0.003854   0.003854   0.003854   0.11%
FillPatchInterp(MF)                              30   0.003722   0.003722   0.003722   0.11%
FabArray::setVal(val, thecmd, scomp, ncomp)     580   0.003671   0.003671   0.003671   0.11%
MLMG::computeResWithCrseCorFineCor()             17    0.00354    0.00354    0.00354   0.10%
FabArray::setDomainBndry()                       92   0.003371   0.003371   0.003371   0.10%
MLCellLinOp::updateSolBC()                       25   0.003363   0.003363   0.003363   0.10%
Castro::check_for_nan()                          18   0.003252   0.003252   0.003252   0.10%
MultiFab::contains_nan()                         18   0.003242   0.003242   0.003242   0.10%
TagBoxArray::mapPRD                               6   0.003193   0.003193   0.003193   0.09%
Castro::apply_tagging_restrictions()              6   0.003144   0.003144   0.003144   0.09%
Castro::init(old)                                 3   0.003023   0.003023   0.003023   0.09%
Castro::computeInitialDt()                        2   0.002922   0.002922   0.002922   0.09%
FabArray::mult()                                 55   0.002569   0.002569   0.002569   0.08%
MLCellLinOp::setLevelBC()                        18   0.002533   0.002533   0.002533   0.07%
Castro::buildMetrics()                            5   0.002468   0.002468   0.002468   0.07%
check_for_negative_density()                      9   0.002415   0.002415   0.002415   0.07%
MLCellLinOp::updateCorBC()                       17   0.002309   0.002309   0.002309   0.07%
MLMG::ResNormInf()                               54   0.002134   0.002134   0.002134   0.06%
MLPoisson::prepareForSolve()                     10   0.002111   0.002111   0.002111   0.06%
MLCellLinOp::prepareForSolve()                   10   0.002102   0.002102   0.002102   0.06%
Gravity::average_fine_ec_onto_crse_ec()           8   0.002028   0.002028   0.002028   0.06%
Gravity::update_max_rhs()                        10   0.002024   0.002024   0.002024   0.06%
Castro::fill_hybrid_hydro_source()               27   0.001658   0.001658   0.001658   0.05%
MLPoisson::FFlux()                              150   0.001559   0.001559   0.001559   0.05%
average_down_faces                               48   0.001336   0.001336   0.001336   0.04%
FabArray::norminf(mask)                          21   0.001259   0.001259   0.001259   0.04%
Castro::avgDown()                                 4   0.001205   0.001205   0.001205   0.04%
Castro::avgDown(state_indx)                      20   0.001201   0.001201   0.001201   0.04%
amrex::average_down_w_geom                       20   0.001193   0.001193   0.001193   0.04%
MLMG::MLResNormInf()                             15   0.001167   0.001167   0.001167   0.03%
Castro::build_fine_mask()                        44   0.001017   0.001017   0.001017   0.03%
Castro::construct_new_hybrid_source()             9   0.001014   0.001014   0.001014   0.03%
OwnerMask()                                       6   0.001008   0.001008   0.001008   0.03%
MLMG::interpCorrection_1                         17  0.0009798  0.0009798  0.0009798   0.03%
Castro::derive()                                  6  0.0009505  0.0009505  0.0009505   0.03%
AmrLevel::derive()                                6  0.0009466  0.0009466  0.0009466   0.03%
Castro::init()                                    1  0.0009033  0.0009033  0.0009033   0.03%
AmrLevel::FillCoarsePatch()                       5  0.0009011  0.0009011  0.0009011   0.03%
TagBoxArray::collate()                            6  0.0008011  0.0008011  0.0008011   0.02%
FabArrayBase::getFB()                          1728  0.0007959  0.0007959  0.0007959   0.02%
Castro::FluxRegFineAdd()                          9  0.0006679  0.0006679  0.0006679   0.02%
Castro::construct_old_hybrid_source()             9  0.0006584  0.0006584  0.0006584   0.02%
Gravity::swapTimeLevels()                         9   0.000655   0.000655   0.000655   0.02%
MultiFab::max()                                  18  0.0006163  0.0006163  0.0006163   0.02%
MLMG::MLRhsNormInf()                             10  0.0006124  0.0006124  0.0006124   0.02%
Castro::react_state()                            18  0.0005675  0.0005675  0.0005675   0.02%
MultiFab::Multiply()                              8  0.0005155  0.0005155  0.0005155   0.02%
Castro::apply_problem_tags()                      6  0.0005057  0.0005057  0.0005057   0.01%
FabArrayBase::FB::FB()                           37  0.0004923  0.0004923  0.0004923   0.01%
Castro::linear_to_hybrid_momentum()               1  0.0003886  0.0003886  0.0003886   0.01%
MLLinOp::define()                                10   0.000285   0.000285   0.000285   0.01%
MLLinOp::defineGrids()                           10  0.0002718  0.0002718  0.0002718   0.01%
AMRErrorTag::operator()                           6  0.0002405  0.0002405  0.0002405   0.01%
Castro::construct_old_rotation_source()           9   0.000211   0.000211   0.000211   0.01%
AmrLevel::AmrLevel(dm)                            5  0.0002003  0.0002003  0.0002003   0.01%
Castro::construct_new_rotation_source()           9  0.0001999  0.0001999  0.0001999   0.01%
Castro::enforce_consistent_e()                    1  0.0001648  0.0001648  0.0001648   0.00%
StateData::define()                              25  0.0001593  0.0001593  0.0001593   0.00%
Castro::swap_state_time_levels()                  9  0.0001302  0.0001302  0.0001302   0.00%
Castro::finalize_advance()                        9  9.424e-05  9.424e-05  9.424e-05   0.00%
Castro::create_source_corrector()                 9  8.035e-05  8.035e-05  8.035e-05   0.00%
MLLinOp::makeAgglomeratedDMap                    10  6.169e-05  6.169e-05  6.169e-05   0.00%
FabArray::RecvLayoutMask()                        8  5.077e-05  5.077e-05  5.077e-05   0.00%
makeSFC                                          50   4.64e-05   4.64e-05   4.64e-05   0.00%
FabArrayBase::TheFPinfo()                        25  4.033e-05  4.033e-05  4.033e-05   0.00%
Amr::writeSmallPlotFile()                         1  3.697e-05  3.697e-05  3.697e-05   0.00%
DistributionMapping::Distribute()                52  2.114e-05  2.114e-05  2.114e-05   0.00%
AmrMesh-cluster                                   4  1.987e-05  1.987e-05  1.987e-05   0.00%
FPinfo::FPinfo()                                  3  1.963e-05  1.963e-05  1.963e-05   0.00%
ClusterList::intersect()                          4  1.238e-05  1.238e-05  1.238e-05   0.00%
Amr::initSubcycle()                               1  1.215e-05  1.215e-05  1.215e-05   0.00%
BoxList::parallelComplementIn()                  12  1.087e-05  1.087e-05  1.087e-05   0.00%
DistributionMapping::SFCProcessorMapDoIt()        2  8.345e-06  8.345e-06  8.345e-06   0.00%
BoxList::complementIn                            12  3.441e-06  3.441e-06  3.441e-06   0.00%
Gravity::set_mass_offset()                        6  3.342e-06  3.342e-06  3.342e-06   0.00%
Castro::retry_advance_ctu()                       5  2.806e-06  2.806e-06  2.806e-06   0.00%
MLLinOp::makeSubCommunicator()                   10  1.702e-06  1.702e-06  1.702e-06   0.00%
ClusterList::chop()                               4  1.507e-06  1.507e-06  1.507e-06   0.00%
--------------------------------------------------------------------------------------------

Unused ParmParse Variables:
  [TOP]::mg.v(nvals = 1)  :: [2]

Device Memory Usage:
------------------------------------------------------------------------------
Name                                         Nalloc  Nfree    AvgMem    MaxMem
------------------------------------------------------------------------------
The_Arena::Initialize()                           1      1    23 MiB  9042 MiB
Castro::reflux()                                436    436    12 MiB   666 MiB
Castro::initMFs()                               258    258   350 MiB   576 MiB
Castro::swap_state_time_levels()                175    175   183 MiB   340 MiB
StateData::define()                             175    175   221 MiB   340 MiB
Castro::initialize_do_advance()                 143    143   109 MiB   325 MiB
FillPatchIterator::Initialize                   899    899  3675 KiB   303 MiB
Amr::writePlotFile()                             56     56    16 MiB   189 MiB
Castro::problem_post_timestep()                 162    162   720 KiB   167 MiB
Castro::FluxRegCrseInit                         660    660   417 KiB   167 MiB
FluxRegister::Reflux()                          648    648  1422 KiB   160 MiB
Castro::initialize_advance()                    143    143    43 MiB   121 MiB
Castro::construct_new_source()                  143    143   167 KiB    67 MiB
Castro::construct_old_source()                  143    143   105 KiB    67 MiB
Castro::buildMetrics()                          140    140    37 MiB    61 MiB
Gravity::multilevel_solve_for_new_phi()         858    858    28 MiB    60 MiB
Castro::Castro()                                210    210  3697 KiB    50 MiB
MLMG::prepareForSolve()                        1902   1902  2593 KiB    42 MiB
Gravity::get_old_grav_vector()                  155    155   183 KiB    33 MiB
Gravity::get_new_grav_vector()                  188    188   228 KiB    33 MiB
ResizeRandomSeed                                  1      1    30 MiB    30 MiB
MLCellLinOp::defineAuxData()                   5608   5608   828 KiB    16 MiB
FillPatchTwoLevels                              300    300  7120   B    11 MiB
FillPatchInterp(MF)                             330    330  4390   B  7955 KiB
Gravity::fill_multipole_BCs()                   346    346   116 KiB  7469 KiB
Gravity::update_max_rhs()                       286    286  4114   B  7424 KiB
Gravity::actual_multilevel_solve()              286    286   715 KiB  7424 KiB
Castro::build_fine_mask()                       224    224  1611 KiB  6912 KiB
AmrLevel::derive()                              162    162  2421   B  6912 KiB
BndryData::define()                            3624   3624   270 KiB  4243 KiB
MLCellLinOp::reflux()                           450    450  5257   B  2376 KiB
Castro::wd_update()                               6      6    21 KiB  2240 KiB
AmrLevel::FillCoarsePatch()                      10     10   381   B  2095 KiB
amrex::average_down                            1483   1483  1517   B  1473 KiB
AmrMesh::MakeNewGrids()                         324    324  4615   B  1041 KiB
MLMG::addInterpCorrection()                    1240   1240   729   B   867 KiB
MLCellLinOp::defineBC()                         276    276  3559   B   689 KiB
Castro::estTimeStep()                            26     26  2381   B   480 KiB
VisMF::Write(FabArray)                         1568   1568  2150   B   320 KiB
Castro::normalize_species()                      87     87  6287   B   320 KiB
Castro::volInBoundary()                          70     70  2746   B   320 KiB
Gravity::average_fine_ec_onto_crse_ec()          48     48   120   B   204 KiB
FabArray::norminf(mask)                          29     29   175   B   163 KiB
amrex::Dot()                                    559    559   400   B   160 KiB
FabArray::norminf()                             470    470   399   B   160 KiB
MultiFab::max()                                  18     18    28   B   160 KiB
check_for_negative_density()                      9      9   115   B   160 KiB
Castro::initData()                                1      1    44   B   160 KiB
FabArray::setVal()                              419    419    45 KiB   101 KiB
MLMG::interpCorrection_1                         34     34    25   B    91 KiB
average_down_faces                               99     99   600   B    69 KiB
FabArray::ParallelCopy_nowait()                 942    942   253   B    57 KiB
MLPoisson::Fsmooth()                            228    228  2973   B    55 KiB
FillBoundary_nowait()                           751    751   419   B    53 KiB
TagBoxArray::mapPRD                             324    324    38   B    45 KiB
OwnerMask()                                     168    168    11   B    38 KiB
MLCellLinOp::applyBC()                         3834   3834   131   B    30 KiB
MLCellLinOp::prepareForSolve()                   68     68     6   B    25 KiB
amrex::Copy()                                   176    176  9598   B    25 KiB
MultiFab::contains_nan()                         18     18    19   B    20 KiB
StateData::FillBoundary(geom)                  2538   2538    36   B    13 KiB
FabArray::setVal(val, thecmd, scomp, ncomp)     244    244     3   B  9808   B
MultiFab::Multiply()                              8      8   804   B  3456   B
MLCGSolver::bicgstab                            155    155    30   B  2688   B
TagBoxArray::collate()                           14     14     0   B   640   B
------------------------------------------------------------------------------

Managed Memory Usage:
-----------------------------------------------------------------
Name                             Nalloc  Nfree   AvgMem    MaxMem
-----------------------------------------------------------------
The_Managed_Arena::Initialize()       1      1  161   B  8192 KiB
-----------------------------------------------------------------

Pinned Memory Usage:
------------------------------------------------------------------------------
Name                                         Nalloc  Nfree    AvgMem    MaxMem
------------------------------------------------------------------------------
The_Pinned_Arena::Initialize()                    1      1    11 KiB  8192 KiB
VisMF::Write(FabArray)                         1624   1624   567 KiB  7168 KiB
Gravity::fill_multipole_BCs()                    30     30  1138   B   278 KiB
FabArray::setVal()                              419    419    45 KiB   101 KiB
FabArray::ParallelCopy_nowait()                 942    942   253   B    57 KiB
MLPoisson::Fsmooth()                            228    228  2973   B    55 KiB
FillBoundary_nowait()                           751    751   419   B    53 KiB
MLCellLinOp::applyBC()                         1917   1917   131   B    30 KiB
MLCellLinOp::prepareForSolve()                   68     68     6   B    25 KiB
amrex::Copy()                                   176    176  9599   B    25 KiB
Gravity::get_new_grav_vector()                   18     18  3656   B    20 KiB
Gravity::get_old_grav_vector()                   12     12  6479   B    20 KiB
OwnerMask()                                       6      6     0   B    15 KiB
StateData::FillBoundary(geom)                  2538   2538    36   B    13 KiB
FabArray::setVal(val, thecmd, scomp, ncomp)     244    244     3   B  9808   B
amrex::average_down                             149    149   586   B  4688   B
MLMG::prepareForSolve()                          18     18   221   B  3712   B
FabArray::norminf(mask)                          29     29   118   B  3472   B
MLMG::addInterpCorrection()                      62     62     2   B  3456   B
MultiFab::Multiply()                              8      8   804   B  3456   B
Castro::FluxRegCrseInit                          12     12     8   B  3456   B
FillPatchInterp(MF)                             140    140     2   B  2720   B
MLCellLinOp::setLevelBC()                        68     68     0   B  2592   B
average_down_faces                               51     51   574   B  2032   B
TagBoxArray::collate()                           16     16     0   B   640   B
amrex::Dot()                                    559    559     2   B   400   B
Castro::build_fine_mask()                         8      8     0   B   208   B
MLCellLinOp::defineAuxData()                      8      8     0   B   208   B
Castro::reflux()                                  4      4     0   B   208   B
FabArray::norminf()                             470    470     1   B   144   B
Castro::wd_update()                               6      6     1   B   112   B
Castro::problem_post_timestep()                  19     19     0   B    48   B
Castro::estTimeStep()                            26     26     0   B    32   B
MultiFab::contains_nan()                         18     18     0   B    16   B
MultiFab::max()                                  18     18     0   B    16   B
Castro::volInBoundary()                          70     70     0   B    16   B
Castro::normalize_species()                      87     87     0   B    16   B
Castro::initData()                                1      1     0   B    16   B
check_for_negative_density()                      9      9     0   B    16   B
------------------------------------------------------------------------------

Total GPU global memory (MB): 12056
Free  GPU global memory (MB): 1843
[The         Arena] space allocated (MB): 9042
[The         Arena] space used      (MB): 0
[The Managed Arena] space allocated (MB): 8
[The Managed Arena] space used      (MB): 0
[The  Pinned Arena] space allocated (MB): 8
[The  Pinned Arena] space used      (MB): 0
AMReX (24.02-19-gf692e78ac94a) finalized