Initializing CUDA...
CUDA initialized with 1 device.
AMReX (23.05-15-g23b157942e41) initialized

Starting run at 08:03:19 UTC on 2023-05-18.
Successfully read inputs file ... 

Castro git describe: 23.05-14-ga1a1083b3
AMReX git describe: 23.05-15-g23b157942
Microphysics git describe: 23.05-7-g600b619d

reading extern runtime parameters ...
13 Species: 
He4  C12  O16  Ne20  Mg24  Si28  S32  Ar36  Ca40  Ti44  Cr48  Fe52  Ni56  
Successfully read inputs file ... 

Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm.

Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm.

Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU.
The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU.
The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU.
The initial orbital period is 30.543687 s.
The initial orbital speed of the primary is -1.831e+08 cm/s.
The initial orbital speed of the secondary is 1.831e+08 cm/s.

Castro::numpts_1d at level  0 is 174
Setting the gravity type to PoissonGrav
Initializing the data at level 0
Done initializing the level 0 data 
...estimated hydro-limited timestep at level 0: 0.05426072637
...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05426072637

grid_places() time: 0.002651262 new finest: 0
Now regridding at level lbase = 0
grid_places() time: 0.001859599 new finest: 0
STEP = 0 TIME = 0 : REGRID  with lbase = 0

Gravity::fill_multipole_BCs() time = 0.006882612

INITIAL GRIDS 
  Level 0   27 grids  884736 cells  100 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

PLOTFILE: file = wdmerger_3D_plt00000
Write plotfile time = 0.207410205  seconds

...estimated hydro-limited timestep at level 0: 0.05426072637
...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05426072637

[Level 0 step 1] ADVANCE with dt = 0.005426072637

  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637
  Estimated number of subcycles remaining: 1

Castro::do_old_sources() time = 0.006316668

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 0.136627589

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.006189089

Gravity::solve_for_phi() time = 0.039135302

Castro::do_new_sources() time = 0.00696486

...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05461684804

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 3.944019825

[Level 0 step 1] Advanced 884736 cells

  Updating the rotational period from 30.54368673 s to 30.46017574 s.


[STEP 1] Coarse TimeStep time: 0.232792638
[STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477]

STEP = 1 TIME = 0.005426072637 DT = 0.005426072637

...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05461684804

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.05461684804
 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637
Now regridding at level lbase = 0
grid_places() time: 0.002246874 new finest: 1
Castro::numpts_1d at level  1 is 340
Gravity::fill_multipole_BCs() time = 0.00692635

STEP = 1 TIME = 0.005426072637 : REGRID  with lbase = 0
  Level 1   2 grids  65536 cells  0.9259259259 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05461684804

...estimated hydro-limited timestep at level 1: 2.526135647e-09
...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 2.526135647e-09

[Level 0 step 2] ADVANCE with dt = 2.526135647e-09

  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09
  Estimated number of subcycles remaining: 1

... old-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.006212399

Gravity::solve_for_phi() time = 0.042547767

Castro::do_old_sources() time = 0.004177628

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 0.131359356

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.006297134

Gravity::solve_for_phi() time = 0.0207327

Castro::do_new_sources() time = 0.007324502

...estimated hydro-limited timestep at level 0: 0.05461716053
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.05461716053

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 3.661004375

[Level 0 step 2] Advanced 884736 cells
[Level 1 step 2] ADVANCE with dt = 2.526135647e-09

  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09
  Estimated number of subcycles remaining: 1

... old-time level Poisson gravity solve at level 1

Gravity::solve_for_phi() time = 0.002099814

Castro::do_old_sources() time = 0.001168083

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 0.005836747

... new-time level Poisson gravity solve at level 1

Gravity::solve_for_phi() time = 0.011543652

Castro::do_new_sources() time = 0.001235736

...estimated hydro-limited timestep at level 1: 6.697001619e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.697001619e-07

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 2.252790095

[Level 1 step 2] Advanced 65536 cells
Castro::do_new_sources() time = 0.001307262

Castro::do_new_sources() time = 0.006058742

Castro::reflux() at level 0 : time = 0.027055499

  Updating the rotational period from 30.46017574 s to 30.52759479 s.


[STEP 2] Coarse TimeStep time: 0.376040788
[STEP 2] FAB kilobyte spread across MPI nodes: [2209725 ... 2209725]

STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09

...estimated hydro-limited timestep at level 0: 0.0008044208529
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0008044208529

...estimated hydro-limited timestep at level 1: 6.697001619e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.697001619e-07

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.0008044208529
 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09
Castro::compute_new_dt : limiting dt at level 1
 ... new dt computed: 6.697001619e-07
 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09
Now regridding at level lbase = 0
grid_places() time: 0.001998596 new finest: 1
Castro::numpts_1d at level  1 is 340
Gravity::fill_multipole_BCs() time = 0.006797326

STEP = 2 TIME = 0.005426075163 : REGRID  with lbase = 0
  Level 1   2 grids  65536 cells  0.9259259259 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

...estimated hydro-limited timestep at level 0: 0.0008044208529
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0008044208529

...estimated hydro-limited timestep at level 1: 6.697001619e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.697001619e-07

[Level 0 step 3] ADVANCE with dt = 2.778749212e-09

  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09
  Estimated number of subcycles remaining: 1

... old-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.006200842

Gravity::solve_for_phi() time = 0.043124061

Castro::do_old_sources() time = 0.004485973

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 0.141466282

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.006257476

Gravity::solve_for_phi() time = 0.021033044

Castro::do_new_sources() time = 0.006150037

...estimated hydro-limited timestep at level 0: 0.0008044237461
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0008044237461

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 3.516199338

[Level 0 step 3] Advanced 884736 cells
[Level 1 step 3] ADVANCE with dt = 2.778749212e-09

  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09
  Estimated number of subcycles remaining: 1

... old-time level Poisson gravity solve at level 1

Gravity::solve_for_phi() time = 0.001924981

Castro::do_old_sources() time = 0.001051438

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 0.006901539

... new-time level Poisson gravity solve at level 1

Gravity::solve_for_phi() time = 0.007151622

Castro::do_new_sources() time = 0.001206121

...estimated hydro-limited timestep at level 1: 6.965184638e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.965184638e-07

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 2.649178702

[Level 1 step 3] Advanced 65536 cells
Castro::do_new_sources() time = 0.001370651

Castro::do_new_sources() time = 0.006078689

Castro::reflux() at level 0 : time = 0.027293024

  Updating the rotational period from 30.52759479 s to 30.52761298 s.


[STEP 3] Coarse TimeStep time: 0.352805582
[STEP 3] FAB kilobyte spread across MPI nodes: [2209725 ... 2209725]

STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09

...estimated hydro-limited timestep at level 0: 0.000804308035
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.000804308035

...estimated hydro-limited timestep at level 1: 6.965184638e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.965184638e-07

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.000804308035
 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09
Castro::compute_new_dt : limiting dt at level 1
 ... new dt computed: 6.965184638e-07
 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09
Now regridding at level lbase = 0
grid_places() time: 0.002031184 new finest: 1
Castro::numpts_1d at level  1 is 340
Gravity::fill_multipole_BCs() time = 0.006779482

STEP = 3 TIME = 0.005426077942 : REGRID  with lbase = 0
  Level 1   2 grids  65536 cells  0.9259259259 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

...estimated hydro-limited timestep at level 0: 0.000804308035
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.000804308035

...estimated hydro-limited timestep at level 1: 6.965184638e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 6.965184638e-07

[Level 0 step 4] ADVANCE with dt = 3.056624133e-09

  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09
  Estimated number of subcycles remaining: 1

... old-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.006187238

Gravity::solve_for_phi() time = 0.042947696

Castro::do_old_sources() time = 0.004505029

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 0.131370514

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.006258002

Gravity::solve_for_phi() time = 0.020969992

Castro::do_new_sources() time = 0.00595564

...estimated hydro-limited timestep at level 0: 0.0008043112215
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0008043112215

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 3.671933134

[Level 0 step 4] Advanced 884736 cells
[Level 1 step 4] ADVANCE with dt = 3.056624133e-09

  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09
  Estimated number of subcycles remaining: 1

... old-time level Poisson gravity solve at level 1

Gravity::solve_for_phi() time = 0.001917821

Castro::do_old_sources() time = 0.000797566

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 0.006128239

... new-time level Poisson gravity solve at level 1

Gravity::solve_for_phi() time = 0.007031175

Castro::do_new_sources() time = 0.001432317

...estimated hydro-limited timestep at level 1: 7.255166705e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 7.255166705e-07

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 2.76886559

[Level 1 step 4] Advanced 65536 cells
Castro::do_new_sources() time = 0.001358694

Castro::do_new_sources() time = 0.005804949

Castro::reflux() at level 0 : time = 0.026619772

  Updating the rotational period from 30.52761298 s to 30.52761297 s.


[STEP 4] Coarse TimeStep time: 0.334044243
[STEP 4] FAB kilobyte spread across MPI nodes: [2209725 ... 2209725]

STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09

...estimated hydro-limited timestep at level 0: 0.0002497928903
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0002497928903

...estimated hydro-limited timestep at level 1: 7.255166705e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 7.255166705e-07

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.0002497928903
 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09
Castro::compute_new_dt : limiting dt at level 1
 ... new dt computed: 7.255166705e-07
 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09
Now regridding at level lbase = 0
grid_places() time: 0.001937983 new finest: 1
Castro::numpts_1d at level  1 is 340
Gravity::fill_multipole_BCs() time = 0.006846449

STEP = 4 TIME = 0.005426080998 : REGRID  with lbase = 0
  Level 1   2 grids  65536 cells  0.9259259259 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

...estimated hydro-limited timestep at level 0: 0.0002497928903
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0002497928903

...estimated hydro-limited timestep at level 1: 7.255166705e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 7.255166705e-07

[Level 0 step 5] ADVANCE with dt = 3.362286546e-09

  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09
  Estimated number of subcycles remaining: 1

... old-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.006200461

Gravity::solve_for_phi() time = 0.042742534

Castro::do_old_sources() time = 0.004544569

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 0.130940352

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.006204844

Gravity::solve_for_phi() time = 0.021048133

Castro::do_new_sources() time = 0.007207813

...estimated hydro-limited timestep at level 0: 0.0006805523364
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.0006805523364

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 3.647077093

[Level 0 step 5] Advanced 884736 cells
[Level 1 step 5] ADVANCE with dt = 3.362286546e-09

  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09
  Estimated number of subcycles remaining: 1

... old-time level Poisson gravity solve at level 1

Gravity::solve_for_phi() time = 0.001909324

Castro::do_old_sources() time = 0.000970445

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 0.007287196

... new-time level Poisson gravity solve at level 1

Gravity::solve_for_phi() time = 0.007006196

Castro::do_new_sources() time = 0.001337541

...estimated hydro-limited timestep at level 1: 7.553385904e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1:  estdt = 7.553385904e-07

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 2.67521667

[Level 1 step 5] Advanced 65536 cells
Castro::do_new_sources() time = 0.001831124

Castro::do_new_sources() time = 0.00602515

Castro::reflux() at level 0 : time = 0.027661191

  Updating the rotational period from 30.52761297 s to 30.52761296 s.


[STEP 5] Coarse TimeStep time: 0.337555187
[STEP 5] FAB kilobyte spread across MPI nodes: [2209725 ... 2209725]

STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09

PLOTFILE: file = wdmerger_3D_plt00005
Write plotfile time = 0.218605562  seconds


Ending run at 08:03:22 UTC on 2023-05-18.
Run time = 3.365232254
Run time without initialization = 1.852775549

  Average number of zones advanced per microsecond: 2.529
  Average number of zones advanced per microsecond per rank: 2.529

CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9481961472


TinyProfiler total time across processes [min...avg...max]: 3.365 ... 3.365 ... 3.365

--------------------------------------------------------------------------------------------
Name                                         NCalls  Excl. Min  Excl. Avg  Excl. Max   Max %
--------------------------------------------------------------------------------------------
Amr::InitAmr()                                    1     1.0663     1.0663     1.0663  31.69%
Castro::construct_ctu_hydro_source()              9      0.698      0.698      0.698  20.74%
VisMF::Write(FabArray)                            3     0.4192     0.4192     0.4192  12.46%
Castro::initMFs()                                 5     0.1611     0.1611     0.1611   4.79%
MLCellLinOp::applyBC()                         3868    0.08929    0.08929    0.08929   2.65%
Gravity::fill_multipole_BCs()                    14    0.08906    0.08906    0.08906   2.65%
FillBoundary_nowait()                          3516    0.07742    0.07742    0.07742   2.30%
Castro::computeTemp()                           104    0.05844    0.05844    0.05844   1.74%
Castro::normalize_species()                     103    0.05628    0.05628    0.05628   1.67%
FabArray::setVal()                             1493    0.04284    0.04284    0.04284   1.27%
amrex::Copy()                                  1129     0.0341     0.0341     0.0341   1.01%
StateData::FillBoundary(geom)                   650    0.03324    0.03324    0.03324   0.99%
FabArray::ParallelCopy_nowait()                1194    0.03299    0.03299    0.03299   0.98%
MLCellLinOp::defineAuxData()                     22    0.03101    0.03101    0.03101   0.92%
Castro::volInBoundary()                          42    0.03029    0.03029    0.03029   0.90%
Castro::enforce_min_density()                   103    0.02734    0.02734    0.02734   0.81%
Castro::reset_internal_energy(MultiFab)         104    0.02605    0.02605    0.02605   0.77%
MLPoisson::Fsmooth()                           2800    0.02489    0.02489    0.02489   0.74%
FabArray::Saxpy()                               755    0.02351    0.02351    0.02351   0.70%
FluxRegister::Reflux()                           24    0.02165    0.02165    0.02165   0.64%
amrex::Add()                                    227    0.02159    0.02159    0.02159   0.64%
amrex::Dot()                                    972    0.01828    0.01828    0.01828   0.54%
Castro::construct_new_source()                  119    0.01653    0.01653    0.01653   0.49%
Castro::estTimeStep()                            26    0.01652    0.01652    0.01652   0.49%
BndryData::define()                              30     0.0165     0.0165     0.0165   0.49%
StateDataPhysBCFunct::()                         95    0.01454    0.01454    0.01454   0.43%
FabArray::norminf()                             670    0.01451    0.01451    0.01451   0.43%
MLPoisson::Fapply()                            1025    0.01241    0.01241    0.01241   0.37%
FabArray::Xpay()                                731    0.01155    0.01155    0.01155   0.34%
Castro::problem_post_timestep()                  10     0.0102     0.0102     0.0102   0.30%
amrex::average_down                             392     0.0093     0.0093     0.0093   0.28%
MLMG::addInterpCorrection()                     340   0.008804   0.008804   0.008804   0.26%
Castro::construct_new_gravity_source()           17   0.007905   0.007905   0.007905   0.23%
Castro::FluxRegCrseInit                           9    0.00789    0.00789    0.00789   0.23%
Castro::reflux()                                  4   0.007133   0.007133   0.007133   0.21%
Castro::construct_old_gravity_source()           18    0.00707    0.00707    0.00707   0.21%
Castro::reset_internal_energy(Fab)             1708    0.00644    0.00644    0.00644   0.19%
Castro::do_advance_ctu()                          9   0.005602   0.005602   0.005602   0.17%
AmrMesh::MakeNewGrids()                           6   0.005541   0.005541   0.005541   0.16%
MLCellLinOp::reflux()                            17   0.005278   0.005278   0.005278   0.16%
Gravity::actual_solve_with_mlmg()                22   0.005232   0.005232   0.005232   0.16%
Castro::initData()                                1   0.005014   0.005014   0.005014   0.15%
FabArray::setVal(val, thecmd, scomp, ncomp)     956   0.004643   0.004643   0.004643   0.14%
Amr::writePlotFile()                              2   0.004601   0.004601   0.004601   0.14%
MLCellLinOp::setLevelBC()                        26   0.004395   0.004395   0.004395   0.13%
FabArrayBase::CPC::define()                     910   0.004336   0.004336   0.004336   0.13%
FabArray::LinComb()                             486      0.004      0.004      0.004   0.12%
MLCellLinOp::compGrad()                          26   0.003955   0.003955   0.003955   0.12%
Castro::wd_update()                               6   0.003296   0.003296   0.003296   0.10%
Castro::construct_old_source()                   63    0.00326    0.00326    0.00326   0.10%
FabArray::setDomainBndry()                       92   0.003204   0.003204   0.003204   0.10%
MultiFab::contains_nan()                         18   0.003156   0.003156   0.003156   0.09%
FillPatchInterp(MF)                              30    0.00309    0.00309    0.00309   0.09%
MLCellLinOp::prepareForSolve()                   22   0.003018   0.003018   0.003018   0.09%
MLMG::prepareForSolve()                          22   0.002853   0.002853   0.002853   0.08%
FabArray::mult()                                 63   0.002635   0.002635   0.002635   0.08%
Castro::fill_hybrid_hydro_source()               43    0.00251    0.00251    0.00251   0.07%
MLCGSolver::bicgstab                             70   0.002093   0.002093   0.002093   0.06%
Castro::apply_tagging_restrictions()              6    0.00182    0.00182    0.00182   0.05%
FabArrayBase::getCPC()                         2138   0.001583   0.001583   0.001583   0.05%
MLCellLinOp::defineBC()                          22    0.00155    0.00155    0.00155   0.05%
TagBoxArray::mapPRD                               6   0.001258   0.001258   0.001258   0.04%
MLCellLinOp::smooth()                          1400   0.001031   0.001031   0.001031   0.03%
MultiFab::Subtract()                             20  0.0009885  0.0009885  0.0009885   0.03%
FabArrayBase::FB::FB()                           84  0.0009465  0.0009465  0.0009465   0.03%
Gravity::get_new_grav_vector()                   10  0.0009365  0.0009365  0.0009365   0.03%
OwnerMask()                                       6   0.000882   0.000882   0.000882   0.03%
Castro::build_fine_mask()                        40  0.0008771  0.0008771  0.0008771   0.03%
FabArray::FillBoundary()                       3516  0.0008727  0.0008727  0.0008727   0.03%
MLCellLinOp::updateSolBC()                       14  0.0007813  0.0007813  0.0007813   0.02%
main()                                            1  0.0007753  0.0007753  0.0007753   0.02%
Gravity::get_old_grav_vector()                    9  0.0007665  0.0007665  0.0007665   0.02%
MLPoisson::FFlux()                               85  0.0007068  0.0007068  0.0007068   0.02%
FillPatchIterator::Initialize                    62  0.0006784  0.0006784  0.0006784   0.02%
FillPatchTwoLevels                               31  0.0006658  0.0006658  0.0006658   0.02%
FabArrayBase::getFB()                          3516   0.000661   0.000661   0.000661   0.02%
TagBoxArray::collate()                            6  0.0006543  0.0006543  0.0006543   0.02%
FabArray::norminf(mask)                          11  0.0006078  0.0006078  0.0006078   0.02%
MLCellLinOp::updateCorBC()                       10  0.0005813  0.0005813  0.0005813   0.02%
Gravity::solve_for_phi()                         17  0.0005717  0.0005717  0.0005717   0.02%
Castro::FluxRegFineAdd()                          9   0.000564   0.000564   0.000564   0.02%
MultiFab::max()                                  18  0.0005313  0.0005313  0.0005313   0.02%
Castro::apply_problem_tags()                      6  0.0005018  0.0005018  0.0005018   0.01%
MLCellLinOp::apply()                           1025  0.0004707  0.0004707  0.0004707   0.01%
Castro::construct_old_gravity()                   9  0.0004405  0.0004405  0.0004405   0.01%
Castro::Castro()                                  5   0.000411   0.000411   0.000411   0.01%
Castro::enforce_speed_limit()                   103  0.0004068  0.0004068  0.0004068   0.01%
Amr::regrid()                                     5  0.0004026  0.0004026  0.0004026   0.01%
Castro::construct_new_rotation_source()          17   0.000396   0.000396   0.000396   0.01%
Castro::subcycle_advance_ctu()                    9  0.0003849  0.0003849  0.0003849   0.01%
FabArray::ParallelCopy()                       1194  0.0003839  0.0003839  0.0003839   0.01%
average_down_faces                               24  0.0003682  0.0003682  0.0003682   0.01%
MLMG::mgVcycle()                                 90  0.0003655  0.0003655  0.0003655   0.01%
MLLinOp::defineGrids()                           22  0.0003129  0.0003129  0.0003129   0.01%
Gravity::create_comp_minus_level_grad_phi()       4  0.0002808  0.0002808  0.0002808   0.01%
Gravity::multilevel_solve_for_new_phi()           5  0.0002761  0.0002761  0.0002761   0.01%
MLCGSolver::ParallelAllReduce                  1304  0.0002672  0.0002672  0.0002672   0.01%
MLCellLinOp::correctionResidual()               430  0.0002356  0.0002356  0.0002356   0.01%
MultiFab::Multiply()                              4  0.0002336  0.0002336  0.0002336   0.01%
Gravity::update_max_rhs()                        10  0.0002301  0.0002301  0.0002301   0.01%
Amr::coarseTimeStep()                             5  0.0002276  0.0002276  0.0002276   0.01%
Castro::construct_old_rotation_source()           9  0.0002076  0.0002076  0.0002076   0.01%
Castro::do_new_sources()                         17  0.0002072  0.0002072  0.0002072   0.01%
Castro::construct_new_gravity()                   9   0.000205   0.000205   0.000205   0.01%
MLMG::interpCorrection_1                         10  0.0001975  0.0001975  0.0001975   0.01%
AMRErrorTag::operator()                           6  0.0001821  0.0001821  0.0001821   0.01%
Castro::initialize_advance()                      9  0.0001685  0.0001685  0.0001685   0.01%
Castro::initialize_do_advance()                   9  0.0001596  0.0001596  0.0001596   0.00%
Castro::finalize_advance()                        9  0.0001538  0.0001538  0.0001538   0.00%
Castro::derive()                                  6  0.0001513  0.0001513  0.0001513   0.00%
Gravity::GetCrsePhi()                             8  0.0001457  0.0001457  0.0001457   0.00%
Castro::swap_state_time_levels()                  9  0.0001378  0.0001378  0.0001378   0.00%
Castro::expand_state()                           13  0.0001347  0.0001347  0.0001347   0.00%
StateData::define()                              25  0.0001332  0.0001332  0.0001332   0.00%
Castro::clean_state()                           103  0.0001317  0.0001317  0.0001317   0.00%
Castro::linear_to_hybrid_momentum()               1  0.0001167  0.0001167  0.0001167   0.00%
Castro::do_old_sources()                          9  0.0001154  0.0001154  0.0001154   0.00%
Castro::post_regrid()                            10  0.0001128  0.0001128  0.0001128   0.00%
Castro::enforce_consistent_e()                    1  0.0001118  0.0001118  0.0001118   0.00%
MLMG:computeResOfCorrection()                   340  0.0001112  0.0001112  0.0001112   0.00%
Gravity::actual_multilevel_solve()                5     0.0001     0.0001     0.0001   0.00%
Gravity::solve_phi_with_mlmg()                   22   9.99e-05   9.99e-05   9.99e-05   0.00%
Amr::grid_places()                                6  9.623e-05  9.623e-05  9.623e-05   0.00%
Castro::buildMetrics()                            5  9.554e-05  9.554e-05  9.554e-05   0.00%
MLMG::actualBottomSolve()                        70  9.275e-05  9.275e-05  9.275e-05   0.00%
MLMG::solve()                                    22  8.857e-05  8.857e-05  8.857e-05   0.00%
MLMG::mgVcycle_down::0                           70  8.372e-05  8.372e-05  8.372e-05   0.00%
MLMG::mgVcycle_down::2                           70  8.053e-05  8.053e-05  8.053e-05   0.00%
MLMG::oneIter()                                  70  7.861e-05  7.861e-05  7.861e-05   0.00%
MLMG::mgVcycle_down::1                           70  7.771e-05  7.771e-05  7.771e-05   0.00%
MLMG::mgVcycle_down::3                           70  7.654e-05  7.654e-05  7.654e-05   0.00%
Amr::timeStep()                                   9   7.12e-05   7.12e-05   7.12e-05   0.00%
Gravity::average_fine_ec_onto_crse_ec()           4  6.615e-05  6.615e-05  6.615e-05   0.00%
MLCellLinOp::solutionResidual()                 109  6.502e-05  6.502e-05  6.502e-05   0.00%
MLMG::mgVcycle_down::4                           60  6.047e-05  6.047e-05  6.047e-05   0.00%
FillPatchSingleLevel                             92  5.994e-05  5.994e-05  5.994e-05   0.00%
Castro::init(old)                                 3   5.54e-05   5.54e-05   5.54e-05   0.00%
Castro::finalize_do_advance()                     9  5.335e-05  5.335e-05  5.335e-05   0.00%
Castro::errorEst()                                6  5.119e-05  5.119e-05  5.119e-05   0.00%
MLMG::mgVcycle_up::3                             70  5.105e-05  5.105e-05  5.105e-05   0.00%
makeSFC                                         102  5.022e-05  5.022e-05  5.022e-05   0.00%
MLMG::mgVcycle_up::4                             60  4.896e-05  4.896e-05  4.896e-05   0.00%
MLMG::mgVcycle_up::0                             70  4.895e-05  4.895e-05  4.895e-05   0.00%
MLMG::mgVcycle_up::1                             70  4.823e-05  4.823e-05  4.823e-05   0.00%
Castro::post_timestep()                           9  4.787e-05  4.787e-05  4.787e-05   0.00%
MLMG::mgVcycle_up::2                             70  4.744e-05  4.744e-05  4.744e-05   0.00%
MLMG::mgVcycle_bottom                            90  4.736e-05  4.736e-05  4.736e-05   0.00%
AmrLevel::AmrLevel(dm)                            5  4.532e-05  4.532e-05  4.532e-05   0.00%
MLMG::ResNormInf()                               99  4.319e-05  4.319e-05  4.319e-05   0.00%
Amr::writeSmallPlotFile()                         1  4.113e-05  4.113e-05  4.113e-05   0.00%
MLPoisson::define()                              22  3.759e-05  3.759e-05  3.759e-05   0.00%
AmrLevel::FillCoarsePatch()                       5  3.668e-05  3.668e-05  3.668e-05   0.00%
DistributionMapping::Distribute()               104  3.645e-05  3.645e-05  3.645e-05   0.00%
MLMG::computeResidual()                          70  3.069e-05  3.069e-05  3.069e-05   0.00%
MLLinOp::makeAgglomeratedDMap                    22  2.871e-05  2.871e-05  2.871e-05   0.00%
Castro::computeNewDt()                            8  2.667e-05  2.667e-05  2.667e-05   0.00%
MLPoisson::prepareForSolve()                     22  2.504e-05  2.504e-05  2.504e-05   0.00%
Amr::defBaseLevel()                               1  2.409e-05  2.409e-05  2.409e-05   0.00%
Castro::advance()                                 9  2.194e-05  2.194e-05  2.194e-05   0.00%
FPinfo::FPinfo()                                  3  1.914e-05  1.914e-05  1.914e-05   0.00%
FabArray::RecvLayoutMask()                        4  1.814e-05  1.814e-05  1.814e-05   0.00%
MLMG::computeMLResidual()                        25  1.778e-05  1.778e-05  1.778e-05   0.00%
FabArrayBase::TheFPinfo()                        25  1.691e-05  1.691e-05  1.691e-05   0.00%
MLLinOp::define()                                22  1.672e-05  1.672e-05  1.672e-05   0.00%
Amr::FinalizeInit()                               1  1.669e-05  1.669e-05  1.669e-05   0.00%
MLMG::computeResWithCrseSolFineCor()             10  1.584e-05  1.584e-05  1.584e-05   0.00%
Castro::apply_source_to_state()                  34  1.566e-05  1.566e-05  1.566e-05   0.00%
ClusterList::intersect()                          4   1.31e-05   1.31e-05   1.31e-05   0.00%
MLMG::getGradSolution()                          22  1.275e-05  1.275e-05  1.275e-05   0.00%
Castro::construct_new_hybrid_source()            17  1.242e-05  1.242e-05  1.242e-05   0.00%
Castro::react_state()                            18  1.209e-05  1.209e-05  1.209e-05   0.00%
Castro::post_init()                               1  1.129e-05  1.129e-05  1.129e-05   0.00%
Castro::check_for_nan()                          18   1.09e-05   1.09e-05   1.09e-05   0.00%
MLMG::MLResNormInf()                             25  1.015e-05  1.015e-05  1.015e-05   0.00%
Amr::initSubcycle()                               1    9.8e-06    9.8e-06    9.8e-06   0.00%
Gravity::swapTimeLevels()                         9  8.578e-06  8.578e-06  8.578e-06   0.00%
MLMG::MLRhsNormInf()                             22  8.279e-06  8.279e-06  8.279e-06   0.00%
MLMG::miniCycle()                                20  8.027e-06  8.027e-06  8.027e-06   0.00%
MLMG::computeResWithCrseCorFineCor()             10  7.771e-06  7.771e-06  7.771e-06   0.00%
Castro::avgDown(state_indx)                      20  7.343e-06  7.343e-06  7.343e-06   0.00%
amrex::average_down_w_geom                       20  6.768e-06  6.768e-06  6.768e-06   0.00%
DistributionMapping::SFCProcessorMapDoIt()        2  6.254e-06  6.254e-06  6.254e-06   0.00%
Castro::construct_old_hybrid_source()             9  5.919e-06  5.919e-06  5.919e-06   0.00%
AmrMesh-cluster                                   4  5.676e-06  5.676e-06  5.676e-06   0.00%
Castro::avgDown()                                 4  4.431e-06  4.431e-06  4.431e-06   0.00%
BoxList::parallelComplementIn()                  12  4.333e-06  4.333e-06  4.333e-06   0.00%
Castro::create_source_corrector()                 9  4.323e-06  4.323e-06  4.323e-06   0.00%
Castro::computeInitialDt()                        2  4.247e-06  4.247e-06  4.247e-06   0.00%
Amr::InitializeInit()                             1  4.223e-06  4.223e-06  4.223e-06   0.00%
Amr::init()                                       1  4.029e-06  4.029e-06  4.029e-06   0.00%
Castro::retry_advance_ctu()                       9  3.818e-06  3.818e-06  3.818e-06   0.00%
MLLinOp::makeSubCommunicator()                   22  3.637e-06  3.637e-06  3.637e-06   0.00%
BoxList::complementIn                            12  3.584e-06  3.584e-06  3.584e-06   0.00%
Gravity::set_mass_offset()                        6  3.307e-06  3.307e-06  3.307e-06   0.00%
Amr::bldFineLevels()                              1  2.265e-06  2.265e-06  2.265e-06   0.00%
Castro::init()                                    1  2.118e-06  2.118e-06  2.118e-06   0.00%
ClusterList::chop()                               4  1.284e-06  1.284e-06  1.284e-06   0.00%
Amr::initialInit()                                1   1.13e-06   1.13e-06   1.13e-06   0.00%
--------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------
Name                                         NCalls  Incl. Min  Incl. Avg  Incl. Max   Max %
--------------------------------------------------------------------------------------------
main()                                            1      3.365      3.365      3.365 100.00%
Amr::coarseTimeStep()                             5      1.633      1.633      1.633  48.54%
Amr::timeStep()                                   9      1.629      1.629      1.629  48.39%
Castro::advance()                                 9      1.303      1.303      1.303  38.72%
Castro::subcycle_advance_ctu()                    9      1.273      1.273      1.273  37.84%
Castro::do_advance_ctu()                          9      1.273      1.273      1.273  37.83%
Amr::InitAmr()                                    1      1.066      1.066      1.066  31.69%
Castro::construct_ctu_hydro_source()              9      0.698      0.698      0.698  20.74%
Gravity::solve_phi_with_mlmg()                   22     0.5018     0.5018     0.5018  14.91%
Amr::init()                                       1      0.446      0.446      0.446  13.25%
Amr::writePlotFile()                              2     0.4262     0.4262     0.4262  12.66%
VisMF::Write(FabArray)                            3     0.4192     0.4192     0.4192  12.46%
Gravity::actual_solve_with_mlmg()                22     0.4094     0.4094     0.4094  12.17%
MLMG::solve()                                    22     0.3368     0.3368     0.3368  10.01%
Gravity::solve_for_phi()                         17     0.3351     0.3351     0.3351   9.96%
MLMG::oneIter()                                  70      0.299      0.299      0.299   8.88%
MLMG::mgVcycle()                                 90       0.28       0.28       0.28   8.32%
Amr::initialInit()                                1     0.2384     0.2384     0.2384   7.09%
Castro::construct_old_gravity()                   9     0.2006     0.2006     0.2006   5.96%
Castro::construct_new_gravity()                   9     0.1753     0.1753     0.1753   5.21%
Castro::clean_state()                           103     0.1738     0.1738     0.1738   5.16%
Amr::InitializeInit()                             1     0.1713     0.1713     0.1713   5.09%
Amr::defBaseLevel()                               1     0.1713     0.1713     0.1713   5.09%
Gravity::multilevel_solve_for_new_phi()           5     0.1696     0.1696     0.1696   5.04%
Gravity::actual_multilevel_solve()                5     0.1694     0.1694     0.1694   5.03%
MLCellLinOp::applyBC()                         3868     0.1684     0.1684     0.1684   5.00%
Castro::post_timestep()                           9     0.1669     0.1669     0.1669   4.96%
Castro::Castro()                                  5     0.1633     0.1633     0.1633   4.85%
Castro::initMFs()                                 5     0.1611     0.1611     0.1611   4.79%
Amr::regrid()                                     5     0.1583     0.1583     0.1583   4.70%
MLCellLinOp::smooth()                          1400     0.1543     0.1543     0.1543   4.59%
Castro::post_regrid()                            10     0.1447     0.1447     0.1447   4.30%
Castro::reflux()                                  4     0.1086     0.1086     0.1086   3.23%
Castro::computeTemp()                           104    0.09092    0.09092    0.09092   2.70%
Gravity::fill_multipole_BCs()                    14     0.0904     0.0904     0.0904   2.69%
FabArray::FillBoundary()                       3516     0.0799     0.0799     0.0799   2.37%
FillBoundary_nowait()                          3516    0.07902    0.07902    0.07902   2.35%
FillPatchIterator::Initialize                    62    0.07481    0.07481    0.07481   2.22%
MLMG::mgVcycle_bottom                            90    0.07016    0.07016    0.07016   2.08%
Castro::do_new_sources()                         17    0.06883    0.06883    0.06883   2.05%
Amr::FinalizeInit()                               1    0.06716    0.06716    0.06716   2.00%
FillPatchSingleLevel                             92    0.06679    0.06679    0.06679   1.98%
MLMG::actualBottomSolve()                        70    0.06613    0.06613    0.06613   1.96%
MLCGSolver::bicgstab                             70    0.06551    0.06551    0.06551   1.95%
MLMG::mgVcycle_down::0                           70    0.05753    0.05753    0.05753   1.71%
Castro::post_init()                               1    0.05679    0.05679    0.05679   1.69%
MLPoisson::define()                              22    0.05651    0.05651    0.05651   1.68%
Castro::normalize_species()                     103    0.05628    0.05628    0.05628   1.67%
MLCellLinOp::apply()                           1025    0.05043    0.05043    0.05043   1.50%
Castro::problem_post_timestep()                  10    0.04936    0.04936    0.04936   1.47%
StateDataPhysBCFunct::()                         95    0.04778    0.04778    0.04778   1.42%
Castro::initialize_do_advance()                   9    0.04588    0.04588    0.04588   1.36%
MLMG::mgVcycle_up::0                             70    0.04327    0.04327    0.04327   1.29%
FabArray::setVal()                             1493    0.04284    0.04284    0.04284   1.27%
Castro::expand_state()                           13    0.04115    0.04115    0.04115   1.22%
FabArray::ParallelCopy()                       1194    0.03771    0.03771    0.03771   1.12%
Castro::construct_new_source()                  119     0.0375     0.0375     0.0375   1.11%
FabArray::ParallelCopy_nowait()                1194    0.03732    0.03732    0.03732   1.11%
MLCellLinOp::defineAuxData()                     22    0.03536    0.03536    0.03536   1.05%
amrex::Copy()                                  1129     0.0341     0.0341     0.0341   1.01%
Castro::wd_update()                               6    0.03403    0.03403    0.03403   1.01%
StateData::FillBoundary(geom)                   650    0.03324    0.03324    0.03324   0.99%
MLCellLinOp::correctionResidual()               430     0.0325     0.0325     0.0325   0.97%
Castro::reset_internal_energy(MultiFab)         104    0.03249    0.03249    0.03249   0.97%
Castro::volInBoundary()                          42     0.0303     0.0303     0.0303   0.90%
FluxRegister::Reflux()                           24     0.0292     0.0292     0.0292   0.87%
Castro::do_old_sources()                          9    0.02812    0.02812    0.02812   0.84%
MLMG:computeResOfCorrection()                   340     0.0276     0.0276     0.0276   0.82%
Castro::enforce_min_density()                   103    0.02734    0.02734    0.02734   0.81%
MLPoisson::Fsmooth()                           2800    0.02489    0.02489    0.02489   0.74%
MLMG::mgVcycle_down::1                           70    0.02363    0.02363    0.02363   0.70%
FabArray::Saxpy()                               755    0.02351    0.02351    0.02351   0.70%
amrex::Add()                                    227    0.02159    0.02159    0.02159   0.64%
Gravity::get_new_grav_vector()                   10    0.02143    0.02143    0.02143   0.64%
MLCellLinOp::defineBC()                          22    0.02066    0.02066    0.02066   0.61%
Castro::initialize_advance()                      9     0.0195     0.0195     0.0195   0.58%
BndryData::define()                              30    0.01904    0.01904    0.01904   0.57%
MLCellLinOp::solutionResidual()                 109     0.0187     0.0187     0.0187   0.56%
amrex::Dot()                                    972    0.01828    0.01828    0.01828   0.54%
Gravity::get_old_grav_vector()                    9    0.01762    0.01762    0.01762   0.52%
MLMG::mgVcycle_up::1                             70    0.01721    0.01721    0.01721   0.51%
Castro::estTimeStep()                            26    0.01652    0.01652    0.01652   0.49%
amrex::average_down                             392    0.01539    0.01539    0.01539   0.46%
FabArray::norminf()                             670    0.01451    0.01451    0.01451   0.43%
MLMG::mgVcycle_down::2                           70    0.01412    0.01412    0.01412   0.42%
MLMG::addInterpCorrection()                     340    0.01393    0.01393    0.01393   0.41%
MLMG::mgVcycle_down::3                           70    0.01325    0.01325    0.01325   0.39%
MLMG::prepareForSolve()                          22    0.01291    0.01291    0.01291   0.38%
Amr::grid_places()                                6    0.01279    0.01279    0.01279   0.38%
AmrMesh::MakeNewGrids()                           6    0.01269    0.01269    0.01269   0.38%
MLPoisson::Fapply()                            1025    0.01241    0.01241    0.01241   0.37%
MLMG::computeResidual()                          70    0.01169    0.01169    0.01169   0.35%
FabArray::Xpay()                                731    0.01155    0.01155    0.01155   0.34%
MLMG::mgVcycle_down::4                           60    0.01113    0.01113    0.01113   0.33%
Castro::construct_old_source()                   63    0.01073    0.01073    0.01073   0.32%
MLCGSolver::ParallelAllReduce                  1304    0.01046    0.01046    0.01046   0.31%
Castro::finalize_advance()                        9    0.01029    0.01029    0.01029   0.31%
MLMG::mgVcycle_up::2                             70     0.0102     0.0102     0.0102   0.30%
MLMG::mgVcycle_up::3                             70    0.01019    0.01019    0.01019   0.30%
Castro::initData()                                1   0.009655   0.009655   0.009655   0.29%
MLMG::mgVcycle_up::4                             60   0.008989   0.008989   0.008989   0.27%
Castro::FluxRegCrseInit                           9   0.008901   0.008901   0.008901   0.26%
MLMG::computeMLResidual()                        25   0.008874   0.008874   0.008874   0.26%
MLCellLinOp::reflux()                            17   0.008477   0.008477   0.008477   0.25%
Castro::computeNewDt()                            8   0.008097   0.008097   0.008097   0.24%
Castro::construct_new_gravity_source()           17   0.007905   0.007905   0.007905   0.23%
MLMG::computeResWithCrseSolFineCor()             10   0.007724   0.007724   0.007724   0.23%
Castro::apply_source_to_state()                  34   0.007557   0.007557   0.007557   0.22%
Castro::construct_old_gravity_source()           18    0.00707    0.00707    0.00707   0.21%
FillPatchTwoLevels                               31   0.007014   0.007014   0.007014   0.21%
Amr::bldFineLevels()                              1   0.006989   0.006989   0.006989   0.21%
Castro::reset_internal_energy(Fab)             1708    0.00644    0.00644    0.00644   0.19%
FabArrayBase::getCPC()                         2138   0.005918   0.005918   0.005918   0.18%
MLMG::getGradSolution()                          22   0.005796   0.005796   0.005796   0.17%
MLCellLinOp::compGrad()                          26   0.005783   0.005783   0.005783   0.17%
MLCellLinOp::setLevelBC()                        26    0.00501    0.00501    0.00501   0.15%
FabArray::setVal(val, thecmd, scomp, ncomp)     956   0.004643   0.004643   0.004643   0.14%
FabArrayBase::CPC::define()                     910   0.004336   0.004336   0.004336   0.13%
MLMG::miniCycle()                                20    0.00402    0.00402    0.00402   0.12%
FabArray::LinComb()                             486      0.004      0.004      0.004   0.12%
MLMG::ResNormInf()                               99   0.003538   0.003538   0.003538   0.11%
Castro::errorEst()                                6   0.003397   0.003397   0.003397   0.10%
FabArray::setDomainBndry()                       92   0.003204   0.003204   0.003204   0.10%
Castro::check_for_nan()                          18   0.003167   0.003167   0.003167   0.09%
MultiFab::contains_nan()                         18   0.003156   0.003156   0.003156   0.09%
FillPatchInterp(MF)                              30    0.00309    0.00309    0.00309   0.09%
MLPoisson::prepareForSolve()                     22   0.003043   0.003043   0.003043   0.09%
MLCellLinOp::prepareForSolve()                   22   0.003018   0.003018   0.003018   0.09%
TagBoxArray::mapPRD                               6   0.002843   0.002843   0.002843   0.08%
Castro::init(old)                                 3   0.002779   0.002779   0.002779   0.08%
FabArray::mult()                                 63   0.002635   0.002635   0.002635   0.08%
Castro::fill_hybrid_hydro_source()               43    0.00251    0.00251    0.00251   0.07%
Castro::computeInitialDt()                        2   0.002098   0.002098   0.002098   0.06%
MLMG::computeResWithCrseCorFineCor()             10   0.002003   0.002003   0.002003   0.06%
MLCellLinOp::updateSolBC()                       14   0.001847   0.001847   0.001847   0.05%
Castro::construct_new_hybrid_source()            17   0.001826   0.001826   0.001826   0.05%
Castro::apply_tagging_restrictions()              6    0.00182    0.00182    0.00182   0.05%
Gravity::update_max_rhs()                        10   0.001816   0.001816   0.001816   0.05%
Gravity::create_comp_minus_level_grad_phi()       4    0.00178    0.00178    0.00178   0.05%
FabArrayBase::getFB()                          3516   0.001607   0.001607   0.001607   0.05%
Gravity::GetCrsePhi()                             8   0.001318   0.001318   0.001318   0.04%
MLCellLinOp::updateCorBC()                       10   0.001315   0.001315   0.001315   0.04%
Castro::avgDown()                                 4   0.001175   0.001175   0.001175   0.03%
Castro::avgDown(state_indx)                      20   0.001171   0.001171   0.001171   0.03%
amrex::average_down_w_geom                       20   0.001164   0.001164   0.001164   0.03%
MLMG::MLResNormInf()                             25   0.001107   0.001107   0.001107   0.03%
MultiFab::Subtract()                             20  0.0009885  0.0009885  0.0009885   0.03%
FabArrayBase::FB::FB()                           84  0.0009465  0.0009465  0.0009465   0.03%
Gravity::average_fine_ec_onto_crse_ec()           4   0.000936   0.000936   0.000936   0.03%
OwnerMask()                                       6   0.000882   0.000882   0.000882   0.03%
Castro::build_fine_mask()                        40  0.0008771  0.0008771  0.0008771   0.03%
Castro::derive()                                  6  0.0008412  0.0008412  0.0008412   0.02%
MLMG::MLRhsNormInf()                             22  0.0007658  0.0007658  0.0007658   0.02%
MLPoisson::FFlux()                               85  0.0007068  0.0007068  0.0007068   0.02%
Castro::construct_old_hybrid_source()             9  0.0007026  0.0007026  0.0007026   0.02%
Castro::init()                                    1  0.0006741  0.0006741  0.0006741   0.02%
AmrLevel::FillCoarsePatch()                       5   0.000672   0.000672   0.000672   0.02%
TagBoxArray::collate()                            6  0.0006543  0.0006543  0.0006543   0.02%
Gravity::swapTimeLevels()                         9  0.0006215  0.0006215  0.0006215   0.02%
Castro::buildMetrics()                            5  0.0006166  0.0006166  0.0006166   0.02%
FabArray::norminf(mask)                          11  0.0006078  0.0006078  0.0006078   0.02%
average_down_faces                               24  0.0005829  0.0005829  0.0005829   0.02%
Castro::FluxRegFineAdd()                          9   0.000564   0.000564   0.000564   0.02%
MLMG::interpCorrection_1                         10  0.0005353  0.0005353  0.0005353   0.02%
MultiFab::max()                                  18  0.0005313  0.0005313  0.0005313   0.02%
Castro::apply_problem_tags()                      6  0.0005018  0.0005018  0.0005018   0.01%
MLLinOp::define()                                22  0.0004466  0.0004466  0.0004466   0.01%
MLLinOp::defineGrids()                           22  0.0004299  0.0004299  0.0004299   0.01%
Castro::enforce_speed_limit()                   103  0.0004068  0.0004068  0.0004068   0.01%
Castro::construct_new_rotation_source()          17   0.000396   0.000396   0.000396   0.01%
Castro::react_state()                            18  0.0003611  0.0003611  0.0003611   0.01%
MultiFab::Multiply()                              4  0.0002336  0.0002336  0.0002336   0.01%
Castro::construct_old_rotation_source()           9  0.0002076  0.0002076  0.0002076   0.01%
AMRErrorTag::operator()                           6  0.0001821  0.0001821  0.0001821   0.01%
AmrLevel::AmrLevel(dm)                            5  0.0001785  0.0001785  0.0001785   0.01%
Castro::swap_state_time_levels()                  9  0.0001378  0.0001378  0.0001378   0.00%
StateData::define()                              25  0.0001332  0.0001332  0.0001332   0.00%
Castro::linear_to_hybrid_momentum()               1  0.0001167  0.0001167  0.0001167   0.00%
MLLinOp::makeAgglomeratedDMap                    22  0.0001133  0.0001133  0.0001133   0.00%
Castro::enforce_consistent_e()                    1  0.0001118  0.0001118  0.0001118   0.00%
makeSFC                                         102   8.46e-05   8.46e-05   8.46e-05   0.00%
Castro::finalize_do_advance()                     9  5.335e-05  5.335e-05  5.335e-05   0.00%
Amr::writeSmallPlotFile()                         1  4.113e-05  4.113e-05  4.113e-05   0.00%
DistributionMapping::Distribute()               104  3.645e-05  3.645e-05  3.645e-05   0.00%
FabArrayBase::TheFPinfo()                        25  3.605e-05  3.605e-05  3.605e-05   0.00%
AmrMesh-cluster                                   4  2.006e-05  2.006e-05  2.006e-05   0.00%
FPinfo::FPinfo()                                  3  1.914e-05  1.914e-05  1.914e-05   0.00%
FabArray::RecvLayoutMask()                        4  1.814e-05  1.814e-05  1.814e-05   0.00%
ClusterList::intersect()                          4   1.31e-05   1.31e-05   1.31e-05   0.00%
Amr::initSubcycle()                               1    9.8e-06    9.8e-06    9.8e-06   0.00%
DistributionMapping::SFCProcessorMapDoIt()        2   8.33e-06   8.33e-06   8.33e-06   0.00%
BoxList::parallelComplementIn()                  12  7.917e-06  7.917e-06  7.917e-06   0.00%
Castro::create_source_corrector()                 9  4.323e-06  4.323e-06  4.323e-06   0.00%
Castro::retry_advance_ctu()                       9  3.818e-06  3.818e-06  3.818e-06   0.00%
MLLinOp::makeSubCommunicator()                   22  3.637e-06  3.637e-06  3.637e-06   0.00%
BoxList::complementIn                            12  3.584e-06  3.584e-06  3.584e-06   0.00%
Gravity::set_mass_offset()                        6  3.307e-06  3.307e-06  3.307e-06   0.00%
ClusterList::chop()                               4  1.284e-06  1.284e-06  1.284e-06   0.00%
--------------------------------------------------------------------------------------------

Unused ParmParse Variables:
  [TOP]::mg.v(nvals = 1)  :: [2]

Device Memory Usage:
------------------------------------------------------------------------------
Name                                         Nalloc  Nfree    AvgMem    MaxMem
------------------------------------------------------------------------------
The_Arena::Initialize()                           1      1    24 MiB  9042 MiB
Castro::construct_ctu_hydro_source()           5148   5148   436 MiB  4449 MiB
Castro::reflux()                                436    436    10 MiB   666 MiB
Castro::initMFs()                               258    258   360 MiB   576 MiB
Castro::swap_state_time_levels()                175    175   177 MiB   340 MiB
StateData::define()                             175    175   227 MiB   340 MiB
FillPatchIterator::Initialize                   899    899  3719 KiB   303 MiB
Castro::initialize_do_advance()                 143    143   106 MiB   303 MiB
Amr::writePlotFile()                             56     56    22 MiB   189 MiB
Castro::problem_post_timestep()                 162    162   714 KiB   167 MiB
Castro::FluxRegCrseInit                         660    660   416 KiB   167 MiB
FluxRegister::Reflux()                          648    648  1408 KiB   160 MiB
Castro::initialize_advance()                    143    143    40 MiB   113 MiB
Castro::construct_new_source()                  259    259   329 KiB    67 MiB
Castro::construct_old_source()                  143    143   111 KiB    67 MiB
Castro::buildMetrics()                          140    140    38 MiB    61 MiB
Gravity::multilevel_solve_for_new_phi()         429    429    28 MiB    58 MiB
Castro::Castro()                                210    210  5035 KiB    50 MiB
MLMG::prepareForSolve()                        2806   2806  3898 KiB    42 MiB
Gravity::get_new_grav_vector()                  173    173   208 KiB    33 MiB
Gravity::get_old_grav_vector()                  143    143   167 KiB    33 MiB
ResizeRandomSeed                                  1      1    30 MiB    30 MiB
Castro::construct_old_gravity()                 432    432  1538 KiB    28 MiB
Gravity::create_comp_minus_level_grad_phi()     432    432  5815 KiB    27 MiB
MLCellLinOp::defineAuxData()                   7592   7592   604 KiB    16 MiB
FillPatchTwoLevels                              300    300  6251   B    11 MiB
Gravity::GetCrsePhi()                           216    216    98 KiB  8290 KiB
FillPatchInterp(MF)                             330    330  3398   B  7955 KiB
Gravity::fill_multipole_BCs()                   470    470   152 KiB  7469 KiB
Gravity::update_max_rhs()                       286    286  3733   B  7424 KiB
Gravity::actual_multilevel_solve()              143    143   365 KiB  7424 KiB
Castro::build_fine_mask()                       224    224   838 KiB  6912 KiB
Gravity::solve_for_phi()                        259    259   610 KiB  6912 KiB
Castro::derive()                                162    162  2092   B  6912 KiB
BndryData::define()                            4920   4920   379 KiB  4243 KiB
MLCellLinOp::reflux()                           255    255  2857   B  2376 KiB
Castro::wd_update()                               6      6    22 KiB  2240 KiB
AmrLevel::FillCoarsePatch()                      10     10   261   B  2095 KiB
amrex::average_down                            2631   2631  2091   B  1473 KiB
AmrMesh::MakeNewGrids()                         324    324  3966   B  1041 KiB
MLMG::addInterpCorrection()                    2460   2460  1403   B   867 KiB
MLCellLinOp::defineBC()                         232    232  2157   B   689 KiB
Castro::estTimeStep()                            26     26  2332   B   480 KiB
Castro::normalize_species()                     103    103  5465   B   320 KiB
Castro::volInBoundary()                          70     70  2921   B   320 KiB
VisMF::Write(FabArray)                         1568   1568  2111   B   320 KiB
Gravity::average_fine_ec_onto_crse_ec()          24     24    55   B   204 KiB
FabArray::norminf(mask)                          15     15    94   B   163 KiB
amrex::Dot()                                   1182   1182   801   B   160 KiB
FabArray::norminf()                             810    810   643   B   160 KiB
Castro::do_advance_ctu()                          9      9   264   B   160 KiB
Castro::initData()                                1      1    20   B   160 KiB
MultiFab::max()                                  18     18    24   B   160 KiB
FabArray::setVal()                              460    460    46 KiB    96 KiB
MLMG::interpCorrection_1                         20     20    13   B    91 KiB
average_down_faces                               51     51   462   B    69 KiB
amrex::Copy()                                   244    244    21 KiB    64 KiB
FabArray::ParallelCopy_nowait()                1182   1182   255   B    57 KiB
MLPoisson::Fsmooth()                            396    396  4707   B    55 KiB
FillBoundary_nowait()                          1280   1280   798   B    53 KiB
TagBoxArray::mapPRD                             324    324    33   B    45 KiB
OwnerMask()                                     168    168     9   B    38 KiB
MLCellLinOp::setLevelBC()                        96     96   357   B    37 KiB
MLCellLinOp::applyBC()                         7736   7736   243   B    30 KiB
MLCellLinOp::prepareForSolve()                  128    128     6   B    25 KiB
MultiFab::contains_nan()                         18     18    19   B    20 KiB
StateData::FillBoundary(geom)                  2538   2538    39   B    13 KiB
FabArray::setVal(val, thecmd, scomp, ncomp)     316    316     4   B  9808   B
MLCGSolver::bicgstab                            630    630    66   B  3584   B
MultiFab::Multiply()                              4      4   139   B  3456   B
TagBoxArray::collate()                           14     14     0   B   672   B
------------------------------------------------------------------------------

Managed Memory Usage:
-----------------------------------------------------------------
Name                             Nalloc  Nfree   AvgMem    MaxMem
-----------------------------------------------------------------
The_Managed_Arena::Initialize()       1      1  182   B  8192 KiB
-----------------------------------------------------------------

Pinned Memory Usage:
------------------------------------------------------------------------------
Name                                         Nalloc  Nfree    AvgMem    MaxMem
------------------------------------------------------------------------------
The_Pinned_Arena::Initialize()                    1      1    12 KiB  8192 KiB
VisMF::Write(FabArray)                         1624   1624   827 KiB  7168 KiB
Gravity::fill_multipole_BCs()                    42     42  1624   B   278 KiB
FabArray::setVal()                              460    460    46 KiB    96 KiB
amrex::Copy()                                   244    244    21 KiB    64 KiB
FabArray::ParallelCopy_nowait()                1182   1182   255   B    57 KiB
MLPoisson::Fsmooth()                            396    396  4707   B    55 KiB
FillBoundary_nowait()                          1280   1280   800   B    53 KiB
MLCellLinOp::applyBC()                         3868   3868   243   B    30 KiB
MLCellLinOp::prepareForSolve()                  128    128     7   B    25 KiB
OwnerMask()                                       6      6     0   B    15 KiB
StateData::FillBoundary(geom)                  2538   2538    39   B    13 KiB
Gravity::get_new_grav_vector()                    3      3  2552   B    10 KiB
FabArray::setVal(val, thecmd, scomp, ncomp)     316    316     4   B  9808   B
amrex::average_down                             197    197   615   B  4688   B
MLMG::prepareForSolve()                          26     26   327   B  3712   B
FabArray::norminf(mask)                          15     15    67   B  3472   B
MLMG::addInterpCorrection()                     130    130     3   B  3456   B
Castro::FluxRegCrseInit                          12     12     8   B  3456   B
MultiFab::Multiply()                              4      4   139   B  3456   B
FillPatchInterp(MF)                             140    140     2   B  2720   B
MLCellLinOp::setLevelBC()                       128    128     0   B  2592   B
average_down_faces                               27     27   451   B  1264   B
TagBoxArray::collate()                           16     16     0   B   784   B
amrex::Dot()                                   1182   1182     5   B   400   B
FabArray::norminf()                             810    810     4   B   272   B
MLCellLinOp::defineAuxData()                      4      4     0   B   208   B
Castro::reflux()                                  4      4     0   B   208   B
Castro::build_fine_mask()                         8      8     0   B   208   B
Castro::wd_update()                               6      6     1   B   112   B
Castro::problem_post_timestep()                  19     19     0   B    48   B
Castro::estTimeStep()                            26     26     0   B    32   B
Castro::volInBoundary()                          70     70     0   B    16   B
MultiFab::contains_nan()                         18     18     0   B    16   B
MultiFab::max()                                  18     18     0   B    16   B
Castro::normalize_species()                     103    103     0   B    16   B
Castro::initData()                                1      1     0   B    16   B
Castro::do_advance_ctu()                          9      9     0   B    16   B
------------------------------------------------------------------------------

Total GPU global memory (MB): 12056
Free  GPU global memory (MB): 2412
[The         Arena] space allocated (MB): 9042
[The         Arena] space used      (MB): 0
[The Managed Arena] space allocated (MB): 8
[The Managed Arena] space used      (MB): 0
[The  Pinned Arena] space allocated (MB): 8
[The  Pinned Arena] space used      (MB): 0
AMReX (23.05-15-g23b157942e41) finalized