MPI initialized with 4 MPI processes
MPI initialized with thread support level 3
OMP initialized with 4 OMP threads
AMReX (22.02-14-gaa0dc39f50f7) initialized

Starting run at 07:53:10 UTC on 2022-02-24.
Successfully read inputs file ... 

Castro git describe: 22.02-4-g0d942c92d
AMReX git describe: 22.02-14-gaa0dc39f5
Microphysics git describe: 22.02-5-g260ac616

reading extern runtime parameters ...
13 Species: 
He4  C12  O16  Ne20  Mg24  Si28  S32  Ar36  Ca40  Ti44  Cr48  Fe52  Ni56  
Successfully read inputs file ... 

Generated initial model for primary WD of mass 0.9 solar masses, central density 1.859e+07 g cm**-3, and radius 6.378e+08 cm.

Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.859e+07 g cm**-3, and radius 6.378e+08 cm.

Castro::numpts_1d at level  0 is 118
Setting the gravity type to PoissonGrav
Warning: the following castro.* parameters are ignored
castro.center = 0.0e0 0.0e0 0.0e0

Initializing the data at level 0
Done initializing the level 0 data 
...estimated hydro-limited timestep at level 0: 0.1183193811
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1183193811

Gravity::fill_multipole_BCs() time = 0.112443543

Gravity::fill_multipole_BCs() time = 0.112343886

      ... norm of composite residual at level 0  1.086122716e-10

INITIAL GRIDS 
  Level 0   8 grids  262144 cells  100 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

PLOTFILE: file = wdmerger_collision_plt00000
Write plotfile time = 0.158096106  seconds

...estimated hydro-limited timestep at level 0: 0.1183193811
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1183193811

[Level 0 step 1] ADVANCE with dt = 0.01183193811

  Beginning subcycle 1 starting at time 0 with dt = 0.01183193811
  Estimated number of subcycles remaining: 1

... Entering burner and doing half-timestep of burning.

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 19.67283955


  Contributions to the state from old-time sources:
       mass added: 0
       xmom added: 8.497561423e+23
       ymom added: -1.813388729e+24
       zmom added: -2.417851639e+24
       eint added: 0
       ener added: 9.696440457e+47

Castro::do_old_sources() time = 0.500811518

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 4.583678854


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.587434011e+48
       ener added: 2.224041905e+42

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.124905753

Gravity::solve_for_phi() time = 0.44854949


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -3.463982899e+48
       ener added: 2.77590766e+47


  Contributions to the state from new-time sources:
       mass added: 0
       xmom added: 9.27301787e+25
       ymom added: -3.199363152e+27
       zmom added: -3.199426904e+27
       eint added: 0
       ener added: -3.749966023e+48

Castro::do_new_sources() time = 0.536787273

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -180436.6878

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 9.855269883

...estimated hydro-limited timestep at level 0: 0.1187673968
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1187673968

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 0.00680749185

[Level 0 step 1] Advanced 262144 cells

  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.503238554e+32
       ener added: 1.504580731e+32


[STEP 1] Coarse TimeStep time: 39.41873316
[STEP 1] FAB kilobyte spread across MPI nodes: [360839 ... 360839]

STEP = 1 TIME = 0.01183193811 DT = 0.01183193811

...estimated hydro-limited timestep at level 0: 0.1187673968
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1187673968

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.1187673968
 ... but limiting to: 0.01301513192 = 1.1 * 0.01183193811
[Level 0 step 2] ADVANCE with dt = 0.01301513192

  Beginning subcycle 1 starting at time 0.01183193811 with dt = 0.01301513192
  Estimated number of subcycles remaining: 1

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -180436.6878

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 19.31924092


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.717986918e+32
       ener added: 1.717986918e+32


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -8.528040118e+46
       ener added: 2.57500084e+46


  Contributions to the state from old-time sources:
       mass added: 0
       xmom added: 2.058050236e+26
       ymom added: -7.049246454e+27
       zmom added: -7.039575048e+27
       eint added: 0
       ener added: 1.095492714e+48

Castro::do_old_sources() time = 0.499283609

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 4.683595982


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.472619958e+48
       ener added: 2.4978038e+42

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.123367021

Gravity::solve_for_phi() time = 0.437387986


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -3.294189959e+48
       ener added: 4.358493059e+47


  Contributions to the state from new-time sources:
       mass added: 0
       xmom added: 1.074062057e+27
       ymom added: -1.273811135e+26
       zmom added: -1.276361213e+26
       eint added: 0
       ener added: -3.730880972e+48

Castro::do_new_sources() time = 0.536084353

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -116400681.3

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 9.814705212


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 9.620726743e+32
       ener added: 4.125852959e+32

...estimated hydro-limited timestep at level 0: 0.1191998721
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1191998721

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 0.00687685638

[Level 0 step 2] Advanced 262144 cells

  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.791728742e+32
       ener added: 2.791728742e+32


[STEP 2] Coarse TimeStep time: 39.0020539
[STEP 2] FAB kilobyte spread across MPI nodes: [360839 ... 360839]

STEP = 2 TIME = 0.02484707003 DT = 0.01301513192

...estimated hydro-limited timestep at level 0: 0.1191998721
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1191998721

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.1191998721
 ... but limiting to: 0.01431664511 = 1.1 * 0.01301513192
[Level 0 step 3] ADVANCE with dt = 0.01431664511

  Beginning subcycle 1 starting at time 0.02484707003 with dt = 0.01431664511
  Estimated number of subcycles remaining: 1

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -119057519.9

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 19.23623306


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 6.95784702e+32
       ener added: 1.375060623e+32


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -9.472798808e+46
       ener added: 3.636738012e+46


  Contributions to the state from old-time sources:
       mass added: 0
       xmom added: 2.589456752e+27
       ymom added: -8.021827276e+27
       zmom added: -8.009133555e+27
       eint added: 0
       ener added: 1.237119322e+48

Castro::do_old_sources() time = 0.503092027

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 4.689053638


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.671439312e+48
       ener added: 4.491729511e+43

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.127699347

Gravity::solve_for_phi() time = 0.452512273


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -3.376081968e+48
       ener added: 5.405023381e+47


  Contributions to the state from new-time sources:
       mass added: 0
       xmom added: -1.23688564e+28
       ymom added: -1.444581352e+27
       zmom added: -1.444184673e+27
       eint added: 0
       ener added: -3.916780534e+48

Castro::do_new_sources() time = 0.540307696

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -41047694.1

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 9.780780129


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.239634936e+34
       ener added: 1.236950581e+34

...estimated hydro-limited timestep at level 0: 0.1195774766
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1195774766

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 0.00688631459

[Level 0 step 3] Advanced 262144 cells

  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.649994822e+33
       ener added: 2.649994822e+33


[STEP 3] Coarse TimeStep time: 38.93959218
[STEP 3] FAB kilobyte spread across MPI nodes: [360839 ... 360839]

STEP = 3 TIME = 0.03916371514 DT = 0.01431664511

...estimated hydro-limited timestep at level 0: 0.1195774766
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1195774766

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.1195774766
 ... but limiting to: 0.01574830962 = 1.1 * 0.01431664511
[Level 0 step 4] ADVANCE with dt = 0.01574830962

  Beginning subcycle 1 starting at time 0.03916371514 with dt = 0.01574830962
  Estimated number of subcycles remaining: 1

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -44572126.43

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 19.1851494


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -9.258482253e+46
       ener added: 6.200079096e+46


  Contributions to the state from old-time sources:
       mass added: 0
       xmom added: -2.436287442e+28
       ymom added: -1.200644678e+28
       zmom added: -1.200946909e+28
       eint added: 0
       ener added: 1.400056178e+48

Castro::do_old_sources() time = 0.506168963

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 4.689823226


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.472992192e+48
       ener added: 1.571693109e+44

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.12148233

Gravity::solve_for_phi() time = 0.45150851


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -3.017160183e+48
       ener added: 6.098309871e+47


  Contributions to the state from new-time sources:
       mass added: 0
       xmom added: -2.46070151e+28
       ymom added: 1.00282144e+28
       zmom added: 1.00285308e+28
       eint added: 0
       ener added: -3.626218303e+48

Castro::do_new_sources() time = 0.544181764

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -2209720963

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 9.768476224


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.195208868e+34
       ener added: 1.080184275e+34

...estimated hydro-limited timestep at level 0: 0.1199311549
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1199311549

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 0.006873614672

[Level 0 step 4] Advanced 262144 cells

  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.799591297e+33
       ener added: 1.799591297e+33


[STEP 4] Coarse TimeStep time: 39.05558242
[STEP 4] FAB kilobyte spread across MPI nodes: [360839 ... 360839]

STEP = 4 TIME = 0.05491202477 DT = 0.01574830962

...estimated hydro-limited timestep at level 0: 0.1199311549
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1199311549

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.1199311549
 ... but limiting to: 0.01732314059 = 1.1 * 0.01574830962
[Level 0 step 5] ADVANCE with dt = 0.01732314059

  Beginning subcycle 1 starting at time 0.05491202477 with dt = 0.01732314059
  Estimated number of subcycles remaining: 1

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -3240886078

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 19.24040545


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 5.757940531e+32
       ener added: 6.871947674e+31


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -8.651576893e+46
       ener added: 9.619804695e+46


  Contributions to the state from old-time sources:
       mass added: 0
       xmom added: -8.093271552e+28
       ymom added: 8.857195017e+27
       zmom added: 8.861426258e+27
       eint added: 0
       ener added: 1.577631435e+48

Castro::do_old_sources() time = 0.50395946

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 4.694616841


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.383201862e+48
       ener added: 2.84444145e+44

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.116113694

Gravity::solve_for_phi() time = 0.443739049


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -3.030904275e+48
       ener added: 6.430291322e+47


  Contributions to the state from new-time sources:
       mass added: 0
       xmom added: -4.331311651e+28
       ymom added: 6.875293362e+26
       zmom added: 6.87642673e+26
       eint added: 0
       ener added: -3.672295669e+48

Castro::do_new_sources() time = 0.543740279

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -4937559697

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 9.772249903


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -7.983270459e+32
       ener added: 4.020357825e+33

...estimated hydro-limited timestep at level 0: 0.1202590217
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1202590217

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 0.006882420389

[Level 0 step 5] Advanced 262144 cells

  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.275605287e+33
       ener added: 1.277752771e+33


[STEP 5] Coarse TimeStep time: 39.00406121
[STEP 5] FAB kilobyte spread across MPI nodes: [360839 ... 360839]

STEP = 5 TIME = 0.07223516535 DT = 0.01732314059

PLOTFILE: file = wdmerger_collision_plt00005
Write plotfile time = 0.146161713  seconds


Ending run at 07:56:31 UTC on 2022-02-24.
Run time = 200.7342418
Run time without initialization = 195.5794482

  Average number of zones advanced per microsecond: 0.007
  Average number of zones advanced per microsecond per rank: 0.002



TinyProfiler total time across processes [min...avg...max]: 200.7 ... 200.7 ... 200.7

--------------------------------------------------------------------------------------------
Name                                         NCalls  Excl. Min  Excl. Avg  Excl. Max   Max %
--------------------------------------------------------------------------------------------
Castro::react_state()                            10   145.4065   145.4887   145.5812  72.52%
Castro::construct_ctu_hydro_source()              5      22.94      23.17      23.36  11.64%
Castro::reset_internal_energy()                  43      4.934      5.047      5.183   2.58%
Castro::computeTemp()                            43      3.911      3.924       3.96   1.97%
MultiFab::AddProduct()                         2055      2.776       2.79       2.81   1.40%
Castro::normalize_species()                      42       2.24       2.25      2.267   1.13%
MultiFab::Subtract()                             85      1.811      1.822      1.837   0.92%
Castro::enforce_min_density()                    42      1.317      1.401      1.566   0.78%
FabArray::setVal()                             2528      1.509      1.527      1.562   0.78%
Amr::defBaseLevel()                               1      1.208      1.215      1.233   0.61%
Amr::InitAmr()                                    1      1.182      1.182      1.182   0.59%
FabArray::ParallelCopy_nowait()                 585      1.072       1.08      1.094   0.54%
Castro::derive()                                288     0.9736     0.9828     0.9973   0.50%
MultiFab::sum()                                2065     0.9389     0.9461     0.9618   0.48%
Castro::estTimeStep()                            11     0.8452     0.8796     0.9191   0.46%
Gravity::fill_multipole_BCs()                     7      0.786     0.7999     0.8177   0.41%
MLPoisson::Fsmooth()                           1520     0.7222     0.7381     0.7556   0.38%
FabArray::ParallelCopy_finish()                 585     0.2047     0.3416     0.4569   0.23%
MultiFab::min()                                   5   0.003549     0.1931     0.4371   0.22%
Castro::volWgtSum()                              78      0.303     0.3521       0.42   0.21%
MLPoisson::Fapply()                             270     0.3155     0.3234     0.3372   0.17%
FillPatchIterator::Initialize                   357     0.2759     0.2808     0.2863   0.14%
Castro::do_advance_ctu()                          5     0.2553      0.259     0.2688   0.13%
MLCellLinOp::applyBC()                         1796     0.2365      0.249     0.2617   0.13%
StateData::FillBoundary(geom)                    21     0.2452     0.2464     0.2473   0.12%
Castro::construct_new_gravity_source()            5      0.228     0.2306     0.2359   0.12%
MultiFab::Saxpy()                                25     0.2294     0.2305     0.2324   0.12%
Castro::expand_state()                            5     0.2135     0.2163     0.2182   0.11%
Castro::wd_update()                               6     0.1163     0.1691     0.2125   0.11%
Castro::volInBoundary()                          42     0.1671     0.1789     0.2028   0.10%
Castro::problem_post_timestep()                   6     0.0127     0.1182     0.1945   0.10%
VisMF::Write(FabArray)                            2     0.1803     0.1826     0.1876   0.09%
FillBoundary_finish()                          1606    0.07597     0.1333      0.156   0.08%
Castro::construct_old_gravity_source()            5     0.1334     0.1358     0.1397   0.07%
FillBoundary_nowait()                          1606     0.1063     0.1127     0.1316   0.07%
FabArray::setDomainBndry()                      357     0.1091     0.1146     0.1252   0.06%
Amr::writePlotFile()                              2      0.117     0.1222     0.1246   0.06%
MultiFab::contains_nan()                         10     0.1212     0.1222     0.1239   0.06%
MultiFab::Xpay()                                244     0.1164     0.1176      0.119   0.06%
Castro::initData()                                1     0.1097     0.1109     0.1128   0.06%
Castro::initialize_do_advance()                   5     0.1022     0.1029     0.1033   0.05%
Castro::locWgtSum()                              18    0.06589    0.08092    0.09991   0.05%
Gravity::get_new_grav_vector()                    6    0.08652    0.08806    0.08986   0.04%
Gravity::get_old_grav_vector()                    5    0.07549    0.07653    0.07907   0.04%
Castro::fill_hybrid_hydro_source()               15    0.05165    0.05188    0.05217   0.03%
MLMG::addInterpCorrection()                     190    0.04438    0.04524    0.04661   0.02%
amrex::average_down                             190    0.04303    0.04382    0.04516   0.02%
MLMG::oneIter()                                  38    0.03558    0.03589    0.03638   0.02%
Castro::evaluate_source_change()                 95    0.03309    0.03461    0.03594   0.02%
MLMG::ResNormInf()                               44    0.02428    0.02957    0.03366   0.02%
FabArray::mult()                                 24    0.03175    0.03187    0.03202   0.02%
Castro::volProductSum()                           6     0.0249    0.02719    0.02995   0.01%
StateData::define()                               5    0.02751    0.02783    0.02797   0.01%
Castro::swap_state_time_levels()                  5    0.02659    0.02713     0.0274   0.01%
MLCellLinOp::compGrad()                           6    0.02431    0.02494    0.02576   0.01%
Castro::initialize_advance()                      5    0.02062    0.02206    0.02386   0.01%
MultiFab::max()                                  24    0.01214    0.01381    0.01656   0.01%
MLCellLinOp::defineAuxData()                      7     0.0135    0.01427    0.01521   0.01%
MLMG::prepareForSolve()                           6    0.01406    0.01447    0.01507   0.01%
main()                                            1     0.0117    0.01244    0.01313   0.01%
Castro::construct_new_source()                   35    0.01264    0.01279    0.01302   0.01%
Castro::construct_old_source()                   35    0.01137    0.01172     0.0124   0.01%
Castro::finalize_do_advance()                     5    0.01009    0.01098    0.01159   0.01%
BndryData::define()                               7   0.009018   0.009221   0.009486   0.00%
Castro::do_old_sources()                          5  0.0001768   0.002163   0.008039   0.00%
Gravity::actual_solve_with_mlmg()                 7   0.003249   0.004475   0.007801   0.00%
Gravity::update_max_rhs()                         6   0.007233   0.007323   0.007405   0.00%
Castro::construct_new_gravity()                   5   0.006193   0.006447   0.006985   0.00%
StateDataPhysBCFunct::()                        357   0.003175   0.004524     0.0068   0.00%
MLCGSolver::bicgstab                              9          0   0.001686   0.006744   0.00%
Gravity::solve_for_phi()                          5   0.005944   0.006177   0.006715   0.00%
Castro::do_new_sources()                          5   0.000179   0.001625   0.005895   0.00%
MultiFab::Copy()                                  6   0.005538   0.005573    0.00566   0.00%
Castro::linear_to_hybrid_momentum()               1   0.004605   0.005267   0.005497   0.00%
FabArray::setVal(val, thecmd, scomp, ncomp)     294   0.004724   0.004898   0.005277   0.00%
FabArray::FillBoundary()                       1606   0.003871   0.004115   0.004385   0.00%
MLCellLinOp::smooth()                           760    0.00347    0.00367   0.003878   0.00%
MLCellLinOp::prepareForSolve()                    7   0.003386   0.003507   0.003677   0.00%
Castro::enforce_consistent_e()                    1   0.003189   0.003339    0.00365   0.00%
Gravity::test_composite_phi()                     1   0.003243   0.003412   0.003531   0.00%
FabArrayBase::getFB()                          1606   0.002882   0.003016   0.003355   0.00%
MLMG::MLRhsNormInf()                              6   0.003059   0.003071   0.003085   0.00%
FabArrayBase::CPC::define()                     188   0.001589   0.001996   0.003072   0.00%
FabArrayBase::getCPC()                          543   0.002798   0.002885   0.002988   0.00%
MLMG::solve()                                     6  0.0007427   0.001842   0.002919   0.00%
MLCellLinOp::setLevelBC()                         7   0.001971   0.002051   0.002264   0.00%
FabArray::ParallelCopy()                        585   0.001697   0.001748   0.001804   0.00%
MultiFab::LinComb()                              67          0  0.0004111   0.001644   0.00%
FillPatchSingleLevel                            357   0.001247   0.001278   0.001333   0.00%
MultiFab::Dot()                                  52          0  0.0003237   0.001295   0.00%
Gravity::actual_multilevel_solve()                1   0.001175   0.001186   0.001195   0.00%
MLLinOp::makeSubCommunicator()                    7  0.0003085  0.0006838   0.001079   0.00%
MLCellLinOp::apply()                            270  0.0006423  0.0007774   0.001072   0.00%
MLCGSolver::ParallelAllReduce                    78          0  0.0002242   0.000897   0.00%
Gravity::multilevel_solve_for_new_phi()           1  0.0008412  0.0008494  0.0008656   0.00%
MLLinOp::defineGrids()                            7  0.0006425  0.0007263  0.0007704   0.00%
Amr::coarseTimeStep()                             5  0.0005692  0.0006385  0.0007408   0.00%
MLCellLinOp::correctionResidual()               199  0.0005755  0.0006307  0.0007128   0.00%
MLCellLinOp::defineBC()                           7  0.0006152   0.000644  0.0006735   0.00%
FabArrayBase::FB::FB()                           16  0.0004658  0.0005258   0.000666   0.00%
Castro::clean_state()                            42  0.0004954  0.0005425  0.0005812   0.00%
MLMG::mgVcycle()                                 38  0.0005034  0.0005339  0.0005732   0.00%
CGSolver::sxay()                                 67          0  0.0001405   0.000562   0.00%
MLMG:computeResOfCorrection()                   190  0.0004433  0.0004675  0.0005018   0.00%
Castro::subcycle_advance_ctu()                    5  6.199e-05   0.000179  0.0004676   0.00%
MLMG::actualBottomSolve()                        38  4.712e-05   0.000139  0.0004133   0.00%
Castro::finalize_advance()                        5  0.0002698  0.0003402  0.0003868   0.00%
MLMG::mgVcycle_down::0                           38  0.0002831  0.0002902  0.0002946   0.00%
MLMG::mgVcycle_down::1                           38  0.0002583   0.000266  0.0002783   0.00%
MLMG::mgVcycle_down::2                           38  0.0002404  0.0002495  0.0002704   0.00%
MLMG::mgVcycle_down::3                           38  0.0002167  0.0002369  0.0002544   0.00%
MLMG::mgVcycle_down::4                           38  0.0001987  0.0002174  0.0002503   0.00%
MLCellLinOp::solutionResidual()                  45  0.0001856  0.0001932  0.0002122   0.00%
MLMG::mgVcycle_up::0                             38  0.0001923  0.0001947  0.0001993   0.00%
DistributionMapping::LeastUsedCPUs()              1  1.696e-05  0.0001457  0.0001972   0.00%
MLMG::mgVcycle_up::1                             38  0.0001714  0.0001756  0.0001877   0.00%
MLMG::mgVcycle_up::2                             38  0.0001656   0.000171  0.0001806   0.00%
Amr::FinalizeInit()                               1  2.007e-05  6.194e-05  0.0001783   0.00%
MLMG::mgVcycle_up::4                             38  0.0001435  0.0001504  0.0001668   0.00%
MLMG::mgVcycle_up::3                             38  0.0001358  0.0001445  0.0001614   0.00%
Gravity::solve_phi_with_mlmg()                    7  0.0001452   0.000151  0.0001555   0.00%
Amr::timeStep()                                   5  8.592e-05  0.0001076  0.0001508   0.00%
MLLinOp::define()                                 7   0.000126  0.0001362  0.0001445   0.00%
makeSFC                                          21  8.995e-05  0.0001022  0.0001167   0.00%
MLMG::computeResidual()                          38  0.0001099  0.0001121   0.000115   0.00%
Castro::computeNewDt()                            4  2.783e-05  4.949e-05  0.0001115   0.00%
Amr::writeSmallPlotFile()                         1    8.3e-05  0.0001003  0.0001093   0.00%
Castro::enforce_speed_limit()                    42  8.169e-05  8.825e-05  9.706e-05   0.00%
Castro::construct_old_gravity()                   5  8.048e-05  8.775e-05  9.325e-05   0.00%
Castro::post_init()                               1  6.834e-05  7.836e-05  8.655e-05   0.00%
MLMG::mgVcycle_bottom                            38  7.152e-05  7.447e-05  7.973e-05   0.00%
Castro::check_for_nan()                          10  6.327e-05  7.171e-05  7.879e-05   0.00%
MLLinOp::makeAgglomeratedDMap                     7  7.052e-05   7.29e-05  7.703e-05   0.00%
Amr::initSubcycle()                               1  4.088e-05  4.958e-05  6.711e-05   0.00%
MLPoisson::define()                               7  5.219e-05   5.59e-05  6.209e-05   0.00%
Castro::apply_source_to_state()                  10  4.781e-05  5.283e-05  6.023e-05   0.00%
Castro::advance()                                 5  4.663e-05  5.306e-05  5.956e-05   0.00%
AmrLevel::AmrLevel(dm)                            1   3.82e-05  4.568e-05  5.905e-05   0.00%
DistributionMapping::Distribute()                22  4.832e-05  5.099e-05  5.344e-05   0.00%
Gravity::swapTimeLevels()                         5  3.749e-05  4.138e-05  4.436e-05   0.00%
Castro::post_timestep()                           5  3.701e-05  3.906e-05  4.114e-05   0.00%
Castro::create_source_corrector()                 5  2.453e-05  3.066e-05  3.823e-05   0.00%
MLPoisson::prepareForSolve()                      7  3.154e-05  3.294e-05  3.404e-05   0.00%
Castro::FluxRegFineAdd()                          5  1.187e-05  1.743e-05   2.81e-05   0.00%
Castro::construct_new_hybrid_source()             5   2.29e-05  2.501e-05  2.615e-05   0.00%
DistributionMapping::SFCProcessorMapDoIt()        1  1.642e-05  1.839e-05  2.354e-05   0.00%
Gravity::set_mass_offset()                        6  1.666e-05  2.019e-05  2.315e-05   0.00%
Castro::retry_advance_ctu()                       5   1.92e-05  2.102e-05  2.284e-05   0.00%
MLMG::getGradSolution()                           6  2.014e-05  2.093e-05  2.278e-05   0.00%
MLMG::buildFineMask()                             6  1.923e-05  1.977e-05  2.048e-05   0.00%
MLMG::computeMLResidual()                         6  1.547e-05  1.667e-05  1.939e-05   0.00%
Castro::construct_old_hybrid_source()             5   1.69e-05  1.782e-05  1.914e-05   0.00%
Castro::post_regrid()                             1   1.59e-05  1.686e-05   1.79e-05   0.00%
MLMG::MLResNormInf()                              6  1.445e-05  1.488e-05  1.543e-05   0.00%
Castro::construct_new_rotation_source()           5  1.108e-05   1.33e-05  1.534e-05   0.00%
Amr::InitializeInit()                             1  6.148e-06   8.68e-06  1.444e-05   0.00%
Castro::construct_old_rotation_source()           5  1.246e-05  1.336e-05  1.427e-05   0.00%
Castro::computeInitialDt()                        2  1.213e-05  1.243e-05  1.271e-05   0.00%
MLMG::compResidual()                              1  7.922e-06  8.027e-06  8.147e-06   0.00%
Amr::init()                                       1  5.475e-06  6.054e-06  6.467e-06   0.00%
Amr::initialInit()                                1  3.456e-06  3.997e-06  4.377e-06   0.00%
--------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------
Name                                         NCalls  Incl. Min  Incl. Avg  Incl. Max   Max %
--------------------------------------------------------------------------------------------
main()                                            1      200.7      200.7      200.7 100.00%
Amr::coarseTimeStep()                             5      195.4      195.4      195.4  97.35%
Amr::timeStep()                                   5        195        195        195  97.16%
Castro::advance()                                 5      190.9      190.9      190.9  95.11%
Castro::subcycle_advance_ctu()                    5      188.6      188.7      188.7  94.00%
Castro::do_advance_ctu()                          5      188.6      188.7      188.7  94.00%
Castro::react_state()                            10      145.4      145.5      145.6  72.53%
Castro::construct_ctu_hydro_source()              5      22.94      23.17      23.36  11.64%
Castro::clean_state()                            42      18.43      18.64      18.87   9.40%
Castro::computeTemp()                            43      12.05      12.16      12.26   6.11%
Castro::reset_internal_energy()                  43      8.138      8.234       8.35   4.16%
Castro::evaluate_source_change()                 95       4.71      4.734       4.78   2.38%
Castro::enforce_min_density()                    42      4.432      4.541      4.693   2.34%
Castro::post_timestep()                           5      4.115      4.115      4.116   2.05%
Amr::init()                                       1      3.972      3.972      3.972   1.98%
Castro::initialize_do_advance()                   5      3.862      3.912      3.964   1.97%
Amr::initialInit()                                1      3.814      3.814      3.814   1.90%
Gravity::solve_phi_with_mlmg()                    7      2.842      2.856      2.872   1.43%
MultiFab::AddProduct()                         2055      2.776       2.79       2.81   1.40%
Castro::do_new_sources()                          5      2.641      2.675        2.7   1.35%
Castro::problem_post_timestep()                   6      2.533      2.554      2.583   1.29%
Castro::do_old_sources()                          5      2.463      2.488      2.513   1.25%
Castro::construct_new_gravity()                   5      2.381      2.391      2.406   1.20%
Castro::initialize_advance()                      5      2.241      2.265       2.29   1.14%
Castro::normalize_species()                      42       2.24       2.25      2.267   1.13%
Gravity::solve_for_phi()                          5      2.184      2.197      2.213   1.10%
Amr::InitializeInit()                             1      2.144      2.165      2.175   1.08%
Amr::defBaseLevel()                               1      2.144      2.165      2.175   1.08%
FillPatchIterator::Initialize                   357      1.928      2.006      2.079   1.04%
Gravity::actual_solve_with_mlmg()                 7       2.05      2.052      2.055   1.02%
MLMG::solve()                                     6      1.973      1.975      1.976   0.98%
MultiFab::Subtract()                             85      1.811      1.822      1.837   0.92%
FillPatchSingleLevel                            357      1.533       1.61      1.694   0.84%
Amr::FinalizeInit()                               1      1.639      1.649       1.67   0.83%
Castro::derive()                                288      1.604      1.618      1.642   0.82%
MLMG::oneIter()                                  38       1.63      1.634      1.641   0.82%
MLMG::mgVcycle()                                 38      1.595      1.598      1.605   0.80%
FabArray::setVal()                             2528      1.509      1.527      1.562   0.78%
FabArray::ParallelCopy()                        585      1.291      1.426      1.532   0.76%
Amr::InitAmr()                                    1      1.182      1.182      1.182   0.59%
MLCellLinOp::smooth()                           760      1.111      1.133      1.166   0.58%
Castro::post_init()                               1      1.152      1.154      1.157   0.58%
FabArray::ParallelCopy_nowait()                 585      1.074      1.082      1.095   0.55%
Castro::volWgtSum()                              78     0.9463      1.002       1.08   0.54%
Castro::expand_state()                            5       1.01      1.027      1.047   0.52%
MultiFab::sum()                                2065     0.9389     0.9461     0.9618   0.48%
Castro::estTimeStep()                            11     0.8452     0.8796     0.9191   0.46%
Castro::wd_update()                               6     0.8506     0.8711     0.9004   0.45%
Castro::initData()                                1     0.8513     0.8692     0.8913   0.44%
Gravity::fill_multipole_BCs()                     7      0.786     0.7999     0.8177   0.41%
MLPoisson::Fsmooth()                           1520     0.7222     0.7381     0.7556   0.38%
MLMG::mgVcycle_down::0                           38     0.7062     0.7109     0.7159   0.36%
Castro::volInBoundary()                          42      0.585     0.5988     0.6292   0.31%
Gravity::multilevel_solve_for_new_phi()           1     0.5418     0.5419     0.5421   0.27%
Gravity::actual_multilevel_solve()                1      0.541     0.5411     0.5412   0.27%
MLCellLinOp::applyBC()                         1796     0.4769     0.5027     0.5312   0.26%
MLMG::mgVcycle_up::0                             38     0.4836     0.4859     0.4914   0.24%
FabArray::ParallelCopy_finish()                 585     0.2047     0.3416     0.4569   0.23%
MLCellLinOp::apply()                            270     0.4164     0.4302     0.4463   0.22%
MultiFab::min()                                   5   0.003549     0.1931     0.4371   0.22%
Castro::construct_new_source()                   35     0.4134     0.4166     0.4236   0.21%
Castro::post_regrid()                             1     0.4063     0.4091     0.4108   0.20%
MLPoisson::Fapply()                             270     0.3155     0.3234     0.3372   0.17%
Castro::construct_old_gravity()                   5     0.1994     0.2453     0.3283   0.16%
Gravity::get_old_grav_vector()                    5     0.1993     0.2452     0.3282   0.16%
Castro::computeNewDt()                            4      0.305     0.3051     0.3051   0.15%
Amr::writePlotFile()                              2     0.3046     0.3048     0.3048   0.15%
MLCellLinOp::solutionResidual()                  45     0.2673     0.2737     0.2842   0.14%
MLCellLinOp::correctionResidual()               199      0.268      0.274     0.2803   0.14%
MLMG:computeResOfCorrection()                   190     0.2685     0.2739     0.2797   0.14%
FabArray::FillBoundary()                       1606     0.2152     0.2537     0.2708   0.13%
StateDataPhysBCFunct::()                        357     0.2488     0.2509     0.2541   0.13%
StateData::FillBoundary(geom)                    21     0.2452     0.2464     0.2473   0.12%
Castro::construct_old_source()                   35     0.2322     0.2352     0.2407   0.12%
MLMG::computeResidual()                          38     0.2245     0.2293     0.2369   0.12%
Castro::construct_new_gravity_source()            5      0.228     0.2306     0.2359   0.12%
MultiFab::Saxpy()                                25     0.2294     0.2305     0.2324   0.12%
Gravity::get_new_grav_vector()                    6     0.2234     0.2254     0.2307   0.11%
VisMF::Write(FabArray)                            2     0.1803     0.1826     0.1876   0.09%
Castro::computeInitialDt()                        2     0.1536     0.1634     0.1845   0.09%
FillBoundary_finish()                          1606    0.07597     0.1333      0.156   0.08%
Castro::locWgtSum()                              18     0.1067     0.1221      0.142   0.07%
Castro::construct_old_gravity_source()            5     0.1334     0.1358     0.1397   0.07%
FillBoundary_nowait()                          1606     0.1097     0.1163      0.135   0.07%
MLMG::mgVcycle_down::1                           38     0.1254     0.1299     0.1339   0.07%
MLMG::addInterpCorrection()                     190    0.05018     0.1099     0.1317   0.07%
Gravity::test_composite_phi()                     1     0.1284     0.1286     0.1286   0.06%
FabArray::setDomainBndry()                      357     0.1091     0.1146     0.1252   0.06%
Castro::check_for_nan()                          10     0.1213     0.1223      0.124   0.06%
MultiFab::contains_nan()                         10     0.1212     0.1222     0.1239   0.06%
MultiFab::Xpay()                                244     0.1164     0.1176      0.119   0.06%
MLMG::mgVcycle_up::2                             38    0.03372    0.09559     0.1181   0.06%
Castro::apply_source_to_state()                  10    0.09193    0.09268    0.09374   0.05%
MLMG::mgVcycle_up::1                             38     0.0866    0.08698    0.08789   0.04%
Castro::volProductSum()                           6    0.05206    0.05441    0.05716   0.03%
Castro::fill_hybrid_hydro_source()               15    0.05165    0.05188    0.05217   0.03%
amrex::average_down                             190    0.04516    0.04661    0.04986   0.02%
MLMG::mgVcycle_down::2                           38    0.04406      0.045    0.04675   0.02%
MLMG::computeMLResidual()                         6     0.0363    0.03835     0.0409   0.02%
MLMG::prepareForSolve()                           6    0.03794    0.03886    0.03993   0.02%
MLMG::mgVcycle_down::3                           38   0.006032    0.01381    0.03567   0.02%
MLPoisson::define()                               7    0.03278    0.03371    0.03504   0.02%
Castro::construct_new_hybrid_source()             5    0.03442     0.0345    0.03465   0.02%
MLMG::ResNormInf()                               44    0.02428    0.02957    0.03366   0.02%
FabArray::mult()                                 24    0.03175    0.03187    0.03202   0.02%
MLMG::getGradSolution()                           6    0.02984    0.03062    0.03186   0.02%
MLCellLinOp::compGrad()                           6    0.02982     0.0306    0.03183   0.02%
AmrLevel::AmrLevel(dm)                            1    0.02757    0.02788    0.02801   0.01%
StateData::define()                               5    0.02751    0.02783    0.02797   0.01%
Castro::swap_state_time_levels()                  5    0.02659    0.02713     0.0274   0.01%
MLMG::mgVcycle_up::3                             38   0.004502   0.009959    0.02526   0.01%
MLCellLinOp::defineAuxData()                      7    0.01709     0.0182    0.01935   0.01%
MLMG::mgVcycle_bottom                            38  0.0001186   0.004695    0.01842   0.01%
MLMG::actualBottomSolve()                        38  4.712e-05    0.00462    0.01834   0.01%
Gravity::update_max_rhs()                         6    0.01337    0.01508    0.01788   0.01%
MLCGSolver::bicgstab                              9          0   0.004402    0.01761   0.01%
Castro::construct_old_hybrid_source()             5    0.01725    0.01742    0.01756   0.01%
MultiFab::max()                                  24    0.01214    0.01381    0.01656   0.01%
MLCellLinOp::defineBC()                           7    0.01348    0.01368    0.01408   0.01%
MLMG::mgVcycle_down::4                           38   0.005775   0.008095    0.01361   0.01%
BndryData::define()                               7     0.0128    0.01304    0.01347   0.01%
Castro::finalize_do_advance()                     5    0.01009    0.01098    0.01159   0.01%
MLMG::mgVcycle_up::4                             38   0.004521   0.006266    0.01049   0.01%
Gravity::swapTimeLevels()                         5   0.009632   0.009763   0.009896   0.00%
MLMG::compResidual()                              1   0.006435   0.006693   0.007052   0.00%
FabArrayBase::getCPC()                          543   0.004452   0.004882   0.006059   0.00%
MultiFab::Copy()                                  6   0.005538   0.005573    0.00566   0.00%
Castro::linear_to_hybrid_momentum()               1   0.004605   0.005267   0.005497   0.00%
FabArray::setVal(val, thecmd, scomp, ncomp)     294   0.004724   0.004898   0.005277   0.00%
FabArrayBase::getFB()                          1606   0.003369   0.003542   0.004021   0.00%
MLPoisson::prepareForSolve()                      7   0.003419    0.00354   0.003709   0.00%
MLCellLinOp::prepareForSolve()                    7   0.003386   0.003507   0.003677   0.00%
Castro::enforce_consistent_e()                    1   0.003189   0.003339    0.00365   0.00%
MLMG::MLResNormInf()                              6   0.003077   0.003086   0.003106   0.00%
MLMG::MLRhsNormInf()                              6   0.003059   0.003071   0.003085   0.00%
FabArrayBase::CPC::define()                     188   0.001589   0.001996   0.003072   0.00%
MLCellLinOp::setLevelBC()                         7   0.001971   0.002051   0.002264   0.00%
MLLinOp::define()                                 7   0.001281   0.001767   0.002225   0.00%
CGSolver::sxay()                                 67          0  0.0005516   0.002206   0.00%
MLLinOp::defineGrids()                            7   0.001155   0.001631    0.00208   0.00%
MLCGSolver::ParallelAllReduce                    78          0  0.0004336   0.001735   0.00%
MultiFab::LinComb()                              67          0  0.0004111   0.001644   0.00%
MultiFab::Dot()                                  52          0  0.0003237   0.001295   0.00%
MLLinOp::makeSubCommunicator()                    7  0.0003085  0.0006838   0.001079   0.00%
FabArrayBase::FB::FB()                           16  0.0004658  0.0005258   0.000666   0.00%
Castro::finalize_advance()                        5  0.0002979  0.0003576  0.0003995   0.00%
MLLinOp::makeAgglomeratedDMap                     7  0.0002039  0.0002209  0.0002388   0.00%
DistributionMapping::SFCProcessorMapDoIt()        1  3.945e-05  0.0001693   0.000226   0.00%
DistributionMapping::LeastUsedCPUs()              1  1.696e-05  0.0001457  0.0001972   0.00%
makeSFC                                          21   0.000133  0.0001481  0.0001618   0.00%
Amr::writeSmallPlotFile()                         1    8.3e-05  0.0001003  0.0001093   0.00%
Castro::enforce_speed_limit()                    42  8.169e-05  8.825e-05  9.706e-05   0.00%
Amr::initSubcycle()                               1  4.088e-05  4.958e-05  6.711e-05   0.00%
DistributionMapping::Distribute()                22  4.832e-05  5.099e-05  5.344e-05   0.00%
Castro::create_source_corrector()                 5  2.453e-05  3.066e-05  3.823e-05   0.00%
Castro::FluxRegFineAdd()                          5  1.187e-05  1.743e-05   2.81e-05   0.00%
Gravity::set_mass_offset()                        6  1.666e-05  2.019e-05  2.315e-05   0.00%
Castro::retry_advance_ctu()                       5   1.92e-05  2.102e-05  2.284e-05   0.00%
MLMG::buildFineMask()                             6  1.923e-05  1.977e-05  2.048e-05   0.00%
Castro::construct_new_rotation_source()           5  1.108e-05   1.33e-05  1.534e-05   0.00%
Castro::construct_old_rotation_source()           5  1.246e-05  1.336e-05  1.427e-05   0.00%
--------------------------------------------------------------------------------------------

Unused ParmParse Variables:
  [TOP]::castro.center(nvals = 3)  :: [0.0e0, 0.0e0, 0.0e0]
  [TOP]::mg.v(nvals = 1)  :: [2]

AMReX (22.02-14-gaa0dc39f50f7) finalized