MPI initialized with 4 MPI processes
MPI initialized with thread support level 3
OMP initialized with 4 OMP threads
AMReX (22.01-22-ge34f5c67fec9) initialized

Starting run at 08:01:58 UTC on 2022-01-13.
Successfully read inputs file ... 

Castro git describe: 21.12-23-g727e39bb6
AMReX git describe: 22.01-22-ge34f5c67f
Microphysics git describe: 22.01-14-geeef682d

reading extern runtime parameters ...
13 Species: 
He4  C12  O16  Ne20  Mg24  Si28  S32  Ar36  Ca40  Ti44  Cr48  Fe52  Ni56  
Successfully read inputs file ... 

Generated initial model for primary WD of mass 0.9 solar masses, central density 1.859e+07 g cm**-3, and radius 6.378e+08 cm.

Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.859e+07 g cm**-3, and radius 6.378e+08 cm.

Castro::numpts_1d at level  0 is 118
Setting the gravity type to PoissonGrav
Warning: the following castro.* parameters are ignored
castro.center = 0.0e0 0.0e0 0.0e0

Initializing the data at level 0
Done initializing the level 0 data 
...estimated hydro-limited timestep at level 0: 0.1183193811
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1183193811

Gravity::fill_multipole_BCs() time = 0.1211283207

Gravity::fill_multipole_BCs() time = 0.1249790192

      ... norm of composite residual at level 0  1.086122716e-10

INITIAL GRIDS 
  Level 0   8 grids  262144 cells  100 % of domain
            smallest grid: 32 x 32 x 32  biggest grid: 32 x 32 x 32

PLOTFILE: file = wdmerger_collision_plt00000
Write plotfile time = 0.166342232  seconds

...estimated hydro-limited timestep at level 0: 0.1183193811
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1183193811

[Level 0 step 1] ADVANCE with dt = 0.01183193811

  Beginning subcycle 1 starting at time 0 with dt = 0.01183193811
  Estimated number of subcycles remaining: 1

... Entering burner and doing half-timestep of burning.

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 20.46647167


  Contributions to the state from old-time sources:
       mass added: 0
       xmom added: 8.412760702e+23
       ymom added: -1.813388729e+24
       zmom added: -2.417851639e+24
       eint added: 0
       ener added: 9.696440457e+47

Castro::do_old_sources() time = 0.5330061913

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 5.00112772


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.587434011e+48
       ener added: 2.224041905e+42

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.1209454536

Gravity::solve_for_phi() time = 0.4816429615


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -3.463982899e+48
       ener added: 2.77590766e+47


  Contributions to the state from new-time sources:
       mass added: 0
       xmom added: 9.27301951e+25
       ymom added: -3.199365513e+27
       zmom added: -3.199422182e+27
       eint added: 0
       ener added: -3.749966023e+48

Castro::do_new_sources() time = 0.5573141575

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -180436.6878

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 10.19798779

...estimated hydro-limited timestep at level 0: 0.1187673968
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1187673968

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 0.006505039846

[Level 0 step 1] Advanced 262144 cells

  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.503238554e+32
       ener added: 1.504580731e+32


[STEP 1] Coarse TimeStep time: 41.19801444
[STEP 1] FAB kilobyte spread across MPI nodes: [360839 ... 360839]

STEP = 1 TIME = 0.01183193811 DT = 0.01183193811

...estimated hydro-limited timestep at level 0: 0.1187673968
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1187673968

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.1187673968
 ... but limiting to: 0.01301513192 = 1.1 * 0.01183193811
[Level 0 step 2] ADVANCE with dt = 0.01301513192

  Beginning subcycle 1 starting at time 0.01183193811 with dt = 0.01301513192
  Estimated number of subcycles remaining: 1

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -180436.6878

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 19.84684491


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.717986918e+32
       ener added: 1.717986918e+32


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -8.528040118e+46
       ener added: 2.57500084e+46


  Contributions to the state from old-time sources:
       mass added: 0
       xmom added: 2.058158274e+26
       ymom added: -7.049246454e+27
       zmom added: -7.039575048e+27
       eint added: 0
       ener added: 1.095492714e+48

Castro::do_old_sources() time = 0.5183455944

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 4.974349976


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.472619958e+48
       ener added: 2.4978038e+42

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.1275987625

Gravity::solve_for_phi() time = 0.4873833656


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -3.294189959e+48
       ener added: 4.358493059e+47


  Contributions to the state from new-time sources:
       mass added: 0
       xmom added: 1.074062154e+27
       ymom added: -1.273811135e+26
       zmom added: -1.276361213e+26
       eint added: 0
       ener added: -3.730880972e+48

Castro::do_new_sources() time = 0.5596449375

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -116400681.3

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 10.12107778


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 9.620726743e+32
       ener added: 4.125852959e+32

...estimated hydro-limited timestep at level 0: 0.1191998721
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1191998721

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 0.006641442305

[Level 0 step 2] Advanced 262144 cells

  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.791728742e+32
       ener added: 2.791728742e+32


[STEP 2] Coarse TimeStep time: 40.36931784
[STEP 2] FAB kilobyte spread across MPI nodes: [360839 ... 360839]

STEP = 2 TIME = 0.02484707003 DT = 0.01301513192

...estimated hydro-limited timestep at level 0: 0.1191998721
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1191998721

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.1191998721
 ... but limiting to: 0.01431664511 = 1.1 * 0.01301513192
[Level 0 step 3] ADVANCE with dt = 0.01431664511

  Beginning subcycle 1 starting at time 0.02484707003 with dt = 0.01431664511
  Estimated number of subcycles remaining: 1

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -119057519.9

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 20.17255878


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 6.95784702e+32
       ener added: 1.375060623e+32


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -9.472798808e+46
       ener added: 3.636738012e+46


  Contributions to the state from old-time sources:
       mass added: 0
       xmom added: 2.589419963e+27
       ymom added: -8.020013887e+27
       zmom added: -8.009133555e+27
       eint added: 0
       ener added: 1.237119322e+48

Castro::do_old_sources() time = 0.5283353329

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 5.021528721


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.671439312e+48
       ener added: 4.491729511e+43

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.1258912086

Gravity::solve_for_phi() time = 0.4862995148


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -3.376081968e+48
       ener added: 5.405023381e+47


  Contributions to the state from new-time sources:
       mass added: 0
       xmom added: -1.23688571e+28
       ymom added: -1.444576629e+27
       zmom added: -1.444194118e+27
       eint added: 0
       ener added: -3.916780534e+48

Castro::do_new_sources() time = 0.5573608875

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -41047694.1

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 10.12777758


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.239634936e+34
       ener added: 1.236950581e+34

...estimated hydro-limited timestep at level 0: 0.1195774766
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1195774766

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 0.006565265768

[Level 0 step 3] Advanced 262144 cells

  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.649994822e+33
       ener added: 2.649994822e+33


[STEP 3] Coarse TimeStep time: 40.82018423
[STEP 3] FAB kilobyte spread across MPI nodes: [360839 ... 360839]

STEP = 3 TIME = 0.03916371514 DT = 0.01431664511

...estimated hydro-limited timestep at level 0: 0.1195774766
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1195774766

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.1195774766
 ... but limiting to: 0.01574830962 = 1.1 * 0.01431664511
[Level 0 step 4] ADVANCE with dt = 0.01574830962

  Beginning subcycle 1 starting at time 0.03916371514 with dt = 0.01574830962
  Estimated number of subcycles remaining: 1

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -44572126.43

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 19.87629128


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -9.258482253e+46
       ener added: 6.200079096e+46


  Contributions to the state from old-time sources:
       mass added: 0
       xmom added: -2.436278008e+28
       ymom added: -1.200644678e+28
       zmom added: -1.200826017e+28
       eint added: 0
       ener added: 1.400056178e+48

Castro::do_old_sources() time = 0.5243396759

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 4.994502306


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.472992192e+48
       ener added: 1.571693109e+44

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.1245009899

Gravity::solve_for_phi() time = 0.4858002663


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -3.017160183e+48
       ener added: 6.098309871e+47


  Contributions to the state from new-time sources:
       mass added: 0
       xmom added: -2.46070151e+28
       ymom added: 1.00282144e+28
       zmom added: 1.00285308e+28
       eint added: 0
       ener added: -3.626218303e+48

Castro::do_new_sources() time = 0.5611565113

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -2209720963

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 10.1253171


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.195208868e+34
       ener added: 1.080184275e+34

...estimated hydro-limited timestep at level 0: 0.1199311549
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1199311549

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 0.006631617003

[Level 0 step 4] Advanced 262144 cells

  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.799591297e+33
       ener added: 1.799591297e+33


[STEP 4] Coarse TimeStep time: 40.42327859
[STEP 4] FAB kilobyte spread across MPI nodes: [360839 ... 360839]

STEP = 4 TIME = 0.05491202477 DT = 0.01574830962

...estimated hydro-limited timestep at level 0: 0.1199311549
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1199311549

Castro::compute_new_dt : limiting dt at level 0
 ... new dt computed: 0.1199311549
 ... but limiting to: 0.01732314059 = 1.1 * 0.01574830962
[Level 0 step 5] ADVANCE with dt = 0.01732314059

  Beginning subcycle 1 starting at time 0.05491202477 with dt = 0.01732314059
  Estimated number of subcycles remaining: 1

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -3240886078

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 19.8750217


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 5.757940531e+32
       ener added: 6.871947674e+31


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -8.651576893e+46
       ener added: 9.619804695e+46


  Contributions to the state from old-time sources:
       mass added: 0
       xmom added: -8.093281499e+28
       ymom added: 8.85779948e+27
       zmom added: 8.861426258e+27
       eint added: 0
       ener added: 1.577631435e+48

Castro::do_old_sources() time = 0.5214662552

... Entering construct_ctu_hydro_source()

... Leaving construct_ctu_hydro_source()

Castro::construct_ctu_hydro_source() time = 4.99919343


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 2.383201862e+48
       ener added: 2.84444145e+44

... new-time level Poisson gravity solve at level 0

Gravity::fill_multipole_BCs() time = 0.1260051727

Gravity::solve_for_phi() time = 0.4876577854


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -3.030904275e+48
       ener added: 6.430291322e+47


  Contributions to the state from new-time sources:
       mass added: 0
       xmom added: -4.331311807e+28
       ymom added: 6.875198915e+26
       zmom added: 6.876521178e+26
       eint added: 0
       ener added: -3.672295669e+48

Castro::do_new_sources() time = 0.561068058

... Entering burner and doing half-timestep of burning.

... (rho e) added from burning: -4937559697

... Leaving burner after completing half-timestep of burning.

Castro::react_state() time = 10.1207912


  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: -7.983270459e+32
       ener added: 4.020357825e+33

...estimated hydro-limited timestep at level 0: 0.1202590217
Castro::estTimeStep (hydro-limited) at level 0:  estdt = 0.1202590217

  Subcycle completed

  Subcycling complete

  Zones advanced per microsecond at this level: 0.006630620521

[Level 0 step 5] Advanced 262144 cells

  Contributions to the state from negative energy resets:
       mass added: 0
       xmom added: 0
       ymom added: 0
       zmom added: 0
       eint added: 1.275605287e+33
       ener added: 1.277752771e+33


[STEP 5] Coarse TimeStep time: 40.43249549
[STEP 5] FAB kilobyte spread across MPI nodes: [360839 ... 360839]

STEP = 5 TIME = 0.07223516535 DT = 0.01732314059

PLOTFILE: file = wdmerger_collision_plt00005
Write plotfile time = 0.153214572  seconds


Ending run at 08:05:27 UTC on 2022-01-13.
Run time = 209.0458798
Run time without initialization = 203.4078166

  Average number of zones advanced per microsecond: 0.006
  Average number of zones advanced per microsecond per rank: 0.002



TinyProfiler total time across processes [min...avg...max]: 209 ... 209 ... 209

--------------------------------------------------------------------------------------------
Name                                         NCalls  Excl. Min  Excl. Avg  Excl. Max   Max %
--------------------------------------------------------------------------------------------
Castro::react_state()                            10   150.8272   150.8803   150.9188  72.19%
Castro::construct_ctu_hydro_source()              5       24.8      24.88      24.98  11.95%
Castro::reset_internal_energy()                  43      5.058      5.096      5.155   2.47%
Castro::computeTemp()                            43      3.955      3.969      3.982   1.90%
MultiFab::AddProduct()                         2055      2.881        2.9      2.912   1.39%
Castro::normalize_species()                      42      2.366      2.387      2.416   1.16%
MultiFab::Subtract()                             85       1.87      1.881      1.896   0.91%
FabArray::setVal()                             2524      1.646      1.663      1.673   0.80%
Castro::enforce_min_density()                    42      1.307      1.348      1.433   0.69%
Amr::InitAmr()                                    1      1.348      1.348      1.349   0.65%
Amr::defBaseLevel()                               1      1.256      1.257      1.258   0.60%
FabArray::ParallelCopy_nowait()                 585      1.146      1.156      1.162   0.56%
MultiFab::sum()                                2065      1.034      1.035      1.036   0.50%
Castro::derive()                                288      1.008      1.012      1.016   0.49%
Castro::estTimeStep()                            11      0.849     0.8734     0.8845   0.42%
Gravity::fill_multipole_BCs()                     7     0.8275     0.8556     0.8697   0.42%
MLPoisson::Fsmooth()                           1520     0.8225     0.8433     0.8593   0.41%
FabArray::ParallelCopy_finish()                 585     0.2203     0.3591     0.4434   0.21%
MLPoisson::Fapply()                             270     0.3526     0.3631     0.3797   0.18%
Castro::volWgtSum()                              78     0.3543     0.3621     0.3783   0.18%
MLCellLinOp::applyBC()                         1796     0.2696       0.28     0.2994   0.14%
FillPatchIterator::Initialize                   357      0.274     0.2768     0.2821   0.13%
Castro::do_advance_ctu()                          5     0.2642     0.2693     0.2755   0.13%
StateData::FillBoundary(geom)                    21     0.2659     0.2668     0.2682   0.13%
Castro::construct_new_gravity_source()            5     0.2534     0.2566     0.2594   0.12%
MultiFab::Saxpy()                                25     0.2329     0.2358      0.237   0.11%
Castro::expand_state()                            5     0.2246     0.2267     0.2289   0.11%
MultiFab::min()                                   5   0.003163     0.1188     0.2042   0.10%
VisMF::Write(FabArray)                            2      0.192     0.1953     0.1993   0.10%
Castro::volInBoundary()                          42     0.1699     0.1816     0.1929   0.09%
Castro::wd_update()                               6      0.131     0.1539     0.1678   0.08%
Castro::construct_old_gravity_source()            5     0.1538     0.1556     0.1577   0.08%
FabArray::setDomainBndry()                      357     0.1209      0.126     0.1348   0.06%
FillBoundary_nowait()                          1606     0.1245     0.1266     0.1292   0.06%
Amr::writePlotFile()                              2     0.1206     0.1248     0.1282   0.06%
MultiFab::Xpay()                                244     0.1241     0.1257     0.1282   0.06%
MultiFab::contains_nan()                         10     0.1248     0.1252      0.126   0.06%
Castro::initData()                                1     0.1217     0.1231     0.1254   0.06%
FillBoundary_finish()                          1606     0.1007     0.1122     0.1232   0.06%
Castro::initialize_do_advance()                   5    0.06806    0.07739     0.1026   0.05%
Gravity::get_new_grav_vector()                    6    0.09029    0.09119    0.09212   0.04%
Castro::locWgtSum()                              18    0.08375    0.08559    0.08953   0.04%
Gravity::get_old_grav_vector()                    5    0.07661    0.07903     0.0804   0.04%
Castro::problem_post_timestep()                   6    0.02981    0.04973    0.05983   0.03%
Castro::fill_hybrid_hydro_source()               15    0.05408    0.05485    0.05684   0.03%
Castro::evaluate_source_change()                 95    0.04998    0.05057    0.05164   0.02%
MLMG::addInterpCorrection()                     190    0.04899    0.04966    0.05094   0.02%
amrex::average_down                             190    0.04611    0.04675    0.04788   0.02%
MLMG::ResNormInf()                               44    0.02797    0.03425    0.03827   0.02%
MLMG::oneIter()                                  38    0.03695    0.03709    0.03716   0.02%
MultiFab::max()                                  24    0.01326    0.02436    0.03662   0.02%
FabArray::mult()                                 24    0.03367     0.0342    0.03491   0.02%
MLCellLinOp::compGrad()                           6    0.02785    0.02901    0.03178   0.02%
Castro::volProductSum()                           6    0.02411     0.0267    0.02852   0.01%
StateData::define()                               5    0.02814    0.02818    0.02822   0.01%
Castro::swap_state_time_levels()                  5    0.02664    0.02671    0.02681   0.01%
Castro::initialize_advance()                      5    0.02019    0.02236    0.02462   0.01%
FabArray::FillBoundary()                       1606     0.0177    0.01816    0.01912   0.01%
StateDataPhysBCFunct::()                        357   0.005496   0.009461    0.01705   0.01%
MLMG::prepareForSolve()                           6    0.01286    0.01397    0.01694   0.01%
MLCellLinOp::defineAuxData()                      7    0.01508    0.01574    0.01652   0.01%
Castro::construct_new_source()                   35    0.01285    0.01541    0.01632   0.01%
MLCellLinOp::smooth()                           760    0.01452     0.0147     0.0148   0.01%
Castro::construct_old_source()                   35    0.01155    0.01357    0.01435   0.01%
main()                                            1   0.006659   0.007886    0.01144   0.01%
BndryData::define()                               7   0.009602   0.009736   0.009948   0.00%
Castro::linear_to_hybrid_momentum()               1   0.005128   0.006478   0.009588   0.00%
MLCGSolver::bicgstab                              9          0    0.00234   0.009362   0.00%
Castro::finalize_do_advance()                     5   0.002297   0.004673   0.008775   0.00%
FabArrayBase::getFB()                          1606    0.00693   0.007169    0.00779   0.00%
Gravity::update_max_rhs()                         6   0.007315   0.007418   0.007515   0.00%
Gravity::solve_for_phi()                          5   0.006094   0.006487   0.007035   0.00%
Castro::do_old_sources()                          5  0.0003655   0.002049   0.007018   0.00%
Castro::construct_new_gravity()                   5   0.006505   0.006676   0.006804   0.00%
FabArray::ParallelCopy()                        585   0.006613   0.006662   0.006703   0.00%
FabArray::setVal(val, thecmd, scomp, ncomp)     294   0.005687   0.005834   0.005909   0.00%
MultiFab::Copy()                                  6   0.005739   0.005763   0.005788   0.00%
Gravity::test_composite_phi()                     1   0.004081   0.004493   0.005238   0.00%
FabArrayBase::getCPC()                          543   0.004636   0.004731   0.004869   0.00%
Castro::do_new_sources()                          5   0.000368   0.001504   0.004865   0.00%
FillPatchSingleLevel                            357   0.004246   0.004272    0.00432   0.00%
Castro::enforce_consistent_e()                    1    0.00349    0.00394   0.004209   0.00%
MLCellLinOp::apply()                            270   0.002679   0.003065   0.004197   0.00%
MLCellLinOp::prepareForSolve()                    7   0.003676   0.003805   0.004022   0.00%
Gravity::actual_solve_with_mlmg()                 7   0.003433   0.003563   0.003889   0.00%
FabArrayBase::CPC::define()                     188   0.002041   0.002414   0.003432   0.00%
MLMG::MLRhsNormInf()                              6   0.003129   0.003163   0.003217   0.00%
MLCellLinOp::correctionResidual()               199   0.002204   0.002324   0.002651   0.00%
MLMG::solve()                                     6  0.0009312   0.002022   0.002566   0.00%
MultiFab::LinComb()                              67          0  0.0006136   0.002455   0.00%
MLCellLinOp::setLevelBC()                         7   0.002214   0.002353   0.002452   0.00%
MLCGSolver::ParallelAllReduce                    78          0  0.0005258   0.002103   0.00%
CGSolver::sxay()                                 67          0  0.0005087   0.002035   0.00%
MLMG::mgVcycle()                                 38   0.001833   0.001863   0.001885   0.00%
MultiFab::Dot()                                  52          0  0.0004644   0.001857   0.00%
MLMG:computeResOfCorrection()                   190   0.001475   0.001501   0.001521   0.00%
Gravity::actual_multilevel_solve()                1   0.001235    0.00131   0.001497   0.00%
Castro::clean_state()                            42   0.001142   0.001169    0.00119   0.00%
MLLinOp::makeSubCommunicator()                    7  0.0001433   0.000786    0.00108   0.00%
Gravity::multilevel_solve_for_new_phi()           1  0.0009713  0.0009979   0.001049   0.00%
MLMG::mgVcycle_down::0                           38  0.0009599  0.0009753  0.0009902   0.00%
MLMG::actualBottomSolve()                        38  0.0001405  0.0003426  0.0009349   0.00%
MLMG::mgVcycle_down::1                           38  0.0009188  0.0009234  0.0009292   0.00%
MLMG::mgVcycle_down::2                           38  0.0008914  0.0009058   0.000923   0.00%
MLMG::mgVcycle_down::3                           38  0.0008585  0.0008735  0.0008855   0.00%
MLMG::mgVcycle_down::4                           38  0.0008464  0.0008576  0.0008638   0.00%
MLLinOp::defineGrids()                            7  0.0007784  0.0008147  0.0008459   0.00%
FabArrayBase::FB::FB()                           16  0.0005103  0.0005902  0.0007675   0.00%
MLCellLinOp::defineBC()                           7  0.0006596  0.0006854  0.0007273   0.00%
Amr::coarseTimeStep()                             5  0.0003421  0.0004853  0.0006682   0.00%
MLMG::mgVcycle_up::0                             38  0.0006065  0.0006141   0.000624   0.00%
MLMG::mgVcycle_up::2                             38  0.0005822  0.0006009  0.0006217   0.00%
MLMG::mgVcycle_up::1                             38  0.0005834  0.0005961  0.0006165   0.00%
MLCellLinOp::solutionResidual()                  45  0.0005511  0.0005677  0.0005914   0.00%
MLMG::mgVcycle_up::4                             38  0.0005618   0.000576  0.0005914   0.00%
MLMG::mgVcycle_up::3                             38  0.0005607  0.0005729   0.000585   0.00%
Castro::subcycle_advance_ctu()                    5  0.0001036  0.0002255  0.0005383   0.00%
MLMG::computeResidual()                          38  0.0003141  0.0003221   0.000331   0.00%
Castro::finalize_advance()                        5  0.0002415  0.0002635  0.0002973   0.00%
MLMG::mgVcycle_bottom                            38  0.0002725  0.0002849  0.0002908   0.00%
Gravity::solve_phi_with_mlmg()                    7  0.0002163  0.0002304  0.0002533   0.00%
makeSFC                                          21   0.000201  0.0002137  0.0002246   0.00%
Castro::enforce_speed_limit()                    42  0.0002015  0.0002089  0.0002218   0.00%
Amr::FinalizeInit()                               1  3.158e-05  7.863e-05   0.000216   0.00%
MLLinOp::define()                                 7  0.0001535  0.0001696  0.0001905   0.00%
Amr::timeStep()                                   5  0.0001414  0.0001478  0.0001658   0.00%
Castro::post_init()                               1  9.896e-05  0.0001153  0.0001504   0.00%
MLPoisson::define()                               7  0.0001268  0.0001354   0.000148   0.00%
Castro::advance()                                 5  0.0001149  0.0001278  0.0001477   0.00%
MLLinOp::makeAgglomeratedDMap                     7  0.0001332  0.0001408  0.0001452   0.00%
Castro::construct_old_gravity()                   5  0.0001098  0.0001214  0.0001415   0.00%
Castro::computeNewDt()                            4  5.042e-05  7.747e-05  0.0001382   0.00%
Castro::check_for_nan()                          10  0.0001151  0.0001235  0.0001297   0.00%
Amr::writeSmallPlotFile()                         1  9.621e-05  0.0001035  0.0001184   0.00%
DistributionMapping::Distribute()                22  0.0001035  0.0001077  0.0001112   0.00%
Castro::apply_source_to_state()                  10  0.0001011  0.0001046  0.0001088   0.00%
Gravity::swapTimeLevels()                         5  9.796e-05  9.904e-05     0.0001   0.00%
Castro::post_timestep()                           5  7.821e-05  8.265e-05  9.216e-05   0.00%
Castro::create_source_corrector()                 5  4.358e-05   5.92e-05  8.917e-05   0.00%
Castro::construct_new_hybrid_source()             5  7.879e-05  7.974e-05  8.167e-05   0.00%
DistributionMapping::LeastUsedCPUs()              1  1.717e-05  6.426e-05  7.996e-05   0.00%
AmrLevel::AmrLevel(dm)                            1  6.504e-05   6.89e-05  7.762e-05   0.00%
MLPoisson::prepareForSolve()                      7  7.092e-05  7.245e-05  7.429e-05   0.00%
MLMG::getGradSolution()                           6  5.642e-05  5.948e-05  6.237e-05   0.00%
Castro::construct_old_hybrid_source()             5  5.754e-05  5.827e-05  5.937e-05   0.00%
Amr::initSubcycle()                               1  4.633e-05  5.087e-05  5.238e-05   0.00%
MLMG::computeMLResidual()                         6  4.875e-05  4.953e-05  5.017e-05   0.00%
DistributionMapping::SFCProcessorMapDoIt()        1  2.517e-05  4.077e-05  4.708e-05   0.00%
MLMG::MLResNormInf()                              6  4.467e-05  4.578e-05  4.667e-05   0.00%
Castro::FluxRegFineAdd()                          5  2.492e-05  3.091e-05  4.354e-05   0.00%
Castro::construct_old_rotation_source()           5  3.917e-05  4.055e-05  4.267e-05   0.00%
Castro::construct_new_rotation_source()           5  3.842e-05  4.044e-05  4.167e-05   0.00%
Gravity::set_mass_offset()                        6  3.471e-05  3.659e-05  3.813e-05   0.00%
Castro::retry_advance_ctu()                       5  2.738e-05  3.057e-05  3.758e-05   0.00%
MLMG::buildFineMask()                             6  3.242e-05  3.302e-05  3.408e-05   0.00%
Amr::InitializeInit()                             1  1.471e-05  1.965e-05  2.929e-05   0.00%
Castro::computeInitialDt()                        2    2.4e-05  2.451e-05  2.517e-05   0.00%
Castro::post_regrid()                             1    2.3e-05  2.315e-05  2.342e-05   0.00%
Amr::init()                                       1  1.533e-05  1.581e-05  1.692e-05   0.00%
MLMG::compResidual()                              1  1.608e-05   1.64e-05  1.675e-05   0.00%
Amr::initialInit()                                1  1.487e-05  1.528e-05  1.567e-05   0.00%
--------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------------------
Name                                         NCalls  Incl. Min  Incl. Avg  Incl. Max   Max %
--------------------------------------------------------------------------------------------
main()                                            1        209        209        209 100.00%
Amr::coarseTimeStep()                             5      203.2      203.2      203.2  97.22%
Amr::timeStep()                                   5      202.9      202.9      202.9  97.04%
Castro::advance()                                 5      198.8      198.8      198.8  95.08%
Castro::subcycle_advance_ctu()                    5      196.4      196.4      196.4  93.95%
Castro::do_advance_ctu()                          5      196.4      196.4      196.4  93.95%
Castro::react_state()                            10      150.8      150.9      150.9  72.20%
Castro::construct_ctu_hydro_source()              5       24.8      24.88      24.98  11.95%
Castro::clean_state()                            42      19.03      19.16      19.31   9.24%
Castro::computeTemp()                            43      12.39      12.45      12.52   5.99%
Castro::reset_internal_energy()                  43      8.433      8.481      8.541   4.09%
Castro::evaluate_source_change()                 95      5.023      5.043      5.054   2.42%
Castro::enforce_min_density()                    42      4.586       4.64      4.725   2.26%
Amr::init()                                       1      4.289      4.289      4.289   2.05%
Amr::initialInit()                                1      4.122      4.122      4.123   1.97%
Castro::post_timestep()                           5      4.092      4.096      4.099   1.96%
Castro::initialize_do_advance()                   5      4.045      4.065      4.098   1.96%
Gravity::solve_phi_with_mlmg()                    7       3.15      3.179      3.193   1.53%
MultiFab::AddProduct()                         2055      2.881        2.9      2.912   1.39%
Castro::do_new_sources()                          5      2.786      2.791      2.796   1.34%
Castro::construct_new_gravity()                   5      2.587      2.617       2.63   1.26%
Castro::do_old_sources()                          5      2.585      2.606      2.623   1.25%
Castro::problem_post_timestep()                   6      2.523      2.544      2.556   1.22%
Gravity::solve_for_phi()                          5      2.386      2.415      2.428   1.16%
Castro::normalize_species()                      42      2.366      2.387      2.416   1.16%
Castro::initialize_advance()                      5      2.359      2.372      2.386   1.14%
Gravity::actual_solve_with_mlmg()                 7      2.318       2.32      2.323   1.11%
Amr::InitializeInit()                             1      2.249      2.261      2.285   1.09%
Amr::defBaseLevel()                               1      2.249      2.261      2.285   1.09%
MLMG::solve()                                     6      2.231      2.232      2.233   1.07%
FillPatchIterator::Initialize                   357      2.061      2.121       2.17   1.04%
MultiFab::Subtract()                             85       1.87      1.881      1.896   0.91%
Amr::FinalizeInit()                               1      1.837      1.861      1.873   0.90%
MLMG::oneIter()                                  38      1.854      1.857      1.862   0.89%
MLMG::mgVcycle()                                 38      1.817       1.82      1.825   0.87%
FillPatchSingleLevel                            357      1.659      1.718      1.772   0.85%
Castro::derive()                                288      1.669      1.675      1.682   0.80%
FabArray::setVal()                             2524      1.646      1.663      1.673   0.80%
FabArray::ParallelCopy()                        585      1.393      1.525      1.606   0.77%
Amr::InitAmr()                                    1      1.348      1.348      1.349   0.65%
Castro::post_init()                               1      1.305      1.316      1.328   0.64%
MLCellLinOp::smooth()                           760      1.257      1.283      1.324   0.63%
FabArray::ParallelCopy_nowait()                 585      1.149      1.159      1.166   0.56%
Castro::expand_state()                            5      1.099      1.113      1.128   0.54%
Castro::volWgtSum()                              78      1.027      1.033      1.049   0.50%
MultiFab::sum()                                2065      1.034      1.035      1.036   0.50%
Castro::initData()                                1     0.9127     0.9241     0.9458   0.45%
Castro::wd_update()                               6     0.8599     0.8815     0.8927   0.43%
Castro::estTimeStep()                            11      0.849     0.8734     0.8845   0.42%
Gravity::fill_multipole_BCs()                     7     0.8275     0.8556     0.8697   0.42%
MLPoisson::Fsmooth()                           1520     0.8225     0.8433     0.8593   0.41%
MLMG::mgVcycle_down::0                           38      0.776     0.7811     0.7873   0.38%
Gravity::multilevel_solve_for_new_phi()           1     0.6341     0.6352     0.6383   0.31%
Gravity::actual_multilevel_solve()                1     0.6332     0.6342     0.6373   0.30%
Castro::volInBoundary()                          42      0.606     0.6197     0.6319   0.30%
MLCellLinOp::applyBC()                         1796     0.5281     0.5447     0.5743   0.27%
MLMG::mgVcycle_up::0                             38     0.5338     0.5361       0.54   0.26%
MLCellLinOp::apply()                            270     0.4627     0.4792     0.4986   0.24%
Castro::construct_new_source()                   35     0.4496     0.4528     0.4558   0.22%
Castro::post_regrid()                             1      0.431     0.4432     0.4542   0.22%
FabArray::ParallelCopy_finish()                 585     0.2203     0.3591     0.4434   0.21%
MLPoisson::Fapply()                             270     0.3526     0.3631     0.3797   0.18%
Amr::writePlotFile()                              2       0.32     0.3201     0.3202   0.15%
MLCellLinOp::solutionResidual()                  45     0.2943     0.3013     0.3142   0.15%
MLMG:computeResOfCorrection()                   190     0.2956     0.3052     0.3127   0.15%
MLCellLinOp::correctionResidual()               199     0.2941     0.3046     0.3119   0.15%
Castro::computeNewDt()                            4     0.3075     0.3076     0.3077   0.15%
StateDataPhysBCFunct::()                        357     0.2731     0.2763     0.2841   0.14%
Castro::construct_old_gravity()                   5     0.2053     0.2414     0.2782   0.13%
Gravity::get_old_grav_vector()                    5     0.2051     0.2413      0.278   0.13%
FabArray::FillBoundary()                       1606     0.2531     0.2647     0.2749   0.13%
StateData::FillBoundary(geom)                    21     0.2659     0.2668     0.2682   0.13%
Castro::construct_old_source()                   35     0.2579     0.2604     0.2642   0.13%
MLMG::computeResidual()                          38     0.2448     0.2511     0.2601   0.12%
Castro::construct_new_gravity_source()            5     0.2534     0.2566     0.2594   0.12%
Gravity::get_new_grav_vector()                    6     0.2347     0.2364     0.2372   0.11%
MultiFab::Saxpy()                                25     0.2329     0.2358      0.237   0.11%
MultiFab::min()                                   5   0.003163     0.1188     0.2042   0.10%
VisMF::Write(FabArray)                            2      0.192     0.1953     0.1993   0.10%
Castro::computeInitialDt()                        2     0.1576     0.1817     0.1934   0.09%
Castro::construct_old_gravity_source()            5     0.1538     0.1556     0.1577   0.08%
MLMG::addInterpCorrection()                     190    0.05689      0.132     0.1574   0.08%
MLMG::mgVcycle_down::1                           38     0.1468     0.1518     0.1563   0.07%
MLMG::mgVcycle_up::2                             38    0.04196     0.1189     0.1448   0.07%
Gravity::test_composite_phi()                     1     0.1396     0.1427     0.1437   0.07%
FillBoundary_nowait()                          1606      0.132     0.1344     0.1367   0.07%
FabArray::setDomainBndry()                      357     0.1209      0.126     0.1348   0.06%
Castro::locWgtSum()                              18     0.1267      0.129     0.1326   0.06%
MultiFab::Xpay()                                244     0.1241     0.1257     0.1282   0.06%
Castro::check_for_nan()                          10      0.125     0.1253     0.1261   0.06%
MultiFab::contains_nan()                         10     0.1248     0.1252      0.126   0.06%
FillBoundary_finish()                          1606     0.1007     0.1122     0.1232   0.06%
MLMG::mgVcycle_up::1                             38    0.09774     0.0981     0.0988   0.05%
Castro::apply_source_to_state()                  10     0.0947    0.09562    0.09656   0.05%
Castro::volProductSum()                           6     0.0526    0.05541    0.05754   0.03%
Castro::fill_hybrid_hydro_source()               15    0.05408    0.05485    0.05684   0.03%
MLMG::mgVcycle_down::2                           38    0.05376     0.0548    0.05628   0.03%
amrex::average_down                             190    0.05056     0.0517    0.05442   0.03%
MLMG::computeMLResidual()                         6    0.03884    0.04381    0.04732   0.02%
MLMG::mgVcycle_down::3                           38     0.0142     0.0225    0.04698   0.02%
MLMG::prepareForSolve()                           6    0.03905    0.04049    0.04417   0.02%
MLPoisson::define()                               7    0.03776    0.03869    0.03934   0.02%
MLMG::getGradSolution()                           6    0.03433    0.03559    0.03869   0.02%
MLCellLinOp::compGrad()                           6    0.03427    0.03553    0.03863   0.02%
MLMG::ResNormInf()                               44    0.02797    0.03425    0.03827   0.02%
Castro::construct_new_hybrid_source()             5    0.03612    0.03648    0.03743   0.02%
Gravity::update_max_rhs()                         6    0.01394      0.025    0.03723   0.02%
MultiFab::max()                                  24    0.01326    0.02436    0.03662   0.02%
FabArray::mult()                                 24    0.03367     0.0342    0.03491   0.02%
MLMG::mgVcycle_up::3                             38    0.01126    0.01715    0.03463   0.02%
MLMG::mgVcycle_bottom                            38  0.0004131   0.008342    0.03209   0.02%
MLMG::actualBottomSolve()                        38  0.0001405   0.008058    0.03179   0.02%
MLCGSolver::bicgstab                              9          0   0.007596    0.03038   0.01%
AmrLevel::AmrLevel(dm)                            1    0.02822    0.02825    0.02829   0.01%
StateData::define()                               5    0.02814    0.02818    0.02822   0.01%
Castro::swap_state_time_levels()                  5    0.02664    0.02671    0.02681   0.01%
MLCellLinOp::defineAuxData()                      7    0.02077    0.02166    0.02307   0.01%
MLMG::mgVcycle_down::4                           38    0.01418    0.01631    0.02229   0.01%
Castro::construct_old_hybrid_source()             5    0.01807    0.01851    0.01955   0.01%
MLMG::mgVcycle_up::4                             38    0.01138    0.01301    0.01766   0.01%
MLCellLinOp::defineBC()                           7    0.01453    0.01467    0.01488   0.01%
BndryData::define()                               7    0.01384    0.01398    0.01422   0.01%
Gravity::swapTimeLevels()                         5    0.01055    0.01104    0.01145   0.01%
Castro::linear_to_hybrid_momentum()               1   0.005128   0.006478   0.009588   0.00%
Castro::finalize_do_advance()                     5   0.002297   0.004673   0.008775   0.00%
FabArrayBase::getFB()                          1606   0.007479   0.007759   0.008557   0.00%
FabArrayBase::getCPC()                          543   0.006695   0.007145   0.008302   0.00%
MLMG::compResidual()                              1   0.007234   0.007406    0.00773   0.00%
FabArray::setVal(val, thecmd, scomp, ncomp)     294   0.005687   0.005834   0.005909   0.00%
MultiFab::Copy()                                  6   0.005739   0.005763   0.005788   0.00%
CGSolver::sxay()                                 67          0   0.001122   0.004489   0.00%
Castro::enforce_consistent_e()                    1    0.00349    0.00394   0.004209   0.00%
MLPoisson::prepareForSolve()                      7   0.003749   0.003877   0.004093   0.00%
MLCellLinOp::prepareForSolve()                    7   0.003676   0.003805   0.004022   0.00%
FabArrayBase::CPC::define()                     188   0.002041   0.002414   0.003432   0.00%
MLMG::MLResNormInf()                              6   0.003223    0.00328   0.003337   0.00%
MLCGSolver::ParallelAllReduce                    78          0   0.000825     0.0033   0.00%
MLMG::MLRhsNormInf()                              6   0.003129   0.003163   0.003217   0.00%
MLLinOp::define()                                 7   0.001553   0.002224   0.002567   0.00%
MultiFab::LinComb()                              67          0  0.0006136   0.002455   0.00%
MLCellLinOp::setLevelBC()                         7   0.002214   0.002353   0.002452   0.00%
MLLinOp::defineGrids()                            7   0.001363   0.002054   0.002397   0.00%
MultiFab::Dot()                                  52          0  0.0004644   0.001857   0.00%
MLLinOp::makeSubCommunicator()                    7  0.0001433   0.000786    0.00108   0.00%
FabArrayBase::FB::FB()                           16  0.0005103  0.0005902  0.0007675   0.00%
MLLinOp::makeAgglomeratedDMap                     7   0.000429  0.0004538  0.0004723   0.00%
Castro::finalize_advance()                        5  0.0002664  0.0002944  0.0003408   0.00%
makeSFC                                          21  0.0002958   0.000313  0.0003271   0.00%
Castro::enforce_speed_limit()                    42  0.0002015  0.0002089  0.0002218   0.00%
DistributionMapping::SFCProcessorMapDoIt()        1  5.025e-05  0.0001135  0.0001357   0.00%
Amr::writeSmallPlotFile()                         1  9.621e-05  0.0001035  0.0001184   0.00%
DistributionMapping::Distribute()                22  0.0001035  0.0001077  0.0001112   0.00%
Castro::create_source_corrector()                 5  4.358e-05   5.92e-05  8.917e-05   0.00%
DistributionMapping::LeastUsedCPUs()              1  1.717e-05  6.426e-05  7.996e-05   0.00%
Amr::initSubcycle()                               1  4.633e-05  5.087e-05  5.238e-05   0.00%
Castro::FluxRegFineAdd()                          5  2.492e-05  3.091e-05  4.354e-05   0.00%
Castro::construct_old_rotation_source()           5  3.917e-05  4.055e-05  4.267e-05   0.00%
Castro::construct_new_rotation_source()           5  3.842e-05  4.044e-05  4.167e-05   0.00%
Gravity::set_mass_offset()                        6  3.471e-05  3.659e-05  3.813e-05   0.00%
Castro::retry_advance_ctu()                       5  2.738e-05  3.057e-05  3.758e-05   0.00%
MLMG::buildFineMask()                             6  3.242e-05  3.302e-05  3.408e-05   0.00%
--------------------------------------------------------------------------------------------

Unused ParmParse Variables:
  [TOP]::castro.center(nvals = 3)  :: [0.0e0, 0.0e0, 0.0e0]
  [TOP]::mg.v(nvals = 1)  :: [2]

AMReX (22.01-22-ge34f5c67fec9) finalized