MPI initialized with 8 MPI processes
MPI initialized with thread support level 3
AMReX (23.08-19-ge7d3d5a4fad6) initialized

Starting run at 06:34:55 UTC on 2023-08-07.
Successfully read inputs file ... 

Castro git describe: 23.08
AMReX git describe: 23.08-19-ge7d3d5a4f
Microphysics git describe: 23.08-3-g3d2714f8

radiation initialized, nGroups = 1
reading extern runtime parameters ...
1 Species: 
X  
Radiation::nGroups = 1
Successfully read inputs file ... 
Creating Radiation object
processors = 8
do_sync            = 1
c        = 2.99792458e+10
sigma    = 5.670373e-05
reltol   = 1e-06
abstol   = 0
maxiter  = 50
relInTol = 0.0001
absInTol = 0
maxInIter = 30
delta_e_rat_dt_tol = 100
delta_T_rat_dt_tol = 100
limiter  = 0
closure  = 3
update_limiter   = 1000
update_planck    = 1000
update_rosseland = 1000
delta_temp = 0.0001
underfac = 1
do_multigroup = 0
accelerate = 1
verbose  = 2
SolverType = 5: SGFLDSolver 
rad_hydro_combined = 1
comoving = 1
dimension 0 rad boundary conditions = 102, 102
dimension 1 rad boundary conditions = 102, 102
dimension 2 rad boundary conditions = 102, 102
Regridding radiation object at level 0...
                                         done
hmabec.bho               = 0
hmabec.use_subgrids      = 0
hmabec.verbose           = 1
hmabec.verbose_threshold = 0
Warning: the following castro.* parameters are ignored
castro.gravity = 0

grid_places() time: 0.028129551 new finest: 1
Regridding radiation object at level 1...
                                         done
Warning: the following castro.* parameters are ignored
castro.gravity = 0

Now regridding at level lbase = 0
grid_places() time: 0.015191498 new finest: 1
Regridding radiation object at level 1...
                                         done
Warning: the following castro.* parameters are ignored
castro.gravity = 0

STEP = 0 TIME = 0 : REGRID  with lbase = 0
  Level 1   8 grids  4096 cells  0.0244140625 % of domain
            smallest grid: 8 x 8 x 8  biggest grid: 8 x 8 x 8

Integrated  Fluid   Mass  is 0.015394863670274892831
Integrated  Fluid  Energy is 29997674.940313063562
Integrated Radiant Energy is 0
     Flux Register Energy is 0
Integrated  Total  Energy is 29997674.940313063562
INITIAL GRIDS 
  Level 0   512 grids  2097152 cells  100 % of domain
            smallest grid: 16 x 16 x 16  biggest grid: 16 x 16 x 16
  Level 1   8 grids  4096 cells  0.0244140625 % of domain
            smallest grid: 8 x 8 x 8  biggest grid: 8 x 8 x 8

PLOTFILE: file = rad-thermalwave-3d_plt00000
Write plotfile time = 1.127827405  seconds

[Level 0 step 1] ADVANCE at time 0 with dt = 1e-15
Radiation flux initialization at level 0...
                                           done
Radiation implicit update, level 0...
hmabec.kdim            = 5
hmabec.struct_flag     = HYPRE_PFMG
hmabec.pfmg_relax_type = 1
hmabec.pfmg_pre_relax  = 1
hmabec.pfmg_post_relax = 1
Radiation Update:  Iteration 1, Relative = 1302911.3751869073603
                                Absolute = 30717.669438446406275
Radiation Update:  Iteration 2, Relative = 0.99981662868865028848
                                Absolute = 23038.180019796520355
Radiation Update:  Iteration 3, Relative = 2.5049676886893679217
                                Absolute = 17278.601887119169987
Radiation Update:  Iteration 4, Relative = 0.24999769808886593281
                                Absolute = 12958.890609044668963
Radiation Update:  Iteration 5, Relative = 0.24999136871489602285
                                Absolute = 9718.9517189824473462
Radiation Update:  Iteration 6, Relative = 0.24997033128851878225
                                Absolute = 7288.6842628490230709
Radiation Update:  Iteration 7, Relative = 0.24990070262122299205
                                Absolute = 5465.2062970578444947
Radiation Update:  Iteration 8, Relative = 0.24967419762748074841
                                Absolute = 4095.7314557644131128
Radiation Update:  Iteration 9, Relative = 0.24894351000289596798
                                Absolute = 3064.1399230131682998
Radiation Update:  Iteration 10, Relative = 0.24661313036933193987
                                Absolute = 2279.7991164082268369
Radiation Update:  Iteration 11, Relative = 0.23933586571505907625
                                Absolute = 1666.8872353665337869
Radiation Update:  Iteration 12, Relative = 0.21783418752900138293
                                Absolute = 1154.030872133507728
Radiation Update:  Iteration 13, Relative = 0.16356883430105931265
                                Absolute = 677.78316110712194131
Radiation Update:  Iteration 14, Relative = 0.093401072746009616843
                                Absolute = 253.16119395304576756
Radiation Update:  Iteration 15, Relative = 0.037594275648102040699
                                Absolute = 32.94838537221403385
Radiation Update:  Iteration 16, Relative = 0.0134962202343157818
                                Absolute = 0.51586695283367589582
Radiation Update:  Iteration 17, Relative = 0.0035380388796303861854
                                Absolute = 0.00012547822871056268923
Radiation Update:  Iteration 18, Relative = 0.00067881569843938286551
                                Absolute = 6.8453740553753306131e-07
Radiation Update:  Iteration 19, Relative = 2.8606673921437502915e-16
                                Absolute = 9.0949470177292823792e-13
                                     done
[Level 0 step 1] Advanced 2097152 cells
[Level 1 step 1] ADVANCE at time 0 with dt = 5e-16
Radiation flux initialization at level 1...
                                           done
Radiation implicit update, level 1...
Radiation Update:  Iteration 1, Relative = 1740874.668854993768
                                Absolute = 58670.981734533677809
Radiation Update:  Iteration 2, Relative = 1.3693198093305067875
                                Absolute = 44003.211727789370343
Radiation Update:  Iteration 3, Relative = 8.4196406826180574257
                                Absolute = 33002.391901588940527
Radiation Update:  Iteration 4, Relative = 0.37636607392454179966
                                Absolute = 24751.700721644883743
Radiation Update:  Iteration 5, Relative = 0.28749652133088227091
                                Absolute = 18563.700313886394724
Radiation Update:  Iteration 6, Relative = 0.24999531548820527749
                                Absolute = 13922.620733922798536
Radiation Update:  Iteration 7, Relative = 0.24998545120069648462
                                Absolute = 10441.618750627872942
Radiation Update:  Iteration 8, Relative = 0.2499517781403827188
                                Absolute = 7830.3110903618398879
Radiation Update:  Iteration 9, Relative = 0.24984312765789992716
                                Absolute = 5870.5579521638974256
Radiation Update:  Iteration 10, Relative = 0.2494946002186735623
                                Absolute = 4397.696101984307461
Radiation Update:  Iteration 11, Relative = 0.24838333322188957397
                                Absolute = 3285.7940291271042952
Radiation Update:  Iteration 12, Relative = 0.24487940595321369686
                                Absolute = 2434.8185895684700881
Radiation Update:  Iteration 13, Relative = 0.23412909072132412347
                                Absolute = 1757.867054671396545
Radiation Update:  Iteration 14, Relative = 0.2036345008265787182
                                Absolute = 1170.9479946106948773
Radiation Update:  Iteration 15, Relative = 0.13441402972060562115
                                Absolute = 615.5215818686356215
Radiation Update:  Iteration 16, Relative = 0.044161140480810649744
                                Absolute = 174.17160435714549749
Radiation Update:  Iteration 17, Relative = 0.014457617881609293245
                                Absolute = 12.704636963490884227
Radiation Update:  Iteration 18, Relative = 0.0033113599243763608762
                                Absolute = 0.064133107453471893677
Radiation Update:  Iteration 19, Relative = 0.0013411946267766876057
                                Absolute = 2.8354589565182664046e-06
Radiation Update:  Iteration 20, Relative = 3.796097931293171471e-16
                                Absolute = 1.3642420526593923569e-12
                                     done
[Level 1 step 1] Advanced 4096 cells
[Level 1 step 2] ADVANCE at time 5e-16 with dt = 5e-16
Radiation implicit update, level 1...
Radiation Update:  Iteration 1, Relative = 1.1293800200035124526
                                Absolute = 58.81465512416070851
Radiation Update:  Iteration 2, Relative = 0.24676661788898782146
                                Absolute = 1.4191275508756007184
Radiation Update:  Iteration 3, Relative = 0.038876324482146826234
                                Absolute = 0.00081055567125076777302
Radiation Update:  Iteration 4, Relative = 0.0026439702170363123604
                                Absolute = 5.6305582054605451958e-06
Radiation Update:  Iteration 5, Relative = 3.857599482584307343e-16
                                Absolute = 1.3642420526593923569e-12
                                     done
[Level 1 step 2] Advanced 4096 cells
Radiation deferred sync setup for coarse level 0...
                                                   done
Integrated  Fluid   Mass  is 0.015394863670274892831
Integrated  Fluid  Energy is 709447.77384859882295
Integrated Radiant Energy is 29288227.166465058923
     Flux Register Energy is -1.1622617533149873456e-06
Integrated  Total  Energy is 29997674.940312497318

[STEP 1] Coarse TimeStep time: 14.19441241
[STEP 1] FAB kilobyte spread across MPI nodes: [381765 ... 381765]

STEP = 1 TIME = 1e-15 DT = 1e-15

[Level 0 step 2] ADVANCE at time 1e-15 with dt = 1.05e-15
Radiation flux initialization at level 0...
                                           done
Radiation implicit update, level 0...
Radiation Update:  Iteration 1, Relative = 41.075798328605387155
                                Absolute = 285.14215141004433463
Radiation Update:  Iteration 2, Relative = 0.70128009912250388602
                                Absolute = 33.627916367149282451
Radiation Update:  Iteration 3, Relative = 0.084541388209284085153
                                Absolute = 0.54191827281829318963
Radiation Update:  Iteration 4, Relative = 0.004043574421279898419
                                Absolute = 0.00013980735730001470074
Radiation Update:  Iteration 5, Relative = 0.00023937818045940403638
                                Absolute = 8.0259146750805143711e-07
Radiation Update:  Iteration 6, Relative = 4.1346497443275626292e-16
                                Absolute = 4.5474735088646411896e-13
                                     done
[Level 0 step 2] Advanced 2097152 cells
[Level 1 step 3] ADVANCE at time 1e-15 with dt = 5.25e-16
Radiation flux initialization at level 1...
                                           done
Radiation implicit update, level 1...
Radiation Update:  Iteration 1, Relative = 0.54641284635439402173
                                Absolute = 2.9436244644628573042
Radiation Update:  Iteration 2, Relative = 0.083948168273111814508
                                Absolute = 0.024972607350363773548
Radiation Update:  Iteration 3, Relative = 0.0076108392530417840263
                                Absolute = 0.00018989121619661375462
Radiation Update:  Iteration 4, Relative = 3.3611508343305987918e-14
                                Absolute = 1.3642420526593923569e-12
                                     done
[Level 1 step 3] Advanced 4096 cells
[Level 1 step 4] ADVANCE at time 1.525e-15 with dt = 5.25e-16
Radiation implicit update, level 1...
Radiation Update:  Iteration 1, Relative = 0.35303629913329753753
                                Absolute = 2.9178944731206346574
Radiation Update:  Iteration 2, Relative = 0.03693670446363742782
                                Absolute = 0.020380594366429249931
Radiation Update:  Iteration 3, Relative = 0.0022787336352588088983
                                Absolute = 0.00013162435776337133575
Radiation Update:  Iteration 4, Relative = 2.1636132208589239413e-14
                                Absolute = 1.3642420526593923569e-12
                                     done
[Level 1 step 4] Advanced 4096 cells
Radiation deferred sync setup for coarse level 0...
                                                   done
Integrated  Fluid   Mass  is 0.015394863670274892831
Integrated  Fluid  Energy is 710342.77262448845431
Integrated Radiant Energy is 29287332.167688906193
     Flux Register Energy is -9.7548753890787439541e-07
Integrated  Total  Energy is 29997674.940312419087

[STEP 2] Coarse TimeStep time: 4.15316105
[STEP 2] FAB kilobyte spread across MPI nodes: [381956 ... 381956]

STEP = 2 TIME = 2.05e-15 DT = 1.05e-15

Now regridding at level lbase = 0
grid_places() time: 0.01140977 new finest: 1
Regridding radiation object at level 1...
                                         done
Warning: the following castro.* parameters are ignored
castro.gravity = 0

STEP = 2 TIME = 2.05e-15 : REGRID  with lbase = 0
  Level 1   8 grids  32768 cells  0.1953125 % of domain
            smallest grid: 16 x 16 x 16  biggest grid: 16 x 16 x 16

[Level 0 step 3] ADVANCE at time 2.05e-15 with dt = 1.1025e-15
Radiation flux initialization at level 0...
                                           done
Radiation implicit update, level 0...
Radiation Update:  Iteration 1, Relative = 20.853193550344439444
                                Absolute = 285.13245403782866561
Radiation Update:  Iteration 2, Relative = 0.58147683155753338013
                                Absolute = 33.626305412896726921
Radiation Update:  Iteration 3, Relative = 0.049883721652757749554
                                Absolute = 0.54187769453619694104
Radiation Update:  Iteration 4, Relative = 0.0026300185572377507599
                                Absolute = 0.00013993746097185066901
Radiation Update:  Iteration 5, Relative = 0.00013963684158169777918
                                Absolute = 8.6661158116285719188e-07
Radiation Update:  Iteration 6, Relative = 2.8841654045367306109e-16
                                Absolute = 9.0949470177292823792e-13
                                     done
[Level 0 step 3] Advanced 2097152 cells
[Level 1 step 5] ADVANCE at time 2.05e-15 with dt = 5.5125e-16
Radiation flux initialization at level 1...
                                           done
Radiation implicit update, level 1...
Radiation Update:  Iteration 1, Relative = 0.27369076291192706574
                                Absolute = 3.0411087480215854839
Radiation Update:  Iteration 2, Relative = 0.021992160092234629837
                                Absolute = 0.019316320396168151774
Radiation Update:  Iteration 3, Relative = 0.00094537318952487051863
                                Absolute = 0.00011619634420512170436
Radiation Update:  Iteration 4, Relative = 2.2158089437866693322e-14
                                Absolute = 9.0949470177292823792e-13
                                     done
[Level 1 step 5] Advanced 32768 cells
[Level 1 step 6] ADVANCE at time 2.60125e-15 with dt = 5.5125e-16
Radiation implicit update, level 1...
Radiation Update:  Iteration 1, Relative = 0.21467196345547245873
                                Absolute = 3.0206419259916792441
Radiation Update:  Iteration 2, Relative = 0.013431330131311340279
                                Absolute = 0.017036881971193906793
Radiation Update:  Iteration 3, Relative = 0.00049108510390611845569
                                Absolute = 9.2054821454468083175e-05
Radiation Update:  Iteration 4, Relative = 1.6659614140711882466e-14
                                Absolute = 9.0949470177292823792e-13
                                     done
[Level 1 step 6] Advanced 32768 cells
Radiation deferred sync setup for coarse level 0...
                                                   done
Integrated  Fluid   Mass  is 0.015394863670274819972
Integrated  Fluid  Energy is 711281.07259683741722
Integrated Radiant Energy is 29286393.867715489119
     Flux Register Energy is 9.2765207824576655538e-14
Integrated  Total  Energy is 29997674.940312325954

[STEP 3] Coarse TimeStep time: 4.096792875
[STEP 3] FAB kilobyte spread across MPI nodes: [381956 ... 381956]

STEP = 3 TIME = 3.1525e-15 DT = 1.1025e-15

[Level 0 step 4] ADVANCE at time 3.1525e-15 with dt = 1.157625e-15
Radiation flux initialization at level 0...
                                           done
Radiation implicit update, level 0...
Radiation Update:  Iteration 1, Relative = 14.594754855865101462
                                Absolute = 285.07206111059667819
Radiation Update:  Iteration 2, Relative = 0.51099978467695539308
                                Absolute = 33.61357590957550201
Radiation Update:  Iteration 3, Relative = 0.036631894140127414794
                                Absolute = 0.54147749412913981359
Radiation Update:  Iteration 4, Relative = 0.00201794587205189873
                                Absolute = 0.00013984414817969081923
Radiation Update:  Iteration 5, Relative = 4.6879370458291014368e-15
                                Absolute = 9.5496943686157464981e-12
                                     done
[Level 0 step 4] Advanced 2097152 cells
[Level 1 step 7] ADVANCE at time 3.1525e-15 with dt = 5.788125e-16
Radiation flux initialization at level 1...
                                           done
Radiation implicit update, level 1...
Radiation Update:  Iteration 1, Relative = 0.1854133078333054796
                                Absolute = 3.1526844403844300757
Radiation Update:  Iteration 2, Relative = 0.0098401135623457820778
                                Absolute = 0.016934946691186780754
Radiation Update:  Iteration 3, Relative = 0.00039205049421427504283
                                Absolute = 8.7635873413205445104e-05
Radiation Update:  Iteration 4, Relative = 1.8625811883700510299e-14
                                Absolute = 1.8189894035458564758e-12
                                     done
[Level 1 step 7] Advanced 32768 cells
[Level 1 step 8] ADVANCE at time 3.7313125e-15 with dt = 5.788125e-16
Radiation implicit update, level 1...
Radiation Update:  Iteration 1, Relative = 0.15628586633639340864
                                Absolute = 3.134743235530830674
Radiation Update:  Iteration 2, Relative = 0.0069133105575972771464
                                Absolute = 0.015432358364094511671
Radiation Update:  Iteration 3, Relative = 0.00029546802907180779764
                                Absolute = 7.3611773174775407824e-05
Radiation Update:  Iteration 4, Relative = 1.5099478276026251327e-14
                                Absolute = 1.3642420526593923569e-12
                                     done
[Level 1 step 8] Advanced 32768 cells
Radiation deferred sync setup for coarse level 0...
                                                   done
Integrated  Fluid   Mass  is 0.015394863670274819972
Integrated  Fluid  Energy is 712256.71972726634704
Integrated Radiant Energy is 29285418.220585085452
     Flux Register Energy is -7.5475644347553625631e-13
Integrated  Total  Energy is 29997674.940312352031

[STEP 4] Coarse TimeStep time: 3.501496716
[STEP 4] FAB kilobyte spread across MPI nodes: [384692 ... 384692]

STEP = 4 TIME = 4.310125e-15 DT = 1.157625e-15

Now regridding at level lbase = 0
grid_places() time: 0.011179735 new finest: 1
Regridding radiation object at level 1...
                                         done
Warning: the following castro.* parameters are ignored
castro.gravity = 0

STEP = 4 TIME = 4.310125e-15 : REGRID  with lbase = 0
  Level 1   8 grids  32768 cells  0.1953125 % of domain
            smallest grid: 16 x 16 x 16  biggest grid: 16 x 16 x 16

[Level 0 step 5] ADVANCE at time 4.310125e-15 with dt = 1.21550625e-15
Radiation flux initialization at level 0...
                                           done
Radiation implicit update, level 0...
Radiation Update:  Iteration 1, Relative = 11.529747077603856198
                                Absolute = 285.00830918719248075
Radiation Update:  Iteration 2, Relative = 0.46308164711237287392
                                Absolute = 33.600098034219627152
Radiation Update:  Iteration 3, Relative = 0.029571895693538637062
                                Absolute = 0.54105343411765716155
Radiation Update:  Iteration 4, Relative = 0.0016787271577487065423
                                Absolute = 0.00013973119848742499016
Radiation Update:  Iteration 5, Relative = 7.2698991551690783461e-15
                                Absolute = 9.0949470177292823792e-12
                                     done
[Level 0 step 5] Advanced 2097152 cells
[Level 1 step 9] ADVANCE at time 4.310125e-15 with dt = 6.07753125e-16
Radiation flux initialization at level 1...
                                           done
Radiation implicit update, level 1...
Radiation Update:  Iteration 1, Relative = 0.14182061814645949283
                                Absolute = 3.2742810833836912821
Radiation Update:  Iteration 2, Relative = 0.0056134926065625149333
                                Absolute = 0.015706872603402644017
Radiation Update:  Iteration 3, Relative = 0.00025141566372381630914
                                Absolute = 7.3175931227353885333e-05
Radiation Update:  Iteration 4, Relative = 1.7771949245834723433e-14
                                Absolute = 1.3642420526593923569e-12
                                     done
[Level 1 step 9] Advanced 32768 cells
[Level 1 step 10] ADVANCE at time 4.917878125e-15 with dt = 6.07753125e-16
Radiation implicit update, level 1...
Radiation Update:  Iteration 1, Relative = 0.12412021608235490611
                                Absolute = 3.2576373964191915888
Radiation Update:  Iteration 2, Relative = 0.0042605287980643702025
                                Absolute = 0.01457624683325065007
Radiation Update:  Iteration 3, Relative = 0.00019911742442456318723
                                Absolute = 6.3535372522238731108e-05
Radiation Update:  Iteration 4, Relative = 1.4906246727192562549e-14
                                Absolute = 9.0949470177292823792e-13
                                     done
[Level 1 step 10] Advanced 32768 cells
Radiation deferred sync setup for coarse level 0...
                                                   done
Integrated  Fluid   Mass  is 0.015394863670274819972
Integrated  Fluid  Energy is 713272.29498282179702
Integrated Radiant Energy is 29284402.645329594612
     Flux Register Energy is -7.3713322724497348774e-13
Integrated  Total  Energy is 29997674.940312415361

[STEP 5] Coarse TimeStep time: 3.526024351
[STEP 5] FAB kilobyte spread across MPI nodes: [384692 ... 384692]

STEP = 5 TIME = 5.52563125e-15 DT = 1.21550625e-15

PLOTFILE: file = rad-thermalwave-3d_plt00005
Write plotfile time = 0.738017921  seconds


Ending run at 06:35:26 UTC on 2023-08-07.
Deleting radiation in variableCleanUp...
                                        done
Run time = 31.73853537
Run time without initialization = 30.23148003

  Average number of zones advanced per microsecond: 0.354
  Average number of zones advanced per microsecond per rank: 0.044



TinyProfiler total time across processes [min...avg...max]: 31.74 ... 31.74 ... 31.74

-------------------------------------------------------------------------------------------
Name                                        NCalls  Excl. Min  Excl. Avg  Excl. Max   Max %
-------------------------------------------------------------------------------------------
HypreMultiABec::setupSolver                     98    10.9814    11.0026    11.0429  34.79%
HypreMultiABec::solve                           98      8.556      8.596      8.617  27.15%
Radiation::compute_eta                          98      1.202      1.215      1.235   3.89%
HypreMultiABec::clearSolver                     98     0.8028      0.821     0.8431   2.66%
Radiation::get_planck_and_temp                  98     0.7685     0.7725     0.7757   2.44%
AmrLevel::derive()                             144     0.7019     0.7099     0.7252   2.29%
update_rosseland_from_temp                      83     0.7089     0.7125     0.7223   2.28%
HypreMultiABec::finalizeMatrix                  98     0.6544     0.6754     0.6935   2.19%
amrex::Copy()                                 1205      0.639     0.6596     0.6849   2.16%
FabArray::setVal()                             959     0.4074     0.5028     0.5951   1.87%
HypreMultiABec::loadMatrix                      98     0.5592      0.571     0.5851   1.84%
RadSolve::levelBCoeffs                          98     0.4039      0.407     0.4118   1.30%
FabArray::ParallelCopy_finish()                919     0.1876     0.3028     0.3995   1.26%
RadSolve::levelRhs                              98     0.3692     0.3728     0.3789   1.19%
FillPatchIterator::Initialize                  240     0.3517      0.359     0.3643   1.15%
VisMF::Write(FabArray)                           4     0.2797     0.3005     0.3495   1.10%
HypreMultiABec::loadLevelVectors                98     0.3223     0.3243      0.329   1.04%
Radiation::compute_exchange                     98     0.2642     0.2654     0.2701   0.85%
FabArray::ParallelCopy_nowait()                919     0.2293     0.2323     0.2354   0.74%
Amr::writePlotFile()                             2     0.1332     0.2004     0.2163   0.68%
RadSolve::levelFlux                             98      0.168     0.1697     0.1709   0.54%
RadSolve::levelFluxReg                          98     0.1563     0.1581      0.162   0.51%
Radiation::get_rosseland                        15     0.1511     0.1518     0.1529   0.48%
Castro::reset_internal_energy(Fab)            7294     0.1428     0.1438     0.1452   0.46%
FillPatchSingleLevel                           277     0.1194     0.1314      0.144   0.45%
FluxRegister::Reflux()                         156     0.1137     0.1161     0.1181   0.37%
Radiation::internal_energy_update               98    0.09654     0.1024      0.106   0.33%
Castro::initialize_do_advance()                 15     0.1001     0.1017     0.1033   0.33%
HypreMultiABec::vectorSetBoxValues            5362    0.09588     0.0992     0.1025   0.32%
Radiation::get_c_v                           10625    0.09465    0.09484    0.09521   0.30%
Radiation::single_group_update                  15    0.08085    0.08444    0.09228   0.29%
Castro::initialize_advance()                    15    0.08066    0.08349    0.08966   0.28%
FillBoundary_finish()                          181    0.04526    0.06874    0.08629   0.27%
Radiation::scaledGradient                       98    0.07533    0.07686    0.07914   0.25%
Castro::Castro()                                 5    0.06562    0.07408    0.07809   0.25%
HypreMultiABec::finalizeVectors                 98    0.06796    0.07273    0.07685   0.24%
Castro::computeTemp()                           76    0.06313    0.06514    0.07418   0.23%
RadSolve::levelACoeffs                          98    0.06854    0.06977    0.07399   0.23%
HypreMultiABec::hmbc                          8043    0.06712    0.06826    0.07081   0.22%
Castro::initMFs()                                5    0.05338     0.0556    0.06348   0.20%
StateData::FillBoundary(geom)                  962     0.0573    0.05897    0.06268   0.20%
Radiation:fluxLimiter                           98    0.05756    0.05856    0.05985   0.19%
Castro::normalize_species()                     58    0.05492    0.05549     0.0557   0.18%
HypreMultiABec::hmmat3                        1968    0.04869    0.05211    0.05552   0.17%
StateData::define()                             15    0.04655    0.04916    0.05277   0.17%
FillBoundary_nowait()                          181    0.04445    0.04684    0.04866   0.15%
Castro::swap_state_time_levels()                15    0.04437    0.04478     0.0453   0.14%
Castro::initData()                               3    0.03132    0.03464    0.04013   0.13%
AmrLevel::FillPatch()                          225    0.03226    0.03584    0.03824   0.12%
Castro::volWgtSum()                             36      0.029    0.03085     0.0366   0.12%
HypreMultiABec::hmac                          2681    0.03052    0.03067    0.03096   0.10%
Castro::buildMetrics()                           5     0.0234    0.02462    0.02673   0.08%
FabArray::setDomainBndry()                     277    0.02043    0.02236    0.02393   0.08%
Castro::enforce_min_density()                   58     0.0216    0.02207    0.02315   0.07%
MultiFab::contains_nan()                        15     0.0169    0.01938    0.02168   0.07%
Amr::FinalizeInit()                              1  5.195e-06   0.002692    0.02148   0.07%
main()                                           1     0.0187    0.02039    0.02132   0.07%
HypreMultiABec::getAbsoluteResidual             98     0.0199    0.02017    0.02034   0.06%
HypreMultiABec::getSolution                     98     0.0188    0.01888    0.01901   0.06%
HypreMultiABec::boundaryFlux                    98     0.0182    0.01863     0.0189   0.06%
HypreMultiABec::vectorGetBoxValues            2681    0.01715    0.01732    0.01752   0.06%
AmrMesh::MakeNewGrids()                          4   0.009955    0.01044    0.01105   0.03%
Castro::apply_tagging_restrictions()             4   0.008397   0.008657   0.009557   0.03%
AMRErrorTag::operator()                          4   0.007945   0.008497   0.009239   0.03%
FillPatchInterp(MF)                             37  0.0006044    0.00594   0.008836   0.03%
FabArrayBase::CPC::define()                    165   0.003012    0.00333   0.003459   0.01%
DistributionMapping::LeastUsedCPUs()            11  0.0004943   0.001751   0.002737   0.01%
Castro::enforce_consistent_e()                   3   0.002067   0.002267   0.002348   0.01%
Radiation::Regrid                                5   0.001826   0.001999   0.002294   0.01%
FabArrayBase::getCPC()                         742   0.001723    0.00181    0.00189   0.01%
FillPatchTwoLevels                             126   0.000655   0.001274   0.001599   0.01%
Castro::reset_internal_energy(MultiFab)         76   0.001496   0.001528   0.001557   0.00%
Castro::build_fine_mask()                       18  0.0009581   0.001242    0.00137   0.00%
Radiation::getBndryData                         15   0.001014   0.001072   0.001344   0.00%
Amr::regrid()                                    3  0.0003917  0.0005532    0.00123   0.00%
TagBoxArray::collate()                           4  0.0002549  0.0008987   0.001165   0.00%
FabArray::ParallelCopy()                       919  0.0009695   0.001047   0.001091   0.00%
OwnerMask()                                      4  0.0008236  0.0008732  0.0009508   0.00%
Castro::finalize_advance()                      15  0.0005431  0.0006759  0.0009058   0.00%
RadSolve::levelSolve                            98  0.0007536  0.0007974   0.000881   0.00%
Castro::post_timestep()                         15  0.0004943  0.0005452  0.0008283   0.00%
amrex::average_down                             19  0.0007192  0.0007384  0.0007599   0.00%
FabArrayBase::FB::FB()                          27  0.0006646  0.0006937  0.0007517   0.00%
StateDataPhysBCFunct::()                       277  0.0005802  0.0006456  0.0007285   0.00%
Amr::coarseTimeStep()                            5   0.000343  0.0006173  0.0006615   0.00%
Amr::InitAmr()                                   1   0.000545  0.0005564  0.0005683   0.00%
FillPatchIterator::FillFromLevel0()            114  0.0002858  0.0003571  0.0003896   0.00%
Amr::timeStep()                                 15  0.0002605  0.0003276  0.0003891   0.00%
HypreMultiABec::bCoefficients                  294  0.0002912  0.0003305  0.0003756   0.00%
FabArray::FillBoundary()                       181  0.0003142  0.0003233  0.0003432   0.00%
Amr::grid_places()                               4  0.0001914  0.0002129  0.0002885   0.00%
Castro::finalize_do_advance()                   15  0.0002381  0.0002504  0.0002639   0.00%
Castro::derive()                               144  0.0001971  0.0002141  0.0002468   0.00%
TagBoxArray::mapPRD                              4  0.0001912  0.0002041  0.0002134   0.00%
Radiation::deferred_sync_setup                   5  9.781e-05  0.0001117  0.0001702   0.00%
HypreMultiABec::aCoefficients                   98  0.0001345  0.0001482   0.000164   0.00%
Radiation::init_flux                            10  3.525e-05  5.578e-05  0.0001549   0.00%
FabArrayBase::getFB()                          181  0.0001271  0.0001401  0.0001501   0.00%
Castro::clean_state()                           58  0.0001337  0.0001381   0.000147   0.00%
Castro::advance()                               15  0.0001072  0.0001168  0.0001393   0.00%
Castro::post_init()                              2   5.61e-05  8.982e-05  0.0001354   0.00%
FillPatchIterator::FillFromTwoLevels()         126  0.0001141   0.000121  0.0001285   0.00%
Castro::do_advance_ctu()                        15   9.64e-05   0.000106  0.0001233   0.00%
FabSetT<MF>::linComb()                          30  0.0001007  0.0001038  0.0001089   0.00%
FPinfo::FPinfo()                                 8  7.671e-05  9.191e-05  0.0001068   0.00%
Castro::errorEst()                               4  7.291e-05  8.415e-05  9.607e-05   0.00%
Castro::subcycle_advance_ctu()                  15  5.732e-05  7.175e-05  8.877e-05   0.00%
DistributionMapping::SFCProcessorMapDoIt()       3  6.155e-05  6.811e-05  7.641e-05   0.00%
FabArrayBase::TheFPinfo()                       37  6.421e-05  6.908e-05  7.492e-05   0.00%
Castro::do_old_sources()                        15   4.38e-05  5.057e-05  6.518e-05   0.00%
AmrLevel::AmrLevel(dm)                           5  4.545e-05  5.282e-05  6.181e-05   0.00%
Radiation::pre_timestep                         15  3.792e-05  4.136e-05   5.55e-05   0.00%
Castro::enforce_speed_limit()                   58  3.189e-05  3.612e-05  4.471e-05   0.00%
RadSolve::levelBndry                            15  1.644e-05  2.631e-05  4.465e-05   0.00%
Castro::avgDown(state_indx)                     19  1.928e-05  3.267e-05  4.284e-05   0.00%
Castro::do_new_sources()                        15  3.459e-05  3.888e-05  4.192e-05   0.00%
Amr::defBaseLevel()                              1  3.036e-05  3.435e-05  4.008e-05   0.00%
Amr::writeSmallPlotFile()                        1  3.678e-05  3.758e-05  3.939e-05   0.00%
Castro::expand_state()                          15  3.034e-05  3.404e-05  3.804e-05   0.00%
Castro::estTimeStep()                           32  2.779e-05   3.04e-05  3.441e-05   0.00%
Castro::create_source_corrector()               15    1.4e-05  1.659e-05  2.711e-05   0.00%
Castro::check_for_nan()                         15  1.843e-05  2.049e-05  2.413e-05   0.00%
ClusterList::intersect()                         0          0   2.98e-06  2.384e-05   0.00%
amrex::average_down_w_geom                      19  7.358e-06  1.035e-05  2.264e-05   0.00%
Castro::post_regrid()                            8  1.449e-05  1.945e-05  2.148e-05   0.00%
Castro::retry_advance_ctu()                     15  1.308e-05  1.563e-05  1.824e-05   0.00%
Radiation::filBndry                             10  1.443e-05  1.528e-05  1.571e-05   0.00%
Castro::computeNewDt()                           6  7.672e-06  1.136e-05  1.518e-05   0.00%
Amr::bldFineLevels()                             1   1.29e-05    1.4e-05  1.511e-05   0.00%
Castro::apply_problem_tags()                     4  1.029e-05  1.324e-05  1.486e-05   0.00%
Amr::initSubcycle()                              1  9.883e-06   1.11e-05  1.198e-05   0.00%
Amr::initialInit()                               1  1.319e-06  3.254e-06  1.187e-05   0.00%
DistributionMapping::Distribute()                3  7.592e-06  8.344e-06  1.059e-05   0.00%
AmrMesh-cluster                                  0          0  1.302e-06  1.042e-05   0.00%
BoxList::parallelComplementIn()                  8  3.263e-06  4.587e-06  1.029e-05   0.00%
Castro::avgDown()                                6  5.643e-06  6.876e-06  7.657e-06   0.00%
Castro::init(old)                                2  6.248e-06  6.793e-06  7.328e-06   0.00%
Amr::InitializeInit()                            1  2.089e-06  2.906e-06  6.226e-06   0.00%
Castro::computeInitialDt()                       2  2.703e-06   3.93e-06   4.62e-06   0.00%
BoxList::complementIn                            8  2.526e-06  3.395e-06  4.093e-06   0.00%
Amr::init()                                      1  1.949e-06   2.15e-06  2.527e-06   0.00%
ClusterList::chop()                              0          0  3.155e-07  2.524e-06   0.00%
-------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------------------
Name                                        NCalls  Incl. Min  Incl. Avg  Incl. Max   Max %
-------------------------------------------------------------------------------------------
main()                                           1      31.74      31.74      31.74 100.00%
Amr::coarseTimeStep()                            5      29.47      29.47      29.47  92.86%
Amr::timeStep()                                 15      29.47      29.47      29.47  92.86%
Castro::advance()                               15      29.32      29.32      29.32  92.38%
Radiation::single_group_update                  15      27.84      27.88      27.93  87.99%
RadSolve::levelSolve                            98      22.34      22.37       22.4  70.57%
HypreMultiABec::setupSolver                     98      10.98         11      11.04  34.79%
HypreMultiABec::solve                           98      8.556      8.596      8.617  27.15%
Amr::writePlotFile()                             2      1.847      1.866      1.869   5.89%
Amr::init()                                      1      1.506      1.506      1.506   4.75%
Castro::derive()                               144      1.372      1.379      1.393   4.39%
AmrLevel::derive()                             144      1.372      1.378      1.392   4.39%
AmrLevel::FillPatch()                          225      1.222      1.291      1.351   4.26%
Radiation::compute_eta                          98      1.297      1.309      1.329   4.19%
FillPatchIterator::Initialize                  240      1.132       1.23      1.319   4.16%
Castro::subcycle_advance_ctu()                  15      1.004      1.036      1.063   3.35%
Castro::do_advance_ctu()                        15      1.003      1.035      1.063   3.35%
Castro::initialize_do_advance()                 15      0.801     0.8616     0.9205   2.90%
FillPatchSingleLevel                           277       0.73     0.8274      0.914   2.88%
HypreMultiABec::clearSolver                     98     0.8028      0.821     0.8431   2.66%
FabArray::ParallelCopy()                       919     0.5988     0.7027     0.7971   2.51%
update_rosseland_from_temp                      83     0.7725     0.7803     0.7862   2.48%
Radiation::get_planck_and_temp                  98     0.7685     0.7725     0.7757   2.44%
FillPatchIterator::FillFromLevel0()            114     0.5777     0.6788     0.7661   2.41%
HypreMultiABec::loadMatrix                      98     0.7114     0.7221     0.7341   2.31%
HypreMultiABec::finalizeMatrix                  98     0.6544     0.6754     0.6935   2.19%
amrex::Copy()                                 1205      0.639     0.6596     0.6849   2.16%
Castro::expand_state()                          15      0.555     0.6176     0.6792   2.14%
FabArray::setVal()                             959     0.4074     0.5028     0.5951   1.87%
RadSolve::levelBCoeffs                          98     0.4597     0.4672     0.4775   1.50%
Radiation::get_rosseland                        15     0.3464     0.3926     0.4365   1.38%
Castro::initialize_advance()                    15     0.3085     0.3711     0.4298   1.35%
HypreMultiABec::loadLevelVectors                98     0.4209     0.4235     0.4256   1.34%
FabArray::ParallelCopy_nowait()                919     0.3901     0.3989     0.4113   1.30%
FabArray::ParallelCopy_finish()                919     0.1876     0.3028     0.3995   1.26%
Amr::initialInit()                               1     0.3755     0.3782     0.3971   1.25%
RadSolve::levelRhs                              98     0.3761     0.3801     0.3859   1.22%
VisMF::Write(FabArray)                           4     0.2797     0.3005     0.3495   1.10%
Amr::InitializeInit()                            1     0.2922     0.2972     0.3009   0.95%
Amr::defBaseLevel()                              1     0.2922     0.2972     0.3009   0.95%
RadSolve::levelFlux                             98     0.2676     0.2825      0.299   0.94%
Radiation::compute_exchange                     98     0.2642     0.2654     0.2701   0.85%
Castro::clean_state()                           58     0.2509     0.2536     0.2558   0.81%
Castro::computeTemp()                           76     0.2075     0.2105     0.2194   0.69%
RadSolve::levelFluxReg                          98     0.1927     0.2017     0.2071   0.65%
Castro::Castro()                                 5     0.1799     0.1835     0.1861   0.59%
FillPatchIterator::FillFromTwoLevels()         126     0.1683     0.1704     0.1718   0.54%
FillPatchTwoLevels                             126     0.1682     0.1703     0.1717   0.54%
FluxRegister::Reflux()                         156     0.1503     0.1586     0.1669   0.53%
Castro::reset_internal_energy(MultiFab)         76     0.1443     0.1453     0.1467   0.46%
Castro::reset_internal_energy(Fab)            7294     0.1428     0.1438     0.1452   0.46%
FabArray::FillBoundary()                       181    0.09506     0.1167     0.1345   0.42%
Castro::do_new_sources()                        15    0.05406    0.08109     0.1068   0.34%
Radiation::internal_energy_update               98    0.09654     0.1024      0.106   0.33%
HypreMultiABec::vectorSetBoxValues            5362    0.09588     0.0992     0.1025   0.32%
RadSolve::levelACoeffs                          98    0.09032    0.09371     0.1003   0.32%
Amr::FinalizeInit()                              1    0.07464      0.081    0.09967   0.31%
Radiation::get_c_v                           10625    0.09465    0.09484    0.09521   0.30%
Castro::post_timestep()                         15    0.09039    0.09049    0.09056   0.29%
Amr::regrid()                                    3    0.08737    0.08832    0.08923   0.28%
FillBoundary_finish()                          181    0.04526    0.06874    0.08629   0.27%
Castro::initData()                               3    0.07026    0.07601    0.08038   0.25%
Radiation::scaledGradient                       98    0.07533    0.07686    0.07914   0.25%
HypreMultiABec::finalizeVectors                 98    0.06796    0.07273    0.07685   0.24%
HypreMultiABec::hmbc                          8043    0.06712    0.06826    0.07081   0.22%
HypreMultiABec::bCoefficients                  294    0.05199    0.06014    0.06866   0.22%
Amr::grid_places()                               4     0.0562    0.06054    0.06602   0.21%
AmrMesh::MakeNewGrids()                          4    0.05599    0.06033    0.06582   0.21%
Castro::initMFs()                                5    0.05338     0.0556    0.06348   0.20%
StateDataPhysBCFunct::()                       277    0.05794    0.05961    0.06329   0.20%
StateData::FillBoundary(geom)                  962     0.0573    0.05897    0.06268   0.20%
Amr::bldFineLevels()                             1    0.05173     0.0554    0.05991   0.19%
Radiation:fluxLimiter                           98    0.05756    0.05856    0.05985   0.19%
Castro::do_old_sources()                        15    0.04501    0.05172    0.05744   0.18%
Castro::normalize_species()                     58    0.05492    0.05549     0.0557   0.18%
HypreMultiABec::hmmat3                        1968    0.04869    0.05211    0.05552   0.17%
AmrLevel::AmrLevel(dm)                           5    0.04661    0.04922    0.05283   0.17%
StateData::define()                             15    0.04655    0.04916    0.05277   0.17%
FillBoundary_nowait()                          181    0.04529    0.04768    0.04948   0.16%
Castro::post_regrid()                            8    0.04486    0.04588    0.04626   0.15%
Castro::swap_state_time_levels()                15    0.04437    0.04478     0.0453   0.14%
Castro::errorEst()                               4    0.04062    0.04177    0.04361   0.14%
Castro::volWgtSum()                             36    0.03016    0.03209    0.03756   0.12%
HypreMultiABec::getSolution                     98    0.03603     0.0362    0.03643   0.11%
Castro::buildMetrics()                           5    0.02906    0.03133    0.03379   0.11%
HypreMultiABec::hmac                          2681    0.03052    0.03067    0.03096   0.10%
HypreMultiABec::aCoefficients                   98    0.02112    0.02394    0.02665   0.08%
FabArray::setDomainBndry()                     277    0.02043    0.02236    0.02393   0.08%
Castro::enforce_min_density()                   58     0.0216    0.02207    0.02315   0.07%
Castro::check_for_nan()                         15    0.01692     0.0194     0.0217   0.07%
MultiFab::contains_nan()                        15     0.0169    0.01938    0.02168   0.07%
HypreMultiABec::getAbsoluteResidual             98     0.0199    0.02017    0.02034   0.06%
Radiation::getBndryData                         15   0.008637    0.01131    0.02034   0.06%
HypreMultiABec::boundaryFlux                    98     0.0182    0.01863     0.0189   0.06%
HypreMultiABec::vectorGetBoxValues            2681    0.01715    0.01732    0.01752   0.06%
Castro::post_init()                              2    0.01435    0.01468     0.0162   0.05%
TagBoxArray::mapPRD                              4   0.003356    0.00661    0.01057   0.03%
Castro::apply_tagging_restrictions()             4   0.008397   0.008657   0.009557   0.03%
AMRErrorTag::operator()                          4   0.007945   0.008497   0.009239   0.03%
FillPatchInterp(MF)                             37  0.0006044    0.00594   0.008836   0.03%
Castro::init(old)                                2   0.005407   0.005439   0.005509   0.02%
FabArrayBase::getCPC()                         742     0.0048    0.00514   0.005345   0.02%
Castro::finalize_do_advance()                   15   0.004292   0.004505   0.004961   0.02%
FabArrayBase::CPC::define()                    165   0.003012    0.00333   0.003459   0.01%
Radiation::pre_timestep                         15   0.002446   0.002641   0.002989   0.01%
Radiation::init_flux                            10   0.002406     0.0026   0.002947   0.01%
FabArrayBase::TheFPinfo()                       37  0.0005533   0.001844    0.00283   0.01%
FPinfo::FPinfo()                                 8  0.0004891   0.001775   0.002759   0.01%
DistributionMapping::LeastUsedCPUs()            11  0.0004943   0.001751   0.002737   0.01%
Castro::enforce_consistent_e()                   3   0.002067   0.002267   0.002348   0.01%
Radiation::Regrid                                5   0.001826   0.001999   0.002294   0.01%
Radiation::filBndry                             10   0.001273   0.001363   0.001419   0.00%
Castro::build_fine_mask()                       18  0.0009581   0.001242    0.00137   0.00%
TagBoxArray::collate()                           4  0.0002549  0.0008987   0.001165   0.00%
Castro::avgDown()                                6  0.0009533  0.0009875   0.001012   0.00%
FabSetT<MF>::linComb()                          30  0.0009029  0.0009508   0.001011   0.00%
Castro::avgDown(state_indx)                     19  0.0009513  0.0009844   0.001008   0.00%
amrex::average_down_w_geom                      19    0.00092  0.0009517  0.0009731   0.00%
amrex::average_down                             19  0.0009114  0.0009414  0.0009649   0.00%
OwnerMask()                                      4  0.0008236  0.0008732  0.0009508   0.00%
Castro::finalize_advance()                      15  0.0005431  0.0006759  0.0009058   0.00%
FabArrayBase::getFB()                          181  0.0008087  0.0008337  0.0008926   0.00%
FabArrayBase::FB::FB()                          27  0.0006646  0.0006937  0.0007517   0.00%
Amr::InitAmr()                                   1   0.000556  0.0005675  0.0005782   0.00%
Radiation::deferred_sync_setup                   5  9.781e-05  0.0001117  0.0001702   0.00%
DistributionMapping::SFCProcessorMapDoIt()       3  8.838e-05  0.0001443  0.0001606   0.00%
Castro::enforce_speed_limit()                   58  3.189e-05  3.612e-05  4.471e-05   0.00%
RadSolve::levelBndry                            15  1.644e-05  2.631e-05  4.465e-05   0.00%
Amr::writeSmallPlotFile()                        1  3.678e-05  3.758e-05  3.939e-05   0.00%
AmrMesh-cluster                                  0          0  4.598e-06  3.678e-05   0.00%
Castro::estTimeStep()                           32  2.779e-05   3.04e-05  3.441e-05   0.00%
Castro::create_source_corrector()               15    1.4e-05  1.659e-05  2.711e-05   0.00%
ClusterList::intersect()                         0          0   2.98e-06  2.384e-05   0.00%
Castro::computeNewDt()                           6    1.6e-05  1.989e-05  2.364e-05   0.00%
Castro::retry_advance_ctu()                     15  1.308e-05  1.563e-05  1.824e-05   0.00%
Castro::apply_problem_tags()                     4  1.029e-05  1.324e-05  1.486e-05   0.00%
BoxList::parallelComplementIn()                  8  6.259e-06  7.982e-06  1.281e-05   0.00%
Amr::initSubcycle()                              1  9.883e-06   1.11e-05  1.198e-05   0.00%
DistributionMapping::Distribute()                3  7.592e-06  8.344e-06  1.059e-05   0.00%
Castro::computeInitialDt()                       2  2.703e-06   3.93e-06   4.62e-06   0.00%
BoxList::complementIn                            8  2.526e-06  3.395e-06  4.093e-06   0.00%
ClusterList::chop()                              0          0  3.155e-07  2.524e-06   0.00%
-------------------------------------------------------------------------------------------

Unused ParmParse Variables:
  [TOP]::castro.gravity(nvals = 1)  :: [0]
  [TOP]::habec.verbose(nvals = 1)  :: [1]

Pinned Memory Usage:
---------------------------------------------------------------------------------------------------------------------
Name                            Nalloc  Nfree  AvgMem min  AvgMem avg  AvgMem max  MaxMem min  MaxMem avg  MaxMem max
---------------------------------------------------------------------------------------------------------------------
The_Pinned_Arena::Initialize()       8      8       3   B       3   B       4   B    8192 KiB    8192 KiB    8192 KiB
---------------------------------------------------------------------------------------------------------------------

AMReX (23.08-19-ge7d3d5a4fad6) finalized