MPI initialized with 8 MPI processes
MPI initialized with thread support level 3
AMReX (23.07-27-gb523c3297d00) initialized
Starting run at 07:02:49 UTC on 2023-07-19.
Successfully read inputs file ...
Castro git describe: 23.07-16-gcd2cd9695
AMReX git describe: 23.07-27-gb523c3297
Microphysics git describe: 23.07-34-g0ef8cc66
reading extern runtime parameters ...
13 Species:
He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56
Successfully read inputs file ...
Castro::numpts_1d at level 0 is 118
Setting the gravity type to PoissonGrav
Initializing the data at level 0
Done initializing the level 0 data
...estimated hydro-limited timestep at level 0: 0.0006897957295
...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295
grid_places() time: 0.002763864 new finest: 1
Castro::numpts_1d at level 1 is 229
Initializing the data at level 1
Done initializing the level 1 data
Now regridding at level lbase = 0
grid_places() time: 0.106821084 new finest: 1
Castro::numpts_1d at level 1 is 229
Initializing the data at level 1
Done initializing the level 1 data
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 27 grids 884736 cells 42.1875 % of domain
smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32
Now regridding at level lbase = 0
grid_places() time: 0.001721457 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 12 grids 163840 cells 7.8125 % of domain
smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16
Relaxation iterations completed: 1
L-infinity norm of residual (relative to old state): 0.9989762608
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -3.124305956e+51
Internal energy: 2.436922647e+50
Virial error: 0.7660034566
Mass: 6.318509172 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.002080192 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 2
L-infinity norm of residual (relative to old state): 0.9279058977
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -6.67850462e+50
Internal energy: 1.437332213e+50
Virial error: 0.3543469856
Mass: 3.906872525 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001118446 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 3
L-infinity norm of residual (relative to old state): 0.7274381815
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -2.541614827e+50
Internal energy: 8.137035244e+49
Virial error: 0.03954346396
Mass: 1.897844596 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.00108181 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 4
L-infinity norm of residual (relative to old state): 0.422397066
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -2.155509991e+50
Internal energy: 7.709619679e+49
Virial error: 0.07301098743
Mass: 1.824999774 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001106726 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 5
L-infinity norm of residual (relative to old state): 0.1636021093
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -2.022705738e+50
Internal energy: 7.549212217e+49
Virial error: 0.1196703616
Mass: 1.79765548 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001064844 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 6
L-infinity norm of residual (relative to old state): 0.05463665804
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.975079248e+50
Internal energy: 7.490161061e+49
Virial error: 0.1377003328
Mass: 1.787603551 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001076954 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 7
L-infinity norm of residual (relative to old state): 0.02057466715
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.9579391e+50
Internal energy: 7.468777332e+49
Virial error: 0.1443835001
Mass: 1.783968613 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001150482 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 8
L-infinity norm of residual (relative to old state): 0.007452617698
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.951802533e+50
Internal energy: 7.461117376e+49
Virial error: 0.1468041335
Mass: 1.782667786 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001085814 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 9
L-infinity norm of residual (relative to old state): 0.002655581458
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.949616885e+50
Internal energy: 7.458390948e+49
Virial error: 0.1476702429
Mass: 1.782205054 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001106097 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 10
L-infinity norm of residual (relative to old state): 0.0009395966873
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.948841216e+50
Internal energy: 7.457424042e+49
Virial error: 0.1479781906
Mass: 1.782041006 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001099944 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 11
L-infinity norm of residual (relative to old state): 0.0003312401846
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.948566562e+50
Internal energy: 7.457081878e+49
Virial error: 0.1480873206
Mass: 1.781982964 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001128629 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 12
L-infinity norm of residual (relative to old state): 0.0001164660774
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.948469459e+50
Internal energy: 7.456960981e+49
Virial error: 0.148125922
Mass: 1.781962456 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001083375 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 13
L-infinity norm of residual (relative to old state): 4.095225831e-05
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.94843517e+50
Internal energy: 7.456918333e+49
Virial error: 0.1481395608
Mass: 1.781955219 solar masses
Relaxation completed!
TIME= 0 MASS = 8.352245583e+32
TIME= 0 XMOM = 0
TIME= 0 YMOM = 0
TIME= 0 ZMOM = 0
TIME= 0 ANG MOM X = 0
TIME= 0 ANG MOM Y = 0
TIME= 0 ANG MOM Z = 0
TIME= 0 RHO*e = 2.118052636e+49
TIME= 0 RHO*K = 0
TIME= 0 RHO*E = 2.118052636e+49
TIME= 0 RHO*PHI = -8.163063831e+49
TIME= 0 TOTAL ENERGY= -1.963479279e+49
TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07
TIME= 0 CENTER OF MASS X-VEL = 0
TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06
TIME= 0 CENTER OF MASS Y-VEL = 0
TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05
TIME= 0 CENTER OF MASS Z-VEL = 0
TIME= 0 MAXIMUM TEMPERATURE = 32885673.5
TIME= 0 MAXIMUM DENSITY = 1351900
INITIAL GRIDS
Level 0 8 grids 262144 cells 100 % of domain
smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
PLOTFILE: file = scf-test_plt00000
Write plotfile time = 0.236481214 seconds
Ending run at 07:02:55 UTC on 2023-07-19.
Run time = 6.236846999
Run time without initialization = 0.000298894
Average number of zones advanced per microsecond: 0.000
Average number of zones advanced per microsecond per rank: 0.000
TinyProfiler total time across processes [min...avg...max]: 6.237 ... 6.237 ... 6.237
--------------------------------------------------------------------------------------------
Name NCalls Excl. Min Excl. Avg Excl. Max Max %
--------------------------------------------------------------------------------------------
Gravity::fill_multipole_BCs() 14 1.1146 1.1294 1.1447 18.35%
Amr::InitAmr() 1 1.138 1.138 1.138 18.24%
Castro::post_init() 2 0.9576 0.9588 0.9598 15.39%
Castro::computeTemp() 36 0.6993 0.7388 0.8027 12.87%
Castro::reset_internal_energy(Fab) 654 0.3916 0.417 0.4529 7.26%
FabArray::ParallelCopy_finish() 2952 0.06953 0.2584 0.3729 5.98%
MLPoisson::Fsmooth() 5088 0.2315 0.2391 0.249 3.99%
Castro::normalize_species() 33 0.1639 0.1733 0.1864 2.99%
Castro::initData() 3 0.1161 0.1284 0.15 2.40%
AmrLevel::derive() 97 0.139 0.1413 0.1444 2.31%
amrex::Copy() 975 0.1319 0.1344 0.1366 2.19%
Castro::initMFs() 16 0.09825 0.1081 0.1237 1.98%
FillBoundary_finish() 5552 0.05238 0.06025 0.0718 1.15%
StateData::define() 64 0.05661 0.06217 0.07114 1.14%
amrex::average_down 844 0.04376 0.0469 0.05072 0.81%
FabArray::setVal() 1769 0.04232 0.04582 0.04925 0.79%
FillBoundary_nowait() 5552 0.0404 0.04139 0.04283 0.69%
MLCellLinOp::applyBC() 6294 0.03494 0.03673 0.04026 0.65%
VisMF::Write(FabArray) 2 0.03006 0.03064 0.03311 0.53%
FabArray::ParallelCopy_nowait() 2952 0.02341 0.02595 0.03064 0.49%
MLPoisson::Fapply() 1040 0.02363 0.02464 0.02572 0.41%
Castro::estTimeStep() 1 0.02173 0.023 0.02557 0.41%
Amr::regrid() 14 0.01484 0.01645 0.02009 0.32%
MLMG::addInterpCorrection() 530 0.01935 0.01963 0.01992 0.32%
FillPatchIterator::Initialize 215 0.01539 0.01676 0.01754 0.28%
MLCellLinOp::reflux() 138 0.01665 0.017 0.01732 0.28%
Castro::buildMetrics() 16 0.01233 0.01354 0.0154 0.25%
MultiFab::Multiply() 287 0.01239 0.01297 0.01355 0.22%
FabArray::Xpay() 1013 0.0122 0.01262 0.01345 0.22%
MLCellLinOp::updateSolBC() 120 0.01059 0.01152 0.01208 0.19%
amrex::Add() 575 0.01072 0.01111 0.01166 0.19%
MLPoisson::FFlux() 3408 0.01112 0.01127 0.01136 0.18%
Castro::Castro() 16 0.008819 0.009613 0.01115 0.18%
MLCellLinOp::updateCorBC() 106 0.009491 0.01032 0.01083 0.17%
FillPatchInterp(MF) 44 0.001969 0.007244 0.01081 0.17%
Amr::writePlotFile() 1 0.005474 0.007808 0.008585 0.14%
MLMG::interpCorrection_1 106 0.006289 0.006907 0.007543 0.12%
AmrMesh::MakeNewGrids() 15 0.006213 0.00628 0.006402 0.10%
Castro::apply_tagging_restrictions() 15 0.005643 0.005941 0.006308 0.10%
MLMG::prepareForSolve() 14 0.004711 0.004942 0.00509 0.08%
FabArray::norminf(mask) 46 0.004777 0.004829 0.004874 0.08%
MLMG::ResNormInf() 152 0.002702 0.003541 0.004275 0.07%
MLCellLinOp::defineAuxData() 14 0.003803 0.00389 0.004025 0.06%
MLLinOp::makeSubCommunicator() 14 0.0004593 0.002509 0.00399 0.06%
FabArray::norminf() 174 0.002937 0.003195 0.003637 0.06%
FabArrayBase::getCPC() 3662 0.003423 0.003511 0.003631 0.06%
MultiFab::max() 54 0.002941 0.003209 0.003387 0.05%
MLCellLinOp::compGrad() 28 0.003172 0.003263 0.003347 0.05%
Gravity::multilevel_solve_for_new_phi() 14 0.002625 0.002941 0.003105 0.05%
Castro::enforce_min_density() 33 0.002718 0.002845 0.003033 0.05%
BndryData::define() 42 0.002278 0.002349 0.002442 0.04%
Gravity::get_new_grav_vector() 4 0.001836 0.00208 0.002399 0.04%
Gravity::actual_solve_with_mlmg() 14 0.001929 0.002021 0.002155 0.03%
DistributionMapping::LeastUsedCPUs() 9 0.0001792 0.001138 0.00211 0.03%
FabArray::FillBoundary() 5552 0.001953 0.002002 0.002086 0.03%
MLCellLinOp::defineBC() 14 0.001798 0.001938 0.002008 0.03%
FabArrayBase::CPC::define() 624 0.001576 0.00171 0.001915 0.03%
MLCellLinOp::smooth() 2544 0.001658 0.001703 0.001812 0.03%
Castro::volWgtSum() 46 0.001695 0.001717 0.001758 0.03%
MLCGSolver::bicgstab 13 0 0.0001892 0.001514 0.02%
FabArray::mult() 34 0.001099 0.001269 0.001455 0.02%
Castro::enforce_consistent_e() 3 0.0009698 0.001134 0.00136 0.02%
FillPatchTwoLevels 126 0.0006735 0.001095 0.001349 0.02%
StateData::FillBoundary(geom) 8 0.001209 0.00127 0.001338 0.02%
FabArray::ParallelCopy() 2952 0.001199 0.001233 0.00129 0.02%
average_down_faces 84 0.001082 0.001172 0.001273 0.02%
FabArrayBase::getFB() 5552 0.0009809 0.001018 0.001089 0.02%
AMRErrorTag::operator() 15 0.0009381 0.0009643 0.001024 0.02%
Gravity::actual_multilevel_solve() 14 0.0007602 0.0008768 0.0009139 0.01%
Castro::build_fine_mask() 55 0.0006526 0.0007109 0.0007541 0.01%
Castro::sum_integrated_quantities() 1 0.0005201 0.0005966 0.0007357 0.01%
MLMG::solve() 14 0.0003956 0.0004773 0.0005847 0.01%
MLCellLinOp::apply() 1040 0.0004297 0.0004597 0.0005794 0.01%
AmrLevel::FillPatch() 215 0.0004846 0.0005067 0.000543 0.01%
TagBoxArray::collate() 15 0.0002304 0.0003556 0.0005423 0.01%
FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000477 0.0004934 0.00052 0.01%
Amr::grid_places() 15 0.0003313 0.00037 0.0004789 0.01%
MLCellLinOp::correctionResidual() 755 0.0003737 0.0003996 0.000465 0.01%
MLMG::mgVcycle() 318 0.0004081 0.0004296 0.000462 0.01%
MLCellLinOp::prepareForSolve() 14 0.0003587 0.0003808 0.0004501 0.01%
FabArray::setDomainBndry() 259 0.0003559 0.000398 0.0004445 0.01%
main() 1 0.0003644 0.0003953 0.0004371 0.01%
Castro::reset_internal_energy(MultiFab) 36 0.000286 0.0003316 0.0003889 0.01%
MLLinOp::defineGrids() 14 0.000257 0.0003083 0.0003746 0.01%
MLCellLinOp::setLevelBC() 28 0.0003354 0.0003462 0.0003635 0.01%
MLMG::MLResNormInf() 32 0.0001914 0.0002563 0.0003599 0.01%
MLMG::oneIter() 106 0.0002619 0.0002798 0.0003021 0.00%
Gravity::average_fine_ec_onto_crse_ec() 14 0.0002711 0.0002796 0.0002909 0.00%
MLMG::mgVcycle_bottom 318 0.0002135 0.0002285 0.0002527 0.00%
MLMG::actualBottomSolve() 106 2.401e-05 5.408e-05 0.0002504 0.00%
MLCGSolver::ParallelAllReduce 81 0 2.986e-05 0.0002389 0.00%
Castro::locWgtSum() 6 0.0001904 0.0001934 0.0001971 0.00%
MLCellLinOp::solutionResidual() 258 0.0001691 0.0001839 0.0001924 0.00%
AmrLevel::AmrLevel(dm) 16 0.0001307 0.0001596 0.000177 0.00%
MLMG::computeResWithCrseSolFineCor() 106 0.000158 0.0001639 0.0001768 0.00%
MLMG:computeResOfCorrection() 530 0.0001509 0.000157 0.0001656 0.00%
StateDataPhysBCFunct::() 259 0.0001381 0.0001442 0.0001499 0.00%
FillPatchSingleLevel 259 0.0001414 0.0001432 0.0001481 0.00%
FillPatchIterator::FillFromTwoLevels() 126 0.0001143 0.0001228 0.0001447 0.00%
Gravity::update_max_rhs() 1 8.921e-05 0.0001109 0.0001434 0.00%
MLMG::mgVcycle_down::0 106 0.000134 0.0001366 0.0001412 0.00%
FabArrayBase::FB::FB() 35 7.543e-05 8.821e-05 0.0001387 0.00%
FillPatchIterator::FillFromLevel0() 89 0.0001103 0.0001176 0.0001254 0.00%
OwnerMask() 15 0.0001027 0.0001098 0.0001208 0.00%
MLMG::mgVcycle_down::1 106 0.0001088 0.0001129 0.0001197 0.00%
amrex::Dot() 54 0 1.481e-05 0.0001185 0.00%
TagBoxArray::mapPRD 15 9.167e-05 0.0001016 0.0001088 0.00%
MLMG::miniCycle() 212 8.382e-05 9.235e-05 0.000107 0.00%
Castro::volProductSum() 2 8.386e-05 9.142e-05 0.0001012 0.00%
Castro::errorEst() 15 4.517e-05 5.57e-05 9.95e-05 0.00%
Amr::FinalizeInit() 1 7.729e-06 2.957e-05 9.916e-05 0.00%
FabArray::LinComb() 27 0 1.219e-05 9.752e-05 0.00%
MLMG::mgVcycle_down::3 106 7.59e-05 8.137e-05 9.517e-05 0.00%
Castro::post_regrid() 30 6.302e-05 8.029e-05 9.34e-05 0.00%
MLMG::computeResWithCrseCorFineCor() 106 8.433e-05 8.685e-05 9.226e-05 0.00%
FPinfo::FPinfo() 9 6.434e-05 7.687e-05 9.076e-05 0.00%
FabArray::Saxpy() 27 0 1.123e-05 8.984e-05 0.00%
MLMG::mgVcycle_down::2 106 8.35e-05 8.527e-05 8.922e-05 0.00%
MLMG::mgVcycle_down::4 106 6.92e-05 7.532e-05 8.807e-05 0.00%
Castro::avgDown(state_indx) 60 6.474e-05 7.05e-05 8.149e-05 0.00%
MLMG::mgVcycle_up::3 106 5.51e-05 6.179e-05 7.89e-05 0.00%
MLMG::mgVcycle_up::0 106 6.414e-05 6.781e-05 7.679e-05 0.00%
Castro::clean_state() 33 6.255e-05 6.935e-05 7.479e-05 0.00%
MLMG::mgVcycle_up::4 106 6.232e-05 6.603e-05 7.407e-05 0.00%
FabArrayBase::TheFPinfo() 49 5.944e-05 6.74e-05 7.354e-05 0.00%
Castro::derive() 97 6.137e-05 6.721e-05 7.194e-05 0.00%
amrex::average_down_w_geom 60 3.67e-05 4.719e-05 7.131e-05 0.00%
Gravity::solve_phi_with_mlmg() 14 5.706e-05 6.57e-05 7.066e-05 0.00%
MLMG::computeResidual() 106 5.741e-05 6.045e-05 6.608e-05 0.00%
MLMG::mgVcycle_up::2 106 5.397e-05 5.743e-05 6.337e-05 0.00%
MLMG::mgVcycle_up::1 106 5.493e-05 5.808e-05 6.144e-05 0.00%
Castro::avgDown() 15 3.383e-05 4.434e-05 6.063e-05 0.00%
Amr::writeSmallPlotFile() 1 2.868e-05 3.358e-05 5.726e-05 0.00%
ClusterList::intersect() 1 0 6.54e-06 5.232e-05 0.00%
Castro::init(old) 13 4.472e-05 4.674e-05 5.158e-05 0.00%
MLMG::computeMLResidual() 32 3.55e-05 4.025e-05 4.967e-05 0.00%
MLPoisson::define() 14 3.093e-05 3.918e-05 4.56e-05 0.00%
makeSFC 42 2.566e-05 3.379e-05 4.185e-05 0.00%
Amr::defBaseLevel() 1 1.654e-05 2.955e-05 3.88e-05 0.00%
DistributionMapping::SFCProcessorMapDoIt() 4 1.471e-05 2.562e-05 3.813e-05 0.00%
Amr::bldFineLevels() 1 1.385e-05 2.471e-05 3.487e-05 0.00%
AmrMesh-cluster 1 0 4.116e-06 3.293e-05 0.00%
DistributionMapping::Distribute() 46 2.053e-05 2.531e-05 2.717e-05 0.00%
MLLinOp::makeAgglomeratedDMap 14 2.113e-05 2.289e-05 2.476e-05 0.00%
MLMG::getGradSolution() 14 1.72e-05 1.852e-05 2.083e-05 0.00%
MLLinOp::define() 14 1.561e-05 1.78e-05 2.049e-05 0.00%
FabArray::RecvLayoutMask() 14 1.652e-05 1.706e-05 1.751e-05 0.00%
Castro::enforce_speed_limit() 33 1.155e-05 1.32e-05 1.691e-05 0.00%
ClusterList::chop() 1 0 1.985e-06 1.588e-05 0.00%
MLPoisson::prepareForSolve() 14 1.267e-05 1.338e-05 1.452e-05 0.00%
BoxList::complementIn 30 9.181e-06 1.096e-05 1.296e-05 0.00%
knapsack() 2 9.834e-06 1.112e-05 1.18e-05 0.00%
BoxList::parallelComplementIn() 30 1.054e-05 1.109e-05 1.155e-05 0.00%
Amr::initSubcycle() 1 8.548e-06 9.518e-06 1.032e-05 0.00%
Castro::apply_problem_tags() 15 8.019e-06 8.524e-06 9.013e-06 0.00%
MLMG::MLRhsNormInf() 14 8.137e-06 8.376e-06 8.632e-06 0.00%
Amr::init() 1 1.556e-06 2.549e-06 6.723e-06 0.00%
DistributionMapping::KnapSackDoIt() 2 3.764e-06 4.243e-06 4.679e-06 0.00%
Amr::InitializeInit() 1 1.914e-06 2.578e-06 3.812e-06 0.00%
Gravity::set_mass_offset() 1 8.43e-07 2.104e-06 3.514e-06 0.00%
Castro::computeInitialDt() 1 1.849e-06 2.322e-06 3.331e-06 0.00%
Castro::gwstrain() 2 1.042e-06 1.246e-06 1.627e-06 0.00%
Amr::initialInit() 1 1.216e-06 1.359e-06 1.527e-06 0.00%
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
Name NCalls Incl. Min Incl. Avg Incl. Max Max %
--------------------------------------------------------------------------------------------
main() 1 6.237 6.237 6.237 100.00%
Amr::init() 1 5.099 5.099 5.099 81.75%
Amr::initialInit() 1 4.862 4.862 4.862 77.96%
Amr::FinalizeInit() 1 4.753 4.755 4.757 76.28%
Castro::post_init() 2 3.526 3.637 3.705 59.40%
Gravity::multilevel_solve_for_new_phi() 14 1.755 1.768 1.783 28.58%
Gravity::actual_multilevel_solve() 14 1.752 1.766 1.78 28.54%
Gravity::solve_phi_with_mlmg() 14 1.746 1.759 1.774 28.44%
Castro::computeTemp() 36 1.091 1.156 1.256 20.14%
Amr::regrid() 14 1.205 1.214 1.232 19.76%
Castro::clean_state() 33 1.055 1.105 1.181 18.93%
Gravity::fill_multipole_BCs() 14 1.116 1.131 1.146 18.38%
Amr::InitAmr() 1 1.138 1.138 1.138 18.24%
Amr::bldFineLevels() 1 0.8894 0.9432 1.029 16.49%
Castro::post_regrid() 30 0.8143 0.8382 0.8737 14.01%
Castro::initData() 3 0.5749 0.6359 0.7355 11.79%
Gravity::actual_solve_with_mlmg() 14 0.6259 0.6279 0.6295 10.09%
MLMG::solve() 14 0.6076 0.6081 0.6084 9.75%
MLMG::oneIter() 106 0.5368 0.5375 0.5381 8.63%
Castro::reset_internal_energy(MultiFab) 36 0.3919 0.4173 0.4533 7.27%
Castro::reset_internal_energy(Fab) 654 0.3916 0.417 0.4529 7.26%
FabArray::ParallelCopy() 2952 0.1284 0.3131 0.4267 6.84%
MLMG::mgVcycle() 318 0.4054 0.4065 0.4077 6.54%
FabArray::ParallelCopy_finish() 2952 0.06953 0.2584 0.3729 5.98%
MLCellLinOp::smooth() 2544 0.3374 0.3394 0.3459 5.55%
amrex::average_down 844 0.07633 0.188 0.2561 4.11%
MLPoisson::Fsmooth() 5088 0.2315 0.2391 0.249 3.99%
Amr::writePlotFile() 1 0.2366 0.2367 0.2368 3.80%
Castro::avgDown() 15 0.04681 0.1586 0.2266 3.63%
Castro::avgDown(state_indx) 60 0.04677 0.1585 0.2266 3.63%
amrex::average_down_w_geom 60 0.04669 0.1584 0.2265 3.63%
Castro::derive() 97 0.199 0.1992 0.1995 3.20%
AmrLevel::derive() 97 0.1989 0.1991 0.1994 3.20%
Castro::normalize_species() 33 0.1639 0.1733 0.1864 2.99%
Castro::Castro() 16 0.1377 0.1516 0.172 2.76%
MLCellLinOp::applyBC() 6294 0.1367 0.1415 0.1507 2.42%
amrex::Copy() 975 0.1319 0.1344 0.1366 2.19%
Amr::grid_places() 15 0.01935 0.0846 0.1249 2.00%
AmrMesh::MakeNewGrids() 15 0.01896 0.08423 0.1246 2.00%
Castro::initMFs() 16 0.09825 0.1081 0.1237 1.98%
AmrLevel::FillPatch() 215 0.116 0.1187 0.122 1.96%
FabArray::FillBoundary() 5552 0.09664 0.1047 0.1157 1.86%
MLMG::mgVcycle_down::0 106 0.1121 0.113 0.1144 1.83%
MLMG::mgVcycle_bottom 318 0.1077 0.1094 0.1139 1.83%
MLMG::miniCycle() 212 0.1078 0.1091 0.1103 1.77%
Amr::InitializeInit() 1 0.1047 0.1073 0.1086 1.74%
Amr::defBaseLevel() 1 0.1047 0.1073 0.1086 1.74%
TagBoxArray::mapPRD 15 0.002037 0.06758 0.1082 1.73%
MLMG::mgVcycle_up::0 106 0.1055 0.1058 0.1062 1.70%
FillPatchIterator::Initialize 215 0.08833 0.0931 0.09618 1.54%
MLMG::computeResWithCrseSolFineCor() 106 0.07062 0.07222 0.07329 1.18%
FillBoundary_finish() 5552 0.05238 0.06025 0.0718 1.15%
AmrLevel::AmrLevel(dm) 16 0.05677 0.06233 0.07127 1.14%
StateData::define() 64 0.05661 0.06217 0.07114 1.14%
FillPatchSingleLevel 259 0.05262 0.05699 0.06059 0.97%
MLCellLinOp::apply() 1040 0.05665 0.05874 0.06055 0.97%
MLCellLinOp::correctionResidual() 755 0.05504 0.05669 0.05815 0.93%
FabArray::ParallelCopy_nowait() 2952 0.05041 0.05343 0.05764 0.92%
MLCellLinOp::solutionResidual() 258 0.05195 0.05439 0.05626 0.90%
FillPatchIterator::FillFromTwoLevels() 126 0.04549 0.04938 0.05204 0.83%
FillPatchTwoLevels 126 0.04537 0.04925 0.05193 0.83%
Castro::init(old) 13 0.04525 0.04769 0.0502 0.80%
FabArray::setVal() 1769 0.04232 0.04582 0.04925 0.79%
MLCellLinOp::reflux() 138 0.04645 0.04799 0.04888 0.78%
FillBoundary_nowait() 5552 0.04148 0.0425 0.04392 0.70%
MLMG::addInterpCorrection() 530 0.02135 0.03162 0.03328 0.53%
VisMF::Write(FabArray) 2 0.03006 0.03064 0.03311 0.53%
MLMG::computeResWithCrseCorFineCor() 106 0.02983 0.03096 0.03141 0.50%
FillPatchIterator::FillFromLevel0() 89 0.02492 0.02662 0.02866 0.46%
MLMG::computeResidual() 106 0.02642 0.02762 0.02808 0.45%
MLPoisson::Fapply() 1040 0.02363 0.02464 0.02572 0.41%
Castro::computeInitialDt() 1 0.02173 0.023 0.02557 0.41%
Castro::estTimeStep() 1 0.02173 0.023 0.02557 0.41%
MLMG::mgVcycle_down::1 106 0.02263 0.02313 0.0235 0.38%
MLMG::computeMLResidual() 32 0.02004 0.02081 0.02133 0.34%
MLCellLinOp::updateSolBC() 120 0.01949 0.02041 0.02125 0.34%
MLMG::mgVcycle_up::2 106 0.008389 0.01915 0.02087 0.33%
MLMG::mgVcycle_up::1 106 0.02052 0.0206 0.02068 0.33%
MLCellLinOp::updateCorBC() 106 0.01798 0.01879 0.01954 0.31%
Gravity::get_new_grav_vector() 4 0.01817 0.01859 0.0193 0.31%
MLMG:computeResOfCorrection() 530 0.01771 0.01786 0.0182 0.29%
Castro::buildMetrics() 16 0.0138 0.01525 0.01737 0.28%
MLPoisson::define() 14 0.0108 0.01289 0.0144 0.23%
MultiFab::Multiply() 287 0.01239 0.01297 0.01355 0.22%
FabArray::Xpay() 1013 0.0122 0.01262 0.01345 0.22%
MLMG::interpCorrection_1 106 0.009632 0.01059 0.01172 0.19%
amrex::Add() 575 0.01072 0.01111 0.01166 0.19%
MLPoisson::FFlux() 3408 0.01112 0.01127 0.01136 0.18%
FillPatchInterp(MF) 44 0.001969 0.007244 0.01081 0.17%
MLMG::ResNormInf() 152 0.009161 0.009792 0.01048 0.17%
Castro::errorEst() 15 0.009454 0.009743 0.0104 0.17%
MLMG::mgVcycle_down::2 106 0.009145 0.009358 0.01025 0.16%
MLMG::prepareForSolve() 14 0.009647 0.009862 0.0102 0.16%
Castro::apply_tagging_restrictions() 15 0.005643 0.005941 0.006308 0.10%
FabArrayBase::getCPC() 3662 0.00506 0.005221 0.005452 0.09%
MLCellLinOp::defineAuxData() 14 0.00485 0.004961 0.005225 0.08%
MLCellLinOp::defineBC() 14 0.004806 0.004982 0.005082 0.08%
Castro::sum_integrated_quantities() 1 0.004817 0.004854 0.004946 0.08%
FabArray::norminf(mask) 46 0.004777 0.004829 0.004874 0.08%
MLMG::getGradSolution() 14 0.004447 0.004525 0.004611 0.07%
MLCellLinOp::compGrad() 28 0.00443 0.004506 0.004593 0.07%
MLMG::mgVcycle_down::3 106 0.001286 0.001773 0.004485 0.07%
MLLinOp::define() 14 0.0007996 0.002912 0.00447 0.07%
MLLinOp::defineGrids() 14 0.0007824 0.002894 0.004451 0.07%
MLMG::MLResNormInf() 32 0.003867 0.003977 0.004085 0.07%
MLLinOp::makeSubCommunicator() 14 0.0004593 0.002509 0.00399 0.06%
MLMG::actualBottomSolve() 106 2.401e-05 0.0004896 0.003734 0.06%
MLMG::mgVcycle_up::3 106 0.0009256 0.001281 0.003653 0.06%
FabArray::norminf() 174 0.002937 0.003195 0.003637 0.06%
Gravity::average_fine_ec_onto_crse_ec() 14 0.003308 0.00346 0.003544 0.06%
MLCGSolver::bicgstab 13 0 0.0004292 0.003433 0.06%
MultiFab::max() 54 0.002941 0.003209 0.003387 0.05%
Castro::enforce_min_density() 33 0.002718 0.002845 0.003033 0.05%
BndryData::define() 42 0.002824 0.002916 0.003025 0.05%
MLMG::mgVcycle_down::4 106 0.001126 0.001319 0.002345 0.04%
FabArrayBase::TheFPinfo() 49 0.000266 0.001224 0.002196 0.04%
average_down_faces 84 0.001905 0.002045 0.002163 0.03%
FPinfo::FPinfo() 9 0.0002047 0.001156 0.002125 0.03%
DistributionMapping::LeastUsedCPUs() 9 0.0001792 0.001138 0.00211 0.03%
FabArrayBase::CPC::define() 624 0.001576 0.00171 0.001915 0.03%
MLMG::mgVcycle_up::4 106 0.001084 0.001203 0.0019 0.03%
MLMG::MLRhsNormInf() 14 0.001732 0.001769 0.001801 0.03%
Castro::volWgtSum() 46 0.0017 0.001722 0.001764 0.03%
StateDataPhysBCFunct::() 259 0.001347 0.001414 0.001488 0.02%
FabArray::mult() 34 0.001099 0.001269 0.001455 0.02%
Castro::enforce_consistent_e() 3 0.0009698 0.001134 0.00136 0.02%
StateData::FillBoundary(geom) 8 0.001209 0.00127 0.001338 0.02%
FabArrayBase::getFB() 5552 0.001059 0.001107 0.001228 0.02%
AMRErrorTag::operator() 15 0.0009381 0.0009643 0.001024 0.02%
Gravity::update_max_rhs() 1 0.0006038 0.0008657 0.001024 0.02%
Castro::build_fine_mask() 55 0.0006526 0.0007109 0.0007541 0.01%
DistributionMapping::KnapSackDoIt() 2 5.297e-05 0.0002459 0.0005531 0.01%
TagBoxArray::collate() 15 0.0002304 0.0003556 0.0005423 0.01%
FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000477 0.0004934 0.00052 0.01%
MLPoisson::prepareForSolve() 14 0.0003718 0.0003941 0.0004628 0.01%
MLCellLinOp::prepareForSolve() 14 0.0003587 0.0003808 0.0004501 0.01%
FabArray::setDomainBndry() 259 0.0003559 0.000398 0.0004445 0.01%
MLCellLinOp::setLevelBC() 28 0.0003354 0.0003462 0.0003635 0.01%
MLCGSolver::ParallelAllReduce 81 0 3.846e-05 0.0003077 0.00%
Castro::locWgtSum() 6 0.0001909 0.000194 0.0001977 0.00%
FabArrayBase::FB::FB() 35 7.543e-05 8.821e-05 0.0001387 0.00%
OwnerMask() 15 0.0001027 0.0001098 0.0001208 0.00%
amrex::Dot() 54 0 1.481e-05 0.0001185 0.00%
DistributionMapping::SFCProcessorMapDoIt() 4 7.336e-05 0.0001054 0.0001152 0.00%
Castro::volProductSum() 2 8.405e-05 9.165e-05 0.0001014 0.00%
AmrMesh-cluster 1 0 1.264e-05 0.0001011 0.00%
FabArray::LinComb() 27 0 1.219e-05 9.752e-05 0.00%
FabArray::Saxpy() 27 0 1.123e-05 8.984e-05 0.00%
MLLinOp::makeAgglomeratedDMap 14 6.606e-05 7.668e-05 8.676e-05 0.00%
makeSFC 42 4.408e-05 5.378e-05 6.337e-05 0.00%
Amr::writeSmallPlotFile() 1 2.868e-05 3.358e-05 5.726e-05 0.00%
ClusterList::intersect() 1 0 6.54e-06 5.232e-05 0.00%
DistributionMapping::Distribute() 46 2.053e-05 2.531e-05 2.717e-05 0.00%
BoxList::parallelComplementIn() 30 2.038e-05 2.205e-05 2.441e-05 0.00%
FabArray::RecvLayoutMask() 14 1.652e-05 1.706e-05 1.751e-05 0.00%
Castro::enforce_speed_limit() 33 1.155e-05 1.32e-05 1.691e-05 0.00%
ClusterList::chop() 1 0 1.985e-06 1.588e-05 0.00%
BoxList::complementIn 30 9.181e-06 1.096e-05 1.296e-05 0.00%
knapsack() 2 9.834e-06 1.112e-05 1.18e-05 0.00%
Amr::initSubcycle() 1 8.548e-06 9.518e-06 1.032e-05 0.00%
Castro::apply_problem_tags() 15 8.019e-06 8.524e-06 9.013e-06 0.00%
Gravity::set_mass_offset() 1 8.43e-07 2.104e-06 3.514e-06 0.00%
Castro::gwstrain() 2 1.042e-06 1.246e-06 1.627e-06 0.00%
--------------------------------------------------------------------------------------------
Pinned Memory Usage:
---------------------------------------------------------------------------------------------------------------------
Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max
---------------------------------------------------------------------------------------------------------------------
The_Pinned_Arena::Initialize() 8 8 17 B 19 B 22 B 8192 KiB 8192 KiB 8192 KiB
---------------------------------------------------------------------------------------------------------------------
AMReX (23.07-27-gb523c3297d00) finalized