MPI initialized with 8 MPI processes
MPI initialized with thread support level 3
AMReX (23.07-51-gbba6d9c2bc68) initialized
Starting run at 07:05:28 UTC on 2023-07-28.
Successfully read inputs file ...
Castro git describe: 23.07-20-g4174f17eb
AMReX git describe: 23.07-51-gbba6d9c2b
Microphysics git describe: 23.07-48-g588beb9c
reading extern runtime parameters ...
13 Species:
He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56
Successfully read inputs file ...
Castro::numpts_1d at level 0 is 118
Setting the gravity type to PoissonGrav
Initializing the data at level 0
Done initializing the level 0 data
...estimated hydro-limited timestep at level 0: 0.0006897957295
...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295
grid_places() time: 0.002852663 new finest: 1
Castro::numpts_1d at level 1 is 229
Initializing the data at level 1
Done initializing the level 1 data
Now regridding at level lbase = 0
grid_places() time: 0.110604201 new finest: 1
Castro::numpts_1d at level 1 is 229
Initializing the data at level 1
Done initializing the level 1 data
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 27 grids 884736 cells 42.1875 % of domain
smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32
Now regridding at level lbase = 0
grid_places() time: 0.001470098 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 12 grids 163840 cells 7.8125 % of domain
smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16
Relaxation iterations completed: 1
L-infinity norm of residual (relative to old state): 0.9989762608
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -3.124305956e+51
Internal energy: 2.436922647e+50
Virial error: 0.7660034566
Mass: 6.318509172 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001921551 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 2
L-infinity norm of residual (relative to old state): 0.9279058977
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -6.67850462e+50
Internal energy: 1.437332213e+50
Virial error: 0.3543469856
Mass: 3.906872525 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.00106261 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 3
L-infinity norm of residual (relative to old state): 0.7274381815
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -2.541614827e+50
Internal energy: 8.137035244e+49
Virial error: 0.03954346396
Mass: 1.897844596 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001048827 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 4
L-infinity norm of residual (relative to old state): 0.422397066
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -2.155509991e+50
Internal energy: 7.709619679e+49
Virial error: 0.07301098743
Mass: 1.824999774 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001064047 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 5
L-infinity norm of residual (relative to old state): 0.1636021093
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -2.022705738e+50
Internal energy: 7.549212217e+49
Virial error: 0.1196703616
Mass: 1.79765548 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001065808 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 6
L-infinity norm of residual (relative to old state): 0.05463665804
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.975079248e+50
Internal energy: 7.490161061e+49
Virial error: 0.1377003328
Mass: 1.787603551 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001057529 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 7
L-infinity norm of residual (relative to old state): 0.02057466715
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.9579391e+50
Internal energy: 7.468777332e+49
Virial error: 0.1443835001
Mass: 1.783968613 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001049059 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 8
L-infinity norm of residual (relative to old state): 0.007452617698
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.951802533e+50
Internal energy: 7.461117376e+49
Virial error: 0.1468041335
Mass: 1.782667786 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001508971 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 9
L-infinity norm of residual (relative to old state): 0.002655581458
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.949616885e+50
Internal energy: 7.458390948e+49
Virial error: 0.1476702429
Mass: 1.782205054 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001813868 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 10
L-infinity norm of residual (relative to old state): 0.0009395966873
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.948841216e+50
Internal energy: 7.457424042e+49
Virial error: 0.1479781906
Mass: 1.782041006 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001575441 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 11
L-infinity norm of residual (relative to old state): 0.0003312401846
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.948566562e+50
Internal energy: 7.457081878e+49
Virial error: 0.1480873206
Mass: 1.781982964 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.00153477 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 12
L-infinity norm of residual (relative to old state): 0.0001164660774
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.948469459e+50
Internal energy: 7.456960981e+49
Virial error: 0.148125922
Mass: 1.781962456 solar masses
Now regridding at level lbase = 0
grid_places() time: 0.001603248 new finest: 1
Castro::numpts_1d at level 1 is 229
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
Relaxation iterations completed: 13
L-infinity norm of residual (relative to old state): 4.095225831e-05
Rotational period (s): 0
Kinetic energy: 0
Potential energy: -1.94843517e+50
Internal energy: 7.456918333e+49
Virial error: 0.1481395608
Mass: 1.781955219 solar masses
Relaxation completed!
TIME= 0 MASS = 8.352245583e+32
TIME= 0 XMOM = 0
TIME= 0 YMOM = 0
TIME= 0 ZMOM = 0
TIME= 0 ANG MOM X = 0
TIME= 0 ANG MOM Y = 0
TIME= 0 ANG MOM Z = 0
TIME= 0 RHO*e = 2.118052636e+49
TIME= 0 RHO*K = 0
TIME= 0 RHO*E = 2.118052636e+49
TIME= 0 RHO*PHI = -8.163063831e+49
TIME= 0 TOTAL ENERGY= -1.963479279e+49
TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07
TIME= 0 CENTER OF MASS X-VEL = 0
TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06
TIME= 0 CENTER OF MASS Y-VEL = 0
TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05
TIME= 0 CENTER OF MASS Z-VEL = 0
TIME= 0 MAXIMUM TEMPERATURE = 32885673.5
TIME= 0 MAXIMUM DENSITY = 1351900
INITIAL GRIDS
Level 0 8 grids 262144 cells 100 % of domain
smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32
Level 1 8 grids 32768 cells 1.5625 % of domain
smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16
PLOTFILE: file = scf-test_plt00000
Write plotfile time = 0.273820422 seconds
Ending run at 07:05:35 UTC on 2023-07-28.
Run time = 6.369979068
Run time without initialization = 0.000615968
Average number of zones advanced per microsecond: 0.000
Average number of zones advanced per microsecond per rank: 0.000
TinyProfiler total time across processes [min...avg...max]: 6.37 ... 6.37 ... 6.37
--------------------------------------------------------------------------------------------
Name NCalls Excl. Min Excl. Avg Excl. Max Max %
--------------------------------------------------------------------------------------------
Amr::InitAmr() 1 1.1418 1.1418 1.1418 17.92%
Gravity::fill_multipole_BCs() 14 1.116 1.129 1.142 17.92%
Castro::post_init() 2 0.9954 0.9982 1 15.70%
Castro::computeTemp() 36 0.6977 0.7387 0.8072 12.67%
Castro::reset_internal_energy(Fab) 654 0.3901 0.4168 0.4607 7.23%
FabArray::ParallelCopy_finish() 2952 0.1141 0.3125 0.4518 7.09%
MLPoisson::Fsmooth() 5088 0.2308 0.2384 0.249 3.91%
Castro::normalize_species() 33 0.1644 0.1733 0.1856 2.91%
AmrLevel::derive() 97 0.1382 0.143 0.152 2.39%
Castro::initData() 3 0.1145 0.1276 0.1483 2.33%
amrex::Copy() 975 0.1248 0.1292 0.1311 2.06%
Castro::initMFs() 16 0.09779 0.1083 0.1244 1.95%
FillBoundary_finish() 5552 0.0666 0.07556 0.09098 1.43%
StateData::define() 64 0.05577 0.06208 0.0712 1.12%
amrex::average_down 844 0.04343 0.04694 0.05027 0.79%
FabArray::setVal() 1769 0.04153 0.04647 0.04965 0.78%
FillBoundary_nowait() 5552 0.03936 0.04163 0.04343 0.68%
MLCellLinOp::applyBC() 6294 0.03454 0.03665 0.04024 0.63%
Amr::writePlotFile() 1 0.005789 0.01582 0.03941 0.62%
VisMF::Write(FabArray) 2 0.02947 0.03069 0.03389 0.53%
FabArray::ParallelCopy_nowait() 2952 0.02403 0.0262 0.03067 0.48%
FillPatchIterator::Initialize 215 0.01468 0.01855 0.02861 0.45%
MLPoisson::Fapply() 1040 0.02372 0.02491 0.02612 0.41%
Castro::estTimeStep() 1 0.02165 0.02252 0.02306 0.36%
MLMG::addInterpCorrection() 530 0.01899 0.01944 0.02023 0.32%
Amr::regrid() 14 0.01446 0.0164 0.01995 0.31%
MLCellLinOp::reflux() 138 0.01661 0.01707 0.01748 0.27%
Castro::sum_integrated_quantities() 1 0.0007832 0.01068 0.01661 0.26%
Castro::buildMetrics() 16 0.01222 0.01357 0.01557 0.24%
FabArray::Xpay() 1013 0.012 0.01277 0.01377 0.22%
MultiFab::Multiply() 287 0.01281 0.01322 0.01369 0.21%
amrex::Add() 575 0.01031 0.01126 0.01216 0.19%
MLCellLinOp::updateSolBC() 120 0.0105 0.01149 0.01211 0.19%
MLPoisson::FFlux() 3408 0.01109 0.01123 0.01146 0.18%
Castro::Castro() 16 0.008731 0.009614 0.01121 0.18%
MLCellLinOp::updateCorBC() 106 0.009481 0.01038 0.01094 0.17%
FillPatchInterp(MF) 44 0.00189 0.007173 0.01083 0.17%
Castro::volWgtSum() 46 0.001563 0.003322 0.008614 0.14%
MLMG::interpCorrection_1 106 0.006337 0.007 0.007697 0.12%
AmrMesh::MakeNewGrids() 15 0.006163 0.006278 0.006391 0.10%
Castro::apply_tagging_restrictions() 15 0.005525 0.005918 0.006291 0.10%
MLCellLinOp::compGrad() 28 0.003178 0.003856 0.00554 0.09%
MLMG::prepareForSolve() 14 0.004707 0.005003 0.005238 0.08%
FabArray::norminf(mask) 46 0.004728 0.004828 0.005071 0.08%
Gravity::get_new_grav_vector() 4 0.001709 0.002658 0.00464 0.07%
MLMG::ResNormInf() 152 0.002814 0.003644 0.004319 0.07%
MLLinOp::makeSubCommunicator() 14 0.001173 0.002545 0.00421 0.07%
MLCellLinOp::defineAuxData() 14 0.003765 0.003895 0.004066 0.06%
MultiFab::max() 54 0.002989 0.00342 0.003745 0.06%
FabArrayBase::getCPC() 3662 0.003454 0.003549 0.003726 0.06%
FabArray::norminf() 174 0.002958 0.003238 0.003626 0.06%
Gravity::multilevel_solve_for_new_phi() 14 0.002721 0.002896 0.003179 0.05%
Castro::enforce_min_density() 33 0.002697 0.002885 0.003086 0.05%
BndryData::define() 42 0.002255 0.002333 0.002463 0.04%
Gravity::actual_solve_with_mlmg() 14 0.001935 0.002105 0.002454 0.04%
Castro::build_fine_mask() 55 0.0006914 0.0009641 0.002354 0.04%
DistributionMapping::LeastUsedCPUs() 9 8.371e-05 0.001278 0.002185 0.03%
FabArray::FillBoundary() 5552 0.001904 0.001983 0.002127 0.03%
MLCellLinOp::defineBC() 14 0.001789 0.001932 0.002 0.03%
FabArrayBase::CPC::define() 624 0.001608 0.001711 0.001919 0.03%
MLCellLinOp::smooth() 2544 0.001674 0.001729 0.00181 0.03%
FabArray::mult() 34 0.001108 0.001328 0.001681 0.03%
FillPatchTwoLevels 126 0.0006843 0.001117 0.001488 0.02%
MLCGSolver::bicgstab 13 0 0.0001802 0.001442 0.02%
StateData::FillBoundary(geom) 8 0.001224 0.001316 0.001394 0.02%
Castro::enforce_consistent_e() 3 0.001012 0.001145 0.001369 0.02%
FabArray::ParallelCopy() 2952 0.001212 0.001239 0.001272 0.02%
average_down_faces 84 0.001051 0.001156 0.001254 0.02%
FabArrayBase::getFB() 5552 0.0009431 0.0009954 0.00111 0.02%
AMRErrorTag::operator() 15 0.00092 0.0009424 0.000973 0.02%
Gravity::actual_multilevel_solve() 14 0.0007575 0.00084 0.0009397 0.01%
main() 1 0.0003766 0.0005635 0.0007607 0.01%
MLCellLinOp::apply() 1040 0.0004352 0.0004612 0.0005889 0.01%
TagBoxArray::collate() 15 0.0002556 0.0003253 0.0005889 0.01%
MLMG::MLResNormInf() 32 0.0001783 0.0004771 0.000584 0.01%
MLMG::solve() 14 0.0004151 0.0004691 0.0005326 0.01%
AmrLevel::FillPatch() 215 0.0004739 0.0004964 0.0005142 0.01%
FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004655 0.000485 0.0005086 0.01%
MLCellLinOp::prepareForSolve() 14 0.0003526 0.0003853 0.0004561 0.01%
MLMG::mgVcycle() 318 0.0004043 0.0004326 0.000454 0.01%
Amr::grid_places() 15 0.0003107 0.0003467 0.0004462 0.01%
MLCellLinOp::correctionResidual() 755 0.0003779 0.000392 0.0004381 0.01%
Castro::reset_internal_energy(MultiFab) 36 0.0002763 0.0003311 0.0004378 0.01%
FabArray::setDomainBndry() 259 0.0003807 0.000401 0.0004197 0.01%
MLCellLinOp::setLevelBC() 28 0.0003234 0.0003583 0.0004027 0.01%
MLLinOp::defineGrids() 14 0.0002575 0.0003038 0.0003743 0.01%
Gravity::average_fine_ec_onto_crse_ec() 14 0.0002618 0.0002818 0.0003073 0.00%
MLMG::oneIter() 106 0.0002534 0.0002695 0.0002822 0.00%
MLMG::mgVcycle_bottom 318 0.0002254 0.0002428 0.0002596 0.00%
MLCGSolver::ParallelAllReduce 81 0 3.076e-05 0.0002461 0.00%
MLMG::actualBottomSolve() 106 2.209e-05 5.128e-05 0.000244 0.00%
Castro::locWgtSum() 6 0.0001813 0.0001885 0.0002074 0.00%
MLCellLinOp::solutionResidual() 258 0.0001716 0.0001812 0.0001954 0.00%
AmrLevel::AmrLevel(dm) 16 0.0001346 0.0001655 0.0001908 0.00%
MLMG::computeResWithCrseSolFineCor() 106 0.0001487 0.0001612 0.0001773 0.00%
MLMG:computeResOfCorrection() 530 0.0001563 0.0001624 0.0001664 0.00%
StateDataPhysBCFunct::() 259 0.0001323 0.0001422 0.0001543 0.00%
FillPatchSingleLevel 259 0.0001346 0.0001391 0.0001454 0.00%
MLMG::mgVcycle_down::0 106 0.0001282 0.000134 0.0001448 0.00%
FabArrayBase::FB::FB() 35 7.774e-05 8.879e-05 0.0001321 0.00%
Gravity::update_max_rhs() 1 7.609e-05 0.0001036 0.0001304 0.00%
FillPatchIterator::FillFromLevel0() 89 0.000109 0.0001159 0.0001276 0.00%
FillPatchIterator::FillFromTwoLevels() 126 0.0001152 0.0001208 0.0001252 0.00%
amrex::Dot() 54 0 1.478e-05 0.0001182 0.00%
MLMG::mgVcycle_down::1 106 0.0001062 0.0001111 0.0001154 0.00%
OwnerMask() 15 8.672e-05 9.988e-05 0.0001111 0.00%
TagBoxArray::mapPRD 15 9.031e-05 9.704e-05 0.0001098 0.00%
MLMG::miniCycle() 212 8.486e-05 9.396e-05 0.0001079 0.00%
Amr::FinalizeInit() 1 7.381e-06 2.697e-05 9.994e-05 0.00%
MLMG::computeResWithCrseCorFineCor() 106 8.026e-05 8.445e-05 9.424e-05 0.00%
FPinfo::FPinfo() 9 6.543e-05 7.871e-05 9.4e-05 0.00%
MLMG::mgVcycle_down::2 106 8.225e-05 8.627e-05 9.322e-05 0.00%
FabArray::LinComb() 27 0 1.161e-05 9.289e-05 0.00%
Castro::volProductSum() 2 7.521e-05 8.009e-05 8.997e-05 0.00%
Castro::post_regrid() 30 5.729e-05 7.027e-05 8.917e-05 0.00%
MLMG::mgVcycle_down::3 106 7.428e-05 7.965e-05 8.806e-05 0.00%
FabArray::Saxpy() 27 0 9.973e-06 7.978e-05 0.00%
Castro::clean_state() 33 6.222e-05 6.916e-05 7.976e-05 0.00%
MLMG::mgVcycle_down::4 106 6.959e-05 7.228e-05 7.864e-05 0.00%
Castro::derive() 97 6.153e-05 6.674e-05 7.61e-05 0.00%
Castro::avgDown(state_indx) 60 6.247e-05 7.151e-05 7.571e-05 0.00%
Gravity::solve_phi_with_mlmg() 14 6.287e-05 6.847e-05 7.528e-05 0.00%
MLMG::mgVcycle_up::0 106 6.35e-05 6.797e-05 7.465e-05 0.00%
Castro::errorEst() 15 4.535e-05 5.702e-05 7.336e-05 0.00%
MLMG::mgVcycle_up::4 106 6.232e-05 6.598e-05 7.12e-05 0.00%
MLMG::mgVcycle_up::2 106 5.426e-05 5.843e-05 7.058e-05 0.00%
FabArrayBase::TheFPinfo() 49 6.43e-05 6.731e-05 6.915e-05 0.00%
MLMG::mgVcycle_up::1 106 5.456e-05 6.018e-05 6.807e-05 0.00%
MLMG::computeResidual() 106 5.257e-05 5.586e-05 6.454e-05 0.00%
MLMG::mgVcycle_up::3 106 5.559e-05 5.83e-05 6.257e-05 0.00%
ClusterList::intersect() 1 0 7.723e-06 6.179e-05 0.00%
Amr::writeSmallPlotFile() 1 2.874e-05 3.285e-05 5.539e-05 0.00%
amrex::average_down_w_geom 60 3.802e-05 4.577e-05 5.057e-05 0.00%
Castro::init(old) 13 4.26e-05 4.707e-05 4.969e-05 0.00%
Castro::avgDown() 15 3.307e-05 3.916e-05 4.907e-05 0.00%
MLPoisson::define() 14 3.606e-05 4.087e-05 4.902e-05 0.00%
MLMG::computeMLResidual() 32 3.596e-05 3.882e-05 4.347e-05 0.00%
makeSFC 42 2.701e-05 3.394e-05 4.319e-05 0.00%
MLLinOp::makeAgglomeratedDMap 14 2.151e-05 2.69e-05 3.653e-05 0.00%
AmrMesh-cluster 1 0 4.269e-06 3.416e-05 0.00%
DistributionMapping::SFCProcessorMapDoIt() 4 1.7e-05 2.137e-05 2.74e-05 0.00%
BoxList::parallelComplementIn() 30 1.007e-05 1.672e-05 2.716e-05 0.00%
DistributionMapping::Distribute() 46 1.949e-05 2.265e-05 2.56e-05 0.00%
MLMG::getGradSolution() 14 1.74e-05 1.886e-05 2.159e-05 0.00%
MLLinOp::define() 14 1.649e-05 1.804e-05 2.128e-05 0.00%
Amr::bldFineLevels() 1 1.422e-05 1.646e-05 1.844e-05 0.00%
Amr::defBaseLevel() 1 1.377e-05 1.589e-05 1.785e-05 0.00%
FabArray::RecvLayoutMask() 14 1.606e-05 1.647e-05 1.685e-05 0.00%
ClusterList::chop() 1 0 2.078e-06 1.663e-05 0.00%
MLPoisson::prepareForSolve() 14 1.261e-05 1.384e-05 1.599e-05 0.00%
Castro::enforce_speed_limit() 33 1.066e-05 1.191e-05 1.401e-05 0.00%
BoxList::complementIn 30 1.074e-05 1.172e-05 1.366e-05 0.00%
Amr::initSubcycle() 1 8.827e-06 1.05e-05 1.326e-05 0.00%
knapsack() 2 1.038e-05 1.132e-05 1.297e-05 0.00%
Castro::apply_problem_tags() 15 8.1e-06 8.714e-06 9.636e-06 0.00%
MLMG::MLRhsNormInf() 14 7.994e-06 8.541e-06 9.077e-06 0.00%
Castro::gwstrain() 2 9.89e-07 1.896e-06 7.344e-06 0.00%
DistributionMapping::KnapSackDoIt() 2 3.722e-06 4.209e-06 5.047e-06 0.00%
Amr::InitializeInit() 1 1.977e-06 2.575e-06 4.21e-06 0.00%
Gravity::set_mass_offset() 1 8.88e-07 2.216e-06 3.957e-06 0.00%
Amr::init() 1 1.708e-06 2.592e-06 3.932e-06 0.00%
Castro::computeInitialDt() 1 1.631e-06 2.261e-06 3.483e-06 0.00%
Amr::initialInit() 1 1.134e-06 1.473e-06 1.795e-06 0.00%
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
Name NCalls Incl. Min Incl. Avg Incl. Max Max %
--------------------------------------------------------------------------------------------
main() 1 6.37 6.37 6.37 100.00%
Amr::init() 1 5.227 5.227 5.227 82.06%
Amr::initialInit() 1 4.953 4.953 4.953 77.76%
Amr::FinalizeInit() 1 4.845 4.846 4.846 76.08%
Castro::post_init() 2 3.616 3.729 3.797 59.60%
Gravity::multilevel_solve_for_new_phi() 14 1.776 1.789 1.802 28.30%
Gravity::actual_multilevel_solve() 14 1.773 1.786 1.8 28.25%
Gravity::solve_phi_with_mlmg() 14 1.767 1.779 1.792 28.14%
Castro::computeTemp() 36 1.091 1.156 1.265 19.86%
Amr::regrid() 14 1.199 1.218 1.239 19.45%
Castro::clean_state() 33 1.053 1.106 1.189 18.67%
Gravity::fill_multipole_BCs() 14 1.118 1.131 1.143 17.95%
Amr::InitAmr() 1 1.142 1.142 1.142 17.92%
Amr::bldFineLevels() 1 0.8888 0.9433 1.032 16.20%
Castro::post_regrid() 30 0.8108 0.8387 0.8791 13.80%
Castro::initData() 3 0.5717 0.6348 0.739 11.60%
Gravity::actual_solve_with_mlmg() 14 0.646 0.6475 0.649 10.19%
MLMG::solve() 14 0.6251 0.6255 0.6258 9.82%
MLMG::oneIter() 106 0.5527 0.5533 0.5538 8.69%
FabArray::ParallelCopy() 2952 0.1709 0.3643 0.5019 7.88%
Castro::reset_internal_energy(MultiFab) 36 0.3904 0.4171 0.4612 7.24%
Castro::reset_internal_energy(Fab) 654 0.3901 0.4168 0.4607 7.23%
FabArray::ParallelCopy_finish() 2952 0.1141 0.3125 0.4518 7.09%
MLMG::mgVcycle() 318 0.4179 0.4191 0.4201 6.59%
MLCellLinOp::smooth() 2544 0.3445 0.3506 0.3581 5.62%
Amr::writePlotFile() 1 0.274 0.2741 0.2741 4.30%
amrex::average_down 844 0.07555 0.1952 0.2664 4.18%
MLPoisson::Fsmooth() 5088 0.2308 0.2384 0.249 3.91%
Castro::avgDown() 15 0.04584 0.1651 0.2366 3.71%
Castro::avgDown(state_indx) 60 0.0458 0.1651 0.2366 3.71%
amrex::average_down_w_geom 60 0.04573 0.165 0.2365 3.71%
Castro::derive() 97 0.2059 0.2286 0.2354 3.70%
AmrLevel::derive() 97 0.2058 0.2286 0.2353 3.69%
Castro::normalize_species() 33 0.1644 0.1733 0.1856 2.91%
Castro::Castro() 16 0.1367 0.152 0.1726 2.71%
AmrLevel::FillPatch() 215 0.1172 0.1558 0.1687 2.65%
MLCellLinOp::applyBC() 6294 0.1497 0.1569 0.1679 2.64%
FillPatchIterator::Initialize 215 0.09553 0.1329 0.1454 2.28%
FabArray::FillBoundary() 5552 0.1126 0.1203 0.1334 2.09%
amrex::Copy() 975 0.1248 0.1292 0.1311 2.06%
Amr::grid_places() 15 0.02171 0.08733 0.1277 2.01%
AmrMesh::MakeNewGrids() 15 0.02136 0.08698 0.1274 2.00%
Castro::initMFs() 16 0.09779 0.1083 0.1244 1.95%
MLMG::mgVcycle_down::0 106 0.1123 0.1133 0.1146 1.80%
MLMG::mgVcycle_bottom 318 0.1084 0.1099 0.1144 1.80%
MLMG::miniCycle() 212 0.1086 0.1096 0.1109 1.74%
TagBoxArray::mapPRD 15 0.004942 0.07049 0.1106 1.74%
FillPatchSingleLevel 259 0.04724 0.09332 0.1095 1.72%
Amr::InitializeInit() 1 0.1073 0.1078 0.1087 1.71%
Amr::defBaseLevel() 1 0.1073 0.1078 0.1087 1.71%
MLMG::mgVcycle_up::0 106 0.1062 0.1066 0.1072 1.68%
FillBoundary_finish() 5552 0.0666 0.07556 0.09098 1.43%
MLMG::computeResWithCrseSolFineCor() 106 0.07239 0.07357 0.07476 1.17%
FillPatchIterator::FillFromLevel0() 89 0.01988 0.06038 0.074 1.16%
AmrLevel::AmrLevel(dm) 16 0.05594 0.06225 0.07136 1.12%
StateData::define() 64 0.05577 0.06208 0.0712 1.12%
MLCellLinOp::apply() 1040 0.05846 0.06023 0.06217 0.98%
MLCellLinOp::correctionResidual() 755 0.05717 0.05844 0.05962 0.94%
FillPatchIterator::FillFromTwoLevels() 126 0.04669 0.05358 0.05706 0.90%
FillPatchTwoLevels 126 0.04657 0.05346 0.05693 0.89%
MLCellLinOp::solutionResidual() 258 0.05317 0.05497 0.05675 0.89%
FabArray::ParallelCopy_nowait() 2952 0.04767 0.05056 0.05557 0.87%
Castro::init(old) 13 0.04598 0.04969 0.05238 0.82%
MLCellLinOp::reflux() 138 0.04796 0.04931 0.04994 0.78%
FabArray::setVal() 1769 0.04153 0.04647 0.04965 0.78%
FillBoundary_nowait() 5552 0.04043 0.04272 0.04448 0.70%
MLMG::addInterpCorrection() 530 0.02104 0.03235 0.03889 0.61%
VisMF::Write(FabArray) 2 0.02947 0.03069 0.03389 0.53%
MLMG::computeResWithCrseCorFineCor() 106 0.03074 0.0316 0.03202 0.50%
MLMG::mgVcycle_up::2 106 0.01912 0.02971 0.03133 0.49%
MLMG::computeResidual() 106 0.02661 0.02758 0.02798 0.44%
Gravity::get_new_grav_vector() 4 0.02651 0.02716 0.02785 0.44%
MLPoisson::Fapply() 1040 0.02372 0.02491 0.02612 0.41%
MLMG::mgVcycle_down::1 106 0.02301 0.02376 0.02439 0.38%
Castro::computeInitialDt() 1 0.02166 0.02252 0.02306 0.36%
Castro::estTimeStep() 1 0.02165 0.02252 0.02306 0.36%
MLMG::computeMLResidual() 32 0.02137 0.02184 0.02266 0.36%
MLCellLinOp::updateSolBC() 120 0.01998 0.02069 0.02116 0.33%
MLMG::mgVcycle_up::1 106 0.0205 0.02065 0.02075 0.33%
Castro::sum_integrated_quantities() 1 0.01298 0.01649 0.02035 0.32%
MLCellLinOp::updateCorBC() 106 0.01819 0.01922 0.02007 0.32%
MLMG:computeResOfCorrection() 530 0.01824 0.01857 0.0191 0.30%
Castro::buildMetrics() 16 0.01352 0.01511 0.01724 0.27%
MLPoisson::define() 14 0.01142 0.01291 0.01436 0.23%
FabArray::Xpay() 1013 0.012 0.01277 0.01377 0.22%
MultiFab::Multiply() 287 0.01281 0.01322 0.01369 0.21%
MLMG::interpCorrection_1 106 0.01021 0.01145 0.01251 0.20%
amrex::Add() 575 0.01031 0.01126 0.01216 0.19%
MLPoisson::FFlux() 3408 0.01109 0.01123 0.01146 0.18%
FillPatchInterp(MF) 44 0.00189 0.007173 0.01083 0.17%
MLMG::ResNormInf() 152 0.009309 0.009936 0.0106 0.17%
MLMG::prepareForSolve() 14 0.009725 0.01017 0.01041 0.16%
MLMG::mgVcycle_down::2 106 0.008949 0.009217 0.01001 0.16%
Castro::errorEst() 15 0.009111 0.009622 0.009993 0.16%
Castro::volWgtSum() 46 0.001567 0.003328 0.00862 0.14%
MLMG::getGradSolution() 14 0.006478 0.006664 0.00687 0.11%
MLCellLinOp::compGrad() 28 0.006458 0.006645 0.006849 0.11%
Castro::apply_tagging_restrictions() 15 0.005525 0.005918 0.006291 0.10%
FabArrayBase::getCPC() 3662 0.005062 0.00526 0.005522 0.09%
MLCellLinOp::defineAuxData() 14 0.004806 0.004967 0.005226 0.08%
MLCellLinOp::defineBC() 14 0.004785 0.004953 0.00512 0.08%
FabArray::norminf(mask) 46 0.004728 0.004828 0.005071 0.08%
MLLinOp::define() 14 0.001516 0.002946 0.00463 0.07%
MLLinOp::defineGrids() 14 0.001498 0.002928 0.004613 0.07%
MLMG::mgVcycle_down::3 106 0.00127 0.001712 0.004471 0.07%
Gravity::average_fine_ec_onto_crse_ec() 14 0.003527 0.003992 0.004367 0.07%
MLMG::MLResNormInf() 32 0.004138 0.004202 0.004298 0.07%
MLLinOp::makeSubCommunicator() 14 0.001173 0.002545 0.00421 0.07%
MultiFab::max() 54 0.002989 0.00342 0.003745 0.06%
MLMG::actualBottomSolve() 106 2.209e-05 0.000479 0.003666 0.06%
MLMG::mgVcycle_up::3 106 0.0009275 0.001282 0.003635 0.06%
FabArray::norminf() 174 0.002958 0.003238 0.003626 0.06%
MLCGSolver::bicgstab 13 0 0.0004206 0.003365 0.05%
average_down_faces 84 0.00209 0.002638 0.003102 0.05%
Castro::enforce_min_density() 33 0.002697 0.002885 0.003086 0.05%
BndryData::define() 42 0.002788 0.002894 0.003043 0.05%
Castro::build_fine_mask() 55 0.0006914 0.0009641 0.002354 0.04%
MLMG::mgVcycle_down::4 106 0.001121 0.001303 0.00234 0.04%
FabArrayBase::TheFPinfo() 49 0.0002004 0.001391 0.002306 0.04%
FPinfo::FPinfo() 9 0.0001319 0.001324 0.002239 0.04%
DistributionMapping::LeastUsedCPUs() 9 8.371e-05 0.001278 0.002185 0.03%
FabArrayBase::CPC::define() 624 0.001608 0.001711 0.001919 0.03%
MLMG::mgVcycle_up::4 106 0.001069 0.001195 0.001896 0.03%
MLMG::MLRhsNormInf() 14 0.001741 0.00177 0.001803 0.03%
FabArray::mult() 34 0.001108 0.001328 0.001681 0.03%
StateDataPhysBCFunct::() 259 0.001363 0.001458 0.001539 0.02%
StateData::FillBoundary(geom) 8 0.001224 0.001316 0.001394 0.02%
Castro::enforce_consistent_e() 3 0.001012 0.001145 0.001369 0.02%
FabArrayBase::getFB() 5552 0.001023 0.001084 0.001242 0.02%
Gravity::update_max_rhs() 1 0.0006217 0.0008187 0.001003 0.02%
AMRErrorTag::operator() 15 0.00092 0.0009424 0.000973 0.02%
DistributionMapping::KnapSackDoIt() 2 3.609e-05 0.0003122 0.0006386 0.01%
TagBoxArray::collate() 15 0.0002556 0.0003253 0.0005889 0.01%
FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004655 0.000485 0.0005086 0.01%
MLPoisson::prepareForSolve() 14 0.0003654 0.0003992 0.0004687 0.01%
MLCellLinOp::prepareForSolve() 14 0.0003526 0.0003853 0.0004561 0.01%
FabArray::setDomainBndry() 259 0.0003807 0.000401 0.0004197 0.01%
MLCellLinOp::setLevelBC() 28 0.0003234 0.0003583 0.0004027 0.01%
MLCGSolver::ParallelAllReduce 81 0 3.923e-05 0.0003138 0.00%
Castro::locWgtSum() 6 0.0001818 0.000189 0.000208 0.00%
FabArrayBase::FB::FB() 35 7.774e-05 8.879e-05 0.0001321 0.00%
amrex::Dot() 54 0 1.478e-05 0.0001182 0.00%
AmrMesh-cluster 1 0 1.407e-05 0.0001126 0.00%
OwnerMask() 15 8.672e-05 9.988e-05 0.0001111 0.00%
DistributionMapping::SFCProcessorMapDoIt() 4 5.342e-05 7.516e-05 9.608e-05 0.00%
MLLinOp::makeAgglomeratedDMap 14 6.296e-05 7.829e-05 9.401e-05 0.00%
FabArray::LinComb() 27 0 1.161e-05 9.289e-05 0.00%
Castro::volProductSum() 2 7.547e-05 8.033e-05 9.015e-05 0.00%
FabArray::Saxpy() 27 0 9.973e-06 7.978e-05 0.00%
makeSFC 42 4.145e-05 5.139e-05 6.305e-05 0.00%
ClusterList::intersect() 1 0 7.723e-06 6.179e-05 0.00%
Amr::writeSmallPlotFile() 1 2.874e-05 3.285e-05 5.539e-05 0.00%
BoxList::parallelComplementIn() 30 2.081e-05 2.844e-05 4.029e-05 0.00%
DistributionMapping::Distribute() 46 1.949e-05 2.265e-05 2.56e-05 0.00%
FabArray::RecvLayoutMask() 14 1.606e-05 1.647e-05 1.685e-05 0.00%
ClusterList::chop() 1 0 2.078e-06 1.663e-05 0.00%
Castro::enforce_speed_limit() 33 1.066e-05 1.191e-05 1.401e-05 0.00%
BoxList::complementIn 30 1.074e-05 1.172e-05 1.366e-05 0.00%
Amr::initSubcycle() 1 8.827e-06 1.05e-05 1.326e-05 0.00%
knapsack() 2 1.038e-05 1.132e-05 1.297e-05 0.00%
Castro::apply_problem_tags() 15 8.1e-06 8.714e-06 9.636e-06 0.00%
Castro::gwstrain() 2 9.89e-07 1.896e-06 7.344e-06 0.00%
Gravity::set_mass_offset() 1 8.88e-07 2.216e-06 3.957e-06 0.00%
--------------------------------------------------------------------------------------------
Pinned Memory Usage:
---------------------------------------------------------------------------------------------------------------------
Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max
---------------------------------------------------------------------------------------------------------------------
The_Pinned_Arena::Initialize() 8 8 17 B 19 B 21 B 8192 KiB 8192 KiB 8192 KiB
---------------------------------------------------------------------------------------------------------------------
AMReX (23.07-51-gbba6d9c2bc68) finalized