Initializing AMReX (23.11-17-g9e35dc19489d)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.11-17-g9e35dc19489d) initialized Starting run at 07:36:28 UTC on 2023-11-22. Successfully read inputs file ... Castro git describe: 23.11-6-gb720d68fa AMReX git describe: 23.11-17-g9e35dc194 Microphysics git describe: 23.11-9-ge9e31f40 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002739387 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.159205785 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.002075314 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.006034372 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001494316 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001422815 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00159568 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001372319 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001324644 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001370262 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001473136 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001287339 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001387746 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001425519 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001358347 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.302167364 seconds Ending run at 07:36:35 UTC on 2023-11-22. Run time = 7.032927008 Run time without initialization = 0.000397283 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 7.033 ... 7.033 ... 7.033 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2509 1.2510 1.2510 17.79% Gravity::fill_multipole_BCs() 14 1.136 1.149 1.164 16.55% Castro::post_init() 2 1.046 1.054 1.06 15.08% Castro::computeTemp() 36 0.764 0.8209 0.9034 12.85% FabArray::ParallelCopy_finish() 2952 0.1178 0.4328 0.6482 9.22% Castro::reset_internal_energy(Fab) 654 0.4135 0.4483 0.5001 7.11% amrex::Copy() 948 0.2187 0.2358 0.2523 3.59% MLPoisson::Fsmooth() 5088 0.1971 0.2034 0.2122 3.02% Castro::normalize_species() 33 0.1618 0.1759 0.2002 2.85% Castro::initMFs() 16 0.1 0.1292 0.171 2.43% Castro::initData() 3 0.1231 0.1382 0.162 2.30% AmrLevel::derive() 97 0.1484 0.1525 0.1586 2.26% FabArray::setVal() 1769 0.06636 0.08013 0.0975 1.39% StateData::define() 64 0.0566 0.0724 0.09364 1.33% FillBoundary_finish() 5552 0.05764 0.0725 0.09189 1.31% amrex::average_down 844 0.04647 0.05272 0.06025 0.86% FabArray::ParallelCopy_nowait() 2952 0.02911 0.03786 0.0529 0.75% FillBoundary_nowait() 5552 0.04091 0.04454 0.04774 0.68% MLCellLinOp::applyBC() 6294 0.0332 0.03653 0.04058 0.58% VisMF::Write(FabArray) 2 0.02928 0.03239 0.03765 0.54% FillPatchIterator::Initialize 215 0.029 0.03342 0.03747 0.53% MLPoisson::Fapply() 1040 0.027 0.02987 0.03365 0.48% MultiFab::Multiply() 287 0.02228 0.02687 0.02825 0.40% Castro::estTimeStep() 1 0.02211 0.02497 0.02723 0.39% Amr::regrid() 14 0.01437 0.01759 0.02089 0.30% Amr::writePlotFile() 1 0.01131 0.01715 0.02047 0.29% Castro::buildMetrics() 16 0.01292 0.01639 0.02014 0.29% FabArray::Xpay() 1013 0.01662 0.01831 0.01979 0.28% Castro::Castro() 16 0.01002 0.01389 0.01904 0.27% MLCellLinOp::reflux() 138 0.01706 0.0178 0.01859 0.26% MLMG::addInterpCorrection() 530 0.01629 0.01646 0.01685 0.24% amrex::Add() 575 0.01256 0.0144 0.01628 0.23% MLPoisson::FFlux() 3408 0.01137 0.01185 0.01256 0.18% MLCellLinOp::updateSolBC() 120 0.01006 0.01113 0.0119 0.17% MLMG::prepareForSolve() 14 0.007719 0.009581 0.01157 0.16% MLCellLinOp::updateCorBC() 106 0.008997 0.009972 0.01061 0.15% DistributionMapping::LeastUsedCPUs() 9 0.0002744 0.005177 0.01061 0.15% FillPatchInterp(MF) 44 0.001872 0.006829 0.01022 0.15% MLMG::interpCorrection_1 106 0.006545 0.007494 0.008497 0.12% MLCellLinOp::compGrad() 28 0.005518 0.006903 0.008229 0.12% Gravity::multilevel_solve_for_new_phi() 14 0.003147 0.005069 0.007016 0.10% Castro::apply_tagging_restrictions() 15 0.005835 0.006347 0.006804 0.10% MultiFab::max() 54 0.00324 0.005313 0.006782 0.10% AmrMesh::MakeNewGrids() 15 0.00639 0.006462 0.006552 0.09% MLMG::ResNormInf() 152 0.002948 0.004763 0.006475 0.09% Gravity::get_new_grav_vector() 4 0.002987 0.004329 0.006222 0.09% MLCellLinOp::defineAuxData() 14 0.004322 0.004804 0.00538 0.08% FabArray::norminf(mask) 46 0.004873 0.004953 0.00505 0.07% FabArrayBase::getCPC() 3662 0.003632 0.00392 0.004208 0.06% FabArray::norminf() 188 0.002964 0.003441 0.00391 0.06% Castro::enforce_min_density() 33 0.002567 0.00297 0.003528 0.05% MLLinOp::makeSubCommunicator() 14 0.0006759 0.00196 0.003195 0.05% BndryData::define() 42 0.002575 0.002783 0.002982 0.04% Gravity::actual_solve_with_mlmg() 14 0.00229 0.002486 0.002836 0.04% Castro::volWgtSum() 46 0.001994 0.002219 0.00245 0.03% MLCellLinOp::defineBC() 14 0.001994 0.002206 0.002437 0.03% Castro::enforce_consistent_e() 3 0.001177 0.0016 0.002286 0.03% FabArrayBase::CPC::define() 624 0.001673 0.001892 0.002244 0.03% FabArray::mult() 34 0.001507 0.00182 0.002243 0.03% FabArray::FillBoundary() 5552 0.001976 0.002026 0.002136 0.03% FillPatchTwoLevels 126 0.0008689 0.001599 0.00209 0.03% MLCellLinOp::smooth() 2544 0.001627 0.001669 0.001743 0.02% average_down_faces 84 0.00122 0.001438 0.001624 0.02% Gravity::actual_multilevel_solve() 14 0.001015 0.001317 0.001612 0.02% MLMG::mgVcycle_down::0 106 0.0001392 0.0003223 0.001549 0.02% Castro::sum_integrated_quantities() 1 0.0005142 0.0009971 0.001519 0.02% FabArray::ParallelCopy() 2952 0.001266 0.001287 0.001326 0.02% StateData::FillBoundary(geom) 8 0.001134 0.001172 0.001255 0.02% Castro::build_fine_mask() 55 0.0008547 0.001053 0.001247 0.02% MLCGSolver::bicgstab 13 0 0.0001521 0.001217 0.02% AMRErrorTag::operator() 15 0.001098 0.001121 0.001166 0.02% FabArrayBase::getFB() 5552 0.0009959 0.001036 0.001164 0.02% MLCellLinOp::setLevelBC() 28 0.0004642 0.0006214 0.0007951 0.01% MLCellLinOp::prepareForSolve() 14 0.0004156 0.0005948 0.0007928 0.01% MLMG::solve() 14 0.0004712 0.0006118 0.0007552 0.01% AmrLevel::FillPatch() 215 0.0006264 0.0006654 0.0007383 0.01% MLCellLinOp::apply() 1040 0.0004221 0.000467 0.0006063 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005233 0.0005584 0.0006029 0.01% main() 1 0.0003834 0.0004651 0.0005691 0.01% FabArray::setDomainBndry() 259 0.0004465 0.0005028 0.000554 0.01% MLMG::mgVcycle() 318 0.0004119 0.0004357 0.0005068 0.01% MLCellLinOp::correctionResidual() 755 0.0004074 0.0004221 0.0004729 0.01% Amr::grid_places() 15 0.0003371 0.0003685 0.000455 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003242 0.0003671 0.0004102 0.01% MLLinOp::defineGrids() 14 0.0003014 0.0003439 0.0003934 0.01% MLMG::MLResNormInf() 32 0.0001513 0.0002779 0.0003865 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0003021 0.0003332 0.0003711 0.01% TagBoxArray::collate() 15 0.0002309 0.0002919 0.0003539 0.01% MLMG::oneIter() 106 0.0002924 0.000311 0.0003295 0.00% MLMG::actualBottomSolve() 106 2.103e-05 5.532e-05 0.0002842 0.00% MLMG::mgVcycle_bottom 318 0.0002257 0.0002483 0.000277 0.00% Castro::locWgtSum() 6 0.0001931 0.0002149 0.0002485 0.00% MLCGSolver::ParallelAllReduce 95 0 3.075e-05 0.000246 0.00% Gravity::update_max_rhs() 1 8.247e-05 0.0001357 0.0002177 0.00% StateDataPhysBCFunct::() 259 0.0001716 0.0001919 0.0002137 0.00% MLCellLinOp::solutionResidual() 258 0.0001814 0.0002001 0.0002119 0.00% MLMG:computeResOfCorrection() 530 0.0001561 0.0001703 0.0001989 0.00% AmrLevel::AmrLevel(dm) 16 0.0001619 0.0001838 0.0001974 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.000159 0.0001699 0.0001909 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001632 0.0001761 0.0001862 0.00% FillPatchSingleLevel 259 0.0001573 0.0001667 0.0001829 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001522 0.0001611 0.0001677 0.00% FPinfo::FPinfo() 9 8.142e-05 9.98e-05 0.0001511 0.00% FabArrayBase::FB::FB() 35 8.319e-05 9.549e-05 0.0001436 0.00% OwnerMask() 15 9.186e-05 0.0001121 0.0001332 0.00% FabArray::Saxpy() 54 0 1.602e-05 0.0001282 0.00% MLMG::mgVcycle_down::1 106 0.0001101 0.0001161 0.0001254 0.00% Castro::volProductSum() 2 8.126e-05 0.0001038 0.0001236 0.00% MLMG::miniCycle() 212 8.891e-05 0.0001059 0.000123 0.00% Castro::avgDown(state_indx) 60 7.901e-05 9.762e-05 0.0001154 0.00% amrex::Dot() 54 0 1.434e-05 0.0001147 0.00% Castro::post_regrid() 30 6.887e-05 8.791e-05 0.0001092 0.00% TagBoxArray::mapPRD 15 9.288e-05 9.978e-05 0.0001073 0.00% MLMG::computeResWithCrseCorFineCor() 106 9.336e-05 9.855e-05 0.0001056 0.00% Gravity::solve_phi_with_mlmg() 14 7.648e-05 8.741e-05 0.0001037 0.00% MLMG::mgVcycle_down::2 106 8.52e-05 9.066e-05 0.0001025 0.00% Amr::FinalizeInit() 1 7.346e-06 2.334e-05 0.0001004 0.00% Castro::derive() 97 7.058e-05 8.366e-05 9.59e-05 0.00% FabArrayBase::TheFPinfo() 49 8.084e-05 8.835e-05 9.501e-05 0.00% MLMG::mgVcycle_down::3 106 7.664e-05 8.416e-05 9.039e-05 0.00% Castro::init(old) 13 6.924e-05 7.852e-05 8.642e-05 0.00% Castro::clean_state() 33 6.142e-05 7.212e-05 8.438e-05 0.00% MLMG::mgVcycle_up::3 106 5.522e-05 6.026e-05 7.998e-05 0.00% MLMG::mgVcycle_down::4 106 7.078e-05 7.358e-05 7.681e-05 0.00% Castro::errorEst() 15 5.125e-05 6.11e-05 7.505e-05 0.00% ClusterList::intersect() 1 0 9.175e-06 7.34e-05 0.00% MLMG::mgVcycle_up::1 106 5.789e-05 6.496e-05 7.326e-05 0.00% MLMG::mgVcycle_up::4 106 6.271e-05 6.632e-05 6.957e-05 0.00% MLMG::mgVcycle_up::0 106 6.397e-05 6.619e-05 6.952e-05 0.00% Castro::avgDown() 15 4.938e-05 5.77e-05 6.717e-05 0.00% amrex::average_down_w_geom 60 5.036e-05 5.939e-05 6.67e-05 0.00% MLMG::computeResidual() 106 5.445e-05 5.889e-05 6.432e-05 0.00% MLMG::mgVcycle_up::2 106 5.476e-05 5.624e-05 6.177e-05 0.00% Amr::defBaseLevel() 1 3.184e-05 4.495e-05 5.84e-05 0.00% MLMG::computeMLResidual() 32 4.149e-05 4.698e-05 5.709e-05 0.00% BoxList::complementIn 30 1.363e-05 2.297e-05 4.841e-05 0.00% MLPoisson::define() 14 4.068e-05 4.37e-05 4.733e-05 0.00% makeSFC 42 2.87e-05 3.629e-05 4.523e-05 0.00% Amr::writeSmallPlotFile() 1 3.477e-05 3.817e-05 4.385e-05 0.00% Amr::bldFineLevels() 1 1.614e-05 2.411e-05 3.472e-05 0.00% AmrMesh-cluster 1 0 4.238e-06 3.39e-05 0.00% Amr::initialInit() 1 1.163e-06 5.683e-06 3.381e-05 0.00% BoxList::parallelComplementIn() 30 1.257e-05 1.782e-05 3.053e-05 0.00% DistributionMapping::Distribute() 46 2.132e-05 2.455e-05 2.899e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.258e-05 2.59e-05 2.89e-05 0.00% MLPoisson::prepareForSolve() 14 1.213e-05 1.513e-05 2.606e-05 0.00% MLMG::getGradSolution() 14 1.808e-05 2.049e-05 2.224e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.66e-05 1.946e-05 2.22e-05 0.00% ClusterList::chop() 1 0 2.764e-06 2.211e-05 0.00% MLLinOp::define() 14 1.724e-05 1.988e-05 2.203e-05 0.00% Castro::enforce_speed_limit() 33 1.141e-05 1.448e-05 1.812e-05 0.00% FabArray::RecvLayoutMask() 14 1.626e-05 1.711e-05 1.803e-05 0.00% knapsack() 2 1.107e-05 1.264e-05 1.554e-05 0.00% Amr::initSubcycle() 1 9.522e-06 1.124e-05 1.275e-05 0.00% Castro::apply_problem_tags() 15 7.445e-06 9.257e-06 1.178e-05 0.00% MLMG::MLRhsNormInf() 14 8.194e-06 9.01e-06 1.01e-05 0.00% DistributionMapping::KnapSackDoIt() 2 4.455e-06 4.964e-06 6.324e-06 0.00% Amr::InitializeInit() 1 2.279e-06 3.095e-06 5.228e-06 0.00% Gravity::set_mass_offset() 1 1.188e-06 1.975e-06 4.322e-06 0.00% Amr::init() 1 1.414e-06 2.125e-06 2.646e-06 0.00% Castro::computeInitialDt() 1 1.223e-06 1.695e-06 2.342e-06 0.00% Castro::gwstrain() 2 9.02e-07 1.316e-06 1.708e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 7.033 7.033 7.033 100.00% Amr::init() 1 5.781 5.781 5.781 82.20% Amr::initialInit() 1 5.479 5.479 5.479 77.91% Amr::FinalizeInit() 1 5.358 5.361 5.363 76.26% Castro::post_init() 2 3.923 4.093 4.2 59.72% Gravity::multilevel_solve_for_new_phi() 14 1.802 1.815 1.829 26.00% Gravity::actual_multilevel_solve() 14 1.798 1.809 1.825 25.95% Gravity::solve_phi_with_mlmg() 14 1.789 1.801 1.817 25.83% Amr::regrid() 14 1.39 1.433 1.472 20.93% Castro::computeTemp() 36 1.182 1.27 1.403 19.95% Castro::clean_state() 33 1.125 1.199 1.311 18.65% Amr::InitAmr() 1 1.251 1.251 1.251 17.79% Amr::bldFineLevels() 1 0.9885 1.079 1.219 17.34% Gravity::fill_multipole_BCs() 14 1.138 1.151 1.166 16.58% Castro::post_regrid() 30 0.8653 0.9076 0.9662 13.74% Castro::initData() 3 0.623 0.6999 0.8272 11.76% FabArray::ParallelCopy() 2952 0.2135 0.5133 0.7207 10.25% Gravity::actual_solve_with_mlmg() 14 0.648 0.6494 0.6506 9.25% FabArray::ParallelCopy_finish() 2952 0.1178 0.4328 0.6482 9.22% MLMG::solve() 14 0.6214 0.6231 0.6244 8.88% MLMG::oneIter() 106 0.5328 0.5338 0.5341 7.59% Castro::reset_internal_energy(MultiFab) 36 0.4139 0.4487 0.5005 7.12% Castro::reset_internal_energy(Fab) 654 0.4135 0.4483 0.5001 7.11% amrex::average_down 844 0.1083 0.2809 0.3939 5.60% MLMG::mgVcycle() 318 0.375 0.377 0.3784 5.38% Castro::avgDown() 15 0.07585 0.2475 0.3589 5.10% Castro::avgDown(state_indx) 60 0.07579 0.2474 0.3588 5.10% amrex::average_down_w_geom 60 0.07569 0.2473 0.3587 5.10% MLCellLinOp::smooth() 2544 0.3046 0.3087 0.3125 4.44% Amr::writePlotFile() 1 0.3023 0.3024 0.3025 4.30% Castro::Castro() 16 0.1562 0.2022 0.2643 3.76% Castro::derive() 97 0.2507 0.2521 0.2529 3.60% AmrLevel::derive() 97 0.2506 0.252 0.2528 3.59% amrex::Copy() 948 0.2187 0.2358 0.2523 3.59% AmrLevel::FillPatch() 215 0.2065 0.2251 0.2359 3.35% MLPoisson::Fsmooth() 5088 0.1971 0.2034 0.2122 3.02% Castro::normalize_species() 33 0.1618 0.1759 0.2002 2.85% FillPatchIterator::Initialize 215 0.1587 0.1832 0.1965 2.79% Amr::grid_places() 15 0.02046 0.1209 0.1835 2.61% AmrMesh::MakeNewGrids() 15 0.02011 0.1205 0.1831 2.60% Castro::initMFs() 16 0.1 0.1292 0.171 2.43% MLCellLinOp::applyBC() 6294 0.1475 0.1567 0.1691 2.40% TagBoxArray::mapPRD 15 0.001565 0.1021 0.1649 2.34% FabArray::FillBoundary() 5552 0.1077 0.1202 0.1359 1.93% FillPatchSingleLevel 259 0.09527 0.1216 0.1336 1.90% Amr::InitializeInit() 1 0.1155 0.1177 0.1206 1.71% Amr::defBaseLevel() 1 0.1155 0.1177 0.1206 1.71% FillPatchIterator::FillFromTwoLevels() 126 0.07887 0.1021 0.1122 1.60% FillPatchTwoLevels 126 0.07868 0.1019 0.112 1.59% MLMG::mgVcycle_down::0 106 0.1066 0.1074 0.108 1.54% MLMG::mgVcycle_bottom 318 0.1011 0.1028 0.1056 1.50% Castro::init(old) 13 0.08229 0.09929 0.1046 1.49% MLMG::miniCycle() 212 0.1012 0.1025 0.1045 1.49% FabArray::setVal() 1769 0.06636 0.08013 0.0975 1.39% FabArray::ParallelCopy_nowait() 2952 0.0697 0.07921 0.09441 1.34% AmrLevel::AmrLevel(dm) 16 0.05679 0.07259 0.0938 1.33% StateData::define() 64 0.0566 0.0724 0.09364 1.33% FillBoundary_finish() 5552 0.05764 0.0725 0.09189 1.31% MLMG::mgVcycle_up::0 106 0.09062 0.09104 0.09131 1.30% MLMG::computeResWithCrseSolFineCor() 106 0.0831 0.08534 0.08649 1.23% MLCellLinOp::apply() 1040 0.06501 0.06964 0.07279 1.03% MLCellLinOp::correctionResidual() 755 0.06493 0.06831 0.07182 1.02% MLCellLinOp::solutionResidual() 258 0.06052 0.06385 0.06782 0.96% MLCellLinOp::reflux() 138 0.05371 0.05728 0.05948 0.85% FillPatchIterator::FillFromLevel0() 89 0.03824 0.04724 0.0555 0.79% FillBoundary_nowait() 5552 0.04199 0.04567 0.04886 0.69% MLMG::computeResWithCrseCorFineCor() 106 0.03549 0.03775 0.03903 0.56% Gravity::get_new_grav_vector() 4 0.03483 0.03681 0.03851 0.55% VisMF::Write(FabArray) 2 0.02928 0.03239 0.03765 0.54% MLPoisson::Fapply() 1040 0.027 0.02987 0.03365 0.48% MLMG::computeMLResidual() 32 0.02527 0.02851 0.0323 0.46% MLMG::computeResidual() 106 0.02797 0.02993 0.03129 0.44% MLMG::addInterpCorrection() 530 0.01835 0.02814 0.02981 0.42% MultiFab::Multiply() 287 0.02228 0.02687 0.02825 0.40% MLCellLinOp::updateSolBC() 120 0.02073 0.0237 0.02792 0.40% Castro::computeInitialDt() 1 0.02212 0.02497 0.02723 0.39% Castro::estTimeStep() 1 0.02211 0.02497 0.02723 0.39% MLMG::mgVcycle_down::1 106 0.0223 0.02269 0.02289 0.33% Castro::buildMetrics() 16 0.01474 0.01861 0.02255 0.32% MLMG:computeResOfCorrection() 530 0.01899 0.01998 0.02097 0.30% MLCellLinOp::updateCorBC() 106 0.01883 0.01994 0.02095 0.30% MLMG::mgVcycle_up::2 106 0.008435 0.01875 0.02034 0.29% FabArray::Xpay() 1013 0.01662 0.01831 0.01979 0.28% MLMG::mgVcycle_up::1 106 0.01891 0.01902 0.01912 0.27% MLMG::prepareForSolve() 14 0.01421 0.01691 0.0188 0.27% amrex::Add() 575 0.01256 0.0144 0.01628 0.23% MLPoisson::define() 14 0.01252 0.01417 0.01587 0.23% MLMG::interpCorrection_1 106 0.01124 0.01246 0.0139 0.20% MLMG::ResNormInf() 152 0.009792 0.01128 0.01285 0.18% MLPoisson::FFlux() 3408 0.01137 0.01185 0.01256 0.18% Castro::errorEst() 15 0.01069 0.01134 0.01211 0.17% FabArrayBase::TheFPinfo() 49 0.0004011 0.005329 0.01077 0.15% FPinfo::FPinfo() 9 0.0003203 0.005241 0.01068 0.15% DistributionMapping::LeastUsedCPUs() 9 0.0002744 0.005177 0.01061 0.15% FillPatchInterp(MF) 44 0.001872 0.006829 0.01022 0.15% MLMG::mgVcycle_down::2 106 0.008935 0.009158 0.009946 0.14% MLMG::getGradSolution() 14 0.008554 0.009038 0.009614 0.14% MLCellLinOp::compGrad() 28 0.008534 0.009018 0.009594 0.14% Castro::sum_integrated_quantities() 1 0.006847 0.00689 0.00692 0.10% Castro::apply_tagging_restrictions() 15 0.005835 0.006347 0.006804 0.10% MultiFab::max() 54 0.00324 0.005313 0.006782 0.10% MLCellLinOp::defineAuxData() 14 0.005338 0.005928 0.006731 0.10% FabArrayBase::getCPC() 3662 0.005305 0.005812 0.006451 0.09% MLCellLinOp::defineBC() 14 0.005321 0.00579 0.006291 0.09% Gravity::average_fine_ec_onto_crse_ec() 14 0.003753 0.004491 0.005213 0.07% FabArray::norminf(mask) 46 0.004873 0.004953 0.00505 0.07% MLMG::mgVcycle_down::3 106 0.001338 0.001795 0.004567 0.06% MLMG::MLResNormInf() 32 0.004009 0.004068 0.004194 0.06% FabArray::norminf() 188 0.002964 0.003441 0.00391 0.06% average_down_faces 84 0.002341 0.003051 0.003828 0.05% MLLinOp::define() 14 0.001106 0.002405 0.003658 0.05% BndryData::define() 42 0.003182 0.00341 0.003646 0.05% MLLinOp::defineGrids() 14 0.001085 0.002385 0.003638 0.05% Gravity::update_max_rhs() 1 0.0007482 0.002442 0.003582 0.05% Castro::enforce_min_density() 33 0.002567 0.00297 0.003528 0.05% MLMG::mgVcycle_up::3 106 0.0009591 0.001292 0.003503 0.05% MLMG::actualBottomSolve() 106 2.103e-05 0.0004508 0.003448 0.05% DistributionMapping::KnapSackDoIt() 2 0.0001078 0.0008707 0.003306 0.05% MLLinOp::makeSubCommunicator() 14 0.0006759 0.00196 0.003195 0.05% MLCGSolver::bicgstab 13 0 0.0003885 0.003108 0.04% MLMG::mgVcycle_down::4 106 0.001185 0.001368 0.002465 0.04% Castro::volWgtSum() 46 0.002001 0.002226 0.002455 0.03% Castro::enforce_consistent_e() 3 0.001177 0.0016 0.002286 0.03% FabArrayBase::CPC::define() 624 0.001673 0.001892 0.002244 0.03% FabArray::mult() 34 0.001507 0.00182 0.002243 0.03% MLMG::MLRhsNormInf() 14 0.001821 0.001872 0.001936 0.03% MLMG::mgVcycle_up::4 106 0.001115 0.001235 0.001901 0.03% StateDataPhysBCFunct::() 259 0.001313 0.001364 0.00146 0.02% FabArrayBase::getFB() 5552 0.001082 0.001131 0.001308 0.02% StateData::FillBoundary(geom) 8 0.001134 0.001172 0.001255 0.02% Castro::build_fine_mask() 55 0.0008547 0.001053 0.001247 0.02% AMRErrorTag::operator() 15 0.001098 0.001121 0.001166 0.02% MLPoisson::prepareForSolve() 14 0.0004279 0.0006099 0.0008063 0.01% MLCellLinOp::setLevelBC() 28 0.0004642 0.0006214 0.0007951 0.01% MLCellLinOp::prepareForSolve() 14 0.0004156 0.0005948 0.0007928 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005233 0.0005584 0.0006029 0.01% FabArray::setDomainBndry() 259 0.0004465 0.0005028 0.000554 0.01% TagBoxArray::collate() 15 0.0002309 0.0002919 0.0003539 0.01% MLCGSolver::ParallelAllReduce 95 0 3.882e-05 0.0003106 0.00% Castro::locWgtSum() 6 0.0001936 0.0002155 0.0002492 0.00% FabArrayBase::FB::FB() 35 8.319e-05 9.549e-05 0.0001436 0.00% OwnerMask() 15 9.186e-05 0.0001121 0.0001332 0.00% AmrMesh-cluster 1 0 1.618e-05 0.0001294 0.00% FabArray::Saxpy() 54 0 1.602e-05 0.0001282 0.00% Castro::volProductSum() 2 8.146e-05 0.000104 0.0001238 0.00% amrex::Dot() 54 0 1.434e-05 0.0001147 0.00% MLLinOp::makeAgglomeratedDMap 14 7.041e-05 8.158e-05 9.519e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 7.37e-05 7.806e-05 8.331e-05 0.00% BoxList::parallelComplementIn() 30 2.651e-05 4.079e-05 7.863e-05 0.00% ClusterList::intersect() 1 0 9.175e-06 7.34e-05 0.00% makeSFC 42 4.617e-05 5.567e-05 6.629e-05 0.00% BoxList::complementIn 30 1.363e-05 2.297e-05 4.841e-05 0.00% Amr::writeSmallPlotFile() 1 3.477e-05 3.817e-05 4.385e-05 0.00% DistributionMapping::Distribute() 46 2.132e-05 2.455e-05 2.899e-05 0.00% ClusterList::chop() 1 0 2.764e-06 2.211e-05 0.00% Castro::enforce_speed_limit() 33 1.141e-05 1.448e-05 1.812e-05 0.00% FabArray::RecvLayoutMask() 14 1.626e-05 1.711e-05 1.803e-05 0.00% knapsack() 2 1.107e-05 1.264e-05 1.554e-05 0.00% Amr::initSubcycle() 1 9.522e-06 1.124e-05 1.275e-05 0.00% Castro::apply_problem_tags() 15 7.445e-06 9.257e-06 1.178e-05 0.00% Gravity::set_mass_offset() 1 1.188e-06 1.975e-06 4.322e-06 0.00% Castro::gwstrain() 2 9.02e-07 1.316e-06 1.708e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 15 B 19 B 32 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.11-17-g9e35dc19489d) finalized