MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.05-29-g76d6d344e12d) initialized Starting run at 07:06:04 UTC on 2023-05-25. Successfully read inputs file ... Castro git describe: 23.05-25-g99ae92958 AMReX git describe: 23.05-29-g76d6d344e Microphysics git describe: 23.05-12-g1f8fd85f reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.00292475 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.123045861 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001621903 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002007324 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00110038 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001090672 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001122982 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001109544 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001127502 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001093389 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001145139 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001120455 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001115994 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001108205 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001083338 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.236598301 seconds Ending run at 07:06:10 UTC on 2023-05-25. Run time = 6.39028342 Run time without initialization = 0.000284306 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.39 ... 6.39 ... 6.39 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2238 1.2239 1.2239 19.15% Gravity::fill_multipole_BCs() 14 1.115 1.128 1.14 17.84% Castro::post_init() 2 0.9795 0.9803 0.9809 15.35% Castro::computeTemp() 36 0.6879 0.7376 0.819 12.82% Castro::reset_internal_energy(Fab) 654 0.39 0.4183 0.4643 7.27% FabArray::ParallelCopy_finish() 2952 0.0598 0.2823 0.4062 6.36% MLPoisson::Fsmooth() 5088 0.2385 0.2469 0.2578 4.03% Castro::normalize_species() 33 0.1666 0.1753 0.1883 2.95% Castro::initData() 3 0.1121 0.1269 0.1498 2.34% Castro::derive() 97 0.1392 0.1402 0.1418 2.22% amrex::Copy() 975 0.1325 0.1344 0.136 2.13% Castro::initMFs() 16 0.09724 0.1089 0.1258 1.97% FillBoundary_finish() 5552 0.05702 0.0671 0.08097 1.27% StateData::define() 64 0.05579 0.06263 0.07237 1.13% FabArray::setVal() 1769 0.04021 0.04976 0.05504 0.86% amrex::average_down 844 0.04392 0.04772 0.05158 0.81% FillBoundary_nowait() 5552 0.04024 0.04198 0.04321 0.68% MLCellLinOp::applyBC() 6294 0.03292 0.03495 0.03747 0.59% VisMF::Write(FabArray) 2 0.03209 0.03274 0.0353 0.55% FabArray::ParallelCopy_nowait() 2952 0.02406 0.02616 0.03067 0.48% Castro::estTimeStep() 1 0.02215 0.0246 0.02692 0.42% MLPoisson::Fapply() 1040 0.02411 0.02506 0.02663 0.42% Amr::regrid() 14 0.01456 0.01671 0.02044 0.32% FillPatchIterator::Initialize 215 0.01597 0.01715 0.01812 0.28% MLMG::addInterpCorrection() 530 0.01722 0.01744 0.01775 0.28% MLCellLinOp::reflux() 138 0.0167 0.01717 0.01751 0.27% Castro::buildMetrics() 16 0.01209 0.01356 0.01561 0.24% FabArray::Xpay() 1013 0.01203 0.01307 0.01445 0.23% Castro::Castro() 16 0.008868 0.01048 0.01369 0.21% MultiFab::Multiply() 287 0.01236 0.01283 0.01304 0.20% amrex::Add() 575 0.01076 0.01154 0.01233 0.19% MLCellLinOp::updateSolBC() 120 0.0106 0.01149 0.01197 0.19% MLPoisson::FFlux() 3408 0.01096 0.01128 0.01151 0.18% MLCellLinOp::updateCorBC() 106 0.00954 0.0104 0.01082 0.17% FillPatchInterp(MF) 44 0.001734 0.006498 0.00968 0.15% Amr::writePlotFile() 1 0.005494 0.007807 0.008556 0.13% MLMG::interpCorrection_1 106 0.006336 0.00691 0.007772 0.12% AmrMesh::MakeNewGrids() 15 0.006541 0.006679 0.006801 0.11% Castro::apply_tagging_restrictions() 15 0.005846 0.006105 0.006279 0.10% MLMG::prepareForSolve() 14 0.004792 0.005048 0.005253 0.08% FabArray::norminf(mask) 46 0.004777 0.004825 0.004871 0.08% MLMG::ResNormInf() 152 0.002661 0.003919 0.004793 0.08% MLCellLinOp::defineAuxData() 14 0.003898 0.003946 0.004043 0.06% FabArray::norminf() 174 0.002891 0.003307 0.003781 0.06% MLLinOp::makeSubCommunicator() 14 0.0007377 0.002191 0.003707 0.06% FabArrayBase::getCPC() 3662 0.003478 0.003532 0.003614 0.06% MultiFab::max() 54 0.002786 0.003219 0.003574 0.06% MLCellLinOp::smooth() 2544 0.001665 0.002097 0.003358 0.05% MLCellLinOp::compGrad() 28 0.003145 0.003288 0.003354 0.05% Castro::enforce_min_density() 33 0.002771 0.002906 0.003113 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002573 0.002726 0.002829 0.04% Gravity::get_new_grav_vector() 4 0.0018 0.002098 0.002503 0.04% BndryData::define() 42 0.002277 0.002343 0.002445 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0001472 0.001489 0.002422 0.04% Gravity::actual_solve_with_mlmg() 14 0.001902 0.001992 0.002176 0.03% FabArray::FillBoundary() 5552 0.001937 0.001991 0.002081 0.03% MLCellLinOp::defineBC() 14 0.001833 0.001962 0.002075 0.03% FabArrayBase::CPC::define() 624 0.001568 0.001714 0.00192 0.03% Castro::volWgtSum() 46 0.001686 0.00171 0.001752 0.03% FabArray::mult() 34 0.00116 0.001335 0.001553 0.02% MLCGSolver::bicgstab 13 0 0.0001845 0.001476 0.02% FillPatchTwoLevels 126 0.0006734 0.001112 0.001401 0.02% Castro::enforce_consistent_e() 3 0.0009715 0.001151 0.001376 0.02% average_down_faces 84 0.001046 0.001143 0.001252 0.02% FabArray::ParallelCopy() 2952 0.001178 0.001195 0.001234 0.02% StateData::FillBoundary(geom) 8 0.001112 0.001155 0.001193 0.02% FabArrayBase::getFB() 5552 0.001039 0.001076 0.001154 0.02% AMRErrorTag::operator() 15 0.0009173 0.0009425 0.0009778 0.02% Gravity::actual_multilevel_solve() 14 0.0007918 0.0008124 0.000841 0.01% Castro::build_fine_mask() 55 0.0006554 0.0006872 0.0007268 0.01% Castro::sum_integrated_quantities() 1 0.0004943 0.0005739 0.0007115 0.01% TagBoxArray::collate() 15 0.0002662 0.000328 0.0006116 0.01% MLMG::solve() 14 0.0004718 0.000537 0.0005978 0.01% MLCellLinOp::apply() 1040 0.0004331 0.0004604 0.0005838 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000457 0.0004741 0.0004979 0.01% MLMG::mgVcycle() 318 0.0004113 0.0004423 0.0004661 0.01% MLCellLinOp::correctionResidual() 755 0.000387 0.0004094 0.0004652 0.01% Amr::grid_places() 15 0.0003536 0.0003831 0.000462 0.01% main() 1 0.0004159 0.0004394 0.0004614 0.01% MLCellLinOp::prepareForSolve() 14 0.000359 0.0003862 0.0004423 0.01% MLLinOp::defineGrids() 14 0.0002737 0.0003185 0.0004349 0.01% FabArray::setDomainBndry() 259 0.0003785 0.0004087 0.000424 0.01% MLCellLinOp::setLevelBC() 28 0.000335 0.0003541 0.0003853 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002964 0.000318 0.0003483 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002646 0.0002787 0.0003069 0.00% MLCGSolver::ParallelAllReduce 81 0 3.778e-05 0.0003022 0.00% MLMG::MLResNormInf() 32 0.0001432 0.0001887 0.0002991 0.00% MLMG::oneIter() 106 0.0002636 0.0002748 0.0002919 0.00% MLMG::actualBottomSolve() 106 2.181e-05 5.686e-05 0.00028 0.00% MLMG::mgVcycle_bottom 318 0.0002231 0.0002489 0.0002654 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001664 0.0001827 0.0002112 0.00% MLCellLinOp::solutionResidual() 258 0.0001812 0.000192 0.0002098 0.00% Castro::locWgtSum() 6 0.0001863 0.0001986 0.0002079 0.00% Castro::init(old) 13 0.0001559 0.0001667 0.000176 0.00% MLMG:computeResOfCorrection() 530 0.0001559 0.000163 0.0001718 0.00% FillPatchSingleLevel 259 0.0001603 0.0001658 0.0001716 0.00% StateDataPhysBCFunct::() 259 0.0001492 0.000156 0.0001714 0.00% AmrLevel::AmrLevel(dm) 16 0.0001349 0.0001438 0.0001543 0.00% MLMG::mgVcycle_down::0 106 0.0001365 0.000145 0.0001518 0.00% FabArrayBase::FB::FB() 35 8.013e-05 8.95e-05 0.0001329 0.00% MLMG::miniCycle() 212 8.447e-05 0.0001128 0.0001326 0.00% Gravity::update_max_rhs() 1 8.016e-05 0.0001076 0.0001304 0.00% amrex::Dot() 54 0 1.513e-05 0.000121 0.00% MLMG::mgVcycle_down::1 106 0.000112 0.0001169 0.0001205 0.00% MLMG::computeResWithCrseCorFineCor() 106 7.846e-05 8.682e-05 0.0001158 0.00% OwnerMask() 15 8.952e-05 0.0001036 0.0001151 0.00% FPinfo::FPinfo() 9 7.36e-05 8.976e-05 0.0001121 0.00% TagBoxArray::mapPRD 15 9.357e-05 9.974e-05 0.0001066 0.00% MLMG::mgVcycle_down::2 106 8.568e-05 8.825e-05 9.8e-05 0.00% Castro::post_regrid() 30 5.956e-05 8.079e-05 9.13e-05 0.00% Castro::volProductSum() 2 8.231e-05 8.444e-05 8.971e-05 0.00% MLMG::mgVcycle_down::4 106 6.996e-05 7.399e-05 8.962e-05 0.00% MLMG::mgVcycle_down::3 106 7.657e-05 8.031e-05 8.716e-05 0.00% FabArray::LinComb() 27 0 1.053e-05 8.427e-05 0.00% FabArray::Saxpy() 27 0 1.009e-05 8.073e-05 0.00% Castro::clean_state() 33 5.796e-05 6.409e-05 7.87e-05 0.00% Amr::FinalizeInit() 1 9.962e-06 2.388e-05 7.805e-05 0.00% MLMG::mgVcycle_up::4 106 6.666e-05 7.177e-05 7.7e-05 0.00% FabArrayBase::TheFPinfo() 49 6.326e-05 6.904e-05 7.523e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.991e-05 6.659e-05 7.508e-05 0.00% ClusterList::intersect() 1 0 9.137e-06 7.309e-05 0.00% MLMG::mgVcycle_up::0 106 6.518e-05 6.794e-05 7.226e-05 0.00% Castro::errorEst() 15 4.704e-05 5.536e-05 7.168e-05 0.00% MLMG::mgVcycle_up::2 106 5.418e-05 5.728e-05 6.673e-05 0.00% Castro::avgDown(state_indx) 60 5.656e-05 6.219e-05 6.596e-05 0.00% Amr::defBaseLevel() 1 3.784e-05 5.184e-05 6.564e-05 0.00% MLMG::mgVcycle_up::1 106 5.785e-05 6.099e-05 6.425e-05 0.00% MLMG::computeResidual() 106 5.53e-05 5.952e-05 6.262e-05 0.00% MLMG::mgVcycle_up::3 106 5.543e-05 5.697e-05 6.24e-05 0.00% amrex::average_down_w_geom 60 4.544e-05 5.063e-05 5.549e-05 0.00% MLMG::computeMLResidual() 32 3.556e-05 4.109e-05 5.184e-05 0.00% Castro::avgDown() 15 3.595e-05 4.424e-05 4.903e-05 0.00% MLPoisson::define() 14 3.478e-05 3.771e-05 4.354e-05 0.00% makeSFC 42 2.712e-05 3.154e-05 4.201e-05 0.00% AmrMesh-cluster 1 0 4.633e-06 3.707e-05 0.00% MLLinOp::define() 14 1.463e-05 1.824e-05 3.342e-05 0.00% Amr::bldFineLevels() 1 1.427e-05 1.903e-05 3.319e-05 0.00% Amr::writeSmallPlotFile() 1 2.88e-05 2.959e-05 3.091e-05 0.00% Amr::initialInit() 1 1.158e-06 4.702e-06 2.825e-05 0.00% DistributionMapping::Distribute() 46 2.269e-05 2.454e-05 2.799e-05 0.00% BoxList::parallelComplementIn() 30 1.021e-05 1.512e-05 2.779e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.113e-05 2.407e-05 2.774e-05 0.00% MLPoisson::prepareForSolve() 14 1.131e-05 1.649e-05 2.377e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.526e-05 2.023e-05 2.313e-05 0.00% FabArray::RecvLayoutMask() 14 1.577e-05 1.702e-05 2.027e-05 0.00% ClusterList::chop() 1 0 2.363e-06 1.891e-05 0.00% MLMG::getGradSolution() 14 1.694e-05 1.784e-05 1.848e-05 0.00% DistributionMapping::KnapSackDoIt() 2 4.13e-06 6.176e-06 1.629e-05 0.00% knapsack() 2 1.022e-05 1.153e-05 1.32e-05 0.00% Castro::enforce_speed_limit() 33 1.024e-05 1.211e-05 1.308e-05 0.00% BoxList::complementIn 30 1.01e-05 1.139e-05 1.293e-05 0.00% Amr::initSubcycle() 1 9.306e-06 1.018e-05 1.043e-05 0.00% MLMG::MLRhsNormInf() 14 8.461e-06 8.642e-06 8.831e-06 0.00% Castro::apply_problem_tags() 15 5.711e-06 6.53e-06 7.133e-06 0.00% Gravity::set_mass_offset() 1 1.054e-06 2.866e-06 6.036e-06 0.00% Amr::InitializeInit() 1 2.101e-06 2.654e-06 4.72e-06 0.00% Castro::computeInitialDt() 1 1.692e-06 2.299e-06 2.652e-06 0.00% Amr::init() 1 1.386e-06 1.745e-06 2.101e-06 0.00% Castro::gwstrain() 2 9.71e-07 1.238e-06 1.424e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.39 6.39 6.39 100.00% Amr::init() 1 5.166 5.166 5.166 80.84% Amr::initialInit() 1 4.929 4.929 4.929 77.14% Amr::FinalizeInit() 1 4.819 4.822 4.824 75.49% Castro::post_init() 2 3.567 3.693 3.772 59.03% Gravity::multilevel_solve_for_new_phi() 14 1.771 1.783 1.797 28.12% Gravity::actual_multilevel_solve() 14 1.768 1.78 1.794 28.08% Gravity::solve_phi_with_mlmg() 14 1.762 1.774 1.788 27.98% Castro::computeTemp() 36 1.082 1.156 1.284 20.09% Amr::regrid() 14 1.215 1.228 1.256 19.65% Amr::InitAmr() 1 1.224 1.224 1.224 19.15% Castro::clean_state() 33 1.057 1.111 1.21 18.93% Gravity::fill_multipole_BCs() 14 1.116 1.129 1.142 17.86% Amr::bldFineLevels() 1 0.8909 0.9532 1.053 16.49% Castro::post_regrid() 30 0.8153 0.8437 0.8931 13.98% Castro::initData() 3 0.557 0.6323 0.7478 11.70% Gravity::actual_solve_with_mlmg() 14 0.643 0.6444 0.6461 10.11% MLMG::solve() 14 0.6244 0.6249 0.6251 9.78% MLMG::oneIter() 106 0.5514 0.5524 0.5532 8.66% Castro::reset_internal_energy(MultiFab) 36 0.3903 0.4187 0.4646 7.27% Castro::reset_internal_energy(Fab) 654 0.39 0.4183 0.4643 7.27% FabArray::ParallelCopy() 2952 0.1187 0.3369 0.4609 7.21% MLMG::mgVcycle() 318 0.4176 0.4181 0.4187 6.55% FabArray::ParallelCopy_finish() 2952 0.0598 0.2823 0.4062 6.36% MLCellLinOp::smooth() 2544 0.3508 0.3527 0.3577 5.60% amrex::average_down 844 0.07724 0.2039 0.2841 4.45% MLPoisson::Fsmooth() 5088 0.2385 0.2469 0.2578 4.03% Castro::avgDown() 15 0.04706 0.1731 0.2524 3.95% Castro::avgDown(state_indx) 60 0.04703 0.1731 0.2523 3.95% amrex::average_down_w_geom 60 0.04697 0.173 0.2522 3.95% Amr::writePlotFile() 1 0.2367 0.2368 0.2369 3.71% Castro::derive() 97 0.1967 0.1971 0.1974 3.09% Castro::normalize_species() 33 0.1666 0.1753 0.1883 2.95% Castro::Castro() 16 0.1382 0.1559 0.1783 2.79% MLCellLinOp::applyBC() 6294 0.1411 0.1472 0.1572 2.46% Amr::grid_places() 15 0.01977 0.09336 0.1406 2.20% AmrMesh::MakeNewGrids() 15 0.0193 0.09298 0.1402 2.19% amrex::Copy() 975 0.1325 0.1344 0.136 2.13% Castro::initMFs() 16 0.09724 0.1089 0.1258 1.97% FabArray::FillBoundary() 5552 0.1036 0.1122 0.1243 1.94% TagBoxArray::mapPRD 15 0.002196 0.07583 0.1232 1.93% MLMG::mgVcycle_bottom 318 0.1146 0.1158 0.1197 1.87% MLMG::miniCycle() 212 0.1147 0.1155 0.1162 1.82% MLMG::mgVcycle_down::0 106 0.114 0.1149 0.1155 1.81% Amr::InitializeInit() 1 0.1049 0.1072 0.1097 1.72% Amr::defBaseLevel() 1 0.1049 0.1072 0.1097 1.72% MLMG::mgVcycle_up::0 106 0.1048 0.105 0.1053 1.65% FillPatchIterator::Initialize 215 0.08749 0.09199 0.09561 1.50% FillBoundary_finish() 5552 0.05702 0.0671 0.08097 1.27% MLMG::computeResWithCrseSolFineCor() 106 0.07225 0.07358 0.07477 1.17% AmrLevel::AmrLevel(dm) 16 0.05594 0.06278 0.0725 1.13% StateData::define() 64 0.05579 0.06263 0.07237 1.13% FillPatchSingleLevel 259 0.05075 0.05625 0.0609 0.95% MLCellLinOp::apply() 1040 0.05746 0.05939 0.06067 0.95% MLCellLinOp::correctionResidual() 755 0.0562 0.05773 0.0601 0.94% FabArray::ParallelCopy_nowait() 2952 0.05099 0.05339 0.05772 0.90% MLCellLinOp::solutionResidual() 258 0.05454 0.05564 0.05697 0.89% FabArray::setVal() 1769 0.04021 0.04976 0.05504 0.86% FillPatchTwoLevels 126 0.04434 0.04893 0.05228 0.82% MLCellLinOp::reflux() 138 0.04737 0.04893 0.05 0.78% Castro::init(old) 13 0.04461 0.04723 0.04983 0.78% FillBoundary_nowait() 5552 0.04137 0.04314 0.0445 0.70% VisMF::Write(FabArray) 2 0.03209 0.03274 0.0353 0.55% MLMG::computeResWithCrseCorFineCor() 106 0.03079 0.03152 0.03239 0.51% MLMG::addInterpCorrection() 530 0.01924 0.02925 0.03083 0.48% MLMG::computeResidual() 106 0.02725 0.02875 0.02992 0.47% Castro::computeInitialDt() 1 0.02215 0.0246 0.02693 0.42% Castro::estTimeStep() 1 0.02215 0.0246 0.02692 0.42% MLMG::mgVcycle_down::1 106 0.0237 0.02464 0.02671 0.42% MLPoisson::Fapply() 1040 0.02411 0.02506 0.02663 0.42% MLMG::mgVcycle_up::2 106 0.01037 0.02083 0.02241 0.35% MLCellLinOp::updateSolBC() 120 0.02053 0.02128 0.02201 0.34% MLMG::computeMLResidual() 32 0.02027 0.02083 0.02123 0.33% MLMG::mgVcycle_up::1 106 0.02027 0.02039 0.02046 0.32% MLCellLinOp::updateCorBC() 106 0.01812 0.01909 0.02013 0.31% MLMG:computeResOfCorrection() 530 0.01791 0.01834 0.01958 0.31% Gravity::get_new_grav_vector() 4 0.01742 0.0185 0.01936 0.30% Castro::buildMetrics() 16 0.01359 0.01526 0.01751 0.27% FabArray::Xpay() 1013 0.01203 0.01307 0.01445 0.23% MLPoisson::define() 14 0.01109 0.01261 0.01431 0.22% MultiFab::Multiply() 287 0.01236 0.01283 0.01304 0.20% amrex::Add() 575 0.01076 0.01154 0.01233 0.19% MLMG::interpCorrection_1 106 0.009959 0.01067 0.01161 0.18% MLPoisson::FFlux() 3408 0.01096 0.01128 0.01151 0.18% MLMG::mgVcycle_down::2 106 0.009053 0.01057 0.0115 0.18% MLMG::ResNormInf() 152 0.009305 0.01024 0.01095 0.17% MLMG::prepareForSolve() 14 0.009935 0.01009 0.01031 0.16% Castro::errorEst() 15 0.009563 0.00987 0.01011 0.16% FillPatchInterp(MF) 44 0.001734 0.006498 0.00968 0.15% Castro::apply_tagging_restrictions() 15 0.005846 0.006105 0.006279 0.10% FabArrayBase::getCPC() 3662 0.005071 0.005247 0.005406 0.08% MLCellLinOp::defineAuxData() 14 0.004893 0.00497 0.005204 0.08% MLCellLinOp::defineBC() 14 0.004866 0.004996 0.005094 0.08% FabArray::norminf(mask) 46 0.004777 0.004825 0.004871 0.08% Castro::sum_integrated_quantities() 1 0.004782 0.004802 0.004861 0.08% MLMG::getGradSolution() 14 0.004465 0.004583 0.004653 0.07% MLCellLinOp::compGrad() 28 0.004448 0.004565 0.004635 0.07% MLMG::mgVcycle_down::3 106 0.001287 0.001734 0.004488 0.07% MLLinOp::define() 14 0.001097 0.002602 0.004267 0.07% MLLinOp::defineGrids() 14 0.001081 0.002584 0.004234 0.07% MLMG::MLResNormInf() 32 0.003826 0.003862 0.003958 0.06% MLMG::actualBottomSolve() 106 2.181e-05 0.0004954 0.003789 0.06% FabArray::norminf() 174 0.002891 0.003307 0.003781 0.06% MLLinOp::makeSubCommunicator() 14 0.0007377 0.002191 0.003707 0.06% MLMG::mgVcycle_up::3 106 0.000915 0.001262 0.003581 0.06% MultiFab::max() 54 0.002786 0.003219 0.003574 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003257 0.003443 0.003514 0.05% MLCGSolver::bicgstab 13 0 0.0004321 0.003457 0.05% Castro::enforce_min_density() 33 0.002771 0.002906 0.003113 0.05% BndryData::define() 42 0.002839 0.002892 0.003017 0.05% FabArrayBase::TheFPinfo() 49 0.0002621 0.001621 0.00256 0.04% FPinfo::FPinfo() 9 0.0001934 0.001552 0.00249 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0001472 0.001489 0.002422 0.04% MLMG::mgVcycle_down::4 106 0.001138 0.001298 0.002277 0.04% average_down_faces 84 0.001899 0.002031 0.002121 0.03% FabArrayBase::CPC::define() 624 0.001568 0.001714 0.00192 0.03% MLMG::mgVcycle_up::4 106 0.001107 0.001217 0.001887 0.03% MLMG::MLRhsNormInf() 14 0.00177 0.001809 0.001824 0.03% Castro::volWgtSum() 46 0.00169 0.001715 0.001756 0.03% FabArray::mult() 34 0.00116 0.001335 0.001553 0.02% Castro::enforce_consistent_e() 3 0.0009715 0.001151 0.001376 0.02% StateDataPhysBCFunct::() 259 0.001265 0.001311 0.001347 0.02% FabArrayBase::getFB() 5552 0.001121 0.001166 0.001287 0.02% StateData::FillBoundary(geom) 8 0.001112 0.001155 0.001193 0.02% Gravity::update_max_rhs() 1 0.0006616 0.0009419 0.001158 0.02% AMRErrorTag::operator() 15 0.0009173 0.0009425 0.0009778 0.02% Castro::build_fine_mask() 55 0.0006554 0.0006872 0.0007268 0.01% TagBoxArray::collate() 15 0.0002662 0.000328 0.0006116 0.01% DistributionMapping::KnapSackDoIt() 2 5.155e-05 0.0002839 0.000573 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000457 0.0004741 0.0004979 0.01% MLPoisson::prepareForSolve() 14 0.0003705 0.0004027 0.0004542 0.01% MLCellLinOp::prepareForSolve() 14 0.000359 0.0003862 0.0004423 0.01% FabArray::setDomainBndry() 259 0.0003785 0.0004087 0.000424 0.01% MLCellLinOp::setLevelBC() 28 0.000335 0.0003541 0.0003853 0.01% MLCGSolver::ParallelAllReduce 81 0 4.63e-05 0.0003704 0.01% Castro::locWgtSum() 6 0.0001868 0.0001992 0.0002084 0.00% FabArrayBase::FB::FB() 35 8.013e-05 8.95e-05 0.0001329 0.00% AmrMesh-cluster 1 0 1.613e-05 0.0001291 0.00% amrex::Dot() 54 0 1.513e-05 0.000121 0.00% OwnerMask() 15 8.952e-05 0.0001036 0.0001151 0.00% MLLinOp::makeAgglomeratedDMap 14 6.689e-05 7.464e-05 9.219e-05 0.00% Castro::volProductSum() 2 8.245e-05 8.462e-05 8.993e-05 0.00% FabArray::LinComb() 27 0 1.053e-05 8.427e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.635e-05 7.027e-05 8.424e-05 0.00% FabArray::Saxpy() 27 0 1.009e-05 8.073e-05 0.00% ClusterList::intersect() 1 0 9.137e-06 7.309e-05 0.00% makeSFC 42 4.442e-05 5.057e-05 6.446e-05 0.00% BoxList::parallelComplementIn() 30 2.031e-05 2.651e-05 3.953e-05 0.00% Amr::writeSmallPlotFile() 1 2.88e-05 2.959e-05 3.091e-05 0.00% DistributionMapping::Distribute() 46 2.269e-05 2.454e-05 2.799e-05 0.00% FabArray::RecvLayoutMask() 14 1.577e-05 1.702e-05 2.027e-05 0.00% ClusterList::chop() 1 0 2.363e-06 1.891e-05 0.00% knapsack() 2 1.022e-05 1.153e-05 1.32e-05 0.00% Castro::enforce_speed_limit() 33 1.024e-05 1.211e-05 1.308e-05 0.00% BoxList::complementIn 30 1.01e-05 1.139e-05 1.293e-05 0.00% Amr::initSubcycle() 1 9.306e-06 1.018e-05 1.043e-05 0.00% Castro::apply_problem_tags() 15 5.711e-06 6.53e-06 7.133e-06 0.00% Gravity::set_mass_offset() 1 1.054e-06 2.866e-06 6.036e-06 0.00% Castro::gwstrain() 2 9.71e-07 1.238e-06 1.424e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 20 B 26 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.05-29-g76d6d344e12d) finalized