MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.05-31-g2e1106e246c4) initialized Starting run at 06:27:22 UTC on 2023-06-01. Successfully read inputs file ... Castro git describe: 23.05-30-g283f15d69 AMReX git describe: 23.05-31-g2e1106e24 Microphysics git describe: 23.05-15-g2652c955 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002924889 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.119744475 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001402007 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002066148 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001116376 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001450358 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001386859 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001675857 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002435045 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001711325 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001693246 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001613185 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001683563 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.005562593 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001151703 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.256047073 seconds Ending run at 06:27:29 UTC on 2023-06-01. Run time = 6.696753844 Run time without initialization = 0.000426306 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.697 ... 6.697 ... 6.697 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.3532 1.3532 1.3532 20.21% Gravity::fill_multipole_BCs() 14 1.171 1.186 1.196 17.87% Castro::post_init() 2 1.021 1.029 1.033 15.42% Castro::computeTemp() 36 0.6929 0.7483 0.8291 12.38% Castro::reset_internal_energy(Fab) 654 0.3901 0.4222 0.4662 6.96% FabArray::ParallelCopy_finish() 2952 0.1342 0.3166 0.4602 6.87% MLPoisson::Fsmooth() 5088 0.2303 0.2425 0.2489 3.72% Castro::normalize_species() 33 0.1648 0.1745 0.1882 2.81% Castro::derive() 97 0.1389 0.1449 0.1556 2.32% Castro::initData() 3 0.114 0.128 0.1498 2.24% amrex::Copy() 975 0.1271 0.1334 0.1439 2.15% Castro::initMFs() 16 0.09974 0.1116 0.1266 1.89% FillBoundary_finish() 5552 0.06769 0.07786 0.0996 1.49% StateData::define() 64 0.05696 0.06368 0.07185 1.07% amrex::average_down 844 0.0419 0.04583 0.04957 0.74% FabArray::setVal() 1769 0.04307 0.0466 0.04895 0.73% FillBoundary_nowait() 5552 0.03915 0.04258 0.04575 0.68% MLCellLinOp::applyBC() 6294 0.03534 0.03736 0.03976 0.59% VisMF::Write(FabArray) 2 0.02972 0.0303 0.03266 0.49% FabArray::ParallelCopy_nowait() 2952 0.02389 0.02693 0.03224 0.48% FillPatchIterator::Initialize 215 0.01548 0.0184 0.02639 0.39% MLPoisson::Fapply() 1040 0.02361 0.02525 0.02633 0.39% Castro::estTimeStep() 1 0.02212 0.0236 0.0251 0.37% Amr::writePlotFile() 1 0.005191 0.01014 0.02248 0.34% MLMG::addInterpCorrection() 530 0.01939 0.01977 0.02016 0.30% MLCellLinOp::reflux() 138 0.01774 0.01866 0.01972 0.29% Amr::regrid() 14 0.01431 0.01605 0.01944 0.29% Castro::buildMetrics() 16 0.01229 0.01384 0.01565 0.23% FabArray::Xpay() 1013 0.01199 0.01295 0.01391 0.21% MultiFab::Multiply() 287 0.01278 0.0131 0.0135 0.20% MLPoisson::FFlux() 3408 0.01149 0.01193 0.01242 0.19% MLCellLinOp::updateSolBC() 120 0.01058 0.01171 0.01241 0.19% amrex::Add() 575 0.01081 0.01135 0.01219 0.18% MLCellLinOp::updateCorBC() 106 0.009503 0.01051 0.0111 0.17% Castro::Castro() 16 0.008855 0.009744 0.01096 0.16% FillPatchInterp(MF) 44 0.001685 0.006449 0.009595 0.14% MLMG::interpCorrection_1 106 0.006331 0.007092 0.007698 0.11% MLMG::prepareForSolve() 14 0.00474 0.005178 0.006804 0.10% AmrMesh::MakeNewGrids() 15 0.006482 0.006559 0.006627 0.10% Castro::apply_tagging_restrictions() 15 0.006003 0.006191 0.006362 0.10% MLCellLinOp::compGrad() 28 0.003244 0.003919 0.005785 0.09% MLLinOp::makeSubCommunicator() 14 0.001481 0.003112 0.005273 0.08% FabArray::norminf(mask) 46 0.004804 0.005002 0.005148 0.08% MLMG::MLResNormInf() 32 0.0002452 0.0009902 0.004746 0.07% MLMG::ResNormInf() 152 0.002945 0.003839 0.004679 0.07% MLCellLinOp::defineAuxData() 14 0.003855 0.004051 0.004585 0.07% MultiFab::max() 54 0.003048 0.003557 0.004169 0.06% Gravity::multilevel_solve_for_new_phi() 14 0.002564 0.003044 0.004084 0.06% FabArrayBase::getCPC() 3662 0.003473 0.003589 0.003804 0.06% FabArray::norminf() 174 0.002929 0.003347 0.003706 0.06% Castro::enforce_min_density() 33 0.002502 0.002711 0.002885 0.04% Gravity::actual_solve_with_mlmg() 14 0.001831 0.002143 0.002883 0.04% BndryData::define() 42 0.002275 0.002394 0.002603 0.04% Gravity::get_new_grav_vector() 4 0.001864 0.002126 0.002463 0.04% FabArray::FillBoundary() 5552 0.00198 0.002042 0.002112 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0003589 0.001338 0.002074 0.03% MLCellLinOp::defineBC() 14 0.001846 0.001982 0.002061 0.03% FabArrayBase::CPC::define() 624 0.00158 0.00173 0.001947 0.03% Castro::volWgtSum() 46 0.001684 0.001714 0.001747 0.03% MLCellLinOp::smooth() 2544 0.001585 0.001656 0.001747 0.03% FabArray::mult() 34 0.001161 0.001346 0.001624 0.02% FillPatchTwoLevels 126 0.0006792 0.001163 0.001534 0.02% MLCGSolver::bicgstab 13 0 0.0001795 0.001436 0.02% Castro::enforce_consistent_e() 3 0.001027 0.001212 0.001428 0.02% StateData::FillBoundary(geom) 8 0.001197 0.001265 0.001304 0.02% FabArray::ParallelCopy() 2952 0.001196 0.001242 0.00127 0.02% average_down_faces 84 0.001054 0.001132 0.001216 0.02% FabArrayBase::getFB() 5552 0.001092 0.001148 0.001198 0.02% Gravity::actual_multilevel_solve() 14 0.0007849 0.0008725 0.001071 0.02% Castro::build_fine_mask() 55 0.0006923 0.0007891 0.001034 0.02% AMRErrorTag::operator() 15 0.0009397 0.0009531 0.0009731 0.01% TagBoxArray::collate() 15 0.0003048 0.000518 0.0008493 0.01% MLMG::solve() 14 0.0004427 0.0006134 0.0008368 0.01% Castro::sum_integrated_quantities() 1 0.0005695 0.0005993 0.0006862 0.01% main() 1 0.0004078 0.0005246 0.0006434 0.01% MLCellLinOp::apply() 1040 0.0004373 0.0004659 0.0005807 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005254 0.0005424 0.0005676 0.01% Amr::grid_places() 15 0.000337 0.0003999 0.0005393 0.01% MLMG::mgVcycle() 318 0.0004315 0.0004649 0.0005238 0.01% MLCellLinOp::correctionResidual() 755 0.0003807 0.0004038 0.0004478 0.01% MLCellLinOp::prepareForSolve() 14 0.0003519 0.0003888 0.0004357 0.01% MLCellLinOp::setLevelBC() 28 0.000341 0.0003663 0.0004157 0.01% FabArray::setDomainBndry() 259 0.0003551 0.0003794 0.0004035 0.01% MLLinOp::defineGrids() 14 0.0002588 0.0003093 0.0003786 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002624 0.0002884 0.0003291 0.00% MLCGSolver::ParallelAllReduce 81 0 3.965e-05 0.0003172 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.000266 0.000279 0.0002916 0.00% MLMG::oneIter() 106 0.0002502 0.0002702 0.0002861 0.00% MLMG::actualBottomSolve() 106 2.656e-05 6.068e-05 0.0002691 0.00% MLMG::mgVcycle_bottom 318 0.0002237 0.0002396 0.0002568 0.00% Castro::locWgtSum() 6 0.0001953 0.0002086 0.0002189 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001642 0.0001818 0.0002074 0.00% OwnerMask() 15 0.0001043 0.0001371 0.0002035 0.00% Castro::init(old) 13 0.0001587 0.0001749 0.0001926 0.00% MLCellLinOp::solutionResidual() 258 0.0001762 0.000185 0.0001925 0.00% FillPatchSingleLevel 259 0.0001532 0.0001651 0.0001849 0.00% MLMG:computeResOfCorrection() 530 0.0001561 0.0001615 0.000177 0.00% AmrLevel::AmrLevel(dm) 16 0.0001224 0.0001502 0.0001685 0.00% StateDataPhysBCFunct::() 259 0.0001408 0.0001502 0.0001597 0.00% MLMG::mgVcycle_down::0 106 0.0001271 0.0001309 0.0001356 0.00% FabArrayBase::FB::FB() 35 7.837e-05 8.958e-05 0.0001355 0.00% MLMG::miniCycle() 212 8.925e-05 0.0001074 0.0001288 0.00% TagBoxArray::mapPRD 15 9.567e-05 0.0001078 0.0001246 0.00% MLMG::mgVcycle_down::1 106 0.0001083 0.000115 0.0001221 0.00% amrex::Dot() 54 0 1.492e-05 0.0001193 0.00% Gravity::update_max_rhs() 1 7.501e-05 8.86e-05 0.0001085 0.00% FPinfo::FPinfo() 9 8.001e-05 9.045e-05 0.0001066 0.00% Amr::FinalizeInit() 1 6.917e-06 1.877e-05 9.594e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 7.924e-05 8.447e-05 9.318e-05 0.00% FabArray::Saxpy() 27 0 1.162e-05 9.292e-05 0.00% MLMG::mgVcycle_down::3 106 7.389e-05 8.139e-05 9.284e-05 0.00% MLMG::getGradSolution() 14 1.653e-05 2.806e-05 9.233e-05 0.00% MLMG::mgVcycle_down::4 106 6.94e-05 7.579e-05 8.955e-05 0.00% Castro::volProductSum() 2 8.488e-05 8.677e-05 8.887e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.564e-05 6.936e-05 8.865e-05 0.00% FabArray::LinComb() 27 0 1.075e-05 8.6e-05 0.00% MLMG::mgVcycle_down::2 106 8.072e-05 8.351e-05 8.595e-05 0.00% FabArrayBase::TheFPinfo() 49 6.211e-05 7.051e-05 8.068e-05 0.00% MLMG::mgVcycle_up::1 106 5.791e-05 6.415e-05 7.748e-05 0.00% MLMG::mgVcycle_up::4 106 6.743e-05 7.083e-05 7.701e-05 0.00% Castro::clean_state() 33 5.989e-05 6.506e-05 7.684e-05 0.00% Castro::post_regrid() 30 6.055e-05 6.566e-05 7.429e-05 0.00% Amr::defBaseLevel() 1 5.393e-05 6.155e-05 7.359e-05 0.00% Castro::avgDown(state_indx) 60 5.827e-05 6.305e-05 7.07e-05 0.00% MLMG::mgVcycle_up::0 106 6.554e-05 6.783e-05 7.06e-05 0.00% MLMG::computeResidual() 106 5.167e-05 5.663e-05 6.384e-05 0.00% amrex::average_down_w_geom 60 4.604e-05 5.391e-05 6.328e-05 0.00% MLMG::mgVcycle_up::3 106 5.553e-05 5.757e-05 6.123e-05 0.00% Castro::errorEst() 15 4.418e-05 5.166e-05 6.077e-05 0.00% ClusterList::intersect() 1 0 7.385e-06 5.908e-05 0.00% MLMG::mgVcycle_up::2 106 5.245e-05 5.497e-05 5.729e-05 0.00% MLPoisson::define() 14 3.194e-05 3.729e-05 4.554e-05 0.00% MLMG::computeMLResidual() 32 3.803e-05 4.119e-05 4.534e-05 0.00% Castro::avgDown() 15 3.262e-05 3.834e-05 4.387e-05 0.00% makeSFC 42 2.788e-05 3.278e-05 3.955e-05 0.00% Amr::writeSmallPlotFile() 1 2.91e-05 3.031e-05 3.142e-05 0.00% AmrMesh-cluster 1 0 3.792e-06 3.034e-05 0.00% Amr::bldFineLevels() 1 1.437e-05 1.942e-05 2.982e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.178e-05 2.442e-05 2.741e-05 0.00% DistributionMapping::Distribute() 46 2.108e-05 2.425e-05 2.665e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.821e-05 2.099e-05 2.285e-05 0.00% MLLinOp::define() 14 1.357e-05 1.745e-05 2.163e-05 0.00% ClusterList::chop() 1 0 2.341e-06 1.873e-05 0.00% FabArray::RecvLayoutMask() 14 1.588e-05 1.636e-05 1.686e-05 0.00% Castro::apply_problem_tags() 15 5.592e-06 7.467e-06 1.487e-05 0.00% Castro::enforce_speed_limit() 33 1.182e-05 1.287e-05 1.461e-05 0.00% MLPoisson::prepareForSolve() 14 1.164e-05 1.295e-05 1.404e-05 0.00% BoxList::complementIn 30 9.25e-06 1.09e-05 1.393e-05 0.00% knapsack() 2 1.045e-05 1.186e-05 1.271e-05 0.00% BoxList::parallelComplementIn() 30 1.065e-05 1.137e-05 1.229e-05 0.00% Amr::initSubcycle() 1 9.69e-06 1.086e-05 1.168e-05 0.00% MLMG::MLRhsNormInf() 14 8.196e-06 8.587e-06 9.466e-06 0.00% Amr::init() 1 1.898e-06 3.341e-06 7.433e-06 0.00% Gravity::set_mass_offset() 1 8.81e-07 2.033e-06 5.246e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.063e-06 4.646e-06 5.219e-06 0.00% Amr::InitializeInit() 1 2.146e-06 2.861e-06 4.088e-06 0.00% Castro::computeInitialDt() 1 1.651e-06 2.421e-06 3.113e-06 0.00% Amr::initialInit() 1 1.36e-06 1.717e-06 2.312e-06 0.00% Castro::gwstrain() 2 9.3e-07 1.189e-06 1.384e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.697 6.697 6.697 100.00% Amr::init() 1 5.343 5.343 5.343 79.78% Amr::initialInit() 1 5.087 5.087 5.087 75.96% Amr::FinalizeInit() 1 4.976 4.977 4.979 74.35% Castro::post_init() 2 3.725 3.843 3.913 58.44% Gravity::multilevel_solve_for_new_phi() 14 1.851 1.864 1.877 28.02% Gravity::actual_multilevel_solve() 14 1.848 1.861 1.874 27.98% Gravity::solve_phi_with_mlmg() 14 1.841 1.854 1.866 27.87% Amr::InitAmr() 1 1.353 1.353 1.353 20.21% Castro::computeTemp() 36 1.083 1.171 1.29 19.26% Amr::regrid() 14 1.223 1.25 1.274 19.03% Castro::clean_state() 33 1.049 1.121 1.213 18.12% Gravity::fill_multipole_BCs() 14 1.172 1.188 1.198 17.89% Amr::bldFineLevels() 1 0.9022 0.9586 1.052 15.72% Castro::post_regrid() 30 0.8092 0.8499 0.8932 13.34% Castro::initData() 3 0.5707 0.64 0.7526 11.24% Gravity::actual_solve_with_mlmg() 14 0.6638 0.6658 0.668 9.98% MLMG::solve() 14 0.6365 0.6375 0.6405 9.56% MLMG::oneIter() 106 0.56 0.5608 0.5613 8.38% FabArray::ParallelCopy() 2952 0.1847 0.3694 0.5125 7.65% Castro::reset_internal_energy(MultiFab) 36 0.3904 0.4225 0.4665 6.97% Castro::reset_internal_energy(Fab) 654 0.3901 0.4222 0.4662 6.96% FabArray::ParallelCopy_finish() 2952 0.1342 0.3166 0.4602 6.87% MLMG::mgVcycle() 318 0.4228 0.4242 0.4252 6.35% MLCellLinOp::smooth() 2544 0.3518 0.3531 0.3594 5.37% amrex::average_down 844 0.07483 0.1977 0.2717 4.06% Amr::writePlotFile() 1 0.2562 0.2563 0.2563 3.83% MLPoisson::Fsmooth() 5088 0.2303 0.2425 0.2489 3.72% Castro::avgDown() 15 0.04512 0.1665 0.2403 3.59% Castro::avgDown(state_indx) 60 0.04508 0.1665 0.2402 3.59% amrex::average_down_w_geom 60 0.04502 0.1664 0.2402 3.59% Castro::derive() 97 0.2062 0.2171 0.2196 3.28% Castro::normalize_species() 33 0.1648 0.1745 0.1882 2.81% MLCellLinOp::applyBC() 6294 0.1525 0.1611 0.1773 2.65% Castro::Castro() 16 0.141 0.1557 0.1732 2.59% amrex::Copy() 975 0.1271 0.1334 0.1439 2.15% FabArray::FillBoundary() 5552 0.1146 0.1237 0.1419 2.12% Amr::grid_places() 15 0.02927 0.09742 0.1388 2.07% AmrMesh::MakeNewGrids() 15 0.02888 0.09702 0.1385 2.07% FillPatchIterator::Initialize 215 0.09482 0.1211 0.1319 1.97% Castro::initMFs() 16 0.09974 0.1116 0.1266 1.89% TagBoxArray::mapPRD 15 0.01151 0.07979 0.1215 1.81% MLMG::mgVcycle_down::0 106 0.1173 0.1181 0.1195 1.78% MLMG::mgVcycle_bottom 318 0.1109 0.1125 0.1164 1.74% MLMG::miniCycle() 212 0.111 0.1122 0.1129 1.69% MLMG::mgVcycle_up::0 106 0.1112 0.1113 0.1116 1.67% Amr::InitializeInit() 1 0.1076 0.1091 0.1106 1.65% Amr::defBaseLevel() 1 0.1076 0.1091 0.1106 1.65% FillBoundary_finish() 5552 0.06769 0.07786 0.0996 1.49% FillPatchSingleLevel 259 0.04848 0.07808 0.0985 1.47% MLMG::computeResWithCrseSolFineCor() 106 0.07534 0.0762 0.07733 1.15% AmrLevel::AmrLevel(dm) 16 0.05711 0.06383 0.07197 1.07% StateData::define() 64 0.05696 0.06368 0.07185 1.07% FillPatchTwoLevels 126 0.04722 0.05914 0.06478 0.97% MLCellLinOp::apply() 1040 0.05922 0.0615 0.0633 0.95% Castro::init(old) 13 0.04786 0.05794 0.06265 0.94% MLCellLinOp::correctionResidual() 755 0.05784 0.05946 0.06073 0.91% MLCellLinOp::solutionResidual() 258 0.05748 0.05811 0.05867 0.88% FabArray::ParallelCopy_nowait() 2952 0.04884 0.05152 0.05793 0.87% MLCellLinOp::reflux() 138 0.04967 0.05207 0.05326 0.80% FabArray::setVal() 1769 0.04307 0.0466 0.04895 0.73% FillBoundary_nowait() 5552 0.04032 0.04382 0.04703 0.70% MLMG::addInterpCorrection() 530 0.02124 0.03251 0.03444 0.51% VisMF::Write(FabArray) 2 0.02972 0.0303 0.03266 0.49% MLMG::computeResWithCrseCorFineCor() 106 0.03136 0.03219 0.03265 0.49% MLMG::computeResidual() 106 0.02751 0.02855 0.02898 0.43% MLPoisson::Fapply() 1040 0.02361 0.02525 0.02633 0.39% MLMG::mgVcycle_down::1 106 0.02419 0.02554 0.02609 0.39% Castro::computeInitialDt() 1 0.02213 0.0236 0.0251 0.37% Castro::estTimeStep() 1 0.02212 0.0236 0.0251 0.37% MLMG::computeMLResidual() 32 0.02207 0.02405 0.025 0.37% MLCellLinOp::updateSolBC() 120 0.0213 0.02299 0.02424 0.36% MLMG::mgVcycle_up::2 106 0.00884 0.02037 0.02232 0.33% MLMG::mgVcycle_up::1 106 0.02052 0.02063 0.02072 0.31% Gravity::get_new_grav_vector() 4 0.01965 0.02008 0.02062 0.31% MLCellLinOp::updateCorBC() 106 0.01874 0.0196 0.02034 0.30% MLMG:computeResOfCorrection() 530 0.01817 0.0186 0.01952 0.29% Castro::buildMetrics() 16 0.01374 0.01539 0.01742 0.26% MLPoisson::define() 14 0.01195 0.01382 0.01609 0.24% FabArray::Xpay() 1013 0.01199 0.01295 0.01391 0.21% MultiFab::Multiply() 287 0.01278 0.0131 0.0135 0.20% MLMG::getGradSolution() 14 0.008398 0.01191 0.01264 0.19% MLCellLinOp::compGrad() 28 0.008306 0.01188 0.01261 0.19% MLMG::interpCorrection_1 106 0.01075 0.01144 0.01257 0.19% MLPoisson::FFlux() 3408 0.01149 0.01193 0.01242 0.19% amrex::Add() 575 0.01081 0.01135 0.01219 0.18% MLMG::prepareForSolve() 14 0.009495 0.01039 0.01162 0.17% MLMG::mgVcycle_down::2 106 0.009222 0.009712 0.01137 0.17% MLMG::ResNormInf() 152 0.009749 0.01035 0.01124 0.17% Castro::errorEst() 15 0.009457 0.009937 0.01053 0.16% FillPatchInterp(MF) 44 0.001685 0.006449 0.009595 0.14% MLMG::MLResNormInf() 32 0.004162 0.004831 0.008629 0.13% Castro::apply_tagging_restrictions() 15 0.006003 0.006191 0.006362 0.10% MLCellLinOp::defineAuxData() 14 0.00493 0.005163 0.005767 0.09% MLLinOp::define() 14 0.001864 0.003515 0.005756 0.09% MLLinOp::defineGrids() 14 0.001847 0.003498 0.005737 0.09% FabArrayBase::getCPC() 3662 0.005053 0.005319 0.005573 0.08% MLCellLinOp::defineBC() 14 0.004854 0.005103 0.005378 0.08% MLLinOp::makeSubCommunicator() 14 0.001481 0.003112 0.005273 0.08% FabArray::norminf(mask) 46 0.004804 0.005002 0.005148 0.08% Castro::sum_integrated_quantities() 1 0.00488 0.004893 0.004944 0.07% Gravity::average_fine_ec_onto_crse_ec() 14 0.003282 0.004086 0.004622 0.07% MLMG::mgVcycle_down::3 106 0.001327 0.001755 0.004454 0.07% MultiFab::max() 54 0.003048 0.003557 0.004169 0.06% MLMG::actualBottomSolve() 106 2.656e-05 0.0004989 0.003775 0.06% FabArray::norminf() 174 0.002929 0.003347 0.003706 0.06% MLMG::mgVcycle_up::3 106 0.0009049 0.001276 0.003616 0.05% MLCGSolver::bicgstab 13 0 0.0004316 0.003453 0.05% average_down_faces 84 0.002052 0.002849 0.003392 0.05% BndryData::define() 42 0.002871 0.002994 0.003223 0.05% Castro::enforce_min_density() 33 0.002502 0.002711 0.002885 0.04% MLMG::mgVcycle_down::4 106 0.001158 0.001341 0.002378 0.04% FabArrayBase::TheFPinfo() 49 0.0004963 0.001469 0.002227 0.03% FPinfo::FPinfo() 9 0.0004234 0.001398 0.002153 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0003589 0.001338 0.002074 0.03% FabArrayBase::CPC::define() 624 0.00158 0.00173 0.001947 0.03% MLMG::MLRhsNormInf() 14 0.001758 0.001835 0.001902 0.03% MLMG::mgVcycle_up::4 106 0.001091 0.001227 0.001869 0.03% Castro::volWgtSum() 46 0.001688 0.001719 0.001753 0.03% Gravity::update_max_rhs() 1 0.0005999 0.001095 0.001656 0.02% FabArray::mult() 34 0.001161 0.001346 0.001624 0.02% StateDataPhysBCFunct::() 259 0.001357 0.001415 0.001446 0.02% Castro::enforce_consistent_e() 3 0.001027 0.001212 0.001428 0.02% FabArrayBase::getFB() 5552 0.00117 0.001238 0.00131 0.02% StateData::FillBoundary(geom) 8 0.001197 0.001265 0.001304 0.02% Castro::build_fine_mask() 55 0.0006923 0.0007891 0.001034 0.02% AMRErrorTag::operator() 15 0.0009397 0.0009531 0.0009731 0.01% TagBoxArray::collate() 15 0.0003048 0.000518 0.0008493 0.01% DistributionMapping::KnapSackDoIt() 2 4.302e-05 0.0003964 0.0007636 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005254 0.0005424 0.0005676 0.01% MLPoisson::prepareForSolve() 14 0.0003659 0.0004018 0.0004493 0.01% MLCellLinOp::prepareForSolve() 14 0.0003519 0.0003888 0.0004357 0.01% MLCellLinOp::setLevelBC() 28 0.000341 0.0003663 0.0004157 0.01% FabArray::setDomainBndry() 259 0.0003551 0.0003794 0.0004035 0.01% MLCGSolver::ParallelAllReduce 81 0 4.833e-05 0.0003866 0.01% Castro::locWgtSum() 6 0.0001959 0.0002092 0.0002195 0.00% OwnerMask() 15 0.0001043 0.0001371 0.0002035 0.00% FabArrayBase::FB::FB() 35 7.837e-05 8.958e-05 0.0001355 0.00% amrex::Dot() 54 0 1.492e-05 0.0001193 0.00% AmrMesh-cluster 1 0 1.352e-05 0.0001081 0.00% FabArray::Saxpy() 27 0 1.162e-05 9.292e-05 0.00% Castro::volProductSum() 2 8.509e-05 8.697e-05 8.901e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 5.719e-05 7.287e-05 8.697e-05 0.00% FabArray::LinComb() 27 0 1.075e-05 8.6e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.545e-05 7.604e-05 8.578e-05 0.00% ClusterList::intersect() 1 0 7.385e-06 5.908e-05 0.00% makeSFC 42 4.367e-05 5.162e-05 5.895e-05 0.00% Amr::writeSmallPlotFile() 1 2.91e-05 3.031e-05 3.142e-05 0.00% DistributionMapping::Distribute() 46 2.108e-05 2.425e-05 2.665e-05 0.00% BoxList::parallelComplementIn() 30 2.075e-05 2.227e-05 2.5e-05 0.00% ClusterList::chop() 1 0 2.341e-06 1.873e-05 0.00% FabArray::RecvLayoutMask() 14 1.588e-05 1.636e-05 1.686e-05 0.00% Castro::apply_problem_tags() 15 5.592e-06 7.467e-06 1.487e-05 0.00% Castro::enforce_speed_limit() 33 1.182e-05 1.287e-05 1.461e-05 0.00% BoxList::complementIn 30 9.25e-06 1.09e-05 1.393e-05 0.00% knapsack() 2 1.045e-05 1.186e-05 1.271e-05 0.00% Amr::initSubcycle() 1 9.69e-06 1.086e-05 1.168e-05 0.00% Gravity::set_mass_offset() 1 8.81e-07 2.033e-06 5.246e-06 0.00% Castro::gwstrain() 2 9.3e-07 1.189e-06 1.384e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 20 B 26 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.05-31-g2e1106e246c4) finalized