MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.03-1-gb96f6e5bd13d) initialized Starting run at 02:55:44 UTC on 2023-03-02. Successfully read inputs file ... Castro git describe: 23.03-34-gd4e492a5d AMReX git describe: 23.03-1-gb96f6e5bd Microphysics git describe: 23.03 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002486863 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.123921984 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001553954 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002079256 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001122862 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001133461 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00113618 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001145989 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00108964 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001115522 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001104029 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001170913 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001121 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001104395 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.006341298 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225826e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 2.373778793e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.284381237e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.577115472e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.228821307 seconds Ending run at 02:55:50 UTC on 2023-03-02. Run time = 6.39333322 Run time without initialization = 0.0002703630003 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.393 ... 6.393 ... 6.393 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1963 1.2176 1.2283 19.21% Amr::InitAmr() 1 1.174 1.174 1.174 18.36% Castro::post_init() 2 0.9414 0.9438 0.9455 14.79% Castro::computeTemp() 36 0.6797 0.7383 0.8133 12.72% Castro::reset_internal_energy(Fab) 654 0.3824 0.4101 0.4512 7.06% FabArray::ParallelCopy_finish() 2952 0.0937 0.2919 0.4263 6.67% MLPoisson::Fsmooth() 5088 0.2468 0.2596 0.2681 4.19% Castro::normalize_species() 33 0.1651 0.1747 0.1895 2.96% Castro::initData() 3 0.1097 0.1276 0.1532 2.40% Castro::derive() 97 0.1333 0.1349 0.137 2.14% amrex::Copy() 975 0.131 0.1336 0.1351 2.11% Castro::initMFs() 16 0.09493 0.1053 0.1211 1.89% FillBoundary_finish() 5552 0.05972 0.07008 0.08843 1.38% StateData::define() 64 0.05446 0.06027 0.06892 1.08% amrex::average_down 844 0.04303 0.0472 0.05345 0.84% FabArray::setVal() 1769 0.04231 0.04572 0.04847 0.76% FillBoundary_nowait() 5552 0.0396 0.0422 0.04424 0.69% MLCellLinOp::applyBC() 6294 0.03291 0.03521 0.03833 0.60% VisMF::Write(FabArray) 2 0.02922 0.02985 0.03231 0.51% FabArray::ParallelCopy_nowait() 2952 0.02406 0.02649 0.03226 0.50% Castro::estTimeStep() 1 0.0213 0.02369 0.02664 0.42% MLPoisson::Fapply() 1040 0.02338 0.02479 0.02605 0.41% MLMG::addInterpCorrection() 530 0.01949 0.01985 0.02023 0.32% Amr::regrid() 14 0.01355 0.01562 0.01883 0.29% FillPatchIterator::Initialize 215 0.01628 0.01706 0.01846 0.29% MLCellLinOp::reflux() 138 0.01573 0.01644 0.01694 0.27% Castro::buildMetrics() 16 0.01172 0.0131 0.01499 0.23% Amr::writePlotFile() 1 0.005173 0.008729 0.01415 0.22% MultiFab::Multiply() 287 0.01253 0.01314 0.01366 0.21% FabArray::Xpay() 1013 0.01217 0.01267 0.01333 0.21% MLCellLinOp::updateSolBC() 120 0.0105 0.01153 0.01235 0.19% MLPoisson::FFlux() 3408 0.01109 0.01149 0.01194 0.19% amrex::Add() 575 0.01063 0.01122 0.01178 0.18% MLCellLinOp::updateCorBC() 106 0.009491 0.01041 0.01112 0.17% Castro::Castro() 16 0.008582 0.009414 0.01075 0.17% FillPatchInterp(MF) 44 0.001738 0.006485 0.009697 0.15% MLMG::interpCorrection_1 106 0.006194 0.006875 0.007612 0.12% AmrMesh::MakeNewGrids() 15 0.006688 0.006713 0.006742 0.11% Castro::apply_tagging_restrictions() 15 0.005762 0.00589 0.006197 0.10% MLMG::prepareForSolve() 14 0.004728 0.004933 0.005337 0.08% MLLinOp::makeSubCommunicator() 14 0.0004376 0.003235 0.005318 0.08% FabArray::norminf(mask) 46 0.004724 0.004867 0.00502 0.08% MLMG::ResNormInf() 152 0.002839 0.003852 0.00465 0.07% MultiFab::max() 54 0.003143 0.00369 0.004144 0.06% MLCellLinOp::defineAuxData() 14 0.003853 0.003939 0.004111 0.06% FabArray::norminf() 174 0.002901 0.003321 0.003661 0.06% FabArrayBase::getCPC() 3662 0.003493 0.003567 0.003646 0.06% Gravity::multilevel_solve_for_new_phi() 14 0.00259 0.003011 0.003637 0.06% MLCellLinOp::compGrad() 28 0.003306 0.00338 0.003477 0.05% Castro::enforce_min_density() 33 0.002473 0.002602 0.00279 0.04% BndryData::define() 42 0.002264 0.002342 0.002452 0.04% Gravity::get_new_grav_vector() 4 0.001784 0.002104 0.002399 0.04% Gravity::actual_solve_with_mlmg() 14 0.001889 0.002032 0.002239 0.04% FabArray::FillBoundary() 5552 0.001992 0.002091 0.002195 0.03% MLCellLinOp::defineBC() 14 0.001827 0.001937 0.002024 0.03% FabArrayBase::CPC::define() 624 0.001607 0.001733 0.001968 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0003307 0.001284 0.00194 0.03% Castro::volWgtSum() 46 0.001672 0.001709 0.001769 0.03% MLCellLinOp::smooth() 2544 0.00167 0.001709 0.001751 0.03% FabArray::mult() 34 0.001145 0.001325 0.001619 0.03% MLCGSolver::bicgstab 13 0 0.0001827 0.001461 0.02% Castro::enforce_consistent_e() 3 0.0009633 0.001155 0.001405 0.02% FillPatchTwoLevels 126 0.0006581 0.001122 0.001394 0.02% StateData::FillBoundary(geom) 8 0.001219 0.001261 0.001332 0.02% average_down_faces 84 0.001111 0.001234 0.001322 0.02% FabArray::ParallelCopy() 2952 0.001202 0.001237 0.001286 0.02% FabArrayBase::getFB() 5552 0.001059 0.00111 0.001216 0.02% AMRErrorTag::operator() 15 0.0009379 0.0009614 0.001079 0.02% Gravity::actual_multilevel_solve() 14 0.0007503 0.0008636 0.0009999 0.02% Castro::sum_integrated_quantities() 1 0.0006945 0.000838 0.0009569 0.01% Castro::build_fine_mask() 55 0.0006476 0.0007186 0.0008402 0.01% MLMG::solve() 14 0.0004211 0.0005453 0.0006723 0.01% MLCellLinOp::apply() 1040 0.000441 0.0004725 0.0005854 0.01% Amr::grid_places() 15 0.0003653 0.0004106 0.0005443 0.01% MLMG::MLResNormInf() 32 0.0001519 0.000322 0.0005397 0.01% MLMG::mgVcycle() 318 0.0004205 0.000448 0.0005088 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004567 0.0004816 0.0005054 0.01% MLCGSolver::ParallelAllReduce 81 0 6.246e-05 0.0004997 0.01% MLCellLinOp::prepareForSolve() 14 0.0003418 0.0003707 0.0004592 0.01% main() 1 0.0003589 0.0004057 0.0004587 0.01% MLCellLinOp::correctionResidual() 755 0.0003827 0.0004039 0.0004392 0.01% FabArray::setDomainBndry() 259 0.0003616 0.0003945 0.0004155 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002979 0.0003636 0.0004113 0.01% MLCellLinOp::setLevelBC() 28 0.0003319 0.0003445 0.0003617 0.01% MLLinOp::defineGrids() 14 0.0002505 0.0002965 0.0003604 0.01% TagBoxArray::collate() 15 0.0002436 0.0003082 0.0003469 0.01% MLMG::actualBottomSolve() 106 2.012e-05 5.935e-05 0.00032 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002763 0.0002868 0.0003044 0.00% MLMG::oneIter() 106 0.0002729 0.0002859 0.0003028 0.00% MLMG::mgVcycle_bottom 318 0.0002342 0.000243 0.0002479 0.00% Castro::locWgtSum() 6 0.0001855 0.0001947 0.0002095 0.00% MLCellLinOp::solutionResidual() 258 0.0001827 0.000188 0.0001974 0.00% FillPatchSingleLevel 259 0.0001633 0.0001714 0.0001823 0.00% MLMG::miniCycle() 212 8.897e-05 0.0001073 0.0001815 0.00% Castro::init(old) 13 0.0001533 0.0001661 0.0001787 0.00% MLMG:computeResOfCorrection() 530 0.0001621 0.0001716 0.0001774 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001583 0.000166 0.0001756 0.00% StateDataPhysBCFunct::() 259 0.0001476 0.0001584 0.000175 0.00% FabArrayBase::FB::FB() 35 7.991e-05 9.686e-05 0.0001529 0.00% MLMG::mgVcycle_down::0 106 0.000131 0.0001382 0.0001458 0.00% AmrLevel::AmrLevel(dm) 16 0.0001193 0.0001264 0.0001344 0.00% Gravity::update_max_rhs() 1 8.752e-05 9.853e-05 0.0001299 0.00% FPinfo::FPinfo() 9 8.032e-05 9.341e-05 0.0001267 0.00% amrex::Dot() 54 0 1.548e-05 0.0001238 0.00% MLMG::mgVcycle_down::1 106 0.0001063 0.0001123 0.0001157 0.00% OwnerMask() 15 9.063e-05 9.995e-05 0.0001082 0.00% TagBoxArray::mapPRD 15 8.954e-05 9.52e-05 0.0001064 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.738e-05 9.188e-05 9.868e-05 0.00% MLMG::mgVcycle_down::2 106 8.25e-05 8.517e-05 9.607e-05 0.00% Castro::post_regrid() 30 6.513e-05 7.816e-05 9.199e-05 0.00% MLMG::mgVcycle_down::3 106 7.303e-05 8.385e-05 8.944e-05 0.00% Castro::volProductSum() 2 7.914e-05 8.516e-05 8.803e-05 0.00% FabArray::LinComb() 27 0 1.075e-05 8.604e-05 0.00% Amr::FinalizeInit() 1 8.028e-06 2.697e-05 8.328e-05 0.00% MLMG::mgVcycle_up::1 106 6.216e-05 6.827e-05 8.136e-05 0.00% MLMG::mgVcycle_up::0 106 7.093e-05 7.535e-05 7.885e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.464e-05 7.006e-05 7.857e-05 0.00% MLMG::mgVcycle_down::4 106 6.937e-05 7.361e-05 7.791e-05 0.00% FabArray::Saxpy() 27 0 9.717e-06 7.773e-05 0.00% FabArrayBase::TheFPinfo() 49 6.793e-05 7.062e-05 7.684e-05 0.00% MLMG::mgVcycle_up::4 106 7.008e-05 7.249e-05 7.486e-05 0.00% MLMG::mgVcycle_up::3 106 5.611e-05 6.076e-05 7.186e-05 0.00% Castro::clean_state() 33 5.771e-05 6.429e-05 6.945e-05 0.00% Castro::avgDown(state_indx) 60 5.879e-05 6.227e-05 6.885e-05 0.00% MLMG::computeResidual() 106 6.018e-05 6.418e-05 6.769e-05 0.00% ClusterList::intersect() 1 0 8.313e-06 6.65e-05 0.00% MLMG::mgVcycle_up::2 106 5.677e-05 6.018e-05 6.266e-05 0.00% amrex::average_down_w_geom 60 5.115e-05 5.678e-05 6.225e-05 0.00% Amr::bldFineLevels() 1 1.497e-05 2.824e-05 6.163e-05 0.00% Castro::errorEst() 15 4.184e-05 4.949e-05 5.728e-05 0.00% Amr::defBaseLevel() 1 2.537e-05 4.12e-05 5.553e-05 0.00% MLMG::computeMLResidual() 32 4.081e-05 4.392e-05 5.429e-05 0.00% Castro::avgDown() 15 3.762e-05 4.29e-05 4.902e-05 0.00% makeSFC 42 2.542e-05 3.182e-05 3.816e-05 0.00% MLPoisson::define() 14 3.245e-05 3.511e-05 3.707e-05 0.00% Amr::writeSmallPlotFile() 1 3.01e-05 3.048e-05 3.134e-05 0.00% AmrMesh-cluster 1 0 3.81e-06 3.048e-05 0.00% DistributionMapping::Distribute() 46 2.235e-05 2.471e-05 2.84e-05 0.00% BoxList::complementIn 30 9.016e-06 1.467e-05 2.75e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.166e-05 2.391e-05 2.737e-05 0.00% MLMG::getGradSolution() 14 1.799e-05 2.019e-05 2.706e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.849e-05 2.038e-05 2.604e-05 0.00% MLLinOp::define() 14 1.388e-05 1.777e-05 2.005e-05 0.00% Castro::enforce_speed_limit() 33 1.115e-05 1.315e-05 1.965e-05 0.00% MLPoisson::prepareForSolve() 14 1.322e-05 1.477e-05 1.852e-05 0.00% ClusterList::chop() 1 0 2.184e-06 1.747e-05 0.00% FabArray::RecvLayoutMask() 14 1.57e-05 1.632e-05 1.717e-05 0.00% BoxList::parallelComplementIn() 30 1.185e-05 1.278e-05 1.382e-05 0.00% knapsack() 2 1.088e-05 1.157e-05 1.258e-05 0.00% Amr::initSubcycle() 1 9.056e-06 1.031e-05 1.1e-05 0.00% MLMG::MLRhsNormInf() 14 8.697e-06 9.206e-06 9.749e-06 0.00% Castro::apply_problem_tags() 15 5.073e-06 5.958e-06 6.683e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.166e-06 4.462e-06 4.825e-06 0.00% Amr::InitializeInit() 1 1.944e-06 2.606e-06 4.569e-06 0.00% Castro::computeInitialDt() 1 1.925e-06 2.218e-06 2.549e-06 0.00% Amr::init() 1 1.561e-06 1.896e-06 2.328e-06 0.00% Castro::gwstrain() 2 1.005e-06 1.203e-06 1.8e-06 0.00% Amr::initialInit() 1 1.203e-06 1.395e-06 1.65e-06 0.00% Gravity::set_mass_offset() 1 8.26e-07 1.185e-06 1.54e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.393 6.393 6.393 100.00% Amr::init() 1 5.219 5.219 5.219 81.63% Amr::initialInit() 1 4.99 4.99 4.99 78.05% Amr::FinalizeInit() 1 4.881 4.883 4.886 76.43% Castro::post_init() 2 3.642 3.767 3.847 60.18% Gravity::multilevel_solve_for_new_phi() 14 1.875 1.895 1.906 29.80% Gravity::actual_multilevel_solve() 14 1.872 1.892 1.903 29.76% Gravity::solve_phi_with_mlmg() 14 1.866 1.886 1.896 29.66% Castro::computeTemp() 36 1.062 1.149 1.265 19.78% Amr::regrid() 14 1.197 1.22 1.24 19.39% Gravity::fill_multipole_BCs() 14 1.198 1.219 1.23 19.24% Castro::clean_state() 33 1.033 1.102 1.192 18.64% Amr::InitAmr() 1 1.174 1.174 1.174 18.36% Amr::bldFineLevels() 1 0.8798 0.943 1.041 16.29% Castro::post_regrid() 30 0.8001 0.8352 0.8756 13.70% Castro::initData() 3 0.553 0.632 0.75 11.73% Gravity::actual_solve_with_mlmg() 14 0.6632 0.666 0.668 10.45% MLMG::solve() 14 0.6447 0.6452 0.6456 10.10% MLMG::oneIter() 106 0.5711 0.5717 0.5722 8.95% FabArray::ParallelCopy() 2952 0.1475 0.3461 0.4814 7.53% Castro::reset_internal_energy(MultiFab) 36 0.3827 0.4105 0.4515 7.06% Castro::reset_internal_energy(Fab) 654 0.3824 0.4101 0.4512 7.06% MLMG::mgVcycle() 318 0.4356 0.4374 0.4384 6.86% FabArray::ParallelCopy_finish() 2952 0.0937 0.2919 0.4263 6.67% MLCellLinOp::smooth() 2544 0.3648 0.3673 0.3739 5.85% amrex::average_down 844 0.07746 0.2046 0.2864 4.48% MLPoisson::Fsmooth() 5088 0.2468 0.2596 0.2681 4.19% Castro::avgDown() 15 0.04575 0.1723 0.2542 3.98% Castro::avgDown(state_indx) 60 0.04571 0.1723 0.2542 3.98% amrex::average_down_w_geom 60 0.04565 0.1722 0.2541 3.97% Amr::writePlotFile() 1 0.229 0.2291 0.2291 3.58% Castro::derive() 97 0.1867 0.1915 0.1929 3.02% Castro::normalize_species() 33 0.1651 0.1747 0.1895 2.96% Castro::Castro() 16 0.1356 0.148 0.1673 2.62% MLCellLinOp::applyBC() 6294 0.1416 0.1508 0.1651 2.58% Amr::grid_places() 15 0.02475 0.09579 0.1426 2.23% AmrMesh::MakeNewGrids() 15 0.02435 0.09538 0.1423 2.22% amrex::Copy() 975 0.131 0.1336 0.1351 2.11% FabArray::FillBoundary() 5552 0.1054 0.1156 0.1322 2.07% TagBoxArray::mapPRD 15 0.007512 0.07846 0.1254 1.96% MLMG::mgVcycle_down::0 106 0.122 0.1226 0.1238 1.94% MLMG::mgVcycle_bottom 318 0.1163 0.1181 0.1224 1.91% Castro::initMFs() 16 0.09493 0.1053 0.1211 1.89% MLMG::miniCycle() 212 0.1164 0.1177 0.1186 1.86% MLMG::mgVcycle_up::0 106 0.1128 0.1138 0.1149 1.80% Amr::InitializeInit() 1 0.1034 0.1064 0.1088 1.70% Amr::defBaseLevel() 1 0.1034 0.1064 0.1088 1.70% FillPatchIterator::Initialize 215 0.08737 0.09476 0.09729 1.52% FillBoundary_finish() 5552 0.05972 0.07008 0.08843 1.38% MLMG::computeResWithCrseSolFineCor() 106 0.07249 0.07378 0.07519 1.18% AmrLevel::AmrLevel(dm) 16 0.05458 0.0604 0.06904 1.08% StateData::define() 64 0.05446 0.06027 0.06892 1.08% FillPatchSingleLevel 259 0.05126 0.05881 0.06381 1.00% MLCellLinOp::apply() 1040 0.05825 0.06039 0.06291 0.98% MLCellLinOp::correctionResidual() 755 0.0567 0.05795 0.0592 0.93% MLCellLinOp::solutionResidual() 258 0.05522 0.05686 0.05884 0.92% FabArray::ParallelCopy_nowait() 2952 0.05121 0.05296 0.05825 0.91% FillPatchTwoLevels 126 0.0461 0.05089 0.05413 0.85% Castro::init(old) 13 0.04607 0.04946 0.05218 0.82% MLCellLinOp::reflux() 138 0.04661 0.04893 0.04995 0.78% FabArray::setVal() 1769 0.04231 0.04572 0.04847 0.76% FillBoundary_nowait() 5552 0.04078 0.0434 0.0455 0.71% MLMG::addInterpCorrection() 530 0.02134 0.03206 0.03377 0.53% MLMG::computeResWithCrseCorFineCor() 106 0.03073 0.03173 0.03251 0.51% VisMF::Write(FabArray) 2 0.02922 0.02985 0.03231 0.51% MLMG::computeResidual() 106 0.02793 0.02926 0.02996 0.47% Castro::computeInitialDt() 1 0.0213 0.02369 0.02664 0.42% Castro::estTimeStep() 1 0.0213 0.02369 0.02664 0.42% MLPoisson::Fapply() 1040 0.02338 0.02479 0.02605 0.41% MLMG::mgVcycle_down::1 106 0.02378 0.0245 0.02479 0.39% MLMG::mgVcycle_up::1 106 0.02301 0.02329 0.0241 0.38% MLCellLinOp::updateSolBC() 120 0.02097 0.02196 0.02298 0.36% MLMG::computeMLResidual() 32 0.02083 0.02142 0.02194 0.34% MLMG::mgVcycle_up::2 106 0.008488 0.01952 0.02126 0.33% MLCellLinOp::updateCorBC() 106 0.01826 0.01925 0.0201 0.31% Gravity::get_new_grav_vector() 4 0.01852 0.0188 0.01934 0.30% MLMG:computeResOfCorrection() 530 0.01777 0.01818 0.01849 0.29% Castro::buildMetrics() 16 0.01314 0.01464 0.01675 0.26% MLPoisson::define() 14 0.01097 0.01363 0.01565 0.24% MultiFab::Multiply() 287 0.01253 0.01314 0.01366 0.21% FabArray::Xpay() 1013 0.01217 0.01267 0.01333 0.21% MLMG::interpCorrection_1 106 0.01001 0.01096 0.01219 0.19% MLPoisson::FFlux() 3408 0.01109 0.01149 0.01194 0.19% amrex::Add() 575 0.01063 0.01122 0.01178 0.18% MLMG::ResNormInf() 152 0.009519 0.01021 0.01119 0.18% MLMG::mgVcycle_down::2 106 0.009375 0.00958 0.01049 0.16% MLMG::prepareForSolve() 14 0.009438 0.00992 0.01046 0.16% Castro::errorEst() 15 0.009453 0.009663 0.009965 0.16% FillPatchInterp(MF) 44 0.001738 0.006485 0.009697 0.15% Castro::apply_tagging_restrictions() 15 0.005762 0.00589 0.006197 0.10% MLLinOp::define() 14 0.0007867 0.003624 0.005753 0.09% MLLinOp::defineGrids() 14 0.0007728 0.003607 0.005733 0.09% FabArrayBase::getCPC() 3662 0.005141 0.0053 0.005615 0.09% MLLinOp::makeSubCommunicator() 14 0.0004376 0.003235 0.005318 0.08% MLCellLinOp::defineAuxData() 14 0.004884 0.004993 0.005309 0.08% Castro::sum_integrated_quantities() 1 0.005063 0.005079 0.005123 0.08% MLCellLinOp::defineBC() 14 0.004792 0.004974 0.005082 0.08% FabArray::norminf(mask) 46 0.004724 0.004867 0.00502 0.08% MLMG::getGradSolution() 14 0.004738 0.004801 0.004857 0.08% MLCellLinOp::compGrad() 28 0.004718 0.00478 0.00483 0.08% MLMG::mgVcycle_down::3 106 0.001311 0.001781 0.004525 0.07% MLMG::MLResNormInf() 32 0.00394 0.004049 0.004197 0.07% MultiFab::max() 54 0.003143 0.00369 0.004144 0.06% MLMG::actualBottomSolve() 106 2.012e-05 0.0005206 0.00401 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003636 0.003722 0.003803 0.06% MLMG::mgVcycle_up::3 106 0.0009176 0.001284 0.003664 0.06% FabArray::norminf() 174 0.002901 0.003321 0.003661 0.06% MLCGSolver::bicgstab 13 0 0.0004548 0.003638 0.06% BndryData::define() 42 0.002804 0.002906 0.003039 0.05% Castro::enforce_min_density() 33 0.002473 0.002602 0.00279 0.04% average_down_faces 84 0.002216 0.002305 0.002382 0.04% MLMG::mgVcycle_down::4 106 0.001142 0.001324 0.002313 0.04% FabArrayBase::TheFPinfo() 49 0.000468 0.00141 0.002099 0.03% FPinfo::FPinfo() 9 0.0003976 0.001339 0.002022 0.03% FabArrayBase::CPC::define() 624 0.001607 0.001733 0.001968 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0003307 0.001284 0.00194 0.03% MLMG::mgVcycle_up::4 106 0.001071 0.001192 0.00189 0.03% MLMG::MLRhsNormInf() 14 0.001759 0.001822 0.001879 0.03% Castro::volWgtSum() 46 0.001678 0.001715 0.001774 0.03% FabArray::mult() 34 0.001145 0.001325 0.001619 0.03% Gravity::update_max_rhs() 1 0.0006045 0.001104 0.001574 0.02% StateDataPhysBCFunct::() 259 0.001376 0.00142 0.00149 0.02% Castro::enforce_consistent_e() 3 0.0009633 0.001155 0.001405 0.02% FabArrayBase::getFB() 5552 0.001141 0.001207 0.001369 0.02% StateData::FillBoundary(geom) 8 0.001219 0.001261 0.001332 0.02% AMRErrorTag::operator() 15 0.0009379 0.0009614 0.001079 0.02% Castro::build_fine_mask() 55 0.0006476 0.0007186 0.0008402 0.01% DistributionMapping::KnapSackDoIt() 2 4.579e-05 0.0003602 0.0007739 0.01% MLCGSolver::ParallelAllReduce 81 0 7.159e-05 0.0005727 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004567 0.0004816 0.0005054 0.01% MLPoisson::prepareForSolve() 14 0.0003551 0.0003854 0.0004729 0.01% MLCellLinOp::prepareForSolve() 14 0.0003418 0.0003707 0.0004592 0.01% FabArray::setDomainBndry() 259 0.0003616 0.0003945 0.0004155 0.01% MLCellLinOp::setLevelBC() 28 0.0003319 0.0003445 0.0003617 0.01% TagBoxArray::collate() 15 0.0002436 0.0003082 0.0003469 0.01% Castro::locWgtSum() 6 0.0001861 0.0001953 0.0002103 0.00% FabArrayBase::FB::FB() 35 7.991e-05 9.686e-05 0.0001529 0.00% amrex::Dot() 54 0 1.548e-05 0.0001238 0.00% AmrMesh-cluster 1 0 1.431e-05 0.0001145 0.00% OwnerMask() 15 9.063e-05 9.995e-05 0.0001082 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 5.357e-05 8.019e-05 9.26e-05 0.00% Castro::volProductSum() 2 7.931e-05 8.536e-05 8.829e-05 0.00% FabArray::LinComb() 27 0 1.075e-05 8.604e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.407e-05 7.497e-05 8.424e-05 0.00% FabArray::Saxpy() 27 0 9.717e-06 7.773e-05 0.00% ClusterList::intersect() 1 0 8.313e-06 6.65e-05 0.00% makeSFC 42 4.242e-05 5.106e-05 5.71e-05 0.00% BoxList::parallelComplementIn() 30 2.124e-05 2.745e-05 4.024e-05 0.00% Amr::writeSmallPlotFile() 1 3.01e-05 3.048e-05 3.134e-05 0.00% DistributionMapping::Distribute() 46 2.235e-05 2.471e-05 2.84e-05 0.00% BoxList::complementIn 30 9.016e-06 1.467e-05 2.75e-05 0.00% Castro::enforce_speed_limit() 33 1.115e-05 1.315e-05 1.965e-05 0.00% ClusterList::chop() 1 0 2.184e-06 1.747e-05 0.00% FabArray::RecvLayoutMask() 14 1.57e-05 1.632e-05 1.717e-05 0.00% knapsack() 2 1.088e-05 1.157e-05 1.258e-05 0.00% Amr::initSubcycle() 1 9.056e-06 1.031e-05 1.1e-05 0.00% Castro::apply_problem_tags() 15 5.073e-06 5.958e-06 6.683e-06 0.00% Castro::gwstrain() 2 1.005e-06 1.203e-06 1.8e-06 0.00% Gravity::set_mass_offset() 1 8.26e-07 1.185e-06 1.54e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 15 B 16 B 19 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.03-1-gb96f6e5bd13d) finalized