MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.05-26-g4167cbe534a0) initialized Starting run at 07:10:42 UTC on 2023-05-23. Successfully read inputs file ... Castro git describe: 23.05-25-g99ae92958 AMReX git describe: 23.05-26-g4167cbe53 Microphysics git describe: 23.05-12-g1f8fd85f reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.003081163 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.114452715 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001903378 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002491753 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.005409319 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001223947 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001164504 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001179133 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001149338 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001155076 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001171529 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001163627 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001141116 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00114323 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001131604 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.262530989 seconds Ending run at 07:10:48 UTC on 2023-05-23. Run time = 6.657553264 Run time without initialization = 0.000397105 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.657 ... 6.658 ... 6.658 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2262 1.2262 1.2262 18.42% Gravity::fill_multipole_BCs() 14 1.137 1.163 1.18 17.73% Castro::post_init() 2 1.066 1.072 1.073 16.12% Castro::computeTemp() 36 0.6975 0.7479 0.823 12.36% FabArray::ParallelCopy_finish() 2952 0.1534 0.3466 0.4956 7.44% Castro::reset_internal_energy(Fab) 654 0.3943 0.4261 0.4889 7.34% MLPoisson::Fsmooth() 5088 0.2427 0.2542 0.2697 4.05% Castro::normalize_species() 33 0.1667 0.1753 0.1898 2.85% Castro::derive() 97 0.1394 0.1436 0.1522 2.29% Castro::initData() 3 0.1177 0.1303 0.1516 2.28% amrex::Copy() 975 0.1248 0.1304 0.1367 2.05% Castro::initMFs() 16 0.09802 0.1122 0.1265 1.90% FillBoundary_finish() 5552 0.06721 0.08953 0.1098 1.65% StateData::define() 64 0.05641 0.06312 0.07136 1.07% amrex::average_down 844 0.04399 0.04852 0.05197 0.78% FabArray::setVal() 1769 0.04109 0.04721 0.0511 0.77% FillBoundary_nowait() 5552 0.0398 0.04351 0.04552 0.68% MLCellLinOp::applyBC() 6294 0.03285 0.03545 0.03864 0.58% VisMF::Write(FabArray) 2 0.03116 0.03205 0.03498 0.53% FabArray::ParallelCopy_nowait() 2952 0.02415 0.02699 0.03152 0.47% FillPatchIterator::Initialize 215 0.01496 0.01971 0.03136 0.47% Amr::writePlotFile() 1 0.00541 0.01165 0.03002 0.45% MLPoisson::Fapply() 1040 0.02427 0.0257 0.02717 0.41% Castro::estTimeStep() 1 0.02245 0.0239 0.02544 0.38% Amr::regrid() 14 0.01458 0.01675 0.02035 0.31% MLMG::addInterpCorrection() 530 0.0173 0.01766 0.01817 0.27% MLCellLinOp::reflux() 138 0.01581 0.01664 0.01721 0.26% Castro::buildMetrics() 16 0.01219 0.01362 0.01545 0.23% FabArray::Xpay() 1013 0.01206 0.01349 0.01543 0.23% MLCellLinOp::updateSolBC() 120 0.01078 0.0119 0.01342 0.20% amrex::Add() 575 0.01039 0.01159 0.01239 0.19% MLCellLinOp::updateCorBC() 106 0.009567 0.01069 0.01236 0.19% MultiFab::Multiply() 287 0.01068 0.01166 0.0121 0.18% MLPoisson::FFlux() 3408 0.01097 0.01151 0.01202 0.18% Castro::Castro() 16 0.008565 0.009618 0.01093 0.16% FillPatchInterp(MF) 44 0.001712 0.006602 0.009898 0.15% MLMG::prepareForSolve() 14 0.004518 0.006 0.009848 0.15% DistributionMapping::LeastUsedCPUs() 9 0.001423 0.00622 0.009518 0.14% MLMG::interpCorrection_1 106 0.006339 0.00711 0.008266 0.12% AmrMesh::MakeNewGrids() 15 0.007507 0.007648 0.007743 0.12% MLLinOp::makeSubCommunicator() 14 0.002053 0.00498 0.007671 0.12% Gravity::multilevel_solve_for_new_phi() 14 0.002898 0.003638 0.006975 0.10% Castro::apply_tagging_restrictions() 15 0.005785 0.006147 0.006469 0.10% MLCellLinOp::compGrad() 28 0.003255 0.003659 0.005432 0.08% MLCellLinOp::defineAuxData() 14 0.003873 0.004155 0.005234 0.08% MLMG::ResNormInf() 152 0.003476 0.004305 0.005193 0.08% FabArray::norminf(mask) 46 0.004832 0.004942 0.005053 0.08% MultiFab::max() 54 0.002893 0.00338 0.003793 0.06% FabArrayBase::getCPC() 3662 0.003459 0.003596 0.003743 0.06% FabArray::norminf() 174 0.002994 0.003316 0.003705 0.06% Castro::enforce_min_density() 33 0.002761 0.002929 0.00317 0.05% BndryData::define() 42 0.002333 0.002521 0.002939 0.04% Gravity::get_new_grav_vector() 4 0.001819 0.0022 0.002457 0.04% Gravity::actual_solve_with_mlmg() 14 0.001961 0.002043 0.002254 0.03% FabArray::FillBoundary() 5552 0.002022 0.002089 0.002149 0.03% MLCellLinOp::defineBC() 14 0.001856 0.001989 0.002087 0.03% FabArrayBase::CPC::define() 624 0.001602 0.001753 0.001967 0.03% FabArray::mult() 34 0.001102 0.001419 0.00189 0.03% MLCellLinOp::smooth() 2544 0.001628 0.001729 0.001783 0.03% Castro::volWgtSum() 46 0.001659 0.001686 0.001714 0.03% FillPatchTwoLevels 126 0.0006854 0.001147 0.001618 0.02% Gravity::actual_multilevel_solve() 14 0.0008265 0.0009833 0.001512 0.02% MLCGSolver::bicgstab 13 0 0.0001815 0.001452 0.02% Castro::enforce_consistent_e() 3 0.001053 0.001204 0.00145 0.02% Castro::build_fine_mask() 55 0.0006621 0.0007961 0.001302 0.02% FabArray::ParallelCopy() 2952 0.001189 0.001236 0.001293 0.02% StateData::FillBoundary(geom) 8 0.00112 0.00121 0.001283 0.02% average_down_faces 84 0.001008 0.001149 0.001253 0.02% FabArrayBase::getFB() 5552 0.001037 0.001104 0.001222 0.02% AMRErrorTag::operator() 15 0.0009174 0.0009358 0.0009596 0.01% Castro::sum_integrated_quantities() 1 0.0005587 0.0006164 0.0007083 0.01% MLMG::solve() 14 0.0004759 0.0005912 0.0006974 0.01% TagBoxArray::collate() 15 0.0002309 0.0003357 0.0006379 0.01% MLCellLinOp::apply() 1040 0.0004398 0.0004809 0.000592 0.01% main() 1 0.000365 0.0004668 0.000566 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004669 0.0004798 0.0004966 0.01% Amr::grid_places() 15 0.0003505 0.0003885 0.0004938 0.01% MLMG::mgVcycle() 318 0.0004308 0.0004531 0.0004932 0.01% MLCellLinOp::correctionResidual() 755 0.0004025 0.0004205 0.0004587 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002832 0.0003427 0.0004463 0.01% MLCellLinOp::prepareForSolve() 14 0.0003536 0.0003779 0.0004376 0.01% MLLinOp::defineGrids() 14 0.0002805 0.0003339 0.0004347 0.01% FabArray::setDomainBndry() 259 0.0003839 0.0004105 0.0004323 0.01% MLCellLinOp::setLevelBC() 28 0.0003299 0.000345 0.0003667 0.01% MLMG::oneIter() 106 0.0002677 0.0002834 0.000314 0.00% MLMG::MLResNormInf() 32 0.0001675 0.000244 0.0003095 0.00% MLCGSolver::ParallelAllReduce 81 0 3.843e-05 0.0003074 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002679 0.0002803 0.0002995 0.00% MLMG::mgVcycle_bottom 318 0.0002196 0.0002335 0.0002844 0.00% MLMG::actualBottomSolve() 106 2.34e-05 5.323e-05 0.0002477 0.00% MLCellLinOp::solutionResidual() 258 0.0001813 0.0001934 0.0002113 0.00% Castro::locWgtSum() 6 0.0001837 0.0001894 0.0002091 0.00% Castro::post_regrid() 30 6.291e-05 9.124e-05 0.0001997 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001697 0.0001816 0.000194 0.00% Castro::init(old) 13 0.0001625 0.0001746 0.0001867 0.00% MLMG:computeResOfCorrection() 530 0.0001629 0.0001689 0.0001786 0.00% FillPatchSingleLevel 259 0.0001513 0.0001644 0.000175 0.00% StateDataPhysBCFunct::() 259 0.0001441 0.0001544 0.0001615 0.00% AmrLevel::AmrLevel(dm) 16 0.0001308 0.0001449 0.0001558 0.00% MLMG::mgVcycle_down::0 106 0.0001278 0.0001384 0.0001509 0.00% amrex::Dot() 54 0 1.682e-05 0.0001345 0.00% Gravity::update_max_rhs() 1 8.336e-05 0.0001083 0.0001318 0.00% FabArrayBase::FB::FB() 35 7.987e-05 9.08e-05 0.0001318 0.00% FPinfo::FPinfo() 9 8.356e-05 9.748e-05 0.000124 0.00% MLMG::mgVcycle_down::1 106 0.0001153 0.0001188 0.0001239 0.00% MLMG::miniCycle() 212 9.012e-05 0.000106 0.0001215 0.00% TagBoxArray::mapPRD 15 9.276e-05 0.0001056 0.0001196 0.00% OwnerMask() 15 9.038e-05 0.0001015 0.0001149 0.00% Castro::clean_state() 33 6.03e-05 7.076e-05 0.0001053 0.00% Castro::volProductSum() 2 8.243e-05 9.171e-05 0.000103 0.00% MLMG::mgVcycle_down::2 106 8.495e-05 9.305e-05 0.0001004 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.628e-05 8.919e-05 9.922e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.375e-05 7.479e-05 9.268e-05 0.00% FabArray::Saxpy() 27 0 1.128e-05 9.024e-05 0.00% Amr::FinalizeInit() 1 6.829e-06 2.277e-05 8.92e-05 0.00% MLMG::mgVcycle_down::3 106 7.498e-05 8.014e-05 8.884e-05 0.00% MLMG::mgVcycle_down::4 106 6.994e-05 7.433e-05 8.711e-05 0.00% FabArray::LinComb() 27 0 1.051e-05 8.41e-05 0.00% FabArrayBase::TheFPinfo() 49 6.226e-05 6.668e-05 7.738e-05 0.00% MLMG::mgVcycle_up::1 106 6.079e-05 6.601e-05 7.557e-05 0.00% MLMG::mgVcycle_up::0 106 6.939e-05 7.114e-05 7.396e-05 0.00% Castro::avgDown(state_indx) 60 5.685e-05 6.518e-05 7.367e-05 0.00% Castro::errorEst() 15 4.488e-05 5.724e-05 7.219e-05 0.00% MLMG::mgVcycle_up::4 106 6.486e-05 6.823e-05 6.986e-05 0.00% Amr::defBaseLevel() 1 5.107e-05 5.982e-05 6.815e-05 0.00% amrex::average_down_w_geom 60 4.401e-05 5.204e-05 6.806e-05 0.00% MLMG::mgVcycle_up::3 106 5.424e-05 5.84e-05 6.253e-05 0.00% MLMG::mgVcycle_up::2 106 5.378e-05 5.666e-05 5.966e-05 0.00% MLMG::computeResidual() 106 5.018e-05 5.441e-05 5.925e-05 0.00% ClusterList::intersect() 1 0 7.302e-06 5.842e-05 0.00% Castro::avgDown() 15 3.261e-05 4.077e-05 5.774e-05 0.00% MLPoisson::define() 14 3.221e-05 3.885e-05 5.759e-05 0.00% MLMG::computeMLResidual() 32 3.805e-05 4.373e-05 5.035e-05 0.00% makeSFC 42 2.871e-05 3.352e-05 3.953e-05 0.00% AmrMesh-cluster 1 0 3.906e-06 3.125e-05 0.00% Amr::writeSmallPlotFile() 1 2.846e-05 2.884e-05 2.936e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.775e-05 2.156e-05 2.663e-05 0.00% DistributionMapping::Distribute() 46 2.23e-05 2.367e-05 2.571e-05 0.00% MLLinOp::define() 14 1.484e-05 1.72e-05 2.514e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.128e-05 2.326e-05 2.443e-05 0.00% MLPoisson::prepareForSolve() 14 1.149e-05 1.368e-05 2.009e-05 0.00% FabArray::RecvLayoutMask() 14 1.654e-05 1.752e-05 1.992e-05 0.00% Amr::bldFineLevels() 1 1.498e-05 1.694e-05 1.976e-05 0.00% MLMG::getGradSolution() 14 1.588e-05 1.683e-05 1.758e-05 0.00% ClusterList::chop() 1 0 2.055e-06 1.644e-05 0.00% Castro::enforce_speed_limit() 33 1.173e-05 1.324e-05 1.57e-05 0.00% knapsack() 2 1.093e-05 1.171e-05 1.274e-05 0.00% BoxList::complementIn 30 9.595e-06 1.093e-05 1.258e-05 0.00% BoxList::parallelComplementIn() 30 1.059e-05 1.113e-05 1.197e-05 0.00% Amr::initSubcycle() 1 9.631e-06 1.045e-05 1.076e-05 0.00% MLMG::MLRhsNormInf() 14 8.391e-06 8.816e-06 9.237e-06 0.00% Castro::apply_problem_tags() 15 5.535e-06 6.582e-06 7.484e-06 0.00% Amr::init() 1 1.563e-06 2.565e-06 7.355e-06 0.00% Gravity::set_mass_offset() 1 8.65e-07 2.072e-06 6.54e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.403e-06 5.046e-06 6.279e-06 0.00% Amr::InitializeInit() 1 2.203e-06 2.684e-06 4.856e-06 0.00% Castro::computeInitialDt() 1 1.685e-06 2.141e-06 2.9e-06 0.00% Amr::initialInit() 1 1.315e-06 1.522e-06 1.751e-06 0.00% Castro::gwstrain() 2 8.85e-07 1.152e-06 1.569e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.657 6.657 6.658 100.00% Amr::init() 1 5.431 5.431 5.431 81.57% Amr::initialInit() 1 5.168 5.168 5.168 77.63% Amr::FinalizeInit() 1 5.057 5.059 5.06 76.01% Castro::post_init() 2 3.779 3.919 3.996 60.03% Gravity::multilevel_solve_for_new_phi() 14 1.847 1.871 1.889 28.37% Gravity::actual_multilevel_solve() 14 1.84 1.867 1.886 28.33% Gravity::solve_phi_with_mlmg() 14 1.833 1.86 1.879 28.23% Castro::computeTemp() 36 1.092 1.174 1.312 19.71% Amr::regrid() 14 1.241 1.263 1.287 19.34% Castro::clean_state() 33 1.059 1.125 1.235 18.55% Amr::InitAmr() 1 1.226 1.226 1.226 18.42% Gravity::fill_multipole_BCs() 14 1.139 1.165 1.182 17.75% Amr::bldFineLevels() 1 0.9012 0.9608 1.055 15.85% Castro::post_regrid() 30 0.8166 0.8533 0.9152 13.75% Castro::initData() 3 0.5754 0.6433 0.7528 11.31% Gravity::actual_solve_with_mlmg() 14 0.6919 0.6948 0.6973 10.47% MLMG::solve() 14 0.6687 0.6702 0.6708 10.08% MLMG::oneIter() 106 0.5854 0.5879 0.5893 8.85% FabArray::ParallelCopy() 2952 0.2049 0.4 0.5464 8.21% FabArray::ParallelCopy_finish() 2952 0.1534 0.3466 0.4956 7.44% Castro::reset_internal_energy(MultiFab) 36 0.3946 0.4265 0.4893 7.35% Castro::reset_internal_energy(Fab) 654 0.3943 0.4261 0.4889 7.34% MLMG::mgVcycle() 318 0.4373 0.4401 0.443 6.65% MLCellLinOp::smooth() 2544 0.3686 0.3731 0.3794 5.70% amrex::average_down 844 0.08056 0.2235 0.3008 4.52% MLPoisson::Fsmooth() 5088 0.2427 0.2542 0.2697 4.05% Castro::avgDown() 15 0.04928 0.1894 0.2664 4.00% Castro::avgDown(state_indx) 60 0.04924 0.1893 0.2664 4.00% amrex::average_down_w_geom 60 0.04918 0.1893 0.2663 4.00% Amr::writePlotFile() 1 0.2627 0.2628 0.2628 3.95% Castro::derive() 97 0.2033 0.2206 0.2245 3.37% Castro::normalize_species() 33 0.1667 0.1753 0.1898 2.85% MLCellLinOp::applyBC() 6294 0.1527 0.1718 0.187 2.81% Castro::Castro() 16 0.1363 0.1566 0.1745 2.62% FabArray::FillBoundary() 5552 0.116 0.1363 0.1541 2.32% FillPatchIterator::Initialize 215 0.1011 0.1373 0.1503 2.26% amrex::Copy() 975 0.1248 0.1304 0.1367 2.05% Amr::grid_places() 15 0.02503 0.0929 0.1351 2.03% AmrMesh::MakeNewGrids() 15 0.02462 0.09251 0.1348 2.02% MLMG::mgVcycle_bottom 318 0.1272 0.1302 0.1347 2.02% MLMG::miniCycle() 212 0.1274 0.1299 0.1331 2.00% Castro::initMFs() 16 0.09802 0.1122 0.1265 1.90% MLMG::mgVcycle_down::0 106 0.1191 0.1198 0.1213 1.82% TagBoxArray::mapPRD 15 0.006278 0.07426 0.1171 1.76% Amr::InitializeInit() 1 0.1075 0.1091 0.1105 1.66% Amr::defBaseLevel() 1 0.1075 0.1091 0.1105 1.66% FillBoundary_finish() 5552 0.06721 0.08953 0.1098 1.65% MLMG::mgVcycle_up::0 106 0.1084 0.1088 0.1093 1.64% FillPatchSingleLevel 259 0.05046 0.08892 0.1067 1.60% MLMG::computeResWithCrseSolFineCor() 106 0.0805 0.08221 0.08392 1.26% FillPatchTwoLevels 126 0.05096 0.06957 0.07757 1.17% Castro::init(old) 13 0.05599 0.06934 0.07616 1.14% AmrLevel::AmrLevel(dm) 16 0.05656 0.06327 0.07151 1.07% StateData::define() 64 0.05641 0.06312 0.07136 1.07% MLCellLinOp::apply() 1040 0.06493 0.06865 0.0705 1.06% MLCellLinOp::solutionResidual() 258 0.06058 0.06653 0.07022 1.05% MLCellLinOp::correctionResidual() 755 0.06169 0.06336 0.06605 0.99% FabArray::ParallelCopy_nowait() 2952 0.04909 0.0521 0.05762 0.87% MLCellLinOp::reflux() 138 0.04903 0.05063 0.05206 0.78% FabArray::setVal() 1769 0.04109 0.04721 0.0511 0.77% FillBoundary_nowait() 5552 0.04093 0.04471 0.04679 0.70% MLMG::computeResWithCrseCorFineCor() 106 0.03347 0.03474 0.03587 0.54% VisMF::Write(FabArray) 2 0.03116 0.03205 0.03498 0.53% MLMG::computeResidual() 106 0.02965 0.03119 0.03321 0.50% MLMG::addInterpCorrection() 530 0.01967 0.02987 0.0314 0.47% MLCellLinOp::updateSolBC() 120 0.02132 0.02667 0.03028 0.45% MLMG::computeMLResidual() 32 0.02134 0.0256 0.02778 0.42% MLPoisson::Fapply() 1040 0.02427 0.0257 0.02717 0.41% Castro::computeInitialDt() 1 0.02245 0.0239 0.02545 0.38% Castro::estTimeStep() 1 0.02245 0.0239 0.02544 0.38% MLMG::mgVcycle_down::1 106 0.02419 0.02459 0.02521 0.38% MLMG::mgVcycle_up::2 106 0.00915 0.01997 0.02174 0.33% Gravity::get_new_grav_vector() 4 0.02026 0.02095 0.02153 0.32% MLMG::mgVcycle_up::1 106 0.02103 0.02111 0.02128 0.32% MLCellLinOp::updateCorBC() 106 0.01951 0.02053 0.02112 0.32% MLMG:computeResOfCorrection() 530 0.01829 0.01887 0.01944 0.29% MLPoisson::define() 14 0.01266 0.01588 0.018 0.27% Castro::buildMetrics() 16 0.01375 0.01537 0.01738 0.26% FabArray::Xpay() 1013 0.01206 0.01349 0.01543 0.23% MLMG::prepareForSolve() 14 0.01003 0.01206 0.01489 0.22% MLMG::interpCorrection_1 106 0.009577 0.01136 0.01272 0.19% amrex::Add() 575 0.01039 0.01159 0.01239 0.19% MultiFab::Multiply() 287 0.01068 0.01166 0.0121 0.18% MLPoisson::FFlux() 3408 0.01097 0.01151 0.01202 0.18% MLMG::ResNormInf() 152 0.009937 0.01071 0.01139 0.17% Castro::errorEst() 15 0.009547 0.01003 0.01069 0.16% MLMG::mgVcycle_down::2 106 0.009289 0.009506 0.01029 0.15% FillPatchInterp(MF) 44 0.001712 0.006602 0.009898 0.15% FabArrayBase::TheFPinfo() 49 0.001565 0.006356 0.009684 0.15% FPinfo::FPinfo() 9 0.001488 0.006289 0.009615 0.14% DistributionMapping::LeastUsedCPUs() 9 0.001423 0.00622 0.009518 0.14% MLLinOp::define() 14 0.002419 0.005406 0.008117 0.12% MLLinOp::defineGrids() 14 0.002403 0.005389 0.008099 0.12% MLLinOp::makeSubCommunicator() 14 0.002053 0.00498 0.007671 0.12% MLMG::getGradSolution() 14 0.006231 0.006381 0.006708 0.10% MLCellLinOp::compGrad() 28 0.006214 0.006364 0.006692 0.10% Castro::apply_tagging_restrictions() 15 0.005785 0.006147 0.006469 0.10% MLCellLinOp::defineAuxData() 14 0.004917 0.005232 0.006334 0.10% MLCellLinOp::defineBC() 14 0.004916 0.005206 0.00573 0.09% FabArrayBase::getCPC() 3662 0.005151 0.005349 0.005545 0.08% FabArray::norminf(mask) 46 0.004832 0.004942 0.005053 0.08% Castro::sum_integrated_quantities() 1 0.00477 0.004814 0.004854 0.07% MLMG::mgVcycle_down::3 106 0.001285 0.001778 0.00459 0.07% MLMG::MLResNormInf() 32 0.003968 0.004027 0.004113 0.06% MLMG::actualBottomSolve() 106 2.34e-05 0.0005005 0.003826 0.06% MultiFab::max() 54 0.002893 0.00338 0.003793 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003363 0.003552 0.003769 0.06% MLMG::mgVcycle_up::3 106 0.0009294 0.0013 0.003718 0.06% FabArray::norminf() 174 0.002994 0.003316 0.003705 0.06% BndryData::define() 42 0.002891 0.003088 0.003527 0.05% MLCGSolver::bicgstab 13 0 0.0004403 0.003523 0.05% Castro::enforce_min_density() 33 0.002761 0.002929 0.00317 0.05% average_down_faces 84 0.002072 0.002257 0.002525 0.04% MLMG::mgVcycle_down::4 106 0.001154 0.001344 0.002367 0.04% FabArrayBase::CPC::define() 624 0.001602 0.001753 0.001967 0.03% MLMG::mgVcycle_up::4 106 0.001096 0.001235 0.001946 0.03% MLMG::MLRhsNormInf() 14 0.001793 0.001846 0.001897 0.03% FabArray::mult() 34 0.001102 0.001419 0.00189 0.03% Castro::volWgtSum() 46 0.001664 0.001691 0.00172 0.03% Castro::enforce_consistent_e() 3 0.001053 0.001204 0.00145 0.02% StateDataPhysBCFunct::() 259 0.001277 0.001364 0.001442 0.02% FabArrayBase::getFB() 5552 0.001119 0.001195 0.001353 0.02% Castro::build_fine_mask() 55 0.0006621 0.0007961 0.001302 0.02% StateData::FillBoundary(geom) 8 0.00112 0.00121 0.001283 0.02% Gravity::update_max_rhs() 1 0.0007033 0.001015 0.001214 0.02% DistributionMapping::KnapSackDoIt() 2 6.089e-05 0.0004002 0.001106 0.02% AMRErrorTag::operator() 15 0.0009174 0.0009358 0.0009596 0.01% TagBoxArray::collate() 15 0.0002309 0.0003357 0.0006379 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004669 0.0004798 0.0004966 0.01% MLPoisson::prepareForSolve() 14 0.000365 0.0003916 0.0004501 0.01% MLCellLinOp::prepareForSolve() 14 0.0003536 0.0003779 0.0004376 0.01% FabArray::setDomainBndry() 259 0.0003839 0.0004105 0.0004323 0.01% MLCGSolver::ParallelAllReduce 81 0 4.867e-05 0.0003894 0.01% MLCellLinOp::setLevelBC() 28 0.0003299 0.000345 0.0003667 0.01% Castro::locWgtSum() 6 0.0001841 0.0001899 0.0002096 0.00% amrex::Dot() 54 0 1.682e-05 0.0001345 0.00% FabArrayBase::FB::FB() 35 7.987e-05 9.08e-05 0.0001318 0.00% OwnerMask() 15 9.038e-05 0.0001015 0.0001149 0.00% AmrMesh-cluster 1 0 1.326e-05 0.0001061 0.00% Castro::volProductSum() 2 8.267e-05 9.192e-05 0.0001033 0.00% FabArray::Saxpy() 27 0 1.128e-05 9.024e-05 0.00% FabArray::LinComb() 27 0 1.051e-05 8.41e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.745e-05 7.493e-05 8.284e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.74e-05 7.18e-05 8.146e-05 0.00% makeSFC 42 4.617e-05 5.167e-05 5.875e-05 0.00% ClusterList::intersect() 1 0 7.302e-06 5.842e-05 0.00% Amr::writeSmallPlotFile() 1 2.846e-05 2.884e-05 2.936e-05 0.00% DistributionMapping::Distribute() 46 2.23e-05 2.367e-05 2.571e-05 0.00% BoxList::parallelComplementIn() 30 2.053e-05 2.206e-05 2.357e-05 0.00% FabArray::RecvLayoutMask() 14 1.654e-05 1.752e-05 1.992e-05 0.00% ClusterList::chop() 1 0 2.055e-06 1.644e-05 0.00% Castro::enforce_speed_limit() 33 1.173e-05 1.324e-05 1.57e-05 0.00% knapsack() 2 1.093e-05 1.171e-05 1.274e-05 0.00% BoxList::complementIn 30 9.595e-06 1.093e-05 1.258e-05 0.00% Amr::initSubcycle() 1 9.631e-06 1.045e-05 1.076e-05 0.00% Castro::apply_problem_tags() 15 5.535e-06 6.582e-06 7.484e-06 0.00% Gravity::set_mass_offset() 1 8.65e-07 2.072e-06 6.54e-06 0.00% Castro::gwstrain() 2 8.85e-07 1.152e-06 1.569e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 18 B 24 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.05-26-g4167cbe534a0) finalized