MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.07-7-g88f03408f18a) initialized Starting run at 06:30:20 UTC on 2023-07-05. Successfully read inputs file ... Castro git describe: 23.07-3-g8dc29e1af AMReX git describe: 23.07-7-g88f03408f Microphysics git describe: 23.07-11-g6678fe90 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002936202 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.115309287 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001848875 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00238212 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001076064 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001068128 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00104488 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001042598 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001077241 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001044086 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001040612 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001051833 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001084732 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001083647 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001071802 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.238092585 seconds Ending run at 06:30:26 UTC on 2023-07-05. Run time = 6.310195464 Run time without initialization = 0.0002655440001 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.31 ... 6.31 ... 6.31 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2067 1.2067 1.2067 19.12% Gravity::fill_multipole_BCs() 14 1.111 1.133 1.148 18.20% Castro::post_init() 2 0.9623 0.9635 0.9651 15.29% Castro::computeTemp() 36 0.68 0.7321 0.7996 12.67% Castro::reset_internal_energy(Fab) 654 0.3875 0.4158 0.4576 7.25% FabArray::ParallelCopy_finish() 2952 0.05638 0.2594 0.3942 6.25% MLPoisson::Fsmooth() 5088 0.2314 0.238 0.2492 3.95% Castro::normalize_species() 33 0.1623 0.1707 0.1811 2.87% Castro::initData() 3 0.1139 0.1285 0.1497 2.37% Castro::derive() 97 0.139 0.1407 0.1421 2.25% amrex::Copy() 975 0.13 0.134 0.1363 2.16% Castro::initMFs() 16 0.09826 0.1084 0.1242 1.97% FillBoundary_finish() 5552 0.0491 0.06102 0.07459 1.18% StateData::define() 64 0.05649 0.06223 0.07122 1.13% FabArray::setVal() 1769 0.04043 0.05011 0.05477 0.87% amrex::average_down 844 0.04186 0.04497 0.04856 0.77% FillBoundary_nowait() 5552 0.03865 0.04155 0.04357 0.69% MLCellLinOp::applyBC() 6294 0.0329 0.03467 0.03765 0.60% VisMF::Write(FabArray) 2 0.03197 0.03278 0.03545 0.56% FabArray::ParallelCopy_nowait() 2952 0.02375 0.02584 0.03051 0.48% MLPoisson::Fapply() 1040 0.02355 0.02486 0.02623 0.42% Castro::estTimeStep() 1 0.02149 0.02283 0.02428 0.38% MLMG::addInterpCorrection() 530 0.01922 0.01941 0.01981 0.31% MLCellLinOp::reflux() 138 0.0183 0.01872 0.01913 0.30% Amr::regrid() 14 0.01413 0.01663 0.01859 0.29% FillPatchIterator::Initialize 215 0.01596 0.01744 0.01821 0.29% Castro::buildMetrics() 16 0.01241 0.01358 0.01553 0.25% FabArray::Xpay() 1013 0.01182 0.01289 0.01433 0.23% MultiFab::Multiply() 287 0.0124 0.01275 0.01299 0.21% amrex::Add() 575 0.01057 0.01142 0.01269 0.20% MLCellLinOp::updateSolBC() 120 0.01054 0.01153 0.01205 0.19% Castro::Castro() 16 0.008717 0.009842 0.01146 0.18% MLPoisson::FFlux() 3408 0.01103 0.01125 0.01138 0.18% MLCellLinOp::updateCorBC() 106 0.009363 0.0103 0.0108 0.17% FillPatchInterp(MF) 44 0.001693 0.006487 0.009758 0.15% Amr::writePlotFile() 1 0.005496 0.008207 0.009237 0.15% MLMG::interpCorrection_1 106 0.006109 0.006916 0.007818 0.12% AmrMesh::MakeNewGrids() 15 0.006425 0.006502 0.006628 0.11% Castro::apply_tagging_restrictions() 15 0.00567 0.005877 0.006144 0.10% MLMG::prepareForSolve() 14 0.00487 0.005079 0.005349 0.08% MLLinOp::makeSubCommunicator() 14 0.0004296 0.003141 0.005085 0.08% FabArray::norminf(mask) 46 0.004665 0.004737 0.004799 0.08% MLMG::ResNormInf() 152 0.002552 0.003734 0.004491 0.07% MLCellLinOp::defineAuxData() 14 0.003906 0.003967 0.004085 0.06% FabArray::norminf() 174 0.003001 0.003284 0.003635 0.06% FabArrayBase::getCPC() 3662 0.00344 0.003495 0.003555 0.06% MultiFab::max() 54 0.002767 0.003148 0.00341 0.05% MLCellLinOp::compGrad() 28 0.00315 0.003274 0.003372 0.05% Castro::enforce_min_density() 33 0.00271 0.00287 0.003257 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002631 0.002824 0.00312 0.05% DistributionMapping::LeastUsedCPUs() 9 0.0001165 0.001553 0.002616 0.04% Gravity::get_new_grav_vector() 4 0.00182 0.002123 0.00258 0.04% BndryData::define() 42 0.002286 0.002384 0.002495 0.04% Gravity::actual_solve_with_mlmg() 14 0.001897 0.001981 0.002211 0.04% FabArray::FillBoundary() 5552 0.001923 0.002002 0.002111 0.03% MLCellLinOp::defineBC() 14 0.00181 0.001944 0.00201 0.03% FabArrayBase::CPC::define() 624 0.001575 0.0017 0.001963 0.03% Castro::volWgtSum() 46 0.001668 0.001719 0.001782 0.03% MLCellLinOp::smooth() 2544 0.001599 0.001659 0.00172 0.03% FabArray::mult() 34 0.001144 0.001333 0.001558 0.02% Castro::enforce_consistent_e() 3 0.001003 0.001217 0.001529 0.02% MLCGSolver::bicgstab 13 0 0.0001832 0.001465 0.02% FillPatchTwoLevels 126 0.0006805 0.001126 0.001408 0.02% FabArray::ParallelCopy() 2952 0.001206 0.001241 0.001285 0.02% StateData::FillBoundary(geom) 8 0.001178 0.001227 0.001281 0.02% average_down_faces 84 0.001051 0.00114 0.001226 0.02% FabArrayBase::getFB() 5552 0.0009786 0.001025 0.001107 0.02% AMRErrorTag::operator() 15 0.0009219 0.0009502 0.0009988 0.02% Gravity::actual_multilevel_solve() 14 0.000732 0.0008044 0.0009028 0.01% Castro::sum_integrated_quantities() 1 0.0005812 0.000743 0.0008548 0.01% Castro::build_fine_mask() 55 0.0006363 0.0006871 0.0007542 0.01% MLCellLinOp::apply() 1040 0.00045 0.0004793 0.0005976 0.01% TagBoxArray::collate() 15 0.0002462 0.0003226 0.0005652 0.01% MLMG::solve() 14 0.0003797 0.0004517 0.0005141 0.01% MLMG::mgVcycle() 318 0.0004 0.0004498 0.0005055 0.01% Amr::grid_places() 15 0.0003524 0.0003904 0.0004999 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004639 0.0004775 0.0004858 0.01% MLCellLinOp::correctionResidual() 755 0.0003977 0.0004236 0.0004752 0.01% MLCellLinOp::prepareForSolve() 14 0.0003627 0.0003866 0.0004607 0.01% FabArray::setDomainBndry() 259 0.0003755 0.0004072 0.0004441 0.01% main() 1 0.0003499 0.0003891 0.0004373 0.01% MLLinOp::defineGrids() 14 0.0002827 0.0003252 0.000361 0.01% MLCellLinOp::setLevelBC() 28 0.0003255 0.0003363 0.0003523 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002865 0.0003127 0.0003467 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002678 0.000279 0.0002973 0.00% MLCGSolver::ParallelAllReduce 81 0 3.716e-05 0.0002973 0.00% MLMG::oneIter() 106 0.0002524 0.0002759 0.0002962 0.00% MLMG::mgVcycle_bottom 318 0.000232 0.0002498 0.0002875 0.00% MLMG::actualBottomSolve() 106 2.301e-05 5.709e-05 0.0002805 0.00% MLMG::MLResNormInf() 32 0.0001213 0.0001841 0.0002352 0.00% Castro::locWgtSum() 6 0.0001901 0.0001991 0.0002263 0.00% AmrLevel::AmrLevel(dm) 16 0.0001546 0.0001749 0.000225 0.00% MLCellLinOp::solutionResidual() 258 0.0001833 0.0001901 0.000206 0.00% FillPatchSingleLevel 259 0.0001577 0.0001631 0.0001763 0.00% Castro::init(old) 13 0.0001613 0.0001701 0.000174 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001522 0.0001639 0.00017 0.00% StateDataPhysBCFunct::() 259 0.0001473 0.0001563 0.0001674 0.00% MLMG::miniCycle() 212 0.0001146 0.0001301 0.0001577 0.00% MLMG:computeResOfCorrection() 530 0.0001481 0.0001547 0.0001571 0.00% MLMG::mgVcycle_down::0 106 0.0001247 0.0001328 0.000144 0.00% Gravity::update_max_rhs() 1 8.124e-05 0.0001085 0.0001404 0.00% FabArrayBase::FB::FB() 35 7.735e-05 8.653e-05 0.0001272 0.00% amrex::Dot() 54 0 1.503e-05 0.0001203 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.375e-05 9.708e-05 0.0001194 0.00% MLMG::mgVcycle_down::1 106 0.0001109 0.0001143 0.0001178 0.00% FPinfo::FPinfo() 9 7.327e-05 8.973e-05 0.0001162 0.00% Amr::FinalizeInit() 1 8.074e-06 2.898e-05 0.0001128 0.00% OwnerMask() 15 8.868e-05 9.644e-05 0.0001045 0.00% TagBoxArray::mapPRD 15 8.744e-05 9.3e-05 0.0001005 0.00% MLMG::mgVcycle_down::3 106 7.218e-05 7.999e-05 9.749e-05 0.00% Castro::volProductSum() 2 8.036e-05 8.516e-05 9.116e-05 0.00% MLMG::mgVcycle_down::2 106 8.108e-05 8.376e-05 8.757e-05 0.00% Castro::post_regrid() 30 5.982e-05 7.384e-05 8.753e-05 0.00% MLMG::mgVcycle_up::0 106 6.318e-05 6.848e-05 8.364e-05 0.00% MLMG::mgVcycle_down::4 106 6.771e-05 7.241e-05 8.079e-05 0.00% Castro::avgDown(state_indx) 60 6.586e-05 6.958e-05 8.063e-05 0.00% FabArray::LinComb() 27 0 1.003e-05 8.027e-05 0.00% MLMG::mgVcycle_up::2 106 5.096e-05 5.627e-05 7.909e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.558e-05 6.463e-05 7.672e-05 0.00% FabArrayBase::TheFPinfo() 49 6.057e-05 6.867e-05 7.565e-05 0.00% MLPoisson::define() 14 3.563e-05 5.147e-05 7.418e-05 0.00% FabArray::Saxpy() 27 0 9.214e-06 7.371e-05 0.00% Castro::errorEst() 15 4.177e-05 5.039e-05 7.342e-05 0.00% MLMG::mgVcycle_up::1 106 5.72e-05 6.229e-05 7.27e-05 0.00% MLMG::mgVcycle_up::4 106 6.377e-05 6.619e-05 7.201e-05 0.00% MLMG::computeResidual() 106 5.546e-05 6.068e-05 7.168e-05 0.00% Castro::clean_state() 33 5.871e-05 6.536e-05 7.116e-05 0.00% MLMG::mgVcycle_up::3 106 5.309e-05 5.728e-05 6.157e-05 0.00% ClusterList::intersect() 1 0 7.532e-06 6.025e-05 0.00% amrex::average_down_w_geom 60 3.704e-05 4.515e-05 5.844e-05 0.00% Castro::avgDown() 15 3.412e-05 4.043e-05 4.585e-05 0.00% Amr::defBaseLevel() 1 2.177e-05 3.191e-05 4.396e-05 0.00% MLMG::computeMLResidual() 32 3.721e-05 4.016e-05 4.347e-05 0.00% makeSFC 42 2.88e-05 3.391e-05 4.099e-05 0.00% Amr::bldFineLevels() 1 1.357e-05 2.447e-05 3.436e-05 0.00% Amr::writeSmallPlotFile() 1 3.079e-05 3.14e-05 3.39e-05 0.00% DistributionMapping::Distribute() 46 2.148e-05 2.386e-05 2.735e-05 0.00% AmrMesh-cluster 1 0 3.335e-06 2.668e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.175e-05 2.413e-05 2.632e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.509e-05 1.897e-05 2.231e-05 0.00% MLMG::getGradSolution() 14 1.604e-05 1.723e-05 1.891e-05 0.00% MLLinOp::define() 14 1.356e-05 1.605e-05 1.864e-05 0.00% FabArray::RecvLayoutMask() 14 1.623e-05 1.667e-05 1.744e-05 0.00% ClusterList::chop() 1 0 2.124e-06 1.699e-05 0.00% MLPoisson::prepareForSolve() 14 1.133e-05 1.317e-05 1.588e-05 0.00% Castro::enforce_speed_limit() 33 9.79e-06 1.189e-05 1.364e-05 0.00% BoxList::parallelComplementIn() 30 1.1e-05 1.196e-05 1.256e-05 0.00% BoxList::complementIn 30 9.917e-06 1.113e-05 1.203e-05 0.00% knapsack() 2 1.081e-05 1.138e-05 1.172e-05 0.00% Amr::initSubcycle() 1 8.885e-06 9.515e-06 1.002e-05 0.00% Castro::apply_problem_tags() 15 7.045e-06 8.088e-06 9.083e-06 0.00% MLMG::MLRhsNormInf() 14 7.862e-06 8.073e-06 8.314e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.219e-06 4.601e-06 5.421e-06 0.00% Amr::InitializeInit() 1 1.791e-06 2.393e-06 4.363e-06 0.00% Gravity::set_mass_offset() 1 8.41e-07 2.616e-06 3.581e-06 0.00% Castro::computeInitialDt() 1 1.632e-06 2.146e-06 2.752e-06 0.00% Amr::init() 1 1.544e-06 1.879e-06 2.158e-06 0.00% Amr::initialInit() 1 1.13e-06 1.346e-06 1.563e-06 0.00% Castro::gwstrain() 2 1.057e-06 1.239e-06 1.373e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.31 6.31 6.31 100.00% Amr::init() 1 5.103 5.103 5.103 80.87% Amr::initialInit() 1 4.865 4.865 4.865 77.09% Amr::FinalizeInit() 1 4.756 4.758 4.759 75.42% Castro::post_init() 2 3.528 3.64 3.711 58.82% Gravity::multilevel_solve_for_new_phi() 14 1.753 1.774 1.792 28.39% Gravity::actual_multilevel_solve() 14 1.75 1.771 1.789 28.34% Gravity::solve_phi_with_mlmg() 14 1.744 1.765 1.782 28.25% Castro::computeTemp() 36 1.068 1.148 1.258 19.93% Amr::regrid() 14 1.197 1.212 1.229 19.47% Amr::InitAmr() 1 1.207 1.207 1.207 19.12% Castro::clean_state() 33 1.038 1.099 1.181 18.72% Gravity::fill_multipole_BCs() 14 1.112 1.135 1.15 18.22% Amr::bldFineLevels() 1 0.888 0.9451 1.035 16.41% Castro::post_regrid() 30 0.8022 0.8341 0.8716 13.81% Castro::initData() 3 0.5607 0.6314 0.7375 11.69% Gravity::actual_solve_with_mlmg() 14 0.627 0.6298 0.6319 10.01% MLMG::solve() 14 0.6089 0.6094 0.6097 9.66% MLMG::oneIter() 106 0.5367 0.5377 0.5385 8.53% Castro::reset_internal_energy(MultiFab) 36 0.3878 0.4161 0.458 7.26% Castro::reset_internal_energy(Fab) 654 0.3875 0.4158 0.4576 7.25% FabArray::ParallelCopy() 2952 0.1157 0.3139 0.4464 7.07% MLMG::mgVcycle() 318 0.4032 0.4049 0.406 6.43% FabArray::ParallelCopy_finish() 2952 0.05638 0.2594 0.3942 6.25% MLCellLinOp::smooth() 2544 0.3341 0.3367 0.3427 5.43% amrex::average_down 844 0.07158 0.1855 0.2595 4.11% MLPoisson::Fsmooth() 5088 0.2314 0.238 0.2492 3.95% Amr::writePlotFile() 1 0.2382 0.2384 0.2384 3.78% Castro::avgDown() 15 0.04248 0.1555 0.2286 3.62% Castro::avgDown(state_indx) 60 0.04244 0.1554 0.2285 3.62% amrex::average_down_w_geom 60 0.04237 0.1554 0.2284 3.62% Castro::derive() 97 0.198 0.1983 0.1985 3.15% Castro::normalize_species() 33 0.1623 0.1707 0.1811 2.87% Castro::Castro() 16 0.1367 0.1548 0.1758 2.79% MLCellLinOp::applyBC() 6294 0.1337 0.1404 0.1501 2.38% amrex::Copy() 975 0.13 0.134 0.1363 2.16% Amr::grid_places() 15 0.01935 0.08828 0.1324 2.10% AmrMesh::MakeNewGrids() 15 0.01896 0.08789 0.1321 2.09% Castro::initMFs() 16 0.09826 0.1084 0.1242 1.97% FabArray::FillBoundary() 5552 0.09601 0.1057 0.1163 1.84% MLMG::mgVcycle_bottom 318 0.1096 0.1116 0.1162 1.84% TagBoxArray::mapPRD 15 0.001695 0.07116 0.1156 1.83% MLMG::mgVcycle_down::0 106 0.1118 0.1125 0.1134 1.80% MLMG::miniCycle() 212 0.1098 0.1113 0.1127 1.79% Amr::InitializeInit() 1 0.1055 0.1069 0.1083 1.72% Amr::defBaseLevel() 1 0.1055 0.1069 0.1083 1.72% MLMG::mgVcycle_up::0 106 0.1035 0.1039 0.1042 1.65% FillPatchIterator::Initialize 215 0.08691 0.09081 0.09378 1.49% MLMG::computeResWithCrseSolFineCor() 106 0.07183 0.07354 0.07478 1.18% FillBoundary_finish() 5552 0.0491 0.06102 0.07459 1.18% AmrLevel::AmrLevel(dm) 16 0.05666 0.0624 0.07138 1.13% StateData::define() 64 0.05649 0.06223 0.07122 1.13% MLCellLinOp::apply() 1040 0.05707 0.05893 0.06037 0.96% FillPatchSingleLevel 259 0.04986 0.05488 0.05918 0.94% MLCellLinOp::correctionResidual() 755 0.05536 0.05703 0.05852 0.93% FabArray::ParallelCopy_nowait() 2952 0.05063 0.05324 0.05807 0.92% MLCellLinOp::solutionResidual() 258 0.05319 0.05503 0.05624 0.89% FabArray::setVal() 1769 0.04043 0.05011 0.05477 0.87% MLCellLinOp::reflux() 138 0.04877 0.05043 0.0516 0.82% FillPatchTwoLevels 126 0.04303 0.04693 0.04901 0.78% Castro::init(old) 13 0.04271 0.04529 0.04727 0.75% FillBoundary_nowait() 5552 0.03976 0.04267 0.04481 0.71% VisMF::Write(FabArray) 2 0.03197 0.03278 0.03545 0.56% MLMG::addInterpCorrection() 530 0.02129 0.03117 0.03277 0.52% MLMG::computeResWithCrseCorFineCor() 106 0.03063 0.03171 0.0326 0.52% MLMG::computeResidual() 106 0.02678 0.02825 0.0294 0.47% MLPoisson::Fapply() 1040 0.02355 0.02486 0.02623 0.42% Castro::computeInitialDt() 1 0.02149 0.02284 0.02428 0.38% Castro::estTimeStep() 1 0.02149 0.02283 0.02428 0.38% MLMG::mgVcycle_down::1 106 0.02238 0.02296 0.02348 0.37% MLMG::computeMLResidual() 32 0.02039 0.02107 0.02154 0.34% MLCellLinOp::updateSolBC() 120 0.02021 0.02065 0.02139 0.34% MLMG::mgVcycle_up::2 106 0.008666 0.01906 0.02067 0.33% MLMG::mgVcycle_up::1 106 0.01976 0.01996 0.02008 0.32% MLCellLinOp::updateCorBC() 106 0.01799 0.01904 0.0197 0.31% Gravity::get_new_grav_vector() 4 0.01808 0.01878 0.01946 0.31% MLMG:computeResOfCorrection() 530 0.01741 0.01755 0.01773 0.28% Castro::buildMetrics() 16 0.01378 0.01527 0.01746 0.28% MLPoisson::define() 14 0.01098 0.01362 0.01547 0.25% FabArray::Xpay() 1013 0.01182 0.01289 0.01433 0.23% MultiFab::Multiply() 287 0.0124 0.01275 0.01299 0.21% amrex::Add() 575 0.01057 0.01142 0.01269 0.20% MLMG::interpCorrection_1 106 0.009365 0.01037 0.0115 0.18% MLPoisson::FFlux() 3408 0.01103 0.01125 0.01138 0.18% MLMG::ResNormInf() 152 0.009034 0.009991 0.01071 0.17% MLMG::prepareForSolve() 14 0.009758 0.009945 0.01032 0.16% Castro::errorEst() 15 0.009397 0.009633 0.01002 0.16% MLMG::mgVcycle_down::2 106 0.008787 0.008972 0.009777 0.15% FillPatchInterp(MF) 44 0.001693 0.006487 0.009758 0.15% Castro::apply_tagging_restrictions() 15 0.00567 0.005877 0.006144 0.10% FabArrayBase::getCPC() 3662 0.005027 0.005194 0.005518 0.09% MLLinOp::define() 14 0.0008079 0.003558 0.00551 0.09% MLLinOp::defineGrids() 14 0.0007917 0.003542 0.005492 0.09% MLCellLinOp::defineAuxData() 14 0.004905 0.004996 0.005239 0.08% Castro::sum_integrated_quantities() 1 0.005005 0.005052 0.005163 0.08% MLCellLinOp::defineBC() 14 0.004827 0.005011 0.005109 0.08% MLLinOp::makeSubCommunicator() 14 0.0004296 0.003141 0.005085 0.08% FabArray::norminf(mask) 46 0.004665 0.004737 0.004799 0.08% MLMG::getGradSolution() 14 0.004408 0.00453 0.004647 0.07% MLCellLinOp::compGrad() 28 0.00439 0.004512 0.004628 0.07% MLMG::mgVcycle_down::3 106 0.001256 0.001734 0.004406 0.07% MLMG::MLResNormInf() 32 0.003792 0.003816 0.00386 0.06% MLMG::actualBottomSolve() 106 2.301e-05 0.0004955 0.003788 0.06% FabArray::norminf() 174 0.003001 0.003284 0.003635 0.06% MLMG::mgVcycle_up::3 106 0.0009339 0.001275 0.003563 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003292 0.003429 0.003517 0.06% MLCGSolver::bicgstab 13 0 0.000432 0.003456 0.05% MultiFab::max() 54 0.002767 0.003148 0.00341 0.05% Castro::enforce_min_density() 33 0.00271 0.00287 0.003257 0.05% BndryData::define() 42 0.002811 0.002937 0.003062 0.05% FabArrayBase::TheFPinfo() 49 0.0002225 0.001675 0.00276 0.04% FPinfo::FPinfo() 9 0.000162 0.001607 0.002687 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0001165 0.001553 0.002616 0.04% MLMG::mgVcycle_down::4 106 0.001124 0.001301 0.002322 0.04% average_down_faces 84 0.00192 0.002054 0.00213 0.03% FabArrayBase::CPC::define() 624 0.001575 0.0017 0.001963 0.03% MLMG::mgVcycle_up::4 106 0.001088 0.001199 0.001875 0.03% MLMG::MLRhsNormInf() 14 0.001725 0.001759 0.001793 0.03% Castro::volWgtSum() 46 0.001673 0.001723 0.001788 0.03% FabArray::mult() 34 0.001144 0.001333 0.001558 0.02% Castro::enforce_consistent_e() 3 0.001003 0.001217 0.001529 0.02% StateDataPhysBCFunct::() 259 0.001327 0.001384 0.001441 0.02% StateData::FillBoundary(geom) 8 0.001178 0.001227 0.001281 0.02% FabArrayBase::getFB() 5552 0.001057 0.001112 0.001234 0.02% Gravity::update_max_rhs() 1 0.000641 0.0008904 0.001059 0.02% AMRErrorTag::operator() 15 0.0009219 0.0009502 0.0009988 0.02% Castro::build_fine_mask() 55 0.0006363 0.0006871 0.0007542 0.01% DistributionMapping::KnapSackDoIt() 2 5.256e-05 0.0002701 0.0006759 0.01% TagBoxArray::collate() 15 0.0002462 0.0003226 0.0005652 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004639 0.0004775 0.0004858 0.01% MLPoisson::prepareForSolve() 14 0.0003747 0.0003997 0.0004741 0.01% MLCellLinOp::prepareForSolve() 14 0.0003627 0.0003866 0.0004607 0.01% FabArray::setDomainBndry() 259 0.0003755 0.0004072 0.0004441 0.01% MLCGSolver::ParallelAllReduce 81 0 4.584e-05 0.0003667 0.01% MLCellLinOp::setLevelBC() 28 0.0003255 0.0003363 0.0003523 0.01% Castro::locWgtSum() 6 0.0001906 0.0001997 0.000227 0.00% FabArrayBase::FB::FB() 35 7.735e-05 8.653e-05 0.0001272 0.00% amrex::Dot() 54 0 1.503e-05 0.0001203 0.00% OwnerMask() 15 8.868e-05 9.644e-05 0.0001045 0.00% AmrMesh-cluster 1 0 1.299e-05 0.0001039 0.00% Castro::volProductSum() 2 8.057e-05 8.537e-05 9.136e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.691e-05 7.651e-05 8.766e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 6.328e-05 7.613e-05 8.652e-05 0.00% FabArray::LinComb() 27 0 1.003e-05 8.027e-05 0.00% FabArray::Saxpy() 27 0 9.214e-06 7.371e-05 0.00% makeSFC 42 4.516e-05 5.238e-05 6.196e-05 0.00% ClusterList::intersect() 1 0 7.532e-06 6.025e-05 0.00% Amr::writeSmallPlotFile() 1 3.079e-05 3.14e-05 3.39e-05 0.00% DistributionMapping::Distribute() 46 2.148e-05 2.386e-05 2.735e-05 0.00% BoxList::parallelComplementIn() 30 2.199e-05 2.31e-05 2.445e-05 0.00% FabArray::RecvLayoutMask() 14 1.623e-05 1.667e-05 1.744e-05 0.00% ClusterList::chop() 1 0 2.124e-06 1.699e-05 0.00% Castro::enforce_speed_limit() 33 9.79e-06 1.189e-05 1.364e-05 0.00% BoxList::complementIn 30 9.917e-06 1.113e-05 1.203e-05 0.00% knapsack() 2 1.081e-05 1.138e-05 1.172e-05 0.00% Amr::initSubcycle() 1 8.885e-06 9.515e-06 1.002e-05 0.00% Castro::apply_problem_tags() 15 7.045e-06 8.088e-06 9.083e-06 0.00% Gravity::set_mass_offset() 1 8.41e-07 2.616e-06 3.581e-06 0.00% Castro::gwstrain() 2 1.057e-06 1.239e-06 1.373e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 19 B 20 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.07-7-g88f03408f18a) finalized