MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.08-40-gd4d0e9031d03) initialized Starting run at 06:24:46 UTC on 2023-08-23. Successfully read inputs file ... Castro git describe: 23.08-6-g41b0e2684 AMReX git describe: 23.08-40-gd4d0e9031 Microphysics git describe: 23.08-15-gced7cc41 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002882858 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.124206257 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.002001981 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.003531765 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00427701 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001804529 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001879695 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001870986 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00182234 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001837505 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001896603 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001762222 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001942202 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001784013 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001890376 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.298443317 seconds Ending run at 06:24:53 UTC on 2023-08-23. Run time = 6.80743762 Run time without initialization = 0.000398231 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.807 ... 6.807 ... 6.807 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2518 1.2518 1.2519 18.39% Gravity::fill_multipole_BCs() 14 1.118 1.147 1.178 17.30% Castro::post_init() 2 1.036 1.044 1.05 15.42% Castro::computeTemp() 36 0.701 0.7418 0.8022 11.78% FabArray::ParallelCopy_finish() 2952 0.1367 0.2662 0.4713 6.92% Castro::reset_internal_energy(Fab) 654 0.3972 0.426 0.459 6.74% MLPoisson::Fsmooth() 5088 0.2446 0.2491 0.2564 3.77% amrex::Copy() 975 0.2188 0.2343 0.2497 3.67% Castro::normalize_species() 33 0.1649 0.1766 0.184 2.70% AmrLevel::derive() 97 0.1467 0.1527 0.1583 2.33% Castro::initMFs() 16 0.09987 0.1316 0.1506 2.21% Castro::initData() 3 0.1158 0.1293 0.1501 2.20% FabArray::setVal() 1769 0.05617 0.09173 0.1071 1.57% StateData::define() 64 0.05725 0.06991 0.0764 1.12% FillBoundary_finish() 5552 0.0569 0.06837 0.07541 1.11% amrex::average_down 844 0.05278 0.05637 0.0586 0.86% FillBoundary_nowait() 5552 0.04097 0.04408 0.04724 0.69% FabArray::ParallelCopy_nowait() 2952 0.02913 0.03788 0.0454 0.67% MLCellLinOp::applyBC() 6294 0.03843 0.03997 0.04257 0.63% FillPatchIterator::Initialize 215 0.02872 0.03361 0.04051 0.60% VisMF::Write(FabArray) 2 0.02792 0.03124 0.03609 0.53% MLPoisson::Fapply() 1040 0.02934 0.03167 0.03451 0.51% Castro::estTimeStep() 1 0.02208 0.02904 0.03434 0.50% MultiFab::Multiply() 287 0.02053 0.02536 0.0281 0.41% Amr::regrid() 14 0.01648 0.01823 0.02041 0.30% FabArray::Xpay() 1013 0.01758 0.01907 0.02031 0.30% Amr::writePlotFile() 1 0.0102 0.01494 0.01854 0.27% Castro::buildMetrics() 16 0.01322 0.01642 0.01849 0.27% MLMG::addInterpCorrection() 530 0.01719 0.01771 0.01826 0.27% MLCellLinOp::reflux() 138 0.01645 0.01727 0.01823 0.27% Castro::Castro() 16 0.009801 0.01421 0.01671 0.25% amrex::Add() 575 0.01388 0.0144 0.01491 0.22% MLPoisson::FFlux() 3408 0.01155 0.01209 0.01272 0.19% MLMG::prepareForSolve() 14 0.007742 0.01016 0.01248 0.18% MLCellLinOp::updateSolBC() 120 0.01093 0.01163 0.0122 0.18% MLCellLinOp::updateCorBC() 106 0.009866 0.01046 0.01098 0.16% FillPatchInterp(MF) 44 0.002016 0.007297 0.01083 0.16% MLMG::interpCorrection_1 106 0.006851 0.007512 0.008291 0.12% MLCellLinOp::compGrad() 28 0.00593 0.006685 0.007386 0.11% Gravity::multilevel_solve_for_new_phi() 14 0.003116 0.005081 0.00711 0.10% AmrMesh::MakeNewGrids() 15 0.006869 0.007013 0.00707 0.10% Castro::apply_tagging_restrictions() 15 0.006633 0.006733 0.006903 0.10% DistributionMapping::LeastUsedCPUs() 9 0.0005635 0.003053 0.006811 0.10% MLCellLinOp::defineAuxData() 14 0.004214 0.004931 0.005539 0.08% MultiFab::max() 54 0.003154 0.004474 0.005305 0.08% FabArray::norminf(mask) 46 0.004827 0.005015 0.005229 0.08% MLLinOp::makeSubCommunicator() 14 0.0003185 0.002486 0.005026 0.07% Gravity::get_new_grav_vector() 4 0.003754 0.004365 0.004797 0.07% MLMG::ResNormInf() 152 0.002785 0.003304 0.004277 0.06% FabArrayBase::getCPC() 3662 0.003646 0.003946 0.004263 0.06% FabArray::norminf() 174 0.003205 0.003377 0.003621 0.05% Castro::enforce_min_density() 33 0.002655 0.003045 0.003198 0.05% BndryData::define() 42 0.002417 0.002726 0.003073 0.05% FabArray::mult() 34 0.001719 0.002111 0.002624 0.04% Castro::volWgtSum() 46 0.002143 0.002382 0.002579 0.04% Gravity::actual_solve_with_mlmg() 14 0.002113 0.002371 0.002573 0.04% MLCellLinOp::defineBC() 14 0.002098 0.002319 0.00247 0.04% FillPatchTwoLevels 126 0.001008 0.001597 0.002183 0.03% FabArray::FillBoundary() 5552 0.002034 0.002103 0.002169 0.03% FabArrayBase::CPC::define() 624 0.001697 0.001865 0.002024 0.03% MLCellLinOp::smooth() 2544 0.001706 0.001755 0.0018 0.03% Castro::sum_integrated_quantities() 1 0.0004342 0.00102 0.001696 0.02% average_down_faces 84 0.001418 0.001507 0.001585 0.02% Castro::enforce_consistent_e() 3 0.0009876 0.001435 0.001549 0.02% Gravity::actual_multilevel_solve() 14 0.001015 0.001254 0.001501 0.02% MLCGSolver::bicgstab 13 0 0.0001863 0.00149 0.02% FabArray::ParallelCopy() 2952 0.001295 0.001329 0.001362 0.02% StateData::FillBoundary(geom) 8 0.001162 0.001241 0.001342 0.02% Castro::build_fine_mask() 55 0.0007449 0.001035 0.001336 0.02% FabArrayBase::getFB() 5552 0.0009763 0.001035 0.001127 0.02% AMRErrorTag::operator() 15 0.0009422 0.0009528 0.0009688 0.01% MLMG::solve() 14 0.0003159 0.0005633 0.0007957 0.01% MLCellLinOp::setLevelBC() 28 0.0003775 0.0005915 0.000769 0.01% AmrLevel::FillPatch() 215 0.000649 0.0006837 0.00072 0.01% MLCellLinOp::prepareForSolve() 14 0.0004254 0.0005712 0.0006899 0.01% MLCellLinOp::apply() 1040 0.0004492 0.0004779 0.0006241 0.01% FabArray::setDomainBndry() 259 0.0005195 0.0005528 0.0005821 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005138 0.0005454 0.0005796 0.01% main() 1 0.0004043 0.0004975 0.0005534 0.01% MLCellLinOp::correctionResidual() 755 0.0004119 0.0004347 0.0004991 0.01% MLMG::mgVcycle() 318 0.0004188 0.0004579 0.0004953 0.01% Amr::grid_places() 15 0.0003672 0.0003906 0.0004761 0.01% MLMG::MLResNormInf() 32 0.0001381 0.0002971 0.0004449 0.01% MLLinOp::defineGrids() 14 0.0002747 0.0003343 0.0004049 0.01% TagBoxArray::collate() 15 0.000256 0.0003102 0.0003994 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0003045 0.0003309 0.0003629 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002986 0.0003297 0.0003527 0.01% MLMG::oneIter() 106 0.000277 0.0002907 0.0003077 0.00% MLMG::mgVcycle_bottom 318 0.0002379 0.0002517 0.0002743 0.00% MLMG::actualBottomSolve() 106 2.238e-05 5.212e-05 0.0002466 0.00% Castro::locWgtSum() 6 0.0002024 0.0002172 0.0002347 0.00% MLCGSolver::ParallelAllReduce 81 0 2.825e-05 0.000226 0.00% StateDataPhysBCFunct::() 259 0.0001818 0.0001993 0.000222 0.00% MLCellLinOp::solutionResidual() 258 0.0002026 0.000212 0.0002202 0.00% AmrLevel::AmrLevel(dm) 16 0.0001345 0.0001702 0.0001991 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001642 0.0001743 0.0001945 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001555 0.0001725 0.0001913 0.00% FillPatchSingleLevel 259 0.0001652 0.0001749 0.0001873 0.00% MLMG:computeResOfCorrection() 530 0.0001587 0.0001634 0.000178 0.00% FillPatchIterator::FillFromLevel0() 89 0.00016 0.0001668 0.0001778 0.00% Gravity::update_max_rhs() 1 0.0001157 0.0001454 0.0001685 0.00% MLMG::mgVcycle_down::0 106 0.0001463 0.000154 0.000166 0.00% MLMG::miniCycle() 212 8.816e-05 0.0001207 0.0001443 0.00% Castro::volProductSum() 2 8.414e-05 0.0001124 0.0001407 0.00% FabArrayBase::FB::FB() 35 7.483e-05 9.267e-05 0.0001404 0.00% Castro::post_regrid() 30 6.39e-05 9.814e-05 0.0001331 0.00% MLMG::mgVcycle_down::1 106 0.0001136 0.0001194 0.0001305 0.00% Castro::avgDown(state_indx) 60 7.718e-05 0.0001014 0.0001177 0.00% OwnerMask() 15 8.832e-05 0.0001045 0.0001175 0.00% amrex::Dot() 54 0 1.437e-05 0.0001149 0.00% TagBoxArray::mapPRD 15 9.381e-05 0.0001015 0.0001109 0.00% FPinfo::FPinfo() 9 7.673e-05 9.205e-05 0.0001057 0.00% MLMG::mgVcycle_down::2 106 8.696e-05 9.357e-05 0.000105 0.00% Castro::derive() 97 7.896e-05 9.117e-05 0.0001048 0.00% Castro::clean_state() 33 6.489e-05 8.619e-05 0.0001034 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.409e-05 9.101e-05 0.0001027 0.00% FabArrayBase::TheFPinfo() 49 7.99e-05 9.214e-05 0.0001018 0.00% Amr::writeSmallPlotFile() 1 3.093e-05 4.387e-05 0.000101 0.00% Gravity::solve_phi_with_mlmg() 14 6.539e-05 8.214e-05 9.699e-05 0.00% MLMG::mgVcycle_down::3 106 7.691e-05 8.786e-05 9.617e-05 0.00% Castro::init(old) 13 7.362e-05 8.492e-05 9.267e-05 0.00% MLMG::mgVcycle_up::1 106 5.994e-05 7.061e-05 8.313e-05 0.00% MLMG::mgVcycle_down::4 106 7.31e-05 7.543e-05 7.965e-05 0.00% FabArray::Saxpy() 27 0 9.843e-06 7.874e-05 0.00% FabArray::LinComb() 27 0 9.777e-06 7.822e-05 0.00% amrex::average_down_w_geom 60 4.491e-05 6.112e-05 7.641e-05 0.00% MLMG::mgVcycle_up::0 106 7.036e-05 7.215e-05 7.59e-05 0.00% MLMG::mgVcycle_up::3 106 5.684e-05 6.298e-05 7.551e-05 0.00% MLMG::mgVcycle_up::4 106 6.895e-05 7.186e-05 7.466e-05 0.00% Amr::FinalizeInit() 1 6.697e-06 1.914e-05 7.273e-05 0.00% Castro::avgDown() 15 5.272e-05 5.897e-05 6.885e-05 0.00% MLMG::computeResidual() 106 6.086e-05 6.44e-05 6.802e-05 0.00% MLMG::mgVcycle_up::2 106 5.777e-05 6.04e-05 6.33e-05 0.00% Castro::errorEst() 15 5.346e-05 5.823e-05 6.243e-05 0.00% ClusterList::intersect() 1 0 7.101e-06 5.681e-05 0.00% MLPoisson::define() 14 3.97e-05 4.532e-05 5.329e-05 0.00% MLMG::computeMLResidual() 32 4.522e-05 4.727e-05 5.316e-05 0.00% Amr::defBaseLevel() 1 3.043e-05 3.83e-05 4.981e-05 0.00% makeSFC 42 2.745e-05 3.582e-05 4.808e-05 0.00% MLMG::getGradSolution() 14 1.954e-05 2.344e-05 3.714e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.302e-05 2.696e-05 3.366e-05 0.00% DistributionMapping::Distribute() 46 2.301e-05 2.685e-05 2.996e-05 0.00% AmrMesh-cluster 1 0 3.704e-06 2.963e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.708e-05 2.103e-05 2.563e-05 0.00% MLLinOp::define() 14 1.645e-05 2.035e-05 2.526e-05 0.00% Amr::bldFineLevels() 1 1.616e-05 1.932e-05 2.25e-05 0.00% Castro::enforce_speed_limit() 33 1.234e-05 1.538e-05 2.045e-05 0.00% MLPoisson::prepareForSolve() 14 1.372e-05 1.592e-05 1.939e-05 0.00% FabArray::RecvLayoutMask() 14 1.695e-05 1.77e-05 1.883e-05 0.00% BoxList::parallelComplementIn() 30 1.078e-05 1.395e-05 1.876e-05 0.00% BoxList::complementIn 30 1.247e-05 1.383e-05 1.778e-05 0.00% ClusterList::chop() 1 0 2.155e-06 1.724e-05 0.00% knapsack() 2 1.059e-05 1.363e-05 1.662e-05 0.00% MLMG::MLRhsNormInf() 14 9.237e-06 1.012e-05 1.155e-05 0.00% Amr::initSubcycle() 1 8.273e-06 9.315e-06 1.074e-05 0.00% Castro::apply_problem_tags() 15 8.202e-06 9.004e-06 9.979e-06 0.00% Amr::initialInit() 1 1.211e-06 4.982e-06 9.559e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.181e-06 5.088e-06 6.763e-06 0.00% Amr::init() 1 1.472e-06 2.999e-06 4.752e-06 0.00% Amr::InitializeInit() 1 2.231e-06 2.985e-06 4.285e-06 0.00% Gravity::set_mass_offset() 1 9.52e-07 2.407e-06 3.751e-06 0.00% Castro::computeInitialDt() 1 1.65e-06 2.339e-06 3.572e-06 0.00% Castro::gwstrain() 2 1.138e-06 1.649e-06 2.275e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.807 6.807 6.807 100.00% Amr::init() 1 5.555 5.555 5.555 81.60% Amr::initialInit() 1 5.256 5.256 5.256 77.22% Amr::FinalizeInit() 1 5.138 5.145 5.15 75.65% Castro::post_init() 2 3.899 3.979 4.084 59.99% Gravity::multilevel_solve_for_new_phi() 14 1.83 1.856 1.884 27.68% Gravity::actual_multilevel_solve() 14 1.823 1.851 1.881 27.63% Gravity::solve_phi_with_mlmg() 14 1.816 1.844 1.874 27.52% Amr::regrid() 14 1.294 1.32 1.348 19.81% Castro::computeTemp() 36 1.098 1.168 1.261 18.53% Amr::InitAmr() 1 1.252 1.252 1.252 18.39% Castro::clean_state() 33 1.064 1.122 1.188 17.45% Gravity::fill_multipole_BCs() 14 1.12 1.149 1.179 17.33% Amr::bldFineLevels() 1 0.8945 0.9847 1.044 15.34% Castro::post_regrid() 30 0.824 0.8551 0.8802 12.93% Castro::initData() 3 0.5748 0.6452 0.7441 10.93% Gravity::actual_solve_with_mlmg() 14 0.692 0.6939 0.6962 10.23% MLMG::solve() 14 0.6662 0.6674 0.6689 9.83% MLMG::oneIter() 106 0.5793 0.5798 0.5805 8.53% FabArray::ParallelCopy() 2952 0.2169 0.3457 0.548 8.05% FabArray::ParallelCopy_finish() 2952 0.1367 0.2662 0.4713 6.92% Castro::reset_internal_energy(MultiFab) 36 0.3975 0.4263 0.4593 6.75% Castro::reset_internal_energy(Fab) 654 0.3972 0.426 0.459 6.74% MLMG::mgVcycle() 318 0.424 0.4252 0.4262 6.26% MLCellLinOp::smooth() 2544 0.3531 0.3567 0.3641 5.35% Amr::writePlotFile() 1 0.2986 0.2987 0.2987 4.39% amrex::average_down 844 0.09363 0.1767 0.2957 4.34% Castro::avgDown() 15 0.0613 0.1444 0.259 3.81% Castro::avgDown(state_indx) 60 0.06124 0.1444 0.259 3.80% amrex::average_down_w_geom 60 0.06115 0.1443 0.2588 3.80% MLPoisson::Fsmooth() 5088 0.2446 0.2491 0.2564 3.77% Castro::derive() 97 0.2504 0.2522 0.2542 3.73% AmrLevel::derive() 97 0.2503 0.2521 0.2541 3.73% amrex::Copy() 975 0.2188 0.2343 0.2497 3.67% Castro::Castro() 16 0.1493 0.2137 0.2497 3.67% AmrLevel::FillPatch() 215 0.1849 0.2083 0.2223 3.27% Castro::normalize_species() 33 0.1649 0.1766 0.184 2.70% FillPatchIterator::Initialize 215 0.1408 0.166 0.1838 2.70% MLCellLinOp::applyBC() 6294 0.1458 0.1556 0.1613 2.37% Castro::initMFs() 16 0.09987 0.1316 0.1506 2.21% Amr::grid_places() 15 0.03116 0.08171 0.1444 2.12% AmrMesh::MakeNewGrids() 15 0.03077 0.08132 0.1441 2.12% FillPatchSingleLevel 259 0.07744 0.1068 0.1296 1.90% TagBoxArray::mapPRD 15 0.01202 0.06229 0.1258 1.85% FabArray::FillBoundary() 5552 0.1065 0.1157 0.1228 1.80% MLMG::mgVcycle_down::0 106 0.1195 0.1205 0.1217 1.79% MLMG::mgVcycle_bottom 318 0.115 0.1165 0.1205 1.77% Amr::InitializeInit() 1 0.1062 0.1115 0.1185 1.74% Amr::defBaseLevel() 1 0.1062 0.1115 0.1185 1.74% MLMG::miniCycle() 212 0.1152 0.1162 0.1177 1.73% MLMG::mgVcycle_up::0 106 0.1069 0.1072 0.1076 1.58% FabArray::setVal() 1769 0.05617 0.09173 0.1071 1.57% FillPatchIterator::FillFromTwoLevels() 126 0.06123 0.08459 0.09878 1.45% FillPatchTwoLevels 126 0.06107 0.08442 0.09858 1.45% Castro::init(old) 13 0.06985 0.08573 0.0954 1.40% FabArray::ParallelCopy_nowait() 2952 0.06935 0.07822 0.0863 1.27% MLMG::computeResWithCrseSolFineCor() 106 0.08302 0.08489 0.08623 1.27% AmrLevel::AmrLevel(dm) 16 0.05745 0.07008 0.07656 1.12% StateData::define() 64 0.05725 0.06991 0.0764 1.12% FillBoundary_finish() 5552 0.0569 0.06837 0.07541 1.11% MLCellLinOp::apply() 1040 0.06488 0.06927 0.07213 1.06% MLCellLinOp::correctionResidual() 755 0.06437 0.0681 0.07082 1.04% MLCellLinOp::solutionResidual() 258 0.06188 0.06381 0.06623 0.97% FillPatchIterator::FillFromLevel0() 89 0.03825 0.04734 0.05582 0.82% MLCellLinOp::reflux() 138 0.05239 0.05446 0.05575 0.82% FillBoundary_nowait() 5552 0.04207 0.04521 0.04837 0.71% MLMG::computeResWithCrseCorFineCor() 106 0.03532 0.03717 0.0379 0.56% VisMF::Write(FabArray) 2 0.02792 0.03124 0.03609 0.53% Gravity::get_new_grav_vector() 4 0.03317 0.03418 0.03477 0.51% MLPoisson::Fapply() 1040 0.02934 0.03167 0.03451 0.51% Castro::computeInitialDt() 1 0.02208 0.02904 0.03434 0.50% Castro::estTimeStep() 1 0.02208 0.02904 0.03434 0.50% MLMG::addInterpCorrection() 530 0.01924 0.02951 0.03138 0.46% MLMG::computeMLResidual() 32 0.02479 0.02772 0.03107 0.46% MLMG::computeResidual() 106 0.0291 0.0302 0.03091 0.45% MultiFab::Multiply() 287 0.02053 0.02536 0.0281 0.41% MLCellLinOp::updateSolBC() 120 0.02093 0.02361 0.02757 0.40% MLMG::mgVcycle_down::1 106 0.0241 0.02474 0.0256 0.38% MLMG::mgVcycle_up::2 106 0.008876 0.01952 0.02129 0.31% MLMG::mgVcycle_up::1 106 0.02071 0.02084 0.02097 0.31% Castro::buildMetrics() 16 0.01477 0.01855 0.02083 0.31% MLCellLinOp::updateCorBC() 106 0.01857 0.01936 0.02032 0.30% FabArray::Xpay() 1013 0.01758 0.01907 0.02031 0.30% MLMG:computeResOfCorrection() 530 0.01849 0.01887 0.01927 0.28% MLMG::prepareForSolve() 14 0.01491 0.01714 0.01893 0.28% MLPoisson::define() 14 0.01322 0.01489 0.01635 0.24% amrex::Add() 575 0.01388 0.0144 0.01491 0.22% MLMG::interpCorrection_1 106 0.01076 0.01211 0.01348 0.20% MLPoisson::FFlux() 3408 0.01155 0.01209 0.01272 0.19% Castro::errorEst() 15 0.0107 0.01136 0.01168 0.17% FillPatchInterp(MF) 44 0.002016 0.007297 0.01083 0.16% MLMG::mgVcycle_down::2 106 0.009411 0.009665 0.01064 0.16% MLMG::ResNormInf() 152 0.00929 0.009771 0.01054 0.15% MLMG::getGradSolution() 14 0.008394 0.008631 0.008819 0.13% MLCellLinOp::compGrad() 28 0.008371 0.008607 0.008796 0.13% Castro::sum_integrated_quantities() 1 0.007069 0.007248 0.007528 0.11% FabArrayBase::TheFPinfo() 49 0.0007202 0.003207 0.006981 0.10% Castro::apply_tagging_restrictions() 15 0.006633 0.006733 0.006903 0.10% FPinfo::FPinfo() 9 0.0006223 0.003114 0.006894 0.10% DistributionMapping::LeastUsedCPUs() 9 0.0005635 0.003053 0.006811 0.10% MLCellLinOp::defineAuxData() 14 0.00529 0.006091 0.00674 0.10% MLCellLinOp::defineBC() 14 0.005376 0.005825 0.006266 0.09% FabArrayBase::getCPC() 3662 0.005343 0.005811 0.006264 0.09% MLLinOp::define() 14 0.0007562 0.002924 0.005476 0.08% MLLinOp::defineGrids() 14 0.0007323 0.002903 0.005459 0.08% MultiFab::max() 54 0.003154 0.004474 0.005305 0.08% FabArray::norminf(mask) 46 0.004827 0.005015 0.005229 0.08% MLLinOp::makeSubCommunicator() 14 0.0003185 0.002486 0.005026 0.07% MLMG::mgVcycle_down::3 106 0.001349 0.001823 0.004621 0.07% MLMG::MLResNormInf() 32 0.004067 0.004117 0.004172 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003726 0.003889 0.004144 0.06% BndryData::define() 42 0.002996 0.003337 0.003719 0.05% MLMG::mgVcycle_up::3 106 0.0009797 0.001337 0.003687 0.05% MLMG::actualBottomSolve() 106 2.238e-05 0.0004792 0.003663 0.05% FabArray::norminf() 174 0.003205 0.003377 0.003621 0.05% MLCGSolver::bicgstab 13 0 0.0004209 0.003367 0.05% Castro::enforce_min_density() 33 0.002655 0.003045 0.003198 0.05% average_down_faces 84 0.002215 0.002437 0.002734 0.04% FabArray::mult() 34 0.001719 0.002111 0.002624 0.04% Castro::volWgtSum() 46 0.00215 0.00239 0.002588 0.04% Gravity::update_max_rhs() 1 0.0006694 0.001663 0.002441 0.04% MLMG::mgVcycle_down::4 106 0.001173 0.001377 0.002324 0.03% FabArrayBase::CPC::define() 624 0.001697 0.001865 0.002024 0.03% MLMG::MLRhsNormInf() 14 0.001827 0.001923 0.002014 0.03% MLMG::mgVcycle_up::4 106 0.001145 0.001268 0.001906 0.03% StateDataPhysBCFunct::() 259 0.001344 0.00144 0.001554 0.02% Castro::enforce_consistent_e() 3 0.0009876 0.001435 0.001549 0.02% StateData::FillBoundary(geom) 8 0.001162 0.001241 0.001342 0.02% Castro::build_fine_mask() 55 0.0007449 0.001035 0.001336 0.02% FabArrayBase::getFB() 5552 0.001051 0.001128 0.001267 0.02% AMRErrorTag::operator() 15 0.0009422 0.0009528 0.0009688 0.01% DistributionMapping::KnapSackDoIt() 2 5.49e-05 0.0003379 0.0008248 0.01% MLCellLinOp::setLevelBC() 28 0.0003775 0.0005915 0.000769 0.01% MLPoisson::prepareForSolve() 14 0.0004413 0.0005871 0.0007074 0.01% MLCellLinOp::prepareForSolve() 14 0.0004254 0.0005712 0.0006899 0.01% FabArray::setDomainBndry() 259 0.0005195 0.0005528 0.0005821 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005138 0.0005454 0.0005796 0.01% TagBoxArray::collate() 15 0.000256 0.0003102 0.0003994 0.01% MLCGSolver::ParallelAllReduce 81 0 3.654e-05 0.0002923 0.00% Castro::locWgtSum() 6 0.000203 0.0002178 0.0002353 0.00% Castro::volProductSum() 2 8.436e-05 0.0001127 0.000141 0.00% FabArrayBase::FB::FB() 35 7.483e-05 9.267e-05 0.0001404 0.00% OwnerMask() 15 8.832e-05 0.0001045 0.0001175 0.00% amrex::Dot() 54 0 1.437e-05 0.0001149 0.00% AmrMesh-cluster 1 0 1.296e-05 0.0001037 0.00% Amr::writeSmallPlotFile() 1 3.093e-05 4.387e-05 0.000101 0.00% MLLinOp::makeAgglomeratedDMap 14 6.697e-05 8.348e-05 9.735e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 6.287e-05 7.671e-05 9.251e-05 0.00% FabArray::Saxpy() 27 0 9.843e-06 7.874e-05 0.00% FabArray::LinComb() 27 0 9.777e-06 7.822e-05 0.00% makeSFC 42 4.396e-05 5.651e-05 7.025e-05 0.00% ClusterList::intersect() 1 0 7.101e-06 5.681e-05 0.00% BoxList::parallelComplementIn() 30 2.326e-05 2.778e-05 3.654e-05 0.00% DistributionMapping::Distribute() 46 2.301e-05 2.685e-05 2.996e-05 0.00% Castro::enforce_speed_limit() 33 1.234e-05 1.538e-05 2.045e-05 0.00% FabArray::RecvLayoutMask() 14 1.695e-05 1.77e-05 1.883e-05 0.00% BoxList::complementIn 30 1.247e-05 1.383e-05 1.778e-05 0.00% ClusterList::chop() 1 0 2.155e-06 1.724e-05 0.00% knapsack() 2 1.059e-05 1.363e-05 1.662e-05 0.00% Amr::initSubcycle() 1 8.273e-06 9.315e-06 1.074e-05 0.00% Castro::apply_problem_tags() 15 8.202e-06 9.004e-06 9.979e-06 0.00% Gravity::set_mass_offset() 1 9.52e-07 2.407e-06 3.751e-06 0.00% Castro::gwstrain() 2 1.138e-06 1.649e-06 2.275e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 16 B 19 B 21 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.08-40-gd4d0e9031d03) finalized