MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.03-6-g5b7fa9867d02) initialized Starting run at 08:05:34 UTC on 2023-03-09. Successfully read inputs file ... Castro git describe: 23.03-2-g0304294be AMReX git describe: 23.03-6-g5b7fa9867 Microphysics git describe: 23.03-12-g1f07dde0 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002625331 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.124929203 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.012520896 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00815164 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002015966 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00117088 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00112944 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001116961 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001141547 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001133865 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001115996 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00114889 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00111827 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001130688 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001111197 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225826e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 2.373778793e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.284381237e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.577115472e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.240384832 seconds Ending run at 08:05:41 UTC on 2023-03-09. Run time = 6.606619369 Run time without initialization = 0.000354633 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.607 ... 6.607 ... 6.607 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.2073 1.2177 1.2296 18.61% Amr::InitAmr() 1 1.163 1.163 1.163 17.61% Castro::post_init() 2 1.045 1.055 1.061 16.05% Castro::computeTemp() 36 0.6898 0.7471 0.8281 12.53% FabArray::ParallelCopy_finish() 2952 0.135 0.3584 0.4911 7.43% Castro::reset_internal_energy(Fab) 654 0.3951 0.4291 0.4662 7.06% MLPoisson::Fsmooth() 5088 0.2261 0.2322 0.2447 3.70% Castro::normalize_species() 33 0.1667 0.1771 0.1918 2.90% Castro::initData() 3 0.1138 0.1297 0.1532 2.32% Castro::derive() 97 0.1377 0.1417 0.1455 2.20% amrex::Copy() 975 0.1217 0.1313 0.142 2.15% Castro::initMFs() 16 0.09501 0.1077 0.1247 1.89% FillBoundary_finish() 5552 0.0573 0.06871 0.07846 1.19% StateData::define() 64 0.05511 0.06129 0.07135 1.08% amrex::average_down 844 0.04311 0.04796 0.05895 0.89% FabArray::setVal() 1769 0.04163 0.04713 0.05235 0.79% FillBoundary_nowait() 5552 0.04003 0.04208 0.04681 0.71% MLCellLinOp::applyBC() 6294 0.03554 0.0371 0.04016 0.61% FabArray::ParallelCopy_nowait() 2952 0.0238 0.02867 0.03682 0.56% VisMF::Write(FabArray) 2 0.02946 0.03004 0.03266 0.49% Castro::estTimeStep() 1 0.02206 0.02441 0.02694 0.41% FillPatchIterator::Initialize 215 0.01579 0.01908 0.02691 0.41% MLPoisson::Fapply() 1040 0.02279 0.025 0.02677 0.41% DistributionMapping::LeastUsedCPUs() 9 0.002976 0.01693 0.02499 0.38% Amr::regrid() 14 0.0135 0.01737 0.02111 0.32% Amr::writePlotFile() 1 0.005603 0.009774 0.01962 0.30% amrex::Add() 575 0.01086 0.01259 0.01875 0.28% MLMG::addInterpCorrection() 530 0.01683 0.01713 0.01773 0.27% MLCellLinOp::reflux() 138 0.01586 0.01635 0.01699 0.26% FabArray::Xpay() 1013 0.01234 0.01407 0.01636 0.25% Castro::buildMetrics() 16 0.01193 0.01329 0.01509 0.23% MultiFab::Multiply() 287 0.0106 0.01198 0.0129 0.20% MLPoisson::FFlux() 3408 0.01094 0.01125 0.01198 0.18% MLCellLinOp::updateSolBC() 120 0.01093 0.01145 0.01184 0.18% MLCellLinOp::updateCorBC() 106 0.009833 0.01033 0.01066 0.16% Castro::Castro() 16 0.008618 0.009538 0.01055 0.16% FillPatchInterp(MF) 44 0.0017 0.006473 0.00972 0.15% MLMG::prepareForSolve() 14 0.004618 0.005782 0.00905 0.14% AmrMesh::MakeNewGrids() 15 0.007555 0.007638 0.007778 0.12% MLMG::interpCorrection_1 106 0.005964 0.006993 0.007744 0.12% MLCellLinOp::compGrad() 28 0.003134 0.004024 0.007649 0.12% MLLinOp::makeSubCommunicator() 14 0.001057 0.003953 0.006403 0.10% MLMG::ResNormInf() 152 0.003719 0.004992 0.006313 0.10% Castro::apply_tagging_restrictions() 15 0.005514 0.005855 0.006178 0.09% FabArray::norminf(mask) 46 0.00472 0.004841 0.005103 0.08% MultiFab::max() 54 0.002835 0.00398 0.00505 0.08% MLCellLinOp::defineAuxData() 14 0.003845 0.004021 0.004679 0.07% Gravity::multilevel_solve_for_new_phi() 14 0.002671 0.003371 0.004484 0.07% TagBoxArray::collate() 15 0.000279 0.003447 0.004026 0.06% FabArrayBase::getCPC() 3662 0.003463 0.003608 0.003754 0.06% FabArray::norminf() 174 0.003066 0.003284 0.003726 0.06% BndryData::define() 42 0.002237 0.00246 0.003027 0.05% Gravity::get_new_grav_vector() 4 0.001733 0.002236 0.002981 0.05% Castro::enforce_min_density() 33 0.002577 0.002759 0.002942 0.04% FabArray::mult() 34 0.001112 0.001439 0.002339 0.04% Gravity::actual_solve_with_mlmg() 14 0.001881 0.002044 0.002317 0.04% MLCellLinOp::defineBC() 14 0.001885 0.001981 0.002242 0.03% FabArray::FillBoundary() 5552 0.001971 0.002047 0.002228 0.03% FabArrayBase::CPC::define() 624 0.001621 0.001726 0.001994 0.03% MLCellLinOp::smooth() 2544 0.001629 0.001687 0.001755 0.03% Castro::volWgtSum() 46 0.001716 0.00173 0.001748 0.03% MLCGSolver::bicgstab 13 0 0.0001837 0.00147 0.02% Castro::enforce_consistent_e() 3 0.000981 0.001181 0.001431 0.02% FillPatchTwoLevels 126 0.0006774 0.00112 0.001374 0.02% Gravity::actual_multilevel_solve() 14 0.0007755 0.0009614 0.001347 0.02% FabArray::ParallelCopy() 2952 0.001221 0.001251 0.001315 0.02% average_down_faces 84 0.001015 0.001135 0.001293 0.02% StateData::FillBoundary(geom) 8 0.001118 0.001172 0.001235 0.02% FabArrayBase::getFB() 5552 0.0009827 0.001037 0.00113 0.02% AMRErrorTag::operator() 15 0.0009106 0.0009297 0.0009438 0.01% Castro::sum_integrated_quantities() 1 0.0006446 0.0007668 0.0008448 0.01% Castro::build_fine_mask() 55 0.0007014 0.0007663 0.0008147 0.01% MLMG::solve() 14 0.0004078 0.0005617 0.0007215 0.01% MLCellLinOp::apply() 1040 0.0004312 0.00047 0.0006045 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005047 0.0005275 0.0005626 0.01% main() 1 0.000383 0.0004878 0.0005517 0.01% MLMG::MLResNormInf() 32 0.0001768 0.0004079 0.0005385 0.01% Amr::grid_places() 15 0.0003614 0.0004035 0.0005374 0.01% MLCGSolver::ParallelAllReduce 81 0 6.534e-05 0.0005227 0.01% MLMG::mgVcycle() 318 0.0003915 0.0004187 0.000456 0.01% MLCellLinOp::prepareForSolve() 14 0.00036 0.0003851 0.0004453 0.01% MLCellLinOp::correctionResidual() 755 0.0003764 0.0003939 0.000443 0.01% FabArray::setDomainBndry() 259 0.0003654 0.000392 0.0004275 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003271 0.0003841 0.0004218 0.01% MLCellLinOp::setLevelBC() 28 0.0003412 0.0003485 0.0003627 0.01% MLLinOp::defineGrids() 14 0.0002721 0.0003159 0.0003412 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002662 0.0002848 0.0003189 0.00% MLMG::oneIter() 106 0.0002485 0.0002698 0.0002991 0.00% MLMG::actualBottomSolve() 106 2.202e-05 5.731e-05 0.0002948 0.00% MLMG::mgVcycle_bottom 318 0.0002196 0.0002291 0.0002392 0.00% OwnerMask() 15 8.856e-05 0.0001156 0.000223 0.00% Castro::locWgtSum() 6 0.000208 0.0002108 0.0002128 0.00% MLCellLinOp::solutionResidual() 258 0.000182 0.0001895 0.0001963 0.00% AmrLevel::AmrLevel(dm) 16 0.0001198 0.0001506 0.0001927 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.000162 0.0001757 0.0001907 0.00% Castro::init(old) 13 0.0001579 0.0001735 0.0001902 0.00% FillPatchSingleLevel 259 0.0001591 0.000169 0.0001775 0.00% MLMG:computeResOfCorrection() 530 0.0001472 0.0001586 0.000176 0.00% TagBoxArray::mapPRD 15 9.269e-05 0.0001058 0.0001685 0.00% StateDataPhysBCFunct::() 259 0.0001431 0.0001497 0.0001663 0.00% Gravity::update_max_rhs() 1 8.124e-05 0.0001043 0.000159 0.00% MLMG::mgVcycle_down::0 106 0.0001311 0.0001408 0.000159 0.00% FabArrayBase::FB::FB() 35 7.64e-05 8.812e-05 0.0001342 0.00% amrex::Dot() 54 0 1.617e-05 0.0001294 0.00% MLMG::mgVcycle_down::1 106 0.0001075 0.0001101 0.0001152 0.00% FPinfo::FPinfo() 9 7.561e-05 8.947e-05 0.0001121 0.00% MLMG::computeResWithCrseCorFineCor() 106 7.719e-05 8.482e-05 0.0001022 0.00% MLMG::miniCycle() 212 8.784e-05 9.479e-05 0.0001007 0.00% MLMG::mgVcycle_down::3 106 7.594e-05 8.359e-05 9.724e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.519e-05 7.642e-05 9.711e-05 0.00% MLMG::mgVcycle_down::2 106 8.092e-05 8.518e-05 9.289e-05 0.00% Castro::volProductSum() 2 8.58e-05 8.808e-05 9.145e-05 0.00% FabArray::Saxpy() 27 0 1.118e-05 8.942e-05 0.00% Castro::post_regrid() 30 6.341e-05 7.88e-05 8.924e-05 0.00% FabArray::LinComb() 27 0 1.085e-05 8.679e-05 0.00% Amr::FinalizeInit() 1 8.041e-06 2.379e-05 8.084e-05 0.00% Amr::defBaseLevel() 1 5.854e-05 6.876e-05 8.075e-05 0.00% MLMG::mgVcycle_down::4 106 6.836e-05 7.025e-05 7.632e-05 0.00% FabArrayBase::TheFPinfo() 49 6.205e-05 6.832e-05 7.544e-05 0.00% MLMG::mgVcycle_up::0 106 6.248e-05 6.859e-05 7.425e-05 0.00% Castro::clean_state() 33 6.45e-05 6.819e-05 7.334e-05 0.00% Castro::avgDown(state_indx) 60 5.741e-05 6.442e-05 7.283e-05 0.00% MLMG::mgVcycle_up::4 106 5.96e-05 6.447e-05 7.148e-05 0.00% MLMG::mgVcycle_up::1 106 5.652e-05 6.162e-05 7.098e-05 0.00% amrex::average_down_w_geom 60 4.618e-05 5.626e-05 6.95e-05 0.00% MLMG::mgVcycle_up::2 106 5.308e-05 5.744e-05 6.878e-05 0.00% ClusterList::intersect() 1 0 8.573e-06 6.859e-05 0.00% MLMG::mgVcycle_up::3 106 5.253e-05 5.517e-05 6.244e-05 0.00% MLMG::computeResidual() 106 5.335e-05 5.717e-05 6.027e-05 0.00% MLPoisson::define() 14 3.177e-05 3.991e-05 5.985e-05 0.00% Castro::errorEst() 15 4.813e-05 5.162e-05 5.888e-05 0.00% MLMG::computeMLResidual() 32 3.889e-05 4.263e-05 5.073e-05 0.00% Castro::avgDown() 15 3.257e-05 3.736e-05 4.189e-05 0.00% makeSFC 42 2.644e-05 3.129e-05 3.854e-05 0.00% Amr::writeSmallPlotFile() 1 2.91e-05 3.017e-05 3.293e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.346e-05 2.63e-05 3.227e-05 0.00% MLLinOp::define() 14 2.023e-05 2.308e-05 3.114e-05 0.00% AmrMesh-cluster 1 0 3.608e-06 2.887e-05 0.00% DistributionMapping::Distribute() 46 2.244e-05 2.484e-05 2.863e-05 0.00% BoxList::complementIn 30 9.605e-06 1.24e-05 2.667e-05 0.00% Amr::initialInit() 1 1.277e-06 4.228e-06 2.317e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.577e-05 1.885e-05 2.28e-05 0.00% MLMG::getGradSolution() 14 1.623e-05 1.843e-05 1.941e-05 0.00% Amr::bldFineLevels() 1 1.447e-05 1.644e-05 1.853e-05 0.00% FabArray::RecvLayoutMask() 14 1.617e-05 1.666e-05 1.82e-05 0.00% ClusterList::chop() 1 0 2.169e-06 1.735e-05 0.00% MLPoisson::prepareForSolve() 14 1.178e-05 1.299e-05 1.476e-05 0.00% Castro::enforce_speed_limit() 33 1.116e-05 1.279e-05 1.437e-05 0.00% BoxList::parallelComplementIn() 30 1.077e-05 1.206e-05 1.398e-05 0.00% knapsack() 2 1.102e-05 1.185e-05 1.345e-05 0.00% Amr::initSubcycle() 1 1.051e-05 1.078e-05 1.103e-05 0.00% MLMG::MLRhsNormInf() 14 8.293e-06 8.855e-06 9.427e-06 0.00% Castro::apply_problem_tags() 15 5.347e-06 6.02e-06 7.144e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.627e-06 4.962e-06 5.512e-06 0.00% Amr::InitializeInit() 1 2.24e-06 2.84e-06 4.707e-06 0.00% Castro::computeInitialDt() 1 1.492e-06 2.227e-06 3.257e-06 0.00% Amr::init() 1 1.768e-06 1.984e-06 2.272e-06 0.00% Gravity::set_mass_offset() 1 9.93e-07 1.272e-06 1.661e-06 0.00% Castro::gwstrain() 2 9.15e-07 1.308e-06 1.601e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.606 6.607 6.607 100.00% Amr::init() 1 5.443 5.443 5.443 82.39% Amr::initialInit() 1 5.202 5.202 5.202 78.75% Amr::FinalizeInit() 1 5.092 5.094 5.097 77.15% Castro::post_init() 2 3.822 3.947 4.034 61.06% Gravity::multilevel_solve_for_new_phi() 14 1.877 1.885 1.899 28.75% Gravity::actual_multilevel_solve() 14 1.874 1.882 1.896 28.70% Gravity::solve_phi_with_mlmg() 14 1.863 1.872 1.887 28.56% Amr::regrid() 14 1.257 1.277 1.305 19.75% Castro::computeTemp() 36 1.085 1.177 1.295 19.60% Gravity::fill_multipole_BCs() 14 1.209 1.219 1.231 18.63% Castro::clean_state() 33 1.056 1.126 1.219 18.45% Amr::InitAmr() 1 1.163 1.163 1.163 17.61% Amr::bldFineLevels() 1 0.8969 0.9618 1.056 15.98% Castro::post_regrid() 30 0.8151 0.8523 0.8959 13.56% Castro::initData() 3 0.5697 0.6479 0.763 11.55% Gravity::actual_solve_with_mlmg() 14 0.6491 0.6524 0.6565 9.94% MLMG::solve() 14 0.6271 0.6287 0.6292 9.52% MLMG::oneIter() 106 0.5488 0.5492 0.55 8.32% FabArray::ParallelCopy() 2952 0.1865 0.4133 0.5446 8.24% FabArray::ParallelCopy_finish() 2952 0.135 0.3584 0.4911 7.43% Castro::reset_internal_energy(MultiFab) 36 0.3955 0.4295 0.4666 7.06% Castro::reset_internal_energy(Fab) 654 0.3951 0.4291 0.4662 7.06% MLMG::mgVcycle() 318 0.3987 0.403 0.4075 6.17% MLCellLinOp::smooth() 2544 0.3319 0.3372 0.3473 5.26% amrex::average_down 844 0.1009 0.2257 0.3155 4.78% Castro::avgDown() 15 0.06948 0.1933 0.2836 4.29% Castro::avgDown(state_indx) 60 0.06944 0.1933 0.2835 4.29% amrex::average_down_w_geom 60 0.06938 0.1932 0.2835 4.29% MLPoisson::Fsmooth() 5088 0.2261 0.2322 0.2447 3.70% Amr::writePlotFile() 1 0.2405 0.2406 0.2406 3.64% Castro::derive() 97 0.1935 0.202 0.2033 3.08% Castro::normalize_species() 33 0.1667 0.1771 0.1918 2.90% Castro::Castro() 16 0.1339 0.1512 0.1728 2.62% MLCellLinOp::applyBC() 6294 0.1417 0.1511 0.1589 2.40% FillPatchIterator::Initialize 215 0.1248 0.143 0.1546 2.34% Amr::grid_places() 15 0.02714 0.1034 0.1494 2.26% AmrMesh::MakeNewGrids() 15 0.02674 0.103 0.149 2.26% amrex::Copy() 975 0.1217 0.1313 0.142 2.15% TagBoxArray::mapPRD 15 0.004224 0.08196 0.1314 1.99% Castro::initMFs() 16 0.09501 0.1077 0.1247 1.89% FabArray::FillBoundary() 5552 0.1032 0.114 0.1215 1.84% MLMG::mgVcycle_bottom 318 0.1068 0.1107 0.1165 1.76% MLMG::mgVcycle_down::0 106 0.1102 0.1116 0.1135 1.72% MLMG::miniCycle() 212 0.107 0.1103 0.1126 1.70% Amr::InitializeInit() 1 0.1055 0.1081 0.1104 1.67% Amr::defBaseLevel() 1 0.1055 0.1081 0.1104 1.67% MLMG::mgVcycle_up::0 106 0.1002 0.1004 0.1007 1.52% FillPatchTwoLevels 126 0.07412 0.08967 0.09926 1.50% FillPatchSingleLevel 259 0.0713 0.08517 0.09659 1.46% Castro::init(old) 13 0.07113 0.08092 0.08653 1.31% FillBoundary_finish() 5552 0.0573 0.06871 0.07846 1.19% MLMG::computeResWithCrseSolFineCor() 106 0.07243 0.07579 0.07773 1.18% AmrLevel::AmrLevel(dm) 16 0.05525 0.06144 0.07148 1.08% StateData::define() 64 0.05511 0.06129 0.07135 1.08% MLCellLinOp::correctionResidual() 755 0.06056 0.06339 0.06811 1.03% MLCellLinOp::apply() 1040 0.05777 0.06123 0.06383 0.97% MLCellLinOp::solutionResidual() 258 0.05605 0.06022 0.06303 0.95% FabArray::ParallelCopy_nowait() 2952 0.0491 0.05368 0.05902 0.89% FabArray::setVal() 1769 0.04163 0.04713 0.05235 0.79% MLCellLinOp::reflux() 138 0.04761 0.04993 0.05205 0.79% FillBoundary_nowait() 5552 0.04109 0.04321 0.04807 0.73% MLMG::computeResWithCrseCorFineCor() 106 0.03412 0.03633 0.04121 0.62% Gravity::get_new_grav_vector() 4 0.0308 0.03218 0.0329 0.50% VisMF::Write(FabArray) 2 0.02946 0.03004 0.03266 0.49% MLMG::addInterpCorrection() 530 0.01921 0.0294 0.03106 0.47% MLMG::computeResidual() 106 0.02748 0.02865 0.02915 0.44% MLCellLinOp::updateCorBC() 106 0.01954 0.02296 0.0282 0.43% MLMG::computeMLResidual() 32 0.02141 0.0252 0.0274 0.41% MLCellLinOp::updateSolBC() 120 0.02043 0.02482 0.02703 0.41% Castro::computeInitialDt() 1 0.02206 0.02441 0.02694 0.41% Castro::estTimeStep() 1 0.02206 0.02441 0.02694 0.41% MLPoisson::Fapply() 1040 0.02279 0.025 0.02677 0.41% MLMG::mgVcycle_down::1 106 0.02413 0.02569 0.02629 0.40% FabArrayBase::TheFPinfo() 49 0.002992 0.01699 0.02512 0.38% FPinfo::FPinfo() 9 0.002929 0.01692 0.02504 0.38% DistributionMapping::LeastUsedCPUs() 9 0.002976 0.01693 0.02499 0.38% MLMG::mgVcycle_up::2 106 0.008511 0.01933 0.02098 0.32% MLMG::mgVcycle_up::1 106 0.02014 0.02023 0.0203 0.31% amrex::Add() 575 0.01086 0.01259 0.01875 0.28% MLMG:computeResOfCorrection() 530 0.018 0.01823 0.01854 0.28% MLMG::interpCorrection_1 106 0.01114 0.0154 0.0184 0.28% Castro::buildMetrics() 16 0.01347 0.015 0.01709 0.26% MLPoisson::define() 14 0.012 0.01463 0.01663 0.25% FabArray::Xpay() 1013 0.01234 0.01407 0.01636 0.25% MLMG::prepareForSolve() 14 0.009845 0.01156 0.01389 0.21% DistributionMapping::KnapSackDoIt() 2 4.564e-05 0.007375 0.01304 0.20% MultiFab::Multiply() 287 0.0106 0.01198 0.0129 0.20% MLMG::ResNormInf() 152 0.01021 0.01132 0.01243 0.19% MLPoisson::FFlux() 3408 0.01094 0.01125 0.01198 0.18% Castro::errorEst() 15 0.00936 0.00969 0.01058 0.16% FillPatchInterp(MF) 44 0.0017 0.006473 0.00972 0.15% MLMG::mgVcycle_down::2 106 0.008848 0.009063 0.009705 0.15% MLMG::getGradSolution() 14 0.005527 0.006637 0.008945 0.14% MLCellLinOp::compGrad() 28 0.005508 0.006618 0.008927 0.14% MLLinOp::define() 14 0.001491 0.004368 0.006844 0.10% MLLinOp::defineGrids() 14 0.00146 0.004345 0.006821 0.10% Gravity::average_fine_ec_onto_crse_ec() 14 0.00332 0.00508 0.006584 0.10% MLLinOp::makeSubCommunicator() 14 0.001057 0.003953 0.006403 0.10% Castro::apply_tagging_restrictions() 15 0.005514 0.005855 0.006178 0.09% MLCellLinOp::defineBC() 14 0.004918 0.005171 0.006025 0.09% MLCellLinOp::defineAuxData() 14 0.004824 0.005054 0.005778 0.09% FabArrayBase::getCPC() 3662 0.005084 0.005333 0.005584 0.08% average_down_faces 84 0.001975 0.003683 0.005334 0.08% FabArray::norminf(mask) 46 0.00472 0.004841 0.005103 0.08% Castro::sum_integrated_quantities() 1 0.005026 0.005051 0.005095 0.08% MultiFab::max() 54 0.002835 0.00398 0.00505 0.08% MLMG::mgVcycle_down::3 106 0.001259 0.001721 0.004562 0.07% MLMG::MLResNormInf() 32 0.004044 0.004123 0.004304 0.07% MLMG::actualBottomSolve() 106 2.202e-05 0.0005258 0.004043 0.06% TagBoxArray::collate() 15 0.000279 0.003447 0.004026 0.06% FabArray::norminf() 174 0.003066 0.003284 0.003726 0.06% MLCGSolver::bicgstab 13 0 0.0004625 0.0037 0.06% BndryData::define() 42 0.002794 0.003059 0.003618 0.05% MLMG::mgVcycle_up::3 106 0.0009046 0.001252 0.003607 0.05% Castro::enforce_min_density() 33 0.002577 0.002759 0.002942 0.04% Gravity::update_max_rhs() 1 0.0008329 0.001603 0.002768 0.04% FabArray::mult() 34 0.001112 0.001439 0.002339 0.04% MLMG::mgVcycle_down::4 106 0.001112 0.00127 0.00226 0.03% FabArrayBase::CPC::define() 624 0.001621 0.001726 0.001994 0.03% MLMG::mgVcycle_up::4 106 0.001066 0.001188 0.001905 0.03% MLMG::MLRhsNormInf() 14 0.00174 0.001787 0.001849 0.03% Castro::volWgtSum() 46 0.001721 0.001735 0.001753 0.03% Castro::enforce_consistent_e() 3 0.000981 0.001181 0.001431 0.02% StateDataPhysBCFunct::() 259 0.001263 0.001321 0.001401 0.02% FabArrayBase::getFB() 5552 0.001063 0.001125 0.001264 0.02% StateData::FillBoundary(geom) 8 0.001118 0.001172 0.001235 0.02% AMRErrorTag::operator() 15 0.0009106 0.0009297 0.0009438 0.01% Castro::build_fine_mask() 55 0.0007014 0.0007663 0.0008147 0.01% MLCGSolver::ParallelAllReduce 81 0 7.474e-05 0.0005979 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005047 0.0005275 0.0005626 0.01% MLPoisson::prepareForSolve() 14 0.0003726 0.0003981 0.000458 0.01% MLCellLinOp::prepareForSolve() 14 0.00036 0.0003851 0.0004453 0.01% FabArray::setDomainBndry() 259 0.0003654 0.000392 0.0004275 0.01% MLCellLinOp::setLevelBC() 28 0.0003412 0.0003485 0.0003627 0.01% OwnerMask() 15 8.856e-05 0.0001156 0.000223 0.00% Castro::locWgtSum() 6 0.0002086 0.0002113 0.0002134 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 7.41e-05 0.0001348 0.0001678 0.00% FabArrayBase::FB::FB() 35 7.64e-05 8.812e-05 0.0001342 0.00% amrex::Dot() 54 0 1.617e-05 0.0001294 0.00% AmrMesh-cluster 1 0 1.435e-05 0.0001148 0.00% Castro::volProductSum() 2 8.598e-05 8.827e-05 9.16e-05 0.00% FabArray::Saxpy() 27 0 1.118e-05 8.942e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.824e-05 7.635e-05 8.87e-05 0.00% FabArray::LinComb() 27 0 1.085e-05 8.679e-05 0.00% ClusterList::intersect() 1 0 8.573e-06 6.859e-05 0.00% makeSFC 42 4.401e-05 5.004e-05 6.014e-05 0.00% BoxList::parallelComplementIn() 30 2.072e-05 2.446e-05 3.984e-05 0.00% Amr::writeSmallPlotFile() 1 2.91e-05 3.017e-05 3.293e-05 0.00% DistributionMapping::Distribute() 46 2.244e-05 2.484e-05 2.863e-05 0.00% BoxList::complementIn 30 9.605e-06 1.24e-05 2.667e-05 0.00% FabArray::RecvLayoutMask() 14 1.617e-05 1.666e-05 1.82e-05 0.00% ClusterList::chop() 1 0 2.169e-06 1.735e-05 0.00% Castro::enforce_speed_limit() 33 1.116e-05 1.279e-05 1.437e-05 0.00% knapsack() 2 1.102e-05 1.185e-05 1.345e-05 0.00% Amr::initSubcycle() 1 1.051e-05 1.078e-05 1.103e-05 0.00% Castro::apply_problem_tags() 15 5.347e-06 6.02e-06 7.144e-06 0.00% Gravity::set_mass_offset() 1 9.93e-07 1.272e-06 1.661e-06 0.00% Castro::gwstrain() 2 9.15e-07 1.308e-06 1.601e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 15 B 17 B 21 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.03-6-g5b7fa9867d02) finalized