Initializing AMReX (v2024-42-g7437aa17d36f)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (v2024-42-g7437aa17d36f) initialized Starting run at 09:44:13 UTC on 2024-03-28. Successfully read inputs file ... Castro git describe: 24.03-37-g6b90dd1c0 AMReX git describe: v2024-42-g7437aa17d Microphysics git describe: 24.03-23-g3112c13a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002767627 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.116101659 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.00184288 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001536735 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00171175 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001737289 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001670248 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001732628 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001665667 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001643341 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001709588 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001711358 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001593859 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002196617 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001637667 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.271421415 seconds Ending run at 09:44:19 UTC on 2024-03-28. Run time = 6.441974195 Run time without initialization = 0.000562318 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.442 ... 6.442 ... 6.442 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1436 1.1655 1.1930 18.52% Amr::InitAmr() 1 1.156 1.156 1.156 17.94% Castro::post_init() 2 0.9608 0.9717 0.98 15.21% Castro::computeTemp() 36 0.6764 0.73 0.8037 12.48% FabArray::ParallelCopy_finish() 2952 0.08201 0.3649 0.5462 8.48% Castro::reset_internal_energy(Fab) 654 0.3202 0.356 0.4043 6.28% MLPoisson::Fsmooth() 5088 0.2455 0.2577 0.2743 4.26% Castro::normalize_species() 33 0.1645 0.1795 0.1947 3.02% amrex::Copy() 948 0.115 0.1355 0.1802 2.80% AmrLevel::derive() 97 0.135 0.1397 0.1526 2.37% Castro::initData() 3 0.1003 0.1136 0.1335 2.07% Castro::initMFs() 16 0.09199 0.1078 0.1263 1.96% FillBoundary_finish() 5539 0.07425 0.09497 0.1211 1.88% StateData::define() 64 0.05151 0.05954 0.0686 1.06% FabArray::setVal() 1755 0.04632 0.05206 0.06313 0.98% FillBoundary_nowait() 5539 0.0504 0.05431 0.05702 0.89% amrex::average_down 844 0.04089 0.04643 0.05347 0.83% MLCellLinOp::applyBC() 6281 0.04142 0.04461 0.0497 0.77% FabArray::ParallelCopy_nowait() 2952 0.02319 0.03181 0.04742 0.74% Amr::writePlotFile() 1 0.007108 0.02449 0.0367 0.57% FillPatchIterator::Initialize 215 0.01502 0.02068 0.03326 0.52% MLPoisson::Fapply() 1027 0.02304 0.02532 0.02855 0.44% VisMF::Write(FabArray) 2 0.01763 0.01966 0.02669 0.41% Castro::estTimeStep() 1 0.02238 0.02447 0.0265 0.41% MLCellLinOp::reflux() 138 0.01756 0.01879 0.01955 0.30% Amr::regrid() 14 0.007543 0.01127 0.01845 0.29% MLMG::addInterpCorrection() 530 0.0168 0.01733 0.01769 0.27% Castro::Castro() 16 0.009968 0.01211 0.01648 0.26% FabArray::Xpay() 1000 0.01147 0.014 0.01628 0.25% Castro::buildMetrics() 16 0.01107 0.01347 0.01549 0.24% MultiFab::Multiply() 287 0.01067 0.01305 0.01502 0.23% amrex::Add() 562 0.01015 0.01178 0.01379 0.21% MLCellLinOp::updateSolBC() 120 0.01034 0.01159 0.01275 0.20% MLPoisson::FFlux() 3408 0.01097 0.01153 0.01186 0.18% MLCellLinOp::updateCorBC() 106 0.009401 0.0105 0.01151 0.18% FillPatchInterp(MF) 44 0.001874 0.006902 0.0103 0.16% MLMG::prepareForSolve() 14 0.004507 0.005748 0.008346 0.13% MLMG::interpCorrection_1 106 0.006403 0.007227 0.008293 0.13% AmrMesh::MakeNewGrids() 15 0.007631 0.00773 0.007834 0.12% DistributionMapping::LeastUsedCPUs() 9 0.0001808 0.004477 0.006971 0.11% Castro::apply_tagging_restrictions() 15 0.005992 0.006395 0.006854 0.11% MultiFab::max() 54 0.003626 0.005248 0.006598 0.10% MLMG::ResNormInf() 152 0.003305 0.005369 0.006581 0.10% FabArray::norminf(mask) 46 0.004812 0.005009 0.005169 0.08% MLCellLinOp::defineAuxData() 14 0.004081 0.004382 0.005064 0.08% MLLinOp::makeSubCommunicator() 14 0.0005904 0.002518 0.00475 0.07% MLCellLinOp::compGrad() 28 0.002951 0.003619 0.004667 0.07% Gravity::multilevel_solve_for_new_phi() 14 0.002889 0.003603 0.004647 0.07% Gravity::get_new_grav_vector() 4 0.001563 0.002307 0.004176 0.06% FabArrayBase::getCPC() 3662 0.003424 0.003629 0.004141 0.06% FabArray::norminf() 188 0.002921 0.003425 0.00402 0.06% Castro::enforce_min_density() 33 0.002528 0.002797 0.003266 0.05% Gravity::actual_solve_with_mlmg() 14 0.002176 0.002395 0.003136 0.05% BndryData::define() 42 0.002595 0.002716 0.002848 0.04% FabArrayBase::CPC::define() 624 0.001705 0.001865 0.00235 0.04% FabArray::FillBoundary() 5539 0.001991 0.002127 0.002231 0.03% Castro::volWgtSum() 46 0.001597 0.00174 0.002173 0.03% Castro::sum_integrated_quantities() 1 0.0006367 0.00164 0.002144 0.03% MLCellLinOp::defineBC() 14 0.001734 0.00192 0.002076 0.03% MLCellLinOp::smooth() 2544 0.001742 0.001847 0.001943 0.03% FillPatchTwoLevels 126 0.0006799 0.001217 0.001793 0.03% FabArray::mult() 34 0.001112 0.001341 0.001701 0.03% average_down_faces 84 0.001061 0.001208 0.001541 0.02% Castro::enforce_consistent_e() 3 0.001057 0.001188 0.001416 0.02% FabArray::ParallelCopy() 2952 0.001285 0.001341 0.001403 0.02% MLCGSolver::bicgstab 13 0 0.0001474 0.001179 0.02% AMRErrorTag::operator() 15 0.001099 0.001118 0.001131 0.02% Gravity::actual_multilevel_solve() 14 0.0007372 0.0008949 0.001129 0.02% FabArrayBase::getFB() 5539 0.0009059 0.0009951 0.001114 0.02% Castro::build_fine_mask() 55 0.0006577 0.0007464 0.001002 0.02% StateData::FillBoundary(geom) 8 0.0008801 0.0009102 0.0009446 0.01% MLMG::solve() 14 0.000537 0.0007105 0.0009395 0.01% TagBoxArray::collate() 15 0.0005276 0.0005916 0.0007824 0.01% main() 1 0.0004546 0.0005466 0.0007627 0.01% MLCellLinOp::prepareForSolve() 14 0.0003756 0.0004231 0.0006279 0.01% MLCellLinOp::apply() 1027 0.0004447 0.0004813 0.0006117 0.01% AmrLevel::FillPatch() 215 0.0004906 0.0005414 0.0006094 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005166 0.0005429 0.0005983 0.01% MLMG::MLResNormInf() 32 0.0002686 0.0003978 0.0005667 0.01% MLCellLinOp::setLevelBC() 28 0.0003287 0.0003749 0.0005526 0.01% Amr::grid_places() 15 0.0003554 0.0003956 0.0005174 0.01% Gravity::update_max_rhs() 1 0.0001904 0.000294 0.0005084 0.01% MLMG::mgVcycle() 318 0.0004369 0.0004703 0.0004975 0.01% FabArray::setDomainBndry() 259 0.0003218 0.0003603 0.0004319 0.01% MLLinOp::defineGrids() 14 0.0002921 0.0003531 0.0004255 0.01% MLCellLinOp::correctionResidual() 742 0.0003766 0.0003933 0.0004101 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003253 0.000355 0.0003982 0.01% MLMG::actualBottomSolve() 106 2.397e-05 6.522e-05 0.0003334 0.01% MLMG::oneIter() 106 0.000273 0.0002933 0.0003226 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002809 0.0002967 0.0003219 0.00% MLMG::mgVcycle_bottom 318 0.0002199 0.0002348 0.0002544 0.00% MLCGSolver::ParallelAllReduce 95 0 3.056e-05 0.0002445 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001904 0.0002087 0.0002186 0.00% Castro::locWgtSum() 6 0.0001981 0.0002044 0.0002121 0.00% StateDataPhysBCFunct::() 259 0.000168 0.0001796 0.0002077 0.00% MLCellLinOp::solutionResidual() 258 0.0001867 0.0001948 0.0002061 0.00% FillPatchSingleLevel 259 0.0001465 0.0001594 0.000184 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001093 0.0001318 0.0001819 0.00% MLMG:computeResOfCorrection() 530 0.0001629 0.0001696 0.0001766 0.00% AmrLevel::AmrLevel(dm) 16 0.0001505 0.0001576 0.0001671 0.00% FabArrayBase::FB::FB() 35 8.346e-05 9.901e-05 0.0001564 0.00% MLMG::mgVcycle_down::0 106 0.0001276 0.0001403 0.000152 0.00% FabArray::Saxpy() 54 0 1.831e-05 0.0001464 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001197 0.0001287 0.0001382 0.00% MLMG::miniCycle() 212 8.938e-05 0.0001039 0.0001303 0.00% Castro::derive() 97 5.988e-05 7.642e-05 0.0001249 0.00% amrex::Dot() 54 0 1.541e-05 0.0001233 0.00% OwnerMask() 15 9.548e-05 0.0001073 0.0001211 0.00% MLMG::mgVcycle_down::1 106 0.0001126 0.0001168 0.0001206 0.00% FPinfo::FPinfo() 9 8.268e-05 9.126e-05 0.0001049 0.00% TagBoxArray::mapPRD 15 9.728e-05 9.984e-05 0.0001042 0.00% Castro::volProductSum() 2 7.956e-05 8.51e-05 0.0001032 0.00% MLMG::mgVcycle_down::2 106 8.341e-05 8.895e-05 9.85e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 7.958e-05 8.753e-05 9.649e-05 0.00% MLMG::mgVcycle_down::3 106 7.362e-05 8.34e-05 9.469e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.957e-05 7.964e-05 9.174e-05 0.00% Castro::avgDown(state_indx) 60 7.269e-05 8.082e-05 8.972e-05 0.00% Castro::post_regrid() 30 6.181e-05 7.124e-05 8.527e-05 0.00% FabArrayBase::TheFPinfo() 49 6.452e-05 7.267e-05 8.432e-05 0.00% Castro::clean_state() 33 7.378e-05 7.921e-05 8.343e-05 0.00% MLMG::computeResidual() 106 6.374e-05 7.097e-05 8.314e-05 0.00% Amr::defBaseLevel() 1 5.926e-05 6.87e-05 8.085e-05 0.00% MLMG::mgVcycle_down::4 106 7.179e-05 7.603e-05 8.07e-05 0.00% Amr::FinalizeInit() 1 8.125e-06 2.036e-05 8.028e-05 0.00% MLMG::mgVcycle_up::4 106 6.559e-05 6.978e-05 7.76e-05 0.00% MLMG::mgVcycle_up::0 106 6.804e-05 7.058e-05 7.289e-05 0.00% MLMG::mgVcycle_up::1 106 5.748e-05 6.376e-05 7.153e-05 0.00% Castro::avgDown() 15 4.085e-05 5.279e-05 7.106e-05 0.00% ClusterList::intersect() 1 0 8.392e-06 6.713e-05 0.00% MLMG::mgVcycle_up::3 106 5.489e-05 5.982e-05 6.417e-05 0.00% Castro::init(old) 13 4.571e-05 5.036e-05 6.044e-05 0.00% amrex::average_down_w_geom 60 3.913e-05 4.765e-05 5.869e-05 0.00% MLMG::mgVcycle_up::2 106 5.217e-05 5.519e-05 5.792e-05 0.00% Castro::errorEst() 15 4.024e-05 4.552e-05 5.524e-05 0.00% MLMG::computeMLResidual() 32 4.058e-05 4.499e-05 5.062e-05 0.00% makeSFC 42 3.034e-05 3.648e-05 4.993e-05 0.00% MLPoisson::define() 14 3.769e-05 4.223e-05 4.641e-05 0.00% MLLinOp::define() 14 2.368e-05 2.815e-05 4.04e-05 0.00% Amr::writeSmallPlotFile() 1 3.083e-05 3.482e-05 3.893e-05 0.00% AmrMesh-cluster 1 0 4.733e-06 3.786e-05 0.00% Amr::bldFineLevels() 1 1.913e-05 2.707e-05 3.502e-05 0.00% DistributionMapping::Distribute() 46 2.365e-05 2.944e-05 3.499e-05 0.00% MLMG::getGradSolution() 14 1.581e-05 1.952e-05 3.01e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.88e-05 2.154e-05 2.954e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.165e-05 2.43e-05 2.834e-05 0.00% ClusterList::chop() 1 0 3.323e-06 2.658e-05 0.00% Amr::initialInit() 1 1.429e-06 4.843e-06 2.152e-05 0.00% Gravity::set_mass_offset() 1 3.659e-06 9.158e-06 2.036e-05 0.00% FabArray::RecvLayoutMask() 14 1.651e-05 1.72e-05 1.788e-05 0.00% Castro::enforce_speed_limit() 33 1.213e-05 1.351e-05 1.714e-05 0.00% MLPoisson::prepareForSolve() 14 1.084e-05 1.264e-05 1.566e-05 0.00% knapsack() 2 1.135e-05 1.303e-05 1.436e-05 0.00% BoxList::parallelComplementIn() 30 1.113e-05 1.23e-05 1.357e-05 0.00% BoxList::complementIn 30 1.018e-05 1.157e-05 1.345e-05 0.00% Amr::initSubcycle() 1 1.046e-05 1.106e-05 1.145e-05 0.00% MLMG::MLRhsNormInf() 14 8.335e-06 9.117e-06 9.683e-06 0.00% Castro::apply_problem_tags() 15 8.223e-06 8.74e-06 9.253e-06 0.00% Amr::init() 1 2.148e-06 4.093e-06 7.365e-06 0.00% Amr::InitializeInit() 1 3.169e-06 3.616e-06 5.321e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.096e-06 4.611e-06 5.296e-06 0.00% Castro::computeInitialDt() 1 1.364e-06 1.719e-06 2.414e-06 0.00% Castro::gwstrain() 2 9.33e-07 1.292e-06 1.596e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.442 6.442 6.442 100.00% Amr::init() 1 5.285 5.285 5.285 82.04% Amr::initialInit() 1 5.014 5.014 5.014 77.83% Amr::FinalizeInit() 1 4.911 4.913 4.915 76.30% Castro::post_init() 2 3.716 3.832 3.914 60.76% Gravity::multilevel_solve_for_new_phi() 14 1.888 1.91 1.936 30.05% Gravity::actual_multilevel_solve() 14 1.885 1.906 1.932 30.00% Gravity::solve_phi_with_mlmg() 14 1.877 1.898 1.924 29.87% Amr::regrid() 14 1.166 1.204 1.225 19.01% Castro::computeTemp() 36 0.997 1.086 1.203 18.67% Gravity::fill_multipole_BCs() 14 1.145 1.167 1.195 18.54% Amr::InitAmr() 1 1.156 1.156 1.156 17.94% Castro::clean_state() 33 0.9787 1.059 1.15 17.86% Amr::bldFineLevels() 1 0.8477 0.9129 1.006 15.61% Castro::post_regrid() 30 0.7477 0.7952 0.8359 12.98% Gravity::actual_solve_with_mlmg() 14 0.7283 0.7304 0.7322 11.37% Castro::initData() 3 0.534 0.6063 0.718 11.15% MLMG::solve() 14 0.7059 0.7077 0.7085 11.00% MLMG::oneIter() 106 0.6198 0.6213 0.6223 9.66% FabArray::ParallelCopy() 2952 0.1636 0.4236 0.5993 9.30% FabArray::ParallelCopy_finish() 2952 0.08201 0.3649 0.5462 8.48% MLMG::mgVcycle() 318 0.4673 0.4685 0.4698 7.29% Castro::reset_internal_energy(MultiFab) 36 0.3205 0.3564 0.4047 6.28% Castro::reset_internal_energy(Fab) 654 0.3202 0.356 0.4043 6.28% MLCellLinOp::smooth() 2544 0.3957 0.3981 0.4042 6.27% amrex::average_down 844 0.08596 0.2101 0.2994 4.65% MLPoisson::Fsmooth() 5088 0.2455 0.2577 0.2743 4.26% Amr::writePlotFile() 1 0.2716 0.2717 0.2718 4.22% Castro::avgDown() 15 0.05297 0.1752 0.2622 4.07% Castro::avgDown(state_indx) 60 0.0529 0.1751 0.2621 4.07% amrex::average_down_w_geom 60 0.05282 0.175 0.2621 4.07% Castro::derive() 97 0.2195 0.2262 0.2318 3.60% AmrLevel::derive() 97 0.2194 0.2262 0.2317 3.60% MLCellLinOp::applyBC() 6281 0.1812 0.1971 0.2164 3.36% AmrLevel::FillPatch() 215 0.1594 0.1878 0.2083 3.23% Castro::normalize_species() 33 0.1645 0.1795 0.1947 3.02% FillPatchIterator::Initialize 215 0.1374 0.1644 0.1863 2.89% Castro::Castro() 16 0.131 0.1536 0.1808 2.81% amrex::Copy() 948 0.115 0.1355 0.1802 2.80% FabArray::FillBoundary() 5539 0.1315 0.1525 0.175 2.72% Amr::grid_places() 15 0.02153 0.0954 0.141 2.19% FillPatchSingleLevel 259 0.08701 0.1158 0.1408 2.19% AmrMesh::MakeNewGrids() 15 0.02112 0.095 0.1406 2.18% MLMG::mgVcycle_bottom 318 0.1321 0.1336 0.1381 2.14% MLMG::miniCycle() 212 0.1323 0.1333 0.1351 2.10% MLMG::mgVcycle_down::0 106 0.1254 0.1261 0.1276 1.98% Castro::initMFs() 16 0.09199 0.1078 0.1263 1.96% TagBoxArray::mapPRD 15 0.002009 0.07611 0.1214 1.88% FillBoundary_finish() 5539 0.07425 0.09497 0.1211 1.88% MLMG::mgVcycle_up::0 106 0.1133 0.1136 0.1142 1.77% FillPatchIterator::FillFromTwoLevels() 126 0.06303 0.08802 0.1042 1.62% FillPatchTwoLevels 126 0.0629 0.08789 0.104 1.62% Amr::InitializeInit() 1 0.09815 0.1002 0.1023 1.59% Amr::defBaseLevel() 1 0.09815 0.1002 0.1023 1.59% Castro::init(old) 13 0.06206 0.08191 0.09246 1.44% MLMG::computeResWithCrseSolFineCor() 106 0.08162 0.08429 0.08532 1.32% FabArray::ParallelCopy_nowait() 2952 0.04413 0.05735 0.08017 1.24% MLCellLinOp::apply() 1027 0.06917 0.07108 0.07311 1.13% MLCellLinOp::solutionResidual() 258 0.06447 0.06755 0.07093 1.10% MLCellLinOp::correctionResidual() 742 0.06634 0.06754 0.06974 1.08% AmrLevel::AmrLevel(dm) 16 0.05167 0.05969 0.06877 1.07% StateData::define() 64 0.05151 0.05954 0.0686 1.06% FillPatchIterator::FillFromLevel0() 89 0.03046 0.05544 0.06734 1.05% FabArray::setVal() 1755 0.04632 0.05206 0.06313 0.98% FillBoundary_nowait() 5539 0.05144 0.0554 0.05811 0.90% MLCellLinOp::reflux() 138 0.05275 0.05535 0.05667 0.88% MLMG::computeResWithCrseCorFineCor() 106 0.03541 0.03639 0.03735 0.58% MLMG::computeResidual() 106 0.03117 0.0323 0.03399 0.53% MLMG::addInterpCorrection() 530 0.0192 0.03056 0.03227 0.50% MLCellLinOp::updateSolBC() 120 0.02545 0.02749 0.0296 0.46% MLMG::computeMLResidual() 32 0.02548 0.02754 0.02893 0.45% MLMG::mgVcycle_down::1 106 0.02761 0.02838 0.02871 0.45% MLPoisson::Fapply() 1027 0.02304 0.02532 0.02855 0.44% VisMF::Write(FabArray) 2 0.01763 0.01966 0.02669 0.41% Gravity::get_new_grav_vector() 4 0.02432 0.02532 0.02655 0.41% Castro::computeInitialDt() 1 0.02238 0.02448 0.0265 0.41% Castro::estTimeStep() 1 0.02238 0.02447 0.0265 0.41% MLMG::mgVcycle_up::2 106 0.01164 0.02365 0.02569 0.40% MLMG::mgVcycle_up::1 106 0.02392 0.02408 0.02419 0.38% MLCellLinOp::updateCorBC() 106 0.02114 0.02203 0.02256 0.35% MLMG:computeResOfCorrection() 530 0.02116 0.02141 0.02205 0.34% Castro::buildMetrics() 16 0.01233 0.01497 0.01727 0.27% FabArray::Xpay() 1000 0.01147 0.014 0.01628 0.25% MLPoisson::define() 14 0.01188 0.01392 0.01556 0.24% MultiFab::Multiply() 287 0.01067 0.01305 0.01502 0.23% MLMG::mgVcycle_down::2 106 0.01215 0.01248 0.01399 0.22% amrex::Add() 562 0.01015 0.01178 0.01379 0.21% MLMG::interpCorrection_1 106 0.01084 0.01188 0.01352 0.21% MLMG::prepareForSolve() 14 0.01074 0.01169 0.01323 0.21% MLMG::ResNormInf() 152 0.01025 0.01194 0.0127 0.20% MLPoisson::FFlux() 3408 0.01097 0.01153 0.01186 0.18% Castro::errorEst() 15 0.009865 0.01033 0.01068 0.17% FillPatchInterp(MF) 44 0.001874 0.006902 0.0103 0.16% FabArrayBase::TheFPinfo() 49 0.0002957 0.004582 0.007096 0.11% FPinfo::FPinfo() 9 0.0002194 0.004509 0.007011 0.11% DistributionMapping::LeastUsedCPUs() 9 0.0001808 0.004477 0.006971 0.11% Castro::apply_tagging_restrictions() 15 0.005992 0.006395 0.006854 0.11% MultiFab::max() 54 0.003626 0.005248 0.006598 0.10% MLMG::getGradSolution() 14 0.005627 0.005926 0.006542 0.10% MLCellLinOp::compGrad() 28 0.00561 0.005907 0.006524 0.10% FabArrayBase::getCPC() 3662 0.005141 0.005494 0.006491 0.10% MLCellLinOp::defineAuxData() 14 0.005178 0.005516 0.006471 0.10% Castro::sum_integrated_quantities() 1 0.005966 0.006035 0.006074 0.09% MLCellLinOp::defineBC() 14 0.005016 0.005381 0.005742 0.09% MLLinOp::define() 14 0.0009767 0.00298 0.005316 0.08% MLLinOp::defineGrids() 14 0.000953 0.002952 0.005276 0.08% MLMG::mgVcycle_down::3 106 0.001379 0.001964 0.005213 0.08% FabArray::norminf(mask) 46 0.004812 0.005009 0.005169 0.08% MLLinOp::makeSubCommunicator() 14 0.0005904 0.002518 0.00475 0.07% Gravity::average_fine_ec_onto_crse_ec() 14 0.003723 0.004185 0.004465 0.07% MLMG::MLResNormInf() 32 0.00411 0.004226 0.004295 0.07% MLMG::mgVcycle_up::3 106 0.0009584 0.001405 0.004115 0.06% FabArray::norminf() 188 0.002921 0.003425 0.00402 0.06% Gravity::update_max_rhs() 1 0.001313 0.002726 0.003939 0.06% BndryData::define() 42 0.003175 0.00333 0.003522 0.05% Castro::enforce_min_density() 33 0.002528 0.002797 0.003266 0.05% MLMG::actualBottomSolve() 106 2.397e-05 0.0004219 0.003187 0.05% average_down_faces 84 0.002255 0.002743 0.003104 0.05% MLCGSolver::bicgstab 13 0 0.000349 0.002792 0.04% MLMG::mgVcycle_down::4 106 0.001272 0.001469 0.0026 0.04% FabArrayBase::CPC::define() 624 0.001705 0.001865 0.00235 0.04% Castro::volWgtSum() 46 0.001603 0.001746 0.00218 0.03% MLMG::mgVcycle_up::4 106 0.001131 0.001305 0.002093 0.03% MLMG::MLRhsNormInf() 14 0.001759 0.001857 0.00192 0.03% FabArray::mult() 34 0.001112 0.001341 0.001701 0.03% Castro::enforce_consistent_e() 3 0.001057 0.001188 0.001416 0.02% FabArrayBase::getFB() 5539 0.000993 0.001094 0.001271 0.02% AMRErrorTag::operator() 15 0.001099 0.001118 0.001131 0.02% StateDataPhysBCFunct::() 259 0.001059 0.00109 0.00113 0.02% Castro::build_fine_mask() 55 0.0006577 0.0007464 0.001002 0.02% StateData::FillBoundary(geom) 8 0.0008801 0.0009102 0.0009446 0.01% DistributionMapping::KnapSackDoIt() 2 4.371e-05 0.0004237 0.0009095 0.01% TagBoxArray::collate() 15 0.0005276 0.0005916 0.0007824 0.01% MLPoisson::prepareForSolve() 14 0.0003887 0.0004357 0.0006436 0.01% MLCellLinOp::prepareForSolve() 14 0.0003756 0.0004231 0.0006279 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005166 0.0005429 0.0005983 0.01% MLCellLinOp::setLevelBC() 28 0.0003287 0.0003749 0.0005526 0.01% FabArray::setDomainBndry() 259 0.0003218 0.0003603 0.0004319 0.01% MLCGSolver::ParallelAllReduce 95 0 3.942e-05 0.0003154 0.00% Castro::locWgtSum() 6 0.0001987 0.000205 0.0002128 0.00% FabArrayBase::FB::FB() 35 8.346e-05 9.901e-05 0.0001564 0.00% FabArray::Saxpy() 54 0 1.831e-05 0.0001464 0.00% AmrMesh-cluster 1 0 1.645e-05 0.0001316 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 9.507e-05 0.0001076 0.0001237 0.00% amrex::Dot() 54 0 1.541e-05 0.0001233 0.00% OwnerMask() 15 9.548e-05 0.0001073 0.0001211 0.00% Castro::volProductSum() 2 7.979e-05 8.532e-05 0.0001034 0.00% MLLinOp::makeAgglomeratedDMap 14 6.821e-05 8.066e-05 9.987e-05 0.00% makeSFC 42 4.656e-05 5.635e-05 7.153e-05 0.00% ClusterList::intersect() 1 0 8.392e-06 6.713e-05 0.00% Amr::writeSmallPlotFile() 1 3.083e-05 3.482e-05 3.893e-05 0.00% DistributionMapping::Distribute() 46 2.365e-05 2.944e-05 3.499e-05 0.00% BoxList::parallelComplementIn() 30 2.155e-05 2.387e-05 2.662e-05 0.00% ClusterList::chop() 1 0 3.323e-06 2.658e-05 0.00% Gravity::set_mass_offset() 1 3.659e-06 9.158e-06 2.036e-05 0.00% FabArray::RecvLayoutMask() 14 1.651e-05 1.72e-05 1.788e-05 0.00% Castro::enforce_speed_limit() 33 1.213e-05 1.351e-05 1.714e-05 0.00% knapsack() 2 1.135e-05 1.303e-05 1.436e-05 0.00% BoxList::complementIn 30 1.018e-05 1.157e-05 1.345e-05 0.00% Amr::initSubcycle() 1 1.046e-05 1.106e-05 1.145e-05 0.00% Castro::apply_problem_tags() 15 8.223e-06 8.74e-06 9.253e-06 0.00% Castro::gwstrain() 2 9.33e-07 1.292e-06 1.596e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 21 B 25 B 29 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-42-g7437aa17d36f) finalized