Initializing AMReX (23.12-21-gef38229189e3)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.12-21-gef38229189e3) initialized Starting run at 08:02:27 UTC on 2023-12-20. Successfully read inputs file ... Castro git describe: 23.12-13-gfe78cf0df AMReX git describe: 23.12-21-gef3822918 Microphysics git describe: 23.12-10-g925e0ce0 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002529816 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.13217753 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001646817 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002054572 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.0013448 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001193899 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001190823 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001192117 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001162782 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001183515 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001177224 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001175949 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001161255 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00116591 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001220981 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.222852083 seconds Ending run at 08:02:34 UTC on 2023-12-20. Run time = 6.42930046 Run time without initialization = 0.000312694 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.429 ... 6.429 ... 6.429 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1182 1.1667 1.1935 18.56% Amr::InitAmr() 1 1.125 1.125 1.125 17.50% Castro::post_init() 2 1.009 1.009 1.011 15.72% Castro::computeTemp() 36 0.7664 0.8253 0.9102 14.16% Castro::reset_internal_energy(Fab) 654 0.4162 0.456 0.5158 8.02% FabArray::ParallelCopy_finish() 2952 0.05358 0.2964 0.4326 6.73% MLPoisson::Fsmooth() 5088 0.1968 0.2091 0.2245 3.49% Castro::normalize_species() 33 0.1645 0.1742 0.1888 2.94% Castro::initData() 3 0.1189 0.1355 0.1615 2.51% AmrLevel::derive() 97 0.1403 0.1418 0.1437 2.23% amrex::Copy() 948 0.1294 0.1326 0.1357 2.11% Castro::initMFs() 16 0.08979 0.09952 0.1149 1.79% FillBoundary_finish() 5552 0.04915 0.06872 0.08879 1.38% StateData::define() 64 0.0516 0.05702 0.06545 1.02% amrex::average_down 844 0.04181 0.045 0.05164 0.80% FabArray::setVal() 1769 0.04251 0.04536 0.0491 0.76% FillBoundary_nowait() 5552 0.03975 0.04257 0.04635 0.72% MLCellLinOp::applyBC() 6294 0.03197 0.03493 0.03878 0.60% FabArray::ParallelCopy_nowait() 2952 0.02386 0.0261 0.03164 0.49% Castro::estTimeStep() 1 0.02221 0.02484 0.02874 0.45% MLPoisson::Fapply() 1040 0.02346 0.02501 0.02639 0.41% VisMF::Write(FabArray) 2 0.0171 0.01768 0.0197 0.31% MLCellLinOp::reflux() 138 0.0179 0.01885 0.0196 0.30% MLMG::addInterpCorrection() 530 0.01677 0.01715 0.01783 0.28% FillPatchIterator::Initialize 215 0.01603 0.01684 0.01755 0.27% Castro::buildMetrics() 16 0.01128 0.01246 0.01423 0.22% FabArray::Xpay() 1013 0.01193 0.01272 0.01377 0.21% MultiFab::Multiply() 287 0.01271 0.01299 0.01344 0.21% Amr::regrid() 14 0.009109 0.01103 0.01303 0.20% MLPoisson::FFlux() 3408 0.0115 0.01202 0.01252 0.19% amrex::Add() 575 0.01058 0.01122 0.01219 0.19% MLCellLinOp::updateSolBC() 120 0.01011 0.01122 0.0119 0.19% MLCellLinOp::updateCorBC() 106 0.009135 0.01012 0.01067 0.17% Castro::Castro() 16 0.008127 0.008877 0.01027 0.16% FillPatchInterp(MF) 44 0.001847 0.006809 0.01019 0.16% Amr::writePlotFile() 1 0.005458 0.00772 0.008451 0.13% MLMG::interpCorrection_1 106 0.006325 0.006977 0.007731 0.12% AmrMesh::MakeNewGrids() 15 0.007466 0.007578 0.007705 0.12% Castro::apply_tagging_restrictions() 15 0.005829 0.006298 0.006835 0.11% MLMG::prepareForSolve() 14 0.004809 0.004945 0.005165 0.08% FabArray::norminf(mask) 46 0.004822 0.004993 0.005158 0.08% MLLinOp::makeSubCommunicator() 14 0.0009255 0.002858 0.004867 0.08% MLMG::ResNormInf() 152 0.00295 0.003732 0.004333 0.07% MLCellLinOp::defineAuxData() 14 0.003994 0.004085 0.004286 0.07% FabArray::norminf() 188 0.003047 0.003342 0.003805 0.06% FabArrayBase::getCPC() 3662 0.00341 0.003515 0.003633 0.06% MultiFab::max() 54 0.002758 0.003165 0.003496 0.05% MLCellLinOp::compGrad() 28 0.003216 0.003336 0.003455 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002539 0.002776 0.002936 0.05% Castro::enforce_min_density() 33 0.002415 0.002577 0.002785 0.04% BndryData::define() 42 0.002497 0.002601 0.002706 0.04% Gravity::actual_solve_with_mlmg() 14 0.002004 0.002133 0.002426 0.04% Gravity::get_new_grav_vector() 4 0.001797 0.002039 0.002398 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0003307 0.001351 0.00224 0.03% FabArray::FillBoundary() 5552 0.001989 0.002067 0.002239 0.03% FabArrayBase::CPC::define() 624 0.001572 0.001762 0.002036 0.03% MLCellLinOp::defineBC() 14 0.001745 0.001876 0.001924 0.03% MLCellLinOp::smooth() 2544 0.001703 0.00179 0.001885 0.03% Castro::volWgtSum() 46 0.00169 0.001729 0.001747 0.03% FabArray::mult() 34 0.00116 0.001371 0.00172 0.03% Castro::enforce_consistent_e() 3 0.0009527 0.001199 0.001433 0.02% FillPatchTwoLevels 126 0.0006984 0.00113 0.001343 0.02% FabArray::ParallelCopy() 2952 0.001191 0.001248 0.001302 0.02% average_down_faces 84 0.001051 0.001161 0.001255 0.02% MLCGSolver::bicgstab 13 0 0.000155 0.00124 0.02% FabArrayBase::getFB() 5552 0.0009661 0.001021 0.001173 0.02% StateData::FillBoundary(geom) 8 0.001072 0.001111 0.001136 0.02% AMRErrorTag::operator() 15 0.000926 0.0009387 0.0009547 0.01% Gravity::actual_multilevel_solve() 14 0.0007405 0.0007887 0.0008075 0.01% MLMG::solve() 14 0.0004397 0.0006622 0.0007934 0.01% Castro::build_fine_mask() 55 0.0006273 0.0006686 0.0007141 0.01% Castro::sum_integrated_quantities() 1 0.0004685 0.0005536 0.0006287 0.01% MLCellLinOp::apply() 1040 0.0004331 0.0004849 0.0006129 0.01% AmrLevel::FillPatch() 215 0.0004847 0.0005015 0.0005212 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003129 0.0003777 0.0005129 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004481 0.00047 0.0005051 0.01% MLCellLinOp::correctionResidual() 755 0.0003948 0.0004249 0.0004892 0.01% MLCellLinOp::prepareForSolve() 14 0.000363 0.0003953 0.0004685 0.01% MLMG::MLResNormInf() 32 0.0001465 0.0002737 0.0004588 0.01% main() 1 0.0003772 0.0004079 0.0004546 0.01% Amr::grid_places() 15 0.0003064 0.00034 0.0004415 0.01% MLLinOp::defineGrids() 14 0.0002687 0.0003249 0.0004277 0.01% MLMG::mgVcycle() 318 0.0003945 0.0004064 0.0004221 0.01% TagBoxArray::collate() 15 0.0002264 0.0002946 0.000392 0.01% MLCellLinOp::setLevelBC() 28 0.0003307 0.0003587 0.0003889 0.01% FabArray::setDomainBndry() 259 0.000326 0.000361 0.0003765 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002879 0.0003087 0.000327 0.01% MLMG::actualBottomSolve() 106 2.108e-05 5.976e-05 0.0003219 0.01% MLMG::oneIter() 106 0.0002836 0.0002903 0.0002983 0.00% MLMG::mgVcycle_bottom 318 0.0002388 0.0002503 0.0002686 0.00% MLCGSolver::ParallelAllReduce 95 0 3.286e-05 0.0002629 0.00% Castro::locWgtSum() 6 0.0002047 0.0002112 0.0002215 0.00% MLCellLinOp::solutionResidual() 258 0.0001757 0.0001857 0.0001958 0.00% StateDataPhysBCFunct::() 259 0.0001484 0.0001647 0.0001916 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001654 0.0001704 0.0001867 0.00% MLMG:computeResOfCorrection() 530 0.0001561 0.0001681 0.0001828 0.00% AmrLevel::AmrLevel(dm) 16 0.0001208 0.0001486 0.0001619 0.00% MLMG::mgVcycle_down::0 106 0.0001273 0.0001404 0.0001606 0.00% FabArrayBase::FB::FB() 35 7.719e-05 9.545e-05 0.0001569 0.00% FillPatchSingleLevel 259 0.0001318 0.0001409 0.0001472 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001208 0.0001298 0.0001447 0.00% Gravity::update_max_rhs() 1 7.776e-05 0.0001083 0.0001319 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001141 0.0001244 0.0001313 0.00% MLMG::mgVcycle_down::1 106 0.0001151 0.0001199 0.0001277 0.00% FabArray::Saxpy() 54 0 1.582e-05 0.0001265 0.00% amrex::Dot() 54 0 1.54e-05 0.0001232 0.00% FPinfo::FPinfo() 9 7.877e-05 9.019e-05 0.0001133 0.00% OwnerMask() 15 8.903e-05 9.965e-05 0.0001103 0.00% MLMG::miniCycle() 212 8.41e-05 9.3e-05 0.0001057 0.00% TagBoxArray::mapPRD 15 9.648e-05 0.0001001 0.0001049 0.00% MLMG::mgVcycle_down::3 106 7.723e-05 8.469e-05 9.764e-05 0.00% MLMG::mgVcycle_down::4 106 7.086e-05 7.722e-05 9.741e-05 0.00% Castro::volProductSum() 2 8.177e-05 8.73e-05 9.721e-05 0.00% MLMG::mgVcycle_down::2 106 8.205e-05 8.866e-05 9.695e-05 0.00% Amr::defBaseLevel() 1 4.165e-05 6.939e-05 9.376e-05 0.00% Amr::FinalizeInit() 1 7.539e-06 2.704e-05 9.209e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.107e-05 8.349e-05 8.603e-05 0.00% Castro::post_regrid() 30 6.153e-05 7.136e-05 8.469e-05 0.00% FabArrayBase::TheFPinfo() 49 6.244e-05 6.777e-05 7.647e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.968e-05 6.692e-05 7.516e-05 0.00% Castro::avgDown(state_indx) 60 6.065e-05 6.625e-05 7.338e-05 0.00% MLMG::mgVcycle_up::1 106 5.864e-05 6.37e-05 7.265e-05 0.00% MLMG::mgVcycle_up::0 106 6.498e-05 6.787e-05 7.153e-05 0.00% MLMG::mgVcycle_up::4 106 5.961e-05 6.404e-05 7.134e-05 0.00% Castro::clean_state() 33 5.984e-05 6.529e-05 6.878e-05 0.00% ClusterList::intersect() 1 0 8.466e-06 6.773e-05 0.00% Castro::derive() 97 5.981e-05 6.319e-05 6.734e-05 0.00% MLMG::mgVcycle_up::3 106 5.616e-05 5.985e-05 6.457e-05 0.00% Castro::errorEst() 15 4.404e-05 4.862e-05 6.391e-05 0.00% MLMG::computeResidual() 106 5.339e-05 5.731e-05 6.366e-05 0.00% MLMG::mgVcycle_up::2 106 5.407e-05 5.758e-05 6.235e-05 0.00% Castro::init(old) 13 4.245e-05 4.773e-05 5.9e-05 0.00% MLPoisson::define() 14 3.691e-05 4.277e-05 5.318e-05 0.00% makeSFC 42 3.063e-05 3.724e-05 5.028e-05 0.00% amrex::average_down_w_geom 60 3.829e-05 4.3e-05 4.924e-05 0.00% Castro::avgDown() 15 3.571e-05 4.102e-05 4.827e-05 0.00% MLMG::computeMLResidual() 32 3.359e-05 3.981e-05 4.724e-05 0.00% Amr::writeSmallPlotFile() 1 3.234e-05 3.289e-05 3.344e-05 0.00% AmrMesh-cluster 1 0 3.542e-06 2.834e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.242e-05 2.506e-05 2.767e-05 0.00% Amr::bldFineLevels() 1 1.464e-05 1.854e-05 2.609e-05 0.00% MLMG::getGradSolution() 14 1.709e-05 1.888e-05 2.456e-05 0.00% DistributionMapping::Distribute() 46 2.094e-05 2.255e-05 2.428e-05 0.00% MLLinOp::define() 14 1.775e-05 1.933e-05 2.242e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.645e-05 1.807e-05 1.969e-05 0.00% FabArray::RecvLayoutMask() 14 1.534e-05 1.635e-05 1.743e-05 0.00% ClusterList::chop() 1 0 2.116e-06 1.693e-05 0.00% BoxList::complementIn 30 1.043e-05 1.244e-05 1.497e-05 0.00% MLPoisson::prepareForSolve() 14 1.126e-05 1.259e-05 1.4e-05 0.00% knapsack() 2 1.117e-05 1.212e-05 1.395e-05 0.00% Castro::enforce_speed_limit() 33 1.039e-05 1.197e-05 1.318e-05 0.00% BoxList::parallelComplementIn() 30 1.052e-05 1.118e-05 1.228e-05 0.00% Amr::initSubcycle() 1 1.132e-05 1.159e-05 1.199e-05 0.00% MLMG::MLRhsNormInf() 14 8.77e-06 9.457e-06 1.006e-05 0.00% Castro::apply_problem_tags() 15 7.273e-06 7.854e-06 9.022e-06 0.00% Amr::initialInit() 1 1.285e-06 3.207e-06 8.548e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.262e-06 4.766e-06 5.311e-06 0.00% Gravity::set_mass_offset() 1 8.18e-07 2.729e-06 5.043e-06 0.00% Amr::InitializeInit() 1 1.945e-06 2.571e-06 4.748e-06 0.00% Castro::computeInitialDt() 1 1.405e-06 1.997e-06 3.098e-06 0.00% Amr::init() 1 1.732e-06 2.135e-06 2.692e-06 0.00% Castro::gwstrain() 2 1.108e-06 1.239e-06 1.356e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.429 6.429 6.429 100.00% Amr::init() 1 5.304 5.304 5.304 82.49% Amr::initialInit() 1 5.08 5.081 5.081 79.02% Amr::FinalizeInit() 1 4.965 4.968 4.972 77.33% Castro::post_init() 2 3.642 3.775 3.863 60.08% Gravity::multilevel_solve_for_new_phi() 14 1.741 1.789 1.818 28.27% Gravity::actual_multilevel_solve() 14 1.738 1.786 1.815 28.23% Gravity::solve_phi_with_mlmg() 14 1.732 1.78 1.809 28.14% Castro::computeTemp() 36 1.185 1.282 1.426 22.19% Amr::regrid() 14 1.273 1.306 1.342 20.87% Castro::clean_state() 33 1.128 1.208 1.321 20.55% Gravity::fill_multipole_BCs() 14 1.12 1.168 1.195 18.59% Amr::InitAmr() 1 1.125 1.125 1.125 17.50% Amr::bldFineLevels() 1 0.9347 1.004 1.109 17.24% Castro::post_regrid() 30 0.869 0.9167 0.9746 15.16% Castro::initData() 3 0.6019 0.6907 0.8201 12.76% Gravity::actual_solve_with_mlmg() 14 0.6094 0.6114 0.6134 9.54% MLMG::solve() 14 0.5898 0.5904 0.5908 9.19% MLMG::oneIter() 106 0.5168 0.5174 0.5179 8.06% Castro::reset_internal_energy(MultiFab) 36 0.4165 0.4564 0.5163 8.03% Castro::reset_internal_energy(Fab) 654 0.4162 0.456 0.5158 8.02% FabArray::ParallelCopy() 2952 0.1144 0.351 0.4891 7.61% FabArray::ParallelCopy_finish() 2952 0.05358 0.2964 0.4326 6.73% MLMG::mgVcycle() 318 0.3792 0.381 0.3827 5.95% MLCellLinOp::smooth() 2544 0.3119 0.3142 0.3199 4.98% amrex::average_down 844 0.0753 0.2091 0.2974 4.63% Castro::avgDown() 15 0.04428 0.1787 0.2665 4.15% Castro::avgDown(state_indx) 60 0.04424 0.1787 0.2665 4.15% amrex::average_down_w_geom 60 0.04418 0.1786 0.2664 4.14% MLPoisson::Fsmooth() 5088 0.1968 0.2091 0.2245 3.49% Amr::writePlotFile() 1 0.223 0.2231 0.2231 3.47% Castro::derive() 97 0.1983 0.1985 0.1987 3.09% AmrLevel::derive() 97 0.1982 0.1984 0.1987 3.09% Castro::normalize_species() 33 0.1645 0.1742 0.1888 2.94% MLCellLinOp::applyBC() 6294 0.1376 0.1494 0.1641 2.55% Castro::Castro() 16 0.1299 0.1409 0.1609 2.50% Amr::grid_places() 15 0.01998 0.09941 0.1509 2.35% AmrMesh::MakeNewGrids() 15 0.01954 0.09907 0.1505 2.34% amrex::Copy() 948 0.1294 0.1326 0.1357 2.11% TagBoxArray::mapPRD 15 0.00167 0.08098 0.1327 2.06% FabArray::FillBoundary() 5552 0.09908 0.1145 0.1316 2.05% AmrLevel::FillPatch() 215 0.1124 0.1175 0.1211 1.88% Amr::InitializeInit() 1 0.1086 0.1125 0.1152 1.79% Amr::defBaseLevel() 1 0.1086 0.1125 0.1152 1.79% Castro::initMFs() 16 0.08979 0.09952 0.1149 1.79% MLMG::mgVcycle_down::0 106 0.1072 0.1081 0.1092 1.70% MLMG::mgVcycle_bottom 318 0.09921 0.1004 0.1045 1.63% MLMG::miniCycle() 212 0.09932 0.1001 0.101 1.57% MLMG::mgVcycle_up::0 106 0.09384 0.09449 0.09544 1.48% FillPatchIterator::Initialize 215 0.08741 0.09188 0.09539 1.48% FillBoundary_finish() 5552 0.04915 0.06872 0.08879 1.38% MLMG::computeResWithCrseSolFineCor() 106 0.07601 0.07746 0.07895 1.23% AmrLevel::AmrLevel(dm) 16 0.05176 0.05717 0.06557 1.02% StateData::define() 64 0.0516 0.05702 0.06545 1.02% MLCellLinOp::apply() 1040 0.06055 0.06193 0.06424 1.00% MLCellLinOp::correctionResidual() 755 0.05658 0.05978 0.06112 0.95% FillPatchSingleLevel 259 0.05059 0.05601 0.06034 0.94% FabArray::ParallelCopy_nowait() 2952 0.05111 0.05333 0.05956 0.93% MLCellLinOp::solutionResidual() 258 0.05343 0.05535 0.05816 0.90% MLCellLinOp::reflux() 138 0.05044 0.05193 0.05306 0.83% FillPatchIterator::FillFromTwoLevels() 126 0.04543 0.04947 0.05224 0.81% FillPatchTwoLevels 126 0.04531 0.04934 0.05211 0.81% Castro::init(old) 13 0.04504 0.04776 0.05066 0.79% FabArray::setVal() 1769 0.04251 0.04536 0.0491 0.76% FillBoundary_nowait() 5552 0.04079 0.04369 0.04768 0.74% MLMG::computeResWithCrseCorFineCor() 106 0.03083 0.03132 0.03174 0.49% MLMG::addInterpCorrection() 530 0.01932 0.029 0.0306 0.48% Castro::computeInitialDt() 1 0.02221 0.02484 0.02874 0.45% Castro::estTimeStep() 1 0.02221 0.02484 0.02874 0.45% MLMG::computeResidual() 106 0.02678 0.02764 0.02822 0.44% MLPoisson::Fapply() 1040 0.02346 0.02501 0.02639 0.41% FillPatchIterator::FillFromLevel0() 89 0.02397 0.02526 0.02593 0.40% MLMG::mgVcycle_down::1 106 0.02311 0.0242 0.02476 0.39% MLMG::computeMLResidual() 32 0.02201 0.02238 0.02279 0.35% MLCellLinOp::updateSolBC() 120 0.02024 0.02087 0.02144 0.33% MLMG::mgVcycle_up::2 106 0.008692 0.01915 0.02075 0.32% MLCellLinOp::updateCorBC() 106 0.01818 0.01905 0.01975 0.31% VisMF::Write(FabArray) 2 0.0171 0.01768 0.0197 0.31% MLMG::mgVcycle_up::1 106 0.01907 0.01917 0.01932 0.30% Gravity::get_new_grav_vector() 4 0.01781 0.01843 0.01903 0.30% MLMG:computeResOfCorrection() 530 0.01791 0.01848 0.01897 0.30% Castro::buildMetrics() 16 0.01269 0.01397 0.016 0.25% MLPoisson::define() 14 0.01159 0.0136 0.01543 0.24% FabArray::Xpay() 1013 0.01193 0.01272 0.01377 0.21% MultiFab::Multiply() 287 0.01271 0.01299 0.01344 0.21% MLPoisson::FFlux() 3408 0.0115 0.01202 0.01252 0.19% MLMG::interpCorrection_1 106 0.009907 0.01109 0.01224 0.19% amrex::Add() 575 0.01058 0.01122 0.01219 0.19% MLMG::ResNormInf() 152 0.009664 0.0102 0.01091 0.17% Castro::errorEst() 15 0.009579 0.009984 0.01053 0.16% MLMG::prepareForSolve() 14 0.009685 0.01001 0.01029 0.16% FillPatchInterp(MF) 44 0.001847 0.006809 0.01019 0.16% MLMG::mgVcycle_down::2 106 0.009126 0.009372 0.01009 0.16% Castro::apply_tagging_restrictions() 15 0.005829 0.006298 0.006835 0.11% FabArrayBase::getCPC() 3662 0.004983 0.005276 0.005646 0.09% MLCellLinOp::defineAuxData() 14 0.004999 0.005114 0.005468 0.09% MLLinOp::define() 14 0.001317 0.003282 0.005414 0.08% MLLinOp::defineGrids() 14 0.001299 0.003263 0.005391 0.08% MLCellLinOp::defineBC() 14 0.004943 0.005158 0.005294 0.08% FabArray::norminf(mask) 46 0.004822 0.004993 0.005158 0.08% MLMG::getGradSolution() 14 0.004729 0.004832 0.004974 0.08% MLCellLinOp::compGrad() 28 0.004711 0.004813 0.004956 0.08% Castro::sum_integrated_quantities() 1 0.004835 0.004852 0.004909 0.08% MLLinOp::makeSubCommunicator() 14 0.0009255 0.002858 0.004867 0.08% MLMG::mgVcycle_down::3 106 0.001393 0.001815 0.004479 0.07% MLMG::MLResNormInf() 32 0.003978 0.004078 0.004119 0.06% FabArray::norminf() 188 0.003047 0.003342 0.003805 0.06% MLMG::mgVcycle_up::3 106 0.000953 0.001308 0.003634 0.06% MLMG::actualBottomSolve() 106 2.108e-05 0.0004698 0.003602 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003205 0.003402 0.003578 0.06% MultiFab::max() 54 0.002758 0.003165 0.003496 0.05% BndryData::define() 42 0.003042 0.003158 0.003268 0.05% MLCGSolver::bicgstab 13 0 0.0004035 0.003228 0.05% Castro::enforce_min_density() 33 0.002415 0.002577 0.002785 0.04% MLMG::mgVcycle_down::4 106 0.001165 0.001362 0.002445 0.04% FabArrayBase::TheFPinfo() 49 0.0004205 0.001467 0.002368 0.04% average_down_faces 84 0.001972 0.002162 0.002344 0.04% FPinfo::FPinfo() 9 0.0003581 0.0014 0.002298 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0003307 0.001351 0.00224 0.03% FabArrayBase::CPC::define() 624 0.001572 0.001762 0.002036 0.03% MLMG::mgVcycle_up::4 106 0.001086 0.001227 0.001969 0.03% MLMG::MLRhsNormInf() 14 0.001771 0.001864 0.001932 0.03% Castro::volWgtSum() 46 0.001695 0.001734 0.001752 0.03% FabArray::mult() 34 0.00116 0.001371 0.00172 0.03% Castro::enforce_consistent_e() 3 0.0009527 0.001199 0.001433 0.02% FabArrayBase::getFB() 5552 0.001043 0.001116 0.00133 0.02% StateDataPhysBCFunct::() 259 0.001221 0.001275 0.001316 0.02% StateData::FillBoundary(geom) 8 0.001072 0.001111 0.001136 0.02% Gravity::update_max_rhs() 1 0.0006579 0.0008973 0.001067 0.02% AMRErrorTag::operator() 15 0.000926 0.0009387 0.0009547 0.01% Castro::build_fine_mask() 55 0.0006273 0.0006686 0.0007141 0.01% DistributionMapping::KnapSackDoIt() 2 3.654e-05 0.0003414 0.0006346 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004481 0.00047 0.0005051 0.01% MLPoisson::prepareForSolve() 14 0.0003754 0.0004079 0.0004816 0.01% MLCellLinOp::prepareForSolve() 14 0.000363 0.0003953 0.0004685 0.01% TagBoxArray::collate() 15 0.0002264 0.0002946 0.000392 0.01% MLCellLinOp::setLevelBC() 28 0.0003307 0.0003587 0.0003889 0.01% FabArray::setDomainBndry() 259 0.000326 0.000361 0.0003765 0.01% MLCGSolver::ParallelAllReduce 95 0 4.166e-05 0.0003333 0.01% Castro::locWgtSum() 6 0.0002053 0.0002118 0.0002222 0.00% FabArrayBase::FB::FB() 35 7.719e-05 9.545e-05 0.0001569 0.00% FabArray::Saxpy() 54 0 1.582e-05 0.0001265 0.00% amrex::Dot() 54 0 1.54e-05 0.0001232 0.00% AmrMesh-cluster 1 0 1.413e-05 0.000113 0.00% OwnerMask() 15 8.903e-05 9.965e-05 0.0001103 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 6.731e-05 8.187e-05 9.862e-05 0.00% Castro::volProductSum() 2 8.196e-05 8.75e-05 9.745e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.982e-05 7.971e-05 9.683e-05 0.00% makeSFC 42 4.74e-05 5.465e-05 6.916e-05 0.00% ClusterList::intersect() 1 0 8.466e-06 6.773e-05 0.00% Amr::writeSmallPlotFile() 1 3.234e-05 3.289e-05 3.344e-05 0.00% BoxList::parallelComplementIn() 30 2.096e-05 2.362e-05 2.725e-05 0.00% DistributionMapping::Distribute() 46 2.094e-05 2.255e-05 2.428e-05 0.00% FabArray::RecvLayoutMask() 14 1.534e-05 1.635e-05 1.743e-05 0.00% ClusterList::chop() 1 0 2.116e-06 1.693e-05 0.00% BoxList::complementIn 30 1.043e-05 1.244e-05 1.497e-05 0.00% knapsack() 2 1.117e-05 1.212e-05 1.395e-05 0.00% Castro::enforce_speed_limit() 33 1.039e-05 1.197e-05 1.318e-05 0.00% Amr::initSubcycle() 1 1.132e-05 1.159e-05 1.199e-05 0.00% Castro::apply_problem_tags() 15 7.273e-06 7.854e-06 9.022e-06 0.00% Gravity::set_mass_offset() 1 8.18e-07 2.729e-06 5.043e-06 0.00% Castro::gwstrain() 2 1.108e-06 1.239e-06 1.356e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 19 B 21 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.12-21-gef38229189e3) finalized