MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.10-8-gfd2dfa282a30) initialized Starting run at 13:39:23 UTC on 2023-10-08. Successfully read inputs file ... Castro git describe: 23.10-15-g80d1947e4 AMReX git describe: 23.10-8-gfd2dfa282 Microphysics git describe: 23.10-6-g657406dc reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.00264863 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.126025211 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001517674 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002866032 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002148398 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001097486 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001089539 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001392133 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002263415 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001110682 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00107758 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001283332 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002048272 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00150147 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001526827 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.24513074 seconds Ending run at 13:39:29 UTC on 2023-10-08. Run time = 6.576282497 Run time without initialization = 0.0003401989998 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.576 ... 6.576 ... 6.576 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2683 1.2683 1.2683 19.29% Gravity::fill_multipole_BCs() 14 1.136 1.153 1.166 17.73% Castro::post_init() 2 1.013 1.016 1.02 15.51% Castro::computeTemp() 36 0.6993 0.7448 0.8147 12.39% Castro::reset_internal_energy(Fab) 654 0.3897 0.4242 0.4635 7.05% FabArray::ParallelCopy_finish() 2952 0.1373 0.3194 0.4517 6.87% MLPoisson::Fsmooth() 5088 0.2327 0.2451 0.2516 3.83% Castro::normalize_species() 33 0.1616 0.175 0.1891 2.88% Castro::initData() 3 0.1159 0.1334 0.1528 2.32% AmrLevel::derive() 97 0.1396 0.1421 0.1457 2.21% amrex::Copy() 975 0.1305 0.1357 0.1437 2.18% Castro::initMFs() 16 0.1028 0.1191 0.1425 2.17% FillBoundary_finish() 5552 0.06256 0.07391 0.09492 1.44% StateData::define() 64 0.05106 0.05658 0.0657 1.00% FabArray::setVal() 1769 0.04176 0.0473 0.05309 0.81% amrex::average_down 844 0.04201 0.04661 0.05058 0.77% FillBoundary_nowait() 5552 0.039 0.04233 0.04492 0.68% MLCellLinOp::applyBC() 6294 0.03344 0.03606 0.03855 0.59% FabArray::ParallelCopy_nowait() 2952 0.02374 0.02834 0.03752 0.57% VisMF::Write(FabArray) 2 0.02952 0.03019 0.03301 0.50% Castro::estTimeStep() 1 0.02278 0.02531 0.0289 0.44% FillPatchIterator::Initialize 215 0.01608 0.01896 0.0263 0.40% MLPoisson::Fapply() 1040 0.02352 0.02499 0.02616 0.40% MLMG::addInterpCorrection() 530 0.01916 0.01961 0.01984 0.30% MLCellLinOp::reflux() 138 0.01746 0.01839 0.01914 0.29% Amr::regrid() 14 0.01263 0.01434 0.01711 0.26% Castro::buildMetrics() 16 0.01144 0.01277 0.01597 0.24% Castro::Castro() 16 0.008428 0.01074 0.01554 0.24% MultiFab::Multiply() 287 0.01194 0.01325 0.01393 0.21% FabArray::Xpay() 1013 0.01213 0.01301 0.01385 0.21% MLPoisson::FFlux() 3408 0.01126 0.01169 0.0123 0.19% MLCellLinOp::updateSolBC() 120 0.01045 0.01159 0.01228 0.19% amrex::Add() 575 0.01087 0.0113 0.01205 0.18% FillPatchInterp(MF) 44 0.001978 0.007525 0.01169 0.18% Amr::writePlotFile() 1 0.007005 0.01033 0.01121 0.17% MLCellLinOp::updateCorBC() 106 0.009501 0.01049 0.01107 0.17% MLLinOp::makeSubCommunicator() 14 0.002724 0.005564 0.008126 0.12% MLMG::interpCorrection_1 106 0.006305 0.007067 0.007543 0.11% AmrMesh::MakeNewGrids() 15 0.0063 0.006404 0.006536 0.10% Castro::apply_tagging_restrictions() 15 0.005582 0.005955 0.00625 0.10% MLMG::prepareForSolve() 14 0.004755 0.005051 0.005411 0.08% MLMG::ResNormInf() 152 0.003023 0.004017 0.004995 0.08% FabArray::norminf(mask) 46 0.004708 0.004806 0.004886 0.07% MLCellLinOp::compGrad() 28 0.003225 0.003807 0.004819 0.07% FabArrayBase::getCPC() 3662 0.003464 0.003761 0.004789 0.07% MLCellLinOp::defineAuxData() 14 0.003953 0.004143 0.004463 0.07% MultiFab::max() 54 0.00309 0.003695 0.004093 0.06% Castro::enforce_min_density() 33 0.003354 0.003603 0.003923 0.06% FabArray::norminf() 174 0.002914 0.003358 0.003734 0.06% Gravity::multilevel_solve_for_new_phi() 14 0.00263 0.003095 0.00356 0.05% BndryData::define() 42 0.002495 0.002554 0.002666 0.04% Gravity::get_new_grav_vector() 4 0.00206 0.002251 0.002562 0.04% Gravity::actual_solve_with_mlmg() 14 0.001969 0.002043 0.002257 0.03% FabArray::FillBoundary() 5552 0.001953 0.002053 0.002171 0.03% Castro::volWgtSum() 46 0.001674 0.00179 0.002088 0.03% MLCellLinOp::defineBC() 14 0.001863 0.001971 0.002039 0.03% FabArrayBase::CPC::define() 624 0.001589 0.001781 0.002027 0.03% MLCellLinOp::smooth() 2544 0.001657 0.001745 0.001855 0.03% DistributionMapping::LeastUsedCPUs() 9 7.407e-05 0.001195 0.00177 0.03% FabArray::mult() 34 0.001163 0.001409 0.001758 0.03% Castro::sum_integrated_quantities() 1 0.0004514 0.001281 0.001651 0.03% FillPatchTwoLevels 126 0.0007263 0.001156 0.001502 0.02% MLCGSolver::bicgstab 13 0 0.0001853 0.001482 0.02% FabArray::ParallelCopy() 2952 0.001188 0.001267 0.001345 0.02% StateData::FillBoundary(geom) 8 0.001226 0.001266 0.001335 0.02% Castro::enforce_consistent_e() 3 0.0009842 0.001102 0.001321 0.02% average_down_faces 84 0.001052 0.001173 0.001262 0.02% FabArrayBase::getFB() 5552 0.0009345 0.0009922 0.001108 0.02% Gravity::actual_multilevel_solve() 14 0.0007939 0.0009264 0.001094 0.02% AMRErrorTag::operator() 15 0.0009223 0.0009408 0.0009902 0.02% Castro::build_fine_mask() 55 0.0006495 0.0007034 0.0007881 0.01% MLMG::solve() 14 0.0005089 0.0006417 0.0007536 0.01% MLCellLinOp::apply() 1040 0.0004145 0.0004595 0.0005924 0.01% TagBoxArray::collate() 15 0.0002941 0.0003692 0.0005866 0.01% AmrLevel::FillPatch() 215 0.0005159 0.0005368 0.0005586 0.01% main() 1 0.0003506 0.0004131 0.0005286 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004667 0.0004813 0.0005065 0.01% MLCellLinOp::prepareForSolve() 14 0.0003675 0.0003911 0.0004909 0.01% Amr::grid_places() 15 0.0003321 0.0003627 0.0004833 0.01% MLCellLinOp::correctionResidual() 755 0.000387 0.0004164 0.000474 0.01% FabArray::setDomainBndry() 259 0.0003876 0.0004257 0.0004708 0.01% MLMG::mgVcycle() 318 0.0004174 0.000437 0.0004625 0.01% MLCellLinOp::setLevelBC() 28 0.0003319 0.0003554 0.0004143 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003118 0.0003449 0.0003958 0.01% MLLinOp::defineGrids() 14 0.0002591 0.0003095 0.0003668 0.01% MLMG::MLResNormInf() 32 0.0001627 0.000236 0.0003621 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002836 0.0003016 0.0003201 0.00% MLMG::oneIter() 106 0.0002711 0.0002917 0.0003175 0.00% MLMG::actualBottomSolve() 106 2.513e-05 5.601e-05 0.0002687 0.00% MLMG::mgVcycle_bottom 318 0.0002175 0.0002316 0.0002615 0.00% MLCGSolver::ParallelAllReduce 81 0 2.906e-05 0.0002325 0.00% Castro::locWgtSum() 6 0.0001823 0.0001933 0.0002061 0.00% MLCellLinOp::solutionResidual() 258 0.0001735 0.0001875 0.0002016 0.00% AmrLevel::AmrLevel(dm) 16 0.0001445 0.0001607 0.0001843 0.00% MLMG:computeResOfCorrection() 530 0.0001593 0.0001664 0.0001776 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001611 0.0001706 0.0001775 0.00% StateDataPhysBCFunct::() 259 0.0001526 0.0001609 0.0001719 0.00% MLMG::mgVcycle_down::0 106 0.000144 0.0001483 0.0001585 0.00% Gravity::update_max_rhs() 1 8.815e-05 0.0001152 0.0001577 0.00% FillPatchSingleLevel 259 0.0001444 0.0001507 0.0001567 0.00% FabArrayBase::FB::FB() 35 7.886e-05 9.523e-05 0.0001566 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001207 0.0001315 0.000144 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001208 0.00013 0.0001416 0.00% MLMG::mgVcycle_down::1 106 0.0001097 0.0001163 0.0001259 0.00% amrex::Dot() 54 0 1.562e-05 0.000125 0.00% Castro::post_regrid() 30 8.176e-05 9.847e-05 0.0001249 0.00% TagBoxArray::mapPRD 15 9.174e-05 9.844e-05 0.0001116 0.00% OwnerMask() 15 9.665e-05 0.0001035 0.0001115 0.00% Castro::clean_state() 33 6.515e-05 7.501e-05 0.0001035 0.00% MLMG::mgVcycle_down::2 106 8.372e-05 9.129e-05 0.0001025 0.00% FPinfo::FPinfo() 9 6.975e-05 8.405e-05 0.0001023 0.00% Amr::FinalizeInit() 1 2.124e-05 3.395e-05 0.0001017 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.485e-05 8.951e-05 0.0001013 0.00% Castro::volProductSum() 2 8.145e-05 8.793e-05 9.962e-05 0.00% MLMG::miniCycle() 212 8.199e-05 9e-05 9.947e-05 0.00% Castro::avgDown(state_indx) 60 7.462e-05 8.179e-05 9.785e-05 0.00% MLMG::mgVcycle_down::3 106 7.702e-05 8.426e-05 9.675e-05 0.00% Castro::derive() 97 6.567e-05 7.289e-05 8.902e-05 0.00% MLMG::mgVcycle_down::4 106 7.434e-05 7.782e-05 8.726e-05 0.00% FabArrayBase::TheFPinfo() 49 6.241e-05 7.215e-05 8.526e-05 0.00% MLMG::mgVcycle_up::2 106 5.423e-05 6.001e-05 8.373e-05 0.00% FabArray::LinComb() 27 0 1.035e-05 8.277e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.453e-05 7.166e-05 7.913e-05 0.00% FabArray::Saxpy() 27 0 9.677e-06 7.742e-05 0.00% Castro::errorEst() 15 5.006e-05 5.955e-05 7.563e-05 0.00% MLMG::computeResidual() 106 5.5e-05 6.194e-05 7.438e-05 0.00% MLMG::mgVcycle_up::4 106 6.217e-05 6.706e-05 7e-05 0.00% MLMG::mgVcycle_up::0 106 6.026e-05 6.466e-05 6.933e-05 0.00% MLMG::mgVcycle_up::1 106 5.628e-05 6.067e-05 6.685e-05 0.00% MLMG::mgVcycle_up::3 106 5.204e-05 5.665e-05 6.125e-05 0.00% ClusterList::intersect() 1 0 7.547e-06 6.038e-05 0.00% Castro::avgDown() 15 3.864e-05 4.399e-05 5.67e-05 0.00% Amr::defBaseLevel() 1 2.812e-05 3.909e-05 5.555e-05 0.00% makeSFC 42 2.858e-05 3.93e-05 5.539e-05 0.00% Castro::init(old) 13 4.357e-05 4.873e-05 5.41e-05 0.00% amrex::average_down_w_geom 60 4.587e-05 4.834e-05 5.239e-05 0.00% MLPoisson::define() 14 3.814e-05 4.125e-05 4.384e-05 0.00% MLMG::computeMLResidual() 32 3.651e-05 3.924e-05 4.166e-05 0.00% Amr::writeSmallPlotFile() 1 3.156e-05 3.364e-05 3.989e-05 0.00% Amr::bldFineLevels() 1 1.552e-05 2.535e-05 3.638e-05 0.00% BoxList::complementIn 30 1.153e-05 1.467e-05 2.908e-05 0.00% BoxList::parallelComplementIn() 30 1.179e-05 1.557e-05 2.872e-05 0.00% AmrMesh-cluster 1 0 3.524e-06 2.819e-05 0.00% DistributionMapping::Distribute() 46 2.164e-05 2.474e-05 2.8e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.053e-05 2.402e-05 2.67e-05 0.00% Amr::initialInit() 1 1.204e-06 5.397e-06 2.626e-05 0.00% MLLinOp::define() 14 1.56e-05 1.792e-05 2.378e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.518e-05 1.988e-05 2.278e-05 0.00% MLMG::getGradSolution() 14 1.738e-05 1.896e-05 2.061e-05 0.00% Castro::enforce_speed_limit() 33 1.253e-05 1.554e-05 1.976e-05 0.00% ClusterList::chop() 1 0 2.418e-06 1.934e-05 0.00% FabArray::RecvLayoutMask() 14 1.601e-05 1.668e-05 1.772e-05 0.00% knapsack() 2 1.04e-05 1.168e-05 1.443e-05 0.00% MLPoisson::prepareForSolve() 14 1.083e-05 1.28e-05 1.361e-05 0.00% Amr::initSubcycle() 1 9.157e-06 9.646e-06 1.01e-05 0.00% MLMG::MLRhsNormInf() 14 7.95e-06 8.603e-06 9.847e-06 0.00% Castro::apply_problem_tags() 15 7.938e-06 8.884e-06 9.719e-06 0.00% Amr::init() 1 1.872e-06 2.901e-06 6.552e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.55e-06 4.804e-06 5.006e-06 0.00% Amr::InitializeInit() 1 2.212e-06 3.014e-06 4.955e-06 0.00% Gravity::set_mass_offset() 1 8.61e-07 1.823e-06 4.949e-06 0.00% Castro::computeInitialDt() 1 2.009e-06 2.348e-06 2.74e-06 0.00% Castro::gwstrain() 2 1.053e-06 1.269e-06 1.555e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.576 6.576 6.576 100.00% Amr::init() 1 5.307 5.307 5.307 80.71% Amr::initialInit() 1 5.062 5.062 5.062 76.98% Amr::FinalizeInit() 1 4.954 4.957 4.961 75.43% Castro::post_init() 2 3.693 3.806 3.883 59.04% Gravity::multilevel_solve_for_new_phi() 14 1.808 1.827 1.839 27.97% Gravity::actual_multilevel_solve() 14 1.805 1.824 1.836 27.93% Gravity::solve_phi_with_mlmg() 14 1.798 1.818 1.83 27.83% Amr::regrid() 14 1.259 1.286 1.308 19.88% Castro::computeTemp() 36 1.089 1.169 1.278 19.44% Amr::InitAmr() 1 1.268 1.268 1.268 19.29% Castro::clean_state() 33 1.054 1.122 1.204 18.31% Gravity::fill_multipole_BCs() 14 1.138 1.154 1.168 17.76% Amr::bldFineLevels() 1 0.9099 0.9711 1.06 16.12% Castro::post_regrid() 30 0.8156 0.8527 0.891 13.55% Castro::initData() 3 0.5743 0.642 0.7519 11.43% Gravity::actual_solve_with_mlmg() 14 0.6598 0.6627 0.6653 10.12% MLMG::solve() 14 0.6372 0.6378 0.6383 9.71% MLMG::oneIter() 106 0.5616 0.5624 0.5632 8.56% FabArray::ParallelCopy() 2952 0.195 0.3762 0.5051 7.68% Castro::reset_internal_energy(MultiFab) 36 0.39 0.4245 0.4638 7.05% Castro::reset_internal_energy(Fab) 654 0.3897 0.4242 0.4635 7.05% FabArray::ParallelCopy_finish() 2952 0.1373 0.3194 0.4517 6.87% MLMG::mgVcycle() 318 0.4244 0.426 0.4269 6.49% MLCellLinOp::smooth() 2544 0.3527 0.3551 0.3611 5.49% amrex::average_down 844 0.08355 0.1935 0.2677 4.07% MLPoisson::Fsmooth() 5088 0.2327 0.2451 0.2516 3.83% Amr::writePlotFile() 1 0.2453 0.2454 0.2454 3.73% Castro::avgDown() 15 0.05147 0.1624 0.2379 3.62% Castro::avgDown(state_indx) 60 0.05142 0.1623 0.2378 3.62% amrex::average_down_w_geom 60 0.05132 0.1622 0.2377 3.62% Castro::derive() 97 0.205 0.2053 0.2058 3.13% AmrLevel::derive() 97 0.2049 0.2052 0.2058 3.13% Castro::normalize_species() 33 0.1616 0.175 0.1891 2.88% Castro::Castro() 16 0.146 0.1644 0.1879 2.86% MLCellLinOp::applyBC() 6294 0.1468 0.1554 0.171 2.60% AmrLevel::FillPatch() 215 0.1507 0.1608 0.168 2.55% Amr::grid_places() 15 0.02153 0.09799 0.147 2.24% AmrMesh::MakeNewGrids() 15 0.02116 0.09763 0.1467 2.23% amrex::Copy() 975 0.1305 0.1357 0.1437 2.18% Castro::initMFs() 16 0.1028 0.1191 0.1425 2.17% FillPatchIterator::Initialize 215 0.1236 0.135 0.142 2.16% FabArray::FillBoundary() 5552 0.1098 0.1194 0.137 2.08% TagBoxArray::mapPRD 15 0.004834 0.08088 0.1297 1.97% MLMG::mgVcycle_down::0 106 0.1193 0.1199 0.1206 1.83% MLMG::mgVcycle_bottom 318 0.1136 0.1154 0.1192 1.81% MLMG::miniCycle() 212 0.1137 0.115 0.1156 1.76% MLMG::mgVcycle_up::0 106 0.1092 0.1097 0.1102 1.68% Amr::InitializeInit() 1 0.1015 0.105 0.1076 1.64% Amr::defBaseLevel() 1 0.1014 0.105 0.1076 1.64% FillPatchSingleLevel 259 0.07764 0.09128 0.1061 1.61% FillBoundary_finish() 5552 0.06256 0.07391 0.09492 1.44% FillPatchIterator::FillFromTwoLevels() 126 0.06637 0.08482 0.09273 1.41% FillPatchTwoLevels 126 0.06624 0.08469 0.09261 1.41% Castro::init(old) 13 0.0727 0.08408 0.09008 1.37% MLMG::computeResWithCrseSolFineCor() 106 0.07476 0.07596 0.07724 1.17% AmrLevel::AmrLevel(dm) 16 0.0512 0.05674 0.06586 1.00% StateData::define() 64 0.05106 0.05658 0.0657 1.00% MLCellLinOp::apply() 1040 0.05945 0.06229 0.06436 0.98% FabArray::ParallelCopy_nowait() 2952 0.05064 0.05561 0.06416 0.98% MLCellLinOp::correctionResidual() 755 0.05806 0.05972 0.06104 0.93% MLCellLinOp::solutionResidual() 258 0.05653 0.05789 0.06004 0.91% MLCellLinOp::reflux() 138 0.04975 0.05197 0.05318 0.81% FabArray::setVal() 1769 0.04176 0.0473 0.05309 0.81% FillBoundary_nowait() 5552 0.04008 0.04342 0.04597 0.70% FillPatchIterator::FillFromLevel0() 89 0.02595 0.03082 0.03387 0.52% MLMG::addInterpCorrection() 530 0.02122 0.03152 0.03321 0.50% VisMF::Write(FabArray) 2 0.02952 0.03019 0.03301 0.50% MLMG::computeResWithCrseCorFineCor() 106 0.03156 0.03217 0.03263 0.50% MLMG::computeResidual() 106 0.02763 0.02934 0.03005 0.46% Castro::computeInitialDt() 1 0.02279 0.02531 0.0289 0.44% Castro::estTimeStep() 1 0.02278 0.02531 0.0289 0.44% MLPoisson::Fapply() 1040 0.02352 0.02499 0.02616 0.40% MLMG::mgVcycle_down::1 106 0.02442 0.02495 0.02528 0.38% MLCellLinOp::updateSolBC() 120 0.02156 0.02243 0.02377 0.36% MLMG::computeMLResidual() 32 0.02195 0.02295 0.02359 0.36% MLMG::mgVcycle_up::2 106 0.008834 0.01955 0.02127 0.32% MLMG::mgVcycle_up::1 106 0.02087 0.02098 0.02108 0.32% MLCellLinOp::updateCorBC() 106 0.01851 0.01933 0.02008 0.31% Gravity::get_new_grav_vector() 4 0.01877 0.01928 0.01995 0.30% MLMG:computeResOfCorrection() 530 0.0185 0.01926 0.01979 0.30% MLPoisson::define() 14 0.01328 0.01643 0.01864 0.28% Castro::buildMetrics() 16 0.01291 0.01442 0.01783 0.27% MultiFab::Multiply() 287 0.01194 0.01325 0.01393 0.21% FabArray::Xpay() 1013 0.01213 0.01301 0.01385 0.21% MLMG::interpCorrection_1 106 0.01069 0.0114 0.0124 0.19% MLPoisson::FFlux() 3408 0.01126 0.01169 0.0123 0.19% amrex::Add() 575 0.01087 0.0113 0.01205 0.18% FillPatchInterp(MF) 44 0.001978 0.007525 0.01169 0.18% MLMG::ResNormInf() 152 0.009706 0.01038 0.01126 0.17% MLMG::prepareForSolve() 14 0.00938 0.01014 0.01054 0.16% MLMG::mgVcycle_down::2 106 0.009258 0.009439 0.01028 0.16% Castro::errorEst() 15 0.009405 0.009703 0.01026 0.16% MLLinOp::define() 14 0.003101 0.005973 0.008612 0.13% MLLinOp::defineGrids() 14 0.003085 0.005956 0.008594 0.13% MLLinOp::makeSubCommunicator() 14 0.002724 0.005564 0.008126 0.12% FabArrayBase::getCPC() 3662 0.005053 0.005542 0.006466 0.10% MLMG::getGradSolution() 14 0.005784 0.006058 0.006277 0.10% MLCellLinOp::compGrad() 28 0.005766 0.006039 0.006259 0.10% Castro::apply_tagging_restrictions() 15 0.005582 0.005955 0.00625 0.10% Castro::sum_integrated_quantities() 1 0.005537 0.005726 0.005835 0.09% MLCellLinOp::defineAuxData() 14 0.004986 0.005203 0.005543 0.08% MLCellLinOp::defineBC() 14 0.004997 0.005213 0.005332 0.08% FabArray::norminf(mask) 46 0.004708 0.004806 0.004886 0.07% MLMG::mgVcycle_down::3 106 0.00135 0.001782 0.004498 0.07% MultiFab::max() 54 0.00309 0.003695 0.004093 0.06% MLMG::MLResNormInf() 32 0.003767 0.003909 0.004051 0.06% Castro::enforce_min_density() 33 0.003354 0.003603 0.003923 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003377 0.003592 0.003804 0.06% MLMG::actualBottomSolve() 106 2.513e-05 0.000491 0.003749 0.06% FabArray::norminf() 174 0.002914 0.003358 0.003734 0.06% MLMG::mgVcycle_up::3 106 0.0009353 0.001296 0.003626 0.06% MLCGSolver::bicgstab 13 0 0.0004285 0.003428 0.05% BndryData::define() 42 0.003026 0.003116 0.003256 0.05% average_down_faces 84 0.002044 0.002279 0.00243 0.04% MLMG::mgVcycle_down::4 106 0.00118 0.001368 0.002414 0.04% Castro::volWgtSum() 46 0.001678 0.001795 0.002094 0.03% FabArrayBase::CPC::define() 624 0.001589 0.001781 0.002027 0.03% FabArrayBase::TheFPinfo() 49 0.0002124 0.001328 0.001908 0.03% MLMG::mgVcycle_up::4 106 0.00111 0.00123 0.001901 0.03% MLMG::MLRhsNormInf() 14 0.001724 0.0018 0.001861 0.03% FPinfo::FPinfo() 9 0.000136 0.001256 0.001833 0.03% DistributionMapping::LeastUsedCPUs() 9 7.407e-05 0.001195 0.00177 0.03% FabArray::mult() 34 0.001163 0.001409 0.001758 0.03% StateDataPhysBCFunct::() 259 0.001378 0.001427 0.001492 0.02% StateData::FillBoundary(geom) 8 0.001226 0.001266 0.001335 0.02% Castro::enforce_consistent_e() 3 0.0009842 0.001102 0.001321 0.02% FabArrayBase::getFB() 5552 0.001017 0.001087 0.001265 0.02% Gravity::update_max_rhs() 1 0.0006282 0.0009719 0.001193 0.02% AMRErrorTag::operator() 15 0.0009223 0.0009408 0.0009902 0.02% Castro::build_fine_mask() 55 0.0006495 0.0007034 0.0007881 0.01% DistributionMapping::KnapSackDoIt() 2 3.824e-05 0.0003137 0.0006812 0.01% TagBoxArray::collate() 15 0.0002941 0.0003692 0.0005866 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004667 0.0004813 0.0005065 0.01% MLPoisson::prepareForSolve() 14 0.0003783 0.0004039 0.0005041 0.01% MLCellLinOp::prepareForSolve() 14 0.0003675 0.0003911 0.0004909 0.01% FabArray::setDomainBndry() 259 0.0003876 0.0004257 0.0004708 0.01% MLCellLinOp::setLevelBC() 28 0.0003319 0.0003554 0.0004143 0.01% MLCGSolver::ParallelAllReduce 81 0 3.812e-05 0.000305 0.00% Castro::locWgtSum() 6 0.0001827 0.0001938 0.0002067 0.00% FabArrayBase::FB::FB() 35 7.886e-05 9.523e-05 0.0001566 0.00% amrex::Dot() 54 0 1.562e-05 0.000125 0.00% OwnerMask() 15 9.665e-05 0.0001035 0.0001115 0.00% AmrMesh-cluster 1 0 1.349e-05 0.0001079 0.00% MLLinOp::makeAgglomeratedDMap 14 6.602e-05 8.2e-05 0.0001012 0.00% Castro::volProductSum() 2 8.162e-05 8.812e-05 9.985e-05 0.00% FabArray::LinComb() 27 0 1.035e-05 8.277e-05 0.00% FabArray::Saxpy() 27 0 9.677e-06 7.742e-05 0.00% makeSFC 42 4.549e-05 5.798e-05 7.527e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.377e-05 6.541e-05 7.241e-05 0.00% ClusterList::intersect() 1 0 7.547e-06 6.038e-05 0.00% BoxList::parallelComplementIn() 30 2.435e-05 3.024e-05 4.292e-05 0.00% Amr::writeSmallPlotFile() 1 3.156e-05 3.364e-05 3.989e-05 0.00% BoxList::complementIn 30 1.153e-05 1.467e-05 2.908e-05 0.00% DistributionMapping::Distribute() 46 2.164e-05 2.474e-05 2.8e-05 0.00% Castro::enforce_speed_limit() 33 1.253e-05 1.554e-05 1.976e-05 0.00% ClusterList::chop() 1 0 2.418e-06 1.934e-05 0.00% FabArray::RecvLayoutMask() 14 1.601e-05 1.668e-05 1.772e-05 0.00% knapsack() 2 1.04e-05 1.168e-05 1.443e-05 0.00% Amr::initSubcycle() 1 9.157e-06 9.646e-06 1.01e-05 0.00% Castro::apply_problem_tags() 15 7.938e-06 8.884e-06 9.719e-06 0.00% Gravity::set_mass_offset() 1 8.61e-07 1.823e-06 4.949e-06 0.00% Castro::gwstrain() 2 1.053e-06 1.269e-06 1.555e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 15 B 23 B 42 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-8-gfd2dfa282a30) finalized