MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.08-29-g3291c074b67a) initialized Starting run at 07:02:33 UTC on 2023-08-14. Successfully read inputs file ... Castro git describe: 23.08-4-gba9dfc263 AMReX git describe: 23.08-29-g3291c074b Microphysics git describe: 23.08-7-g783d1a02 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002792267 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.116249069 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001406963 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001984834 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001052467 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001034641 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00102725 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001057028 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001065665 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001107559 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001107785 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001082822 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00107878 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001077012 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001091745 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.236443593 seconds Ending run at 07:02:40 UTC on 2023-08-14. Run time = 6.267810395 Run time without initialization = 0.000272104 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.268 ... 6.268 ... 6.268 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1164 1.1305 1.1421 18.22% Amr::InitAmr() 1 1.142 1.142 1.142 18.22% Castro::post_init() 2 0.9661 0.9677 0.9683 15.45% Castro::computeTemp() 36 0.6944 0.7389 0.8004 12.77% Castro::reset_internal_energy(Fab) 654 0.3903 0.4178 0.4557 7.27% FabArray::ParallelCopy_finish() 2952 0.06589 0.2601 0.3884 6.20% MLPoisson::Fsmooth() 5088 0.2338 0.239 0.2487 3.97% Castro::normalize_species() 33 0.1644 0.1738 0.1874 2.99% Castro::initData() 3 0.1143 0.1288 0.1507 2.40% AmrLevel::derive() 97 0.1387 0.1411 0.1438 2.29% amrex::Copy() 975 0.1318 0.1337 0.1366 2.18% Castro::initMFs() 16 0.0978 0.1087 0.1258 2.01% FillBoundary_finish() 5552 0.05656 0.06753 0.07774 1.24% StateData::define() 64 0.05602 0.06238 0.07204 1.15% FabArray::setVal() 1769 0.04242 0.04625 0.05293 0.84% amrex::average_down 844 0.04325 0.04661 0.05064 0.81% FillBoundary_nowait() 5552 0.03916 0.04219 0.04465 0.71% MLCellLinOp::applyBC() 6294 0.03247 0.03482 0.03744 0.60% VisMF::Write(FabArray) 2 0.03037 0.03092 0.03321 0.53% FabArray::ParallelCopy_nowait() 2952 0.02365 0.0262 0.03141 0.50% Castro::estTimeStep() 1 0.02203 0.02605 0.02982 0.48% MLPoisson::Fapply() 1040 0.02418 0.025 0.02626 0.42% Amr::regrid() 14 0.01471 0.01651 0.02047 0.33% MLMG::addInterpCorrection() 530 0.01937 0.01959 0.01995 0.32% FillPatchIterator::Initialize 215 0.0152 0.0166 0.01749 0.28% MLCellLinOp::reflux() 138 0.01666 0.0169 0.01722 0.27% Castro::buildMetrics() 16 0.0122 0.01362 0.0157 0.25% FabArray::Xpay() 1013 0.01217 0.01277 0.01343 0.21% MultiFab::Multiply() 287 0.01264 0.01294 0.01338 0.21% MLPoisson::FFlux() 3408 0.01117 0.01153 0.0128 0.20% amrex::Add() 575 0.01069 0.01133 0.01225 0.20% MLCellLinOp::updateSolBC() 120 0.01069 0.01148 0.01203 0.19% Castro::Castro() 16 0.008665 0.009654 0.01126 0.18% MLCellLinOp::updateCorBC() 106 0.009506 0.01029 0.01081 0.17% FillPatchInterp(MF) 44 0.001909 0.007202 0.01072 0.17% Amr::writePlotFile() 1 0.005578 0.00803 0.008603 0.14% MLMG::interpCorrection_1 106 0.006343 0.006964 0.007588 0.12% AmrMesh::MakeNewGrids() 15 0.006212 0.006277 0.006338 0.10% Castro::apply_tagging_restrictions() 15 0.005563 0.00582 0.006063 0.10% MLMG::prepareForSolve() 14 0.004822 0.004949 0.005244 0.08% MLLinOp::makeSubCommunicator() 14 0.001696 0.003148 0.005002 0.08% FabArray::norminf(mask) 46 0.004705 0.004806 0.004931 0.08% MLMG::ResNormInf() 152 0.002901 0.003657 0.004336 0.07% MLCellLinOp::defineAuxData() 14 0.003803 0.003912 0.004076 0.07% FabArray::norminf() 174 0.002995 0.00329 0.003646 0.06% FabArrayBase::getCPC() 3662 0.003424 0.003498 0.003572 0.06% Gravity::multilevel_solve_for_new_phi() 14 0.002681 0.003051 0.003567 0.06% MultiFab::max() 54 0.00283 0.003204 0.003552 0.06% MLCellLinOp::compGrad() 28 0.003224 0.003328 0.003414 0.05% Castro::enforce_min_density() 33 0.002707 0.002868 0.003076 0.05% MLMG::MLResNormInf() 32 0.0001757 0.0009947 0.002669 0.04% BndryData::define() 42 0.002265 0.002345 0.002452 0.04% Gravity::get_new_grav_vector() 4 0.001742 0.002064 0.002414 0.04% Gravity::actual_solve_with_mlmg() 14 0.001922 0.002012 0.002244 0.04% FabArray::FillBoundary() 5552 0.001925 0.002007 0.002147 0.03% MLCellLinOp::defineBC() 14 0.001806 0.001919 0.001999 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0001773 0.001311 0.001992 0.03% FabArrayBase::CPC::define() 624 0.001579 0.001705 0.00195 0.03% MLCellLinOp::smooth() 2544 0.001647 0.001705 0.001783 0.03% Castro::volWgtSum() 46 0.001704 0.001719 0.001737 0.03% FabArray::mult() 34 0.001135 0.001303 0.001557 0.02% MLCGSolver::bicgstab 13 0 0.0001795 0.001436 0.02% FillPatchTwoLevels 126 0.0006765 0.001085 0.001404 0.02% Castro::enforce_consistent_e() 3 0.001005 0.001156 0.001348 0.02% FabArray::ParallelCopy() 2952 0.00122 0.001261 0.001309 0.02% StateData::FillBoundary(geom) 8 0.00122 0.001252 0.001286 0.02% average_down_faces 84 0.001063 0.001158 0.00127 0.02% FabArrayBase::getFB() 5552 0.0009336 0.00101 0.001123 0.02% Gravity::actual_multilevel_solve() 14 0.000799 0.0009046 0.001005 0.02% AMRErrorTag::operator() 15 0.0009399 0.0009516 0.0009797 0.02% Castro::build_fine_mask() 55 0.0007009 0.0007808 0.0009175 0.01% Castro::sum_integrated_quantities() 1 0.0005976 0.0006633 0.000709 0.01% MLMG::solve() 14 0.0004141 0.0004986 0.0006246 0.01% MLCellLinOp::apply() 1040 0.0004259 0.0004633 0.0006165 0.01% AmrLevel::FillPatch() 215 0.0005042 0.0005222 0.0005402 0.01% TagBoxArray::collate() 15 0.0002415 0.0003277 0.0005379 0.01% main() 1 0.000445 0.0004846 0.000534 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004644 0.0004781 0.0005072 0.01% Amr::grid_places() 15 0.0002968 0.0003494 0.0004857 0.01% MLMG::mgVcycle() 318 0.000423 0.0004552 0.0004822 0.01% MLCellLinOp::prepareForSolve() 14 0.0003488 0.0003795 0.0004711 0.01% MLCellLinOp::correctionResidual() 755 0.0003789 0.0003974 0.0004456 0.01% FabArray::setDomainBndry() 259 0.0003763 0.0004049 0.000426 0.01% Castro::reset_internal_energy(MultiFab) 36 0.000291 0.0003382 0.0004218 0.01% MLCellLinOp::setLevelBC() 28 0.0003271 0.0003486 0.0003775 0.01% MLLinOp::defineGrids() 14 0.0002602 0.0002973 0.0003374 0.01% MLMG::oneIter() 106 0.0002787 0.0002944 0.0003219 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002709 0.000282 0.0003003 0.00% MLMG::mgVcycle_bottom 318 0.0002218 0.0002374 0.0002604 0.00% MLMG::actualBottomSolve() 106 2.052e-05 5.171e-05 0.0002528 0.00% MLCGSolver::ParallelAllReduce 81 0 3.045e-05 0.0002436 0.00% MLCellLinOp::solutionResidual() 258 0.0001771 0.000188 0.0002108 0.00% Castro::locWgtSum() 6 0.000186 0.000191 0.0001979 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001625 0.0001728 0.0001875 0.00% AmrLevel::AmrLevel(dm) 16 0.0001509 0.0001697 0.0001842 0.00% StateDataPhysBCFunct::() 259 0.0001431 0.0001596 0.0001783 0.00% MLMG:computeResOfCorrection() 530 0.0001596 0.0001659 0.000175 0.00% MLMG::mgVcycle_down::0 106 0.0001388 0.0001448 0.0001556 0.00% FillPatchSingleLevel 259 0.0001368 0.0001462 0.0001533 0.00% MLMG::miniCycle() 212 9.595e-05 0.0001251 0.0001438 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001168 0.0001237 0.0001334 0.00% FabArrayBase::FB::FB() 35 7.686e-05 8.708e-05 0.0001317 0.00% Gravity::update_max_rhs() 1 7.544e-05 0.0001033 0.0001291 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001211 0.0001254 0.0001286 0.00% amrex::Dot() 54 0 1.481e-05 0.0001184 0.00% FPinfo::FPinfo() 9 6.904e-05 8.199e-05 0.0001184 0.00% MLMG::mgVcycle_down::1 106 0.0001077 0.0001108 0.0001169 0.00% Amr::FinalizeInit() 1 6.801e-06 2.937e-05 0.0001144 0.00% OwnerMask() 15 8.914e-05 0.0001028 0.0001103 0.00% TagBoxArray::mapPRD 15 9.179e-05 9.772e-05 0.0001038 0.00% MLMG::computeResWithCrseCorFineCor() 106 7.876e-05 8.44e-05 9.71e-05 0.00% Castro::post_regrid() 30 5.857e-05 7.853e-05 9.3e-05 0.00% Castro::errorEst() 15 4.488e-05 5.946e-05 9.296e-05 0.00% Castro::volProductSum() 2 8.298e-05 8.69e-05 9.294e-05 0.00% MLMG::mgVcycle_down::2 106 8.467e-05 8.78e-05 9.261e-05 0.00% MLMG::mgVcycle_down::3 106 7.645e-05 8.497e-05 9.11e-05 0.00% MLMG::mgVcycle_down::4 106 7.002e-05 7.717e-05 8.779e-05 0.00% Castro::derive() 97 6.232e-05 7.034e-05 8.546e-05 0.00% Castro::avgDown(state_indx) 60 6.536e-05 7.143e-05 8.145e-05 0.00% FabArray::Saxpy() 27 0 1.004e-05 8.036e-05 0.00% FabArray::LinComb() 27 0 9.916e-06 7.933e-05 0.00% Castro::clean_state() 33 6.049e-05 6.924e-05 7.579e-05 0.00% MLMG::mgVcycle_up::0 106 6.909e-05 7.173e-05 7.426e-05 0.00% FabArrayBase::TheFPinfo() 49 6.1e-05 6.748e-05 7.42e-05 0.00% MLMG::mgVcycle_up::4 106 6.461e-05 6.866e-05 7.338e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.367e-05 6.69e-05 7.056e-05 0.00% MLMG::mgVcycle_up::3 106 5.47e-05 5.847e-05 6.687e-05 0.00% MLMG::mgVcycle_up::1 106 5.871e-05 6.13e-05 6.315e-05 0.00% MLMG::computeResidual() 106 5.657e-05 5.908e-05 6.144e-05 0.00% amrex::average_down_w_geom 60 3.93e-05 4.539e-05 5.742e-05 0.00% ClusterList::intersect() 1 0 7.171e-06 5.737e-05 0.00% MLMG::mgVcycle_up::2 106 5.462e-05 5.607e-05 5.71e-05 0.00% Castro::init(old) 13 4.547e-05 4.988e-05 5.701e-05 0.00% MLPoisson::define() 14 3.905e-05 4.226e-05 5.142e-05 0.00% MLMG::computeMLResidual() 32 3.688e-05 4.218e-05 4.933e-05 0.00% makeSFC 42 2.715e-05 3.285e-05 4.231e-05 0.00% Amr::defBaseLevel() 1 1.593e-05 2.892e-05 4.133e-05 0.00% Castro::avgDown() 15 3.467e-05 3.838e-05 4.03e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.806e-05 2.671e-05 3.877e-05 0.00% Amr::writeSmallPlotFile() 1 2.965e-05 3.042e-05 3.149e-05 0.00% BoxList::parallelComplementIn() 30 1.044e-05 1.524e-05 2.823e-05 0.00% BoxList::complementIn 30 1.155e-05 1.721e-05 2.758e-05 0.00% MLLinOp::define() 14 1.669e-05 1.927e-05 2.694e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.186e-05 2.406e-05 2.678e-05 0.00% AmrMesh-cluster 1 0 3.327e-06 2.661e-05 0.00% DistributionMapping::Distribute() 46 1.967e-05 2.212e-05 2.451e-05 0.00% MLMG::getGradSolution() 14 1.671e-05 1.853e-05 2.112e-05 0.00% FabArray::RecvLayoutMask() 14 1.596e-05 1.698e-05 1.888e-05 0.00% knapsack() 2 1.049e-05 1.242e-05 1.832e-05 0.00% Amr::bldFineLevels() 1 1.356e-05 1.615e-05 1.786e-05 0.00% ClusterList::chop() 1 0 1.959e-06 1.567e-05 0.00% MLPoisson::prepareForSolve() 14 1.26e-05 1.352e-05 1.472e-05 0.00% Castro::enforce_speed_limit() 33 1.073e-05 1.239e-05 1.3e-05 0.00% Amr::initSubcycle() 1 8.353e-06 9.876e-06 1.094e-05 0.00% Castro::apply_problem_tags() 15 7.916e-06 8.795e-06 9.499e-06 0.00% Amr::init() 1 1.473e-06 2.875e-06 9.235e-06 0.00% MLMG::MLRhsNormInf() 14 7.447e-06 8.19e-06 8.507e-06 0.00% Castro::gwstrain() 2 1.039e-06 2.076e-06 7.393e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.239e-06 4.697e-06 5.108e-06 0.00% Amr::InitializeInit() 1 1.772e-06 2.582e-06 4.472e-06 0.00% Gravity::set_mass_offset() 1 8.96e-07 2.288e-06 3.834e-06 0.00% Castro::computeInitialDt() 1 1.71e-06 2.36e-06 2.841e-06 0.00% Amr::initialInit() 1 1.194e-06 1.37e-06 1.715e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.268 6.268 6.268 100.00% Amr::init() 1 5.125 5.125 5.125 81.77% Amr::initialInit() 1 4.888 4.889 4.889 78.00% Amr::FinalizeInit() 1 4.776 4.78 4.784 76.33% Castro::post_init() 2 3.545 3.654 3.725 59.43% Gravity::multilevel_solve_for_new_phi() 14 1.765 1.781 1.792 28.60% Gravity::actual_multilevel_solve() 14 1.762 1.778 1.789 28.54% Gravity::solve_phi_with_mlmg() 14 1.756 1.772 1.783 28.44% Castro::computeTemp() 36 1.085 1.157 1.256 20.04% Amr::regrid() 14 1.2 1.216 1.24 19.78% Castro::clean_state() 33 1.049 1.105 1.183 18.87% Gravity::fill_multipole_BCs() 14 1.118 1.132 1.144 18.25% Amr::InitAmr() 1 1.142 1.142 1.142 18.22% Amr::bldFineLevels() 1 0.8926 0.9499 1.037 16.55% Castro::post_regrid() 30 0.8099 0.8371 0.8753 13.96% Castro::initData() 3 0.5689 0.6391 0.7429 11.85% Gravity::actual_solve_with_mlmg() 14 0.6375 0.6389 0.6408 10.22% MLMG::solve() 14 0.6162 0.6172 0.6185 9.87% MLMG::oneIter() 106 0.5435 0.5442 0.5447 8.69% Castro::reset_internal_energy(MultiFab) 36 0.3906 0.4181 0.4562 7.28% Castro::reset_internal_energy(Fab) 654 0.3903 0.4178 0.4557 7.27% FabArray::ParallelCopy() 2952 0.1258 0.3147 0.4415 7.04% MLMG::mgVcycle() 318 0.4079 0.4088 0.4097 6.54% FabArray::ParallelCopy_finish() 2952 0.06589 0.2601 0.3884 6.20% MLCellLinOp::smooth() 2544 0.3378 0.3399 0.3457 5.51% amrex::average_down 844 0.07566 0.1858 0.257 4.10% MLPoisson::Fsmooth() 5088 0.2338 0.239 0.2487 3.97% Amr::writePlotFile() 1 0.2366 0.2367 0.2368 3.78% Castro::avgDown() 15 0.04604 0.1561 0.2281 3.64% Castro::avgDown(state_indx) 60 0.046 0.1561 0.228 3.64% amrex::average_down_w_geom 60 0.04592 0.156 0.2279 3.64% Castro::derive() 97 0.1984 0.1987 0.199 3.17% AmrLevel::derive() 97 0.1984 0.1986 0.1989 3.17% Castro::normalize_species() 33 0.1644 0.1738 0.1874 2.99% Castro::Castro() 16 0.1373 0.1522 0.1723 2.75% MLCellLinOp::applyBC() 6294 0.1406 0.1476 0.1554 2.48% amrex::Copy() 975 0.1318 0.1337 0.1366 2.18% Amr::grid_places() 15 0.01909 0.08799 0.1329 2.12% AmrMesh::MakeNewGrids() 15 0.01872 0.08764 0.1326 2.11% Castro::initMFs() 16 0.0978 0.1087 0.1258 2.01% FabArray::FillBoundary() 5552 0.1031 0.1128 0.1229 1.96% AmrLevel::FillPatch() 215 0.1143 0.1173 0.1217 1.94% TagBoxArray::mapPRD 15 0.002331 0.07114 0.116 1.85% MLMG::mgVcycle_down::0 106 0.1126 0.1134 0.1144 1.82% MLMG::mgVcycle_bottom 318 0.1077 0.1092 0.1135 1.81% Amr::InitializeInit() 1 0.1043 0.1081 0.1121 1.79% Amr::defBaseLevel() 1 0.1043 0.1081 0.1121 1.79% MLMG::miniCycle() 212 0.1079 0.1089 0.1101 1.76% MLMG::mgVcycle_up::0 106 0.1044 0.1047 0.105 1.67% FillPatchIterator::Initialize 215 0.08883 0.09163 0.09608 1.53% FillBoundary_finish() 5552 0.05656 0.06753 0.07774 1.24% MLMG::computeResWithCrseSolFineCor() 106 0.07451 0.07596 0.07701 1.23% AmrLevel::AmrLevel(dm) 16 0.05619 0.06255 0.07223 1.15% StateData::define() 64 0.05602 0.06238 0.07204 1.15% MLCellLinOp::apply() 1040 0.05923 0.06079 0.06238 1.00% FillPatchSingleLevel 259 0.05162 0.05537 0.06026 0.96% MLCellLinOp::correctionResidual() 755 0.05688 0.0587 0.05998 0.96% FabArray::ParallelCopy_nowait() 2952 0.04976 0.05332 0.05857 0.93% MLCellLinOp::solutionResidual() 258 0.05271 0.05472 0.05621 0.90% MLCellLinOp::reflux() 138 0.05146 0.05272 0.0539 0.86% FabArray::setVal() 1769 0.04242 0.04625 0.05293 0.84% FillPatchIterator::FillFromTwoLevels() 126 0.04462 0.0484 0.05147 0.82% FillPatchTwoLevels 126 0.0445 0.04827 0.05134 0.82% Castro::init(old) 13 0.04375 0.04666 0.04949 0.79% FillBoundary_nowait() 5552 0.0402 0.04328 0.04574 0.73% MLMG::addInterpCorrection() 530 0.02143 0.03157 0.03323 0.53% VisMF::Write(FabArray) 2 0.03037 0.03092 0.03321 0.53% MLMG::computeResWithCrseCorFineCor() 106 0.03047 0.0313 0.0318 0.51% Castro::computeInitialDt() 1 0.02203 0.02605 0.02982 0.48% Castro::estTimeStep() 1 0.02203 0.02605 0.02982 0.48% MLMG::computeResidual() 106 0.02669 0.02786 0.02841 0.45% FillPatchIterator::FillFromLevel0() 89 0.0242 0.02628 0.02787 0.44% MLPoisson::Fapply() 1040 0.02418 0.025 0.02626 0.42% MLMG::mgVcycle_down::1 106 0.0229 0.02325 0.02373 0.38% MLMG::computeMLResidual() 32 0.02076 0.02195 0.02259 0.36% MLCellLinOp::updateSolBC() 120 0.01959 0.02043 0.02113 0.34% MLMG::mgVcycle_up::2 106 0.008559 0.01936 0.02099 0.33% MLMG::mgVcycle_up::1 106 0.02042 0.02055 0.02067 0.33% MLMG:computeResOfCorrection() 530 0.01837 0.01967 0.02007 0.32% MLCellLinOp::updateCorBC() 106 0.01801 0.01892 0.01961 0.31% Gravity::get_new_grav_vector() 4 0.0174 0.01835 0.01897 0.30% Castro::buildMetrics() 16 0.01355 0.01516 0.01736 0.28% MLPoisson::define() 14 0.01207 0.0135 0.01523 0.24% FabArray::Xpay() 1013 0.01217 0.01277 0.01343 0.21% MultiFab::Multiply() 287 0.01264 0.01294 0.01338 0.21% MLMG::mgVcycle_down::2 106 0.01217 0.01235 0.01323 0.21% MLPoisson::FFlux() 3408 0.01117 0.01153 0.0128 0.20% amrex::Add() 575 0.01069 0.01133 0.01225 0.20% MLMG::interpCorrection_1 106 0.009626 0.01061 0.01173 0.19% FillPatchInterp(MF) 44 0.001909 0.007202 0.01072 0.17% MLMG::ResNormInf() 152 0.0093 0.009969 0.01058 0.17% MLMG::prepareForSolve() 14 0.009609 0.009939 0.01045 0.17% Castro::errorEst() 15 0.009302 0.009624 0.009873 0.16% MLMG::getGradSolution() 14 0.004519 0.005817 0.006512 0.10% MLCellLinOp::compGrad() 28 0.004498 0.005799 0.006496 0.10% MLMG::MLResNormInf() 32 0.003898 0.004665 0.006271 0.10% Castro::apply_tagging_restrictions() 15 0.005563 0.00582 0.006063 0.10% FabArrayBase::getCPC() 3662 0.005048 0.005203 0.005503 0.09% MLLinOp::define() 14 0.002052 0.003538 0.00543 0.09% MLLinOp::defineGrids() 14 0.002033 0.003519 0.005411 0.09% MLCellLinOp::defineAuxData() 14 0.004831 0.004972 0.005277 0.08% MLCellLinOp::defineBC() 14 0.004887 0.004945 0.005062 0.08% Castro::sum_integrated_quantities() 1 0.004933 0.004961 0.005047 0.08% MLLinOp::makeSubCommunicator() 14 0.001696 0.003148 0.005002 0.08% FabArray::norminf(mask) 46 0.004705 0.004806 0.004931 0.08% MLMG::mgVcycle_down::3 106 0.001336 0.001743 0.004467 0.07% MLMG::actualBottomSolve() 106 2.052e-05 0.0004793 0.003674 0.06% FabArray::norminf() 174 0.002995 0.00329 0.003646 0.06% MLMG::mgVcycle_up::3 106 0.0009196 0.00128 0.003636 0.06% MultiFab::max() 54 0.00283 0.003204 0.003552 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003214 0.003359 0.00351 0.06% MLCGSolver::bicgstab 13 0 0.000421 0.003368 0.05% Castro::enforce_min_density() 33 0.002707 0.002868 0.003076 0.05% BndryData::define() 42 0.002808 0.002898 0.002989 0.05% MLMG::mgVcycle_down::4 106 0.001149 0.001326 0.002387 0.04% average_down_faces 84 0.001938 0.002061 0.002148 0.03% FabArrayBase::TheFPinfo() 49 0.0003013 0.001419 0.002112 0.03% FPinfo::FPinfo() 9 0.0002398 0.001351 0.002038 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0001773 0.001311 0.001992 0.03% FabArrayBase::CPC::define() 624 0.001579 0.001705 0.00195 0.03% MLMG::mgVcycle_up::4 106 0.001081 0.001207 0.001903 0.03% MLMG::MLRhsNormInf() 14 0.001737 0.00178 0.001821 0.03% Castro::volWgtSum() 46 0.001709 0.001725 0.001743 0.03% FabArray::mult() 34 0.001135 0.001303 0.001557 0.02% StateDataPhysBCFunct::() 259 0.001367 0.001412 0.001452 0.02% Castro::enforce_consistent_e() 3 0.001005 0.001156 0.001348 0.02% StateData::FillBoundary(geom) 8 0.00122 0.001252 0.001286 0.02% FabArrayBase::getFB() 5552 0.001016 0.001097 0.001255 0.02% Gravity::update_max_rhs() 1 0.0006338 0.0008953 0.001126 0.02% AMRErrorTag::operator() 15 0.0009399 0.0009516 0.0009797 0.02% Castro::build_fine_mask() 55 0.0007009 0.0007808 0.0009175 0.01% DistributionMapping::KnapSackDoIt() 2 4.617e-05 0.0003609 0.0007113 0.01% TagBoxArray::collate() 15 0.0002415 0.0003277 0.0005379 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004644 0.0004781 0.0005072 0.01% MLPoisson::prepareForSolve() 14 0.0003616 0.000393 0.000484 0.01% MLCellLinOp::prepareForSolve() 14 0.0003488 0.0003795 0.0004711 0.01% FabArray::setDomainBndry() 259 0.0003763 0.0004049 0.000426 0.01% MLCellLinOp::setLevelBC() 28 0.0003271 0.0003486 0.0003775 0.01% MLCGSolver::ParallelAllReduce 81 0 3.898e-05 0.0003118 0.00% Castro::locWgtSum() 6 0.0001865 0.0001915 0.0001985 0.00% FabArrayBase::FB::FB() 35 7.686e-05 8.708e-05 0.0001317 0.00% amrex::Dot() 54 0 1.481e-05 0.0001184 0.00% OwnerMask() 15 8.914e-05 0.0001028 0.0001103 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 6.177e-05 9.053e-05 0.0001034 0.00% AmrMesh-cluster 1 0 1.246e-05 9.965e-05 0.00% Castro::volProductSum() 2 8.323e-05 8.711e-05 9.32e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.349e-05 7.36e-05 8.778e-05 0.00% FabArray::Saxpy() 27 0 1.004e-05 8.036e-05 0.00% FabArray::LinComb() 27 0 9.916e-06 7.933e-05 0.00% makeSFC 42 4.141e-05 4.955e-05 6.1e-05 0.00% ClusterList::intersect() 1 0 7.171e-06 5.737e-05 0.00% BoxList::parallelComplementIn() 30 2.224e-05 3.245e-05 5.052e-05 0.00% Amr::writeSmallPlotFile() 1 2.965e-05 3.042e-05 3.149e-05 0.00% BoxList::complementIn 30 1.155e-05 1.721e-05 2.758e-05 0.00% DistributionMapping::Distribute() 46 1.967e-05 2.212e-05 2.451e-05 0.00% FabArray::RecvLayoutMask() 14 1.596e-05 1.698e-05 1.888e-05 0.00% knapsack() 2 1.049e-05 1.242e-05 1.832e-05 0.00% ClusterList::chop() 1 0 1.959e-06 1.567e-05 0.00% Castro::enforce_speed_limit() 33 1.073e-05 1.239e-05 1.3e-05 0.00% Amr::initSubcycle() 1 8.353e-06 9.876e-06 1.094e-05 0.00% Castro::apply_problem_tags() 15 7.916e-06 8.795e-06 9.499e-06 0.00% Castro::gwstrain() 2 1.039e-06 2.076e-06 7.393e-06 0.00% Gravity::set_mass_offset() 1 8.96e-07 2.288e-06 3.834e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 20 B 28 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.08-29-g3291c074b67a) finalized