MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.04-24-g27ef4ea56945) initialized Starting run at 06:37:22 UTC on 2023-04-14. Successfully read inputs file ... Castro git describe: 23.04-11-gdc5a63a14 AMReX git describe: 23.04-24-g27ef4ea56 Microphysics git describe: 23.04-4-gabda4ae3 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002644472 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.11985054 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001448272 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001822751 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001154859 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001207597 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001131116 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001130535 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001139227 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001119295 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001135823 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001155521 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001189366 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001139479 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002939709 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225826e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 2.373778793e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.284381237e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.577115472e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.235256756 seconds Ending run at 06:37:28 UTC on 2023-04-14. Run time = 6.392267296 Run time without initialization = 0.0002713200001 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.392 ... 6.392 ... 6.392 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1925 1.2054 1.2216 19.11% Amr::InitAmr() 1 1.186 1.186 1.186 18.56% Castro::post_init() 2 0.9596 0.9608 0.962 15.05% Castro::computeTemp() 36 0.6894 0.7377 0.8106 12.68% Castro::reset_internal_energy(Fab) 654 0.3887 0.4178 0.462 7.23% FabArray::ParallelCopy_finish() 2952 0.05463 0.2735 0.404 6.32% MLPoisson::Fsmooth() 5088 0.2359 0.2444 0.257 4.02% Castro::normalize_species() 33 0.1643 0.1726 0.186 2.91% Castro::initData() 3 0.1163 0.1302 0.1528 2.39% Castro::derive() 97 0.1383 0.1401 0.1436 2.25% amrex::Copy() 975 0.1325 0.1346 0.1373 2.15% Castro::initMFs() 16 0.09866 0.1089 0.1263 1.98% FillBoundary_finish() 5552 0.05345 0.06864 0.08193 1.28% StateData::define() 64 0.05665 0.06241 0.07187 1.12% amrex::average_down 844 0.04107 0.04434 0.05098 0.80% FabArray::setVal() 1769 0.04172 0.0453 0.04906 0.77% FillBoundary_nowait() 5552 0.0399 0.04188 0.04669 0.73% MLCellLinOp::applyBC() 6294 0.03495 0.03632 0.0398 0.62% VisMF::Write(FabArray) 2 0.0307 0.03128 0.03352 0.52% FabArray::ParallelCopy_nowait() 2952 0.02368 0.02608 0.03137 0.49% MLPoisson::Fapply() 1040 0.02371 0.02485 0.02675 0.42% Castro::estTimeStep() 1 0.02196 0.02388 0.02577 0.40% Amr::regrid() 14 0.01453 0.0162 0.01945 0.30% MLCellLinOp::reflux() 138 0.01763 0.01793 0.01823 0.29% FillPatchIterator::Initialize 215 0.01585 0.01697 0.0177 0.28% MLMG::addInterpCorrection() 530 0.01687 0.01707 0.01756 0.27% Castro::buildMetrics() 16 0.01232 0.01364 0.01565 0.24% FabArray::Xpay() 1013 0.01199 0.0127 0.01348 0.21% MultiFab::Multiply() 287 0.01228 0.01292 0.01343 0.21% MLCellLinOp::updateSolBC() 120 0.01054 0.01151 0.01278 0.20% amrex::Add() 575 0.01078 0.01125 0.01208 0.19% MLPoisson::FFlux() 3408 0.01093 0.01114 0.01135 0.18% Castro::Castro() 16 0.008703 0.00951 0.01113 0.17% MLCellLinOp::updateCorBC() 106 0.009527 0.01039 0.01086 0.17% FillPatchInterp(MF) 44 0.001685 0.006533 0.009812 0.15% Amr::writePlotFile() 1 0.0055 0.008089 0.008787 0.14% MLMG::interpCorrection_1 106 0.006278 0.007044 0.008518 0.13% AmrMesh::MakeNewGrids() 15 0.007463 0.007582 0.007724 0.12% MLLinOp::makeSubCommunicator() 14 0.002779 0.004236 0.006357 0.10% Castro::apply_tagging_restrictions() 15 0.005653 0.005886 0.006241 0.10% MLMG::ResNormInf() 152 0.002833 0.003709 0.005093 0.08% MLMG::prepareForSolve() 14 0.004618 0.004932 0.005075 0.08% FabArray::norminf(mask) 46 0.004725 0.004749 0.004768 0.07% MLCellLinOp::defineAuxData() 14 0.00386 0.003921 0.004093 0.06% FabArray::norminf() 174 0.002983 0.00325 0.003615 0.06% FabArrayBase::getCPC() 3662 0.003393 0.003474 0.003533 0.06% MLCellLinOp::compGrad() 28 0.003236 0.003338 0.003445 0.05% MultiFab::max() 54 0.002788 0.003172 0.003436 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002547 0.002875 0.003079 0.05% Castro::enforce_min_density() 33 0.002524 0.002643 0.002872 0.04% BndryData::define() 42 0.002251 0.002359 0.002421 0.04% Gravity::get_new_grav_vector() 4 0.001831 0.002117 0.002406 0.04% Gravity::actual_solve_with_mlmg() 14 0.001859 0.002002 0.002234 0.03% FabArray::FillBoundary() 5552 0.001914 0.001986 0.002201 0.03% MLCellLinOp::defineBC() 14 0.001817 0.001937 0.002011 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0001421 0.001235 0.001971 0.03% FabArrayBase::CPC::define() 624 0.001602 0.001729 0.001927 0.03% MLCellLinOp::smooth() 2544 0.001668 0.001729 0.001817 0.03% Castro::volWgtSum() 46 0.001692 0.001718 0.001735 0.03% FabArray::mult() 34 0.001158 0.001333 0.001659 0.03% MLCGSolver::bicgstab 13 0 0.0001832 0.001465 0.02% FillPatchTwoLevels 126 0.0006615 0.001104 0.001428 0.02% Castro::enforce_consistent_e() 3 0.00106 0.001179 0.001372 0.02% FabArray::ParallelCopy() 2952 0.001152 0.00118 0.001267 0.02% StateData::FillBoundary(geom) 8 0.001112 0.001163 0.001211 0.02% FabArrayBase::getFB() 5552 0.001049 0.001093 0.001206 0.02% average_down_faces 84 0.001037 0.001123 0.001201 0.02% AMRErrorTag::operator() 15 0.0009278 0.0009585 0.0009935 0.02% Gravity::actual_multilevel_solve() 14 0.00076 0.0008433 0.000971 0.02% Castro::sum_integrated_quantities() 1 0.000698 0.0007727 0.0009502 0.01% Castro::build_fine_mask() 55 0.0006248 0.0007052 0.000775 0.01% MLMG::solve() 14 0.0003941 0.0004902 0.0006356 0.01% MLCellLinOp::apply() 1040 0.0004251 0.0004597 0.0005946 0.01% MLCGSolver::ParallelAllReduce 81 0 6.994e-05 0.0005595 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004578 0.0004794 0.0004988 0.01% MLCellLinOp::prepareForSolve() 14 0.0003614 0.0003878 0.0004682 0.01% MLCellLinOp::correctionResidual() 755 0.0003829 0.0004068 0.0004653 0.01% main() 1 0.0003917 0.0004128 0.0004621 0.01% Amr::grid_places() 15 0.0003539 0.0003767 0.0004584 0.01% FabArray::setDomainBndry() 259 0.0003865 0.0004162 0.0004459 0.01% MLMG::mgVcycle() 318 0.0004039 0.0004205 0.0004436 0.01% MLCellLinOp::setLevelBC() 28 0.0003264 0.0003504 0.0003766 0.01% MLLinOp::defineGrids() 14 0.0002819 0.0003211 0.0003694 0.01% Castro::reset_internal_energy(MultiFab) 36 0.000271 0.0003197 0.000367 0.01% TagBoxArray::collate() 15 0.0002471 0.0002874 0.0003265 0.01% MLMG::MLResNormInf() 32 0.000175 0.0002349 0.0002934 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002593 0.0002743 0.0002925 0.00% MLMG::oneIter() 106 0.0002639 0.0002775 0.0002895 0.00% MLMG::actualBottomSolve() 106 2.254e-05 5.184e-05 0.0002443 0.00% MLMG::mgVcycle_bottom 318 0.0002041 0.0002216 0.0002347 0.00% MLCellLinOp::solutionResidual() 258 0.0001841 0.0001898 0.0001971 0.00% Castro::locWgtSum() 6 0.0001855 0.0001879 0.0001966 0.00% FillPatchSingleLevel 259 0.0001625 0.0001675 0.0001837 0.00% MLMG:computeResOfCorrection() 530 0.0001538 0.0001626 0.0001774 0.00% Castro::init(old) 13 0.0001539 0.0001649 0.0001727 0.00% StateDataPhysBCFunct::() 259 0.0001403 0.0001504 0.0001695 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001494 0.0001547 0.0001636 0.00% AmrLevel::AmrLevel(dm) 16 0.0001229 0.0001452 0.0001571 0.00% MLMG::mgVcycle_down::0 106 0.0001289 0.0001341 0.00014 0.00% FabArrayBase::FB::FB() 35 7.91e-05 9.284e-05 0.0001317 0.00% Gravity::update_max_rhs() 1 9.307e-05 0.000106 0.0001265 0.00% amrex::Dot() 54 0 1.532e-05 0.0001225 0.00% MLMG::mgVcycle_down::1 106 0.000107 0.0001128 0.0001178 0.00% OwnerMask() 15 8.766e-05 0.0001008 0.0001105 0.00% FPinfo::FPinfo() 9 7.865e-05 9.011e-05 0.0001081 0.00% TagBoxArray::mapPRD 15 9.155e-05 9.544e-05 0.0001013 0.00% MLMG::miniCycle() 212 8.371e-05 8.858e-05 9.769e-05 0.00% MLMG::mgVcycle_down::3 106 7.229e-05 8.239e-05 9.654e-05 0.00% Amr::FinalizeInit() 1 7.037e-06 2.555e-05 9.542e-05 0.00% MLMG::mgVcycle_down::2 106 7.972e-05 8.392e-05 9.193e-05 0.00% Castro::volProductSum() 2 7.983e-05 8.554e-05 8.924e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.286e-05 8.569e-05 8.723e-05 0.00% Castro::post_regrid() 30 6.178e-05 7.261e-05 8.616e-05 0.00% FabArray::LinComb() 27 0 1.005e-05 8.042e-05 0.00% MLMG::mgVcycle_down::4 106 6.754e-05 7.145e-05 7.838e-05 0.00% MLMG::mgVcycle_up::1 106 5.749e-05 6.156e-05 7.67e-05 0.00% MLMG::mgVcycle_up::4 106 6.336e-05 6.721e-05 7.535e-05 0.00% FabArray::Saxpy() 27 0 9.404e-06 7.523e-05 0.00% Castro::avgDown(state_indx) 60 5.596e-05 6.302e-05 7.477e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.055e-05 6.678e-05 7.417e-05 0.00% MLMG::mgVcycle_up::0 106 6.57e-05 6.698e-05 7.069e-05 0.00% Amr::defBaseLevel() 1 2.284e-05 5.131e-05 6.903e-05 0.00% MLMG::computeResidual() 106 5.73e-05 6.026e-05 6.9e-05 0.00% Castro::clean_state() 33 6.069e-05 6.394e-05 6.882e-05 0.00% FabArrayBase::TheFPinfo() 49 6.132e-05 6.424e-05 6.704e-05 0.00% Castro::errorEst() 15 4.456e-05 5.072e-05 6.641e-05 0.00% ClusterList::intersect() 1 0 8.048e-06 6.439e-05 0.00% amrex::average_down_w_geom 60 4.756e-05 5.414e-05 6.255e-05 0.00% MLMG::mgVcycle_up::2 106 5.109e-05 5.313e-05 6.12e-05 0.00% MLMG::mgVcycle_up::3 106 5.258e-05 5.529e-05 6.117e-05 0.00% Castro::avgDown() 15 3.642e-05 4.006e-05 5.653e-05 0.00% MLMG::computeMLResidual() 32 3.746e-05 4.286e-05 5.396e-05 0.00% MLPoisson::define() 14 3.175e-05 3.826e-05 5.006e-05 0.00% makeSFC 42 2.781e-05 3.453e-05 4.387e-05 0.00% Amr::initSubcycle() 1 8.95e-06 1.338e-05 3.442e-05 0.00% Amr::writeSmallPlotFile() 1 2.788e-05 3.007e-05 3.101e-05 0.00% MLLinOp::define() 14 2.054e-05 2.463e-05 2.946e-05 0.00% BoxList::parallelComplementIn() 30 1.064e-05 1.344e-05 2.817e-05 0.00% DistributionMapping::Distribute() 46 2.321e-05 2.58e-05 2.784e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.104e-05 2.358e-05 2.754e-05 0.00% AmrMesh-cluster 1 0 3.391e-06 2.713e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.653e-05 2.098e-05 2.403e-05 0.00% MLMG::getGradSolution() 14 1.819e-05 1.878e-05 2.036e-05 0.00% Amr::bldFineLevels() 1 1.675e-05 1.779e-05 1.891e-05 0.00% ClusterList::chop() 1 0 2.18e-06 1.744e-05 0.00% MLPoisson::prepareForSolve() 14 1.245e-05 1.462e-05 1.719e-05 0.00% FabArray::RecvLayoutMask() 14 1.564e-05 1.622e-05 1.657e-05 0.00% Castro::enforce_speed_limit() 33 1.04e-05 1.206e-05 1.539e-05 0.00% BoxList::complementIn 30 1.031e-05 1.242e-05 1.469e-05 0.00% knapsack() 2 1.033e-05 1.124e-05 1.242e-05 0.00% MLMG::MLRhsNormInf() 14 7.799e-06 8.268e-06 8.944e-06 0.00% Amr::InitializeInit() 1 2.142e-06 3.599e-06 8.579e-06 0.00% Castro::apply_problem_tags() 15 5.785e-06 6.405e-06 6.843e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.264e-06 4.858e-06 6.361e-06 0.00% Castro::computeInitialDt() 1 1.762e-06 2.26e-06 3.125e-06 0.00% Amr::initialInit() 1 1.23e-06 1.546e-06 2.065e-06 0.00% Amr::init() 1 1.539e-06 1.745e-06 2.025e-06 0.00% Castro::gwstrain() 2 1.075e-06 1.302e-06 1.805e-06 0.00% Gravity::set_mass_offset() 1 8.39e-07 1.095e-06 1.366e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.392 6.392 6.392 100.00% Amr::init() 1 5.206 5.206 5.206 81.44% Amr::initialInit() 1 4.97 4.97 4.97 77.75% Amr::FinalizeInit() 1 4.86 4.862 4.864 76.09% Castro::post_init() 2 3.617 3.732 3.805 59.53% Gravity::multilevel_solve_for_new_phi() 14 1.851 1.862 1.877 29.37% Gravity::actual_multilevel_solve() 14 1.848 1.859 1.874 29.32% Gravity::solve_phi_with_mlmg() 14 1.842 1.853 1.868 29.22% Castro::computeTemp() 36 1.078 1.156 1.273 19.91% Amr::regrid() 14 1.203 1.22 1.24 19.40% Gravity::fill_multipole_BCs() 14 1.194 1.207 1.223 19.14% Castro::clean_state() 33 1.045 1.104 1.195 18.69% Amr::InitAmr() 1 1.186 1.186 1.186 18.56% Amr::bldFineLevels() 1 0.8956 0.9546 1.048 16.39% Castro::post_regrid() 30 0.804 0.8351 0.8781 13.74% Castro::initData() 3 0.5683 0.6397 0.7521 11.77% Gravity::actual_solve_with_mlmg() 14 0.6436 0.6451 0.6476 10.13% MLMG::solve() 14 0.6229 0.6235 0.6238 9.76% MLMG::oneIter() 106 0.551 0.5517 0.5522 8.64% Castro::reset_internal_energy(MultiFab) 36 0.389 0.4181 0.4623 7.23% Castro::reset_internal_energy(Fab) 654 0.3887 0.4178 0.462 7.23% FabArray::ParallelCopy() 2952 0.1142 0.328 0.4566 7.14% MLMG::mgVcycle() 318 0.4155 0.4169 0.4186 6.55% FabArray::ParallelCopy_finish() 2952 0.05463 0.2735 0.404 6.32% MLCellLinOp::smooth() 2544 0.3456 0.3488 0.3559 5.57% amrex::average_down 844 0.07574 0.1913 0.264 4.13% MLPoisson::Fsmooth() 5088 0.2359 0.2444 0.257 4.02% Amr::writePlotFile() 1 0.2354 0.2355 0.2356 3.69% Castro::avgDown() 15 0.04611 0.1614 0.2336 3.65% Castro::avgDown(state_indx) 60 0.04606 0.1613 0.2336 3.65% amrex::average_down_w_geom 60 0.04599 0.1613 0.2335 3.65% Castro::derive() 97 0.1968 0.197 0.1973 3.09% Castro::normalize_species() 33 0.1643 0.1726 0.186 2.91% Castro::Castro() 16 0.1384 0.1519 0.1744 2.73% MLCellLinOp::applyBC() 6294 0.1425 0.15 0.1604 2.51% Amr::grid_places() 15 0.02148 0.09333 0.1378 2.16% AmrMesh::MakeNewGrids() 15 0.02109 0.09295 0.1374 2.15% amrex::Copy() 975 0.1325 0.1346 0.1373 2.15% Castro::initMFs() 16 0.09866 0.1089 0.1263 1.98% FabArray::FillBoundary() 5552 0.1037 0.1137 0.1254 1.96% TagBoxArray::mapPRD 15 0.003216 0.07519 0.1199 1.88% MLMG::mgVcycle_down::0 106 0.1169 0.1177 0.1182 1.85% MLMG::mgVcycle_bottom 318 0.1112 0.1131 0.1176 1.84% MLMG::miniCycle() 212 0.1114 0.1127 0.1142 1.79% Amr::InitializeInit() 1 0.1065 0.1084 0.1103 1.73% Amr::defBaseLevel() 1 0.1065 0.1084 0.1103 1.73% MLMG::mgVcycle_up::0 106 0.1051 0.1054 0.1058 1.66% FillPatchIterator::Initialize 215 0.08821 0.0913 0.09386 1.47% FillBoundary_finish() 5552 0.05345 0.06864 0.08193 1.28% MLMG::computeResWithCrseSolFineCor() 106 0.07313 0.0748 0.07606 1.19% AmrLevel::AmrLevel(dm) 16 0.0568 0.06255 0.072 1.13% StateData::define() 64 0.05665 0.06241 0.07187 1.12% MLCellLinOp::apply() 1040 0.06092 0.06345 0.06569 1.03% MLCellLinOp::correctionResidual() 755 0.05856 0.05953 0.06239 0.98% MLCellLinOp::solutionResidual() 258 0.05502 0.05778 0.06026 0.94% FillPatchSingleLevel 259 0.05186 0.05613 0.05999 0.94% FabArray::ParallelCopy_nowait() 2952 0.05145 0.05326 0.0583 0.91% FillPatchTwoLevels 126 0.04556 0.04824 0.05065 0.79% MLCellLinOp::reflux() 138 0.04735 0.04899 0.05005 0.78% Castro::init(old) 13 0.04472 0.04694 0.04917 0.77% FabArray::setVal() 1769 0.04172 0.0453 0.04906 0.77% FillBoundary_nowait() 5552 0.04107 0.04306 0.04803 0.75% VisMF::Write(FabArray) 2 0.0307 0.03128 0.03352 0.52% MLMG::computeResWithCrseCorFineCor() 106 0.03147 0.03253 0.03315 0.52% MLMG::addInterpCorrection() 530 0.01904 0.0296 0.03125 0.49% MLMG::computeResidual() 106 0.02616 0.02809 0.0287 0.45% MLPoisson::Fapply() 1040 0.02371 0.02485 0.02675 0.42% Castro::computeInitialDt() 1 0.02196 0.02388 0.02577 0.40% Castro::estTimeStep() 1 0.02196 0.02388 0.02577 0.40% MLMG::mgVcycle_down::1 106 0.02412 0.02515 0.02574 0.40% MLMG::computeMLResidual() 32 0.02095 0.02149 0.02195 0.34% MLMG::mgVcycle_up::2 106 0.008875 0.01995 0.02164 0.34% MLCellLinOp::updateSolBC() 120 0.01974 0.02057 0.02141 0.33% MLCellLinOp::updateCorBC() 106 0.01805 0.02005 0.02098 0.33% MLMG::mgVcycle_up::1 106 0.02041 0.02048 0.02056 0.32% MLMG:computeResOfCorrection() 530 0.01811 0.0188 0.02013 0.31% Gravity::get_new_grav_vector() 4 0.0178 0.01807 0.0187 0.29% Castro::buildMetrics() 16 0.01362 0.01515 0.01742 0.27% MLPoisson::define() 14 0.01318 0.01465 0.01669 0.26% FabArray::Xpay() 1013 0.01199 0.0127 0.01348 0.21% MultiFab::Multiply() 287 0.01228 0.01292 0.01343 0.21% MLMG::interpCorrection_1 106 0.009802 0.01092 0.01233 0.19% amrex::Add() 575 0.01078 0.01125 0.01208 0.19% MLMG::ResNormInf() 152 0.0093 0.009932 0.01139 0.18% MLPoisson::FFlux() 3408 0.01093 0.01114 0.01135 0.18% MLMG::prepareForSolve() 14 0.009564 0.009807 0.01009 0.16% Castro::errorEst() 15 0.009368 0.009637 0.01008 0.16% MLMG::mgVcycle_down::2 106 0.009045 0.009208 0.009954 0.16% FillPatchInterp(MF) 44 0.001685 0.006533 0.009812 0.15% MLLinOp::define() 14 0.003151 0.004659 0.006833 0.11% MLLinOp::defineGrids() 14 0.00313 0.004635 0.006806 0.11% MLLinOp::makeSubCommunicator() 14 0.002779 0.004236 0.006357 0.10% Castro::apply_tagging_restrictions() 15 0.005653 0.005886 0.006241 0.10% FabArrayBase::getCPC() 3662 0.004994 0.005203 0.005426 0.08% MLCellLinOp::defineAuxData() 14 0.004877 0.004967 0.005289 0.08% MLCellLinOp::defineBC() 14 0.004786 0.004985 0.005117 0.08% Castro::sum_integrated_quantities() 1 0.004994 0.005036 0.005077 0.08% FabArray::norminf(mask) 46 0.004725 0.004749 0.004768 0.07% MLMG::getGradSolution() 14 0.004564 0.004653 0.004736 0.07% MLCellLinOp::compGrad() 28 0.004546 0.004634 0.004718 0.07% MLMG::mgVcycle_down::3 106 0.00127 0.001738 0.004566 0.07% MLMG::actualBottomSolve() 106 2.254e-05 0.0005253 0.004032 0.06% MLMG::MLResNormInf() 32 0.003768 0.003861 0.003939 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003456 0.003618 0.003913 0.06% MLCGSolver::bicgstab 13 0 0.0004672 0.003738 0.06% MLMG::mgVcycle_up::3 106 0.0008914 0.001258 0.003641 0.06% FabArray::norminf() 174 0.002983 0.00325 0.003615 0.06% MultiFab::max() 54 0.002788 0.003172 0.003436 0.05% BndryData::define() 42 0.002805 0.002919 0.003004 0.05% Castro::enforce_min_density() 33 0.002524 0.002643 0.002872 0.04% average_down_faces 84 0.002042 0.002237 0.002458 0.04% MLMG::mgVcycle_down::4 106 0.001118 0.001302 0.002419 0.04% FabArrayBase::TheFPinfo() 49 0.0002155 0.001321 0.002068 0.03% FPinfo::FPinfo() 9 0.0001524 0.001256 0.002001 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0001421 0.001235 0.001971 0.03% FabArrayBase::CPC::define() 624 0.001602 0.001729 0.001927 0.03% MLMG::mgVcycle_up::4 106 0.001057 0.001191 0.001921 0.03% MLMG::MLRhsNormInf() 14 0.001732 0.001771 0.00181 0.03% Castro::volWgtSum() 46 0.001697 0.001723 0.00174 0.03% FabArray::mult() 34 0.001158 0.001333 0.001659 0.03% Castro::enforce_consistent_e() 3 0.00106 0.001179 0.001372 0.02% StateDataPhysBCFunct::() 259 0.001281 0.001313 0.001357 0.02% FabArrayBase::getFB() 5552 0.001134 0.001186 0.001338 0.02% StateData::FillBoundary(geom) 8 0.001112 0.001163 0.001211 0.02% Gravity::update_max_rhs() 1 0.0006277 0.0009393 0.001086 0.02% AMRErrorTag::operator() 15 0.0009278 0.0009585 0.0009935 0.02% Castro::build_fine_mask() 55 0.0006248 0.0007052 0.000775 0.01% MLCGSolver::ParallelAllReduce 81 0 7.877e-05 0.0006301 0.01% DistributionMapping::KnapSackDoIt() 2 3.546e-05 0.0002852 0.0005012 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004578 0.0004794 0.0004988 0.01% MLPoisson::prepareForSolve() 14 0.0003759 0.0004024 0.0004806 0.01% MLCellLinOp::prepareForSolve() 14 0.0003614 0.0003878 0.0004682 0.01% FabArray::setDomainBndry() 259 0.0003865 0.0004162 0.0004459 0.01% MLCellLinOp::setLevelBC() 28 0.0003264 0.0003504 0.0003766 0.01% TagBoxArray::collate() 15 0.0002471 0.0002874 0.0003265 0.01% Castro::locWgtSum() 6 0.0001861 0.0001885 0.0001971 0.00% FabArrayBase::FB::FB() 35 7.91e-05 9.284e-05 0.0001317 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 6.016e-05 0.0001122 0.0001278 0.00% amrex::Dot() 54 0 1.532e-05 0.0001225 0.00% OwnerMask() 15 8.766e-05 0.0001008 0.0001105 0.00% AmrMesh-cluster 1 0 1.362e-05 0.000109 0.00% MLLinOp::makeAgglomeratedDMap 14 6.99e-05 7.783e-05 9.253e-05 0.00% Castro::volProductSum() 2 8.002e-05 8.575e-05 8.939e-05 0.00% FabArray::LinComb() 27 0 1.005e-05 8.042e-05 0.00% FabArray::Saxpy() 27 0 9.404e-06 7.523e-05 0.00% makeSFC 42 4.692e-05 5.425e-05 6.499e-05 0.00% ClusterList::intersect() 1 0 8.048e-06 6.439e-05 0.00% BoxList::parallelComplementIn() 30 2.115e-05 2.586e-05 3.994e-05 0.00% Amr::initSubcycle() 1 8.95e-06 1.338e-05 3.442e-05 0.00% Amr::writeSmallPlotFile() 1 2.788e-05 3.007e-05 3.101e-05 0.00% DistributionMapping::Distribute() 46 2.321e-05 2.58e-05 2.784e-05 0.00% ClusterList::chop() 1 0 2.18e-06 1.744e-05 0.00% FabArray::RecvLayoutMask() 14 1.564e-05 1.622e-05 1.657e-05 0.00% Castro::enforce_speed_limit() 33 1.04e-05 1.206e-05 1.539e-05 0.00% BoxList::complementIn 30 1.031e-05 1.242e-05 1.469e-05 0.00% knapsack() 2 1.033e-05 1.124e-05 1.242e-05 0.00% Castro::apply_problem_tags() 15 5.785e-06 6.405e-06 6.843e-06 0.00% Castro::gwstrain() 2 1.075e-06 1.302e-06 1.805e-06 0.00% Gravity::set_mass_offset() 1 8.39e-07 1.095e-06 1.366e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 16 B 18 B 21 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.04-24-g27ef4ea56945) finalized