Initializing AMReX (v2024-34-g9e8f8d60eca3)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (v2024-34-g9e8f8d60eca3) initialized Starting run at 07:40:14 UTC on 2024-03-26. Successfully read inputs file ... Castro git describe: 24.03-26-g5707c0c2f AMReX git describe: v2024-34-g9e8f8d60e Microphysics git describe: 24.03-21-g81de2adb reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002897227 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.123462497 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001767062 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001511696 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001588199 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001210753 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001207875 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001187971 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001250854 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001209401 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001225651 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001214237 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001215967 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.004769057 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001202056 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.242970625 seconds Ending run at 07:40:20 UTC on 2024-03-26. Run time = 6.48401276 Run time without initialization = 0.000355054 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.484 ... 6.484 ... 6.484 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1445 1.1671 1.1882 18.32% Amr::InitAmr() 1 1.115 1.115 1.115 17.20% Castro::post_init() 2 1.019 1.023 1.024 15.80% Castro::computeTemp() 36 0.7587 0.7967 0.8555 13.19% Castro::reset_internal_energy(Fab) 654 0.4014 0.4394 0.4695 7.24% FabArray::ParallelCopy_finish() 2952 0.1122 0.2914 0.422 6.51% MLPoisson::Fsmooth() 5088 0.2418 0.2486 0.2552 3.94% Castro::normalize_species() 33 0.1691 0.1786 0.1964 3.03% Castro::initData() 3 0.1231 0.1361 0.1584 2.44% AmrLevel::derive() 97 0.139 0.1427 0.1458 2.25% amrex::Copy() 948 0.1253 0.1292 0.1371 2.11% Castro::initMFs() 16 0.09418 0.1031 0.1149 1.77% FillBoundary_finish() 5539 0.07466 0.08152 0.08834 1.36% StateData::define() 64 0.05324 0.0581 0.06531 1.01% FabArray::setVal() 1755 0.04575 0.05353 0.05933 0.91% FillBoundary_nowait() 5539 0.05145 0.05378 0.05674 0.88% amrex::average_down 844 0.04275 0.04531 0.04842 0.75% MLCellLinOp::applyBC() 6281 0.03428 0.03639 0.03911 0.60% FabArray::ParallelCopy_nowait() 2952 0.02499 0.02928 0.03408 0.53% Castro::estTimeStep() 1 0.02232 0.02557 0.03189 0.49% VisMF::Write(FabArray) 2 0.01709 0.02087 0.0301 0.46% MLPoisson::Fapply() 1027 0.02444 0.02535 0.0261 0.40% Amr::writePlotFile() 1 0.005094 0.01465 0.02138 0.33% FillPatchIterator::Initialize 215 0.01542 0.01755 0.02035 0.31% MLCellLinOp::reflux() 138 0.01683 0.01751 0.01806 0.28% MLMG::addInterpCorrection() 530 0.01607 0.01686 0.01741 0.27% Castro::buildMetrics() 16 0.01146 0.01295 0.01466 0.23% FabArray::Xpay() 1000 0.01263 0.01347 0.01443 0.22% Castro::Castro() 16 0.01037 0.01129 0.01306 0.20% MultiFab::Multiply() 287 0.01163 0.01233 0.01288 0.20% amrex::Add() 562 0.01098 0.01172 0.0127 0.20% MLPoisson::FFlux() 3408 0.01138 0.01174 0.0121 0.19% Amr::regrid() 14 0.008746 0.01003 0.01201 0.19% MLCellLinOp::updateSolBC() 120 0.01061 0.01138 0.01171 0.18% MLCellLinOp::updateCorBC() 106 0.00944 0.01022 0.01054 0.16% FillPatchInterp(MF) 44 0.001911 0.006877 0.01023 0.16% AmrMesh::MakeNewGrids() 15 0.007932 0.008098 0.008164 0.13% MLMG::interpCorrection_1 106 0.006567 0.007106 0.007756 0.12% Castro::apply_tagging_restrictions() 15 0.005975 0.006406 0.006862 0.11% MLMG::prepareForSolve() 14 0.004979 0.00552 0.005924 0.09% MLMG::ResNormInf() 152 0.00392 0.004537 0.005397 0.08% FabArray::norminf(mask) 46 0.004756 0.004971 0.005186 0.08% MLLinOp::makeSubCommunicator() 14 0.0005227 0.002626 0.004719 0.07% MLCellLinOp::defineAuxData() 14 0.004143 0.00428 0.00447 0.07% MultiFab::max() 54 0.00306 0.003822 0.004349 0.07% Gravity::multilevel_solve_for_new_phi() 14 0.00294 0.003319 0.003954 0.06% FabArrayBase::getCPC() 3662 0.003525 0.003646 0.003774 0.06% FabArray::norminf() 188 0.003232 0.003417 0.003664 0.06% MLCellLinOp::compGrad() 28 0.003189 0.00334 0.003634 0.06% BndryData::define() 42 0.002605 0.002721 0.00285 0.04% Castro::enforce_min_density() 33 0.002498 0.002607 0.002718 0.04% Gravity::get_new_grav_vector() 4 0.001842 0.002101 0.002506 0.04% Gravity::actual_solve_with_mlmg() 14 0.002179 0.002264 0.002465 0.04% FabArray::FillBoundary() 5539 0.002019 0.002166 0.002327 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0002686 0.001154 0.002191 0.03% FabArrayBase::CPC::define() 624 0.001737 0.00187 0.002138 0.03% MLCellLinOp::defineBC() 14 0.001856 0.001924 0.001978 0.03% MLCellLinOp::smooth() 2544 0.001699 0.001775 0.001952 0.03% Castro::volWgtSum() 46 0.001648 0.001704 0.001753 0.03% FabArray::mult() 34 0.001103 0.0013 0.001566 0.02% FabArray::ParallelCopy() 2952 0.001235 0.001313 0.001426 0.02% FillPatchTwoLevels 126 0.0007182 0.001137 0.00141 0.02% Castro::enforce_consistent_e() 3 0.0009733 0.001182 0.001408 0.02% average_down_faces 84 0.001091 0.001191 0.001318 0.02% MLCGSolver::bicgstab 13 0 0.0001464 0.001171 0.02% StateData::FillBoundary(geom) 8 0.001066 0.001123 0.00117 0.02% FabArrayBase::getFB() 5539 0.0009348 0.0009907 0.001091 0.02% Gravity::actual_multilevel_solve() 14 0.00081 0.0008717 0.001 0.02% AMRErrorTag::operator() 15 0.0009346 0.0009441 0.0009501 0.01% MLMG::solve() 14 0.0004488 0.0006805 0.0008891 0.01% Castro::sum_integrated_quantities() 1 0.0005708 0.0007109 0.0008102 0.01% Castro::build_fine_mask() 55 0.0006581 0.0007136 0.0008092 0.01% TagBoxArray::collate() 15 0.0004526 0.000563 0.0007367 0.01% MLCellLinOp::apply() 1027 0.0004547 0.0004993 0.0006425 0.01% Amr::grid_places() 15 0.0003426 0.0003796 0.0005779 0.01% MLMG::MLResNormInf() 32 0.0002214 0.0004042 0.0005608 0.01% AmrLevel::FillPatch() 215 0.0005077 0.0005365 0.0005606 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003124 0.0003649 0.0005426 0.01% main() 1 0.0004276 0.000485 0.0005279 0.01% MLCellLinOp::prepareForSolve() 14 0.0003728 0.0004003 0.0004959 0.01% MLMG::mgVcycle() 318 0.0004343 0.0004616 0.0004946 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000448 0.0004651 0.0004844 0.01% MLCellLinOp::correctionResidual() 742 0.0003951 0.0004115 0.0004388 0.01% FabArray::setDomainBndry() 259 0.0003507 0.0003759 0.0004349 0.01% MLCellLinOp::setLevelBC() 28 0.0003197 0.0003498 0.0003779 0.01% MLLinOp::defineGrids() 14 0.0002871 0.0003255 0.0003722 0.01% MLMG::oneIter() 106 0.0002948 0.0003203 0.0003579 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002929 0.0003162 0.0003432 0.01% Gravity::update_max_rhs() 1 0.0001937 0.0002555 0.0003364 0.01% MLMG::actualBottomSolve() 106 2.185e-05 5.676e-05 0.0002841 0.00% MLMG::mgVcycle_bottom 318 0.0002356 0.0002457 0.0002572 0.00% MLCGSolver::ParallelAllReduce 95 0 2.936e-05 0.0002349 0.00% MLCellLinOp::solutionResidual() 258 0.0001912 0.0002055 0.0002193 0.00% Castro::locWgtSum() 6 0.0001984 0.0002048 0.000217 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001876 0.0001977 0.0002092 0.00% MLMG:computeResOfCorrection() 530 0.0001695 0.0001745 0.0001874 0.00% StateDataPhysBCFunct::() 259 0.0001468 0.0001599 0.0001742 0.00% MLMG::mgVcycle_down::0 106 0.0001433 0.0001515 0.000166 0.00% AmrLevel::AmrLevel(dm) 16 0.0001352 0.0001482 0.0001617 0.00% FillPatchSingleLevel 259 0.0001381 0.0001471 0.0001583 0.00% OwnerMask() 15 9.622e-05 0.0001161 0.0001537 0.00% FabArrayBase::FB::FB() 35 8.004e-05 9.754e-05 0.0001518 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001145 0.0001254 0.0001483 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001248 0.0001301 0.0001403 0.00% MLMG::mgVcycle_down::1 106 0.0001111 0.0001197 0.0001269 0.00% MLMG::miniCycle() 212 8.899e-05 0.0001046 0.0001237 0.00% FabArray::Saxpy() 54 0 1.52e-05 0.0001216 0.00% amrex::Dot() 54 0 1.471e-05 0.0001176 0.00% FPinfo::FPinfo() 9 8.049e-05 9.016e-05 0.0001147 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.634e-05 9.853e-05 0.0001085 0.00% TagBoxArray::mapPRD 15 9.225e-05 9.831e-05 0.0001065 0.00% MLMG::mgVcycle_down::2 106 8.649e-05 9.262e-05 0.0001035 0.00% MLMG::mgVcycle_down::3 106 7.381e-05 8.743e-05 0.0001022 0.00% Amr::FinalizeInit() 1 7.132e-06 1.972e-05 9.825e-05 0.00% Castro::volProductSum() 2 8.197e-05 8.47e-05 8.769e-05 0.00% Castro::clean_state() 33 6.453e-05 7.184e-05 8.351e-05 0.00% Castro::post_regrid() 30 6.788e-05 7.334e-05 8.272e-05 0.00% MLMG::mgVcycle_up::4 106 6.975e-05 7.474e-05 8.236e-05 0.00% Castro::avgDown(state_indx) 60 6.448e-05 7.438e-05 8.172e-05 0.00% MLMG::mgVcycle_down::4 106 7.156e-05 7.656e-05 8.144e-05 0.00% FabArrayBase::TheFPinfo() 49 6.64e-05 7.213e-05 8.11e-05 0.00% MLMG::mgVcycle_up::3 106 5.706e-05 6.424e-05 8.101e-05 0.00% Castro::derive() 97 6.564e-05 6.914e-05 7.805e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.733e-05 7.311e-05 7.757e-05 0.00% MLMG::mgVcycle_up::1 106 6.243e-05 6.754e-05 7.594e-05 0.00% MLMG::mgVcycle_up::2 106 5.755e-05 6.378e-05 7.213e-05 0.00% MLMG::mgVcycle_up::0 106 6.447e-05 6.834e-05 7.14e-05 0.00% MLMG::computeResidual() 106 6.108e-05 6.485e-05 7.087e-05 0.00% ClusterList::intersect() 1 0 8.576e-06 6.861e-05 0.00% Castro::init(old) 13 4.648e-05 5.246e-05 6.722e-05 0.00% Castro::errorEst() 15 4.788e-05 5.512e-05 6.639e-05 0.00% MLMG::computeMLResidual() 32 4.594e-05 5.206e-05 6.166e-05 0.00% MLPoisson::define() 14 3.766e-05 4.241e-05 5.561e-05 0.00% Amr::defBaseLevel() 1 3.554e-05 4.762e-05 5.553e-05 0.00% Castro::avgDown() 15 3.971e-05 4.459e-05 5.507e-05 0.00% amrex::average_down_w_geom 60 3.884e-05 4.447e-05 5.112e-05 0.00% makeSFC 42 2.899e-05 3.452e-05 4.018e-05 0.00% MLLinOp::define() 14 2.372e-05 2.685e-05 3.956e-05 0.00% Amr::writeSmallPlotFile() 1 3.321e-05 3.539e-05 3.909e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.819e-05 2.137e-05 3.758e-05 0.00% Amr::bldFineLevels() 1 1.508e-05 2.27e-05 3.256e-05 0.00% AmrMesh-cluster 1 0 3.875e-06 3.1e-05 0.00% MLPoisson::prepareForSolve() 14 1.193e-05 1.755e-05 2.905e-05 0.00% DistributionMapping::Distribute() 46 2.106e-05 2.454e-05 2.887e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.1e-05 2.403e-05 2.782e-05 0.00% FabArray::RecvLayoutMask() 14 1.607e-05 1.906e-05 2.183e-05 0.00% Amr::initialInit() 1 1.301e-06 8.957e-06 2.019e-05 0.00% MLMG::getGradSolution() 14 1.59e-05 1.804e-05 1.924e-05 0.00% ClusterList::chop() 1 0 2.252e-06 1.802e-05 0.00% BoxList::parallelComplementIn() 30 1.124e-05 1.295e-05 1.38e-05 0.00% BoxList::complementIn 30 9.252e-06 1.146e-05 1.364e-05 0.00% knapsack() 2 1.118e-05 1.223e-05 1.344e-05 0.00% Castro::enforce_speed_limit() 33 1.066e-05 1.234e-05 1.32e-05 0.00% Castro::gwstrain() 2 1.165e-06 3.609e-06 1.236e-05 0.00% Amr::initSubcycle() 1 9.726e-06 1.058e-05 1.167e-05 0.00% MLMG::MLRhsNormInf() 14 8.476e-06 8.944e-06 9.432e-06 0.00% Castro::apply_problem_tags() 15 7.446e-06 8.453e-06 9.38e-06 0.00% Amr::init() 1 1.897e-06 3.769e-06 9.372e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.799e-06 5.149e-06 5.622e-06 0.00% Amr::InitializeInit() 1 3.143e-06 4.018e-06 5.454e-06 0.00% Gravity::set_mass_offset() 1 9.75e-07 2.65e-06 4.316e-06 0.00% Castro::computeInitialDt() 1 1.529e-06 1.839e-06 2.22e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.484 6.484 6.484 100.00% Amr::init() 1 5.369 5.369 5.369 82.80% Amr::initialInit() 1 5.125 5.125 5.125 79.05% Amr::FinalizeInit() 1 5.012 5.016 5.022 77.45% Castro::post_init() 2 3.731 3.834 3.919 60.44% Gravity::multilevel_solve_for_new_phi() 14 1.839 1.864 1.886 29.08% Gravity::actual_multilevel_solve() 14 1.836 1.861 1.882 29.03% Gravity::solve_phi_with_mlmg() 14 1.83 1.854 1.875 28.92% Castro::computeTemp() 36 1.16 1.236 1.324 20.42% Amr::regrid() 14 1.263 1.287 1.315 20.28% Castro::clean_state() 33 1.118 1.18 1.247 19.23% Gravity::fill_multipole_BCs() 14 1.146 1.169 1.19 18.35% Amr::InitAmr() 1 1.115 1.115 1.115 17.20% Amr::bldFineLevels() 1 0.9276 0.9962 1.08 16.65% Castro::post_regrid() 30 0.8557 0.8875 0.9107 14.04% Castro::initData() 3 0.6143 0.6855 0.7878 12.15% Gravity::actual_solve_with_mlmg() 14 0.6828 0.685 0.6869 10.59% MLMG::solve() 14 0.663 0.6634 0.6637 10.24% MLMG::oneIter() 106 0.5842 0.5849 0.5855 9.03% FabArray::ParallelCopy() 2952 0.1706 0.3476 0.4745 7.32% Castro::reset_internal_energy(MultiFab) 36 0.4017 0.4397 0.4699 7.25% Castro::reset_internal_energy(Fab) 654 0.4014 0.4394 0.4695 7.24% MLMG::mgVcycle() 318 0.4398 0.4417 0.4435 6.84% FabArray::ParallelCopy_finish() 2952 0.1122 0.2914 0.422 6.51% MLCellLinOp::smooth() 2544 0.3709 0.3735 0.3796 5.85% amrex::average_down 844 0.08044 0.1835 0.2708 4.18% MLPoisson::Fsmooth() 5088 0.2418 0.2486 0.2552 3.94% Amr::writePlotFile() 1 0.2431 0.2433 0.2433 3.75% Castro::avgDown() 15 0.04864 0.1518 0.2366 3.65% Castro::avgDown(state_indx) 60 0.04858 0.1518 0.2365 3.65% amrex::average_down_w_geom 60 0.04851 0.1517 0.2365 3.65% Castro::derive() 97 0.2057 0.208 0.2096 3.23% AmrLevel::derive() 97 0.2057 0.2079 0.2095 3.23% Castro::normalize_species() 33 0.1691 0.1786 0.1964 3.03% MLCellLinOp::applyBC() 6281 0.1695 0.1749 0.1797 2.77% Castro::Castro() 16 0.1368 0.1495 0.1661 2.56% AmrLevel::FillPatch() 215 0.1342 0.1411 0.1494 2.30% Amr::grid_places() 15 0.02254 0.09301 0.1466 2.26% AmrMesh::MakeNewGrids() 15 0.02197 0.09263 0.1462 2.26% FabArray::FillBoundary() 5539 0.1339 0.1385 0.1444 2.23% amrex::Copy() 948 0.1253 0.1292 0.1371 2.11% FillPatchIterator::Initialize 215 0.1093 0.1174 0.1277 1.97% TagBoxArray::mapPRD 15 0.002906 0.07346 0.1274 1.96% MLMG::mgVcycle_bottom 318 0.1186 0.1201 0.1235 1.90% MLMG::mgVcycle_down::0 106 0.1205 0.1217 0.1227 1.89% MLMG::miniCycle() 212 0.1187 0.1199 0.1207 1.86% Castro::initMFs() 16 0.09418 0.1031 0.1149 1.77% Amr::InitializeInit() 1 0.1033 0.1096 0.1129 1.74% Amr::defBaseLevel() 1 0.1033 0.1096 0.1129 1.74% MLMG::mgVcycle_up::0 106 0.1081 0.1088 0.1094 1.69% FillPatchSingleLevel 259 0.0702 0.07909 0.09309 1.44% FillBoundary_finish() 5539 0.07466 0.08152 0.08834 1.36% MLMG::computeResWithCrseSolFineCor() 106 0.07708 0.07846 0.07935 1.22% FillPatchIterator::FillFromTwoLevels() 126 0.05703 0.06475 0.07154 1.10% FillPatchTwoLevels 126 0.0569 0.06462 0.07141 1.10% MLCellLinOp::apply() 1027 0.0649 0.06623 0.06783 1.05% Castro::init(old) 13 0.05619 0.0624 0.06673 1.03% MLCellLinOp::correctionResidual() 742 0.06283 0.06423 0.06585 1.02% AmrLevel::AmrLevel(dm) 16 0.05338 0.05825 0.06545 1.01% StateData::define() 64 0.05324 0.0581 0.06531 1.01% MLCellLinOp::solutionResidual() 258 0.05873 0.06049 0.06171 0.95% FabArray::ParallelCopy_nowait() 2952 0.04761 0.05493 0.06068 0.94% FabArray::setVal() 1755 0.04575 0.05353 0.05933 0.91% FillBoundary_nowait() 5539 0.05247 0.05487 0.05798 0.89% MLCellLinOp::reflux() 138 0.05075 0.05171 0.05238 0.81% FillPatchIterator::FillFromLevel0() 89 0.03149 0.03479 0.04266 0.66% MLMG::computeResWithCrseCorFineCor() 106 0.03408 0.03451 0.03496 0.54% Castro::computeInitialDt() 1 0.02232 0.02557 0.03189 0.49% Castro::estTimeStep() 1 0.02232 0.02557 0.03189 0.49% MLMG::computeResidual() 106 0.02918 0.0306 0.03123 0.48% MLMG::addInterpCorrection() 530 0.01844 0.02884 0.03065 0.47% VisMF::Write(FabArray) 2 0.01709 0.02087 0.0301 0.46% MLMG::mgVcycle_down::1 106 0.02664 0.02738 0.02802 0.43% MLPoisson::Fapply() 1027 0.02444 0.02535 0.0261 0.40% MLMG::mgVcycle_up::2 106 0.01236 0.02259 0.02442 0.38% MLCellLinOp::updateSolBC() 120 0.0227 0.0233 0.0243 0.37% MLMG::computeMLResidual() 32 0.02242 0.02317 0.02374 0.37% MLMG::mgVcycle_up::1 106 0.02226 0.02284 0.02323 0.36% MLCellLinOp::updateCorBC() 106 0.0203 0.02118 0.02209 0.34% MLMG:computeResOfCorrection() 530 0.0204 0.02082 0.02132 0.33% Gravity::get_new_grav_vector() 4 0.01812 0.01902 0.01949 0.30% Castro::buildMetrics() 16 0.01288 0.01451 0.01648 0.25% MLPoisson::define() 14 0.01172 0.01378 0.01583 0.24% FabArray::Xpay() 1000 0.01263 0.01347 0.01443 0.22% MLMG::mgVcycle_down::2 106 0.01171 0.01194 0.01319 0.20% MLMG::interpCorrection_1 106 0.01097 0.01193 0.01302 0.20% MultiFab::Multiply() 287 0.01163 0.01233 0.01288 0.20% amrex::Add() 562 0.01098 0.01172 0.0127 0.20% MLPoisson::FFlux() 3408 0.01138 0.01174 0.0121 0.19% MLMG::ResNormInf() 152 0.01041 0.01105 0.01164 0.18% MLMG::prepareForSolve() 14 0.01047 0.01078 0.01137 0.18% Castro::errorEst() 15 0.009641 0.01025 0.01066 0.16% FillPatchInterp(MF) 44 0.001911 0.006877 0.01023 0.16% Castro::apply_tagging_restrictions() 15 0.005975 0.006406 0.006862 0.11% FabArrayBase::getCPC() 3662 0.005262 0.005516 0.005854 0.09% MLCellLinOp::defineAuxData() 14 0.005164 0.005331 0.005524 0.09% MLCellLinOp::defineBC() 14 0.005271 0.005349 0.005464 0.08% MLMG::getGradSolution() 14 0.005083 0.005165 0.005259 0.08% MLCellLinOp::compGrad() 28 0.005065 0.005147 0.00524 0.08% FabArray::norminf(mask) 46 0.004756 0.004971 0.005186 0.08% MLLinOp::define() 14 0.000921 0.003056 0.005162 0.08% MLLinOp::defineGrids() 14 0.0008973 0.003029 0.005135 0.08% Castro::sum_integrated_quantities() 1 0.004994 0.005013 0.005074 0.08% MLLinOp::makeSubCommunicator() 14 0.0005227 0.002626 0.004719 0.07% MLMG::mgVcycle_down::3 106 0.001353 0.001844 0.004588 0.07% MultiFab::max() 54 0.00306 0.003822 0.004349 0.07% MLMG::MLResNormInf() 32 0.004138 0.004191 0.004232 0.07% Gravity::average_fine_ec_onto_crse_ec() 14 0.00351 0.003644 0.00386 0.06% MLMG::mgVcycle_up::3 106 0.000973 0.001357 0.00373 0.06% FabArray::norminf() 188 0.003232 0.003417 0.003664 0.06% BndryData::define() 42 0.003189 0.003295 0.003444 0.05% MLMG::actualBottomSolve() 106 2.185e-05 0.0003953 0.002992 0.05% Castro::enforce_min_density() 33 0.002498 0.002607 0.002718 0.04% MLCGSolver::bicgstab 13 0 0.0003322 0.002658 0.04% MLMG::mgVcycle_down::4 106 0.001193 0.001426 0.002578 0.04% average_down_faces 84 0.00217 0.00224 0.002384 0.04% FabArrayBase::TheFPinfo() 49 0.0003475 0.001237 0.00232 0.04% FPinfo::FPinfo() 9 0.0002734 0.001165 0.002239 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0002686 0.001154 0.002191 0.03% FabArrayBase::CPC::define() 624 0.001737 0.00187 0.002138 0.03% MLMG::mgVcycle_up::4 106 0.001142 0.001288 0.00199 0.03% MLMG::MLRhsNormInf() 14 0.001792 0.001868 0.001942 0.03% Gravity::update_max_rhs() 1 0.0008864 0.001445 0.001902 0.03% Castro::volWgtSum() 46 0.001653 0.001709 0.001758 0.03% FabArray::mult() 34 0.001103 0.0013 0.001566 0.02% Castro::enforce_consistent_e() 3 0.0009733 0.001182 0.001408 0.02% StateDataPhysBCFunct::() 259 0.001218 0.001283 0.001338 0.02% FabArrayBase::getFB() 5539 0.001022 0.001088 0.001243 0.02% StateData::FillBoundary(geom) 8 0.001066 0.001123 0.00117 0.02% AMRErrorTag::operator() 15 0.0009346 0.0009441 0.0009501 0.01% Castro::build_fine_mask() 55 0.0006581 0.0007136 0.0008092 0.01% TagBoxArray::collate() 15 0.0004526 0.000563 0.0007367 0.01% DistributionMapping::KnapSackDoIt() 2 5.542e-05 0.0002749 0.0005601 0.01% MLPoisson::prepareForSolve() 14 0.0003913 0.0004179 0.000525 0.01% MLCellLinOp::prepareForSolve() 14 0.0003728 0.0004003 0.0004959 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000448 0.0004651 0.0004844 0.01% FabArray::setDomainBndry() 259 0.0003507 0.0003759 0.0004349 0.01% MLCellLinOp::setLevelBC() 28 0.0003197 0.0003498 0.0003779 0.01% MLCGSolver::ParallelAllReduce 95 0 3.755e-05 0.0003004 0.00% Castro::locWgtSum() 6 0.0001988 0.0002053 0.0002175 0.00% OwnerMask() 15 9.622e-05 0.0001161 0.0001537 0.00% FabArrayBase::FB::FB() 35 8.004e-05 9.754e-05 0.0001518 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 0.0001099 0.0001234 0.0001413 0.00% FabArray::Saxpy() 54 0 1.52e-05 0.0001216 0.00% amrex::Dot() 54 0 1.471e-05 0.0001176 0.00% AmrMesh-cluster 1 0 1.47e-05 0.0001176 0.00% MLLinOp::makeAgglomeratedDMap 14 6.926e-05 7.713e-05 8.827e-05 0.00% Castro::volProductSum() 2 8.218e-05 8.493e-05 8.792e-05 0.00% ClusterList::intersect() 1 0 8.576e-06 6.861e-05 0.00% makeSFC 42 4.633e-05 5.31e-05 6.057e-05 0.00% Amr::writeSmallPlotFile() 1 3.321e-05 3.539e-05 3.909e-05 0.00% DistributionMapping::Distribute() 46 2.106e-05 2.454e-05 2.887e-05 0.00% BoxList::parallelComplementIn() 30 2.05e-05 2.441e-05 2.744e-05 0.00% FabArray::RecvLayoutMask() 14 1.607e-05 1.906e-05 2.183e-05 0.00% ClusterList::chop() 1 0 2.252e-06 1.802e-05 0.00% BoxList::complementIn 30 9.252e-06 1.146e-05 1.364e-05 0.00% knapsack() 2 1.118e-05 1.223e-05 1.344e-05 0.00% Castro::enforce_speed_limit() 33 1.066e-05 1.234e-05 1.32e-05 0.00% Castro::gwstrain() 2 1.165e-06 3.609e-06 1.236e-05 0.00% Amr::initSubcycle() 1 9.726e-06 1.058e-05 1.167e-05 0.00% Castro::apply_problem_tags() 15 7.446e-06 8.453e-06 9.38e-06 0.00% Gravity::set_mass_offset() 1 9.75e-07 2.65e-06 4.316e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 20 B 20 B 26 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-34-g9e8f8d60eca3) finalized