Initializing AMReX (24.02-30-g2ecafcff4013)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.02-30-g2ecafcff4013) initialized Starting run at 08:05:34 UTC on 2024-02-23. Successfully read inputs file ... Castro git describe: 24.02-21-g56d243e7a AMReX git describe: 24.02-30-g2ecafcff4 Microphysics git describe: 24.02-23-g3df6ba0c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002811315 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.129145806 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001578694 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001981529 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001121658 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001178829 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001182114 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001163201 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00114463 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001141764 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001179773 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001127619 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001187361 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001175657 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001148329 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.224742014 seconds Ending run at 08:05:41 UTC on 2024-02-23. Run time = 6.463078718 Run time without initialization = 0.000276517 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.463 ... 6.463 ... 6.463 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1503 1.1718 1.1878 18.38% Amr::InitAmr() 1 1.144 1.144 1.144 17.71% Castro::post_init() 2 1.014 1.016 1.017 15.73% Castro::computeTemp() 36 0.7627 0.8217 0.9088 14.06% Castro::reset_internal_energy(Fab) 654 0.4026 0.4462 0.5064 7.84% FabArray::ParallelCopy_finish() 2952 0.0543 0.2962 0.4422 6.84% MLPoisson::Fsmooth() 5088 0.1948 0.2052 0.2183 3.38% Castro::normalize_species() 33 0.1632 0.1745 0.1904 2.95% Castro::initData() 3 0.1207 0.1381 0.1693 2.62% AmrLevel::derive() 97 0.139 0.1422 0.1457 2.25% amrex::Copy() 948 0.1315 0.1334 0.1348 2.09% Castro::initMFs() 16 0.08855 0.09884 0.1202 1.86% FillBoundary_finish() 5539 0.04907 0.06727 0.08527 1.32% StateData::define() 64 0.05042 0.05672 0.06891 1.07% FabArray::setVal() 1755 0.04053 0.04913 0.05305 0.82% amrex::average_down 844 0.04059 0.04487 0.05055 0.78% FillBoundary_nowait() 5539 0.04038 0.0428 0.04682 0.72% Castro::estTimeStep() 1 0.02594 0.03942 0.04357 0.67% MLCellLinOp::applyBC() 6281 0.03383 0.03639 0.04022 0.62% FabArray::ParallelCopy_nowait() 2952 0.02412 0.02617 0.03084 0.48% MLPoisson::Fapply() 1027 0.02362 0.02504 0.02689 0.42% VisMF::Write(FabArray) 2 0.01707 0.01759 0.01968 0.30% MLMG::addInterpCorrection() 530 0.01793 0.01843 0.01924 0.30% FillPatchIterator::Initialize 215 0.01577 0.01696 0.0177 0.27% MLCellLinOp::reflux() 138 0.0154 0.01629 0.01714 0.27% Castro::buildMetrics() 16 0.01108 0.0124 0.01493 0.23% FabArray::Xpay() 1000 0.01176 0.01294 0.01437 0.22% MultiFab::Multiply() 287 0.0127 0.01301 0.0136 0.21% amrex::Add() 562 0.01061 0.01152 0.01271 0.20% Amr::regrid() 14 0.009178 0.01112 0.01235 0.19% MLPoisson::FFlux() 3408 0.01104 0.01167 0.01233 0.19% MLCellLinOp::updateSolBC() 120 0.01041 0.01129 0.01194 0.18% MLCellLinOp::updateCorBC() 106 0.009145 0.01013 0.01072 0.17% Castro::Castro() 16 0.008045 0.008967 0.01038 0.16% FillPatchInterp(MF) 44 0.001819 0.006821 0.01026 0.16% Amr::writePlotFile() 1 0.005108 0.007444 0.008079 0.12% MLMG::interpCorrection_1 106 0.006405 0.007119 0.007774 0.12% Castro::apply_tagging_restrictions() 15 0.005906 0.006511 0.007125 0.11% AmrMesh::MakeNewGrids() 15 0.006285 0.006396 0.006689 0.10% MLLinOp::makeSubCommunicator() 14 0.0002197 0.002934 0.005478 0.08% MLMG::ResNormInf() 152 0.002818 0.004194 0.005362 0.08% MLMG::prepareForSolve() 14 0.004771 0.005048 0.005257 0.08% FabArray::norminf(mask) 46 0.004629 0.00487 0.005111 0.08% MLCellLinOp::defineAuxData() 14 0.003867 0.003996 0.004284 0.07% FabArray::norminf() 188 0.002814 0.00332 0.003935 0.06% MultiFab::max() 54 0.002807 0.003326 0.003722 0.06% FabArrayBase::getCPC() 3662 0.003352 0.003483 0.003546 0.05% Castro::enforce_min_density() 33 0.003051 0.003227 0.00347 0.05% MLCellLinOp::compGrad() 28 0.003151 0.003315 0.003437 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002699 0.002873 0.00303 0.05% BndryData::define() 42 0.002497 0.002566 0.002661 0.04% Gravity::get_new_grav_vector() 4 0.001802 0.002102 0.002475 0.04% Gravity::actual_solve_with_mlmg() 14 0.002002 0.00214 0.002408 0.04% DistributionMapping::LeastUsedCPUs() 9 0.000194 0.00143 0.002333 0.04% FabArray::FillBoundary() 5539 0.001959 0.002051 0.002158 0.03% MLCellLinOp::defineBC() 14 0.001754 0.001916 0.002023 0.03% FabArrayBase::CPC::define() 624 0.00159 0.001735 0.001996 0.03% MLCellLinOp::smooth() 2544 0.001667 0.001719 0.001774 0.03% Castro::volWgtSum() 46 0.001634 0.001682 0.001733 0.03% FabArray::mult() 34 0.0011 0.001249 0.001442 0.02% FillPatchTwoLevels 126 0.0007124 0.001136 0.001394 0.02% Castro::enforce_consistent_e() 3 0.001056 0.001221 0.001363 0.02% average_down_faces 84 0.001087 0.001192 0.00131 0.02% FabArray::ParallelCopy() 2952 0.00117 0.001215 0.00125 0.02% MLCGSolver::bicgstab 13 0 0.0001478 0.001182 0.02% AMRErrorTag::operator() 15 0.001093 0.001127 0.001179 0.02% StateData::FillBoundary(geom) 8 0.00106 0.001093 0.001136 0.02% FabArrayBase::getFB() 5539 0.0009912 0.001031 0.001106 0.02% Gravity::actual_multilevel_solve() 14 0.0007776 0.0008406 0.0009026 0.01% MLMG::solve() 14 0.0003627 0.0006049 0.0008111 0.01% Castro::build_fine_mask() 55 0.0006173 0.0006883 0.0007699 0.01% Castro::sum_integrated_quantities() 1 0.0003508 0.0005392 0.000654 0.01% TagBoxArray::collate() 15 0.000226 0.0003017 0.0006233 0.01% MLCellLinOp::apply() 1027 0.0004472 0.0004838 0.000598 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000508 0.0005307 0.0005548 0.01% AmrLevel::FillPatch() 215 0.0004851 0.0005062 0.0005371 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003075 0.0003592 0.000488 0.01% MLCellLinOp::prepareForSolve() 14 0.0003729 0.000394 0.0004778 0.01% MLMG::mgVcycle() 318 0.0003872 0.0004111 0.0004505 0.01% main() 1 0.0003759 0.000402 0.0004282 0.01% MLMG::MLResNormInf() 32 8.98e-05 0.0002921 0.0004277 0.01% Amr::grid_places() 15 0.0003015 0.0003391 0.0004243 0.01% MLCellLinOp::correctionResidual() 742 0.0003824 0.0004026 0.0004175 0.01% MLLinOp::defineGrids() 14 0.000277 0.0003295 0.0004104 0.01% FabArray::setDomainBndry() 259 0.0003312 0.0003647 0.0003984 0.01% MLCellLinOp::setLevelBC() 28 0.0003166 0.0003377 0.0003604 0.01% MLMG::oneIter() 106 0.0002866 0.0002989 0.0003123 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002706 0.0002879 0.0003034 0.00% MLMG::actualBottomSolve() 106 2.219e-05 5.514e-05 0.000278 0.00% Castro::locWgtSum() 6 0.0002 0.0002112 0.000249 0.00% MLMG::mgVcycle_bottom 318 0.0002189 0.0002281 0.0002407 0.00% MLCGSolver::ParallelAllReduce 95 0 2.949e-05 0.0002359 0.00% MLCellLinOp::solutionResidual() 258 0.000182 0.0001967 0.0002078 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001727 0.0001813 0.0001878 0.00% StateDataPhysBCFunct::() 259 0.0001405 0.000153 0.0001773 0.00% AmrLevel::AmrLevel(dm) 16 0.0001478 0.0001573 0.0001685 0.00% MLMG:computeResOfCorrection() 530 0.0001473 0.000157 0.0001658 0.00% FillPatchSingleLevel 259 0.0001385 0.0001436 0.0001492 0.00% MLMG::mgVcycle_down::0 106 0.0001228 0.0001316 0.0001421 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001228 0.0001302 0.0001414 0.00% FabArrayBase::FB::FB() 35 7.935e-05 9.109e-05 0.0001404 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001134 0.0001226 0.0001286 0.00% amrex::Dot() 54 0 1.6e-05 0.000128 0.00% FabArray::Saxpy() 54 0 1.585e-05 0.0001268 0.00% Gravity::update_max_rhs() 1 8.017e-05 0.000102 0.0001224 0.00% FPinfo::FPinfo() 9 7.622e-05 9.493e-05 0.0001191 0.00% MLMG::mgVcycle_down::1 106 0.0001049 0.0001114 0.0001143 0.00% OwnerMask() 15 8.823e-05 0.0001021 0.0001121 0.00% TagBoxArray::mapPRD 15 9.348e-05 9.839e-05 0.0001086 0.00% MLMG::miniCycle() 212 8.075e-05 8.854e-05 0.0001043 0.00% MLMG::mgVcycle_down::2 106 7.99e-05 8.551e-05 9.662e-05 0.00% Castro::volProductSum() 2 8.244e-05 8.601e-05 9.242e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 7.812e-05 8.449e-05 8.956e-05 0.00% MLMG::mgVcycle_down::3 106 7.474e-05 7.915e-05 8.8e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.739e-05 7.222e-05 8.748e-05 0.00% Castro::avgDown(state_indx) 60 6.316e-05 7.064e-05 8.706e-05 0.00% Castro::post_regrid() 30 5.894e-05 6.751e-05 8.653e-05 0.00% FabArrayBase::TheFPinfo() 49 6.438e-05 7.304e-05 8.079e-05 0.00% Castro::clean_state() 33 6.23e-05 6.707e-05 7.824e-05 0.00% MLMG::mgVcycle_down::4 106 6.763e-05 7.215e-05 7.662e-05 0.00% Amr::FinalizeInit() 1 8.217e-06 2.375e-05 7.639e-05 0.00% MLMG::mgVcycle_up::4 106 6.491e-05 6.992e-05 7.601e-05 0.00% MLMG::mgVcycle_up::0 106 6.398e-05 6.958e-05 7.584e-05 0.00% Castro::derive() 97 5.814e-05 6.43e-05 7.158e-05 0.00% MLMG::mgVcycle_up::2 106 5.54e-05 5.801e-05 6.588e-05 0.00% MLMG::mgVcycle_up::1 106 5.735e-05 6.133e-05 6.465e-05 0.00% MLPoisson::define() 14 3.891e-05 4.715e-05 6.307e-05 0.00% MLMG::computeResidual() 106 5.455e-05 5.729e-05 6.245e-05 0.00% MLMG::computeMLResidual() 32 3.553e-05 4.431e-05 6.237e-05 0.00% MLMG::mgVcycle_up::3 106 5.269e-05 5.734e-05 6.229e-05 0.00% ClusterList::intersect() 1 0 7.722e-06 6.177e-05 0.00% Castro::errorEst() 15 4.37e-05 4.903e-05 5.978e-05 0.00% Castro::init(old) 13 3.971e-05 4.682e-05 5.142e-05 0.00% Castro::avgDown() 15 3.27e-05 4.003e-05 4.903e-05 0.00% amrex::average_down_w_geom 60 3.931e-05 4.334e-05 4.811e-05 0.00% makeSFC 42 2.747e-05 3.491e-05 4.4e-05 0.00% Amr::defBaseLevel() 1 2.105e-05 2.772e-05 3.571e-05 0.00% Amr::writeSmallPlotFile() 1 3.126e-05 3.285e-05 3.498e-05 0.00% AmrMesh-cluster 1 0 3.808e-06 3.046e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.216e-05 2.471e-05 2.787e-05 0.00% Amr::bldFineLevels() 1 1.364e-05 1.742e-05 2.506e-05 0.00% DistributionMapping::Distribute() 46 2.104e-05 2.281e-05 2.471e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.504e-05 2.064e-05 2.451e-05 0.00% ClusterList::chop() 1 0 2.693e-06 2.154e-05 0.00% MLLinOp::define() 14 1.597e-05 1.778e-05 2.082e-05 0.00% MLMG::getGradSolution() 14 1.585e-05 1.663e-05 1.804e-05 0.00% FabArray::RecvLayoutMask() 14 1.548e-05 1.63e-05 1.74e-05 0.00% MLMG::MLRhsNormInf() 14 8.253e-06 9.391e-06 1.509e-05 0.00% MLPoisson::prepareForSolve() 14 1.191e-05 1.312e-05 1.438e-05 0.00% Castro::enforce_speed_limit() 33 1.168e-05 1.271e-05 1.405e-05 0.00% knapsack() 2 1.132e-05 1.182e-05 1.261e-05 0.00% BoxList::complementIn 30 9.747e-06 1.098e-05 1.206e-05 0.00% BoxList::parallelComplementIn() 30 9.98e-06 1.076e-05 1.201e-05 0.00% Amr::initSubcycle() 1 9.915e-06 1.097e-05 1.173e-05 0.00% Castro::apply_problem_tags() 15 7.631e-06 8.796e-06 1.159e-05 0.00% Castro::gwstrain() 2 1.051e-06 2.299e-06 9.114e-06 0.00% Amr::InitializeInit() 1 2.012e-06 2.971e-06 5.386e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.148e-06 4.679e-06 5.231e-06 0.00% Gravity::set_mass_offset() 1 7.49e-07 2.291e-06 4.372e-06 0.00% Castro::computeInitialDt() 1 1.24e-06 1.644e-06 2.919e-06 0.00% Amr::init() 1 1.895e-06 2.194e-06 2.698e-06 0.00% Amr::initialInit() 1 1.242e-06 1.706e-06 2.052e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.463 6.463 6.463 100.00% Amr::init() 1 5.318 5.318 5.318 82.29% Amr::initialInit() 1 5.093 5.093 5.093 78.81% Amr::FinalizeInit() 1 4.966 4.979 4.983 77.11% Castro::post_init() 2 3.64 3.773 3.852 59.59% Gravity::multilevel_solve_for_new_phi() 14 1.768 1.79 1.808 27.98% Gravity::actual_multilevel_solve() 14 1.765 1.787 1.806 27.94% Gravity::solve_phi_with_mlmg() 14 1.759 1.781 1.799 27.84% Castro::computeTemp() 36 1.166 1.268 1.415 21.89% Amr::regrid() 14 1.264 1.296 1.331 20.60% Castro::clean_state() 33 1.113 1.199 1.315 20.35% Gravity::fill_multipole_BCs() 14 1.152 1.173 1.189 18.40% Amr::InitAmr() 1 1.144 1.144 1.144 17.71% Amr::bldFineLevels() 1 0.9416 1.003 1.108 17.15% Castro::post_regrid() 30 0.8566 0.9096 0.9703 15.01% Castro::initData() 3 0.6116 0.6898 0.8194 12.68% Gravity::actual_solve_with_mlmg() 14 0.6044 0.607 0.6094 9.43% MLMG::solve() 14 0.5854 0.5861 0.5864 9.07% MLMG::oneIter() 106 0.5125 0.5133 0.5139 7.95% Castro::reset_internal_energy(MultiFab) 36 0.4031 0.4465 0.5067 7.84% Castro::reset_internal_energy(Fab) 654 0.4026 0.4462 0.5064 7.84% FabArray::ParallelCopy() 2952 0.1133 0.3508 0.4958 7.67% FabArray::ParallelCopy_finish() 2952 0.0543 0.2962 0.4422 6.84% MLMG::mgVcycle() 318 0.3776 0.3784 0.3799 5.88% MLCellLinOp::smooth() 2544 0.3097 0.3115 0.3173 4.91% amrex::average_down 844 0.07537 0.2082 0.2877 4.45% Castro::avgDown() 15 0.04405 0.1775 0.2572 3.98% Castro::avgDown(state_indx) 60 0.04401 0.1775 0.2572 3.98% amrex::average_down_w_geom 60 0.04394 0.1774 0.2571 3.98% Amr::writePlotFile() 1 0.2249 0.225 0.225 3.48% MLPoisson::Fsmooth() 5088 0.1948 0.2052 0.2183 3.38% Castro::derive() 97 0.2005 0.2008 0.2012 3.11% AmrLevel::derive() 97 0.2004 0.2008 0.2012 3.11% Castro::normalize_species() 33 0.1632 0.1745 0.1904 2.95% Castro::Castro() 16 0.1266 0.1421 0.1677 2.60% MLCellLinOp::applyBC() 6281 0.138 0.1496 0.1633 2.53% Amr::grid_places() 15 0.02033 0.09874 0.1475 2.28% AmrMesh::MakeNewGrids() 15 0.02001 0.0984 0.1471 2.28% amrex::Copy() 948 0.1315 0.1334 0.1348 2.09% TagBoxArray::mapPRD 15 0.002183 0.08106 0.1298 2.01% FabArray::FillBoundary() 5539 0.0991 0.1132 0.1293 2.00% Amr::InitializeInit() 1 0.1097 0.1139 0.1274 1.97% Amr::defBaseLevel() 1 0.1097 0.1139 0.1274 1.97% AmrLevel::FillPatch() 215 0.1141 0.1192 0.1217 1.88% Castro::initMFs() 16 0.08855 0.09884 0.1202 1.86% MLMG::mgVcycle_down::0 106 0.1052 0.1057 0.1067 1.65% MLMG::mgVcycle_bottom 318 0.1015 0.1026 0.1062 1.64% MLMG::miniCycle() 212 0.1016 0.1024 0.1034 1.60% FillPatchIterator::Initialize 215 0.08812 0.09329 0.09624 1.49% MLMG::mgVcycle_up::0 106 0.09338 0.09365 0.094 1.45% FillBoundary_finish() 5539 0.04907 0.06727 0.08527 1.32% MLMG::computeResWithCrseSolFineCor() 106 0.07313 0.07488 0.07591 1.17% AmrLevel::AmrLevel(dm) 16 0.05056 0.05687 0.06907 1.07% StateData::define() 64 0.05042 0.05672 0.06891 1.07% MLCellLinOp::apply() 1027 0.05817 0.06032 0.06214 0.96% FillPatchSingleLevel 259 0.05102 0.05722 0.06175 0.96% MLCellLinOp::correctionResidual() 742 0.05663 0.05794 0.0584 0.90% FabArray::ParallelCopy_nowait() 2952 0.0505 0.0534 0.05774 0.89% MLCellLinOp::solutionResidual() 258 0.05415 0.05568 0.05691 0.88% FabArray::setVal() 1755 0.04053 0.04913 0.05305 0.82% FillPatchIterator::FillFromTwoLevels() 126 0.04637 0.0494 0.05297 0.82% FillPatchTwoLevels 126 0.04623 0.04927 0.05284 0.82% MLCellLinOp::reflux() 138 0.04734 0.05 0.05154 0.80% Castro::init(old) 13 0.04541 0.04745 0.05038 0.78% FillBoundary_nowait() 5539 0.04146 0.04392 0.04807 0.74% Castro::computeInitialDt() 1 0.02594 0.03942 0.04357 0.67% Castro::estTimeStep() 1 0.02594 0.03942 0.04357 0.67% MLMG::computeResWithCrseCorFineCor() 106 0.03128 0.03195 0.03252 0.50% MLMG::addInterpCorrection() 530 0.02071 0.0299 0.03151 0.49% FillPatchIterator::FillFromLevel0() 89 0.02373 0.02661 0.02974 0.46% MLMG::computeResidual() 106 0.02725 0.02844 0.02925 0.45% MLPoisson::Fapply() 1027 0.02362 0.02504 0.02689 0.42% MLMG::mgVcycle_down::1 106 0.02238 0.02309 0.02366 0.37% MLCellLinOp::updateSolBC() 120 0.01988 0.02072 0.02154 0.33% MLMG::computeMLResidual() 32 0.02024 0.02108 0.0215 0.33% MLMG::mgVcycle_up::2 106 0.008761 0.01888 0.02056 0.32% MLCellLinOp::updateCorBC() 106 0.01796 0.01912 0.02012 0.31% VisMF::Write(FabArray) 2 0.01707 0.01759 0.01968 0.30% MLMG::mgVcycle_up::1 106 0.01917 0.01923 0.01935 0.30% Gravity::get_new_grav_vector() 4 0.01774 0.01851 0.0192 0.30% MLMG:computeResOfCorrection() 530 0.01773 0.01804 0.01829 0.28% Castro::buildMetrics() 16 0.01249 0.01397 0.01671 0.26% MLPoisson::define() 14 0.01122 0.01367 0.01605 0.25% FabArray::Xpay() 1000 0.01176 0.01294 0.01437 0.22% MultiFab::Multiply() 287 0.0127 0.01301 0.0136 0.21% amrex::Add() 562 0.01061 0.01152 0.01271 0.20% MLPoisson::FFlux() 3408 0.01104 0.01167 0.01233 0.19% MLMG::interpCorrection_1 106 0.01001 0.01077 0.01159 0.18% MLMG::ResNormInf() 152 0.009692 0.01056 0.0113 0.17% Castro::errorEst() 15 0.009663 0.01042 0.01103 0.17% MLMG::prepareForSolve() 14 0.009834 0.01007 0.0106 0.16% FillPatchInterp(MF) 44 0.001819 0.006821 0.01026 0.16% MLMG::mgVcycle_down::2 106 0.008957 0.009165 0.009886 0.15% Castro::apply_tagging_restrictions() 15 0.005906 0.006511 0.007125 0.11% MLLinOp::define() 14 0.0006252 0.003359 0.00594 0.09% MLLinOp::defineGrids() 14 0.0006085 0.003341 0.005919 0.09% FabArrayBase::getCPC() 3662 0.004941 0.005218 0.005536 0.09% MLCellLinOp::defineAuxData() 14 0.004883 0.00504 0.005497 0.09% MLLinOp::makeSubCommunicator() 14 0.0002197 0.002934 0.005478 0.08% MLCellLinOp::defineBC() 14 0.004948 0.005225 0.005453 0.08% FabArray::norminf(mask) 46 0.004629 0.00487 0.005111 0.08% Castro::sum_integrated_quantities() 1 0.004761 0.004808 0.004871 0.08% MLMG::getGradSolution() 14 0.004559 0.004676 0.00479 0.07% MLCellLinOp::compGrad() 28 0.004542 0.004659 0.004773 0.07% MLMG::mgVcycle_down::3 106 0.001327 0.001802 0.004572 0.07% MLMG::MLResNormInf() 32 0.003888 0.004012 0.00419 0.06% FabArray::norminf() 188 0.002814 0.00332 0.003935 0.06% MultiFab::max() 54 0.002807 0.003326 0.003722 0.06% MLMG::mgVcycle_up::3 106 0.00093 0.0013 0.003691 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003187 0.003391 0.003548 0.05% Castro::enforce_min_density() 33 0.003051 0.003227 0.00347 0.05% BndryData::define() 42 0.003083 0.003178 0.003282 0.05% MLMG::actualBottomSolve() 106 2.219e-05 0.0003958 0.003003 0.05% MLCGSolver::bicgstab 13 0 0.0003341 0.002672 0.04% FabArrayBase::TheFPinfo() 49 0.0003299 0.001562 0.002448 0.04% average_down_faces 84 0.002021 0.002226 0.002391 0.04% FPinfo::FPinfo() 9 0.0002602 0.001489 0.002379 0.04% MLMG::mgVcycle_down::4 106 0.001146 0.001338 0.002369 0.04% DistributionMapping::LeastUsedCPUs() 9 0.000194 0.00143 0.002333 0.04% FabArrayBase::CPC::define() 624 0.00159 0.001735 0.001996 0.03% MLMG::mgVcycle_up::4 106 0.00111 0.001245 0.001992 0.03% MLMG::MLRhsNormInf() 14 0.001708 0.001817 0.001924 0.03% Castro::volWgtSum() 46 0.00164 0.001687 0.001737 0.03% FabArray::mult() 34 0.0011 0.001249 0.001442 0.02% Castro::enforce_consistent_e() 3 0.001056 0.001221 0.001363 0.02% StateDataPhysBCFunct::() 259 0.001213 0.001246 0.001296 0.02% FabArrayBase::getFB() 5539 0.001077 0.001122 0.001247 0.02% Gravity::update_max_rhs() 1 0.0006708 0.001018 0.001197 0.02% AMRErrorTag::operator() 15 0.001093 0.001127 0.001179 0.02% StateData::FillBoundary(geom) 8 0.00106 0.001093 0.001136 0.02% Castro::build_fine_mask() 55 0.0006173 0.0006883 0.0007699 0.01% TagBoxArray::collate() 15 0.000226 0.0003017 0.0006233 0.01% DistributionMapping::KnapSackDoIt() 2 3.788e-05 0.0002642 0.0005585 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000508 0.0005307 0.0005548 0.01% MLPoisson::prepareForSolve() 14 0.0003854 0.0004071 0.0004901 0.01% MLCellLinOp::prepareForSolve() 14 0.0003729 0.000394 0.0004778 0.01% FabArray::setDomainBndry() 259 0.0003312 0.0003647 0.0003984 0.01% MLCellLinOp::setLevelBC() 28 0.0003166 0.0003377 0.0003604 0.01% MLCGSolver::ParallelAllReduce 95 0 3.864e-05 0.0003091 0.00% Castro::locWgtSum() 6 0.0002006 0.0002117 0.0002496 0.00% FabArrayBase::FB::FB() 35 7.935e-05 9.109e-05 0.0001404 0.00% amrex::Dot() 54 0 1.6e-05 0.000128 0.00% FabArray::Saxpy() 54 0 1.585e-05 0.0001268 0.00% AmrMesh-cluster 1 0 1.422e-05 0.0001138 0.00% OwnerMask() 15 8.823e-05 0.0001021 0.0001121 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.504e-05 7.791e-05 9.653e-05 0.00% Castro::volProductSum() 2 8.274e-05 8.623e-05 9.263e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.68e-05 7.734e-05 9.155e-05 0.00% makeSFC 42 4.464e-05 5.263e-05 6.368e-05 0.00% ClusterList::intersect() 1 0 7.722e-06 6.177e-05 0.00% Amr::writeSmallPlotFile() 1 3.126e-05 3.285e-05 3.498e-05 0.00% DistributionMapping::Distribute() 46 2.104e-05 2.281e-05 2.471e-05 0.00% BoxList::parallelComplementIn() 30 1.973e-05 2.174e-05 2.31e-05 0.00% ClusterList::chop() 1 0 2.693e-06 2.154e-05 0.00% FabArray::RecvLayoutMask() 14 1.548e-05 1.63e-05 1.74e-05 0.00% Castro::enforce_speed_limit() 33 1.168e-05 1.271e-05 1.405e-05 0.00% knapsack() 2 1.132e-05 1.182e-05 1.261e-05 0.00% BoxList::complementIn 30 9.747e-06 1.098e-05 1.206e-05 0.00% Amr::initSubcycle() 1 9.915e-06 1.097e-05 1.173e-05 0.00% Castro::apply_problem_tags() 15 7.631e-06 8.796e-06 1.159e-05 0.00% Castro::gwstrain() 2 1.051e-06 2.299e-06 9.114e-06 0.00% Gravity::set_mass_offset() 1 7.49e-07 2.291e-06 4.372e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 16 B 18 B 20 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.02-30-g2ecafcff4013) finalized