MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.07-32-g587542a395e4) initialized Starting run at 06:55:00 UTC on 2023-07-21. Successfully read inputs file ... Castro git describe: 23.07-16-gcd2cd9695 AMReX git describe: 23.07-32-g587542a39 Microphysics git describe: 23.07-34-g0ef8cc66 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002963683 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.116776579 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001475301 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00189546 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002373833 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001171539 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001149643 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001143634 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001137403 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001113844 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001119307 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001144592 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001142607 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001110476 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001121156 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.239060978 seconds Ending run at 06:55:06 UTC on 2023-07-21. Run time = 6.42892853 Run time without initialization = 0.0002849520001 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.429 ... 6.429 ... 6.429 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1922 1.2037 1.2218 19.00% Amr::InitAmr() 1 1.16 1.16 1.16 18.04% Castro::post_init() 2 0.9949 0.9967 0.9978 15.52% Castro::computeTemp() 36 0.6981 0.7415 0.8255 12.84% Castro::reset_internal_energy(Fab) 654 0.4024 0.4262 0.4773 7.42% FabArray::ParallelCopy_finish() 2952 0.05619 0.2808 0.3971 6.18% MLPoisson::Fsmooth() 5088 0.2323 0.2379 0.255 3.97% Castro::normalize_species() 33 0.1672 0.176 0.1906 2.96% Castro::initData() 3 0.1143 0.1293 0.1538 2.39% AmrLevel::derive() 97 0.1398 0.1422 0.1443 2.24% amrex::Copy() 975 0.1325 0.1343 0.1367 2.13% Castro::initMFs() 16 0.09994 0.1102 0.1268 1.97% FillBoundary_finish() 5552 0.04287 0.0655 0.07649 1.19% StateData::define() 64 0.05739 0.06321 0.0725 1.13% FabArray::setVal() 1769 0.04267 0.04599 0.04842 0.75% FillBoundary_nowait() 5552 0.03968 0.04287 0.04839 0.75% amrex::average_down 844 0.04247 0.04472 0.04755 0.74% MLCellLinOp::applyBC() 6294 0.0328 0.0354 0.03919 0.61% VisMF::Write(FabArray) 2 0.02999 0.0314 0.03389 0.53% FabArray::ParallelCopy_nowait() 2952 0.02382 0.02656 0.03249 0.51% Castro::estTimeStep() 1 0.02223 0.02441 0.02781 0.43% MLPoisson::Fapply() 1040 0.02425 0.02543 0.02741 0.43% Amr::regrid() 14 0.01485 0.017 0.01961 0.31% MLCellLinOp::reflux() 138 0.01796 0.01854 0.01917 0.30% MLMG::addInterpCorrection() 530 0.01703 0.01798 0.01889 0.29% FillPatchIterator::Initialize 215 0.01627 0.01715 0.01768 0.28% Castro::buildMetrics() 16 0.01253 0.01372 0.01563 0.24% FabArray::Xpay() 1013 0.01245 0.01313 0.01419 0.22% MultiFab::Multiply() 287 0.01272 0.01301 0.0134 0.21% MLCellLinOp::updateSolBC() 120 0.01094 0.01171 0.01239 0.19% MLPoisson::FFlux() 3408 0.01146 0.01193 0.01234 0.19% amrex::Add() 575 0.01072 0.01142 0.01213 0.19% MLCellLinOp::updateCorBC() 106 0.009752 0.01049 0.01106 0.17% Castro::Castro() 16 0.008885 0.009653 0.01077 0.17% FillPatchInterp(MF) 44 0.001954 0.007098 0.01074 0.17% MLLinOp::makeSubCommunicator() 14 0.001909 0.006365 0.009461 0.15% Amr::writePlotFile() 1 0.005494 0.008025 0.009073 0.14% MLMG::interpCorrection_1 106 0.006472 0.007036 0.007874 0.12% AmrMesh::MakeNewGrids() 15 0.007466 0.007556 0.007673 0.12% Castro::apply_tagging_restrictions() 15 0.005451 0.005787 0.00612 0.10% FabArray::norminf(mask) 46 0.004811 0.005001 0.005196 0.08% MLMG::prepareForSolve() 14 0.004788 0.00498 0.005144 0.08% MLMG::ResNormInf() 152 0.002842 0.003716 0.004294 0.07% MLCellLinOp::defineAuxData() 14 0.003966 0.004052 0.004273 0.07% FabArray::norminf() 174 0.003199 0.00343 0.003874 0.06% FabArrayBase::getCPC() 3662 0.003479 0.003562 0.003635 0.06% MLCellLinOp::compGrad() 28 0.003225 0.003297 0.003421 0.05% MultiFab::max() 54 0.002676 0.003169 0.003352 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002774 0.002985 0.003236 0.05% Castro::enforce_min_density() 33 0.002717 0.002874 0.003083 0.05% FabArrayBase::CPC::define() 624 0.001619 0.001898 0.003079 0.05% BndryData::define() 42 0.00228 0.00239 0.002535 0.04% Gravity::get_new_grav_vector() 4 0.001784 0.002066 0.002426 0.04% Gravity::actual_solve_with_mlmg() 14 0.001941 0.002059 0.002353 0.04% FabArray::FillBoundary() 5552 0.001937 0.002046 0.002212 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0004607 0.001353 0.002173 0.03% MLCellLinOp::defineBC() 14 0.001838 0.001946 0.002058 0.03% MLCellLinOp::smooth() 2544 0.001735 0.001818 0.00187 0.03% Castro::volWgtSum() 46 0.001672 0.001699 0.001732 0.03% FabArray::mult() 34 0.001199 0.001374 0.001674 0.03% MLCGSolver::bicgstab 13 0 0.0001937 0.00155 0.02% FabArray::ParallelCopy() 2952 0.001224 0.001273 0.00136 0.02% FillPatchTwoLevels 126 0.0007053 0.001107 0.001339 0.02% Castro::enforce_consistent_e() 3 0.0009308 0.001112 0.00132 0.02% average_down_faces 84 0.00114 0.001218 0.00131 0.02% StateData::FillBoundary(geom) 8 0.001198 0.001243 0.001294 0.02% FabArrayBase::getFB() 5552 0.0009577 0.001011 0.001146 0.02% AMRErrorTag::operator() 15 0.0009223 0.0009381 0.0009556 0.01% Gravity::actual_multilevel_solve() 14 0.00081 0.0008675 0.000909 0.01% Castro::build_fine_mask() 55 0.000652 0.0007117 0.000756 0.01% Castro::sum_integrated_quantities() 1 0.0005191 0.0005968 0.0007266 0.01% MLMG::solve() 14 0.0003954 0.000544 0.0006993 0.01% MLCellLinOp::apply() 1040 0.0004337 0.0004684 0.0006453 0.01% TagBoxArray::collate() 15 0.0002477 0.0003286 0.0005902 0.01% AmrLevel::FillPatch() 215 0.0004687 0.0005015 0.0005334 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004768 0.0004959 0.0005209 0.01% Amr::grid_places() 15 0.0003372 0.000367 0.0004707 0.01% MLMG::mgVcycle() 318 0.0004186 0.0004465 0.0004679 0.01% MLCellLinOp::correctionResidual() 755 0.0003879 0.0004144 0.0004655 0.01% main() 1 0.0003972 0.0004124 0.0004578 0.01% MLCellLinOp::prepareForSolve() 14 0.0003551 0.0003802 0.0004535 0.01% FabArray::setDomainBndry() 259 0.0004074 0.000417 0.0004344 0.01% MLMG::MLResNormInf() 32 9.813e-05 0.0002627 0.0004171 0.01% MLLinOp::defineGrids() 14 0.0002943 0.0003401 0.0004015 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003028 0.000341 0.0003743 0.01% MLCellLinOp::setLevelBC() 28 0.0003313 0.000349 0.0003656 0.01% MLMG::oneIter() 106 0.0002524 0.0002722 0.0003159 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002741 0.0002854 0.0002965 0.00% MLMG::actualBottomSolve() 106 2.278e-05 5.756e-05 0.0002824 0.00% MLMG::mgVcycle_bottom 318 0.0002169 0.0002454 0.0002788 0.00% MLCGSolver::ParallelAllReduce 81 0 3.309e-05 0.0002647 0.00% Castro::locWgtSum() 6 0.0001989 0.0002137 0.0002404 0.00% MLCellLinOp::solutionResidual() 258 0.0001871 0.0001928 0.0002019 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001599 0.0001739 0.0001933 0.00% MLMG:computeResOfCorrection() 530 0.0001507 0.0001608 0.0001751 0.00% AmrLevel::AmrLevel(dm) 16 0.0001328 0.000153 0.000168 0.00% StateDataPhysBCFunct::() 259 0.0001379 0.0001455 0.0001651 0.00% MLMG::mgVcycle_down::0 106 0.0001439 0.0001482 0.0001647 0.00% FabArrayBase::FB::FB() 35 7.652e-05 9.167e-05 0.0001486 0.00% MLMG::miniCycle() 212 8.981e-05 0.0001075 0.0001461 0.00% FillPatchSingleLevel 259 0.0001378 0.0001405 0.0001438 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001166 0.0001235 0.0001357 0.00% Gravity::update_max_rhs() 1 9.923e-05 0.0001103 0.0001325 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001072 0.0001212 0.0001273 0.00% amrex::Dot() 54 0 1.588e-05 0.000127 0.00% MLMG::mgVcycle_down::1 106 0.0001122 0.0001185 0.0001226 0.00% OwnerMask() 15 9.079e-05 0.0001002 0.0001123 0.00% MLMG::mgVcycle_down::3 106 7.536e-05 8.973e-05 0.0001097 0.00% TagBoxArray::mapPRD 15 9.444e-05 9.898e-05 0.000106 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.192e-05 8.882e-05 0.0001045 0.00% MLMG::mgVcycle_down::2 106 8.307e-05 8.993e-05 9.615e-05 0.00% FPinfo::FPinfo() 9 6.813e-05 8.009e-05 9.517e-05 0.00% Castro::volProductSum() 2 8.188e-05 8.478e-05 8.681e-05 0.00% Castro::post_regrid() 30 6.11e-05 7.287e-05 8.638e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.188e-05 6.99e-05 8.347e-05 0.00% MLMG::mgVcycle_down::4 106 7.021e-05 7.536e-05 8.325e-05 0.00% FabArray::Saxpy() 27 0 1.038e-05 8.301e-05 0.00% FabArray::LinComb() 27 0 1.017e-05 8.133e-05 0.00% MLMG::computeResidual() 106 5.416e-05 5.985e-05 7.96e-05 0.00% Castro::derive() 97 5.87e-05 6.725e-05 7.913e-05 0.00% Amr::FinalizeInit() 1 7.405e-06 2.447e-05 7.806e-05 0.00% FabArrayBase::TheFPinfo() 49 6.694e-05 7.287e-05 7.806e-05 0.00% MLMG::mgVcycle_up::0 106 6.658e-05 7.074e-05 7.67e-05 0.00% MLMG::mgVcycle_up::2 106 5.718e-05 6.435e-05 7.487e-05 0.00% Castro::clean_state() 33 6.124e-05 6.622e-05 7.401e-05 0.00% Castro::avgDown(state_indx) 60 6.688e-05 7.025e-05 7.356e-05 0.00% MLMG::mgVcycle_up::4 106 6.524e-05 6.886e-05 7.322e-05 0.00% MLMG::mgVcycle_up::3 106 5.478e-05 6.092e-05 7.302e-05 0.00% MLMG::mgVcycle_up::1 106 6.016e-05 6.275e-05 6.652e-05 0.00% Castro::errorEst() 15 4.453e-05 5.061e-05 6.569e-05 0.00% ClusterList::intersect() 1 0 6.798e-06 5.438e-05 0.00% MLMG::computeMLResidual() 32 3.916e-05 4.472e-05 5.377e-05 0.00% makeSFC 42 2.694e-05 3.613e-05 5.312e-05 0.00% MLPoisson::define() 14 3.94e-05 4.318e-05 4.831e-05 0.00% Castro::init(old) 13 4.059e-05 4.519e-05 4.77e-05 0.00% amrex::average_down_w_geom 60 3.949e-05 4.36e-05 4.707e-05 0.00% Castro::avgDown() 15 3.484e-05 4.114e-05 4.655e-05 0.00% DistributionMapping::Distribute() 46 2.188e-05 2.567e-05 3.404e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.15e-05 2.474e-05 3.384e-05 0.00% Amr::writeSmallPlotFile() 1 2.814e-05 2.94e-05 3.044e-05 0.00% Amr::defBaseLevel() 1 1.367e-05 1.81e-05 2.873e-05 0.00% AmrMesh-cluster 1 0 3.202e-06 2.561e-05 0.00% FabArray::RecvLayoutMask() 14 1.651e-05 1.798e-05 2.43e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.469e-05 2.159e-05 2.419e-05 0.00% MLLinOp::define() 14 1.63e-05 1.859e-05 2.115e-05 0.00% Castro::enforce_speed_limit() 33 1.093e-05 1.32e-05 1.959e-05 0.00% MLMG::getGradSolution() 14 1.713e-05 1.824e-05 1.956e-05 0.00% Amr::bldFineLevels() 1 1.382e-05 1.609e-05 1.742e-05 0.00% ClusterList::chop() 1 0 2.131e-06 1.705e-05 0.00% MLPoisson::prepareForSolve() 14 1.164e-05 1.285e-05 1.387e-05 0.00% BoxList::complementIn 30 1.028e-05 1.176e-05 1.364e-05 0.00% knapsack() 2 1.016e-05 1.129e-05 1.241e-05 0.00% BoxList::parallelComplementIn() 30 1.053e-05 1.12e-05 1.232e-05 0.00% Amr::initSubcycle() 1 8.725e-06 9.67e-06 1.013e-05 0.00% MLMG::MLRhsNormInf() 14 8.651e-06 9.198e-06 9.551e-06 0.00% Castro::apply_problem_tags() 15 7.598e-06 8.246e-06 8.954e-06 0.00% DistributionMapping::KnapSackDoIt() 2 3.719e-06 4.351e-06 4.947e-06 0.00% Amr::InitializeInit() 1 1.823e-06 2.33e-06 3.795e-06 0.00% Gravity::set_mass_offset() 1 8.84e-07 1.643e-06 3.36e-06 0.00% Castro::computeInitialDt() 1 1.501e-06 1.905e-06 2.679e-06 0.00% Amr::init() 1 1.558e-06 2.103e-06 2.486e-06 0.00% Amr::initialInit() 1 1.107e-06 1.405e-06 2.013e-06 0.00% Castro::gwstrain() 2 8.24e-07 1.131e-06 1.419e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.429 6.429 6.429 100.00% Amr::init() 1 5.268 5.269 5.269 81.95% Amr::initialInit() 1 5.029 5.029 5.029 78.23% Amr::FinalizeInit() 1 4.918 4.92 4.923 76.58% Castro::post_init() 2 3.662 3.787 3.858 60.01% Gravity::multilevel_solve_for_new_phi() 14 1.851 1.862 1.881 29.26% Gravity::actual_multilevel_solve() 14 1.848 1.86 1.878 29.21% Gravity::solve_phi_with_mlmg() 14 1.84 1.851 1.87 29.08% Castro::computeTemp() 36 1.102 1.168 1.303 20.27% Amr::regrid() 14 1.223 1.233 1.269 19.74% Castro::clean_state() 33 1.067 1.119 1.226 19.06% Gravity::fill_multipole_BCs() 14 1.194 1.205 1.223 19.03% Amr::InitAmr() 1 1.16 1.16 1.16 18.04% Amr::bldFineLevels() 1 0.9 0.9566 1.057 16.44% Castro::post_regrid() 30 0.826 0.8501 0.9058 14.09% Castro::initData() 3 0.5732 0.6396 0.7586 11.80% Gravity::actual_solve_with_mlmg() 14 0.6409 0.6451 0.6482 10.08% MLMG::solve() 14 0.6205 0.6211 0.6213 9.66% MLMG::oneIter() 106 0.5454 0.547 0.5489 8.54% Castro::reset_internal_energy(MultiFab) 36 0.4028 0.4266 0.4776 7.43% Castro::reset_internal_energy(Fab) 654 0.4024 0.4262 0.4773 7.42% FabArray::ParallelCopy() 2952 0.1172 0.3364 0.4533 7.05% MLMG::mgVcycle() 318 0.4103 0.4112 0.4132 6.43% FabArray::ParallelCopy_finish() 2952 0.05619 0.2808 0.3971 6.18% MLCellLinOp::smooth() 2544 0.3393 0.3417 0.3482 5.42% amrex::average_down 844 0.07402 0.1994 0.2716 4.22% MLPoisson::Fsmooth() 5088 0.2323 0.2379 0.255 3.97% Castro::avgDown() 15 0.04359 0.1684 0.2394 3.72% Castro::avgDown(state_indx) 60 0.04355 0.1683 0.2394 3.72% amrex::average_down_w_geom 60 0.04348 0.1682 0.2393 3.72% Amr::writePlotFile() 1 0.2392 0.2393 0.2393 3.72% Castro::derive() 97 0.2004 0.2008 0.2012 3.13% AmrLevel::derive() 97 0.2004 0.2007 0.2011 3.13% Castro::normalize_species() 33 0.1672 0.176 0.1906 2.96% Castro::Castro() 16 0.1401 0.1538 0.1734 2.70% MLCellLinOp::applyBC() 6294 0.134 0.1469 0.1546 2.40% amrex::Copy() 975 0.1325 0.1343 0.1367 2.13% Amr::grid_places() 15 0.01999 0.09246 0.1362 2.12% AmrMesh::MakeNewGrids() 15 0.01952 0.09209 0.1358 2.11% Castro::initMFs() 16 0.09994 0.1102 0.1268 1.97% FabArray::FillBoundary() 5552 0.09477 0.1115 0.1218 1.89% AmrLevel::FillPatch() 215 0.1132 0.1169 0.1208 1.88% TagBoxArray::mapPRD 15 0.001952 0.07445 0.1186 1.84% MLMG::mgVcycle_down::0 106 0.1144 0.1155 0.1166 1.81% MLMG::mgVcycle_bottom 318 0.1094 0.1106 0.1154 1.80% MLMG::miniCycle() 212 0.1095 0.1103 0.1117 1.74% Amr::InitializeInit() 1 0.1059 0.1093 0.1115 1.73% Amr::defBaseLevel() 1 0.1059 0.1093 0.1115 1.73% MLMG::mgVcycle_up::0 106 0.1031 0.1034 0.1038 1.62% FillPatchIterator::Initialize 215 0.0874 0.09101 0.0945 1.47% FillBoundary_finish() 5552 0.04287 0.0655 0.07649 1.19% MLMG::computeResWithCrseSolFineCor() 106 0.07269 0.07403 0.0751 1.17% AmrLevel::AmrLevel(dm) 16 0.05754 0.06337 0.07263 1.13% StateData::define() 64 0.05739 0.06321 0.0725 1.13% MLCellLinOp::apply() 1040 0.06062 0.06189 0.06318 0.98% MLCellLinOp::correctionResidual() 755 0.05934 0.06005 0.0608 0.95% FabArray::ParallelCopy_nowait() 2952 0.05169 0.0543 0.05968 0.93% FillPatchSingleLevel 259 0.04982 0.05456 0.05965 0.93% MLCellLinOp::solutionResidual() 258 0.05439 0.0572 0.05962 0.93% MLCellLinOp::reflux() 138 0.04859 0.05033 0.05116 0.80% FillPatchIterator::FillFromTwoLevels() 126 0.04461 0.04726 0.04982 0.77% FillPatchTwoLevels 126 0.04449 0.04714 0.0497 0.77% FillBoundary_nowait() 5552 0.04072 0.04397 0.04969 0.77% FabArray::setVal() 1769 0.04267 0.04599 0.04842 0.75% Castro::init(old) 13 0.04347 0.04536 0.04732 0.74% VisMF::Write(FabArray) 2 0.02999 0.0314 0.03389 0.53% MLMG::computeResWithCrseCorFineCor() 106 0.03246 0.03333 0.03376 0.53% MLMG::addInterpCorrection() 530 0.02044 0.03077 0.03271 0.51% MLMG::computeResidual() 106 0.02829 0.03012 0.03175 0.49% FillPatchIterator::FillFromLevel0() 89 0.0246 0.02623 0.02785 0.43% Castro::computeInitialDt() 1 0.02223 0.02441 0.02781 0.43% Castro::estTimeStep() 1 0.02223 0.02441 0.02781 0.43% MLPoisson::Fapply() 1040 0.02425 0.02543 0.02741 0.43% MLMG::mgVcycle_down::1 106 0.02367 0.02459 0.0253 0.39% MLCellLinOp::updateSolBC() 120 0.02037 0.0225 0.0243 0.38% MLMG::mgVcycle_up::2 106 0.009326 0.02069 0.02264 0.35% MLMG::computeMLResidual() 32 0.02072 0.02125 0.02185 0.34% MLMG::mgVcycle_up::1 106 0.0205 0.02062 0.02073 0.32% MLPoisson::define() 14 0.01304 0.017 0.02002 0.31% MLCellLinOp::updateCorBC() 106 0.01802 0.01918 0.0197 0.31% MLMG:computeResOfCorrection() 530 0.01812 0.01857 0.01932 0.30% Gravity::get_new_grav_vector() 4 0.01756 0.01837 0.01894 0.29% Castro::buildMetrics() 16 0.01398 0.01531 0.01741 0.27% FabArray::Xpay() 1013 0.01245 0.01313 0.01419 0.22% MultiFab::Multiply() 287 0.01272 0.01301 0.0134 0.21% MLPoisson::FFlux() 3408 0.01146 0.01193 0.01234 0.19% amrex::Add() 575 0.01072 0.01142 0.01213 0.19% MLMG::interpCorrection_1 106 0.00966 0.01075 0.01163 0.18% FillPatchInterp(MF) 44 0.001954 0.007098 0.01074 0.17% MLMG::ResNormInf() 152 0.009667 0.01026 0.01066 0.17% MLMG::prepareForSolve() 14 0.009461 0.009812 0.01037 0.16% MLMG::mgVcycle_down::2 106 0.00931 0.009485 0.01006 0.16% MLLinOp::define() 14 0.002312 0.006804 0.009973 0.16% MLLinOp::defineGrids() 14 0.002295 0.006786 0.009953 0.15% Castro::errorEst() 15 0.009143 0.009516 0.009845 0.15% MLLinOp::makeSubCommunicator() 14 0.001909 0.006365 0.009461 0.15% FabArrayBase::getCPC() 3662 0.005098 0.00546 0.006666 0.10% Castro::apply_tagging_restrictions() 15 0.005451 0.005787 0.00612 0.10% Gravity::average_fine_ec_onto_crse_ec() 14 0.005593 0.005779 0.005925 0.09% MLCellLinOp::defineAuxData() 14 0.004978 0.005123 0.005492 0.09% FabArray::norminf(mask) 46 0.004811 0.005001 0.005196 0.08% MLCellLinOp::defineBC() 14 0.004909 0.005034 0.005195 0.08% Castro::sum_integrated_quantities() 1 0.004885 0.004943 0.005063 0.08% MLMG::mgVcycle_down::3 106 0.001316 0.001827 0.00479 0.07% MLMG::getGradSolution() 14 0.004538 0.004593 0.004725 0.07% MLCellLinOp::compGrad() 28 0.004519 0.004575 0.004707 0.07% average_down_faces 84 0.002042 0.003023 0.00458 0.07% MLMG::MLResNormInf() 32 0.004017 0.004068 0.004191 0.07% MLMG::actualBottomSolve() 106 2.278e-05 0.0005106 0.003907 0.06% FabArray::norminf() 174 0.003199 0.00343 0.003874 0.06% MLMG::mgVcycle_up::3 106 0.0009571 0.001355 0.00385 0.06% MLCGSolver::bicgstab 13 0 0.0004462 0.003569 0.06% MultiFab::max() 54 0.002676 0.003169 0.003352 0.05% BndryData::define() 42 0.002832 0.002958 0.003123 0.05% Castro::enforce_min_density() 33 0.002717 0.002874 0.003083 0.05% FabArrayBase::CPC::define() 624 0.001619 0.001898 0.003079 0.05% MLMG::mgVcycle_down::4 106 0.00114 0.001351 0.002429 0.04% FabArrayBase::TheFPinfo() 49 0.0006004 0.00148 0.002305 0.04% FPinfo::FPinfo() 9 0.0005223 0.001407 0.002231 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0004607 0.001353 0.002173 0.03% MLMG::mgVcycle_up::4 106 0.001097 0.001261 0.002018 0.03% MLMG::MLRhsNormInf() 14 0.001812 0.001879 0.001972 0.03% Castro::volWgtSum() 46 0.001677 0.001704 0.001737 0.03% FabArray::mult() 34 0.001199 0.001374 0.001674 0.03% StateDataPhysBCFunct::() 259 0.001335 0.001388 0.001435 0.02% Castro::enforce_consistent_e() 3 0.0009308 0.001112 0.00132 0.02% FabArrayBase::getFB() 5552 0.001036 0.001103 0.001294 0.02% StateData::FillBoundary(geom) 8 0.001198 0.001243 0.001294 0.02% Gravity::update_max_rhs() 1 0.0006157 0.0009146 0.00109 0.02% AMRErrorTag::operator() 15 0.0009223 0.0009381 0.0009556 0.01% Castro::build_fine_mask() 55 0.000652 0.0007117 0.000756 0.01% DistributionMapping::KnapSackDoIt() 2 4.067e-05 0.0003675 0.0006319 0.01% TagBoxArray::collate() 15 0.0002477 0.0003286 0.0005902 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004768 0.0004959 0.0005209 0.01% MLPoisson::prepareForSolve() 14 0.000367 0.0003931 0.0004664 0.01% MLCellLinOp::prepareForSolve() 14 0.0003551 0.0003802 0.0004535 0.01% FabArray::setDomainBndry() 259 0.0004074 0.000417 0.0004344 0.01% MLCellLinOp::setLevelBC() 28 0.0003313 0.000349 0.0003656 0.01% MLCGSolver::ParallelAllReduce 81 0 4.223e-05 0.0003378 0.01% Castro::locWgtSum() 6 0.0001993 0.0002143 0.000241 0.00% FabArrayBase::FB::FB() 35 7.652e-05 9.167e-05 0.0001486 0.00% amrex::Dot() 54 0 1.588e-05 0.000127 0.00% OwnerMask() 15 9.079e-05 0.0001002 0.0001123 0.00% MLLinOp::makeAgglomeratedDMap 14 6.97e-05 8.097e-05 9.805e-05 0.00% AmrMesh-cluster 1 0 1.213e-05 9.704e-05 0.00% Castro::volProductSum() 2 8.207e-05 8.497e-05 8.701e-05 0.00% FabArray::Saxpy() 27 0 1.038e-05 8.301e-05 0.00% FabArray::LinComb() 27 0 1.017e-05 8.133e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.218e-05 6.934e-05 8.08e-05 0.00% makeSFC 42 4.821e-05 5.623e-05 7.212e-05 0.00% ClusterList::intersect() 1 0 6.798e-06 5.438e-05 0.00% DistributionMapping::Distribute() 46 2.188e-05 2.567e-05 3.404e-05 0.00% Amr::writeSmallPlotFile() 1 2.814e-05 2.94e-05 3.044e-05 0.00% BoxList::parallelComplementIn() 30 2.118e-05 2.297e-05 2.44e-05 0.00% FabArray::RecvLayoutMask() 14 1.651e-05 1.798e-05 2.43e-05 0.00% Castro::enforce_speed_limit() 33 1.093e-05 1.32e-05 1.959e-05 0.00% ClusterList::chop() 1 0 2.131e-06 1.705e-05 0.00% BoxList::complementIn 30 1.028e-05 1.176e-05 1.364e-05 0.00% knapsack() 2 1.016e-05 1.129e-05 1.241e-05 0.00% Amr::initSubcycle() 1 8.725e-06 9.67e-06 1.013e-05 0.00% Castro::apply_problem_tags() 15 7.598e-06 8.246e-06 8.954e-06 0.00% Gravity::set_mass_offset() 1 8.84e-07 1.643e-06 3.36e-06 0.00% Castro::gwstrain() 2 8.24e-07 1.131e-06 1.419e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 18 B 23 B 46 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.07-32-g587542a395e4) finalized