MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.07-4-g9fc635426cae) initialized Starting run at 18:20:46 UTC on 2023-07-03. Successfully read inputs file ... Castro git describe: 23.07 AMReX git describe: 23.07-4-g9fc635426 Microphysics git describe: 23.07-10-g139855b1 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002956984 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.117331191 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001770282 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002058258 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001128486 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001087957 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001178771 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001099473 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002043517 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001097422 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001456529 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001103987 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001162032 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001107017 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001142683 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.23849512 seconds Ending run at 18:20:52 UTC on 2023-07-03. Run time = 6.508433738 Run time without initialization = 0.0002695859998 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.508 ... 6.508 ... 6.508 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2486 1.2486 1.2487 19.19% Gravity::fill_multipole_BCs() 14 1.167 1.178 1.193 18.33% Castro::post_init() 2 0.9947 0.9958 0.9969 15.32% Castro::computeTemp() 36 0.6981 0.7462 0.8259 12.69% Castro::reset_internal_energy(Fab) 654 0.3954 0.4251 0.4692 7.21% FabArray::ParallelCopy_finish() 2952 0.06715 0.28 0.4012 6.16% MLPoisson::Fsmooth() 5088 0.2272 0.2371 0.253 3.89% Castro::normalize_species() 33 0.1654 0.1744 0.1901 2.92% Castro::initData() 3 0.1157 0.1306 0.1513 2.33% Castro::derive() 97 0.1399 0.142 0.1442 2.22% amrex::Copy() 975 0.1317 0.1347 0.1375 2.11% Castro::initMFs() 16 0.09984 0.1102 0.1262 1.94% FillBoundary_finish() 5552 0.05602 0.07683 0.09157 1.41% StateData::define() 64 0.05679 0.06275 0.07324 1.13% FabArray::setVal() 1769 0.04034 0.0503 0.05507 0.85% amrex::average_down 844 0.04407 0.04779 0.05228 0.80% FillBoundary_nowait() 5552 0.03966 0.04206 0.04552 0.70% MLCellLinOp::applyBC() 6294 0.03543 0.03759 0.04206 0.65% VisMF::Write(FabArray) 2 0.03021 0.03093 0.03303 0.51% FabArray::ParallelCopy_nowait() 2952 0.02419 0.02631 0.03131 0.48% MLPoisson::Fapply() 1040 0.02373 0.02506 0.02691 0.41% Castro::estTimeStep() 1 0.02212 0.02362 0.02529 0.39% Amr::regrid() 14 0.01389 0.01577 0.01958 0.30% MLMG::addInterpCorrection() 530 0.01722 0.01794 0.01904 0.29% FillPatchIterator::Initialize 215 0.01548 0.01727 0.01816 0.28% MLCellLinOp::reflux() 138 0.0158 0.01647 0.0172 0.26% Castro::buildMetrics() 16 0.01232 0.01363 0.01563 0.24% FabArray::Xpay() 1013 0.01205 0.01324 0.01488 0.23% MultiFab::Multiply() 287 0.0128 0.01311 0.01421 0.22% amrex::Add() 575 0.01089 0.01164 0.01301 0.20% MLPoisson::FFlux() 3408 0.01121 0.0118 0.01238 0.19% MLCellLinOp::updateSolBC() 120 0.0108 0.01165 0.01236 0.19% Castro::Castro() 16 0.008572 0.009619 0.01128 0.17% MLCellLinOp::updateCorBC() 106 0.0095 0.01046 0.01113 0.17% FillPatchInterp(MF) 44 0.001698 0.006506 0.009826 0.15% Amr::writePlotFile() 1 0.005635 0.008208 0.009206 0.14% MLLinOp::makeSubCommunicator() 14 0.003902 0.006637 0.008941 0.14% MLMG::interpCorrection_1 106 0.006405 0.007034 0.007828 0.12% AmrMesh::MakeNewGrids() 15 0.00744 0.007567 0.007718 0.12% Castro::apply_tagging_restrictions() 15 0.005563 0.005892 0.006068 0.09% FabArray::norminf(mask) 46 0.004799 0.005025 0.005425 0.08% MLMG::prepareForSolve() 14 0.004753 0.005041 0.005196 0.08% MLMG::ResNormInf() 152 0.002662 0.004078 0.005047 0.08% MLCellLinOp::defineAuxData() 14 0.003862 0.004009 0.004274 0.07% FabArray::norminf() 174 0.002972 0.003376 0.003984 0.06% MultiFab::max() 54 0.002926 0.003445 0.003941 0.06% FabArrayBase::getCPC() 3662 0.003522 0.003614 0.00373 0.06% MLCellLinOp::compGrad() 28 0.003231 0.003333 0.003459 0.05% Castro::enforce_min_density() 33 0.002743 0.002874 0.003073 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002662 0.002841 0.003003 0.05% Gravity::get_new_grav_vector() 4 0.001905 0.002219 0.002615 0.04% DistributionMapping::LeastUsedCPUs() 9 0.000197 0.001511 0.002555 0.04% BndryData::define() 42 0.00228 0.002373 0.002533 0.04% Gravity::actual_solve_with_mlmg() 14 0.001923 0.002067 0.00241 0.04% MLCellLinOp::defineBC() 14 0.001864 0.001989 0.002185 0.03% FabArray::FillBoundary() 5552 0.001916 0.002021 0.002163 0.03% FabArrayBase::CPC::define() 624 0.001555 0.001747 0.002019 0.03% MLCellLinOp::smooth() 2544 0.001637 0.001705 0.001782 0.03% Castro::volWgtSum() 46 0.00164 0.001679 0.001704 0.03% MLCGSolver::bicgstab 13 0 0.0001933 0.001547 0.02% FabArray::mult() 34 0.001113 0.001307 0.001514 0.02% Castro::enforce_consistent_e() 3 0.001001 0.001189 0.001472 0.02% FillPatchTwoLevels 126 0.0006736 0.001141 0.00139 0.02% StateData::FillBoundary(geom) 8 0.001228 0.001274 0.001336 0.02% FabArray::ParallelCopy() 2952 0.001216 0.001253 0.001312 0.02% average_down_faces 84 0.001098 0.001205 0.0013 0.02% FabArrayBase::getFB() 5552 0.001041 0.001073 0.001168 0.02% MLMG::solve() 14 0.0005127 0.0008117 0.001066 0.02% AMRErrorTag::operator() 15 0.0009258 0.0009526 0.0009784 0.02% Castro::sum_integrated_quantities() 1 0.000766 0.0008682 0.0009617 0.01% Gravity::actual_multilevel_solve() 14 0.0007869 0.000857 0.0009171 0.01% Castro::build_fine_mask() 55 0.0006914 0.0007402 0.0007997 0.01% TagBoxArray::collate() 15 0.0002345 0.0003152 0.0006373 0.01% MLCellLinOp::apply() 1040 0.0004415 0.0004807 0.0006158 0.01% MLMG::mgVcycle() 318 0.000423 0.0004543 0.0005467 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004662 0.0004919 0.0005371 0.01% MLCellLinOp::correctionResidual() 755 0.0004088 0.0004356 0.0004919 0.01% Amr::grid_places() 15 0.000353 0.0003792 0.0004762 0.01% MLCellLinOp::prepareForSolve() 14 0.0003566 0.0003811 0.0004666 0.01% main() 1 0.0003614 0.0004021 0.0004486 0.01% FabArray::setDomainBndry() 259 0.0003791 0.0004109 0.0004288 0.01% MLLinOp::defineGrids() 14 0.0002862 0.0003223 0.0004029 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002767 0.0003208 0.0003984 0.01% MLCellLinOp::setLevelBC() 28 0.0003442 0.0003517 0.0003644 0.01% MLMG::actualBottomSolve() 106 2.326e-05 6.455e-05 0.0003388 0.01% MLMG::MLResNormInf() 32 0.0001232 0.0002412 0.0003358 0.01% MLMG::oneIter() 106 0.0002591 0.0002828 0.0003214 0.00% MLCGSolver::ParallelAllReduce 81 0 4.009e-05 0.0003207 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002727 0.000286 0.0002997 0.00% MLMG::mgVcycle_bottom 318 0.0002464 0.0002592 0.0002764 0.00% MLCellLinOp::solutionResidual() 258 0.000185 0.000197 0.0002131 0.00% Castro::locWgtSum() 6 0.0001826 0.0001891 0.0002092 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001686 0.0001782 0.0001989 0.00% Castro::init(old) 13 0.000154 0.0001701 0.0001957 0.00% MLMG:computeResOfCorrection() 530 0.0001611 0.000171 0.0001819 0.00% AmrLevel::AmrLevel(dm) 16 0.0001598 0.00017 0.0001814 0.00% FillPatchSingleLevel 259 0.00017 0.0001731 0.0001796 0.00% StateDataPhysBCFunct::() 259 0.0001506 0.0001571 0.0001771 0.00% FabArrayBase::FB::FB() 35 7.904e-05 0.000102 0.000161 0.00% MLMG::mgVcycle_down::0 106 0.0001347 0.000144 0.0001576 0.00% MLMG::miniCycle() 212 8.842e-05 0.0001124 0.0001563 0.00% Gravity::update_max_rhs() 1 6.939e-05 9.477e-05 0.000139 0.00% amrex::Dot() 54 0 1.697e-05 0.0001357 0.00% MLMG::mgVcycle_down::1 106 0.0001129 0.0001207 0.0001281 0.00% OwnerMask() 15 8.934e-05 9.793e-05 0.0001145 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.656e-05 9.307e-05 0.00011 0.00% TagBoxArray::mapPRD 15 9.244e-05 9.563e-05 9.985e-05 0.00% Amr::FinalizeInit() 1 7.147e-06 2.21e-05 9.77e-05 0.00% Castro::volProductSum() 2 8.09e-05 8.519e-05 9.65e-05 0.00% MLMG::mgVcycle_down::3 106 7.651e-05 8.378e-05 9.622e-05 0.00% FPinfo::FPinfo() 9 7.505e-05 8.828e-05 9.524e-05 0.00% MLMG::mgVcycle_down::2 106 8.458e-05 8.933e-05 9.343e-05 0.00% Castro::post_regrid() 30 5.982e-05 6.648e-05 8.929e-05 0.00% FabArray::LinComb() 27 0 1.115e-05 8.924e-05 0.00% MLMG::mgVcycle_down::4 106 6.999e-05 7.512e-05 8.853e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.613e-05 7.278e-05 8.552e-05 0.00% MLMG::mgVcycle_up::4 106 6.563e-05 7.228e-05 8.031e-05 0.00% Castro::clean_state() 33 6.263e-05 6.688e-05 8.015e-05 0.00% MLMG::mgVcycle_up::0 106 6.843e-05 7.291e-05 7.897e-05 0.00% FabArray::Saxpy() 27 0 9.797e-06 7.837e-05 0.00% Castro::avgDown(state_indx) 60 6.879e-05 7.189e-05 7.497e-05 0.00% MLMG::mgVcycle_up::1 106 5.831e-05 6.294e-05 7.269e-05 0.00% FabArrayBase::TheFPinfo() 49 5.924e-05 6.56e-05 6.892e-05 0.00% MLMG::computeMLResidual() 32 3.609e-05 4.265e-05 6.552e-05 0.00% MLMG::computeResidual() 106 5.769e-05 6.048e-05 6.45e-05 0.00% MLMG::mgVcycle_up::3 106 5.68e-05 5.935e-05 6.386e-05 0.00% ClusterList::intersect() 1 0 7.957e-06 6.366e-05 0.00% MLMG::mgVcycle_up::2 106 5.262e-05 5.604e-05 6.117e-05 0.00% Castro::avgDown() 15 3.279e-05 3.938e-05 6.01e-05 0.00% MLPoisson::define() 14 3.934e-05 4.51e-05 5.269e-05 0.00% Castro::errorEst() 15 4.415e-05 4.723e-05 5.043e-05 0.00% amrex::average_down_w_geom 60 4.075e-05 4.421e-05 4.726e-05 0.00% makeSFC 42 2.72e-05 3.384e-05 4.046e-05 0.00% Amr::bldFineLevels() 1 1.415e-05 1.828e-05 3.717e-05 0.00% Amr::defBaseLevel() 1 1.793e-05 2.487e-05 3.287e-05 0.00% Amr::writeSmallPlotFile() 1 2.983e-05 3.05e-05 3.119e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.134e-05 2.474e-05 2.878e-05 0.00% DistributionMapping::Distribute() 46 2.192e-05 2.589e-05 2.862e-05 0.00% AmrMesh-cluster 1 0 3.541e-06 2.833e-05 0.00% ClusterList::chop() 1 0 3.149e-06 2.519e-05 0.00% MLPoisson::prepareForSolve() 14 1.227e-05 1.483e-05 2.424e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.547e-05 2.029e-05 2.391e-05 0.00% MLLinOp::define() 14 1.424e-05 1.792e-05 2.107e-05 0.00% MLMG::getGradSolution() 14 1.749e-05 1.903e-05 2.021e-05 0.00% FabArray::RecvLayoutMask() 14 1.633e-05 1.709e-05 1.773e-05 0.00% DistributionMapping::KnapSackDoIt() 2 4.592e-06 6.136e-06 1.438e-05 0.00% Castro::enforce_speed_limit() 33 1.177e-05 1.282e-05 1.369e-05 0.00% BoxList::complementIn 30 1.01e-05 1.158e-05 1.364e-05 0.00% BoxList::parallelComplementIn() 30 1.106e-05 1.171e-05 1.275e-05 0.00% knapsack() 2 1.083e-05 1.158e-05 1.272e-05 0.00% MLMG::MLRhsNormInf() 14 8.551e-06 9.426e-06 1.125e-05 0.00% Amr::init() 1 1.564e-06 2.941e-06 1.086e-05 0.00% Amr::initSubcycle() 1 8.758e-06 9.819e-06 1.073e-05 0.00% Castro::apply_problem_tags() 15 7.297e-06 8.057e-06 9.247e-06 0.00% Gravity::set_mass_offset() 1 8.4e-07 3.053e-06 5.971e-06 0.00% Amr::InitializeInit() 1 1.953e-06 2.39e-06 4.006e-06 0.00% Castro::computeInitialDt() 1 1.749e-06 2.059e-06 2.326e-06 0.00% Amr::initialInit() 1 1.184e-06 1.405e-06 1.787e-06 0.00% Castro::gwstrain() 2 8.46e-07 1.067e-06 1.753e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.508 6.508 6.508 100.00% Amr::init() 1 5.259 5.259 5.259 80.81% Amr::initialInit() 1 5.021 5.021 5.021 77.14% Amr::FinalizeInit() 1 4.911 4.912 4.914 75.50% Castro::post_init() 2 3.656 3.773 3.848 59.13% Gravity::multilevel_solve_for_new_phi() 14 1.836 1.849 1.864 28.63% Gravity::actual_multilevel_solve() 14 1.833 1.846 1.861 28.59% Gravity::solve_phi_with_mlmg() 14 1.827 1.839 1.854 28.49% Castro::computeTemp() 36 1.094 1.172 1.295 19.89% Amr::regrid() 14 1.201 1.237 1.274 19.58% Amr::InitAmr() 1 1.249 1.249 1.249 19.19% Castro::clean_state() 33 1.06 1.123 1.223 18.79% Gravity::fill_multipole_BCs() 14 1.168 1.18 1.194 18.35% Amr::bldFineLevels() 1 0.903 0.9625 1.056 16.22% Castro::post_regrid() 30 0.8083 0.8513 0.9068 13.93% Castro::initData() 3 0.5731 0.6434 0.7533 11.57% Gravity::actual_solve_with_mlmg() 14 0.6564 0.659 0.6612 10.16% MLMG::solve() 14 0.6339 0.6347 0.635 9.76% MLMG::oneIter() 106 0.5576 0.5582 0.5592 8.59% Castro::reset_internal_energy(MultiFab) 36 0.3958 0.4254 0.4695 7.21% Castro::reset_internal_energy(Fab) 654 0.3954 0.4251 0.4692 7.21% FabArray::ParallelCopy() 2952 0.1266 0.335 0.4578 7.03% MLMG::mgVcycle() 318 0.4189 0.4203 0.4219 6.48% FabArray::ParallelCopy_finish() 2952 0.06715 0.28 0.4012 6.16% MLCellLinOp::smooth() 2544 0.3502 0.3528 0.3587 5.51% amrex::average_down 844 0.08198 0.198 0.2737 4.21% MLPoisson::Fsmooth() 5088 0.2272 0.2371 0.253 3.89% Castro::avgDown() 15 0.0476 0.1652 0.2401 3.69% Castro::avgDown(state_indx) 60 0.04757 0.1651 0.24 3.69% amrex::average_down_w_geom 60 0.0475 0.1651 0.24 3.69% Amr::writePlotFile() 1 0.2386 0.2388 0.2388 3.67% Castro::derive() 97 0.2002 0.2004 0.2008 3.08% Castro::normalize_species() 33 0.1654 0.1744 0.1901 2.92% Castro::Castro() 16 0.1383 0.1565 0.1773 2.72% MLCellLinOp::applyBC() 6294 0.1471 0.1597 0.1712 2.63% amrex::Copy() 975 0.1317 0.1347 0.1375 2.11% Amr::grid_places() 15 0.02068 0.09169 0.1367 2.10% AmrMesh::MakeNewGrids() 15 0.02029 0.09132 0.1364 2.10% FabArray::FillBoundary() 5552 0.105 0.1221 0.1357 2.09% Castro::initMFs() 16 0.09984 0.1102 0.1262 1.94% MLMG::mgVcycle_down::0 106 0.1171 0.1179 0.1207 1.85% TagBoxArray::mapPRD 15 0.00235 0.07356 0.119 1.83% MLMG::mgVcycle_bottom 318 0.1112 0.1122 0.1171 1.80% MLMG::miniCycle() 212 0.1113 0.1119 0.1133 1.74% Amr::InitializeInit() 1 0.1066 0.1082 0.1097 1.69% Amr::defBaseLevel() 1 0.1066 0.1082 0.1097 1.69% MLMG::mgVcycle_up::0 106 0.107 0.1073 0.1076 1.65% FillPatchIterator::Initialize 215 0.09232 0.09485 0.1002 1.54% FillBoundary_finish() 5552 0.05602 0.07683 0.09157 1.41% MLMG::computeResWithCrseSolFineCor() 106 0.07536 0.07669 0.07758 1.19% AmrLevel::AmrLevel(dm) 16 0.05697 0.06292 0.07341 1.13% StateData::define() 64 0.05679 0.06275 0.07324 1.13% FillPatchSingleLevel 259 0.05316 0.05816 0.06505 1.00% MLCellLinOp::apply() 1040 0.05996 0.0613 0.06317 0.97% MLCellLinOp::solutionResidual() 258 0.05689 0.05868 0.06041 0.93% MLCellLinOp::correctionResidual() 755 0.05784 0.05913 0.06018 0.92% FabArray::ParallelCopy_nowait() 2952 0.05027 0.0537 0.05812 0.89% FabArray::setVal() 1769 0.04034 0.0503 0.05507 0.85% FillPatchTwoLevels 126 0.04694 0.05025 0.0543 0.83% MLCellLinOp::reflux() 138 0.04743 0.0495 0.05237 0.80% Castro::init(old) 13 0.04584 0.04818 0.05181 0.80% FillBoundary_nowait() 5552 0.04082 0.04323 0.04684 0.72% MLMG::addInterpCorrection() 530 0.02032 0.03075 0.03335 0.51% VisMF::Write(FabArray) 2 0.03021 0.03093 0.03303 0.51% MLMG::computeResWithCrseCorFineCor() 106 0.03117 0.03202 0.03291 0.51% MLMG::computeResidual() 106 0.02967 0.03088 0.03164 0.49% MLPoisson::Fapply() 1040 0.02373 0.02506 0.02691 0.41% MLMG::mgVcycle_down::1 106 0.02448 0.02548 0.0261 0.40% Castro::computeInitialDt() 1 0.02212 0.02363 0.02529 0.39% Castro::estTimeStep() 1 0.02212 0.02362 0.02529 0.39% MLCellLinOp::updateSolBC() 120 0.0224 0.02335 0.02424 0.37% MLMG::mgVcycle_up::2 106 0.009337 0.0207 0.02255 0.35% MLMG::computeMLResidual() 32 0.02082 0.02141 0.02201 0.34% MLMG::mgVcycle_up::1 106 0.02075 0.02088 0.02099 0.32% MLCellLinOp::updateCorBC() 106 0.01808 0.01935 0.02027 0.31% Gravity::get_new_grav_vector() 4 0.01805 0.01922 0.02007 0.31% MLMG:computeResOfCorrection() 530 0.01825 0.01872 0.01999 0.31% MLPoisson::define() 14 0.01453 0.01727 0.01932 0.30% Castro::buildMetrics() 16 0.01384 0.01552 0.0178 0.27% FabArray::Xpay() 1013 0.01205 0.01324 0.01488 0.23% MultiFab::Multiply() 287 0.0128 0.01311 0.01421 0.22% amrex::Add() 575 0.01089 0.01164 0.01301 0.20% MLPoisson::FFlux() 3408 0.01121 0.0118 0.01238 0.19% MLMG::interpCorrection_1 106 0.01028 0.01113 0.01197 0.18% MLMG::ResNormInf() 152 0.009724 0.01055 0.01123 0.17% MLMG::prepareForSolve() 14 0.00979 0.01065 0.01109 0.17% MLMG::mgVcycle_down::2 106 0.009406 0.009577 0.01032 0.16% FillPatchInterp(MF) 44 0.001698 0.006506 0.009826 0.15% Castro::errorEst() 15 0.009402 0.00964 0.009821 0.15% MLLinOp::define() 14 0.004287 0.007057 0.009384 0.14% MLLinOp::defineGrids() 14 0.00427 0.007039 0.009366 0.14% MLLinOp::makeSubCommunicator() 14 0.003902 0.006637 0.008941 0.14% Castro::apply_tagging_restrictions() 15 0.005563 0.005892 0.006068 0.09% FabArrayBase::getCPC() 3662 0.005077 0.005361 0.005748 0.09% MLCellLinOp::defineBC() 14 0.004923 0.005069 0.005498 0.08% MLCellLinOp::defineAuxData() 14 0.004907 0.005104 0.00547 0.08% FabArray::norminf(mask) 46 0.004799 0.005025 0.005425 0.08% Castro::sum_integrated_quantities() 1 0.005096 0.005112 0.005156 0.08% MLMG::getGradSolution() 14 0.004505 0.004619 0.004793 0.07% MLMG::mgVcycle_down::3 106 0.001339 0.001815 0.004777 0.07% MLCellLinOp::compGrad() 28 0.004487 0.0046 0.004773 0.07% MLMG::MLResNormInf() 32 0.003953 0.004028 0.004129 0.06% MLMG::actualBottomSolve() 106 2.326e-05 0.0005279 0.004045 0.06% FabArray::norminf() 174 0.002972 0.003376 0.003984 0.06% MultiFab::max() 54 0.002926 0.003445 0.003941 0.06% MLMG::mgVcycle_up::3 106 0.000935 0.001329 0.003796 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003244 0.003499 0.003689 0.06% MLCGSolver::bicgstab 13 0 0.0004564 0.003651 0.06% BndryData::define() 42 0.002841 0.002949 0.003173 0.05% Castro::enforce_min_density() 33 0.002743 0.002874 0.003073 0.05% FabArrayBase::TheFPinfo() 49 0.0003196 0.00164 0.00269 0.04% FPinfo::FPinfo() 9 0.0002533 0.001574 0.002626 0.04% DistributionMapping::LeastUsedCPUs() 9 0.000197 0.001511 0.002555 0.04% average_down_faces 84 0.002002 0.002245 0.002466 0.04% MLMG::mgVcycle_down::4 106 0.001141 0.001357 0.002451 0.04% MLMG::MLRhsNormInf() 14 0.001788 0.001921 0.002254 0.03% FabArrayBase::CPC::define() 624 0.001555 0.001747 0.002019 0.03% MLMG::mgVcycle_up::4 106 0.001092 0.001255 0.002017 0.03% Castro::volWgtSum() 46 0.001645 0.001685 0.00171 0.03% FabArray::mult() 34 0.001113 0.001307 0.001514 0.02% StateDataPhysBCFunct::() 259 0.001383 0.001431 0.001491 0.02% Castro::enforce_consistent_e() 3 0.001001 0.001189 0.001472 0.02% Gravity::update_max_rhs() 1 0.0006136 0.00104 0.001454 0.02% StateData::FillBoundary(geom) 8 0.001228 0.001274 0.001336 0.02% FabArrayBase::getFB() 5552 0.00112 0.001175 0.001319 0.02% AMRErrorTag::operator() 15 0.0009258 0.0009526 0.0009784 0.02% Castro::build_fine_mask() 55 0.0006914 0.0007402 0.0007997 0.01% TagBoxArray::collate() 15 0.0002345 0.0003152 0.0006373 0.01% DistributionMapping::KnapSackDoIt() 2 5.267e-05 0.0003078 0.0005615 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004662 0.0004919 0.0005371 0.01% MLPoisson::prepareForSolve() 14 0.0003689 0.000396 0.0004806 0.01% MLCellLinOp::prepareForSolve() 14 0.0003566 0.0003811 0.0004666 0.01% FabArray::setDomainBndry() 259 0.0003791 0.0004109 0.0004288 0.01% MLCGSolver::ParallelAllReduce 81 0 5.004e-05 0.0004004 0.01% MLCellLinOp::setLevelBC() 28 0.0003442 0.0003517 0.0003644 0.01% Castro::locWgtSum() 6 0.0001832 0.0001898 0.0002101 0.00% FabArrayBase::FB::FB() 35 7.904e-05 0.000102 0.000161 0.00% amrex::Dot() 54 0 1.697e-05 0.0001357 0.00% AmrMesh-cluster 1 0 1.465e-05 0.0001172 0.00% OwnerMask() 15 8.934e-05 9.793e-05 0.0001145 0.00% Castro::volProductSum() 2 8.114e-05 8.541e-05 9.679e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.505e-05 7.909e-05 9.053e-05 0.00% FabArray::LinComb() 27 0 1.115e-05 8.924e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.291e-05 6.888e-05 7.851e-05 0.00% FabArray::Saxpy() 27 0 9.797e-06 7.837e-05 0.00% ClusterList::intersect() 1 0 7.957e-06 6.366e-05 0.00% makeSFC 42 4.371e-05 5.434e-05 6.176e-05 0.00% Amr::writeSmallPlotFile() 1 2.983e-05 3.05e-05 3.119e-05 0.00% DistributionMapping::Distribute() 46 2.192e-05 2.589e-05 2.862e-05 0.00% BoxList::parallelComplementIn() 30 2.141e-05 2.329e-05 2.638e-05 0.00% ClusterList::chop() 1 0 3.149e-06 2.519e-05 0.00% FabArray::RecvLayoutMask() 14 1.633e-05 1.709e-05 1.773e-05 0.00% Castro::enforce_speed_limit() 33 1.177e-05 1.282e-05 1.369e-05 0.00% BoxList::complementIn 30 1.01e-05 1.158e-05 1.364e-05 0.00% knapsack() 2 1.083e-05 1.158e-05 1.272e-05 0.00% Amr::initSubcycle() 1 8.758e-06 9.819e-06 1.073e-05 0.00% Castro::apply_problem_tags() 15 7.297e-06 8.057e-06 9.247e-06 0.00% Gravity::set_mass_offset() 1 8.4e-07 3.053e-06 5.971e-06 0.00% Castro::gwstrain() 2 8.46e-07 1.067e-06 1.753e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 16 B 20 B 23 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.07-4-g9fc635426cae) finalized