MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.05-30-g07f87b0a9047) initialized Starting run at 06:33:12 UTC on 2023-05-30. Successfully read inputs file ... Castro git describe: 23.05-30-g283f15d69 AMReX git describe: 23.05-30-g07f87b0a9 Microphysics git describe: 23.05-13-gbf803460 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002904862 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.113452068 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001877173 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00206907 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001108561 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001120566 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001105134 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001090835 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001073201 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001153031 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001081453 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001102759 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00109885 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001086421 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00433014 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.237685887 seconds Ending run at 06:33:19 UTC on 2023-05-30. Run time = 6.388684729 Run time without initialization = 0.000282187 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.389 ... 6.389 ... 6.389 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2796 1.2797 1.2797 20.03% Gravity::fill_multipole_BCs() 14 1.108 1.125 1.14 17.85% Castro::post_init() 2 0.956 0.957 0.9584 15.00% Castro::computeTemp() 36 0.6933 0.7407 0.8074 12.64% Castro::reset_internal_energy(Fab) 654 0.3911 0.4175 0.4553 7.13% FabArray::ParallelCopy_finish() 2952 0.06705 0.2625 0.3812 5.97% MLPoisson::Fsmooth() 5088 0.2305 0.238 0.2469 3.86% Castro::normalize_species() 33 0.1639 0.1723 0.1851 2.90% Castro::initData() 3 0.1152 0.1284 0.1509 2.36% Castro::derive() 97 0.1405 0.1418 0.1445 2.26% amrex::Copy() 975 0.1321 0.1359 0.1384 2.17% Castro::initMFs() 16 0.09994 0.1106 0.1273 1.99% FillBoundary_finish() 5552 0.05262 0.06254 0.0758 1.19% StateData::define() 64 0.0575 0.06435 0.07526 1.18% FabArray::setVal() 1769 0.04248 0.04618 0.0496 0.78% amrex::average_down 844 0.0416 0.04484 0.04752 0.74% FillBoundary_nowait() 5552 0.03969 0.0418 0.0439 0.69% MLCellLinOp::applyBC() 6294 0.03521 0.03655 0.03914 0.61% VisMF::Write(FabArray) 2 0.03012 0.03081 0.03354 0.52% FabArray::ParallelCopy_nowait() 2952 0.02368 0.02639 0.03191 0.50% MLPoisson::Fapply() 1040 0.02371 0.02475 0.02609 0.41% Castro::estTimeStep() 1 0.02228 0.02333 0.02524 0.40% Amr::regrid() 14 0.01414 0.01714 0.02072 0.32% MLMG::addInterpCorrection() 530 0.0192 0.01944 0.01986 0.31% MLCellLinOp::reflux() 138 0.01752 0.01801 0.01841 0.29% FillPatchIterator::Initialize 215 0.01617 0.01722 0.01787 0.28% Castro::buildMetrics() 16 0.01259 0.01489 0.01592 0.25% FabArray::Xpay() 1013 0.01184 0.01257 0.01376 0.22% MultiFab::Multiply() 287 0.01275 0.01294 0.01316 0.21% MLCellLinOp::updateSolBC() 120 0.01057 0.01149 0.01212 0.19% amrex::Add() 575 0.0107 0.01124 0.01189 0.19% MLPoisson::FFlux() 3408 0.0113 0.01154 0.01182 0.18% Castro::Castro() 16 0.008746 0.009703 0.01117 0.17% MLCellLinOp::updateCorBC() 106 0.009481 0.01035 0.01087 0.17% FillPatchInterp(MF) 44 0.001743 0.006458 0.009557 0.15% Amr::writePlotFile() 1 0.005504 0.007928 0.008746 0.14% AmrMesh::MakeNewGrids() 15 0.006441 0.006717 0.008081 0.13% MLMG::interpCorrection_1 106 0.006322 0.006988 0.00766 0.12% Castro::apply_tagging_restrictions() 15 0.006031 0.006199 0.006401 0.10% MLMG::prepareForSolve() 14 0.004903 0.005054 0.005186 0.08% FabArray::norminf(mask) 46 0.00469 0.004757 0.004813 0.08% MLLinOp::makeSubCommunicator() 14 0.0005627 0.003045 0.004758 0.07% MLMG::ResNormInf() 152 0.002692 0.003422 0.004122 0.06% MLCellLinOp::defineAuxData() 14 0.003782 0.003856 0.004018 0.06% FabArray::norminf() 174 0.002933 0.003236 0.003608 0.06% MultiFab::max() 54 0.002762 0.003222 0.003525 0.06% FabArrayBase::getCPC() 3662 0.003422 0.003467 0.003512 0.05% MLCellLinOp::compGrad() 28 0.003128 0.003318 0.003444 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002573 0.00287 0.003233 0.05% Castro::enforce_min_density() 33 0.002535 0.0027 0.002864 0.04% Gravity::get_new_grav_vector() 4 0.001894 0.002121 0.002415 0.04% BndryData::define() 42 0.002258 0.00231 0.002354 0.04% Gravity::actual_solve_with_mlmg() 14 0.001889 0.001951 0.002153 0.03% FabArray::FillBoundary() 5552 0.00196 0.001988 0.002062 0.03% MLCellLinOp::defineBC() 14 0.001838 0.00194 0.002016 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0001452 0.001157 0.001946 0.03% FabArrayBase::CPC::define() 624 0.001605 0.001703 0.001881 0.03% Castro::volWgtSum() 46 0.001651 0.001707 0.001755 0.03% MLCellLinOp::smooth() 2544 0.001565 0.00161 0.001671 0.03% FabArray::mult() 34 0.001128 0.001325 0.001648 0.03% MLCGSolver::bicgstab 13 0 0.0001771 0.001417 0.02% Castro::enforce_consistent_e() 3 0.0009892 0.001197 0.001414 0.02% FillPatchTwoLevels 126 0.0006592 0.001092 0.001389 0.02% StateData::FillBoundary(geom) 8 0.001165 0.001217 0.001266 0.02% FabArray::ParallelCopy() 2952 0.001176 0.001206 0.001249 0.02% FabArrayBase::getFB() 5552 0.001077 0.001114 0.001181 0.02% average_down_faces 84 0.0009729 0.001071 0.001155 0.02% AMRErrorTag::operator() 15 0.0009302 0.0009466 0.0009677 0.02% Gravity::actual_multilevel_solve() 14 0.0007589 0.0008199 0.0008991 0.01% Castro::build_fine_mask() 55 0.0007254 0.0007698 0.0008965 0.01% Castro::sum_integrated_quantities() 1 0.0004847 0.0006273 0.0008225 0.01% MLMG::solve() 14 0.000366 0.0004968 0.0006283 0.01% TagBoxArray::collate() 15 0.0002273 0.000323 0.0005665 0.01% MLCellLinOp::apply() 1040 0.0004309 0.0004583 0.0005647 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004969 0.0005178 0.0005428 0.01% Amr::grid_places() 15 0.0003296 0.0003747 0.0004903 0.01% main() 1 0.0003678 0.0004356 0.0004822 0.01% MLMG::mgVcycle() 318 0.0004207 0.0004464 0.000481 0.01% MLCellLinOp::prepareForSolve() 14 0.0003476 0.0003796 0.0004493 0.01% MLCellLinOp::correctionResidual() 755 0.0003741 0.0003926 0.0004332 0.01% FabArray::setDomainBndry() 259 0.0003734 0.0003935 0.0004215 0.01% MLLinOp::defineGrids() 14 0.0002516 0.0003054 0.0003846 0.01% MLCellLinOp::setLevelBC() 28 0.0003356 0.0003595 0.0003821 0.01% MLCGSolver::ParallelAllReduce 81 0 3.889e-05 0.0003111 0.00% MLMG::MLResNormInf() 32 0.0001217 0.0001942 0.0003102 0.00% Castro::reset_internal_energy(MultiFab) 36 0.0002698 0.0002849 0.0003019 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002587 0.000272 0.0002842 0.00% MLMG::mgVcycle_bottom 318 0.0002065 0.000234 0.0002674 0.00% MLMG::oneIter() 106 0.0002513 0.0002578 0.0002655 0.00% MLMG::actualBottomSolve() 106 2.482e-05 5.518e-05 0.0002506 0.00% MLCellLinOp::solutionResidual() 258 0.0001693 0.0001812 0.0001989 0.00% Castro::init(old) 13 0.0001557 0.0001689 0.0001973 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001658 0.0001769 0.0001962 0.00% Castro::locWgtSum() 6 0.0001809 0.0001859 0.0001891 0.00% MLMG:computeResOfCorrection() 530 0.0001517 0.0001589 0.0001749 0.00% AmrLevel::AmrLevel(dm) 16 0.0001254 0.0001482 0.0001724 0.00% FillPatchSingleLevel 259 0.0001544 0.0001618 0.0001672 0.00% StateDataPhysBCFunct::() 259 0.0001402 0.0001517 0.0001605 0.00% MLMG::mgVcycle_down::0 106 0.0001218 0.000128 0.0001424 0.00% MLMG::miniCycle() 212 8.864e-05 0.0001041 0.0001399 0.00% FabArrayBase::FB::FB() 35 7.563e-05 8.626e-05 0.0001329 0.00% Gravity::update_max_rhs() 1 8.009e-05 9.802e-05 0.0001206 0.00% amrex::Dot() 54 0 1.472e-05 0.0001178 0.00% MLMG::mgVcycle_down::1 106 0.0001099 0.0001123 0.0001142 0.00% OwnerMask() 15 9.095e-05 9.88e-05 0.0001121 0.00% FPinfo::FPinfo() 9 7.578e-05 8.99e-05 0.0001066 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.004e-05 8.865e-05 0.0001035 0.00% Castro::post_regrid() 30 6.09e-05 7.232e-05 0.0001033 0.00% TagBoxArray::mapPRD 15 9.183e-05 9.465e-05 0.0001002 0.00% Castro::volProductSum() 2 8.265e-05 8.841e-05 9.948e-05 0.00% MLMG::mgVcycle_down::3 106 7.518e-05 8.257e-05 9.876e-05 0.00% Amr::FinalizeInit() 1 7.136e-06 2.925e-05 8.421e-05 0.00% MLMG::mgVcycle_down::2 106 8.015e-05 8.153e-05 8.279e-05 0.00% MLMG::mgVcycle_up::4 106 6.683e-05 7.004e-05 8.012e-05 0.00% FabArray::Saxpy() 27 0 9.907e-06 7.926e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.542e-05 6.546e-05 7.748e-05 0.00% FabArray::LinComb() 27 0 9.655e-06 7.724e-05 0.00% FabArrayBase::TheFPinfo() 49 6.485e-05 6.928e-05 7.721e-05 0.00% MLMG::mgVcycle_down::4 106 6.936e-05 7.126e-05 7.639e-05 0.00% MLMG::mgVcycle_up::0 106 6.362e-05 6.711e-05 7.487e-05 0.00% Castro::clean_state() 33 5.862e-05 6.453e-05 7.447e-05 0.00% MLMG::computeResidual() 106 5.01e-05 5.729e-05 7.392e-05 0.00% Amr::defBaseLevel() 1 5.414e-05 6.137e-05 7.287e-05 0.00% MLMG::mgVcycle_up::1 106 5.885e-05 6.317e-05 7.225e-05 0.00% Castro::avgDown(state_indx) 60 5.436e-05 6.166e-05 6.76e-05 0.00% MLMG::mgVcycle_up::3 106 5.4e-05 5.779e-05 6.717e-05 0.00% MLMG::mgVcycle_up::2 106 5.204e-05 5.449e-05 6.345e-05 0.00% amrex::average_down_w_geom 60 4.429e-05 5.046e-05 6.006e-05 0.00% ClusterList::intersect() 1 0 6.978e-06 5.582e-05 0.00% Castro::errorEst() 15 4.527e-05 4.847e-05 5.468e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.18e-05 2.742e-05 5.221e-05 0.00% Castro::avgDown() 15 3.487e-05 4.02e-05 4.539e-05 0.00% MLMG::computeMLResidual() 32 3.738e-05 4.128e-05 4.474e-05 0.00% makeSFC 42 2.538e-05 3.199e-05 4.237e-05 0.00% MLPoisson::define() 14 3.011e-05 3.58e-05 4.099e-05 0.00% Amr::bldFineLevels() 1 1.334e-05 1.885e-05 4.067e-05 0.00% Amr::writeSmallPlotFile() 1 2.86e-05 2.917e-05 2.972e-05 0.00% MLMG::getGradSolution() 14 1.703e-05 2.251e-05 2.724e-05 0.00% AmrMesh-cluster 1 0 3.358e-06 2.686e-05 0.00% MLLinOp::define() 14 1.317e-05 1.893e-05 2.68e-05 0.00% DistributionMapping::Distribute() 46 2.085e-05 2.224e-05 2.535e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.69e-05 2.019e-05 2.44e-05 0.00% MLPoisson::prepareForSolve() 14 1.098e-05 1.359e-05 1.965e-05 0.00% BoxList::complementIn 30 8.761e-06 1.298e-05 1.848e-05 0.00% ClusterList::chop() 1 0 2.087e-06 1.669e-05 0.00% FabArray::RecvLayoutMask() 14 1.527e-05 1.577e-05 1.636e-05 0.00% Castro::enforce_speed_limit() 33 1.115e-05 1.221e-05 1.447e-05 0.00% knapsack() 2 1.096e-05 1.167e-05 1.248e-05 0.00% BoxList::parallelComplementIn() 30 1.055e-05 1.131e-05 1.22e-05 0.00% Amr::initSubcycle() 1 9.921e-06 1.057e-05 1.134e-05 0.00% MLMG::MLRhsNormInf() 14 7.904e-06 8.309e-06 8.893e-06 0.00% Castro::apply_problem_tags() 15 6.156e-06 6.601e-06 7.242e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.133e-06 4.825e-06 5.346e-06 0.00% Amr::InitializeInit() 1 2.422e-06 2.867e-06 4.948e-06 0.00% Gravity::set_mass_offset() 1 8.84e-07 1.816e-06 4.086e-06 0.00% Castro::computeInitialDt() 1 1.466e-06 2.262e-06 2.8e-06 0.00% Amr::init() 1 1.465e-06 1.773e-06 2.11e-06 0.00% Amr::initialInit() 1 1.282e-06 1.465e-06 1.821e-06 0.00% Castro::gwstrain() 2 9.57e-07 1.11e-06 1.502e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.389 6.389 6.389 100.00% Amr::init() 1 5.109 5.109 5.109 79.96% Amr::initialInit() 1 4.871 4.871 4.871 76.24% Amr::FinalizeInit() 1 4.761 4.762 4.764 74.57% Castro::post_init() 2 3.525 3.632 3.699 57.90% Gravity::multilevel_solve_for_new_phi() 14 1.751 1.768 1.783 27.91% Gravity::actual_multilevel_solve() 14 1.748 1.765 1.78 27.86% Gravity::solve_phi_with_mlmg() 14 1.742 1.759 1.774 27.76% Amr::InitAmr() 1 1.28 1.28 1.28 20.03% Castro::computeTemp() 36 1.085 1.159 1.262 19.75% Amr::regrid() 14 1.203 1.223 1.246 19.50% Castro::clean_state() 33 1.048 1.106 1.188 18.59% Gravity::fill_multipole_BCs() 14 1.109 1.126 1.142 17.87% Amr::bldFineLevels() 1 0.9026 0.9556 1.042 16.31% Castro::post_regrid() 30 0.8062 0.8376 0.8775 13.74% Castro::initData() 3 0.5738 0.6381 0.7449 11.66% Gravity::actual_solve_with_mlmg() 14 0.6294 0.632 0.6337 9.92% MLMG::solve() 14 0.6113 0.6117 0.612 9.58% MLMG::oneIter() 106 0.5406 0.5412 0.5417 8.48% Castro::reset_internal_energy(MultiFab) 36 0.3914 0.4178 0.4556 7.13% Castro::reset_internal_energy(Fab) 654 0.3911 0.4175 0.4553 7.13% FabArray::ParallelCopy() 2952 0.1275 0.3177 0.435 6.81% MLMG::mgVcycle() 318 0.4071 0.4096 0.4106 6.43% FabArray::ParallelCopy_finish() 2952 0.06705 0.2625 0.3812 5.97% MLCellLinOp::smooth() 2544 0.3379 0.3411 0.3459 5.41% amrex::average_down 844 0.07348 0.1831 0.2512 3.93% MLPoisson::Fsmooth() 5088 0.2305 0.238 0.2469 3.86% Amr::writePlotFile() 1 0.2378 0.2379 0.238 3.72% Castro::avgDown() 15 0.04459 0.1536 0.2219 3.47% Castro::avgDown(state_indx) 60 0.04455 0.1536 0.2218 3.47% amrex::average_down_w_geom 60 0.04449 0.1535 0.2218 3.47% Castro::derive() 97 0.1996 0.2 0.2003 3.14% Castro::normalize_species() 33 0.1639 0.1723 0.1851 2.90% Castro::Castro() 16 0.1415 0.1555 0.1746 2.73% MLCellLinOp::applyBC() 6294 0.1358 0.1441 0.154 2.41% amrex::Copy() 975 0.1321 0.1359 0.1384 2.17% Amr::grid_places() 15 0.02319 0.09201 0.1328 2.08% AmrMesh::MakeNewGrids() 15 0.02281 0.09164 0.1325 2.07% Castro::initMFs() 16 0.09994 0.1106 0.1273 1.99% FabArray::FillBoundary() 5552 0.09882 0.1075 0.1188 1.86% MLMG::mgVcycle_bottom 318 0.1098 0.1124 0.1167 1.83% TagBoxArray::mapPRD 15 0.005613 0.07448 0.115 1.80% MLMG::mgVcycle_down::0 106 0.1137 0.1142 0.1149 1.80% MLMG::miniCycle() 212 0.11 0.1121 0.1132 1.77% Amr::InitializeInit() 1 0.1066 0.1086 0.1096 1.72% Amr::defBaseLevel() 1 0.1066 0.1086 0.1096 1.72% MLMG::mgVcycle_up::0 106 0.1048 0.1051 0.1055 1.65% FillPatchIterator::Initialize 215 0.08873 0.09224 0.09447 1.48% FillBoundary_finish() 5552 0.05262 0.06254 0.0758 1.19% AmrLevel::AmrLevel(dm) 16 0.05767 0.0645 0.0754 1.18% StateData::define() 64 0.0575 0.06435 0.07526 1.18% MLMG::computeResWithCrseSolFineCor() 106 0.07118 0.07223 0.07338 1.15% MLCellLinOp::apply() 1040 0.05667 0.05862 0.06026 0.94% FillPatchSingleLevel 259 0.05274 0.05701 0.06013 0.94% MLCellLinOp::correctionResidual() 755 0.0553 0.05684 0.05946 0.93% FabArray::ParallelCopy_nowait() 2952 0.05068 0.05393 0.05924 0.93% MLCellLinOp::solutionResidual() 258 0.05229 0.05415 0.05548 0.87% FillPatchTwoLevels 126 0.04524 0.04857 0.05185 0.81% MLCellLinOp::reflux() 138 0.04785 0.04949 0.05056 0.79% Castro::init(old) 13 0.04517 0.04722 0.05015 0.78% FabArray::setVal() 1769 0.04248 0.04618 0.0496 0.78% FillBoundary_nowait() 5552 0.04093 0.043 0.04522 0.71% VisMF::Write(FabArray) 2 0.03012 0.03081 0.03354 0.52% MLMG::addInterpCorrection() 530 0.0213 0.03115 0.03269 0.51% MLMG::computeResWithCrseCorFineCor() 106 0.03014 0.03122 0.03194 0.50% MLMG::computeResidual() 106 0.02665 0.02777 0.02824 0.44% MLPoisson::Fapply() 1040 0.02371 0.02475 0.02609 0.41% Castro::computeInitialDt() 1 0.02228 0.02333 0.02525 0.40% Castro::estTimeStep() 1 0.02228 0.02333 0.02524 0.40% MLMG::mgVcycle_down::1 106 0.0237 0.02393 0.0242 0.38% MLMG::computeMLResidual() 32 0.02025 0.02087 0.02126 0.33% MLCellLinOp::updateSolBC() 120 0.01971 0.02036 0.0211 0.33% MLMG::mgVcycle_up::2 106 0.008583 0.0189 0.02049 0.32% MLMG::mgVcycle_up::1 106 0.02001 0.02024 0.02035 0.32% MLCellLinOp::updateCorBC() 106 0.01864 0.01893 0.01951 0.31% Gravity::get_new_grav_vector() 4 0.01702 0.01799 0.01861 0.29% MLMG:computeResOfCorrection() 530 0.01747 0.01786 0.01852 0.29% Castro::buildMetrics() 16 0.01407 0.01646 0.01751 0.27% MLPoisson::define() 14 0.01079 0.01334 0.01504 0.24% FabArray::Xpay() 1013 0.01184 0.01257 0.01376 0.22% MultiFab::Multiply() 287 0.01275 0.01294 0.01316 0.21% MLMG::interpCorrection_1 106 0.01071 0.01148 0.01215 0.19% amrex::Add() 575 0.0107 0.01124 0.01189 0.19% MLPoisson::FFlux() 3408 0.0113 0.01154 0.01182 0.18% MLMG::ResNormInf() 152 0.00912 0.009622 0.01034 0.16% Castro::errorEst() 15 0.009673 0.009888 0.01014 0.16% MLMG::prepareForSolve() 14 0.009595 0.009763 0.01005 0.16% MLMG::mgVcycle_down::2 106 0.008722 0.008896 0.00963 0.15% FillPatchInterp(MF) 44 0.001743 0.006458 0.009557 0.15% Castro::apply_tagging_restrictions() 15 0.006031 0.006199 0.006401 0.10% FabArrayBase::getCPC() 3662 0.005034 0.00517 0.005303 0.08% MLCellLinOp::defineAuxData() 14 0.004807 0.004898 0.005189 0.08% MLLinOp::define() 14 0.0008958 0.003446 0.00518 0.08% MLLinOp::defineGrids() 14 0.0008782 0.003427 0.005162 0.08% MLCellLinOp::defineBC() 14 0.004824 0.004958 0.005035 0.08% Castro::sum_integrated_quantities() 1 0.004845 0.004903 0.005006 0.08% FabArray::norminf(mask) 46 0.00469 0.004757 0.004813 0.08% MLLinOp::makeSubCommunicator() 14 0.0005627 0.003045 0.004758 0.07% MLMG::getGradSolution() 14 0.004544 0.004604 0.004679 0.07% MLCellLinOp::compGrad() 28 0.004521 0.004581 0.004655 0.07% MLMG::mgVcycle_down::3 106 0.001269 0.001721 0.004434 0.07% MLMG::MLResNormInf() 32 0.003768 0.00383 0.003933 0.06% MLMG::actualBottomSolve() 106 2.482e-05 0.0004844 0.003684 0.06% FabArray::norminf() 174 0.002933 0.003236 0.003608 0.06% MLMG::mgVcycle_up::3 106 0.0009029 0.001251 0.003576 0.06% MultiFab::max() 54 0.002762 0.003222 0.003525 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003286 0.003402 0.003485 0.05% MLCGSolver::bicgstab 13 0 0.0004226 0.003381 0.05% BndryData::define() 42 0.002854 0.002893 0.00295 0.05% Castro::enforce_min_density() 33 0.002535 0.0027 0.002864 0.04% MLMG::mgVcycle_down::4 106 0.001125 0.001304 0.002348 0.04% average_down_faces 84 0.001869 0.002005 0.002127 0.03% FabArrayBase::TheFPinfo() 49 0.0002881 0.001296 0.002072 0.03% FPinfo::FPinfo() 9 0.0002176 0.001226 0.002006 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0001452 0.001157 0.001946 0.03% FabArrayBase::CPC::define() 624 0.001605 0.001703 0.001881 0.03% MLMG::mgVcycle_up::4 106 0.001075 0.001189 0.001846 0.03% MLMG::MLRhsNormInf() 14 0.001757 0.001789 0.001828 0.03% Castro::volWgtSum() 46 0.001656 0.001712 0.00176 0.03% FabArray::mult() 34 0.001128 0.001325 0.001648 0.03% StateDataPhysBCFunct::() 259 0.001318 0.001369 0.001418 0.02% Castro::enforce_consistent_e() 3 0.0009892 0.001197 0.001414 0.02% Gravity::update_max_rhs() 1 0.0006052 0.0009901 0.001405 0.02% FabArrayBase::getFB() 5552 0.001152 0.0012 0.001314 0.02% StateData::FillBoundary(geom) 8 0.001165 0.001217 0.001266 0.02% AMRErrorTag::operator() 15 0.0009302 0.0009466 0.0009677 0.02% Castro::build_fine_mask() 55 0.0007254 0.0007698 0.0008965 0.01% DistributionMapping::KnapSackDoIt() 2 4.583e-05 0.0002755 0.0006728 0.01% TagBoxArray::collate() 15 0.0002273 0.000323 0.0005665 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004969 0.0005178 0.0005428 0.01% MLPoisson::prepareForSolve() 14 0.0003595 0.0003932 0.0004603 0.01% MLCellLinOp::prepareForSolve() 14 0.0003476 0.0003796 0.0004493 0.01% FabArray::setDomainBndry() 259 0.0003734 0.0003935 0.0004215 0.01% MLCellLinOp::setLevelBC() 28 0.0003356 0.0003595 0.0003821 0.01% MLCGSolver::ParallelAllReduce 81 0 4.735e-05 0.0003788 0.01% Castro::locWgtSum() 6 0.0001813 0.0001864 0.0001896 0.00% FabArrayBase::FB::FB() 35 7.563e-05 8.626e-05 0.0001329 0.00% amrex::Dot() 54 0 1.472e-05 0.0001178 0.00% MLLinOp::makeAgglomeratedDMap 14 6.386e-05 7.632e-05 0.0001144 0.00% OwnerMask() 15 9.095e-05 9.88e-05 0.0001121 0.00% Castro::volProductSum() 2 8.282e-05 8.863e-05 9.966e-05 0.00% AmrMesh-cluster 1 0 1.242e-05 9.938e-05 0.00% FabArray::Saxpy() 27 0 9.907e-06 7.926e-05 0.00% FabArray::LinComb() 27 0 9.655e-06 7.724e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.77e-05 6.248e-05 7.541e-05 0.00% makeSFC 42 4.107e-05 4.89e-05 6.221e-05 0.00% ClusterList::intersect() 1 0 6.978e-06 5.582e-05 0.00% BoxList::parallelComplementIn() 30 1.966e-05 2.429e-05 2.974e-05 0.00% Amr::writeSmallPlotFile() 1 2.86e-05 2.917e-05 2.972e-05 0.00% DistributionMapping::Distribute() 46 2.085e-05 2.224e-05 2.535e-05 0.00% BoxList::complementIn 30 8.761e-06 1.298e-05 1.848e-05 0.00% ClusterList::chop() 1 0 2.087e-06 1.669e-05 0.00% FabArray::RecvLayoutMask() 14 1.527e-05 1.577e-05 1.636e-05 0.00% Castro::enforce_speed_limit() 33 1.115e-05 1.221e-05 1.447e-05 0.00% knapsack() 2 1.096e-05 1.167e-05 1.248e-05 0.00% Amr::initSubcycle() 1 9.921e-06 1.057e-05 1.134e-05 0.00% Castro::apply_problem_tags() 15 6.156e-06 6.601e-06 7.242e-06 0.00% Gravity::set_mass_offset() 1 8.84e-07 1.816e-06 4.086e-06 0.00% Castro::gwstrain() 2 9.57e-07 1.11e-06 1.502e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 21 B 24 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.05-30-g07f87b0a9047) finalized