MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.10-6-gd197c8f5db9e) initialized Starting run at 06:49:10 UTC on 2023-10-06. Successfully read inputs file ... Castro git describe: 23.10-7-g9701338cc AMReX git describe: 23.10-6-gd197c8f5d Microphysics git describe: 23.10-5-g0ad0ab25 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002684358 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.111216224 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001554177 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001877217 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001123925 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001057522 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001098766 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00106918 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001081787 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001106783 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001066977 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001085827 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001070434 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001107674 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001103316 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.232831139 seconds Ending run at 06:49:16 UTC on 2023-10-06. Run time = 6.363956122 Run time without initialization = 0.0002930309997 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.364 ... 6.364 ... 6.364 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2317 1.2317 1.2317 19.35% Gravity::fill_multipole_BCs() 14 1.127 1.139 1.152 18.10% Castro::post_init() 2 0.9797 0.9804 0.9811 15.42% Castro::computeTemp() 36 0.694 0.7412 0.8157 12.82% Castro::reset_internal_energy(Fab) 654 0.398 0.4218 0.4663 7.33% FabArray::ParallelCopy_finish() 2952 0.05786 0.2672 0.3821 6.00% MLPoisson::Fsmooth() 5088 0.2385 0.2441 0.2571 4.04% Castro::normalize_species() 33 0.1623 0.1724 0.1849 2.90% Castro::initData() 3 0.1151 0.1296 0.1542 2.42% AmrLevel::derive() 97 0.1387 0.14 0.141 2.22% amrex::Copy() 975 0.1319 0.1332 0.1357 2.13% Castro::initMFs() 16 0.08929 0.09871 0.1142 1.79% FillBoundary_finish() 5552 0.05202 0.06508 0.07515 1.18% StateData::define() 64 0.051 0.05627 0.06431 1.01% amrex::average_down 844 0.04342 0.04591 0.04909 0.77% FabArray::setVal() 1769 0.04225 0.0459 0.04856 0.76% FillBoundary_nowait() 5552 0.03988 0.04136 0.04363 0.69% MLCellLinOp::applyBC() 6294 0.03378 0.03616 0.03912 0.61% VisMF::Write(FabArray) 2 0.02776 0.02857 0.03087 0.49% FabArray::ParallelCopy_nowait() 2952 0.02326 0.02585 0.03067 0.48% MLPoisson::Fapply() 1040 0.02403 0.02498 0.02659 0.42% Castro::estTimeStep() 1 0.02199 0.02354 0.02573 0.40% MLMG::addInterpCorrection() 530 0.01925 0.01953 0.02013 0.32% MLCellLinOp::reflux() 138 0.01786 0.0182 0.01865 0.29% FillPatchIterator::Initialize 215 0.01654 0.01709 0.01767 0.28% Amr::regrid() 14 0.008806 0.01115 0.01416 0.22% Castro::buildMetrics() 16 0.01119 0.01234 0.01406 0.22% FabArray::Xpay() 1013 0.01239 0.01279 0.01369 0.22% MultiFab::Multiply() 287 0.01257 0.01286 0.01306 0.21% MLCellLinOp::updateSolBC() 120 0.01069 0.01154 0.01219 0.19% amrex::Add() 575 0.01066 0.01112 0.01177 0.19% MLPoisson::FFlux() 3408 0.01128 0.01151 0.01173 0.18% FillPatchInterp(MF) 44 0.001969 0.00731 0.01099 0.17% MLCellLinOp::updateCorBC() 106 0.009648 0.01041 0.01099 0.17% Castro::Castro() 16 0.008149 0.008865 0.01008 0.16% Amr::writePlotFile() 1 0.005444 0.007795 0.008636 0.14% MLMG::interpCorrection_1 106 0.006425 0.006993 0.007679 0.12% AmrMesh::MakeNewGrids() 15 0.006164 0.006291 0.006412 0.10% Castro::apply_tagging_restrictions() 15 0.005495 0.005849 0.006252 0.10% MLMG::prepareForSolve() 14 0.004753 0.004957 0.005118 0.08% MLLinOp::makeSubCommunicator() 14 0.0007031 0.003268 0.005041 0.08% FabArray::norminf(mask) 46 0.004807 0.004851 0.004902 0.08% MLMG::ResNormInf() 152 0.002735 0.003712 0.004516 0.07% MLCellLinOp::defineAuxData() 14 0.003967 0.004034 0.004231 0.07% FabArray::norminf() 174 0.003108 0.003379 0.003933 0.06% Castro::enforce_min_density() 33 0.003367 0.00355 0.003806 0.06% FabArrayBase::getCPC() 3662 0.003427 0.003531 0.003644 0.06% MultiFab::max() 54 0.002675 0.003159 0.003501 0.06% MLCellLinOp::compGrad() 28 0.003172 0.003246 0.003329 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002603 0.00281 0.003092 0.05% BndryData::define() 42 0.00245 0.002524 0.002633 0.04% Gravity::get_new_grav_vector() 4 0.00183 0.002098 0.002361 0.04% Gravity::actual_solve_with_mlmg() 14 0.00194 0.002013 0.002214 0.03% FabArray::FillBoundary() 5552 0.001958 0.002009 0.002132 0.03% MLCellLinOp::defineBC() 14 0.001785 0.001948 0.002058 0.03% FabArrayBase::CPC::define() 624 0.001631 0.00173 0.00195 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0002061 0.001224 0.001807 0.03% MLCellLinOp::smooth() 2544 0.001659 0.001717 0.001763 0.03% FabArray::mult() 34 0.001189 0.001334 0.001714 0.03% Castro::volWgtSum() 46 0.001658 0.001681 0.001704 0.03% MLCGSolver::bicgstab 13 0 0.0001882 0.001506 0.02% FillPatchTwoLevels 126 0.000669 0.001088 0.001371 0.02% StateData::FillBoundary(geom) 8 0.001194 0.001246 0.001309 0.02% Castro::enforce_consistent_e() 3 0.0009957 0.001104 0.00128 0.02% FabArray::ParallelCopy() 2952 0.001203 0.001219 0.001254 0.02% average_down_faces 84 0.001046 0.001132 0.001226 0.02% FabArrayBase::getFB() 5552 0.0009361 0.0009871 0.001108 0.02% AMRErrorTag::operator() 15 0.0009303 0.0009426 0.000973 0.02% Gravity::actual_multilevel_solve() 14 0.0007325 0.0008101 0.0008622 0.01% Castro::sum_integrated_quantities() 1 0.0004968 0.000571 0.0007417 0.01% Castro::build_fine_mask() 55 0.0006284 0.0006792 0.0007339 0.01% MLCellLinOp::apply() 1040 0.0004245 0.000452 0.0006056 0.01% TagBoxArray::collate() 15 0.0002501 0.0003334 0.0005544 0.01% AmrLevel::FillPatch() 215 0.0004986 0.00051 0.0005188 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004632 0.0004823 0.0005147 0.01% MLMG::solve() 14 0.0004574 0.0004807 0.0004985 0.01% MLCellLinOp::prepareForSolve() 14 0.0003441 0.0003751 0.000467 0.01% MLMG::mgVcycle() 318 0.0004165 0.0004359 0.0004647 0.01% MLCellLinOp::correctionResidual() 755 0.0003894 0.0004088 0.0004626 0.01% Amr::grid_places() 15 0.0003017 0.0003538 0.0004468 0.01% FabArray::setDomainBndry() 259 0.0003881 0.0004058 0.0004389 0.01% main() 1 0.0003537 0.0003785 0.0004171 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003095 0.0003591 0.0004053 0.01% MLLinOp::defineGrids() 14 0.0002672 0.000305 0.0003857 0.01% MLCellLinOp::setLevelBC() 28 0.0003221 0.0003448 0.0003761 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002788 0.0002961 0.0003236 0.01% MLMG::MLResNormInf() 32 0.0001392 0.0002431 0.0003143 0.00% MLMG::oneIter() 106 0.0002686 0.0002873 0.0003082 0.00% MLCGSolver::ParallelAllReduce 81 0 3.543e-05 0.0002834 0.00% MLMG::actualBottomSolve() 106 2.35e-05 5.72e-05 0.0002777 0.00% MLMG::mgVcycle_bottom 318 0.0002205 0.000229 0.0002487 0.00% MLCellLinOp::solutionResidual() 258 0.0001727 0.0001883 0.0001996 0.00% Castro::locWgtSum() 6 0.0001823 0.0001864 0.0001943 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001597 0.0001675 0.0001833 0.00% AmrLevel::AmrLevel(dm) 16 0.000145 0.0001547 0.0001794 0.00% MLMG:computeResOfCorrection() 530 0.0001615 0.000166 0.0001742 0.00% MLMG::mgVcycle_down::0 106 0.00014 0.0001489 0.0001668 0.00% StateDataPhysBCFunct::() 259 0.000142 0.0001489 0.0001568 0.00% FillPatchSingleLevel 259 0.0001408 0.0001468 0.0001568 0.00% Gravity::update_max_rhs() 1 9.21e-05 0.0001085 0.0001415 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001223 0.0001265 0.0001348 0.00% FabArrayBase::FB::FB() 35 7.509e-05 8.742e-05 0.0001328 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001124 0.0001194 0.0001299 0.00% MLMG::miniCycle() 212 8.46e-05 9.866e-05 0.0001283 0.00% amrex::Dot() 54 0 1.583e-05 0.0001266 0.00% MLMG::mgVcycle_down::1 106 0.0001058 0.0001141 0.0001206 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.391e-05 9.288e-05 0.0001157 0.00% OwnerMask() 15 8.976e-05 0.0001039 0.0001131 0.00% TagBoxArray::mapPRD 15 9.173e-05 9.491e-05 9.935e-05 0.00% FPinfo::FPinfo() 9 7.075e-05 8.169e-05 9.296e-05 0.00% MLMG::mgVcycle_down::4 106 7.314e-05 7.871e-05 8.871e-05 0.00% MLMG::mgVcycle_down::3 106 7.53e-05 8.222e-05 8.816e-05 0.00% Castro::post_regrid() 30 5.997e-05 7.832e-05 8.593e-05 0.00% Castro::volProductSum() 2 7.864e-05 8.31e-05 8.538e-05 0.00% MLMG::mgVcycle_down::2 106 8.024e-05 8.309e-05 8.49e-05 0.00% Castro::errorEst() 15 4.546e-05 5.713e-05 8.487e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.944e-05 6.839e-05 8.274e-05 0.00% FabArray::Saxpy() 27 0 1.03e-05 8.239e-05 0.00% FabArray::LinComb() 27 0 1.021e-05 8.169e-05 0.00% Amr::FinalizeInit() 1 8.486e-06 2.677e-05 7.748e-05 0.00% Castro::derive() 97 6.279e-05 6.645e-05 7.68e-05 0.00% FabArrayBase::TheFPinfo() 49 6.05e-05 6.809e-05 7.574e-05 0.00% MLMG::mgVcycle_up::0 106 6.081e-05 6.735e-05 7.488e-05 0.00% Castro::avgDown(state_indx) 60 6.339e-05 6.804e-05 7.364e-05 0.00% Castro::clean_state() 33 5.993e-05 6.648e-05 6.997e-05 0.00% MLMG::mgVcycle_up::1 106 5.657e-05 6.219e-05 6.996e-05 0.00% MLMG::mgVcycle_up::4 106 6.454e-05 6.658e-05 6.936e-05 0.00% Amr::writeSmallPlotFile() 1 3.1e-05 4.236e-05 6.828e-05 0.00% MLMG::mgVcycle_up::2 106 5.444e-05 5.76e-05 6.796e-05 0.00% MLMG::computeResidual() 106 5.542e-05 5.817e-05 6.329e-05 0.00% MLMG::mgVcycle_up::3 106 5.41e-05 5.655e-05 6.16e-05 0.00% MLMG::computeMLResidual() 32 3.454e-05 4.352e-05 5.975e-05 0.00% amrex::average_down_w_geom 60 3.751e-05 4.431e-05 5.456e-05 0.00% ClusterList::intersect() 1 0 6.794e-06 5.436e-05 0.00% Castro::init(old) 13 4.492e-05 4.779e-05 5.4e-05 0.00% makeSFC 42 2.898e-05 3.681e-05 5.15e-05 0.00% Amr::defBaseLevel() 1 3.67e-05 4.429e-05 5.107e-05 0.00% MLPoisson::define() 14 3.762e-05 4.133e-05 4.496e-05 0.00% Castro::avgDown() 15 3.409e-05 3.706e-05 4.213e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.128e-05 2.376e-05 2.688e-05 0.00% AmrMesh-cluster 1 0 3.353e-06 2.682e-05 0.00% DistributionMapping::Distribute() 46 2.146e-05 2.363e-05 2.59e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.531e-05 2.109e-05 2.422e-05 0.00% BoxList::parallelComplementIn() 30 1.074e-05 1.314e-05 2.042e-05 0.00% MLPoisson::prepareForSolve() 14 1.132e-05 1.324e-05 1.968e-05 0.00% MLLinOp::define() 14 1.394e-05 1.702e-05 1.945e-05 0.00% MLMG::getGradSolution() 14 1.686e-05 1.779e-05 1.864e-05 0.00% Amr::bldFineLevels() 1 1.228e-05 1.697e-05 1.855e-05 0.00% FabArray::RecvLayoutMask() 14 1.595e-05 1.681e-05 1.792e-05 0.00% ClusterList::chop() 1 0 2.057e-06 1.646e-05 0.00% BoxList::complementIn 30 1.035e-05 1.207e-05 1.477e-05 0.00% Castro::enforce_speed_limit() 33 1.116e-05 1.173e-05 1.287e-05 0.00% knapsack() 2 1.026e-05 1.107e-05 1.24e-05 0.00% Amr::initSubcycle() 1 8.774e-06 9.873e-06 1.069e-05 0.00% Amr::initialInit() 1 1.291e-06 3.127e-06 9.371e-06 0.00% Castro::apply_problem_tags() 15 7.165e-06 8.24e-06 8.927e-06 0.00% MLMG::MLRhsNormInf() 14 8.378e-06 8.592e-06 8.875e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.346e-06 4.664e-06 5.341e-06 0.00% Gravity::set_mass_offset() 1 7.93e-07 1.706e-06 4.449e-06 0.00% Amr::InitializeInit() 1 2.106e-06 2.868e-06 4.139e-06 0.00% Amr::init() 1 1.664e-06 2.246e-06 2.827e-06 0.00% Castro::computeInitialDt() 1 1.903e-06 2.285e-06 2.696e-06 0.00% Castro::gwstrain() 2 1.029e-06 1.308e-06 1.579e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.364 6.364 6.364 100.00% Amr::init() 1 5.132 5.132 5.132 80.64% Amr::initialInit() 1 4.899 4.899 4.899 76.98% Amr::FinalizeInit() 1 4.791 4.793 4.795 75.35% Castro::post_init() 2 3.564 3.68 3.749 58.91% Gravity::multilevel_solve_for_new_phi() 14 1.781 1.793 1.808 28.40% Gravity::actual_multilevel_solve() 14 1.778 1.79 1.805 28.36% Gravity::solve_phi_with_mlmg() 14 1.771 1.784 1.799 28.26% Castro::computeTemp() 36 1.093 1.163 1.282 20.15% Amr::InitAmr() 1 1.232 1.232 1.232 19.35% Amr::regrid() 14 1.186 1.209 1.229 19.32% Castro::clean_state() 33 1.056 1.111 1.202 18.89% Gravity::fill_multipole_BCs() 14 1.128 1.14 1.154 18.13% Amr::bldFineLevels() 1 0.8827 0.9367 1.03 16.18% Castro::post_regrid() 30 0.8134 0.8429 0.8856 13.92% Castro::initData() 3 0.5752 0.6397 0.7539 11.85% Gravity::actual_solve_with_mlmg() 14 0.6408 0.6432 0.6451 10.14% MLMG::solve() 14 0.6218 0.6224 0.6227 9.78% MLMG::oneIter() 106 0.5503 0.5509 0.5513 8.66% Castro::reset_internal_energy(MultiFab) 36 0.3984 0.4222 0.4666 7.33% Castro::reset_internal_energy(Fab) 654 0.398 0.4218 0.4663 7.33% FabArray::ParallelCopy() 2952 0.1169 0.3216 0.4356 6.85% MLMG::mgVcycle() 318 0.4177 0.4193 0.4212 6.62% FabArray::ParallelCopy_finish() 2952 0.05786 0.2672 0.3821 6.00% MLCellLinOp::smooth() 2544 0.3447 0.3476 0.3555 5.59% amrex::average_down 844 0.07487 0.1917 0.261 4.10% MLPoisson::Fsmooth() 5088 0.2385 0.2441 0.2571 4.04% Amr::writePlotFile() 1 0.233 0.2331 0.2331 3.66% Castro::avgDown() 15 0.04381 0.161 0.2299 3.61% Castro::avgDown(state_indx) 60 0.04378 0.161 0.2299 3.61% amrex::average_down_w_geom 60 0.04371 0.1609 0.2298 3.61% Castro::derive() 97 0.1973 0.1975 0.1976 3.11% AmrLevel::derive() 97 0.1973 0.1974 0.1976 3.10% Castro::normalize_species() 33 0.1623 0.1724 0.1849 2.90% Castro::Castro() 16 0.1269 0.1402 0.158 2.48% MLCellLinOp::applyBC() 6294 0.1381 0.1457 0.1532 2.41% amrex::Copy() 975 0.1319 0.1332 0.1357 2.13% Amr::grid_places() 15 0.01924 0.08876 0.1279 2.01% AmrMesh::MakeNewGrids() 15 0.01879 0.08841 0.1276 2.00% AmrLevel::FillPatch() 215 0.1152 0.1173 0.1189 1.87% MLMG::mgVcycle_bottom 318 0.1122 0.1137 0.1186 1.86% MLMG::mgVcycle_down::0 106 0.1174 0.118 0.1186 1.86% FabArray::FillBoundary() 5552 0.09901 0.1095 0.118 1.85% MLMG::miniCycle() 212 0.1123 0.1134 0.1149 1.81% Castro::initMFs() 16 0.08929 0.09871 0.1142 1.79% TagBoxArray::mapPRD 15 0.002616 0.07202 0.1115 1.75% Amr::InitializeInit() 1 0.1036 0.1058 0.1074 1.69% Amr::defBaseLevel() 1 0.1036 0.1058 0.1073 1.69% MLMG::mgVcycle_up::0 106 0.106 0.1064 0.1068 1.68% FillPatchIterator::Initialize 215 0.08852 0.09173 0.09409 1.48% FillBoundary_finish() 5552 0.05202 0.06508 0.07515 1.18% MLMG::computeResWithCrseSolFineCor() 106 0.07135 0.07309 0.07412 1.16% AmrLevel::AmrLevel(dm) 16 0.05115 0.05642 0.06446 1.01% StateData::define() 64 0.051 0.05627 0.06431 1.01% MLCellLinOp::apply() 1040 0.05849 0.06003 0.06228 0.98% FillPatchSingleLevel 259 0.05079 0.05509 0.05894 0.93% MLCellLinOp::correctionResidual() 755 0.05649 0.05774 0.05874 0.92% FabArray::ParallelCopy_nowait() 2952 0.0509 0.05318 0.05774 0.91% MLCellLinOp::solutionResidual() 258 0.05317 0.05492 0.05634 0.89% FillPatchIterator::FillFromTwoLevels() 126 0.04533 0.04859 0.05117 0.80% FillPatchTwoLevels 126 0.0452 0.04847 0.05104 0.80% MLCellLinOp::reflux() 138 0.04805 0.04974 0.05049 0.79% Castro::init(old) 13 0.04521 0.04677 0.04931 0.77% FabArray::setVal() 1769 0.04225 0.0459 0.04856 0.76% FillBoundary_nowait() 5552 0.0409 0.04244 0.04487 0.71% MLMG::addInterpCorrection() 530 0.02163 0.03257 0.03447 0.54% MLMG::computeResWithCrseCorFineCor() 106 0.03039 0.03129 0.03239 0.51% VisMF::Write(FabArray) 2 0.02776 0.02857 0.03087 0.49% MLMG::computeResidual() 106 0.02678 0.02795 0.02837 0.45% FillPatchIterator::FillFromLevel0() 89 0.02455 0.02569 0.0268 0.42% MLPoisson::Fapply() 1040 0.02403 0.02498 0.02659 0.42% Castro::computeInitialDt() 1 0.02199 0.02355 0.02574 0.40% Castro::estTimeStep() 1 0.02199 0.02354 0.02573 0.40% MLMG::mgVcycle_down::1 106 0.02334 0.0236 0.02381 0.37% MLMG::mgVcycle_up::2 106 0.008787 0.02048 0.02235 0.35% MLMG::computeMLResidual() 32 0.02052 0.02113 0.02174 0.34% MLCellLinOp::updateSolBC() 120 0.01994 0.02055 0.02143 0.34% MLMG::mgVcycle_up::1 106 0.02053 0.02059 0.02069 0.33% MLCellLinOp::updateCorBC() 106 0.01794 0.01875 0.01951 0.31% MLMG:computeResOfCorrection() 530 0.01837 0.01879 0.01934 0.30% Gravity::get_new_grav_vector() 4 0.01782 0.01844 0.01916 0.30% MLPoisson::define() 14 0.0119 0.01396 0.01579 0.25% Castro::buildMetrics() 16 0.01255 0.0139 0.01578 0.25% FabArray::Xpay() 1013 0.01239 0.01279 0.01369 0.22% MultiFab::Multiply() 287 0.01257 0.01286 0.01306 0.21% amrex::Add() 575 0.01066 0.01112 0.01177 0.19% MLPoisson::FFlux() 3408 0.01128 0.01151 0.01173 0.18% MLMG::mgVcycle_down::2 106 0.009961 0.01033 0.01172 0.18% MLMG::interpCorrection_1 106 0.009749 0.01069 0.01165 0.18% FillPatchInterp(MF) 44 0.001969 0.00731 0.01099 0.17% MLMG::ResNormInf() 152 0.009564 0.01012 0.01082 0.17% MLMG::prepareForSolve() 14 0.009569 0.009802 0.01017 0.16% Castro::errorEst() 15 0.009112 0.009506 0.009924 0.16% Castro::apply_tagging_restrictions() 15 0.005495 0.005849 0.006252 0.10% FabArrayBase::getCPC() 3662 0.005064 0.005261 0.005594 0.09% MLLinOp::define() 14 0.001079 0.003669 0.005544 0.09% MLLinOp::defineGrids() 14 0.001065 0.003652 0.005525 0.09% MLCellLinOp::defineAuxData() 14 0.00499 0.005084 0.005418 0.09% MLCellLinOp::defineBC() 14 0.004998 0.005164 0.005354 0.08% MLLinOp::makeSubCommunicator() 14 0.0007031 0.003268 0.005041 0.08% FabArray::norminf(mask) 46 0.004807 0.004851 0.004902 0.08% Castro::sum_integrated_quantities() 1 0.004741 0.004783 0.004857 0.08% MLMG::getGradSolution() 14 0.004439 0.004514 0.004627 0.07% MLCellLinOp::compGrad() 28 0.004421 0.004496 0.004611 0.07% MLMG::mgVcycle_down::3 106 0.001332 0.00178 0.004602 0.07% MLMG::MLResNormInf() 32 0.003862 0.003958 0.004075 0.06% FabArray::norminf() 174 0.003108 0.003379 0.003933 0.06% MLMG::actualBottomSolve() 106 2.35e-05 0.0005058 0.003867 0.06% Castro::enforce_min_density() 33 0.003367 0.00355 0.003806 0.06% MLMG::mgVcycle_up::3 106 0.0009489 0.001317 0.003765 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003295 0.003475 0.003648 0.06% MLCGSolver::bicgstab 13 0 0.0004422 0.003537 0.06% MultiFab::max() 54 0.002675 0.003159 0.003501 0.06% BndryData::define() 42 0.002998 0.003088 0.003204 0.05% MLMG::mgVcycle_down::4 106 0.001164 0.001344 0.002383 0.04% average_down_faces 84 0.001969 0.002108 0.002201 0.03% MLMG::mgVcycle_up::4 106 0.001109 0.00123 0.001979 0.03% FabArrayBase::CPC::define() 624 0.001631 0.00173 0.00195 0.03% FabArrayBase::TheFPinfo() 49 0.0003258 0.001343 0.001943 0.03% FPinfo::FPinfo() 9 0.0002603 0.001275 0.001876 0.03% MLMG::MLRhsNormInf() 14 0.001795 0.001814 0.001845 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0002061 0.001224 0.001807 0.03% FabArray::mult() 34 0.001189 0.001334 0.001714 0.03% Castro::volWgtSum() 46 0.001663 0.001686 0.001711 0.03% StateDataPhysBCFunct::() 259 0.001337 0.001395 0.001466 0.02% StateData::FillBoundary(geom) 8 0.001194 0.001246 0.001309 0.02% Castro::enforce_consistent_e() 3 0.0009957 0.001104 0.00128 0.02% FabArrayBase::getFB() 5552 0.001017 0.001075 0.00124 0.02% Gravity::update_max_rhs() 1 0.0006218 0.0009551 0.001149 0.02% AMRErrorTag::operator() 15 0.0009303 0.0009426 0.000973 0.02% Castro::build_fine_mask() 55 0.0006284 0.0006792 0.0007339 0.01% DistributionMapping::KnapSackDoIt() 2 3.906e-05 0.0003566 0.0006602 0.01% TagBoxArray::collate() 15 0.0002501 0.0003334 0.0005544 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004632 0.0004823 0.0005147 0.01% MLPoisson::prepareForSolve() 14 0.000356 0.0003884 0.0004867 0.01% MLCellLinOp::prepareForSolve() 14 0.0003441 0.0003751 0.000467 0.01% FabArray::setDomainBndry() 259 0.0003881 0.0004058 0.0004389 0.01% MLCellLinOp::setLevelBC() 28 0.0003221 0.0003448 0.0003761 0.01% MLCGSolver::ParallelAllReduce 81 0 4.461e-05 0.0003569 0.01% Castro::locWgtSum() 6 0.0001827 0.0001869 0.0001948 0.00% FabArrayBase::FB::FB() 35 7.509e-05 8.742e-05 0.0001328 0.00% amrex::Dot() 54 0 1.583e-05 0.0001266 0.00% OwnerMask() 15 8.976e-05 0.0001039 0.0001131 0.00% MLLinOp::makeAgglomeratedDMap 14 6.651e-05 7.855e-05 9.843e-05 0.00% AmrMesh-cluster 1 0 1.22e-05 9.763e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 6.124e-05 7.382e-05 9.431e-05 0.00% Castro::volProductSum() 2 7.884e-05 8.33e-05 8.56e-05 0.00% FabArray::Saxpy() 27 0 1.03e-05 8.239e-05 0.00% FabArray::LinComb() 27 0 1.021e-05 8.169e-05 0.00% makeSFC 42 4.523e-05 5.479e-05 7.215e-05 0.00% Amr::writeSmallPlotFile() 1 3.1e-05 4.236e-05 6.828e-05 0.00% ClusterList::intersect() 1 0 6.794e-06 5.436e-05 0.00% BoxList::parallelComplementIn() 30 2.167e-05 2.521e-05 3.519e-05 0.00% DistributionMapping::Distribute() 46 2.146e-05 2.363e-05 2.59e-05 0.00% FabArray::RecvLayoutMask() 14 1.595e-05 1.681e-05 1.792e-05 0.00% ClusterList::chop() 1 0 2.057e-06 1.646e-05 0.00% BoxList::complementIn 30 1.035e-05 1.207e-05 1.477e-05 0.00% Castro::enforce_speed_limit() 33 1.116e-05 1.173e-05 1.287e-05 0.00% knapsack() 2 1.026e-05 1.107e-05 1.24e-05 0.00% Amr::initSubcycle() 1 8.774e-06 9.873e-06 1.069e-05 0.00% Castro::apply_problem_tags() 15 7.165e-06 8.24e-06 8.927e-06 0.00% Gravity::set_mass_offset() 1 7.93e-07 1.706e-06 4.449e-06 0.00% Castro::gwstrain() 2 1.029e-06 1.308e-06 1.579e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 16 B 18 B 21 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-6-gd197c8f5db9e) finalized