MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.09-22-gb2052f2d2e5c) initialized Starting run at 06:19:22 UTC on 2023-09-19. Successfully read inputs file ... Castro git describe: 23.09-10-g575c8c93b AMReX git describe: 23.09-22-gb2052f2d2 Microphysics git describe: 23.09-9-gdfc865b7 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.003222311 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.145931603 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001637597 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00229713 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001242056 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001288773 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001223192 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001209799 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.007795975 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001259543 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001288474 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001200743 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002255109 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.005589373 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001510641 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.752327181 seconds Ending run at 06:19:29 UTC on 2023-09-19. Run time = 7.177447838 Run time without initialization = 0.0003700090001 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 7.177 ... 7.177 ... 7.178 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.1941 1.1942 1.1942 16.64% Gravity::fill_multipole_BCs() 14 1.151 1.166 1.181 16.45% Castro::post_init() 2 1.037 1.045 1.052 14.65% Castro::computeTemp() 36 0.6948 0.7374 0.8077 11.25% FabArray::ParallelCopy_finish() 2952 0.1311 0.4019 0.5832 8.13% Amr::writePlotFile() 1 0.525 0.528 0.5298 7.38% Castro::reset_internal_energy(Fab) 654 0.3933 0.4232 0.4666 6.50% MLPoisson::Fsmooth() 5088 0.2354 0.2428 0.2551 3.55% Castro::normalize_species() 33 0.1621 0.1743 0.19 2.65% Castro::initData() 3 0.1187 0.1415 0.1819 2.53% Castro::initMFs() 16 0.09189 0.1174 0.1463 2.04% AmrLevel::derive() 97 0.1376 0.1408 0.1438 2.00% amrex::Copy() 975 0.1196 0.1333 0.1429 1.99% StateData::define() 64 0.05134 0.06604 0.08324 1.16% FabArray::setVal() 1769 0.05188 0.06671 0.0808 1.13% FillBoundary_finish() 5552 0.05288 0.06499 0.07743 1.08% amrex::average_down 844 0.0457 0.04997 0.05706 0.80% FabArray::ParallelCopy_nowait() 2952 0.02433 0.03201 0.04728 0.66% FillBoundary_nowait() 5552 0.03977 0.0422 0.04659 0.65% MLCellLinOp::applyBC() 6294 0.0336 0.03583 0.03952 0.55% FillPatchIterator::Initialize 215 0.01504 0.02284 0.03545 0.49% Castro::estTimeStep() 1 0.02157 0.02701 0.03441 0.48% VisMF::Write(FabArray) 2 0.02846 0.02943 0.03189 0.44% MLPoisson::Fapply() 1040 0.0245 0.0255 0.02678 0.37% MLMG::addInterpCorrection() 530 0.01932 0.0195 0.02004 0.28% Castro::buildMetrics() 16 0.01118 0.01446 0.01768 0.25% MLCellLinOp::reflux() 138 0.01598 0.01639 0.01693 0.24% FabArray::Xpay() 1013 0.01289 0.01409 0.01595 0.22% Amr::regrid() 14 0.01027 0.01178 0.01412 0.20% MultiFab::Multiply() 287 0.01155 0.013 0.01387 0.19% amrex::Add() 575 0.01094 0.01177 0.01361 0.19% Castro::Castro() 16 0.008353 0.01021 0.01298 0.18% DistributionMapping::LeastUsedCPUs() 9 0.001918 0.008045 0.01274 0.18% MLCellLinOp::updateSolBC() 120 0.01049 0.01146 0.012 0.17% MLPoisson::FFlux() 3408 0.01141 0.0116 0.01197 0.17% FillPatchInterp(MF) 44 0.001942 0.00726 0.01079 0.15% MLCellLinOp::updateCorBC() 106 0.009468 0.01031 0.01078 0.15% MLMG::prepareForSolve() 14 0.005069 0.006686 0.009826 0.14% MultiFab::max() 54 0.002693 0.006414 0.008892 0.12% Gravity::multilevel_solve_for_new_phi() 14 0.002807 0.005823 0.008618 0.12% AmrMesh::MakeNewGrids() 15 0.007879 0.008046 0.008364 0.12% MLMG::interpCorrection_1 106 0.006346 0.006942 0.007616 0.11% Castro::apply_tagging_restrictions() 15 0.006259 0.006674 0.007039 0.10% FabArray::norminf(mask) 46 0.004797 0.004818 0.004859 0.07% MLCellLinOp::defineAuxData() 14 0.003833 0.004185 0.004447 0.06% MLMG::ResNormInf() 152 0.002326 0.003331 0.004164 0.06% MLLinOp::makeSubCommunicator() 14 0.0006026 0.002499 0.003929 0.05% Gravity::get_new_grav_vector() 4 0.00204 0.002635 0.003897 0.05% FabArrayBase::getCPC() 3662 0.003523 0.003628 0.003742 0.05% Castro::enforce_min_density() 33 0.002918 0.003228 0.0036 0.05% FabArray::norminf() 174 0.00291 0.003215 0.00358 0.05% MLCellLinOp::compGrad() 28 0.003247 0.003334 0.003427 0.05% BndryData::define() 42 0.002437 0.002578 0.002765 0.04% Gravity::actual_solve_with_mlmg() 14 0.001915 0.002031 0.002316 0.03% Gravity::actual_multilevel_solve() 14 0.0008229 0.001521 0.002267 0.03% FabArray::FillBoundary() 5552 0.001984 0.002059 0.00224 0.03% MLCellLinOp::defineBC() 14 0.001851 0.00199 0.002183 0.03% Castro::volWgtSum() 46 0.001657 0.001811 0.002071 0.03% FabArrayBase::CPC::define() 624 0.001588 0.001726 0.002052 0.03% Castro::enforce_consistent_e() 3 0.001014 0.00132 0.001923 0.03% MLCellLinOp::smooth() 2544 0.001715 0.001761 0.001882 0.03% FabArray::mult() 34 0.001158 0.001334 0.00173 0.02% Castro::sum_integrated_quantities() 1 0.0004263 0.001141 0.001651 0.02% MLCGSolver::bicgstab 13 0 0.0001969 0.001575 0.02% FillPatchTwoLevels 126 0.0007048 0.001172 0.001458 0.02% FabArray::ParallelCopy() 2952 0.00123 0.001266 0.001347 0.02% average_down_faces 84 0.001082 0.001191 0.001308 0.02% StateData::FillBoundary(geom) 8 0.001121 0.001151 0.00119 0.02% FabArrayBase::getFB() 5552 0.0009653 0.001017 0.001153 0.02% AMRErrorTag::operator() 15 0.0009195 0.000956 0.001037 0.01% Castro::build_fine_mask() 55 0.0006767 0.0007787 0.0009806 0.01% Gravity::update_max_rhs() 1 7.875e-05 0.0002318 0.0008888 0.01% TagBoxArray::collate() 15 0.0002845 0.0003815 0.00074 0.01% MLCellLinOp::apply() 1040 0.0004298 0.0004655 0.0006286 0.01% MLMG::solve() 14 0.0004363 0.0005277 0.0006285 0.01% AmrLevel::FillPatch() 215 0.0004849 0.0005136 0.000575 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000475 0.0004951 0.0005165 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002808 0.0003656 0.000513 0.01% main() 1 0.0003581 0.0004515 0.0005124 0.01% Amr::grid_places() 15 0.0003386 0.0003777 0.0004803 0.01% MLMG::mgVcycle() 318 0.0004133 0.0004351 0.000477 0.01% MLCellLinOp::correctionResidual() 755 0.0003834 0.0004149 0.0004757 0.01% MLCellLinOp::prepareForSolve() 14 0.0003595 0.0003889 0.000459 0.01% FabArray::setDomainBndry() 259 0.0003636 0.0003997 0.0004254 0.01% MLCellLinOp::setLevelBC() 28 0.0003288 0.0003438 0.0003617 0.01% MLLinOp::defineGrids() 14 0.0002617 0.0003032 0.0003563 0.00% MLMG::actualBottomSolve() 106 2.306e-05 6.289e-05 0.0003307 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002752 0.0002885 0.0003103 0.00% MLMG::oneIter() 106 0.0002635 0.0002778 0.0002948 0.00% MLMG::MLResNormInf() 32 0.0001573 0.0002327 0.0002803 0.00% MLMG::mgVcycle_bottom 318 0.0002149 0.0002323 0.0002629 0.00% MLCGSolver::ParallelAllReduce 81 0 3.102e-05 0.0002482 0.00% Castro::locWgtSum() 6 0.0002017 0.0002149 0.0002322 0.00% MLCellLinOp::solutionResidual() 258 0.0001813 0.0001924 0.0002065 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001577 0.0001713 0.0001855 0.00% AmrLevel::AmrLevel(dm) 16 0.000135 0.0001585 0.0001744 0.00% MLMG:computeResOfCorrection() 530 0.0001514 0.0001594 0.0001709 0.00% StateDataPhysBCFunct::() 259 0.0001369 0.000148 0.0001662 0.00% FabArrayBase::FB::FB() 35 7.625e-05 9.269e-05 0.0001644 0.00% FillPatchSingleLevel 259 0.0001332 0.0001483 0.0001583 0.00% MLMG::mgVcycle_down::0 106 0.0001407 0.0001482 0.0001537 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001093 0.0001236 0.0001476 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001195 0.0001268 0.0001379 0.00% Castro::post_regrid() 30 5.807e-05 8.527e-05 0.0001374 0.00% amrex::Dot() 54 0 1.6e-05 0.000128 0.00% MLMG::mgVcycle_down::1 106 0.0001136 0.0001189 0.0001259 0.00% OwnerMask() 15 9.159e-05 0.0001042 0.0001238 0.00% MLMG::miniCycle() 212 8.341e-05 9.621e-05 0.0001207 0.00% TagBoxArray::mapPRD 15 9.272e-05 9.961e-05 0.0001149 0.00% FPinfo::FPinfo() 9 7.028e-05 8.144e-05 0.0001045 0.00% MLMG::mgVcycle_down::2 106 8.58e-05 8.997e-05 0.0001014 0.00% Castro::volProductSum() 2 8.168e-05 8.957e-05 0.0001001 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.188e-05 8.78e-05 9.248e-05 0.00% Castro::avgDown(state_indx) 60 6.846e-05 7.684e-05 9.21e-05 0.00% MLMG::mgVcycle_down::3 106 7.549e-05 8.049e-05 8.785e-05 0.00% Amr::FinalizeInit() 1 6.955e-06 2.378e-05 8.352e-05 0.00% FabArray::Saxpy() 27 0 1.026e-05 8.208e-05 0.00% Castro::derive() 97 5.93e-05 6.922e-05 8.123e-05 0.00% Castro::clean_state() 33 5.732e-05 6.772e-05 8.076e-05 0.00% FabArray::LinComb() 27 0 1.009e-05 8.07e-05 0.00% Castro::errorEst() 15 4.438e-05 5.618e-05 7.983e-05 0.00% MLMG::mgVcycle_down::4 106 7.064e-05 7.375e-05 7.964e-05 0.00% MLMG::mgVcycle_up::4 106 6.869e-05 7.323e-05 7.926e-05 0.00% MLMG::mgVcycle_up::0 106 6.755e-05 7.002e-05 7.797e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.107e-05 6.863e-05 7.737e-05 0.00% FabArrayBase::TheFPinfo() 49 6.405e-05 7.037e-05 7.627e-05 0.00% MLMG::mgVcycle_up::2 106 5.716e-05 5.99e-05 6.808e-05 0.00% MLMG::computeResidual() 106 5.271e-05 5.925e-05 6.684e-05 0.00% MLMG::mgVcycle_up::3 106 5.61e-05 5.933e-05 6.547e-05 0.00% MLMG::mgVcycle_up::1 106 5.839e-05 6.126e-05 6.357e-05 0.00% ClusterList::intersect() 1 0 7.486e-06 5.989e-05 0.00% Castro::init(old) 13 4.56e-05 4.884e-05 5.787e-05 0.00% amrex::average_down_w_geom 60 3.96e-05 4.768e-05 5.732e-05 0.00% MLPoisson::define() 14 3.779e-05 4.285e-05 5.426e-05 0.00% Castro::avgDown() 15 3.654e-05 4.198e-05 5.182e-05 0.00% Amr::bldFineLevels() 1 1.469e-05 2.85e-05 5.127e-05 0.00% Amr::defBaseLevel() 1 2.943e-05 3.794e-05 5.022e-05 0.00% MLMG::computeMLResidual() 32 3.824e-05 4.131e-05 4.622e-05 0.00% makeSFC 42 2.79e-05 3.362e-05 3.933e-05 0.00% Amr::writeSmallPlotFile() 1 3.025e-05 3.238e-05 3.862e-05 0.00% AmrMesh-cluster 1 0 3.955e-06 3.164e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.617e-05 2.196e-05 2.917e-05 0.00% BoxList::parallelComplementIn() 30 1.124e-05 1.415e-05 2.88e-05 0.00% DistributionMapping::Distribute() 46 2.208e-05 2.419e-05 2.825e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.16e-05 2.427e-05 2.743e-05 0.00% BoxList::complementIn 30 1.107e-05 1.387e-05 2.618e-05 0.00% MLLinOp::define() 14 1.427e-05 1.716e-05 2.153e-05 0.00% MLMG::getGradSolution() 14 1.705e-05 1.837e-05 1.997e-05 0.00% Castro::computeInitialDt() 1 1.818e-06 4.568e-06 1.889e-05 0.00% FabArray::RecvLayoutMask() 14 1.691e-05 1.745e-05 1.843e-05 0.00% ClusterList::chop() 1 0 2.182e-06 1.746e-05 0.00% Amr::initSubcycle() 1 8.783e-06 1.029e-05 1.421e-05 0.00% Castro::enforce_speed_limit() 33 1.106e-05 1.25e-05 1.419e-05 0.00% MLPoisson::prepareForSolve() 14 1.23e-05 1.314e-05 1.415e-05 0.00% knapsack() 2 1.094e-05 1.204e-05 1.412e-05 0.00% Amr::init() 1 1.711e-06 2.987e-06 1.003e-05 0.00% MLMG::MLRhsNormInf() 14 8.103e-06 8.817e-06 9.414e-06 0.00% Castro::apply_problem_tags() 15 7.572e-06 8.565e-06 9.38e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.334e-06 4.838e-06 5.677e-06 0.00% Amr::InitializeInit() 1 2.044e-06 2.84e-06 5.001e-06 0.00% Gravity::set_mass_offset() 1 9.26e-07 2.207e-06 3.953e-06 0.00% Amr::initialInit() 1 1.149e-06 1.455e-06 1.991e-06 0.00% Castro::gwstrain() 2 1.211e-06 1.42e-06 1.623e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 7.177 7.177 7.177 100.00% Amr::init() 1 5.983 5.983 5.983 83.35% Amr::initialInit() 1 5.23 5.23 5.23 72.87% Amr::FinalizeInit() 1 5.114 5.119 5.126 71.42% Castro::post_init() 2 3.793 3.936 4.034 56.20% Gravity::multilevel_solve_for_new_phi() 14 1.822 1.832 1.845 25.70% Gravity::actual_multilevel_solve() 14 1.814 1.826 1.842 25.66% Gravity::solve_phi_with_mlmg() 14 1.806 1.819 1.836 25.57% Amr::regrid() 14 1.297 1.332 1.365 19.01% Castro::computeTemp() 36 1.088 1.161 1.274 17.74% Castro::clean_state() 33 1.051 1.111 1.202 16.75% Amr::InitAmr() 1 1.194 1.194 1.194 16.64% Gravity::fill_multipole_BCs() 14 1.153 1.168 1.182 16.47% Amr::bldFineLevels() 1 0.921 1.006 1.126 15.68% Castro::post_regrid() 30 0.8106 0.845 0.8925 12.43% Castro::initData() 3 0.5772 0.6622 0.7942 11.06% Amr::writePlotFile() 1 0.7525 0.7526 0.7526 10.49% Gravity::actual_solve_with_mlmg() 14 0.6496 0.6513 0.6527 9.09% FabArray::ParallelCopy() 2952 0.2045 0.4592 0.6342 8.84% MLMG::solve() 14 0.63 0.6307 0.6313 8.80% FabArray::ParallelCopy_finish() 2952 0.1311 0.4019 0.5832 8.13% MLMG::oneIter() 106 0.5513 0.5519 0.5524 7.70% Castro::reset_internal_energy(MultiFab) 36 0.3936 0.4235 0.4671 6.51% Castro::reset_internal_energy(Fab) 654 0.3933 0.4232 0.4666 6.50% MLMG::mgVcycle() 318 0.4116 0.4131 0.4164 5.80% MLCellLinOp::smooth() 2544 0.3425 0.3452 0.3537 4.93% amrex::average_down 844 0.1041 0.2501 0.3457 4.82% Castro::avgDown() 15 0.07343 0.2185 0.3132 4.36% Castro::avgDown(state_indx) 60 0.07338 0.2184 0.3132 4.36% amrex::average_down_w_geom 60 0.07331 0.2184 0.3131 4.36% MLPoisson::Fsmooth() 5088 0.2354 0.2428 0.2551 3.55% Castro::Castro() 16 0.1357 0.1694 0.2083 2.90% Castro::derive() 97 0.1947 0.1961 0.1968 2.74% AmrLevel::derive() 97 0.1946 0.196 0.1968 2.74% Castro::normalize_species() 33 0.1621 0.1743 0.19 2.65% AmrLevel::FillPatch() 215 0.1577 0.1768 0.187 2.61% Amr::grid_places() 15 0.02738 0.1187 0.1765 2.46% AmrMesh::MakeNewGrids() 15 0.0269 0.1183 0.1762 2.45% FillPatchIterator::Initialize 215 0.135 0.1543 0.1632 2.27% TagBoxArray::mapPRD 15 0.007479 0.0991 0.1576 2.20% MLCellLinOp::applyBC() 6294 0.1404 0.1462 0.1547 2.16% Castro::initMFs() 16 0.09189 0.1174 0.1463 2.04% amrex::Copy() 975 0.1196 0.1333 0.1429 1.99% FabArray::FillBoundary() 5552 0.103 0.1104 0.1203 1.68% FillPatchIterator::FillFromTwoLevels() 126 0.07832 0.1039 0.1185 1.65% FillPatchTwoLevels 126 0.07819 0.1038 0.1184 1.65% MLMG::mgVcycle_down::0 106 0.1153 0.116 0.1169 1.63% Amr::InitializeInit() 1 0.1039 0.1113 0.1168 1.63% Amr::defBaseLevel() 1 0.1039 0.1113 0.1167 1.63% MLMG::mgVcycle_bottom 318 0.1088 0.1105 0.1165 1.62% FillPatchSingleLevel 259 0.06606 0.09639 0.1137 1.58% MLMG::miniCycle() 212 0.1089 0.1102 0.1127 1.57% MLMG::mgVcycle_up::0 106 0.1062 0.1068 0.1069 1.49% Castro::init(old) 13 0.07907 0.09637 0.1052 1.47% AmrLevel::AmrLevel(dm) 16 0.05151 0.0662 0.08337 1.16% StateData::define() 64 0.05134 0.06604 0.08324 1.16% FabArray::setVal() 1769 0.05188 0.06671 0.0808 1.13% FillBoundary_finish() 5552 0.05288 0.06499 0.07743 1.08% MLMG::computeResWithCrseSolFineCor() 106 0.07347 0.07567 0.07731 1.08% FabArray::ParallelCopy_nowait() 2952 0.0482 0.05608 0.07202 1.00% MLCellLinOp::solutionResidual() 258 0.05806 0.06048 0.06332 0.88% MLCellLinOp::apply() 1040 0.06026 0.06158 0.06316 0.88% MLCellLinOp::correctionResidual() 755 0.05784 0.06042 0.06166 0.86% MLCellLinOp::reflux() 138 0.04872 0.04939 0.05023 0.70% FillBoundary_nowait() 5552 0.04083 0.04331 0.04791 0.67% MLMG::computeResWithCrseCorFineCor() 106 0.03114 0.03345 0.03456 0.48% Castro::computeInitialDt() 1 0.02159 0.02701 0.03441 0.48% Castro::estTimeStep() 1 0.02157 0.02701 0.03441 0.48% Gravity::get_new_grav_vector() 4 0.03057 0.03163 0.03363 0.47% MLMG::addInterpCorrection() 530 0.02153 0.03193 0.03349 0.47% FillPatchIterator::FillFromLevel0() 89 0.02016 0.02722 0.03205 0.45% VisMF::Write(FabArray) 2 0.02846 0.02943 0.03189 0.44% MLMG::computeResidual() 106 0.02766 0.02812 0.02853 0.40% MLMG::computeMLResidual() 32 0.02325 0.02614 0.02834 0.39% MLCellLinOp::updateSolBC() 120 0.02128 0.02444 0.02716 0.38% MLPoisson::Fapply() 1040 0.0245 0.0255 0.02678 0.37% MLMG::mgVcycle_down::1 106 0.02296 0.02343 0.02377 0.33% MLMG::mgVcycle_up::2 106 0.00906 0.02015 0.0219 0.31% MLCellLinOp::updateCorBC() 106 0.0189 0.02023 0.02139 0.30% MLMG::mgVcycle_up::1 106 0.02067 0.02076 0.02088 0.29% Castro::buildMetrics() 16 0.01298 0.01647 0.02013 0.28% MLMG:computeResOfCorrection() 530 0.01787 0.01827 0.01867 0.26% FabArray::Xpay() 1013 0.01289 0.01409 0.01595 0.22% MLPoisson::define() 14 0.01214 0.0135 0.01515 0.21% MLMG::prepareForSolve() 14 0.01091 0.01241 0.01494 0.21% MultiFab::Multiply() 287 0.01155 0.013 0.01387 0.19% amrex::Add() 575 0.01094 0.01177 0.01361 0.19% FabArrayBase::TheFPinfo() 49 0.002052 0.008168 0.01288 0.18% FPinfo::FPinfo() 9 0.001984 0.008097 0.0128 0.18% DistributionMapping::LeastUsedCPUs() 9 0.001918 0.008045 0.01274 0.18% MLMG::interpCorrection_1 106 0.01055 0.01135 0.01257 0.18% MLPoisson::FFlux() 3408 0.01141 0.0116 0.01197 0.17% Castro::errorEst() 15 0.009815 0.01052 0.0114 0.16% FillPatchInterp(MF) 44 0.001942 0.00726 0.01079 0.15% MLMG::mgVcycle_down::2 106 0.009146 0.009326 0.01018 0.14% MLMG::ResNormInf() 152 0.008794 0.009538 0.01013 0.14% MultiFab::max() 54 0.002693 0.006414 0.008892 0.12% Castro::apply_tagging_restrictions() 15 0.006259 0.006674 0.007039 0.10% Gravity::update_max_rhs() 1 0.0009586 0.004301 0.006676 0.09% Castro::sum_integrated_quantities() 1 0.005543 0.005647 0.005775 0.08% FabArrayBase::getCPC() 3662 0.00516 0.005354 0.005771 0.08% MLCellLinOp::defineAuxData() 14 0.004902 0.005297 0.005724 0.08% MLCellLinOp::defineBC() 14 0.005046 0.005267 0.005453 0.08% FabArray::norminf(mask) 46 0.004797 0.004818 0.004859 0.07% MLMG::getGradSolution() 14 0.004683 0.004733 0.004837 0.07% MLCellLinOp::compGrad() 28 0.004665 0.004714 0.004819 0.07% MLMG::mgVcycle_down::3 106 0.001283 0.001769 0.00463 0.06% MLLinOp::define() 14 0.0009993 0.002896 0.004338 0.06% MLLinOp::defineGrids() 14 0.000985 0.002879 0.004321 0.06% MLMG::MLResNormInf() 32 0.003852 0.003904 0.003962 0.06% MLMG::actualBottomSolve() 106 2.306e-05 0.0005134 0.003935 0.05% MLLinOp::makeSubCommunicator() 14 0.0006026 0.002499 0.003929 0.05% Gravity::average_fine_ec_onto_crse_ec() 14 0.003267 0.00352 0.003743 0.05% MLMG::mgVcycle_up::3 106 0.0009567 0.001313 0.003708 0.05% Castro::enforce_min_density() 33 0.002918 0.003228 0.0036 0.05% FabArray::norminf() 174 0.00291 0.003215 0.00358 0.05% MLCGSolver::bicgstab 13 0 0.0004439 0.003551 0.05% BndryData::define() 42 0.003007 0.003148 0.003359 0.05% MLMG::mgVcycle_down::4 106 0.001168 0.001347 0.002434 0.03% average_down_faces 84 0.00202 0.002212 0.002428 0.03% Castro::volWgtSum() 46 0.001661 0.001816 0.002077 0.03% FabArrayBase::CPC::define() 624 0.001588 0.001726 0.002052 0.03% MLMG::mgVcycle_up::4 106 0.00114 0.00126 0.001978 0.03% Castro::enforce_consistent_e() 3 0.001014 0.00132 0.001923 0.03% MLMG::MLRhsNormInf() 14 0.001808 0.001823 0.001844 0.03% FabArray::mult() 34 0.001158 0.001334 0.00173 0.02% StateDataPhysBCFunct::() 259 0.001267 0.001299 0.001334 0.02% FabArrayBase::getFB() 5552 0.001042 0.001109 0.001317 0.02% StateData::FillBoundary(geom) 8 0.001121 0.001151 0.00119 0.02% AMRErrorTag::operator() 15 0.0009195 0.000956 0.001037 0.01% Castro::build_fine_mask() 55 0.0006767 0.0007787 0.0009806 0.01% DistributionMapping::KnapSackDoIt() 2 0.0002491 0.0005727 0.0009237 0.01% TagBoxArray::collate() 15 0.0002845 0.0003815 0.00074 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000475 0.0004951 0.0005165 0.01% MLPoisson::prepareForSolve() 14 0.0003726 0.0004021 0.0004723 0.01% MLCellLinOp::prepareForSolve() 14 0.0003595 0.0003889 0.000459 0.01% FabArray::setDomainBndry() 259 0.0003636 0.0003997 0.0004254 0.01% MLCellLinOp::setLevelBC() 28 0.0003288 0.0003438 0.0003617 0.01% MLCGSolver::ParallelAllReduce 81 0 4.043e-05 0.0003234 0.00% Castro::locWgtSum() 6 0.0002023 0.0002155 0.0002329 0.00% FabArrayBase::FB::FB() 35 7.625e-05 9.269e-05 0.0001644 0.00% amrex::Dot() 54 0 1.6e-05 0.000128 0.00% OwnerMask() 15 9.159e-05 0.0001042 0.0001238 0.00% AmrMesh-cluster 1 0 1.362e-05 0.000109 0.00% Castro::volProductSum() 2 8.191e-05 8.98e-05 0.0001003 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.509e-05 7.321e-05 9.179e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.572e-05 7.652e-05 8.766e-05 0.00% FabArray::Saxpy() 27 0 1.026e-05 8.208e-05 0.00% FabArray::LinComb() 27 0 1.009e-05 8.07e-05 0.00% makeSFC 42 4.411e-05 5.225e-05 6.165e-05 0.00% ClusterList::intersect() 1 0 7.486e-06 5.989e-05 0.00% BoxList::parallelComplementIn() 30 2.281e-05 2.802e-05 4.096e-05 0.00% Amr::writeSmallPlotFile() 1 3.025e-05 3.238e-05 3.862e-05 0.00% DistributionMapping::Distribute() 46 2.208e-05 2.419e-05 2.825e-05 0.00% BoxList::complementIn 30 1.107e-05 1.387e-05 2.618e-05 0.00% FabArray::RecvLayoutMask() 14 1.691e-05 1.745e-05 1.843e-05 0.00% ClusterList::chop() 1 0 2.182e-06 1.746e-05 0.00% Amr::initSubcycle() 1 8.783e-06 1.029e-05 1.421e-05 0.00% Castro::enforce_speed_limit() 33 1.106e-05 1.25e-05 1.419e-05 0.00% knapsack() 2 1.094e-05 1.204e-05 1.412e-05 0.00% Castro::apply_problem_tags() 15 7.572e-06 8.565e-06 9.38e-06 0.00% Gravity::set_mass_offset() 1 9.26e-07 2.207e-06 3.953e-06 0.00% Castro::gwstrain() 2 1.211e-06 1.42e-06 1.623e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 15 B 16 B 20 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.09-22-gb2052f2d2e5c) finalized