Initializing AMReX (24.01-29-gd5cc57909f51)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.01-29-gd5cc57909f51) initialized Starting run at 08:27:43 UTC on 2024-01-26. Successfully read inputs file ... Castro git describe: 24.01-18-g8f66f04f6 AMReX git describe: 24.01-29-gd5cc57909 Microphysics git describe: 24.01-9-ga4d7ab4d reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002503718 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.127783511 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001793733 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001932579 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00150242 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001167745 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001125394 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001615214 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001139189 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00112717 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001134195 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001127086 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001119272 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001649224 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001109533 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.224961344 seconds Ending run at 08:27:49 UTC on 2024-01-26. Run time = 6.430857281 Run time without initialization = 0.000295046 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.431 ... 6.431 ... 6.431 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1611 1.1789 1.1897 18.50% Amr::InitAmr() 1 1.136 1.136 1.136 17.67% Castro::post_init() 2 0.9937 0.9957 0.9982 15.52% Castro::computeTemp() 36 0.7418 0.8156 0.904 14.06% Castro::reset_internal_energy(Fab) 654 0.3974 0.4394 0.4933 7.67% FabArray::ParallelCopy_finish() 2952 0.07627 0.2885 0.4458 6.93% MLPoisson::Fsmooth() 5088 0.2344 0.2434 0.2578 4.01% Castro::normalize_species() 33 0.1641 0.1722 0.1855 2.88% Castro::initData() 3 0.1162 0.1346 0.158 2.46% AmrLevel::derive() 97 0.1394 0.1414 0.1465 2.28% amrex::Copy() 948 0.1274 0.1339 0.139 2.16% Castro::initMFs() 16 0.08894 0.09796 0.1127 1.75% FillBoundary_finish() 5539 0.05134 0.07367 0.08803 1.37% StateData::define() 64 0.05124 0.0563 0.06443 1.00% amrex::average_down 844 0.03999 0.04391 0.04883 0.76% FabArray::setVal() 1755 0.04324 0.04576 0.0482 0.75% FillBoundary_nowait() 5539 0.04019 0.04204 0.04514 0.70% MLCellLinOp::applyBC() 6281 0.03338 0.03541 0.03857 0.60% FabArray::ParallelCopy_nowait() 2952 0.02375 0.02622 0.03146 0.49% Castro::estTimeStep() 1 0.02165 0.0231 0.02853 0.44% MLPoisson::Fapply() 1027 0.02224 0.0242 0.02566 0.40% VisMF::Write(FabArray) 2 0.01708 0.01754 0.02005 0.31% FillPatchIterator::Initialize 215 0.01528 0.0164 0.01745 0.27% MLMG::addInterpCorrection() 530 0.01611 0.01633 0.01712 0.27% MLCellLinOp::reflux() 138 0.0154 0.01596 0.01632 0.25% Castro::buildMetrics() 16 0.0112 0.01233 0.01398 0.22% FabArray::Xpay() 1000 0.01199 0.01267 0.0139 0.22% MultiFab::Multiply() 287 0.01274 0.01322 0.0135 0.21% Amr::regrid() 14 0.009341 0.01122 0.01339 0.21% amrex::Add() 562 0.01054 0.01113 0.01152 0.18% MLCellLinOp::updateSolBC() 120 0.009836 0.01078 0.01136 0.18% MLPoisson::FFlux() 3408 0.01076 0.01102 0.01123 0.17% MLCellLinOp::updateCorBC() 106 0.008855 0.009756 0.01075 0.17% Castro::Castro() 16 0.008151 0.008896 0.01009 0.16% FillPatchInterp(MF) 44 0.001829 0.006748 0.00999 0.16% Amr::writePlotFile() 1 0.005316 0.007807 0.008377 0.13% MLMG::interpCorrection_1 106 0.006056 0.006895 0.007551 0.12% MLLinOp::makeSubCommunicator() 14 0.0004924 0.005171 0.007198 0.11% Castro::apply_tagging_restrictions() 15 0.005863 0.006326 0.006817 0.11% AmrMesh::MakeNewGrids() 15 0.006346 0.006393 0.006457 0.10% MLMG::prepareForSolve() 14 0.004742 0.004973 0.005192 0.08% FabArray::norminf(mask) 46 0.004699 0.004737 0.004773 0.07% MLMG::ResNormInf() 152 0.002663 0.003654 0.004531 0.07% MultiFab::max() 54 0.002759 0.003467 0.004142 0.06% MLCellLinOp::defineAuxData() 14 0.003889 0.003989 0.004079 0.06% FabArray::norminf() 188 0.002895 0.003317 0.00378 0.06% FabArrayBase::getCPC() 3662 0.003368 0.003467 0.003641 0.06% MLCellLinOp::compGrad() 28 0.003173 0.003332 0.00346 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002642 0.002939 0.003222 0.05% Castro::enforce_min_density() 33 0.002455 0.002577 0.002768 0.04% BndryData::define() 42 0.002356 0.002466 0.002614 0.04% Gravity::get_new_grav_vector() 4 0.001829 0.002093 0.002463 0.04% Gravity::actual_solve_with_mlmg() 14 0.002006 0.002064 0.002274 0.04% FabArray::FillBoundary() 5539 0.00195 0.002036 0.002268 0.04% DistributionMapping::LeastUsedCPUs() 9 0.000476 0.001307 0.002159 0.03% FabArrayBase::CPC::define() 624 0.001593 0.001729 0.001998 0.03% MLCellLinOp::defineBC() 14 0.001753 0.001877 0.001984 0.03% MLCellLinOp::smooth() 2544 0.001654 0.001712 0.00188 0.03% Castro::volWgtSum() 46 0.001628 0.001698 0.001784 0.03% FabArray::mult() 34 0.001119 0.001327 0.001642 0.03% Castro::enforce_consistent_e() 3 0.0009711 0.001175 0.001376 0.02% FillPatchTwoLevels 126 0.0006604 0.001107 0.001309 0.02% FabArray::ParallelCopy() 2952 0.001188 0.001221 0.001287 0.02% AMRErrorTag::operator() 15 0.001084 0.001121 0.001212 0.02% StateData::FillBoundary(geom) 8 0.001099 0.001147 0.001209 0.02% average_down_faces 84 0.001028 0.00114 0.0012 0.02% FabArrayBase::getFB() 5539 0.0009366 0.0009857 0.001066 0.02% MLCGSolver::bicgstab 13 0 0.0001273 0.001018 0.02% Gravity::actual_multilevel_solve() 14 0.0007472 0.0008419 0.0009407 0.01% Castro::sum_integrated_quantities() 1 0.0004924 0.0006271 0.0008559 0.01% Castro::build_fine_mask() 55 0.0006263 0.0007033 0.0007517 0.01% MLMG::solve() 14 0.0004337 0.0004879 0.0006022 0.01% AmrLevel::FillPatch() 215 0.0004808 0.0005067 0.0005509 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004897 0.0005186 0.0005446 0.01% MLCellLinOp::apply() 1027 0.0004163 0.0004436 0.0005164 0.01% MLMG::mgVcycle() 318 0.0003698 0.000403 0.0004565 0.01% MLCellLinOp::prepareForSolve() 14 0.000365 0.0003914 0.0004527 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003167 0.000368 0.0004479 0.01% main() 1 0.0003842 0.0004166 0.0004452 0.01% MLCellLinOp::correctionResidual() 742 0.0003732 0.0003896 0.000418 0.01% Amr::grid_places() 15 0.0003011 0.0003283 0.0003996 0.01% FabArray::setDomainBndry() 259 0.0003412 0.0003728 0.000397 0.01% MLCellLinOp::setLevelBC() 28 0.0003362 0.0003576 0.0003901 0.01% TagBoxArray::collate() 15 0.000232 0.0002825 0.0003788 0.01% MLLinOp::defineGrids() 14 0.000293 0.0003281 0.0003609 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.000274 0.000287 0.0002975 0.00% MLMG::MLResNormInf() 32 0.0001455 0.000196 0.0002929 0.00% MLMG::oneIter() 106 0.0002675 0.0002778 0.0002913 0.00% MLMG::mgVcycle_bottom 318 0.0002195 0.0002401 0.0002767 0.00% MLMG::actualBottomSolve() 106 2.013e-05 5.701e-05 0.0002764 0.00% MLCGSolver::ParallelAllReduce 95 0 2.924e-05 0.0002339 0.00% Castro::locWgtSum() 6 0.0002016 0.0002037 0.000209 0.00% MLCellLinOp::solutionResidual() 258 0.0001743 0.0001886 0.0002011 0.00% MLMG:computeResOfCorrection() 530 0.00015 0.000164 0.000189 0.00% StateDataPhysBCFunct::() 259 0.0001468 0.0001579 0.000187 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001621 0.0001694 0.0001869 0.00% AmrLevel::AmrLevel(dm) 16 0.000134 0.0001563 0.0001768 0.00% FillPatchSingleLevel 259 0.0001329 0.0001411 0.0001543 0.00% MLMG::mgVcycle_down::0 106 0.0001216 0.000133 0.0001457 0.00% FabArrayBase::FB::FB() 35 7.789e-05 9.441e-05 0.0001401 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001138 0.0001248 0.0001305 0.00% Gravity::update_max_rhs() 1 8.022e-05 0.0001017 0.0001303 0.00% FabArray::Saxpy() 54 0 1.592e-05 0.0001273 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001048 0.0001146 0.0001269 0.00% MLMG::miniCycle() 212 8.224e-05 0.0001012 0.0001243 0.00% amrex::Dot() 54 0 1.547e-05 0.0001238 0.00% MLMG::mgVcycle_down::1 106 0.0001053 0.0001117 0.0001232 0.00% FPinfo::FPinfo() 9 7.98e-05 9.058e-05 0.000108 0.00% OwnerMask() 15 9.104e-05 0.0001007 0.0001076 0.00% Castro::derive() 97 5.806e-05 6.772e-05 0.0001003 0.00% TagBoxArray::mapPRD 15 9.56e-05 9.789e-05 0.0001001 0.00% MLMG::mgVcycle_down::2 106 7.828e-05 8.399e-05 9.912e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 7.525e-05 8.549e-05 9.79e-05 0.00% MLMG::mgVcycle_down::3 106 7.722e-05 8.544e-05 9.535e-05 0.00% MLMG::mgVcycle_down::4 106 6.914e-05 7.385e-05 9.461e-05 0.00% Castro::volProductSum() 2 7.611e-05 8.419e-05 9.45e-05 0.00% Castro::post_regrid() 30 6.241e-05 7.994e-05 8.831e-05 0.00% MLMG::mgVcycle_up::1 106 5.683e-05 6.542e-05 8.559e-05 0.00% MLMG::mgVcycle_up::0 106 6.84e-05 7.117e-05 8.038e-05 0.00% FabArrayBase::TheFPinfo() 49 6.322e-05 6.854e-05 7.896e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.316e-05 6.939e-05 7.827e-05 0.00% MLMG::mgVcycle_up::4 106 6.718e-05 6.956e-05 7.768e-05 0.00% Castro::avgDown(state_indx) 60 6.244e-05 6.72e-05 7.658e-05 0.00% Amr::FinalizeInit() 1 1.958e-05 2.96e-05 7.457e-05 0.00% Castro::clean_state() 33 6.241e-05 6.791e-05 7.289e-05 0.00% MLMG::mgVcycle_up::3 106 5.557e-05 5.86e-05 6.617e-05 0.00% MLMG::mgVcycle_up::2 106 5.292e-05 5.643e-05 6.352e-05 0.00% MLMG::computeResidual() 106 5.677e-05 5.887e-05 6.332e-05 0.00% ClusterList::intersect() 1 0 7.702e-06 6.162e-05 0.00% Castro::errorEst() 15 3.996e-05 4.903e-05 6.035e-05 0.00% Castro::init(old) 13 4.269e-05 4.865e-05 5.808e-05 0.00% MLMG::computeMLResidual() 32 3.39e-05 4.566e-05 5.346e-05 0.00% amrex::average_down_w_geom 60 4.031e-05 4.454e-05 5.027e-05 0.00% Amr::defBaseLevel() 1 2.687e-05 3.738e-05 4.929e-05 0.00% MLPoisson::define() 14 3.406e-05 4.239e-05 4.708e-05 0.00% Castro::avgDown() 15 3.671e-05 4.14e-05 4.533e-05 0.00% makeSFC 42 2.779e-05 3.351e-05 4.256e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.205e-05 2.569e-05 3.718e-05 0.00% Amr::bldFineLevels() 1 1.772e-05 2.614e-05 3.488e-05 0.00% Amr::writeSmallPlotFile() 1 3.202e-05 3.377e-05 3.452e-05 0.00% AmrMesh-cluster 1 0 3.686e-06 2.949e-05 0.00% DistributionMapping::Distribute() 46 2.105e-05 2.38e-05 2.57e-05 0.00% Amr::initialInit() 1 1.269e-06 9.374e-06 2.504e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.648e-05 2.012e-05 2.41e-05 0.00% MLLinOp::define() 14 1.738e-05 1.934e-05 2.264e-05 0.00% knapsack() 2 1.058e-05 1.272e-05 1.998e-05 0.00% BoxList::complementIn 30 9.484e-06 1.325e-05 1.936e-05 0.00% MLMG::getGradSolution() 14 1.544e-05 1.658e-05 1.854e-05 0.00% ClusterList::chop() 1 0 2.069e-06 1.655e-05 0.00% FabArray::RecvLayoutMask() 14 1.517e-05 1.585e-05 1.638e-05 0.00% Castro::enforce_speed_limit() 33 1.154e-05 1.261e-05 1.459e-05 0.00% MLPoisson::prepareForSolve() 14 1.217e-05 1.306e-05 1.414e-05 0.00% BoxList::parallelComplementIn() 30 1.07e-05 1.148e-05 1.311e-05 0.00% Amr::initSubcycle() 1 9.653e-06 1.078e-05 1.153e-05 0.00% Castro::apply_problem_tags() 15 7.126e-06 8.183e-06 8.939e-06 0.00% MLMG::MLRhsNormInf() 14 7.659e-06 8.02e-06 8.479e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.668e-06 5.473e-06 8.126e-06 0.00% Castro::gwstrain() 2 1.079e-06 1.898e-06 6.311e-06 0.00% Amr::InitializeInit() 1 2.138e-06 3.102e-06 6.005e-06 0.00% Amr::init() 1 1.686e-06 2.305e-06 3.654e-06 0.00% Gravity::set_mass_offset() 1 8.29e-07 2.003e-06 3.417e-06 0.00% Castro::computeInitialDt() 1 1.183e-06 1.778e-06 2.382e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.431 6.431 6.431 100.00% Amr::init() 1 5.294 5.294 5.294 82.32% Amr::initialInit() 1 5.069 5.069 5.069 78.82% Amr::FinalizeInit() 1 4.956 4.958 4.963 77.18% Castro::post_init() 2 3.657 3.788 3.88 60.34% Gravity::multilevel_solve_for_new_phi() 14 1.816 1.833 1.845 28.68% Gravity::actual_multilevel_solve() 14 1.813 1.83 1.842 28.64% Gravity::solve_phi_with_mlmg() 14 1.807 1.823 1.836 28.54% Castro::computeTemp() 36 1.139 1.255 1.398 21.73% Amr::regrid() 14 1.254 1.277 1.308 20.33% Castro::clean_state() 33 1.098 1.184 1.292 20.09% Gravity::fill_multipole_BCs() 14 1.163 1.18 1.191 18.52% Amr::InitAmr() 1 1.136 1.136 1.136 17.67% Amr::bldFineLevels() 1 0.9128 0.9842 1.087 16.90% Castro::post_regrid() 30 0.853 0.8982 0.9538 14.83% Castro::initData() 3 0.5829 0.6802 0.8022 12.47% Gravity::actual_solve_with_mlmg() 14 0.6378 0.6425 0.6445 10.02% MLMG::solve() 14 0.6193 0.6198 0.6201 9.64% MLMG::oneIter() 106 0.549 0.5498 0.5501 8.55% FabArray::ParallelCopy() 2952 0.1285 0.3429 0.4989 7.76% Castro::reset_internal_energy(MultiFab) 36 0.3977 0.4398 0.4937 7.68% Castro::reset_internal_energy(Fab) 654 0.3974 0.4394 0.4933 7.67% FabArray::ParallelCopy_finish() 2952 0.07627 0.2885 0.4458 6.93% MLMG::mgVcycle() 318 0.4169 0.418 0.4205 6.54% MLCellLinOp::smooth() 2544 0.3515 0.3537 0.3588 5.58% amrex::average_down 844 0.07487 0.2062 0.2983 4.64% Castro::avgDown() 15 0.04546 0.1769 0.2698 4.20% Castro::avgDown(state_indx) 60 0.04542 0.1768 0.2698 4.20% amrex::average_down_w_geom 60 0.04535 0.1768 0.2697 4.19% MLPoisson::Fsmooth() 5088 0.2344 0.2434 0.2578 4.01% Amr::writePlotFile() 1 0.2251 0.2252 0.2252 3.50% Castro::derive() 97 0.2003 0.2007 0.201 3.13% AmrLevel::derive() 97 0.2003 0.2006 0.2009 3.12% Castro::normalize_species() 33 0.1641 0.1722 0.1855 2.88% MLCellLinOp::applyBC() 6281 0.1367 0.1542 0.1654 2.57% Castro::Castro() 16 0.1274 0.1395 0.1566 2.43% Amr::grid_places() 15 0.01903 0.09176 0.1466 2.28% AmrMesh::MakeNewGrids() 15 0.01871 0.09143 0.1463 2.27% amrex::Copy() 948 0.1274 0.1339 0.139 2.16% FabArray::FillBoundary() 5539 0.09816 0.1188 0.132 2.05% TagBoxArray::mapPRD 15 0.001707 0.0743 0.1296 2.01% AmrLevel::FillPatch() 215 0.1148 0.1187 0.1218 1.89% MLMG::mgVcycle_down::0 106 0.1168 0.1176 0.1188 1.85% MLMG::mgVcycle_bottom 318 0.1115 0.1129 0.1154 1.80% MLMG::miniCycle() 212 0.1117 0.1127 0.1141 1.77% Castro::initMFs() 16 0.08894 0.09796 0.1127 1.75% Amr::InitializeInit() 1 0.1056 0.111 0.1125 1.75% Amr::defBaseLevel() 1 0.1056 0.111 0.1125 1.75% MLMG::mgVcycle_up::0 106 0.1071 0.1075 0.1082 1.68% FillPatchIterator::Initialize 215 0.09041 0.09322 0.09653 1.50% FillBoundary_finish() 5539 0.05134 0.07367 0.08803 1.37% MLMG::computeResWithCrseSolFineCor() 106 0.07023 0.07211 0.07338 1.14% AmrLevel::AmrLevel(dm) 16 0.05138 0.05645 0.06456 1.00% StateData::define() 64 0.05124 0.0563 0.06443 1.00% MLCellLinOp::apply() 1027 0.0586 0.06116 0.06319 0.98% FillPatchSingleLevel 259 0.05267 0.05787 0.06108 0.95% MLCellLinOp::correctionResidual() 742 0.05714 0.05828 0.05998 0.93% FabArray::ParallelCopy_nowait() 2952 0.05092 0.05316 0.05878 0.91% MLCellLinOp::solutionResidual() 258 0.05274 0.05486 0.05658 0.88% FillPatchIterator::FillFromTwoLevels() 126 0.04616 0.04883 0.05214 0.81% FillPatchTwoLevels 126 0.04603 0.0487 0.05203 0.81% Castro::init(old) 13 0.04397 0.04655 0.04896 0.76% MLCellLinOp::reflux() 138 0.04472 0.0471 0.04826 0.75% FabArray::setVal() 1755 0.04324 0.04576 0.0482 0.75% FillBoundary_nowait() 5539 0.04123 0.04312 0.04631 0.72% MLMG::computeResWithCrseCorFineCor() 106 0.03002 0.03134 0.03193 0.50% FillPatchIterator::FillFromLevel0() 89 0.02414 0.02766 0.03044 0.47% Castro::computeInitialDt() 1 0.02165 0.0231 0.02853 0.44% Castro::estTimeStep() 1 0.02165 0.0231 0.02853 0.44% MLMG::addInterpCorrection() 530 0.01792 0.02712 0.02849 0.44% MLMG::computeResidual() 106 0.02604 0.02703 0.02748 0.43% MLPoisson::Fapply() 1027 0.02224 0.0242 0.02566 0.40% MLMG::mgVcycle_down::1 106 0.0239 0.02467 0.02506 0.39% MLMG::computeMLResidual() 32 0.01972 0.02067 0.02145 0.33% MLCellLinOp::updateSolBC() 120 0.01954 0.0202 0.02129 0.33% MLMG::mgVcycle_up::1 106 0.0207 0.021 0.02111 0.33% MLMG:computeResOfCorrection() 530 0.01864 0.01945 0.02022 0.31% VisMF::Write(FabArray) 2 0.01708 0.01754 0.02005 0.31% MLMG::mgVcycle_up::2 106 0.008828 0.01824 0.01981 0.31% MLCellLinOp::updateCorBC() 106 0.01791 0.01861 0.01923 0.30% Gravity::get_new_grav_vector() 4 0.01801 0.01834 0.01894 0.29% MLPoisson::define() 14 0.01135 0.01571 0.01747 0.27% Castro::buildMetrics() 16 0.01255 0.01385 0.01562 0.24% FabArray::Xpay() 1000 0.01199 0.01267 0.0139 0.22% MultiFab::Multiply() 287 0.01274 0.01322 0.0135 0.21% MLMG::interpCorrection_1 106 0.01053 0.01133 0.01248 0.19% amrex::Add() 562 0.01054 0.01113 0.01152 0.18% MLPoisson::FFlux() 3408 0.01076 0.01102 0.01123 0.17% MLMG::mgVcycle_down::2 106 0.009824 0.01012 0.01109 0.17% Castro::errorEst() 15 0.009753 0.0102 0.01076 0.17% MLMG::ResNormInf() 152 0.009183 0.009926 0.01067 0.17% MLMG::prepareForSolve() 14 0.009395 0.009923 0.01058 0.16% FillPatchInterp(MF) 44 0.001829 0.006748 0.00999 0.16% MLLinOp::define() 14 0.0008709 0.005596 0.007668 0.12% MLLinOp::defineGrids() 14 0.0008524 0.005577 0.007648 0.12% MLLinOp::makeSubCommunicator() 14 0.0004924 0.005171 0.007198 0.11% Castro::apply_tagging_restrictions() 15 0.005863 0.006326 0.006817 0.11% FabArrayBase::getCPC() 3662 0.004961 0.005196 0.005421 0.08% MLCellLinOp::defineBC() 14 0.00488 0.005072 0.005343 0.08% MLCellLinOp::defineAuxData() 14 0.004875 0.005 0.005229 0.08% Castro::sum_integrated_quantities() 1 0.004898 0.004908 0.00495 0.08% FabArray::norminf(mask) 46 0.004699 0.004737 0.004773 0.07% MLMG::getGradSolution() 14 0.004504 0.004616 0.00474 0.07% MLCellLinOp::compGrad() 28 0.004488 0.004599 0.004723 0.07% MLMG::mgVcycle_down::3 106 0.001308 0.00178 0.00437 0.07% MultiFab::max() 54 0.002759 0.003467 0.004142 0.06% MLMG::MLResNormInf() 32 0.003747 0.003823 0.003962 0.06% FabArray::norminf() 188 0.002895 0.003317 0.00378 0.06% MLMG::mgVcycle_up::3 106 0.0009272 0.001283 0.00353 0.05% Gravity::average_fine_ec_onto_crse_ec() 14 0.003232 0.003407 0.003507 0.05% BndryData::define() 42 0.002922 0.003066 0.003216 0.05% MLMG::actualBottomSolve() 106 2.013e-05 0.0003686 0.002769 0.04% Castro::enforce_min_density() 33 0.002455 0.002577 0.002768 0.04% MLCGSolver::bicgstab 13 0 0.0003053 0.002442 0.04% FabArrayBase::TheFPinfo() 49 0.0006311 0.001448 0.002292 0.04% MLMG::mgVcycle_down::4 106 0.001123 0.001311 0.002239 0.03% FPinfo::FPinfo() 9 0.0005641 0.001379 0.002224 0.03% DistributionMapping::LeastUsedCPUs() 9 0.000476 0.001307 0.002159 0.03% average_down_faces 84 0.001839 0.001998 0.002091 0.03% FabArrayBase::CPC::define() 624 0.001593 0.001729 0.001998 0.03% MLMG::mgVcycle_up::4 106 0.001079 0.001214 0.001861 0.03% MLMG::MLRhsNormInf() 14 0.001748 0.001774 0.001802 0.03% Castro::volWgtSum() 46 0.001633 0.001702 0.001788 0.03% Gravity::update_max_rhs() 1 0.000611 0.001119 0.001748 0.03% FabArray::mult() 34 0.001119 0.001327 0.001642 0.03% Castro::enforce_consistent_e() 3 0.0009711 0.001175 0.001376 0.02% StateDataPhysBCFunct::() 259 0.001255 0.001304 0.001364 0.02% AMRErrorTag::operator() 15 0.001084 0.001121 0.001212 0.02% StateData::FillBoundary(geom) 8 0.001099 0.001147 0.001209 0.02% FabArrayBase::getFB() 5539 0.001015 0.00108 0.001169 0.02% Castro::build_fine_mask() 55 0.0006263 0.0007033 0.0007517 0.01% DistributionMapping::KnapSackDoIt() 2 4.52e-05 0.0002998 0.0005732 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004897 0.0005186 0.0005446 0.01% MLPoisson::prepareForSolve() 14 0.0003772 0.0004044 0.0004668 0.01% MLCellLinOp::prepareForSolve() 14 0.000365 0.0003914 0.0004527 0.01% FabArray::setDomainBndry() 259 0.0003412 0.0003728 0.000397 0.01% MLCellLinOp::setLevelBC() 28 0.0003362 0.0003576 0.0003901 0.01% TagBoxArray::collate() 15 0.000232 0.0002825 0.0003788 0.01% MLCGSolver::ParallelAllReduce 95 0 3.838e-05 0.000307 0.00% Castro::locWgtSum() 6 0.0002021 0.0002042 0.0002094 0.00% FabArrayBase::FB::FB() 35 7.789e-05 9.441e-05 0.0001401 0.00% FabArray::Saxpy() 54 0 1.592e-05 0.0001273 0.00% amrex::Dot() 54 0 1.547e-05 0.0001238 0.00% AmrMesh-cluster 1 0 1.346e-05 0.0001077 0.00% OwnerMask() 15 9.104e-05 0.0001007 0.0001076 0.00% Castro::volProductSum() 2 7.635e-05 8.439e-05 9.469e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.711e-05 7.774e-05 9.234e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.56e-05 6.154e-05 6.799e-05 0.00% makeSFC 42 4.479e-05 5.205e-05 6.269e-05 0.00% ClusterList::intersect() 1 0 7.702e-06 6.162e-05 0.00% Amr::writeSmallPlotFile() 1 3.202e-05 3.377e-05 3.452e-05 0.00% BoxList::parallelComplementIn() 30 2.045e-05 2.472e-05 3.246e-05 0.00% DistributionMapping::Distribute() 46 2.105e-05 2.38e-05 2.57e-05 0.00% knapsack() 2 1.058e-05 1.272e-05 1.998e-05 0.00% BoxList::complementIn 30 9.484e-06 1.325e-05 1.936e-05 0.00% ClusterList::chop() 1 0 2.069e-06 1.655e-05 0.00% FabArray::RecvLayoutMask() 14 1.517e-05 1.585e-05 1.638e-05 0.00% Castro::enforce_speed_limit() 33 1.154e-05 1.261e-05 1.459e-05 0.00% Amr::initSubcycle() 1 9.653e-06 1.078e-05 1.153e-05 0.00% Castro::apply_problem_tags() 15 7.126e-06 8.183e-06 8.939e-06 0.00% Castro::gwstrain() 2 1.079e-06 1.898e-06 6.311e-06 0.00% Gravity::set_mass_offset() 1 8.29e-07 2.003e-06 3.417e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 18 B 19 B 20 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.01-29-gd5cc57909f51) finalized