Initializing AMReX (23.10-22-gbe6c6415467d)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.10-22-gbe6c6415467d) initialized Starting run at 06:35:25 UTC on 2023-10-27. Successfully read inputs file ... Castro git describe: 23.10-46-g13f63f26e AMReX git describe: 23.10-22-gbe6c64154 Microphysics git describe: 23.10-18-g5dd1a910 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002480084 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.125277417 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.00162494 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001918269 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001126501 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00111774 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001197597 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001137173 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001146791 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001127958 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001154941 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001140214 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001165243 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001086026 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00107939 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.241430505 seconds Ending run at 06:35:31 UTC on 2023-10-27. Run time = 6.501040518 Run time without initialization = 0.0002923540001 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.501 ... 6.501 ... 6.501 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1704 1.1794 1.1893 18.29% Amr::InitAmr() 1 1.148 1.149 1.149 17.67% Castro::post_init() 2 1.026 1.028 1.03 15.85% Castro::computeTemp() 36 0.7832 0.8357 0.9221 14.18% Castro::reset_internal_energy(Fab) 654 0.417 0.4538 0.5044 7.76% FabArray::ParallelCopy_finish() 2952 0.06646 0.291 0.4242 6.52% MLPoisson::Fsmooth() 5088 0.1988 0.2072 0.218 3.35% Castro::normalize_species() 33 0.1641 0.1727 0.1862 2.86% Castro::initData() 3 0.1232 0.1382 0.1622 2.49% AmrLevel::derive() 97 0.1436 0.1447 0.1462 2.25% amrex::Copy() 975 0.1324 0.1359 0.1399 2.15% Castro::initMFs() 16 0.08813 0.09679 0.1105 1.70% FillBoundary_finish() 5552 0.04957 0.06186 0.07733 1.19% StateData::define() 64 0.05025 0.05543 0.06339 0.98% FabArray::setVal() 1769 0.03993 0.0502 0.05462 0.84% amrex::average_down 844 0.04288 0.04683 0.0518 0.80% FillBoundary_nowait() 5552 0.04109 0.04383 0.04609 0.71% MLCellLinOp::applyBC() 6294 0.0335 0.036 0.03973 0.61% VisMF::Write(FabArray) 2 0.02827 0.03037 0.03298 0.51% FabArray::ParallelCopy_nowait() 2952 0.02411 0.02632 0.03094 0.48% MLPoisson::Fapply() 1040 0.02404 0.02551 0.02691 0.41% Castro::estTimeStep() 1 0.02242 0.0236 0.02513 0.39% FillPatchIterator::Initialize 215 0.01631 0.01742 0.01854 0.29% MLCellLinOp::reflux() 138 0.01632 0.01694 0.0177 0.27% MLMG::addInterpCorrection() 530 0.01661 0.01702 0.01763 0.27% FabArray::Xpay() 1013 0.01275 0.01371 0.01455 0.22% Castro::buildMetrics() 16 0.01091 0.01208 0.01383 0.21% MultiFab::Multiply() 287 0.01291 0.01337 0.0138 0.21% amrex::Add() 575 0.01095 0.01179 0.01269 0.20% MLPoisson::FFlux() 3408 0.01132 0.01174 0.01259 0.19% Amr::regrid() 14 0.008389 0.009787 0.01211 0.19% MLCellLinOp::updateSolBC() 120 0.009993 0.01097 0.0116 0.18% Amr::writePlotFile() 1 0.00557 0.008232 0.01083 0.17% MLCellLinOp::updateCorBC() 106 0.008975 0.009862 0.01042 0.16% FillPatchInterp(MF) 44 0.001853 0.00683 0.01031 0.16% Castro::Castro() 16 0.0079 0.008859 0.01018 0.16% MLMG::interpCorrection_1 106 0.006593 0.007159 0.007867 0.12% Castro::apply_tagging_restrictions() 15 0.005868 0.006404 0.006783 0.10% AmrMesh::MakeNewGrids() 15 0.006414 0.006518 0.006643 0.10% MLMG::prepareForSolve() 14 0.004821 0.005129 0.005334 0.08% FabArray::norminf(mask) 46 0.004911 0.005047 0.005178 0.08% MLMG::ResNormInf() 152 0.002739 0.003812 0.004484 0.07% MLCellLinOp::defineAuxData() 14 0.003977 0.004061 0.004175 0.06% MLLinOp::makeSubCommunicator() 14 0.0007694 0.002613 0.004147 0.06% FabArray::norminf() 174 0.003139 0.003453 0.004014 0.06% FabArrayBase::getCPC() 3662 0.003474 0.003549 0.003644 0.06% MultiFab::max() 54 0.002774 0.003336 0.003599 0.06% MLCellLinOp::compGrad() 28 0.003199 0.003317 0.003457 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002711 0.002918 0.003117 0.05% Castro::enforce_min_density() 33 0.002472 0.002626 0.002862 0.04% BndryData::define() 42 0.002461 0.002538 0.002651 0.04% Gravity::get_new_grav_vector() 4 0.001888 0.00213 0.002461 0.04% FabArrayBase::CPC::define() 624 0.001681 0.001871 0.002412 0.04% Gravity::actual_solve_with_mlmg() 14 0.002031 0.002149 0.002387 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0001841 0.001349 0.002299 0.04% FabArray::FillBoundary() 5552 0.002004 0.002095 0.002239 0.03% MLCellLinOp::defineBC() 14 0.001809 0.00194 0.002033 0.03% Castro::volWgtSum() 46 0.001664 0.001707 0.001827 0.03% MLCellLinOp::smooth() 2544 0.001678 0.00173 0.001807 0.03% MLCGSolver::bicgstab 13 0 0.0001968 0.001574 0.02% FabArray::mult() 34 0.001226 0.001345 0.001511 0.02% Castro::enforce_consistent_e() 3 0.001039 0.001226 0.001434 0.02% FillPatchTwoLevels 126 0.0006905 0.001123 0.001363 0.02% average_down_faces 84 0.00109 0.001197 0.001299 0.02% FabArray::ParallelCopy() 2952 0.001212 0.001242 0.001295 0.02% AMRErrorTag::operator() 15 0.001114 0.001147 0.001195 0.02% StateData::FillBoundary(geom) 8 0.001075 0.001099 0.001145 0.02% FabArrayBase::getFB() 5552 0.0009498 0.001008 0.001122 0.02% Gravity::actual_multilevel_solve() 14 0.0008185 0.0008473 0.0008772 0.01% Castro::sum_integrated_quantities() 1 0.0004837 0.0006912 0.0008332 0.01% Castro::build_fine_mask() 55 0.0006524 0.0006932 0.0007222 0.01% MLMG::solve() 14 0.0003608 0.0004901 0.0006251 0.01% MLCellLinOp::apply() 1040 0.0004183 0.0004699 0.0006061 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005054 0.0005293 0.0005599 0.01% AmrLevel::FillPatch() 215 0.0004892 0.0005292 0.0005567 0.01% MLCellLinOp::prepareForSolve() 14 0.000368 0.0003988 0.0004661 0.01% MLCellLinOp::correctionResidual() 755 0.0003855 0.0004082 0.0004556 0.01% main() 1 0.0003781 0.000412 0.0004506 0.01% Amr::grid_places() 15 0.000319 0.0003524 0.0004443 0.01% MLMG::mgVcycle() 318 0.000395 0.0004148 0.0004393 0.01% MLLinOp::defineGrids() 14 0.0002731 0.0003252 0.0004059 0.01% FabArray::setDomainBndry() 259 0.0003363 0.0003638 0.000396 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003175 0.0003495 0.0003941 0.01% MLCellLinOp::setLevelBC() 28 0.0003161 0.0003437 0.0003742 0.01% TagBoxArray::collate() 15 0.0002196 0.0002729 0.0003643 0.01% MLMG::oneIter() 106 0.0002859 0.0003023 0.0003153 0.00% MLMG::MLResNormInf() 32 0.0001105 0.0002169 0.000297 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002742 0.0002859 0.0002948 0.00% MLMG::actualBottomSolve() 106 2.304e-05 5.88e-05 0.0002944 0.00% MLMG::mgVcycle_bottom 318 0.0002169 0.0002308 0.0002646 0.00% MLCGSolver::ParallelAllReduce 81 0 2.92e-05 0.0002336 0.00% Castro::locWgtSum() 6 0.0001874 0.0002006 0.0002106 0.00% MLCellLinOp::solutionResidual() 258 0.0001849 0.0001995 0.0002083 0.00% MLMG:computeResOfCorrection() 530 0.0001585 0.0001684 0.0001831 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001557 0.0001694 0.000183 0.00% MLMG::mgVcycle_down::0 106 0.0001367 0.0001517 0.0001689 0.00% StateDataPhysBCFunct::() 259 0.0001456 0.0001564 0.000165 0.00% AmrLevel::AmrLevel(dm) 16 0.0001282 0.0001482 0.0001579 0.00% FillPatchSingleLevel 259 0.0001356 0.0001439 0.0001529 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001153 0.0001294 0.0001417 0.00% FabArrayBase::FB::FB() 35 7.975e-05 9.269e-05 0.0001375 0.00% Gravity::update_max_rhs() 1 8.349e-05 9.963e-05 0.0001366 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001208 0.0001239 0.0001287 0.00% MLMG::mgVcycle_down::1 106 0.0001162 0.0001206 0.0001266 0.00% amrex::Dot() 54 0 1.531e-05 0.0001225 0.00% MLMG::miniCycle() 212 8.596e-05 9.817e-05 0.0001218 0.00% OwnerMask() 15 8.649e-05 0.0001032 0.0001149 0.00% Castro::volProductSum() 2 7.978e-05 9.18e-05 0.0001127 0.00% FPinfo::FPinfo() 9 7.471e-05 8.632e-05 0.0001026 0.00% TagBoxArray::mapPRD 15 9.593e-05 9.899e-05 0.0001022 0.00% MLMG::computeResWithCrseCorFineCor() 106 7.723e-05 8.25e-05 9.748e-05 0.00% MLMG::mgVcycle_down::2 106 8.598e-05 9.098e-05 9.577e-05 0.00% MLMG::mgVcycle_down::3 106 7.477e-05 8.145e-05 9.177e-05 0.00% FabArray::LinComb() 27 0 1.084e-05 8.67e-05 0.00% MLMG::mgVcycle_down::4 106 6.99e-05 7.76e-05 8.486e-05 0.00% Castro::post_regrid() 30 6.011e-05 6.922e-05 8.397e-05 0.00% Castro::derive() 97 6.028e-05 6.87e-05 8.295e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.266e-05 6.865e-05 8.258e-05 0.00% FabArray::Saxpy() 27 0 9.99e-06 7.992e-05 0.00% Amr::FinalizeInit() 1 8.016e-06 2.339e-05 7.841e-05 0.00% MLMG::mgVcycle_up::1 106 6.138e-05 6.788e-05 7.733e-05 0.00% Castro::avgDown(state_indx) 60 6.185e-05 6.876e-05 7.499e-05 0.00% MLMG::mgVcycle_up::0 106 6.442e-05 6.854e-05 7.347e-05 0.00% MLMG::mgVcycle_up::3 106 5.514e-05 6.046e-05 7.306e-05 0.00% MLMG::mgVcycle_up::4 106 6.289e-05 6.688e-05 7.215e-05 0.00% MLMG::computeResidual() 106 5.441e-05 5.852e-05 7.15e-05 0.00% Castro::clean_state() 33 6.109e-05 6.751e-05 7.126e-05 0.00% FabArrayBase::TheFPinfo() 49 6.439e-05 6.754e-05 7.126e-05 0.00% MLMG::mgVcycle_up::2 106 5.52e-05 6.02e-05 6.995e-05 0.00% Castro::errorEst() 15 4.434e-05 4.964e-05 6.94e-05 0.00% Castro::avgDown() 15 3.521e-05 4.707e-05 6.511e-05 0.00% Amr::defBaseLevel() 1 3.203e-05 5.044e-05 6.266e-05 0.00% ClusterList::intersect() 1 0 7.574e-06 6.059e-05 0.00% MLPoisson::define() 14 3.593e-05 4.748e-05 5.951e-05 0.00% Castro::init(old) 13 4.207e-05 4.993e-05 5.618e-05 0.00% amrex::average_down_w_geom 60 4.041e-05 4.602e-05 5.519e-05 0.00% MLMG::computeMLResidual() 32 3.624e-05 4.101e-05 5.157e-05 0.00% makeSFC 42 2.813e-05 3.723e-05 4.552e-05 0.00% Amr::bldFineLevels() 1 1.367e-05 1.943e-05 4.332e-05 0.00% FabArray::RecvLayoutMask() 14 1.507e-05 1.875e-05 3.876e-05 0.00% Amr::writeSmallPlotFile() 1 3.438e-05 3.499e-05 3.607e-05 0.00% AmrMesh-cluster 1 0 4.373e-06 3.498e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.249e-05 2.445e-05 2.776e-05 0.00% DistributionMapping::Distribute() 46 2.283e-05 2.457e-05 2.663e-05 0.00% MLLinOp::define() 14 1.708e-05 1.894e-05 2.264e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.72e-05 1.861e-05 2.039e-05 0.00% MLMG::getGradSolution() 14 1.525e-05 1.775e-05 1.96e-05 0.00% ClusterList::chop() 1 0 2.051e-06 1.641e-05 0.00% BoxList::complementIn 30 1.042e-05 1.213e-05 1.432e-05 0.00% Castro::enforce_speed_limit() 33 1.054e-05 1.19e-05 1.331e-05 0.00% BoxList::parallelComplementIn() 30 1.085e-05 1.18e-05 1.282e-05 0.00% MLPoisson::prepareForSolve() 14 1.041e-05 1.185e-05 1.275e-05 0.00% knapsack() 2 1.043e-05 1.162e-05 1.263e-05 0.00% Amr::initSubcycle() 1 1.108e-05 1.121e-05 1.139e-05 0.00% DistributionMapping::KnapSackDoIt() 2 4.209e-06 5.34e-06 1.036e-05 0.00% Castro::gwstrain() 2 9.14e-07 2.251e-06 9.425e-06 0.00% Castro::apply_problem_tags() 15 7.292e-06 7.782e-06 8.523e-06 0.00% MLMG::MLRhsNormInf() 14 7.591e-06 8.02e-06 8.272e-06 0.00% Gravity::set_mass_offset() 1 9.68e-07 2.92e-06 4.429e-06 0.00% Amr::InitializeInit() 1 2.103e-06 2.512e-06 4.296e-06 0.00% Castro::computeInitialDt() 1 1.394e-06 1.905e-06 2.245e-06 0.00% Amr::init() 1 1.621e-06 1.816e-06 2.209e-06 0.00% Amr::initialInit() 1 1.238e-06 1.499e-06 2.034e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.501 6.501 6.501 100.00% Amr::init() 1 5.352 5.352 5.352 82.33% Amr::initialInit() 1 5.11 5.11 5.111 78.61% Amr::FinalizeInit() 1 4.996 4.997 4.999 76.89% Castro::post_init() 2 3.67 3.799 3.88 59.69% Gravity::multilevel_solve_for_new_phi() 14 1.787 1.796 1.807 27.79% Gravity::actual_multilevel_solve() 14 1.784 1.793 1.804 27.75% Gravity::solve_phi_with_mlmg() 14 1.777 1.787 1.798 27.66% Castro::computeTemp() 36 1.202 1.29 1.425 21.92% Amr::regrid() 14 1.278 1.306 1.342 20.65% Castro::clean_state() 33 1.143 1.212 1.318 20.27% Gravity::fill_multipole_BCs() 14 1.172 1.181 1.191 18.32% Amr::InitAmr() 1 1.148 1.149 1.149 17.67% Amr::bldFineLevels() 1 0.944 1.009 1.113 17.12% Castro::post_regrid() 30 0.8796 0.9184 0.9741 14.98% Castro::initData() 3 0.6193 0.7001 0.822 12.64% Gravity::actual_solve_with_mlmg() 14 0.604 0.6056 0.6072 9.34% MLMG::solve() 14 0.5847 0.585 0.5852 9.00% MLMG::oneIter() 106 0.5105 0.5114 0.5119 7.87% Castro::reset_internal_energy(MultiFab) 36 0.4173 0.4541 0.5047 7.76% Castro::reset_internal_energy(Fab) 654 0.417 0.4538 0.5044 7.76% FabArray::ParallelCopy() 2952 0.1262 0.3463 0.4781 7.35% FabArray::ParallelCopy_finish() 2952 0.06646 0.291 0.4242 6.52% MLMG::mgVcycle() 318 0.3748 0.3756 0.3773 5.80% MLCellLinOp::smooth() 2544 0.3076 0.3095 0.3155 4.85% amrex::average_down 844 0.07889 0.2074 0.2877 4.43% Castro::avgDown() 15 0.04663 0.1758 0.2575 3.96% Castro::avgDown(state_indx) 60 0.04657 0.1758 0.2575 3.96% amrex::average_down_w_geom 60 0.04651 0.1757 0.2574 3.96% Amr::writePlotFile() 1 0.2415 0.2417 0.2417 3.72% MLPoisson::Fsmooth() 5088 0.1988 0.2072 0.218 3.35% Castro::derive() 97 0.2031 0.2036 0.2041 3.14% AmrLevel::derive() 97 0.2031 0.2036 0.204 3.14% Castro::normalize_species() 33 0.1641 0.1727 0.1862 2.86% Castro::Castro() 16 0.124 0.1407 0.1593 2.45% MLCellLinOp::applyBC() 6294 0.1373 0.1449 0.1556 2.39% Amr::grid_places() 15 0.01927 0.09569 0.143 2.20% AmrMesh::MakeNewGrids() 15 0.01892 0.09533 0.1426 2.19% amrex::Copy() 975 0.1324 0.1359 0.1399 2.15% TagBoxArray::mapPRD 15 0.00179 0.07809 0.1259 1.94% AmrLevel::FillPatch() 215 0.1174 0.1211 0.1233 1.90% FabArray::FillBoundary() 5552 0.09916 0.1089 0.1221 1.88% Amr::InitializeInit() 1 0.1117 0.1133 0.1145 1.76% Amr::defBaseLevel() 1 0.1117 0.1133 0.1145 1.76% Castro::initMFs() 16 0.08813 0.09679 0.1105 1.70% MLMG::mgVcycle_down::0 106 0.1042 0.1047 0.1054 1.62% MLMG::mgVcycle_bottom 318 0.09878 0.1001 0.1043 1.60% MLMG::miniCycle() 212 0.09892 0.09971 0.1008 1.55% FillPatchIterator::Initialize 215 0.09004 0.09482 0.09819 1.51% MLMG::mgVcycle_up::0 106 0.09234 0.09251 0.0927 1.43% FillBoundary_finish() 5552 0.04957 0.06186 0.07733 1.19% MLMG::computeResWithCrseSolFineCor() 106 0.07361 0.07524 0.07621 1.17% AmrLevel::AmrLevel(dm) 16 0.05041 0.05557 0.06352 0.98% FillPatchSingleLevel 259 0.05261 0.0583 0.06346 0.98% StateData::define() 64 0.05025 0.05543 0.06339 0.98% MLCellLinOp::apply() 1040 0.05796 0.06013 0.06144 0.95% MLCellLinOp::correctionResidual() 755 0.05661 0.05801 0.05913 0.91% FabArray::ParallelCopy_nowait() 2952 0.05207 0.05403 0.05841 0.90% MLCellLinOp::solutionResidual() 258 0.05419 0.05564 0.05712 0.88% FabArray::setVal() 1769 0.03993 0.0502 0.05462 0.84% FillPatchIterator::FillFromTwoLevels() 126 0.04495 0.05071 0.05444 0.84% FillPatchTwoLevels 126 0.04483 0.05058 0.05431 0.84% Castro::init(old) 13 0.04547 0.04898 0.05201 0.80% MLCellLinOp::reflux() 138 0.04809 0.04998 0.05141 0.79% FillBoundary_nowait() 5552 0.04219 0.04493 0.04735 0.73% VisMF::Write(FabArray) 2 0.02827 0.03037 0.03298 0.51% MLMG::computeResWithCrseCorFineCor() 106 0.0305 0.03154 0.03217 0.49% MLMG::addInterpCorrection() 530 0.01922 0.02939 0.03097 0.48% MLMG::computeResidual() 106 0.02712 0.02815 0.02859 0.44% FillPatchIterator::FillFromLevel0() 89 0.02484 0.02638 0.02799 0.43% MLPoisson::Fapply() 1040 0.02404 0.02551 0.02691 0.41% Castro::computeInitialDt() 1 0.02242 0.02361 0.02513 0.39% Castro::estTimeStep() 1 0.02242 0.0236 0.02513 0.39% MLMG::mgVcycle_down::1 106 0.02224 0.02288 0.02331 0.36% MLMG::computeMLResidual() 32 0.02154 0.02201 0.02252 0.35% MLMG::mgVcycle_up::2 106 0.009339 0.02032 0.02201 0.34% MLCellLinOp::updateSolBC() 120 0.01987 0.02059 0.02124 0.33% MLMG::mgVcycle_up::1 106 0.0195 0.01957 0.0197 0.30% Gravity::get_new_grav_vector() 4 0.01752 0.01873 0.01958 0.30% MLCellLinOp::updateCorBC() 106 0.01782 0.01867 0.01954 0.30% MLMG:computeResOfCorrection() 530 0.01803 0.01822 0.01851 0.28% Castro::buildMetrics() 16 0.01236 0.01365 0.0156 0.24% MLPoisson::define() 14 0.01181 0.0135 0.01533 0.24% FabArray::Xpay() 1013 0.01275 0.01371 0.01455 0.22% MultiFab::Multiply() 287 0.01291 0.01337 0.0138 0.21% amrex::Add() 575 0.01095 0.01179 0.01269 0.20% MLPoisson::FFlux() 3408 0.01132 0.01174 0.01259 0.19% MLMG::interpCorrection_1 106 0.009899 0.01064 0.01143 0.18% MLMG::ResNormInf() 152 0.009849 0.01043 0.01099 0.17% MLMG::prepareForSolve() 14 0.01015 0.01041 0.01098 0.17% Castro::errorEst() 15 0.009676 0.01022 0.01064 0.16% FillPatchInterp(MF) 44 0.001853 0.00683 0.01031 0.16% MLMG::mgVcycle_down::2 106 0.009168 0.00937 0.01022 0.16% Castro::apply_tagging_restrictions() 15 0.005868 0.006404 0.006783 0.10% FabArrayBase::getCPC() 3662 0.00518 0.00542 0.005905 0.09% MLCellLinOp::defineAuxData() 14 0.004992 0.005208 0.005795 0.09% MLCellLinOp::defineBC() 14 0.004956 0.005202 0.005358 0.08% FabArray::norminf(mask) 46 0.004911 0.005047 0.005178 0.08% Castro::sum_integrated_quantities() 1 0.004969 0.004984 0.005033 0.08% MLMG::getGradSolution() 14 0.004562 0.00466 0.00479 0.07% MLCellLinOp::compGrad() 28 0.004544 0.004643 0.004773 0.07% MLLinOp::define() 14 0.001137 0.003038 0.004669 0.07% MLLinOp::defineGrids() 14 0.001119 0.003019 0.004647 0.07% MLMG::mgVcycle_down::3 106 0.001357 0.001796 0.004584 0.07% MLMG::MLResNormInf() 32 0.003978 0.004084 0.004225 0.06% MLLinOp::makeSubCommunicator() 14 0.0007694 0.002613 0.004147 0.06% FabArray::norminf() 174 0.003139 0.003453 0.004014 0.06% MLMG::actualBottomSolve() 106 2.304e-05 0.0005092 0.003898 0.06% MLMG::mgVcycle_up::3 106 0.0009479 0.001326 0.003683 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003284 0.003512 0.00366 0.06% MultiFab::max() 54 0.002774 0.003336 0.003599 0.06% MLCGSolver::bicgstab 13 0 0.0004437 0.00355 0.05% BndryData::define() 42 0.003038 0.003133 0.003263 0.05% Castro::enforce_min_density() 33 0.002472 0.002626 0.002862 0.04% FabArrayBase::TheFPinfo() 49 0.000317 0.00148 0.002445 0.04% MLMG::mgVcycle_down::4 106 0.001159 0.001371 0.002435 0.04% FabArrayBase::CPC::define() 624 0.001681 0.001871 0.002412 0.04% average_down_faces 84 0.002016 0.002251 0.002409 0.04% FPinfo::FPinfo() 9 0.0002522 0.001412 0.002374 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0001841 0.001349 0.002299 0.04% MLMG::mgVcycle_up::4 106 0.001127 0.001265 0.002031 0.03% MLMG::MLRhsNormInf() 14 0.001793 0.001872 0.001942 0.03% Castro::volWgtSum() 46 0.00167 0.001712 0.001833 0.03% FabArray::mult() 34 0.001226 0.001345 0.001511 0.02% Castro::enforce_consistent_e() 3 0.001039 0.001226 0.001434 0.02% StateDataPhysBCFunct::() 259 0.001221 0.001255 0.001294 0.02% FabArrayBase::getFB() 5552 0.00103 0.001101 0.00126 0.02% AMRErrorTag::operator() 15 0.001114 0.001147 0.001195 0.02% Gravity::update_max_rhs() 1 0.0005811 0.001011 0.001189 0.02% StateData::FillBoundary(geom) 8 0.001075 0.001099 0.001145 0.02% Castro::build_fine_mask() 55 0.0006524 0.0006932 0.0007222 0.01% DistributionMapping::KnapSackDoIt() 2 5.958e-05 0.000296 0.0006736 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005054 0.0005293 0.0005599 0.01% MLPoisson::prepareForSolve() 14 0.0003784 0.0004107 0.0004786 0.01% MLCellLinOp::prepareForSolve() 14 0.000368 0.0003988 0.0004661 0.01% FabArray::setDomainBndry() 259 0.0003363 0.0003638 0.000396 0.01% MLCellLinOp::setLevelBC() 28 0.0003161 0.0003437 0.0003742 0.01% TagBoxArray::collate() 15 0.0002196 0.0002729 0.0003643 0.01% MLCGSolver::ParallelAllReduce 81 0 3.786e-05 0.0003029 0.00% Castro::locWgtSum() 6 0.0001879 0.0002011 0.0002111 0.00% FabArrayBase::FB::FB() 35 7.975e-05 9.269e-05 0.0001375 0.00% amrex::Dot() 54 0 1.531e-05 0.0001225 0.00% OwnerMask() 15 8.649e-05 0.0001032 0.0001149 0.00% Castro::volProductSum() 2 7.999e-05 9.205e-05 0.0001129 0.00% AmrMesh-cluster 1 0 1.4e-05 0.000112 0.00% MLLinOp::makeAgglomeratedDMap 14 7.1e-05 8.108e-05 9.346e-05 0.00% FabArray::LinComb() 27 0 1.084e-05 8.67e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 5.461e-05 6.427e-05 8.461e-05 0.00% FabArray::Saxpy() 27 0 9.99e-06 7.992e-05 0.00% makeSFC 42 4.841e-05 5.663e-05 6.569e-05 0.00% ClusterList::intersect() 1 0 7.574e-06 6.059e-05 0.00% FabArray::RecvLayoutMask() 14 1.507e-05 1.875e-05 3.876e-05 0.00% Amr::writeSmallPlotFile() 1 3.438e-05 3.499e-05 3.607e-05 0.00% DistributionMapping::Distribute() 46 2.283e-05 2.457e-05 2.663e-05 0.00% BoxList::parallelComplementIn() 30 2.146e-05 2.393e-05 2.637e-05 0.00% ClusterList::chop() 1 0 2.051e-06 1.641e-05 0.00% BoxList::complementIn 30 1.042e-05 1.213e-05 1.432e-05 0.00% Castro::enforce_speed_limit() 33 1.054e-05 1.19e-05 1.331e-05 0.00% knapsack() 2 1.043e-05 1.162e-05 1.263e-05 0.00% Amr::initSubcycle() 1 1.108e-05 1.121e-05 1.139e-05 0.00% Castro::gwstrain() 2 9.14e-07 2.251e-06 9.425e-06 0.00% Castro::apply_problem_tags() 15 7.292e-06 7.782e-06 8.523e-06 0.00% Gravity::set_mass_offset() 1 9.68e-07 2.92e-06 4.429e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 16 B 20 B 27 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-22-gbe6c6415467d) finalized