MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.06-1-g08326158c80e) initialized Starting run at 20:12:07 UTC on 2023-06-04. Successfully read inputs file ... Castro git describe: 23.06-10-g5dbaf1fe1 AMReX git describe: 23.06-1-g08326158c Microphysics git describe: 23.06-2-g726fe1e2 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.003005318 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.123273611 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001668349 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002159643 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001209966 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001181299 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001208816 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001221622 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001192403 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001165 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001211996 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001200608 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00118552 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001215006 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001214017 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.238267721 seconds Ending run at 20:12:13 UTC on 2023-06-04. Run time = 6.44159552 Run time without initialization = 0.000275088 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.442 ... 6.442 ... 6.442 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2447 1.2447 1.2448 19.32% Gravity::fill_multipole_BCs() 14 1.134 1.154 1.165 18.09% Castro::post_init() 2 0.9885 0.9892 0.9902 15.37% Castro::computeTemp() 36 0.6751 0.7373 0.8182 12.70% Castro::reset_internal_energy(Fab) 654 0.3839 0.4201 0.4667 7.24% FabArray::ParallelCopy_finish() 2952 0.0781 0.284 0.429 6.66% MLPoisson::Fsmooth() 5088 0.225 0.2373 0.2447 3.80% Castro::normalize_species() 33 0.165 0.1754 0.1903 2.95% Castro::initData() 3 0.1101 0.1256 0.1494 2.32% Castro::derive() 97 0.139 0.1419 0.1437 2.23% amrex::Copy() 975 0.1297 0.1335 0.1362 2.11% Castro::initMFs() 16 0.09894 0.1102 0.1292 2.01% FillBoundary_finish() 5552 0.0547 0.07069 0.09388 1.46% StateData::define() 64 0.0564 0.06226 0.07126 1.11% amrex::average_down 844 0.04308 0.04741 0.05111 0.79% FabArray::setVal() 1769 0.04301 0.04684 0.04883 0.76% FillBoundary_nowait() 5552 0.03868 0.04231 0.04712 0.73% MLCellLinOp::applyBC() 6294 0.03273 0.0351 0.03738 0.58% VisMF::Write(FabArray) 2 0.03035 0.03106 0.03369 0.52% FabArray::ParallelCopy_nowait() 2952 0.02362 0.02613 0.03166 0.49% Castro::estTimeStep() 1 0.02197 0.02427 0.02649 0.41% MLPoisson::Fapply() 1040 0.02299 0.02491 0.02635 0.41% Amr::regrid() 14 0.01491 0.01721 0.02062 0.32% MLCellLinOp::reflux() 138 0.01678 0.01754 0.01827 0.28% MLMG::addInterpCorrection() 530 0.01693 0.01745 0.01785 0.28% FillPatchIterator::Initialize 215 0.01543 0.01693 0.01782 0.28% Castro::buildMetrics() 16 0.01218 0.01352 0.01554 0.24% FabArray::Xpay() 1013 0.01225 0.01278 0.01346 0.21% MultiFab::Multiply() 287 0.01265 0.01298 0.01321 0.21% MLCellLinOp::updateCorBC() 106 0.009259 0.01064 0.01291 0.20% amrex::Add() 575 0.0106 0.0113 0.01279 0.20% MLCellLinOp::updateSolBC() 120 0.01024 0.01153 0.01232 0.19% Castro::Castro() 16 0.008714 0.009977 0.01208 0.19% MLPoisson::FFlux() 3408 0.01087 0.0115 0.01203 0.19% FillPatchInterp(MF) 44 0.001668 0.006611 0.009833 0.15% Amr::writePlotFile() 1 0.00557 0.008106 0.008944 0.14% AmrMesh::MakeNewGrids() 15 0.007574 0.00768 0.007796 0.12% MLMG::interpCorrection_1 106 0.005853 0.006903 0.007652 0.12% Castro::apply_tagging_restrictions() 15 0.005933 0.006118 0.00631 0.10% FabArray::norminf(mask) 46 0.004857 0.005036 0.00522 0.08% MLMG::prepareForSolve() 14 0.00477 0.004894 0.004999 0.08% MLLinOp::makeSubCommunicator() 14 0.0008416 0.002631 0.004568 0.07% MLMG::ResNormInf() 152 0.002873 0.003839 0.004544 0.07% MLCellLinOp::defineAuxData() 14 0.00386 0.003954 0.004047 0.06% MultiFab::max() 54 0.002774 0.003352 0.003769 0.06% FabArray::norminf() 174 0.002998 0.003305 0.003677 0.06% FabArrayBase::getCPC() 3662 0.003476 0.003566 0.003647 0.06% MLCellLinOp::compGrad() 28 0.003163 0.00331 0.003387 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002701 0.002977 0.003188 0.05% Castro::enforce_min_density() 33 0.002718 0.0029 0.003122 0.05% BndryData::define() 42 0.002324 0.00241 0.002483 0.04% Gravity::get_new_grav_vector() 4 0.001773 0.002072 0.002414 0.04% Gravity::actual_solve_with_mlmg() 14 0.001915 0.002049 0.002297 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0003206 0.001308 0.002204 0.03% FabArray::FillBoundary() 5552 0.001946 0.002044 0.002105 0.03% MLCellLinOp::defineBC() 14 0.001781 0.001933 0.002072 0.03% FabArrayBase::CPC::define() 624 0.001564 0.001725 0.001941 0.03% MLCellLinOp::smooth() 2544 0.001673 0.001737 0.001768 0.03% Castro::volWgtSum() 46 0.001688 0.001724 0.001759 0.03% FabArray::mult() 34 0.001168 0.001354 0.001625 0.03% MLCGSolver::bicgstab 13 0 0.0001797 0.001437 0.02% Castro::enforce_consistent_e() 3 0.0009556 0.001128 0.001367 0.02% FillPatchTwoLevels 126 0.0006847 0.001119 0.001349 0.02% average_down_faces 84 0.001073 0.001171 0.001273 0.02% FabArray::ParallelCopy() 2952 0.001195 0.001236 0.001268 0.02% StateData::FillBoundary(geom) 8 0.001157 0.001178 0.001227 0.02% FabArrayBase::getFB() 5552 0.001036 0.001088 0.001157 0.02% AMRErrorTag::operator() 15 0.0009451 0.0009532 0.0009632 0.01% Gravity::actual_multilevel_solve() 14 0.0007759 0.0008704 0.0009208 0.01% Castro::sum_integrated_quantities() 1 0.0005429 0.0007035 0.0008279 0.01% MLMG::solve() 14 0.0004387 0.0006147 0.0008189 0.01% Castro::build_fine_mask() 55 0.0006416 0.0007233 0.0007829 0.01% TagBoxArray::collate() 15 0.0002391 0.000335 0.0006191 0.01% MLCellLinOp::apply() 1040 0.0004401 0.0004666 0.0005772 0.01% Amr::grid_places() 15 0.0003394 0.0003936 0.0005289 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004569 0.0004828 0.0005004 0.01% MLCellLinOp::correctionResidual() 755 0.0004124 0.0004301 0.0004866 0.01% MLMG::MLResNormInf() 32 0.0001159 0.0002541 0.0004695 0.01% main() 1 0.0003877 0.000423 0.0004622 0.01% MLMG::mgVcycle() 318 0.0004205 0.0004361 0.0004564 0.01% MLCellLinOp::prepareForSolve() 14 0.0003507 0.0003749 0.0004325 0.01% FabArray::setDomainBndry() 259 0.0003709 0.0004057 0.00043 0.01% MLLinOp::defineGrids() 14 0.0002704 0.0003174 0.0003706 0.01% MLCellLinOp::setLevelBC() 28 0.0003337 0.0003427 0.000352 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002704 0.000303 0.0003307 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002661 0.0002835 0.0003052 0.00% MLMG::oneIter() 106 0.0002746 0.0002887 0.0002965 0.00% MLCGSolver::ParallelAllReduce 81 0 3.685e-05 0.0002948 0.00% MLMG::actualBottomSolve() 106 2.453e-05 5.9e-05 0.0002931 0.00% MLMG::mgVcycle_bottom 318 0.0002077 0.0002265 0.0002915 0.00% Castro::locWgtSum() 6 0.0002018 0.0002104 0.0002341 0.00% MLCellLinOp::solutionResidual() 258 0.0001918 0.0001997 0.0002062 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001625 0.0001742 0.00019 0.00% FillPatchSingleLevel 259 0.0001621 0.000174 0.0001891 0.00% AmrLevel::AmrLevel(dm) 16 0.0001339 0.0001477 0.0001719 0.00% Castro::init(old) 13 0.0001542 0.0001624 0.0001684 0.00% MLMG:computeResOfCorrection() 530 0.000152 0.0001577 0.0001642 0.00% StateDataPhysBCFunct::() 259 0.0001403 0.0001489 0.0001586 0.00% MLMG::mgVcycle_down::0 106 0.0001344 0.000142 0.0001543 0.00% FabArrayBase::FB::FB() 35 7.71e-05 8.903e-05 0.000133 0.00% FPinfo::FPinfo() 9 7.98e-05 9.477e-05 0.000125 0.00% MLMG::mgVcycle_down::1 106 0.0001125 0.0001178 0.0001235 0.00% amrex::Dot() 54 0 1.465e-05 0.0001172 0.00% Gravity::update_max_rhs() 1 8.501e-05 9.842e-05 0.0001165 0.00% OwnerMask() 15 8.798e-05 9.971e-05 0.0001125 0.00% TagBoxArray::mapPRD 15 9.394e-05 9.862e-05 0.0001097 0.00% Castro::volProductSum() 2 8.507e-05 9.179e-05 0.0001082 0.00% MLMG::miniCycle() 212 8.672e-05 9.424e-05 0.0001078 0.00% Castro::post_regrid() 30 6.508e-05 8.668e-05 0.0001025 0.00% MLMG::mgVcycle_down::3 106 7.685e-05 8.356e-05 0.0001016 0.00% Amr::FinalizeInit() 1 1.196e-05 3.132e-05 9.429e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.232e-05 8.514e-05 8.896e-05 0.00% MLMG::mgVcycle_down::2 106 8.236e-05 8.499e-05 8.759e-05 0.00% FabArray::Saxpy() 27 0 1.076e-05 8.606e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.352e-05 7.48e-05 8.461e-05 0.00% BoxList::complementIn 30 9.865e-06 2.135e-05 8.425e-05 0.00% FabArrayBase::TheFPinfo() 49 6.341e-05 6.968e-05 7.747e-05 0.00% FabArray::LinComb() 27 0 9.479e-06 7.583e-05 0.00% MLMG::mgVcycle_up::1 106 5.954e-05 6.425e-05 7.573e-05 0.00% MLMG::mgVcycle_down::4 106 6.884e-05 7.145e-05 7.424e-05 0.00% Castro::avgDown(state_indx) 60 5.234e-05 6.171e-05 7.406e-05 0.00% amrex::average_down_w_geom 60 4.906e-05 5.721e-05 7.237e-05 0.00% MLMG::mgVcycle_up::4 106 6.546e-05 6.816e-05 7.158e-05 0.00% MLMG::mgVcycle_up::0 106 6.317e-05 6.642e-05 7.003e-05 0.00% Castro::clean_state() 33 5.783e-05 6.216e-05 6.728e-05 0.00% MLMG::mgVcycle_up::3 106 5.512e-05 5.989e-05 6.728e-05 0.00% MLMG::mgVcycle_up::2 106 5.18e-05 5.589e-05 6.69e-05 0.00% MLMG::computeResidual() 106 5.319e-05 5.793e-05 6.554e-05 0.00% Castro::errorEst() 15 4.589e-05 5.49e-05 6.528e-05 0.00% Castro::avgDown() 15 3.695e-05 4.511e-05 6.376e-05 0.00% Amr::defBaseLevel() 1 2.924e-05 4.397e-05 5.905e-05 0.00% ClusterList::intersect() 1 0 7.355e-06 5.884e-05 0.00% MLMG::computeMLResidual() 32 3.65e-05 4.26e-05 5.793e-05 0.00% MLPoisson::define() 14 4.383e-05 4.664e-05 5.028e-05 0.00% BoxList::parallelComplementIn() 30 1.048e-05 1.931e-05 4.703e-05 0.00% Amr::initSubcycle() 1 2.552e-05 3.76e-05 4.403e-05 0.00% makeSFC 42 2.747e-05 3.382e-05 4.151e-05 0.00% Amr::bldFineLevels() 1 1.62e-05 2.573e-05 4.018e-05 0.00% Amr::writeSmallPlotFile() 1 2.8e-05 2.924e-05 3.002e-05 0.00% AmrMesh-cluster 1 0 3.658e-06 2.927e-05 0.00% DistributionMapping::Distribute() 46 2.286e-05 2.384e-05 2.65e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.3e-05 2.446e-05 2.603e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.699e-05 2.119e-05 2.341e-05 0.00% MLLinOp::define() 14 1.569e-05 1.782e-05 2.282e-05 0.00% MLMG::getGradSolution() 14 1.689e-05 1.82e-05 1.903e-05 0.00% MLPoisson::prepareForSolve() 14 1.168e-05 1.362e-05 1.891e-05 0.00% FabArray::RecvLayoutMask() 14 1.621e-05 1.679e-05 1.745e-05 0.00% ClusterList::chop() 1 0 2.094e-06 1.675e-05 0.00% Castro::enforce_speed_limit() 33 1.051e-05 1.201e-05 1.357e-05 0.00% knapsack() 2 1.071e-05 1.132e-05 1.27e-05 0.00% MLMG::MLRhsNormInf() 14 8.202e-06 8.684e-06 9.141e-06 0.00% Castro::apply_problem_tags() 15 6.045e-06 6.749e-06 7.317e-06 0.00% Gravity::set_mass_offset() 1 8.28e-07 3.408e-06 5.436e-06 0.00% DistributionMapping::KnapSackDoIt() 2 3.919e-06 4.806e-06 5.329e-06 0.00% Amr::InitializeInit() 1 2.632e-06 2.971e-06 4.84e-06 0.00% Castro::computeInitialDt() 1 1.997e-06 2.47e-06 3.041e-06 0.00% Amr::init() 1 1.642e-06 2.083e-06 2.444e-06 0.00% Amr::initialInit() 1 1.215e-06 1.456e-06 1.769e-06 0.00% Castro::gwstrain() 2 1.009e-06 1.223e-06 1.518e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.442 6.442 6.442 100.00% Amr::init() 1 5.196 5.196 5.196 80.67% Amr::initialInit() 1 4.958 4.958 4.958 76.97% Amr::FinalizeInit() 1 4.848 4.851 4.853 75.34% Castro::post_init() 2 3.596 3.723 3.804 59.06% Gravity::multilevel_solve_for_new_phi() 14 1.784 1.805 1.818 28.22% Gravity::actual_multilevel_solve() 14 1.78 1.802 1.815 28.18% Gravity::solve_phi_with_mlmg() 14 1.774 1.795 1.809 28.08% Castro::computeTemp() 36 1.059 1.158 1.285 19.95% Amr::regrid() 14 1.198 1.228 1.25 19.40% Amr::InitAmr() 1 1.245 1.245 1.245 19.32% Castro::clean_state() 33 1.031 1.112 1.211 18.80% Gravity::fill_multipole_BCs() 14 1.136 1.155 1.167 18.11% Amr::bldFineLevels() 1 0.8883 0.9521 1.052 16.34% Castro::post_regrid() 30 0.7971 0.8442 0.8914 13.84% Castro::initData() 3 0.556 0.632 0.7514 11.67% Gravity::actual_solve_with_mlmg() 14 0.6378 0.6396 0.6414 9.96% MLMG::solve() 14 0.6191 0.6195 0.6198 9.62% MLMG::oneIter() 106 0.5466 0.5475 0.5479 8.51% FabArray::ParallelCopy() 2952 0.1305 0.3384 0.4819 7.48% Castro::reset_internal_energy(MultiFab) 36 0.3842 0.4204 0.467 7.25% Castro::reset_internal_energy(Fab) 654 0.3839 0.4201 0.4667 7.24% FabArray::ParallelCopy_finish() 2952 0.0781 0.284 0.429 6.66% MLMG::mgVcycle() 318 0.409 0.4103 0.4115 6.39% MLCellLinOp::smooth() 2544 0.3404 0.3426 0.3484 5.41% amrex::average_down 844 0.07656 0.2039 0.2855 4.43% Castro::avgDown() 15 0.04634 0.1732 0.2549 3.96% Castro::avgDown(state_indx) 60 0.0463 0.1731 0.2549 3.96% amrex::average_down_w_geom 60 0.04624 0.1731 0.2548 3.96% MLPoisson::Fsmooth() 5088 0.225 0.2373 0.2447 3.80% Amr::writePlotFile() 1 0.2384 0.2386 0.2386 3.70% Castro::derive() 97 0.2 0.2002 0.2006 3.11% Castro::normalize_species() 33 0.165 0.1754 0.1903 2.95% Castro::Castro() 16 0.1395 0.154 0.1752 2.72% MLCellLinOp::applyBC() 6294 0.1389 0.1513 0.1685 2.62% Amr::grid_places() 15 0.02117 0.09536 0.1423 2.21% AmrMesh::MakeNewGrids() 15 0.02075 0.09497 0.1419 2.20% amrex::Copy() 975 0.1297 0.1335 0.1362 2.11% FabArray::FillBoundary() 5552 0.1018 0.1162 0.1357 2.11% Castro::initMFs() 16 0.09894 0.1102 0.1292 2.01% TagBoxArray::mapPRD 15 0.002564 0.0769 0.1241 1.93% MLMG::mgVcycle_bottom 318 0.1092 0.1105 0.1147 1.78% MLMG::mgVcycle_down::0 106 0.1137 0.1141 0.1147 1.78% MLMG::miniCycle() 212 0.1093 0.1102 0.1111 1.73% Amr::InitializeInit() 1 0.1049 0.1072 0.1095 1.70% Amr::defBaseLevel() 1 0.1049 0.1071 0.1095 1.70% MLMG::mgVcycle_up::0 106 0.1022 0.1024 0.1029 1.60% FillPatchIterator::Initialize 215 0.08681 0.09165 0.09587 1.49% FillBoundary_finish() 5552 0.0547 0.07069 0.09388 1.46% MLMG::computeResWithCrseSolFineCor() 106 0.07419 0.07551 0.07689 1.19% AmrLevel::AmrLevel(dm) 16 0.05655 0.06241 0.07139 1.11% StateData::define() 64 0.0564 0.06226 0.07126 1.11% MLCellLinOp::apply() 1040 0.06149 0.06395 0.0674 1.05% FillPatchSingleLevel 259 0.05111 0.05651 0.06419 1.00% MLCellLinOp::correctionResidual() 755 0.05907 0.06126 0.06264 0.97% MLCellLinOp::solutionResidual() 258 0.05466 0.05615 0.05734 0.89% FabArray::ParallelCopy_nowait() 2952 0.0512 0.05317 0.0565 0.88% MLCellLinOp::reflux() 138 0.04696 0.04945 0.05084 0.79% FillPatchTwoLevels 126 0.04384 0.04714 0.05058 0.79% FabArray::setVal() 1769 0.04301 0.04684 0.04883 0.76% FillBoundary_nowait() 5552 0.03985 0.04348 0.04831 0.75% Castro::init(old) 13 0.04383 0.04566 0.0483 0.75% MLMG::computeResWithCrseCorFineCor() 106 0.0323 0.0334 0.03407 0.53% VisMF::Write(FabArray) 2 0.03035 0.03106 0.03369 0.52% MLMG::addInterpCorrection() 530 0.019 0.0299 0.03248 0.50% MLMG::computeResidual() 106 0.02716 0.02813 0.02863 0.44% Castro::computeInitialDt() 1 0.02197 0.02427 0.02649 0.41% Castro::estTimeStep() 1 0.02197 0.02427 0.02649 0.41% MLPoisson::Fapply() 1040 0.02299 0.02491 0.02635 0.41% MLMG::mgVcycle_down::1 106 0.02458 0.02512 0.02563 0.40% MLMG::mgVcycle_up::2 106 0.009255 0.02053 0.02257 0.35% MLCellLinOp::updateSolBC() 120 0.01964 0.02062 0.02126 0.33% MLMG::computeMLResidual() 32 0.02028 0.02092 0.02123 0.33% MLMG:computeResOfCorrection() 530 0.01811 0.01984 0.02112 0.33% MLCellLinOp::updateCorBC() 106 0.0184 0.01949 0.02085 0.32% MLMG::mgVcycle_up::1 106 0.02038 0.02045 0.02052 0.32% Gravity::get_new_grav_vector() 4 0.01742 0.01808 0.0187 0.29% Castro::buildMetrics() 16 0.01363 0.01507 0.01718 0.27% MLPoisson::define() 14 0.01133 0.01311 0.01484 0.23% FabArray::Xpay() 1013 0.01225 0.01278 0.01346 0.21% MultiFab::Multiply() 287 0.01265 0.01298 0.01321 0.21% amrex::Add() 575 0.0106 0.0113 0.01279 0.20% MLMG::mgVcycle_down::2 106 0.01048 0.0111 0.01271 0.20% MLPoisson::FFlux() 3408 0.01087 0.0115 0.01203 0.19% MLMG::interpCorrection_1 106 0.009671 0.01052 0.01162 0.18% MLMG::ResNormInf() 152 0.009722 0.01032 0.01111 0.17% Castro::errorEst() 15 0.009552 0.009811 0.01009 0.16% MLMG::prepareForSolve() 14 0.009826 0.009924 0.01008 0.16% FillPatchInterp(MF) 44 0.001668 0.006611 0.009833 0.15% Castro::apply_tagging_restrictions() 15 0.005933 0.006118 0.00631 0.10% FabArrayBase::getCPC() 3662 0.005088 0.005291 0.005448 0.08% MLCellLinOp::defineBC() 14 0.004825 0.005028 0.005232 0.08% FabArray::norminf(mask) 46 0.004857 0.005036 0.00522 0.08% MLCellLinOp::defineAuxData() 14 0.004877 0.004989 0.00519 0.08% Castro::sum_integrated_quantities() 1 0.004994 0.005026 0.00512 0.08% MLLinOp::define() 14 0.001211 0.003043 0.005044 0.08% MLLinOp::defineGrids() 14 0.001194 0.003025 0.005021 0.08% MLMG::getGradSolution() 14 0.004519 0.004609 0.004668 0.07% MLCellLinOp::compGrad() 28 0.0045 0.004591 0.004651 0.07% MLLinOp::makeSubCommunicator() 14 0.0008416 0.002631 0.004568 0.07% MLMG::mgVcycle_down::3 106 0.001316 0.00177 0.004411 0.07% MLMG::MLResNormInf() 32 0.003975 0.004108 0.004211 0.07% MultiFab::max() 54 0.002774 0.003352 0.003769 0.06% MLMG::actualBottomSolve() 106 2.453e-05 0.000488 0.003725 0.06% FabArray::norminf() 174 0.002998 0.003305 0.003677 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003252 0.003417 0.00356 0.06% MLMG::mgVcycle_up::3 106 0.0009107 0.001277 0.003513 0.05% MLCGSolver::bicgstab 13 0 0.0004225 0.00338 0.05% Castro::enforce_min_density() 33 0.002718 0.0029 0.003122 0.05% BndryData::define() 42 0.002898 0.002969 0.003053 0.05% FabArrayBase::TheFPinfo() 49 0.0004491 0.001436 0.002346 0.04% MLMG::mgVcycle_down::4 106 0.001123 0.001318 0.002323 0.04% FPinfo::FPinfo() 9 0.000384 0.001366 0.002277 0.04% average_down_faces 84 0.001987 0.002111 0.002275 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0003206 0.001308 0.002204 0.03% FabArrayBase::CPC::define() 624 0.001564 0.001725 0.001941 0.03% MLMG::MLRhsNormInf() 14 0.001775 0.001858 0.001933 0.03% MLMG::mgVcycle_up::4 106 0.001083 0.001213 0.001851 0.03% Castro::volWgtSum() 46 0.001692 0.001729 0.001763 0.03% FabArray::mult() 34 0.001168 0.001354 0.001625 0.03% Gravity::update_max_rhs() 1 0.0006062 0.001037 0.001485 0.02% StateDataPhysBCFunct::() 259 0.0013 0.001327 0.001377 0.02% Castro::enforce_consistent_e() 3 0.0009556 0.001128 0.001367 0.02% FabArrayBase::getFB() 5552 0.001119 0.001177 0.00129 0.02% StateData::FillBoundary(geom) 8 0.001157 0.001178 0.001227 0.02% AMRErrorTag::operator() 15 0.0009451 0.0009532 0.0009632 0.01% Castro::build_fine_mask() 55 0.0006416 0.0007233 0.0007829 0.01% DistributionMapping::KnapSackDoIt() 2 4.331e-05 0.0004151 0.0007285 0.01% TagBoxArray::collate() 15 0.0002391 0.000335 0.0006191 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004569 0.0004828 0.0005004 0.01% MLPoisson::prepareForSolve() 14 0.000364 0.0003886 0.0004442 0.01% MLCellLinOp::prepareForSolve() 14 0.0003507 0.0003749 0.0004325 0.01% FabArray::setDomainBndry() 259 0.0003709 0.0004057 0.00043 0.01% MLCGSolver::ParallelAllReduce 81 0 4.531e-05 0.0003625 0.01% MLCellLinOp::setLevelBC() 28 0.0003337 0.0003427 0.000352 0.01% Castro::locWgtSum() 6 0.0002024 0.0002109 0.0002346 0.00% FabArrayBase::FB::FB() 35 7.71e-05 8.903e-05 0.000133 0.00% BoxList::parallelComplementIn() 30 2.034e-05 4.065e-05 0.0001313 0.00% amrex::Dot() 54 0 1.465e-05 0.0001172 0.00% OwnerMask() 15 8.798e-05 9.971e-05 0.0001125 0.00% Castro::volProductSum() 2 8.526e-05 9.2e-05 0.0001084 0.00% AmrMesh-cluster 1 0 1.311e-05 0.0001049 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 5.396e-05 7.975e-05 9.344e-05 0.00% FabArray::Saxpy() 27 0 1.076e-05 8.606e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.832e-05 7.635e-05 8.454e-05 0.00% BoxList::complementIn 30 9.865e-06 2.135e-05 8.425e-05 0.00% FabArray::LinComb() 27 0 9.479e-06 7.583e-05 0.00% makeSFC 42 4.491e-05 5.189e-05 5.947e-05 0.00% ClusterList::intersect() 1 0 7.355e-06 5.884e-05 0.00% Amr::initSubcycle() 1 2.552e-05 3.76e-05 4.403e-05 0.00% Amr::writeSmallPlotFile() 1 2.8e-05 2.924e-05 3.002e-05 0.00% DistributionMapping::Distribute() 46 2.286e-05 2.384e-05 2.65e-05 0.00% FabArray::RecvLayoutMask() 14 1.621e-05 1.679e-05 1.745e-05 0.00% ClusterList::chop() 1 0 2.094e-06 1.675e-05 0.00% Castro::enforce_speed_limit() 33 1.051e-05 1.201e-05 1.357e-05 0.00% knapsack() 2 1.071e-05 1.132e-05 1.27e-05 0.00% Castro::apply_problem_tags() 15 6.045e-06 6.749e-06 7.317e-06 0.00% Gravity::set_mass_offset() 1 8.28e-07 3.408e-06 5.436e-06 0.00% Castro::gwstrain() 2 1.009e-06 1.223e-06 1.518e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 18 B 21 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.06-1-g08326158c80e) finalized