MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.09-4-gf3598d2f7b6b) initialized Starting run at 07:05:41 UTC on 2023-09-06. Successfully read inputs file ... Castro git describe: 23.09 AMReX git describe: 23.09-4-gf3598d2f7 Microphysics git describe: 23.08-19-gbb8d2a2b reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002659596 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.114084709 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.00166081 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001978165 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001055894 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001061157 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00112397 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001103616 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001114071 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001092678 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001072179 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001065379 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001095493 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001050928 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001078054 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.233900821 seconds Ending run at 07:05:47 UTC on 2023-09-06. Run time = 6.280722666 Run time without initialization = 0.000273639 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.281 ... 6.281 ... 6.281 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2067 1.2067 1.2067 19.21% Gravity::fill_multipole_BCs() 14 1.113 1.126 1.144 18.21% Castro::post_init() 2 0.9518 0.9536 0.9546 15.20% Castro::computeTemp() 36 0.695 0.7371 0.8018 12.77% Castro::reset_internal_energy(Fab) 654 0.3924 0.4178 0.4547 7.24% FabArray::ParallelCopy_finish() 2952 0.06932 0.2592 0.381 6.07% MLPoisson::Fsmooth() 5088 0.2365 0.2421 0.2507 3.99% Castro::normalize_species() 33 0.1651 0.1736 0.1897 3.02% Castro::initData() 3 0.1153 0.1288 0.1511 2.41% AmrLevel::derive() 97 0.1381 0.1397 0.1408 2.24% amrex::Copy() 975 0.1316 0.1336 0.1356 2.16% Castro::initMFs() 16 0.08898 0.09805 0.1116 1.78% FillBoundary_finish() 5552 0.05154 0.05998 0.07023 1.12% StateData::define() 64 0.05092 0.05608 0.06394 1.02% FabArray::setVal() 1769 0.04098 0.0517 0.05588 0.89% amrex::average_down 844 0.04154 0.04427 0.04751 0.76% FillBoundary_nowait() 5552 0.03946 0.04121 0.04349 0.69% MLCellLinOp::applyBC() 6294 0.03691 0.03876 0.04181 0.67% VisMF::Write(FabArray) 2 0.02931 0.02989 0.03211 0.51% FabArray::ParallelCopy_nowait() 2952 0.02358 0.02584 0.03 0.48% MLPoisson::Fapply() 1040 0.02399 0.02481 0.02574 0.41% Castro::estTimeStep() 1 0.02136 0.02243 0.02336 0.37% MLMG::addInterpCorrection() 530 0.01909 0.01943 0.01966 0.31% MLCellLinOp::reflux() 138 0.01736 0.01793 0.01825 0.29% FillPatchIterator::Initialize 215 0.01658 0.01713 0.01768 0.28% FabArray::Xpay() 1013 0.01205 0.01303 0.01421 0.23% Castro::buildMetrics() 16 0.01113 0.01223 0.01385 0.22% Amr::regrid() 14 0.009282 0.01093 0.01321 0.21% MultiFab::Multiply() 287 0.01246 0.01279 0.01321 0.21% amrex::Add() 575 0.01042 0.0114 0.01261 0.20% MLCellLinOp::updateSolBC() 120 0.01055 0.01144 0.01199 0.19% MLPoisson::FFlux() 3408 0.01132 0.01152 0.0117 0.19% FillPatchInterp(MF) 44 0.001953 0.00731 0.01089 0.17% MLCellLinOp::updateCorBC() 106 0.009519 0.01032 0.01084 0.17% Castro::Castro() 16 0.007921 0.009056 0.0104 0.17% Amr::writePlotFile() 1 0.005215 0.007396 0.008177 0.13% MLMG::interpCorrection_1 106 0.006337 0.006956 0.007539 0.12% AmrMesh::MakeNewGrids() 15 0.006231 0.006281 0.006378 0.10% Castro::apply_tagging_restrictions() 15 0.005532 0.005887 0.006216 0.10% MLMG::prepareForSolve() 14 0.004731 0.00501 0.005235 0.08% MLMG::ResNormInf() 152 0.002981 0.003974 0.004999 0.08% FabArray::norminf(mask) 46 0.004662 0.004724 0.004783 0.08% MLCellLinOp::defineAuxData() 14 0.003807 0.003898 0.004021 0.06% Gravity::get_new_grav_vector() 4 0.001693 0.002192 0.003921 0.06% DistributionMapping::LeastUsedCPUs() 9 0.0001082 0.002295 0.003788 0.06% FabArray::norminf() 174 0.003059 0.003338 0.003731 0.06% MLLinOp::makeSubCommunicator() 14 0.0003856 0.002002 0.003709 0.06% FabArrayBase::getCPC() 3662 0.003375 0.003472 0.003601 0.06% MultiFab::max() 54 0.002789 0.003184 0.003404 0.05% MLCellLinOp::compGrad() 28 0.003214 0.003275 0.003354 0.05% Castro::enforce_min_density() 33 0.003011 0.003137 0.003325 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002559 0.002792 0.003017 0.05% BndryData::define() 42 0.002249 0.002308 0.002382 0.04% Gravity::actual_solve_with_mlmg() 14 0.001946 0.002002 0.002145 0.03% FabArray::FillBoundary() 5552 0.001948 0.002017 0.002082 0.03% MLCellLinOp::defineBC() 14 0.001839 0.001961 0.002027 0.03% FabArrayBase::CPC::define() 624 0.001584 0.001702 0.00191 0.03% MLCellLinOp::smooth() 2544 0.001632 0.001698 0.001772 0.03% Castro::volWgtSum() 46 0.001677 0.001689 0.001706 0.03% FabArray::mult() 34 0.001058 0.001239 0.001597 0.03% MLCGSolver::bicgstab 13 0 0.0001801 0.001441 0.02% Castro::enforce_consistent_e() 3 0.0009657 0.00119 0.00139 0.02% FillPatchTwoLevels 126 0.0006888 0.001122 0.001351 0.02% StateData::FillBoundary(geom) 8 0.001234 0.001283 0.001344 0.02% FabArray::ParallelCopy() 2952 0.001226 0.001261 0.001299 0.02% average_down_faces 84 0.001066 0.001155 0.001245 0.02% FabArrayBase::getFB() 5552 0.0009469 0.001002 0.001073 0.02% AMRErrorTag::operator() 15 0.0009167 0.0009303 0.0009462 0.02% Gravity::actual_multilevel_solve() 14 0.0007302 0.0008053 0.0008465 0.01% Castro::build_fine_mask() 55 0.0006328 0.0006831 0.0007454 0.01% MLCellLinOp::apply() 1040 0.0004309 0.0004556 0.0005638 0.01% Castro::sum_integrated_quantities() 1 0.0003969 0.0004648 0.0005461 0.01% TagBoxArray::collate() 15 0.0002362 0.0003167 0.0005413 0.01% AmrLevel::FillPatch() 215 0.0004911 0.0005108 0.0005249 0.01% MLMG::solve() 14 0.0004113 0.0004661 0.0005228 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004652 0.0004832 0.000507 0.01% MLMG::mgVcycle() 318 0.0004491 0.0004679 0.0005066 0.01% MLCellLinOp::correctionResidual() 755 0.0004117 0.0004298 0.0004681 0.01% MLCellLinOp::prepareForSolve() 14 0.0003532 0.0003801 0.000467 0.01% Amr::grid_places() 15 0.0003031 0.0003432 0.0004322 0.01% FabArray::setDomainBndry() 259 0.0003806 0.0003986 0.0004211 0.01% main() 1 0.0003668 0.0003859 0.0004191 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002814 0.0003352 0.0003972 0.01% MLCellLinOp::setLevelBC() 28 0.0003416 0.0003584 0.000377 0.01% MLLinOp::defineGrids() 14 0.0002578 0.0002925 0.0003462 0.01% MLMG::MLResNormInf() 32 0.0001188 0.0002164 0.0003385 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002741 0.0002843 0.0003064 0.00% MLMG::oneIter() 106 0.0002705 0.0002785 0.0002906 0.00% MLMG::actualBottomSolve() 106 2.221e-05 5.372e-05 0.0002572 0.00% MLMG::mgVcycle_bottom 318 0.0002231 0.0002269 0.0002349 0.00% MLCGSolver::ParallelAllReduce 81 0 2.828e-05 0.0002262 0.00% MLCellLinOp::solutionResidual() 258 0.0001835 0.0001936 0.0002042 0.00% Castro::locWgtSum() 6 0.0001844 0.0001861 0.0001885 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001586 0.0001676 0.0001867 0.00% AmrLevel::AmrLevel(dm) 16 0.0001176 0.0001586 0.000181 0.00% MLMG:computeResOfCorrection() 530 0.0001492 0.0001576 0.0001711 0.00% FillPatchSingleLevel 259 0.0001393 0.000145 0.0001551 0.00% StateDataPhysBCFunct::() 259 0.0001365 0.0001436 0.0001534 0.00% MLMG::mgVcycle_down::0 106 0.0001297 0.0001345 0.0001452 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001187 0.0001282 0.0001366 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001189 0.0001256 0.0001296 0.00% FabArrayBase::FB::FB() 35 7.449e-05 8.749e-05 0.0001284 0.00% Gravity::update_max_rhs() 1 8.211e-05 0.0001035 0.0001227 0.00% MLMG::miniCycle() 212 8.65e-05 0.0001073 0.0001213 0.00% MLMG::mgVcycle_down::1 106 0.0001065 0.0001147 0.0001198 0.00% amrex::Dot() 54 0 1.44e-05 0.0001152 0.00% OwnerMask() 15 8.648e-05 9.517e-05 0.0001042 0.00% Castro::volProductSum() 2 8.267e-05 8.756e-05 0.0001002 0.00% MLMG::mgVcycle_down::2 106 8.627e-05 9.054e-05 9.988e-05 0.00% TagBoxArray::mapPRD 15 8.945e-05 9.431e-05 9.682e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.309e-05 8.805e-05 9.563e-05 0.00% FPinfo::FPinfo() 9 6.512e-05 8.397e-05 9.48e-05 0.00% MLMG::mgVcycle_down::3 106 7.909e-05 8.501e-05 9.409e-05 0.00% Castro::derive() 97 6.064e-05 6.629e-05 8.756e-05 0.00% Castro::clean_state() 33 6.111e-05 6.982e-05 8.635e-05 0.00% MLMG::mgVcycle_up::0 106 6.96e-05 7.267e-05 8.392e-05 0.00% Castro::post_regrid() 30 6.112e-05 7.204e-05 8.34e-05 0.00% FabArrayBase::TheFPinfo() 49 5.886e-05 7.067e-05 8.289e-05 0.00% Castro::errorEst() 15 4.138e-05 5.344e-05 7.687e-05 0.00% MLMG::mgVcycle_up::1 106 5.952e-05 6.473e-05 7.642e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.176e-05 6.643e-05 7.608e-05 0.00% MLMG::mgVcycle_down::4 106 7.162e-05 7.35e-05 7.586e-05 0.00% MLMG::mgVcycle_up::4 106 6.642e-05 7.002e-05 7.528e-05 0.00% FabArray::Saxpy() 27 0 9.403e-06 7.523e-05 0.00% Amr::FinalizeInit() 1 6.953e-06 2.422e-05 7.445e-05 0.00% FabArray::LinComb() 27 0 9.218e-06 7.374e-05 0.00% Castro::avgDown(state_indx) 60 6.573e-05 6.903e-05 7.26e-05 0.00% Castro::init(old) 13 4.365e-05 5.042e-05 6.641e-05 0.00% MLMG::mgVcycle_up::3 106 5.584e-05 5.977e-05 6.527e-05 0.00% MLMG::computeResidual() 106 5.877e-05 6.104e-05 6.407e-05 0.00% MLMG::mgVcycle_up::2 106 5.618e-05 5.772e-05 5.982e-05 0.00% ClusterList::intersect() 1 0 6.881e-06 5.505e-05 0.00% Castro::avgDown() 15 3.468e-05 4.076e-05 5.211e-05 0.00% amrex::average_down_w_geom 60 3.915e-05 4.368e-05 4.708e-05 0.00% MLPoisson::define() 14 3.608e-05 4.288e-05 4.646e-05 0.00% MLMG::computeMLResidual() 32 3.642e-05 3.903e-05 4.094e-05 0.00% makeSFC 42 2.641e-05 3.3e-05 3.959e-05 0.00% Amr::defBaseLevel() 1 1.9e-05 2.769e-05 3.934e-05 0.00% Amr::writeSmallPlotFile() 1 3.026e-05 3.138e-05 3.293e-05 0.00% Amr::bldFineLevels() 1 1.434e-05 2.385e-05 3.121e-05 0.00% AmrMesh-cluster 1 0 3.644e-06 2.915e-05 0.00% DistributionMapping::Distribute() 46 2.32e-05 2.473e-05 2.737e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.075e-05 2.379e-05 2.586e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.512e-05 2.104e-05 2.482e-05 0.00% MLLinOp::define() 14 1.581e-05 1.806e-05 2.082e-05 0.00% FabArray::RecvLayoutMask() 14 1.633e-05 1.74e-05 1.868e-05 0.00% MLMG::getGradSolution() 14 1.529e-05 1.694e-05 1.841e-05 0.00% MLPoisson::prepareForSolve() 14 1.292e-05 1.401e-05 1.571e-05 0.00% ClusterList::chop() 1 0 1.79e-06 1.432e-05 0.00% Amr::initSubcycle() 1 9.311e-06 1.059e-05 1.406e-05 0.00% Castro::enforce_speed_limit() 33 1.054e-05 1.202e-05 1.287e-05 0.00% knapsack() 2 1.06e-05 1.154e-05 1.269e-05 0.00% BoxList::complementIn 30 9.568e-06 1.139e-05 1.246e-05 0.00% BoxList::parallelComplementIn() 30 1.086e-05 1.15e-05 1.225e-05 0.00% Amr::initialInit() 1 1.201e-06 4.842e-06 1.184e-05 0.00% MLMG::MLRhsNormInf() 14 7.964e-06 8.348e-06 9.118e-06 0.00% Castro::apply_problem_tags() 15 7.612e-06 8.028e-06 8.458e-06 0.00% Castro::gwstrain() 2 1.116e-06 2.117e-06 7.642e-06 0.00% Amr::InitializeInit() 1 1.819e-06 2.827e-06 5.704e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.076e-06 4.545e-06 5.268e-06 0.00% Gravity::set_mass_offset() 1 8.47e-07 2.232e-06 4.047e-06 0.00% Castro::computeInitialDt() 1 1.684e-06 2.287e-06 2.933e-06 0.00% Amr::init() 1 1.727e-06 1.926e-06 2.135e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.281 6.281 6.281 100.00% Amr::init() 1 5.074 5.074 5.074 80.78% Amr::initialInit() 1 4.839 4.839 4.84 77.05% Amr::FinalizeInit() 1 4.732 4.733 4.733 75.36% Castro::post_init() 2 3.518 3.626 3.698 58.88% Gravity::multilevel_solve_for_new_phi() 14 1.757 1.771 1.789 28.48% Gravity::actual_multilevel_solve() 14 1.754 1.769 1.786 28.44% Gravity::solve_phi_with_mlmg() 14 1.748 1.762 1.78 28.34% Castro::computeTemp() 36 1.088 1.155 1.257 20.01% Amr::regrid() 14 1.19 1.206 1.229 19.57% Amr::InitAmr() 1 1.207 1.207 1.207 19.21% Castro::clean_state() 33 1.051 1.106 1.188 18.91% Gravity::fill_multipole_BCs() 14 1.114 1.127 1.146 18.24% Amr::bldFineLevels() 1 0.874 0.9334 1.02 16.24% Castro::post_regrid() 30 0.8107 0.8394 0.8794 14.00% Castro::initData() 3 0.5718 0.6376 0.7438 11.84% Gravity::actual_solve_with_mlmg() 14 0.633 0.6347 0.6363 10.13% MLMG::solve() 14 0.6149 0.6154 0.6156 9.80% MLMG::oneIter() 106 0.5434 0.5441 0.5446 8.67% Castro::reset_internal_energy(MultiFab) 36 0.3927 0.4181 0.4551 7.25% Castro::reset_internal_energy(Fab) 654 0.3924 0.4178 0.4547 7.24% FabArray::ParallelCopy() 2952 0.1277 0.3138 0.4327 6.89% MLMG::mgVcycle() 318 0.4113 0.4122 0.4135 6.58% FabArray::ParallelCopy_finish() 2952 0.06932 0.2592 0.381 6.07% MLCellLinOp::smooth() 2544 0.3412 0.3431 0.3492 5.56% amrex::average_down 844 0.07294 0.1822 0.2571 4.09% MLPoisson::Fsmooth() 5088 0.2365 0.2421 0.2507 3.99% Amr::writePlotFile() 1 0.234 0.2341 0.2342 3.73% Castro::avgDown() 15 0.04355 0.1526 0.2261 3.60% Castro::avgDown(state_indx) 60 0.04352 0.1525 0.2261 3.60% amrex::average_down_w_geom 60 0.04345 0.1525 0.226 3.60% Castro::derive() 97 0.1976 0.1977 0.1979 3.15% AmrLevel::derive() 97 0.1975 0.1977 0.1979 3.15% Castro::normalize_species() 33 0.1651 0.1736 0.1897 3.02% Castro::Castro() 16 0.1257 0.1425 0.1607 2.56% MLCellLinOp::applyBC() 6294 0.1389 0.143 0.1504 2.40% amrex::Copy() 975 0.1316 0.1336 0.1356 2.16% Amr::grid_places() 15 0.01876 0.08723 0.1309 2.08% AmrMesh::MakeNewGrids() 15 0.01843 0.08689 0.1306 2.08% AmrLevel::FillPatch() 215 0.1179 0.1211 0.1238 1.97% MLMG::mgVcycle_down::0 106 0.1145 0.1152 0.1166 1.86% MLMG::mgVcycle_bottom 318 0.1114 0.1126 0.1163 1.85% TagBoxArray::mapPRD 15 0.001308 0.07041 0.1139 1.81% FabArray::FillBoundary() 5552 0.09778 0.1043 0.1135 1.81% MLMG::miniCycle() 212 0.1115 0.1123 0.1129 1.80% Castro::initMFs() 16 0.08898 0.09805 0.1116 1.78% Amr::InitializeInit() 1 0.1059 0.1068 0.1079 1.72% Amr::defBaseLevel() 1 0.1059 0.1068 0.1079 1.72% MLMG::mgVcycle_up::0 106 0.1058 0.1061 0.1065 1.70% FillPatchIterator::Initialize 215 0.0913 0.09559 0.09887 1.57% MLMG::computeResWithCrseSolFineCor() 106 0.07131 0.07292 0.07406 1.18% FillBoundary_finish() 5552 0.05154 0.05998 0.07023 1.12% AmrLevel::AmrLevel(dm) 16 0.0511 0.05624 0.06406 1.02% StateData::define() 64 0.05092 0.05608 0.06394 1.02% FillPatchSingleLevel 259 0.05361 0.05772 0.06289 1.00% MLCellLinOp::apply() 1040 0.05809 0.05948 0.06116 0.97% MLCellLinOp::correctionResidual() 755 0.05642 0.0576 0.05925 0.94% FabArray::ParallelCopy_nowait() 2952 0.05042 0.05333 0.05711 0.91% MLCellLinOp::solutionResidual() 258 0.05294 0.05469 0.05611 0.89% FabArray::setVal() 1769 0.04098 0.0517 0.05588 0.89% FillPatchIterator::FillFromTwoLevels() 126 0.04692 0.0513 0.05421 0.86% FillPatchTwoLevels 126 0.04679 0.05117 0.05408 0.86% MLCellLinOp::reflux() 138 0.0478 0.04978 0.05101 0.81% Castro::init(old) 13 0.04664 0.04837 0.05093 0.81% FillBoundary_nowait() 5552 0.04055 0.0423 0.04461 0.71% MLMG::addInterpCorrection() 530 0.02114 0.03119 0.03296 0.52% MLMG::computeResWithCrseCorFineCor() 106 0.03098 0.03154 0.03215 0.51% VisMF::Write(FabArray) 2 0.02931 0.02989 0.03211 0.51% MLMG::computeResidual() 106 0.02642 0.02779 0.02844 0.45% FillPatchIterator::FillFromLevel0() 89 0.02535 0.02681 0.02784 0.44% MLPoisson::Fapply() 1040 0.02399 0.02481 0.02574 0.41% MLMG::mgVcycle_down::1 106 0.02293 0.0234 0.02383 0.38% Castro::computeInitialDt() 1 0.02136 0.02243 0.02336 0.37% Castro::estTimeStep() 1 0.02136 0.02243 0.02336 0.37% MLMG::computeMLResidual() 32 0.02033 0.02097 0.02139 0.34% Gravity::get_new_grav_vector() 4 0.02005 0.02055 0.02126 0.34% MLMG::mgVcycle_up::2 106 0.008923 0.01935 0.02105 0.34% MLCellLinOp::updateSolBC() 120 0.01966 0.02016 0.02085 0.33% MLMG::mgVcycle_up::1 106 0.02021 0.02036 0.02048 0.33% MLCellLinOp::updateCorBC() 106 0.01813 0.01904 0.01988 0.32% MLMG:computeResOfCorrection() 530 0.0179 0.01816 0.01843 0.29% Castro::buildMetrics() 16 0.01283 0.01412 0.01602 0.26% FabArray::Xpay() 1013 0.01205 0.01303 0.01421 0.23% MLPoisson::define() 14 0.01081 0.01236 0.01392 0.22% MultiFab::Multiply() 287 0.01246 0.01279 0.01321 0.21% amrex::Add() 575 0.01042 0.0114 0.01261 0.20% MLPoisson::FFlux() 3408 0.01132 0.01152 0.0117 0.19% MLMG::interpCorrection_1 106 0.009647 0.01061 0.01146 0.18% MLMG::ResNormInf() 152 0.00932 0.01025 0.01111 0.18% FillPatchInterp(MF) 44 0.001953 0.00731 0.01089 0.17% MLMG::prepareForSolve() 14 0.009543 0.009815 0.01014 0.16% MLMG::mgVcycle_down::2 106 0.008879 0.009094 0.009905 0.16% Castro::errorEst() 15 0.009196 0.009598 0.009874 0.16% Castro::apply_tagging_restrictions() 15 0.005532 0.005887 0.006216 0.10% FabArrayBase::getCPC() 3662 0.005011 0.005174 0.005396 0.09% MLCellLinOp::defineAuxData() 14 0.004831 0.004962 0.005198 0.08% MLCellLinOp::defineBC() 14 0.004893 0.004966 0.005028 0.08% FabArray::norminf(mask) 46 0.004662 0.004724 0.004783 0.08% Castro::sum_integrated_quantities() 1 0.004663 0.004683 0.004733 0.08% MLMG::getGradSolution() 14 0.00448 0.00457 0.004678 0.07% MLCellLinOp::compGrad() 28 0.004464 0.004553 0.004661 0.07% MLMG::mgVcycle_down::3 106 0.001283 0.001767 0.004483 0.07% MLLinOp::define() 14 0.0007382 0.002389 0.00413 0.07% MLLinOp::defineGrids() 14 0.0007212 0.002371 0.004111 0.07% FabArrayBase::TheFPinfo() 49 0.0002403 0.002428 0.003938 0.06% MLMG::MLResNormInf() 32 0.003767 0.003828 0.003922 0.06% FPinfo::FPinfo() 9 0.0001675 0.002357 0.003865 0.06% DistributionMapping::LeastUsedCPUs() 9 0.0001082 0.002295 0.003788 0.06% FabArray::norminf() 174 0.003059 0.003338 0.003731 0.06% MLLinOp::makeSubCommunicator() 14 0.0003856 0.002002 0.003709 0.06% MLMG::mgVcycle_up::3 106 0.0009291 0.0013 0.003648 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003369 0.003528 0.003619 0.06% MLMG::actualBottomSolve() 106 2.221e-05 0.0004703 0.00359 0.06% MultiFab::max() 54 0.002789 0.003184 0.003404 0.05% Castro::enforce_min_density() 33 0.003011 0.003137 0.003325 0.05% MLCGSolver::bicgstab 13 0 0.0004107 0.003286 0.05% BndryData::define() 42 0.002787 0.00287 0.002949 0.05% MLMG::mgVcycle_down::4 106 0.001153 0.001319 0.002357 0.04% average_down_faces 84 0.001957 0.002138 0.002232 0.04% MLMG::mgVcycle_up::4 106 0.001095 0.001227 0.001931 0.03% FabArrayBase::CPC::define() 624 0.001584 0.001702 0.00191 0.03% MLMG::MLRhsNormInf() 14 0.00175 0.001777 0.001791 0.03% Castro::volWgtSum() 46 0.001681 0.001694 0.001712 0.03% FabArray::mult() 34 0.001058 0.001239 0.001597 0.03% StateDataPhysBCFunct::() 259 0.001373 0.001427 0.00149 0.02% Castro::enforce_consistent_e() 3 0.0009657 0.00119 0.00139 0.02% StateData::FillBoundary(geom) 8 0.001234 0.001283 0.001344 0.02% Gravity::update_max_rhs() 1 0.0006194 0.0009571 0.001209 0.02% FabArrayBase::getFB() 5552 0.001023 0.001089 0.001201 0.02% AMRErrorTag::operator() 15 0.0009167 0.0009303 0.0009462 0.02% Castro::build_fine_mask() 55 0.0006328 0.0006831 0.0007454 0.01% DistributionMapping::KnapSackDoIt() 2 4.115e-05 0.0003402 0.0006569 0.01% TagBoxArray::collate() 15 0.0002362 0.0003167 0.0005413 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004652 0.0004832 0.000507 0.01% MLPoisson::prepareForSolve() 14 0.0003662 0.0003942 0.0004799 0.01% MLCellLinOp::prepareForSolve() 14 0.0003532 0.0003801 0.000467 0.01% FabArray::setDomainBndry() 259 0.0003806 0.0003986 0.0004211 0.01% MLCellLinOp::setLevelBC() 28 0.0003416 0.0003584 0.000377 0.01% MLCGSolver::ParallelAllReduce 81 0 3.659e-05 0.0002927 0.00% Castro::locWgtSum() 6 0.0001848 0.0001867 0.0001891 0.00% FabArrayBase::FB::FB() 35 7.449e-05 8.749e-05 0.0001284 0.00% amrex::Dot() 54 0 1.44e-05 0.0001152 0.00% OwnerMask() 15 8.648e-05 9.517e-05 0.0001042 0.00% Castro::volProductSum() 2 8.295e-05 8.777e-05 0.0001004 0.00% AmrMesh-cluster 1 0 1.232e-05 9.852e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.676e-05 7.617e-05 8.74e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.043e-05 6.466e-05 7.564e-05 0.00% FabArray::Saxpy() 27 0 9.403e-06 7.523e-05 0.00% FabArray::LinComb() 27 0 9.218e-06 7.374e-05 0.00% makeSFC 42 4.601e-05 5.238e-05 6.156e-05 0.00% ClusterList::intersect() 1 0 6.881e-06 5.505e-05 0.00% Amr::writeSmallPlotFile() 1 3.026e-05 3.138e-05 3.293e-05 0.00% DistributionMapping::Distribute() 46 2.32e-05 2.473e-05 2.737e-05 0.00% BoxList::parallelComplementIn() 30 2.048e-05 2.289e-05 2.464e-05 0.00% FabArray::RecvLayoutMask() 14 1.633e-05 1.74e-05 1.868e-05 0.00% ClusterList::chop() 1 0 1.79e-06 1.432e-05 0.00% Amr::initSubcycle() 1 9.311e-06 1.059e-05 1.406e-05 0.00% Castro::enforce_speed_limit() 33 1.054e-05 1.202e-05 1.287e-05 0.00% knapsack() 2 1.06e-05 1.154e-05 1.269e-05 0.00% BoxList::complementIn 30 9.568e-06 1.139e-05 1.246e-05 0.00% Castro::apply_problem_tags() 15 7.612e-06 8.028e-06 8.458e-06 0.00% Castro::gwstrain() 2 1.116e-06 2.117e-06 7.642e-06 0.00% Gravity::set_mass_offset() 1 8.47e-07 2.232e-06 4.047e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 18 B 22 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.09-4-gf3598d2f7b6b) finalized