MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.08-40-gd4d0e9031d03) initialized Starting run at 06:20:22 UTC on 2023-08-24. Successfully read inputs file ... Castro git describe: 23.08-6-g41b0e2684 AMReX git describe: 23.08-40-gd4d0e9031 Microphysics git describe: 23.08-15-gced7cc41 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.003153759 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.160852717 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.002264266 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.011399266 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001443187 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001276505 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001263543 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001285215 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001369226 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001270807 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001358693 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001265343 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001316501 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001296511 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001272236 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.290261424 seconds Ending run at 06:20:29 UTC on 2023-08-24. Run time = 6.869517471 Run time without initialization = 0.000393068 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.869 ... 6.869 ... 6.87 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2771 1.2771 1.2772 18.59% Gravity::fill_multipole_BCs() 14 1.112 1.13 1.139 16.58% Castro::post_init() 2 1.009 1.017 1.023 14.89% Castro::computeTemp() 36 0.6819 0.7344 0.8078 11.76% FabArray::ParallelCopy_finish() 2952 0.1014 0.3936 0.5901 8.59% Castro::reset_internal_energy(Fab) 654 0.3894 0.4209 0.4662 6.79% MLPoisson::Fsmooth() 5088 0.2369 0.2442 0.2541 3.70% amrex::Copy() 975 0.2172 0.2303 0.2446 3.56% Castro::normalize_species() 33 0.1616 0.1756 0.1959 2.85% Castro::initMFs() 16 0.09995 0.1319 0.1711 2.49% AmrLevel::derive() 97 0.1445 0.1498 0.1547 2.25% Castro::initData() 3 0.1131 0.1298 0.1532 2.23% FabArray::setVal() 1769 0.06445 0.07792 0.0968 1.41% StateData::define() 64 0.05461 0.0728 0.09382 1.37% FillBoundary_finish() 5552 0.04785 0.06223 0.07776 1.13% amrex::average_down 844 0.04962 0.0562 0.06317 0.92% FabArray::ParallelCopy_nowait() 2952 0.0308 0.03732 0.05258 0.77% FillBoundary_nowait() 5552 0.04099 0.04293 0.0467 0.68% MLCellLinOp::applyBC() 6294 0.03684 0.0393 0.04287 0.62% Castro::estTimeStep() 1 0.02211 0.02934 0.0373 0.54% FillPatchIterator::Initialize 215 0.0288 0.03337 0.03667 0.53% VisMF::Write(FabArray) 2 0.02649 0.02907 0.03406 0.50% MLPoisson::Fapply() 1040 0.02694 0.02967 0.03332 0.49% MultiFab::Multiply() 287 0.01948 0.02523 0.02771 0.40% Amr::regrid() 14 0.01596 0.01777 0.02045 0.30% Castro::buildMetrics() 16 0.01274 0.01644 0.0202 0.29% Castro::Castro() 16 0.009711 0.01391 0.01935 0.28% FabArray::Xpay() 1013 0.01737 0.01844 0.01927 0.28% Amr::writePlotFile() 1 0.01152 0.01648 0.01827 0.27% MLMG::addInterpCorrection() 530 0.0171 0.01726 0.01747 0.25% MLCellLinOp::reflux() 138 0.01618 0.01655 0.01701 0.25% amrex::Add() 575 0.01289 0.01442 0.01613 0.23% DistributionMapping::LeastUsedCPUs() 9 0.0008184 0.006787 0.0128 0.19% MLPoisson::FFlux() 3408 0.01165 0.01189 0.01237 0.18% MLCellLinOp::updateSolBC() 120 0.01056 0.01151 0.0123 0.18% MLMG::prepareForSolve() 14 0.007642 0.009469 0.01141 0.17% MLCellLinOp::updateCorBC() 106 0.00945 0.01033 0.01105 0.16% FillPatchInterp(MF) 44 0.001992 0.007275 0.01081 0.16% MLMG::interpCorrection_1 106 0.006349 0.007336 0.008412 0.12% Gravity::multilevel_solve_for_new_phi() 14 0.00304 0.005395 0.007964 0.12% MultiFab::max() 54 0.003203 0.005467 0.007332 0.11% MLCellLinOp::compGrad() 28 0.005774 0.006571 0.007294 0.11% AmrMesh::MakeNewGrids() 15 0.006878 0.006992 0.007144 0.10% Castro::apply_tagging_restrictions() 15 0.006524 0.006671 0.00679 0.10% Gravity::get_new_grav_vector() 4 0.00303 0.004366 0.006054 0.09% MLMG::ResNormInf() 152 0.002767 0.004484 0.005713 0.08% MLCellLinOp::defineAuxData() 14 0.004185 0.004733 0.005365 0.08% FabArray::norminf(mask) 46 0.004724 0.004763 0.004797 0.07% FabArrayBase::getCPC() 3662 0.003614 0.003906 0.004149 0.06% FabArray::norminf() 174 0.002886 0.003336 0.003776 0.05% MLLinOp::makeSubCommunicator() 14 0.0005528 0.002055 0.00349 0.05% Castro::enforce_min_density() 33 0.002599 0.002981 0.003431 0.05% BndryData::define() 42 0.002469 0.002681 0.00291 0.04% Gravity::actual_solve_with_mlmg() 14 0.002255 0.002355 0.002557 0.04% FabArray::mult() 34 0.001605 0.002027 0.00253 0.04% MLCellLinOp::defineBC() 14 0.002025 0.002255 0.002521 0.04% Castro::volWgtSum() 46 0.00203 0.002245 0.002461 0.04% FabArrayBase::CPC::define() 624 0.00161 0.001856 0.002201 0.03% FillPatchTwoLevels 126 0.0008789 0.0016 0.00215 0.03% FabArray::FillBoundary() 5552 0.00198 0.002038 0.002135 0.03% Castro::enforce_consistent_e() 3 0.0009526 0.001418 0.001905 0.03% MLCellLinOp::smooth() 2544 0.001683 0.001717 0.001764 0.03% Gravity::actual_multilevel_solve() 14 0.0009854 0.001334 0.001747 0.03% average_down_faces 84 0.001269 0.001433 0.001599 0.02% MLCGSolver::bicgstab 13 0 0.0001919 0.001535 0.02% Castro::sum_integrated_quantities() 1 0.0004577 0.001011 0.001535 0.02% FabArray::ParallelCopy() 2952 0.001275 0.001317 0.001366 0.02% StateData::FillBoundary(geom) 8 0.001164 0.001256 0.001365 0.02% Castro::build_fine_mask() 55 0.0009139 0.001085 0.001219 0.02% FabArrayBase::getFB() 5552 0.0009739 0.001021 0.001137 0.02% AMRErrorTag::operator() 15 0.00093 0.0009453 0.0009639 0.01% MLCellLinOp::prepareForSolve() 14 0.0004076 0.000567 0.0007941 0.01% MLCellLinOp::setLevelBC() 28 0.0004575 0.0006036 0.0007529 0.01% MLMG::solve() 14 0.0004557 0.0005956 0.0007377 0.01% AmrLevel::FillPatch() 215 0.0006143 0.0006641 0.0007297 0.01% TagBoxArray::collate() 15 0.0002574 0.0003474 0.0006911 0.01% MLCellLinOp::apply() 1040 0.0004265 0.0004712 0.0006268 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004978 0.0005319 0.0006099 0.01% FabArray::setDomainBndry() 259 0.0004442 0.0005306 0.000594 0.01% Gravity::update_max_rhs() 1 7.573e-05 0.0001834 0.000586 0.01% main() 1 0.000356 0.0004422 0.0005429 0.01% MLMG::mgVcycle() 318 0.0004324 0.0004629 0.0005061 0.01% Amr::grid_places() 15 0.0003412 0.0003873 0.0005043 0.01% MLCellLinOp::correctionResidual() 755 0.0004023 0.0004195 0.0004754 0.01% MLLinOp::defineGrids() 14 0.0002498 0.0003246 0.0003962 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002866 0.0003284 0.0003842 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002748 0.000326 0.0003796 0.01% MLMG::actualBottomSolve() 106 2.156e-05 5.907e-05 0.0003087 0.00% MLMG::oneIter() 106 0.0002569 0.0002766 0.0002853 0.00% MLMG::MLResNormInf() 32 0.0001214 0.0001771 0.0002555 0.00% MLMG::mgVcycle_bottom 318 0.0002385 0.0002448 0.0002519 0.00% Castro::locWgtSum() 6 0.0002006 0.0002087 0.0002338 0.00% MLCGSolver::ParallelAllReduce 81 0 2.831e-05 0.0002265 0.00% MLCellLinOp::solutionResidual() 258 0.0001936 0.0002029 0.0002168 0.00% AmrLevel::AmrLevel(dm) 16 0.0001564 0.000181 0.0002092 0.00% StateDataPhysBCFunct::() 259 0.0001796 0.000195 0.0002087 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001526 0.0001748 0.0002019 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001609 0.0001739 0.0001918 0.00% FillPatchIterator::FillFromLevel0() 89 0.000158 0.0001664 0.0001778 0.00% FillPatchSingleLevel 259 0.0001665 0.0001707 0.0001761 0.00% MLMG:computeResOfCorrection() 530 0.0001527 0.0001603 0.0001648 0.00% MLMG::mgVcycle_down::0 106 0.0001408 0.0001464 0.0001513 0.00% FabArrayBase::FB::FB() 35 8.045e-05 9.129e-05 0.0001417 0.00% MLMG::miniCycle() 212 8.652e-05 0.000105 0.0001406 0.00% OwnerMask() 15 9.396e-05 0.00011 0.0001304 0.00% MLMG::mgVcycle_down::1 106 0.0001097 0.0001175 0.0001266 0.00% FPinfo::FPinfo() 9 7.892e-05 9.093e-05 0.0001248 0.00% Castro::derive() 97 7.363e-05 9.043e-05 0.0001169 0.00% Castro::avgDown(state_indx) 60 8.621e-05 0.0001011 0.0001167 0.00% amrex::Dot() 54 0 1.422e-05 0.0001138 0.00% Castro::volProductSum() 2 8.819e-05 9.897e-05 0.0001115 0.00% Castro::post_regrid() 30 6.054e-05 8.317e-05 0.0001072 0.00% TagBoxArray::mapPRD 15 9.332e-05 9.956e-05 0.0001063 0.00% Amr::FinalizeInit() 1 5.831e-06 2.124e-05 0.0001048 0.00% Gravity::solve_phi_with_mlmg() 14 7.043e-05 8.128e-05 0.0001025 0.00% FabArrayBase::TheFPinfo() 49 8.085e-05 9.294e-05 0.0001023 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.317e-05 8.867e-05 0.000101 0.00% Castro::init(old) 13 6.956e-05 8.083e-05 0.0001009 0.00% MLMG::mgVcycle_down::3 106 7.494e-05 8.205e-05 9.815e-05 0.00% MLMG::mgVcycle_down::2 106 8.868e-05 9.096e-05 9.49e-05 0.00% Castro::clean_state() 33 6.477e-05 7.527e-05 8.784e-05 0.00% MLMG::mgVcycle_down::4 106 7.142e-05 7.766e-05 8.777e-05 0.00% FabArray::Saxpy() 27 0 1.023e-05 8.183e-05 0.00% MLMG::mgVcycle_up::0 106 6.783e-05 7.233e-05 7.948e-05 0.00% FabArray::LinComb() 27 0 9.859e-06 7.887e-05 0.00% Castro::errorEst() 15 4.91e-05 6.156e-05 7.563e-05 0.00% MLMG::mgVcycle_up::4 106 6.731e-05 6.981e-05 7.346e-05 0.00% Castro::avgDown() 15 5.315e-05 5.994e-05 7.173e-05 0.00% MLMG::mgVcycle_up::1 106 6.119e-05 6.519e-05 7.146e-05 0.00% MLMG::mgVcycle_up::3 106 5.668e-05 6.057e-05 7.001e-05 0.00% amrex::average_down_w_geom 60 5.508e-05 6.22e-05 6.887e-05 0.00% MLMG::computeResidual() 106 5.741e-05 6.226e-05 6.69e-05 0.00% ClusterList::intersect() 1 0 7.917e-06 6.334e-05 0.00% MLMG::mgVcycle_up::2 106 5.746e-05 5.871e-05 5.97e-05 0.00% Amr::defBaseLevel() 1 2.406e-05 3.627e-05 5.833e-05 0.00% MLMG::computeMLResidual() 32 4.287e-05 4.628e-05 5.382e-05 0.00% MLPoisson::define() 14 3.803e-05 4.449e-05 5.063e-05 0.00% BoxList::complementIn 30 1.271e-05 2.246e-05 4.904e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 3.006e-05 3.738e-05 4.5e-05 0.00% makeSFC 42 2.791e-05 3.431e-05 4.177e-05 0.00% Amr::writeSmallPlotFile() 1 3.126e-05 3.528e-05 4.079e-05 0.00% AmrMesh-cluster 1 0 5.087e-06 4.07e-05 0.00% MLLinOp::define() 14 1.622e-05 2.14e-05 3.539e-05 0.00% BoxList::parallelComplementIn() 30 1.234e-05 1.62e-05 3.157e-05 0.00% DistributionMapping::Distribute() 46 2.007e-05 2.587e-05 3.151e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.141e-05 2.498e-05 3.12e-05 0.00% Amr::bldFineLevels() 1 1.536e-05 1.921e-05 2.828e-05 0.00% FabArray::RecvLayoutMask() 14 1.628e-05 1.861e-05 2.816e-05 0.00% MLMG::getGradSolution() 14 1.784e-05 2.066e-05 2.524e-05 0.00% ClusterList::chop() 1 0 2.752e-06 2.202e-05 0.00% Castro::enforce_speed_limit() 33 1.144e-05 1.5e-05 2.102e-05 0.00% MLPoisson::prepareForSolve() 14 1.279e-05 1.558e-05 1.891e-05 0.00% Amr::initSubcycle() 1 8.34e-06 9.981e-06 1.336e-05 0.00% knapsack() 2 1.117e-05 1.198e-05 1.296e-05 0.00% Castro::apply_problem_tags() 15 7.921e-06 9.465e-06 1.089e-05 0.00% Amr::InitializeInit() 1 1.941e-06 3.916e-06 1.027e-05 0.00% Amr::initialInit() 1 1.197e-06 3.219e-06 9.417e-06 0.00% MLMG::MLRhsNormInf() 14 8.658e-06 8.962e-06 9.334e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.176e-06 5.246e-06 6.588e-06 0.00% Gravity::set_mass_offset() 1 9.82e-07 2.433e-06 3.943e-06 0.00% Amr::init() 1 1.952e-06 2.284e-06 2.846e-06 0.00% Castro::computeInitialDt() 1 1.556e-06 2.125e-06 2.71e-06 0.00% Castro::gwstrain() 2 1.013e-06 1.434e-06 1.787e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.869 6.869 6.87 100.00% Amr::init() 1 5.592 5.592 5.592 81.40% Amr::initialInit() 1 5.301 5.301 5.301 77.17% Amr::FinalizeInit() 1 5.183 5.19 5.198 75.67% Castro::post_init() 2 3.848 3.997 4.101 59.70% Gravity::multilevel_solve_for_new_phi() 14 1.809 1.823 1.835 26.72% Gravity::actual_multilevel_solve() 14 1.802 1.817 1.828 26.61% Gravity::solve_phi_with_mlmg() 14 1.794 1.81 1.82 26.50% Amr::regrid() 14 1.317 1.342 1.368 19.92% Amr::InitAmr() 1 1.277 1.277 1.277 18.59% Castro::computeTemp() 36 1.072 1.156 1.273 18.54% Castro::clean_state() 33 1.039 1.108 1.206 17.56% Gravity::fill_multipole_BCs() 14 1.114 1.132 1.142 16.62% Amr::bldFineLevels() 1 0.9263 1.014 1.138 16.56% Castro::post_regrid() 30 0.8065 0.8415 0.8892 12.94% Castro::initData() 3 0.5605 0.6425 0.7613 11.08% Gravity::actual_solve_with_mlmg() 14 0.6754 0.6772 0.6787 9.88% FabArray::ParallelCopy() 2952 0.1931 0.4717 0.6658 9.69% MLMG::solve() 14 0.65 0.6519 0.6532 9.51% FabArray::ParallelCopy_finish() 2952 0.1014 0.3936 0.5901 8.59% MLMG::oneIter() 106 0.5636 0.5643 0.565 8.22% Castro::reset_internal_energy(MultiFab) 36 0.3897 0.4212 0.4666 6.79% Castro::reset_internal_energy(Fab) 654 0.3894 0.4209 0.4662 6.79% MLMG::mgVcycle() 318 0.4099 0.4118 0.4135 6.02% amrex::average_down 844 0.1068 0.2632 0.3685 5.36% MLCellLinOp::smooth() 2544 0.341 0.3447 0.3494 5.09% Castro::avgDown() 15 0.07443 0.2295 0.3338 4.86% Castro::avgDown(state_indx) 60 0.07437 0.2294 0.3338 4.86% amrex::average_down_w_geom 60 0.07426 0.2293 0.3337 4.86% Amr::writePlotFile() 1 0.2904 0.2906 0.2906 4.23% Castro::Castro() 16 0.1545 0.2035 0.2615 3.81% MLPoisson::Fsmooth() 5088 0.2369 0.2442 0.2541 3.70% Castro::derive() 97 0.2421 0.2451 0.2467 3.59% AmrLevel::derive() 97 0.242 0.245 0.2466 3.59% amrex::Copy() 975 0.2172 0.2303 0.2446 3.56% AmrLevel::FillPatch() 215 0.1896 0.211 0.2258 3.29% Castro::normalize_species() 33 0.1616 0.1756 0.1959 2.85% Amr::grid_places() 15 0.0238 0.1191 0.1912 2.78% AmrMesh::MakeNewGrids() 15 0.02329 0.1187 0.1909 2.78% FillPatchIterator::Initialize 215 0.1466 0.1712 0.1868 2.72% TagBoxArray::mapPRD 15 0.003207 0.09927 0.1725 2.51% Castro::initMFs() 16 0.09995 0.1319 0.1711 2.49% MLCellLinOp::applyBC() 6294 0.1386 0.1476 0.1587 2.31% FabArray::FillBoundary() 5552 0.0975 0.1083 0.1219 1.77% FillPatchSingleLevel 259 0.08354 0.107 0.1198 1.74% MLMG::mgVcycle_bottom 318 0.1137 0.1155 0.1188 1.73% Amr::InitializeInit() 1 0.1034 0.1113 0.1186 1.73% Amr::defBaseLevel() 1 0.1034 0.1113 0.1186 1.73% MLMG::miniCycle() 212 0.1138 0.1151 0.1162 1.69% MLMG::mgVcycle_down::0 106 0.1135 0.1143 0.115 1.67% MLMG::mgVcycle_up::0 106 0.1041 0.1044 0.1047 1.52% FillPatchIterator::FillFromTwoLevels() 126 0.06745 0.09221 0.1045 1.52% FillPatchTwoLevels 126 0.06728 0.09204 0.1043 1.52% FabArray::setVal() 1769 0.06445 0.07792 0.0968 1.41% Castro::init(old) 13 0.07168 0.08978 0.096 1.40% AmrLevel::AmrLevel(dm) 16 0.05476 0.07298 0.09401 1.37% StateData::define() 64 0.05461 0.0728 0.09382 1.37% FabArray::ParallelCopy_nowait() 2952 0.07194 0.07684 0.09036 1.32% MLMG::computeResWithCrseSolFineCor() 106 0.08053 0.0823 0.08417 1.23% FillBoundary_finish() 5552 0.04785 0.06223 0.07776 1.13% MLCellLinOp::apply() 1040 0.06392 0.06675 0.07001 1.02% MLCellLinOp::correctionResidual() 755 0.06368 0.06572 0.06808 0.99% MLCellLinOp::solutionResidual() 258 0.06033 0.06329 0.06662 0.97% MLCellLinOp::reflux() 138 0.05062 0.05318 0.05486 0.80% FillPatchIterator::FillFromLevel0() 89 0.03611 0.04512 0.05311 0.77% FillBoundary_nowait() 5552 0.04206 0.04404 0.04798 0.70% Gravity::get_new_grav_vector() 4 0.03548 0.03674 0.0385 0.56% MLMG::computeResWithCrseCorFineCor() 106 0.0357 0.03686 0.03808 0.55% Castro::computeInitialDt() 1 0.02211 0.02934 0.0373 0.54% Castro::estTimeStep() 1 0.02211 0.02934 0.0373 0.54% VisMF::Write(FabArray) 2 0.02649 0.02907 0.03406 0.50% MLPoisson::Fapply() 1040 0.02694 0.02967 0.03332 0.49% MLMG::computeMLResidual() 32 0.02441 0.02748 0.03139 0.46% MLMG::addInterpCorrection() 530 0.01894 0.0294 0.03112 0.45% MLMG::computeResidual() 106 0.02856 0.02979 0.03107 0.45% MultiFab::Multiply() 287 0.01948 0.02523 0.02771 0.40% MLCellLinOp::updateSolBC() 120 0.02063 0.02361 0.02714 0.40% MLMG::mgVcycle_down::1 106 0.0226 0.02305 0.02346 0.34% Castro::buildMetrics() 16 0.0144 0.01855 0.02282 0.33% MLCellLinOp::updateCorBC() 106 0.0183 0.01964 0.0212 0.31% MLMG::mgVcycle_up::2 106 0.00859 0.01941 0.02108 0.31% MLMG::mgVcycle_up::1 106 0.0199 0.02 0.02011 0.29% FabArray::Xpay() 1013 0.01737 0.01844 0.01927 0.28% MLMG::prepareForSolve() 14 0.01429 0.01692 0.01899 0.28% MLMG:computeResOfCorrection() 530 0.01774 0.01806 0.01852 0.27% amrex::Add() 575 0.01289 0.01442 0.01613 0.23% MLPoisson::define() 14 0.01178 0.01411 0.01609 0.23% MLMG::interpCorrection_1 106 0.01006 0.01171 0.01347 0.20% FabArrayBase::TheFPinfo() 49 0.0009771 0.006929 0.01297 0.19% FPinfo::FPinfo() 9 0.0008909 0.006836 0.01287 0.19% DistributionMapping::LeastUsedCPUs() 9 0.0008184 0.006787 0.0128 0.19% Castro::errorEst() 15 0.01096 0.0117 0.01252 0.18% MLPoisson::FFlux() 3408 0.01165 0.01189 0.01237 0.18% MLMG::ResNormInf() 152 0.009271 0.01076 0.01182 0.17% FillPatchInterp(MF) 44 0.001992 0.007275 0.01081 0.16% MLMG::mgVcycle_down::2 106 0.008946 0.009111 0.009915 0.14% MLMG::getGradSolution() 14 0.007989 0.008303 0.008627 0.13% MLCellLinOp::compGrad() 28 0.007967 0.008283 0.008608 0.13% MultiFab::max() 54 0.003203 0.005467 0.007332 0.11% Castro::sum_integrated_quantities() 1 0.006689 0.006794 0.006889 0.10% MLCellLinOp::defineAuxData() 14 0.005245 0.00588 0.006822 0.10% Castro::apply_tagging_restrictions() 15 0.006524 0.006671 0.00679 0.10% FabArrayBase::getCPC() 3662 0.005355 0.005762 0.006306 0.09% MLCellLinOp::defineBC() 14 0.005188 0.005704 0.006287 0.09% DistributionMapping::KnapSackDoIt() 2 5.229e-05 0.002462 0.005229 0.08% FabArray::norminf(mask) 46 0.004724 0.004763 0.004797 0.07% MLMG::mgVcycle_down::3 106 0.001332 0.00181 0.004654 0.07% Gravity::update_max_rhs() 1 0.0007851 0.002759 0.004332 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003643 0.003933 0.004171 0.06% MLLinOp::define() 14 0.0009534 0.002481 0.003955 0.06% MLMG::MLResNormInf() 32 0.003765 0.003817 0.003947 0.06% MLLinOp::defineGrids() 14 0.0009305 0.002459 0.003935 0.06% MLMG::actualBottomSolve() 106 2.156e-05 0.0005009 0.003843 0.06% FabArray::norminf() 174 0.002886 0.003336 0.003776 0.05% MLMG::mgVcycle_up::3 106 0.0009537 0.0013 0.003635 0.05% BndryData::define() 42 0.00304 0.003286 0.00357 0.05% MLLinOp::makeSubCommunicator() 14 0.0005528 0.002055 0.00349 0.05% MLCGSolver::bicgstab 13 0 0.0004351 0.003481 0.05% Castro::enforce_min_density() 33 0.002599 0.002981 0.003431 0.05% average_down_faces 84 0.002239 0.00256 0.002851 0.04% FabArray::mult() 34 0.001605 0.002027 0.00253 0.04% Castro::volWgtSum() 46 0.002037 0.002253 0.002469 0.04% MLMG::mgVcycle_down::4 106 0.001172 0.00136 0.00246 0.04% FabArrayBase::CPC::define() 624 0.00161 0.001856 0.002201 0.03% Castro::enforce_consistent_e() 3 0.0009526 0.001418 0.001905 0.03% MLMG::MLRhsNormInf() 14 0.001761 0.00182 0.001886 0.03% MLMG::mgVcycle_up::4 106 0.001118 0.001223 0.001884 0.03% StateDataPhysBCFunct::() 259 0.001343 0.001451 0.001561 0.02% StateData::FillBoundary(geom) 8 0.001164 0.001256 0.001365 0.02% FabArrayBase::getFB() 5552 0.001056 0.001112 0.001278 0.02% Castro::build_fine_mask() 55 0.0009139 0.001085 0.001219 0.02% AMRErrorTag::operator() 15 0.00093 0.0009453 0.0009639 0.01% MLPoisson::prepareForSolve() 14 0.0004205 0.0005826 0.0008104 0.01% MLCellLinOp::prepareForSolve() 14 0.0004076 0.000567 0.0007941 0.01% MLCellLinOp::setLevelBC() 28 0.0004575 0.0006036 0.0007529 0.01% TagBoxArray::collate() 15 0.0002574 0.0003474 0.0006911 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004978 0.0005319 0.0006099 0.01% FabArray::setDomainBndry() 259 0.0004442 0.0005306 0.000594 0.01% MLCGSolver::ParallelAllReduce 81 0 3.647e-05 0.0002918 0.00% Castro::locWgtSum() 6 0.0002012 0.0002093 0.0002346 0.00% FabArrayBase::FB::FB() 35 8.045e-05 9.129e-05 0.0001417 0.00% OwnerMask() 15 9.396e-05 0.00011 0.0001304 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 7.321e-05 0.0001025 0.00013 0.00% AmrMesh-cluster 1 0 1.576e-05 0.000126 0.00% amrex::Dot() 54 0 1.422e-05 0.0001138 0.00% Castro::volProductSum() 2 8.846e-05 9.921e-05 0.0001117 0.00% MLLinOp::makeAgglomeratedDMap 14 6.531e-05 7.931e-05 9.124e-05 0.00% FabArray::Saxpy() 27 0 1.023e-05 8.183e-05 0.00% BoxList::parallelComplementIn() 30 2.629e-05 3.865e-05 8.061e-05 0.00% FabArray::LinComb() 27 0 9.859e-06 7.887e-05 0.00% makeSFC 42 4.273e-05 5.433e-05 6.513e-05 0.00% ClusterList::intersect() 1 0 7.917e-06 6.334e-05 0.00% BoxList::complementIn 30 1.271e-05 2.246e-05 4.904e-05 0.00% Amr::writeSmallPlotFile() 1 3.126e-05 3.528e-05 4.079e-05 0.00% DistributionMapping::Distribute() 46 2.007e-05 2.587e-05 3.151e-05 0.00% FabArray::RecvLayoutMask() 14 1.628e-05 1.861e-05 2.816e-05 0.00% ClusterList::chop() 1 0 2.752e-06 2.202e-05 0.00% Castro::enforce_speed_limit() 33 1.144e-05 1.5e-05 2.102e-05 0.00% Amr::initSubcycle() 1 8.34e-06 9.981e-06 1.336e-05 0.00% knapsack() 2 1.117e-05 1.198e-05 1.296e-05 0.00% Castro::apply_problem_tags() 15 7.921e-06 9.465e-06 1.089e-05 0.00% Gravity::set_mass_offset() 1 9.82e-07 2.433e-06 3.943e-06 0.00% Castro::gwstrain() 2 1.013e-06 1.434e-06 1.787e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 15 B 17 B 19 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.08-40-gd4d0e9031d03) finalized