MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.04-20-g15038d466c05) initialized Starting run at 06:41:39 UTC on 2023-04-12. Successfully read inputs file ... Castro git describe: 23.04-7-g4402e6bb6 AMReX git describe: 23.04-20-g15038d466 Microphysics git describe: 23.04-4-gabda4ae3 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002507867 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.117070521 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001645945 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001946335 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00110264 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00107822 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001101727 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001065967 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.003157711 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001099114 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001084888 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001099386 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001129356 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001108309 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001205912 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225826e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 2.373778793e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.284381237e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.577115472e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.23524215 seconds Ending run at 06:41:45 UTC on 2023-04-12. Run time = 6.517376089 Run time without initialization = 0.0002822609999 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.517 ... 6.517 ... 6.517 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.2061 1.2229 1.2314 18.89% Amr::InitAmr() 1 1.228 1.228 1.228 18.84% Castro::post_init() 2 0.9952 0.9964 0.9982 15.32% Castro::computeTemp() 36 0.6955 0.7399 0.8211 12.60% Castro::reset_internal_energy(Fab) 654 0.3866 0.4199 0.4645 7.13% FabArray::ParallelCopy_finish() 2952 0.08646 0.2879 0.4249 6.52% MLPoisson::Fsmooth() 5088 0.2394 0.2503 0.2651 4.07% Castro::normalize_species() 33 0.164 0.176 0.1943 2.98% Castro::initData() 3 0.1141 0.1273 0.1501 2.30% Castro::derive() 97 0.1396 0.1407 0.1418 2.18% amrex::Copy() 975 0.1309 0.1354 0.1365 2.09% Castro::initMFs() 16 0.09913 0.1092 0.1252 1.92% FillBoundary_finish() 5552 0.0461 0.06368 0.08129 1.25% StateData::define() 64 0.0549 0.06118 0.0707 1.08% FabArray::setVal() 1769 0.04002 0.05019 0.05375 0.82% amrex::average_down 844 0.0429 0.04676 0.05232 0.80% FillBoundary_nowait() 5552 0.03975 0.04157 0.04482 0.69% MLCellLinOp::applyBC() 6294 0.0326 0.03475 0.03839 0.59% VisMF::Write(FabArray) 2 0.02975 0.03045 0.03268 0.50% FabArray::ParallelCopy_nowait() 2952 0.02382 0.026 0.03053 0.47% Castro::estTimeStep() 1 0.02181 0.02557 0.02743 0.42% MLPoisson::Fapply() 1040 0.02377 0.02502 0.02675 0.41% MLMG::addInterpCorrection() 530 0.01919 0.01985 0.02066 0.32% Amr::regrid() 14 0.01443 0.01667 0.01986 0.30% MLCellLinOp::reflux() 138 0.01683 0.0175 0.01824 0.28% FillPatchIterator::Initialize 215 0.01526 0.0171 0.01781 0.27% Castro::buildMetrics() 16 0.01211 0.01342 0.0154 0.24% FabArray::Xpay() 1013 0.01214 0.01302 0.01462 0.22% MultiFab::Multiply() 287 0.01271 0.01298 0.01338 0.21% amrex::Add() 575 0.01074 0.01145 0.01274 0.20% MLCellLinOp::updateSolBC() 120 0.01055 0.01153 0.01231 0.19% MLPoisson::FFlux() 3408 0.0113 0.01174 0.01226 0.19% MLCellLinOp::updateCorBC() 106 0.009512 0.01044 0.0112 0.17% Castro::Castro() 16 0.008684 0.009637 0.01098 0.17% FillPatchInterp(MF) 44 0.001668 0.006515 0.0098 0.15% Amr::writePlotFile() 1 0.005523 0.007887 0.008489 0.13% MLMG::interpCorrection_1 106 0.006235 0.006922 0.007461 0.11% AmrMesh::MakeNewGrids() 15 0.006361 0.006502 0.006584 0.10% Castro::apply_tagging_restrictions() 15 0.005548 0.005911 0.006169 0.09% MLLinOp::makeSubCommunicator() 14 0.0006238 0.002965 0.005386 0.08% MLMG::prepareForSolve() 14 0.004659 0.005104 0.005348 0.08% MLMG::ResNormInf() 152 0.002923 0.00443 0.005176 0.08% FabArray::norminf(mask) 46 0.004879 0.005008 0.00513 0.08% MLCellLinOp::defineAuxData() 14 0.003914 0.003973 0.004121 0.06% FabArray::norminf() 174 0.002985 0.003392 0.003962 0.06% FabArrayBase::getCPC() 3662 0.003478 0.003534 0.003613 0.06% MultiFab::max() 54 0.002794 0.003359 0.003604 0.06% MLCellLinOp::compGrad() 28 0.003197 0.003325 0.003432 0.05% Castro::enforce_min_density() 33 0.002561 0.002696 0.002909 0.04% Gravity::multilevel_solve_for_new_phi() 14 0.002654 0.002737 0.002842 0.04% Gravity::get_new_grav_vector() 4 0.0018 0.002124 0.002518 0.04% BndryData::define() 42 0.002331 0.00239 0.002469 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0001583 0.001459 0.002337 0.04% FabArray::FillBoundary() 5552 0.001962 0.002034 0.002203 0.03% Gravity::actual_solve_with_mlmg() 14 0.001909 0.002008 0.002196 0.03% MLCellLinOp::defineBC() 14 0.001867 0.00199 0.002101 0.03% FabArrayBase::CPC::define() 624 0.001607 0.001761 0.00201 0.03% Castro::volWgtSum() 46 0.001694 0.001718 0.00175 0.03% MLCellLinOp::smooth() 2544 0.001615 0.001671 0.001745 0.03% MLCGSolver::bicgstab 13 0 0.0001946 0.001557 0.02% FabArray::mult() 34 0.00114 0.001277 0.001493 0.02% Castro::enforce_consistent_e() 3 0.001038 0.001243 0.001378 0.02% FillPatchTwoLevels 126 0.0006544 0.001115 0.001372 0.02% StateData::FillBoundary(geom) 8 0.001204 0.001258 0.001306 0.02% FabArray::ParallelCopy() 2952 0.001183 0.001212 0.001261 0.02% average_down_faces 84 0.00106 0.00113 0.001222 0.02% FabArrayBase::getFB() 5552 0.001009 0.001049 0.001159 0.02% AMRErrorTag::operator() 15 0.0009154 0.0009427 0.0009725 0.01% Gravity::actual_multilevel_solve() 14 0.0007559 0.0008024 0.0008458 0.01% Castro::build_fine_mask() 55 0.000648 0.0006881 0.0007404 0.01% Castro::sum_integrated_quantities() 1 0.0005934 0.0006396 0.0007112 0.01% MLMG::solve() 14 0.0004025 0.000543 0.0007023 0.01% MLCellLinOp::apply() 1040 0.0004326 0.0004685 0.0006046 0.01% MLCGSolver::ParallelAllReduce 81 0 6.549e-05 0.0005239 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004537 0.0004833 0.0005207 0.01% main() 1 0.000403 0.0004381 0.0005129 0.01% Amr::grid_places() 15 0.0003431 0.0003823 0.0004782 0.01% MLCellLinOp::correctionResidual() 755 0.0003846 0.000408 0.0004684 0.01% MLMG::mgVcycle() 318 0.000383 0.0004142 0.0004661 0.01% MLCellLinOp::prepareForSolve() 14 0.0003612 0.0003865 0.0004557 0.01% FabArray::setDomainBndry() 259 0.0003766 0.0004007 0.0004233 0.01% TagBoxArray::collate() 15 0.0002709 0.0003064 0.0004092 0.01% MLCellLinOp::setLevelBC() 28 0.0003302 0.0003493 0.0003744 0.01% MLLinOp::defineGrids() 14 0.0002452 0.0002896 0.000335 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002835 0.000306 0.0003267 0.01% MLMG::MLResNormInf() 32 0.0001567 0.0002301 0.0003265 0.01% MLMG::oneIter() 106 0.0002597 0.0002819 0.0003178 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002657 0.0002819 0.0002935 0.00% MLMG::actualBottomSolve() 106 2.329e-05 5.584e-05 0.0002578 0.00% MLMG::mgVcycle_bottom 318 0.0002211 0.0002329 0.000242 0.00% MLCellLinOp::solutionResidual() 258 0.0001805 0.0001977 0.0002392 0.00% Castro::locWgtSum() 6 0.0002019 0.0002067 0.0002116 0.00% Castro::init(old) 13 0.0001556 0.0001707 0.0001864 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001515 0.0001645 0.0001794 0.00% FillPatchSingleLevel 259 0.0001571 0.0001645 0.0001714 0.00% MLMG:computeResOfCorrection() 530 0.0001567 0.000161 0.0001669 0.00% StateDataPhysBCFunct::() 259 0.0001449 0.0001514 0.0001625 0.00% AmrLevel::AmrLevel(dm) 16 0.0001378 0.0001457 0.0001592 0.00% FabArrayBase::FB::FB() 35 7.752e-05 8.812e-05 0.0001411 0.00% MLMG::mgVcycle_down::0 106 0.000126 0.0001317 0.0001385 0.00% Gravity::update_max_rhs() 1 8.027e-05 9.602e-05 0.0001218 0.00% MLMG::miniCycle() 212 8.92e-05 0.000102 0.0001195 0.00% amrex::Dot() 54 0 1.491e-05 0.0001193 0.00% MLMG::mgVcycle_down::1 106 0.0001074 0.0001118 0.0001144 0.00% OwnerMask() 15 9.137e-05 0.0001026 0.0001144 0.00% FPinfo::FPinfo() 9 7.649e-05 9.045e-05 0.0001095 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.27e-05 8.884e-05 0.0001072 0.00% TagBoxArray::mapPRD 15 8.967e-05 9.826e-05 0.000107 0.00% MLMG::mgVcycle_down::3 106 7.428e-05 8.377e-05 9.759e-05 0.00% MLMG::mgVcycle_down::2 106 8.112e-05 8.533e-05 9.308e-05 0.00% Castro::post_regrid() 30 6.046e-05 7.756e-05 9.286e-05 0.00% Castro::volProductSum() 2 8.189e-05 8.572e-05 8.969e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.769e-05 7.099e-05 8.957e-05 0.00% FabArray::LinComb() 27 0 1.106e-05 8.846e-05 0.00% MLMG::mgVcycle_down::4 106 6.857e-05 7.4e-05 8.66e-05 0.00% Amr::FinalizeInit() 1 6.664e-06 1.71e-05 7.969e-05 0.00% MLMG::mgVcycle_up::4 106 6.453e-05 7.069e-05 7.752e-05 0.00% FabArray::Saxpy() 27 0 9.638e-06 7.71e-05 0.00% MLMG::mgVcycle_up::0 106 6.43e-05 7.063e-05 7.676e-05 0.00% MLMG::mgVcycle_up::1 106 5.715e-05 6.375e-05 7.466e-05 0.00% Castro::avgDown(state_indx) 60 5.643e-05 6.169e-05 7.262e-05 0.00% amrex::average_down_w_geom 60 4.683e-05 5.7e-05 7.109e-05 0.00% FabArrayBase::TheFPinfo() 49 6.296e-05 6.631e-05 6.975e-05 0.00% Castro::clean_state() 33 5.864e-05 6.245e-05 6.876e-05 0.00% MLMG::computeResidual() 106 5.799e-05 6.099e-05 6.702e-05 0.00% MLMG::computeMLResidual() 32 3.538e-05 4.304e-05 6.343e-05 0.00% MLMG::mgVcycle_up::3 106 5.219e-05 5.537e-05 6.307e-05 0.00% ClusterList::intersect() 1 0 7.843e-06 6.275e-05 0.00% MLMG::mgVcycle_up::2 106 5.243e-05 5.597e-05 6.236e-05 0.00% Amr::defBaseLevel() 1 2.241e-05 4.877e-05 5.681e-05 0.00% Castro::errorEst() 15 4.488e-05 4.955e-05 5.471e-05 0.00% MLPoisson::define() 14 3.171e-05 3.558e-05 4.321e-05 0.00% makeSFC 42 2.731e-05 3.314e-05 4.155e-05 0.00% Castro::avgDown() 15 3.302e-05 3.592e-05 3.998e-05 0.00% Amr::bldFineLevels() 1 1.367e-05 1.91e-05 3.816e-05 0.00% Amr::writeSmallPlotFile() 1 2.859e-05 2.926e-05 3.025e-05 0.00% AmrMesh-cluster 1 0 3.706e-06 2.965e-05 0.00% DistributionMapping::Distribute() 46 2.103e-05 2.31e-05 2.573e-05 0.00% MLLinOp::define() 14 1.975e-05 2.336e-05 2.557e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.104e-05 2.349e-05 2.552e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.861e-05 2.036e-05 2.234e-05 0.00% Amr::initialInit() 1 1.202e-06 3.804e-06 2.062e-05 0.00% FabArray::RecvLayoutMask() 14 1.546e-05 1.639e-05 1.94e-05 0.00% MLMG::getGradSolution() 14 1.646e-05 1.811e-05 1.884e-05 0.00% Castro::enforce_speed_limit() 33 1.107e-05 1.352e-05 1.881e-05 0.00% ClusterList::chop() 1 0 1.998e-06 1.598e-05 0.00% BoxList::complementIn 30 9.499e-06 1.235e-05 1.455e-05 0.00% MLPoisson::prepareForSolve() 14 1.153e-05 1.257e-05 1.368e-05 0.00% knapsack() 2 1.052e-05 1.171e-05 1.332e-05 0.00% BoxList::parallelComplementIn() 30 9.998e-06 1.131e-05 1.196e-05 0.00% Amr::initSubcycle() 1 1.03e-05 1.055e-05 1.082e-05 0.00% MLMG::MLRhsNormInf() 14 8.114e-06 8.607e-06 9.054e-06 0.00% Castro::apply_problem_tags() 15 5.54e-06 6.008e-06 6.294e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.258e-06 4.901e-06 5.918e-06 0.00% Amr::InitializeInit() 1 2.709e-06 3.083e-06 4.298e-06 0.00% Castro::computeInitialDt() 1 2.036e-06 2.329e-06 2.731e-06 0.00% Amr::init() 1 1.616e-06 1.935e-06 2.225e-06 0.00% Castro::gwstrain() 2 1.018e-06 1.249e-06 1.511e-06 0.00% Gravity::set_mass_offset() 1 8.02e-07 9.922e-07 1.162e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.517 6.517 6.517 100.00% Amr::init() 1 5.289 5.289 5.289 81.15% Amr::initialInit() 1 5.054 5.054 5.054 77.54% Amr::FinalizeInit() 1 4.942 4.945 4.947 75.91% Castro::post_init() 2 3.687 3.815 3.888 59.65% Gravity::multilevel_solve_for_new_phi() 14 1.866 1.882 1.891 29.01% Gravity::actual_multilevel_solve() 14 1.864 1.88 1.888 28.97% Gravity::solve_phi_with_mlmg() 14 1.858 1.874 1.882 28.88% Castro::computeTemp() 36 1.082 1.16 1.283 19.69% Amr::regrid() 14 1.21 1.232 1.252 19.20% Gravity::fill_multipole_BCs() 14 1.208 1.224 1.233 18.92% Amr::InitAmr() 1 1.228 1.228 1.228 18.84% Castro::clean_state() 33 1.048 1.114 1.208 18.53% Amr::bldFineLevels() 1 0.896 0.9535 1.057 16.21% Castro::post_regrid() 30 0.8093 0.8454 0.8878 13.62% Castro::initData() 3 0.5693 0.6361 0.7554 11.59% Gravity::actual_solve_with_mlmg() 14 0.6463 0.6485 0.6508 9.99% MLMG::solve() 14 0.6276 0.6281 0.6283 9.64% MLMG::oneIter() 106 0.5542 0.5549 0.5556 8.53% FabArray::ParallelCopy() 2952 0.1399 0.3426 0.4777 7.33% Castro::reset_internal_energy(MultiFab) 36 0.387 0.4202 0.4649 7.13% Castro::reset_internal_energy(Fab) 654 0.3866 0.4199 0.4645 7.13% FabArray::ParallelCopy_finish() 2952 0.08646 0.2879 0.4249 6.52% MLMG::mgVcycle() 318 0.4186 0.4197 0.4217 6.47% MLCellLinOp::smooth() 2544 0.3492 0.3516 0.3581 5.49% amrex::average_down 844 0.0806 0.2069 0.2812 4.31% MLPoisson::Fsmooth() 5088 0.2394 0.2503 0.2651 4.07% Castro::avgDown() 15 0.05027 0.1765 0.2509 3.85% Castro::avgDown(state_indx) 60 0.05023 0.1765 0.2508 3.85% amrex::average_down_w_geom 60 0.05016 0.1764 0.2507 3.85% Amr::writePlotFile() 1 0.2354 0.2355 0.2355 3.61% Castro::derive() 97 0.1977 0.198 0.1981 3.04% Castro::normalize_species() 33 0.164 0.176 0.1943 2.98% Castro::Castro() 16 0.1391 0.1552 0.176 2.70% MLCellLinOp::applyBC() 6294 0.1325 0.1432 0.1569 2.41% amrex::Copy() 975 0.1309 0.1354 0.1365 2.09% Amr::grid_places() 15 0.0189 0.09362 0.1361 2.09% AmrMesh::MakeNewGrids() 15 0.0185 0.09324 0.1358 2.08% Castro::initMFs() 16 0.09913 0.1092 0.1252 1.92% FabArray::FillBoundary() 5552 0.09443 0.1084 0.1241 1.90% MLMG::mgVcycle_bottom 318 0.1138 0.1153 0.1203 1.85% TagBoxArray::mapPRD 15 0.001769 0.07656 0.1191 1.83% MLMG::mgVcycle_down::0 106 0.1159 0.1164 0.1168 1.79% MLMG::miniCycle() 212 0.1139 0.1149 0.1165 1.79% Amr::InitializeInit() 1 0.1063 0.1082 0.112 1.72% Amr::defBaseLevel() 1 0.1063 0.1082 0.112 1.72% MLMG::mgVcycle_up::0 106 0.108 0.1082 0.1085 1.67% FillPatchIterator::Initialize 215 0.0899 0.09247 0.09594 1.47% FillBoundary_finish() 5552 0.0461 0.06368 0.08129 1.25% MLMG::computeResWithCrseSolFineCor() 106 0.07279 0.07471 0.07584 1.16% AmrLevel::AmrLevel(dm) 16 0.05505 0.06133 0.07084 1.09% StateData::define() 64 0.0549 0.06118 0.0707 1.08% FillPatchSingleLevel 259 0.05299 0.0569 0.06158 0.94% MLCellLinOp::apply() 1040 0.05721 0.05941 0.06152 0.94% MLCellLinOp::correctionResidual() 755 0.05673 0.05787 0.05915 0.91% FabArray::ParallelCopy_nowait() 2952 0.05125 0.05356 0.05794 0.89% MLCellLinOp::solutionResidual() 258 0.05327 0.05527 0.05728 0.88% FabArray::setVal() 1769 0.04002 0.05019 0.05375 0.82% FillPatchTwoLevels 126 0.04737 0.04929 0.05245 0.80% MLCellLinOp::reflux() 138 0.04801 0.05008 0.05132 0.79% Castro::init(old) 13 0.04537 0.04757 0.05044 0.77% FillBoundary_nowait() 5552 0.04085 0.04271 0.04612 0.71% MLMG::addInterpCorrection() 530 0.02225 0.03252 0.03433 0.53% MLMG::computeResWithCrseCorFineCor() 106 0.03128 0.03217 0.03273 0.50% VisMF::Write(FabArray) 2 0.02975 0.03045 0.03268 0.50% MLMG::computeResidual() 106 0.02686 0.0282 0.02909 0.45% Castro::computeInitialDt() 1 0.02181 0.02557 0.02743 0.42% Castro::estTimeStep() 1 0.02181 0.02557 0.02743 0.42% MLPoisson::Fapply() 1040 0.02377 0.02502 0.02675 0.41% MLMG::mgVcycle_down::1 106 0.02343 0.02371 0.02404 0.37% MLMG::mgVcycle_up::2 106 0.009102 0.02033 0.02209 0.34% MLMG::computeMLResidual() 32 0.02068 0.02122 0.02181 0.33% MLCellLinOp::updateSolBC() 120 0.01958 0.02053 0.02113 0.32% MLMG::mgVcycle_up::1 106 0.0205 0.02057 0.02067 0.32% MLCellLinOp::updateCorBC() 106 0.01875 0.01964 0.0205 0.31% Gravity::get_new_grav_vector() 4 0.01783 0.01854 0.01923 0.30% MLMG:computeResOfCorrection() 530 0.01741 0.01776 0.01812 0.28% Castro::buildMetrics() 16 0.01361 0.01508 0.01737 0.27% MLPoisson::define() 14 0.01132 0.0135 0.0158 0.24% FabArray::Xpay() 1013 0.01214 0.01302 0.01462 0.22% MultiFab::Multiply() 287 0.01271 0.01298 0.01338 0.21% amrex::Add() 575 0.01074 0.01145 0.01274 0.20% MLPoisson::FFlux() 3408 0.0113 0.01174 0.01226 0.19% MLMG::ResNormInf() 152 0.009779 0.01097 0.01182 0.18% MLMG::interpCorrection_1 106 0.009791 0.01039 0.01095 0.17% MLMG::prepareForSolve() 14 0.009851 0.01012 0.01037 0.16% MLMG::mgVcycle_down::2 106 0.008974 0.009149 0.00992 0.15% FillPatchInterp(MF) 44 0.001668 0.006515 0.0098 0.15% Castro::errorEst() 15 0.009266 0.009639 0.00979 0.15% Castro::apply_tagging_restrictions() 15 0.005548 0.005911 0.006169 0.09% MLLinOp::define() 14 0.0009929 0.003353 0.005832 0.09% MLLinOp::defineGrids() 14 0.0009696 0.003329 0.005807 0.09% FabArrayBase::getCPC() 3662 0.005088 0.005295 0.005608 0.09% MLLinOp::makeSubCommunicator() 14 0.0006238 0.002965 0.005386 0.08% MLCellLinOp::defineAuxData() 14 0.004954 0.005038 0.005359 0.08% MLCellLinOp::defineBC() 14 0.004865 0.005072 0.005226 0.08% FabArray::norminf(mask) 46 0.004879 0.005008 0.00513 0.08% Castro::sum_integrated_quantities() 1 0.004889 0.004928 0.004997 0.08% MLMG::getGradSolution() 14 0.004498 0.004585 0.004714 0.07% MLCellLinOp::compGrad() 28 0.00448 0.004567 0.004696 0.07% MLMG::mgVcycle_down::3 106 0.001314 0.001796 0.004594 0.07% MLMG::MLResNormInf() 32 0.003945 0.004059 0.004177 0.06% MLMG::actualBottomSolve() 106 2.329e-05 0.0005343 0.004086 0.06% FabArray::norminf() 174 0.002985 0.003392 0.003962 0.06% MLCGSolver::bicgstab 13 0 0.0004723 0.003778 0.06% MLMG::mgVcycle_up::3 106 0.0008908 0.001271 0.003751 0.06% MultiFab::max() 54 0.002794 0.003359 0.003604 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.00316 0.003344 0.003467 0.05% BndryData::define() 42 0.002874 0.00295 0.003047 0.05% Castro::enforce_min_density() 33 0.002561 0.002696 0.002909 0.04% FabArrayBase::TheFPinfo() 49 0.0002809 0.001589 0.002494 0.04% FPinfo::FPinfo() 9 0.0002152 0.001523 0.002429 0.04% MLMG::mgVcycle_down::4 106 0.001127 0.001313 0.002379 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0001583 0.001459 0.002337 0.04% average_down_faces 84 0.001913 0.002082 0.002209 0.03% FabArrayBase::CPC::define() 624 0.001607 0.001761 0.00201 0.03% MLMG::mgVcycle_up::4 106 0.001082 0.001214 0.001971 0.03% MLMG::MLRhsNormInf() 14 0.001776 0.001853 0.001932 0.03% Castro::volWgtSum() 46 0.001699 0.001723 0.001754 0.03% FabArray::mult() 34 0.00114 0.001277 0.001493 0.02% StateDataPhysBCFunct::() 259 0.001349 0.00141 0.001468 0.02% Castro::enforce_consistent_e() 3 0.001038 0.001243 0.001378 0.02% StateData::FillBoundary(geom) 8 0.001204 0.001258 0.001306 0.02% FabArrayBase::getFB() 5552 0.00109 0.001137 0.0013 0.02% Gravity::update_max_rhs() 1 0.0006331 0.0009446 0.001156 0.02% AMRErrorTag::operator() 15 0.0009154 0.0009427 0.0009725 0.01% Castro::build_fine_mask() 55 0.000648 0.0006881 0.0007404 0.01% MLCGSolver::ParallelAllReduce 81 0 7.398e-05 0.0005919 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004537 0.0004833 0.0005207 0.01% DistributionMapping::KnapSackDoIt() 2 3.979e-05 0.0003027 0.0004849 0.01% MLPoisson::prepareForSolve() 14 0.0003733 0.0003991 0.0004674 0.01% MLCellLinOp::prepareForSolve() 14 0.0003612 0.0003865 0.0004557 0.01% FabArray::setDomainBndry() 259 0.0003766 0.0004007 0.0004233 0.01% TagBoxArray::collate() 15 0.0002709 0.0003064 0.0004092 0.01% MLCellLinOp::setLevelBC() 28 0.0003302 0.0003493 0.0003744 0.01% Castro::locWgtSum() 6 0.0002025 0.0002073 0.0002121 0.00% FabArrayBase::FB::FB() 35 7.752e-05 8.812e-05 0.0001411 0.00% amrex::Dot() 54 0 1.491e-05 0.0001193 0.00% OwnerMask() 15 9.137e-05 0.0001026 0.0001144 0.00% AmrMesh-cluster 1 0 1.355e-05 0.0001084 0.00% Castro::volProductSum() 2 8.207e-05 8.594e-05 8.988e-05 0.00% FabArray::LinComb() 27 0 1.106e-05 8.846e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.675e-05 7.449e-05 8.526e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 5.668e-05 6.86e-05 8.044e-05 0.00% FabArray::Saxpy() 27 0 9.638e-06 7.71e-05 0.00% ClusterList::intersect() 1 0 7.843e-06 6.275e-05 0.00% makeSFC 42 4.438e-05 5.1e-05 6.023e-05 0.00% Amr::writeSmallPlotFile() 1 2.859e-05 2.926e-05 3.025e-05 0.00% BoxList::parallelComplementIn() 30 2.081e-05 2.366e-05 2.602e-05 0.00% DistributionMapping::Distribute() 46 2.103e-05 2.31e-05 2.573e-05 0.00% FabArray::RecvLayoutMask() 14 1.546e-05 1.639e-05 1.94e-05 0.00% Castro::enforce_speed_limit() 33 1.107e-05 1.352e-05 1.881e-05 0.00% ClusterList::chop() 1 0 1.998e-06 1.598e-05 0.00% BoxList::complementIn 30 9.499e-06 1.235e-05 1.455e-05 0.00% knapsack() 2 1.052e-05 1.171e-05 1.332e-05 0.00% Amr::initSubcycle() 1 1.03e-05 1.055e-05 1.082e-05 0.00% Castro::apply_problem_tags() 15 5.54e-06 6.008e-06 6.294e-06 0.00% Castro::gwstrain() 2 1.018e-06 1.249e-06 1.511e-06 0.00% Gravity::set_mass_offset() 1 8.02e-07 9.922e-07 1.162e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 16 B 21 B 27 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.04-20-g15038d466c05) finalized