MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.08-49-g22908d8ad214) initialized Starting run at 06:20:52 UTC on 2023-08-30. Successfully read inputs file ... Castro git describe: 23.08-7-gf1b93be75 AMReX git describe: 23.08-49-g22908d8ad Microphysics git describe: 23.08-18-g58259177 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002971384 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.144606208 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001864791 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002090246 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002067667 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001039778 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001532571 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001642028 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00186397 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001622673 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001612629 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001652227 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001588722 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.004203748 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001522383 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.260037968 seconds Ending run at 06:20:59 UTC on 2023-08-30. Run time = 6.682185246 Run time without initialization = 0.0003667380001 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.682 ... 6.682 ... 6.682 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2310 1.2311 1.2311 18.42% Gravity::fill_multipole_BCs() 14 1.125 1.142 1.154 17.27% Castro::post_init() 2 1.035 1.047 1.057 15.81% Castro::computeTemp() 36 0.6945 0.739 0.8051 12.05% FabArray::ParallelCopy_finish() 2952 0.1489 0.3896 0.5517 8.26% Castro::reset_internal_energy(Fab) 654 0.3948 0.4245 0.4638 6.94% MLPoisson::Fsmooth() 5088 0.2259 0.2333 0.2432 3.64% Castro::normalize_species() 33 0.1656 0.1774 0.1938 2.90% Castro::initMFs() 16 0.1037 0.13 0.1693 2.53% amrex::Copy() 975 0.1297 0.1442 0.163 2.44% Castro::initData() 3 0.1167 0.1299 0.1506 2.25% AmrLevel::derive() 97 0.1396 0.1453 0.1499 2.24% StateData::define() 64 0.06005 0.07102 0.0906 1.36% FabArray::setVal() 1769 0.05884 0.06474 0.07442 1.11% FillBoundary_finish() 5552 0.05183 0.06206 0.07321 1.10% amrex::average_down 844 0.04511 0.04884 0.05526 0.83% FabArray::ParallelCopy_nowait() 2952 0.02578 0.03232 0.045 0.67% FillBoundary_nowait() 5552 0.04202 0.04312 0.0449 0.67% MLCellLinOp::applyBC() 6294 0.03359 0.03535 0.03797 0.57% FillPatchIterator::Initialize 215 0.01728 0.02431 0.03437 0.51% Castro::estTimeStep() 1 0.02158 0.02656 0.03187 0.48% VisMF::Write(FabArray) 2 0.02821 0.02888 0.03101 0.46% MLPoisson::Fapply() 1040 0.02392 0.02508 0.02619 0.39% Amr::writePlotFile() 1 0.007629 0.01555 0.02576 0.39% Castro::Castro() 16 0.008944 0.01346 0.02253 0.34% Castro::buildMetrics() 16 0.01265 0.01572 0.02061 0.31% MLCellLinOp::reflux() 138 0.01851 0.01887 0.01952 0.29% MLMG::addInterpCorrection() 530 0.01677 0.01717 0.01733 0.26% Amr::regrid() 14 0.01169 0.0134 0.01672 0.25% MultiFab::Multiply() 287 0.01185 0.01459 0.01592 0.24% FabArray::Xpay() 1013 0.01227 0.01306 0.01445 0.22% amrex::Add() 575 0.0114 0.01185 0.01223 0.18% MLCellLinOp::updateSolBC() 120 0.01056 0.0115 0.01213 0.18% MLPoisson::FFlux() 3408 0.0116 0.01178 0.01198 0.18% FillPatchInterp(MF) 44 0.001947 0.007299 0.01096 0.16% MLCellLinOp::updateCorBC() 106 0.009493 0.01035 0.01096 0.16% MLMG::prepareForSolve() 14 0.005134 0.006645 0.00909 0.14% MultiFab::max() 54 0.003319 0.00669 0.008866 0.13% MLMG::interpCorrection_1 106 0.006309 0.007009 0.007643 0.11% DistributionMapping::LeastUsedCPUs() 9 0.00108 0.004939 0.00733 0.11% AmrMesh::MakeNewGrids() 15 0.006281 0.00636 0.006437 0.10% Gravity::multilevel_solve_for_new_phi() 14 0.002695 0.00418 0.006316 0.09% Castro::apply_tagging_restrictions() 15 0.005321 0.005803 0.006122 0.09% MLCellLinOp::compGrad() 28 0.003621 0.00399 0.005583 0.08% FabArray::norminf(mask) 46 0.004724 0.004789 0.004923 0.07% MLMG::ResNormInf() 152 0.003064 0.003791 0.0049 0.07% MLCellLinOp::defineAuxData() 14 0.004012 0.004257 0.004832 0.07% Castro::enforce_min_density() 33 0.003068 0.003393 0.003914 0.06% FabArrayBase::getCPC() 3662 0.003534 0.003671 0.003874 0.06% FabArray::norminf() 174 0.00303 0.003345 0.00382 0.06% MLLinOp::makeSubCommunicator() 14 0.0008593 0.002288 0.003672 0.05% Gravity::get_new_grav_vector() 4 0.002131 0.002594 0.003545 0.05% BndryData::define() 42 0.002484 0.002593 0.002778 0.04% Gravity::actual_solve_with_mlmg() 14 0.001905 0.002087 0.0024 0.04% FabArray::FillBoundary() 5552 0.001942 0.002016 0.002119 0.03% Castro::enforce_consistent_e() 3 0.001047 0.001403 0.002108 0.03% Castro::volWgtSum() 46 0.001627 0.001784 0.002092 0.03% MLCellLinOp::defineBC() 14 0.001823 0.001971 0.002022 0.03% FabArrayBase::CPC::define() 624 0.001665 0.001754 0.00201 0.03% Castro::sum_integrated_quantities() 1 0.0005253 0.00135 0.001897 0.03% MLCellLinOp::smooth() 2544 0.001615 0.001706 0.001772 0.03% FabArray::mult() 34 0.001107 0.001401 0.001728 0.03% FillPatchTwoLevels 126 0.0007538 0.001237 0.001532 0.02% MLCGSolver::bicgstab 13 0 0.000186 0.001488 0.02% average_down_faces 84 0.001174 0.001243 0.00134 0.02% FabArray::ParallelCopy() 2952 0.001212 0.001253 0.001298 0.02% StateData::FillBoundary(geom) 8 0.001196 0.001245 0.001295 0.02% Gravity::actual_multilevel_solve() 14 0.0007888 0.0009277 0.001283 0.02% Castro::build_fine_mask() 55 0.0006798 0.0008121 0.001121 0.02% FabArrayBase::getFB() 5552 0.0009234 0.0009923 0.001099 0.02% Gravity::update_max_rhs() 1 9.621e-05 0.0002454 0.00101 0.02% AMRErrorTag::operator() 15 0.0009179 0.0009266 0.0009414 0.01% MLMG::solve() 14 0.0004882 0.0005628 0.0006718 0.01% TagBoxArray::collate() 15 0.0002812 0.0003604 0.0006429 0.01% AmrLevel::FillPatch() 215 0.0005143 0.0005431 0.0006012 0.01% MLCellLinOp::apply() 1040 0.000415 0.0004503 0.0005853 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004732 0.0004933 0.0005297 0.01% main() 1 0.0003928 0.0004807 0.0005234 0.01% MLCellLinOp::prepareForSolve() 14 0.0003581 0.0003978 0.0005183 0.01% MLMG::MLResNormInf() 32 0.0001766 0.0003887 0.0005107 0.01% Amr::grid_places() 15 0.0003385 0.0003787 0.0005041 0.01% MLMG::mgVcycle() 318 0.0004012 0.0004355 0.0004781 0.01% FabArray::setDomainBndry() 259 0.0003718 0.000417 0.0004689 0.01% MLCellLinOp::setLevelBC() 28 0.0003256 0.0003605 0.0004639 0.01% MLCellLinOp::correctionResidual() 755 0.0004032 0.0004243 0.0004633 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002975 0.0003362 0.0003789 0.01% MLLinOp::defineGrids() 14 0.0002573 0.0003184 0.0003713 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002731 0.0002973 0.0003598 0.01% MLMG::oneIter() 106 0.0002813 0.0002886 0.0003112 0.00% MLMG::actualBottomSolve() 106 2.126e-05 5.345e-05 0.0002642 0.00% MLMG::mgVcycle_bottom 318 0.0002149 0.0002262 0.0002367 0.00% MLCGSolver::ParallelAllReduce 81 0 2.91e-05 0.0002328 0.00% MLCellLinOp::solutionResidual() 258 0.000182 0.0001933 0.0002054 0.00% Castro::locWgtSum() 6 0.0001845 0.0001918 0.0002041 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001646 0.0001788 0.0001966 0.00% AmrLevel::AmrLevel(dm) 16 0.0001431 0.000158 0.0001805 0.00% MLMG:computeResOfCorrection() 530 0.0001504 0.0001583 0.0001655 0.00% StateDataPhysBCFunct::() 259 0.0001382 0.0001494 0.0001574 0.00% FillPatchSingleLevel 259 0.0001445 0.00015 0.0001572 0.00% MLMG::mgVcycle_down::0 106 0.0001336 0.0001418 0.0001515 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001196 0.0001296 0.0001446 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001217 0.00013 0.0001418 0.00% FabArrayBase::FB::FB() 35 7.815e-05 8.882e-05 0.0001388 0.00% amrex::Dot() 54 0 1.66e-05 0.0001328 0.00% MLMG::mgVcycle_down::3 106 7.852e-05 9.042e-05 0.000128 0.00% MLMG::mgVcycle_down::1 106 0.000114 0.00012 0.0001254 0.00% MLMG::miniCycle() 212 8.869e-05 0.0001037 0.0001226 0.00% OwnerMask() 15 9.224e-05 0.0001032 0.000113 0.00% Amr::FinalizeInit() 1 7.372e-06 2.927e-05 0.0001129 0.00% FPinfo::FPinfo() 9 6.78e-05 8.719e-05 0.0001089 0.00% TagBoxArray::mapPRD 15 9.327e-05 9.819e-05 0.0001084 0.00% MLMG::mgVcycle_down::2 106 9.171e-05 9.539e-05 0.0001029 0.00% MLMG::computeResWithCrseCorFineCor() 106 7.948e-05 8.356e-05 9.937e-05 0.00% Castro::volProductSum() 2 7.953e-05 8.54e-05 9.704e-05 0.00% Castro::post_regrid() 30 6.256e-05 7.818e-05 9.357e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.029e-05 7.271e-05 9.16e-05 0.00% Castro::clean_state() 33 6.267e-05 7.301e-05 9.079e-05 0.00% MLMG::mgVcycle_up::0 106 6.935e-05 7.44e-05 8.753e-05 0.00% Castro::avgDown(state_indx) 60 7.299e-05 7.983e-05 8.623e-05 0.00% FabArrayBase::TheFPinfo() 49 7.134e-05 7.664e-05 8.215e-05 0.00% Castro::derive() 97 5.879e-05 6.925e-05 8.058e-05 0.00% MLMG::mgVcycle_down::4 106 7.184e-05 7.485e-05 7.982e-05 0.00% FabArray::Saxpy() 27 0 9.773e-06 7.818e-05 0.00% FabArray::LinComb() 27 0 9.751e-06 7.801e-05 0.00% MLMG::mgVcycle_up::4 106 6.655e-05 7.014e-05 7.782e-05 0.00% Castro::avgDown() 15 4.03e-05 5.161e-05 7.262e-05 0.00% MLMG::mgVcycle_up::1 106 6.16e-05 6.454e-05 6.863e-05 0.00% MLMG::computeResidual() 106 5.437e-05 5.882e-05 6.624e-05 0.00% Castro::init(old) 13 4.406e-05 5.109e-05 6.576e-05 0.00% MLMG::mgVcycle_up::3 106 5.549e-05 5.829e-05 6.428e-05 0.00% MLMG::mgVcycle_up::2 106 5.704e-05 5.915e-05 6.396e-05 0.00% Castro::errorEst() 15 4.513e-05 5.237e-05 6.28e-05 0.00% MLPoisson::define() 14 3.841e-05 4.398e-05 5.892e-05 0.00% amrex::average_down_w_geom 60 4.081e-05 5.025e-05 5.785e-05 0.00% ClusterList::intersect() 1 0 6.95e-06 5.56e-05 0.00% MLMG::computeMLResidual() 32 3.703e-05 3.973e-05 4.692e-05 0.00% Amr::bldFineLevels() 1 1.642e-05 2.289e-05 4.493e-05 0.00% Amr::defBaseLevel() 1 2.665e-05 3.549e-05 4.396e-05 0.00% makeSFC 42 2.701e-05 3.412e-05 4.284e-05 0.00% Amr::writeSmallPlotFile() 1 2.923e-05 3.158e-05 3.65e-05 0.00% BoxList::complementIn 30 9.931e-06 1.591e-05 3.285e-05 0.00% AmrMesh-cluster 1 0 3.84e-06 3.072e-05 0.00% DistributionMapping::Distribute() 46 2.201e-05 2.44e-05 2.787e-05 0.00% MLLinOp::define() 14 1.506e-05 1.909e-05 2.719e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.264e-05 2.45e-05 2.592e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.708e-05 2.042e-05 2.426e-05 0.00% MLPoisson::prepareForSolve() 14 1.153e-05 1.486e-05 2.157e-05 0.00% MLMG::getGradSolution() 14 1.742e-05 1.852e-05 2.023e-05 0.00% Castro::enforce_speed_limit() 33 1.132e-05 1.372e-05 1.903e-05 0.00% FabArray::RecvLayoutMask() 14 1.645e-05 1.73e-05 1.871e-05 0.00% knapsack() 2 1.107e-05 1.281e-05 1.757e-05 0.00% ClusterList::chop() 1 0 2.112e-06 1.689e-05 0.00% Amr::initSubcycle() 1 8.926e-06 1.079e-05 1.334e-05 0.00% BoxList::parallelComplementIn() 30 1.084e-05 1.168e-05 1.28e-05 0.00% Amr::initialInit() 1 1.276e-06 4.487e-06 1.179e-05 0.00% MLMG::MLRhsNormInf() 14 8.233e-06 8.789e-06 9.694e-06 0.00% Castro::apply_problem_tags() 15 8.104e-06 8.61e-06 9.544e-06 0.00% Amr::InitializeInit() 1 2.254e-06 3.065e-06 5.973e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.193e-06 4.892e-06 5.733e-06 0.00% Gravity::set_mass_offset() 1 1.034e-06 2.811e-06 4.939e-06 0.00% Castro::computeInitialDt() 1 1.752e-06 2.28e-06 2.961e-06 0.00% Amr::init() 1 1.748e-06 2.224e-06 2.602e-06 0.00% Castro::gwstrain() 2 1.175e-06 1.348e-06 1.499e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.682 6.682 6.682 100.00% Amr::init() 1 5.451 5.451 5.451 81.57% Amr::initialInit() 1 5.19 5.19 5.19 77.67% Amr::FinalizeInit() 1 5.074 5.079 5.084 76.09% Castro::post_init() 2 3.749 3.88 3.958 59.22% Gravity::multilevel_solve_for_new_phi() 14 1.78 1.795 1.809 27.07% Gravity::actual_multilevel_solve() 14 1.774 1.791 1.804 27.00% Gravity::solve_phi_with_mlmg() 14 1.767 1.784 1.797 26.90% Amr::regrid() 14 1.295 1.333 1.357 20.30% Castro::computeTemp() 36 1.092 1.164 1.269 18.99% Amr::InitAmr() 1 1.231 1.231 1.231 18.42% Castro::clean_state() 33 1.059 1.119 1.198 17.93% Gravity::fill_multipole_BCs() 14 1.127 1.144 1.155 17.29% Amr::bldFineLevels() 1 0.9551 1.02 1.131 16.92% Castro::post_regrid() 30 0.8171 0.8491 0.881 13.18% Castro::initData() 3 0.5795 0.6429 0.7454 11.15% Gravity::actual_solve_with_mlmg() 14 0.6385 0.6401 0.6415 9.60% MLMG::solve() 14 0.6165 0.6177 0.6182 9.25% FabArray::ParallelCopy() 2952 0.2219 0.4497 0.6072 9.09% FabArray::ParallelCopy_finish() 2952 0.1489 0.3896 0.5517 8.26% MLMG::oneIter() 106 0.5359 0.5367 0.5372 8.04% Castro::reset_internal_energy(MultiFab) 36 0.3951 0.4248 0.4641 6.95% Castro::reset_internal_energy(Fab) 654 0.3948 0.4245 0.4638 6.94% MLMG::mgVcycle() 318 0.3983 0.3992 0.4018 6.01% MLCellLinOp::smooth() 2544 0.33 0.3324 0.3383 5.06% amrex::average_down 844 0.1025 0.2321 0.309 4.62% Castro::avgDown() 15 0.0717 0.2021 0.2793 4.18% Castro::avgDown(state_indx) 60 0.07166 0.202 0.2792 4.18% amrex::average_down_w_geom 60 0.07158 0.2019 0.2791 4.18% Amr::writePlotFile() 1 0.2602 0.2603 0.2604 3.90% Castro::Castro() 16 0.1595 0.1944 0.2546 3.81% MLPoisson::Fsmooth() 5088 0.2259 0.2333 0.2432 3.64% Castro::derive() 97 0.2084 0.2174 0.2234 3.34% AmrLevel::derive() 97 0.2083 0.2173 0.2233 3.34% AmrLevel::FillPatch() 215 0.1623 0.1882 0.2033 3.04% Castro::normalize_species() 33 0.1656 0.1774 0.1938 2.90% FillPatchIterator::Initialize 215 0.1384 0.1628 0.1771 2.65% Amr::grid_places() 15 0.02048 0.111 0.1714 2.57% AmrMesh::MakeNewGrids() 15 0.02012 0.1106 0.1711 2.56% Castro::initMFs() 16 0.1037 0.13 0.1693 2.53% amrex::Copy() 975 0.1297 0.1442 0.163 2.44% TagBoxArray::mapPRD 15 0.003394 0.09409 0.1546 2.31% MLCellLinOp::applyBC() 6294 0.1356 0.1436 0.1528 2.29% FillPatchSingleLevel 259 0.08151 0.1056 0.1251 1.87% FabArray::FillBoundary() 5552 0.09855 0.1083 0.1183 1.77% Amr::InitializeInit() 1 0.1059 0.1112 0.1162 1.74% Amr::defBaseLevel() 1 0.1059 0.1112 0.1162 1.74% MLMG::mgVcycle_down::0 106 0.1114 0.1121 0.1129 1.69% MLMG::mgVcycle_bottom 318 0.1071 0.1083 0.1124 1.68% MLMG::miniCycle() 212 0.1073 0.108 0.1087 1.63% FillPatchIterator::FillFromTwoLevels() 126 0.07916 0.0995 0.1066 1.60% FillPatchTwoLevels 126 0.07903 0.09937 0.1065 1.59% MLMG::mgVcycle_up::0 106 0.1008 0.1013 0.1038 1.55% Castro::init(old) 13 0.07942 0.09468 0.1017 1.52% AmrLevel::AmrLevel(dm) 16 0.06021 0.07118 0.09074 1.36% StateData::define() 64 0.06005 0.07102 0.0906 1.36% MLMG::computeResWithCrseSolFineCor() 106 0.07304 0.07437 0.07532 1.13% FabArray::setVal() 1769 0.05884 0.06474 0.07442 1.11% FillBoundary_finish() 5552 0.05183 0.06206 0.07321 1.10% FabArray::ParallelCopy_nowait() 2952 0.05227 0.05886 0.07175 1.07% MLCellLinOp::solutionResidual() 258 0.05726 0.06031 0.06361 0.95% MLCellLinOp::apply() 1040 0.05771 0.05981 0.0613 0.92% MLCellLinOp::correctionResidual() 755 0.05606 0.05772 0.05877 0.88% MLCellLinOp::reflux() 138 0.05037 0.05235 0.05391 0.81% FillPatchIterator::FillFromLevel0() 89 0.02455 0.03861 0.05331 0.80% FillBoundary_nowait() 5552 0.04309 0.0442 0.04614 0.69% MLMG::computeResWithCrseCorFineCor() 106 0.03042 0.0318 0.03225 0.48% Castro::computeInitialDt() 1 0.02158 0.02656 0.03187 0.48% Castro::estTimeStep() 1 0.02158 0.02656 0.03187 0.48% VisMF::Write(FabArray) 2 0.02821 0.02888 0.03101 0.46% MLMG::computeMLResidual() 32 0.02614 0.02836 0.03095 0.46% MLMG::addInterpCorrection() 530 0.01884 0.02895 0.0306 0.46% Gravity::get_new_grav_vector() 4 0.02654 0.02814 0.02921 0.44% MLMG::computeResidual() 106 0.02647 0.0279 0.02883 0.43% MLCellLinOp::updateSolBC() 120 0.02325 0.02539 0.02816 0.42% MLPoisson::Fapply() 1040 0.02392 0.02508 0.02619 0.39% MLMG::mgVcycle_down::1 106 0.02284 0.0232 0.02364 0.35% Castro::buildMetrics() 16 0.01444 0.01769 0.02295 0.34% MLMG::mgVcycle_up::2 106 0.00849 0.01889 0.02065 0.31% MLMG::mgVcycle_up::1 106 0.01998 0.02019 0.0203 0.30% MLCellLinOp::updateCorBC() 106 0.01837 0.01922 0.01983 0.30% MLMG:computeResOfCorrection() 530 0.01766 0.01788 0.01808 0.27% MLMG::interpCorrection_1 106 0.0118 0.0145 0.01601 0.24% MultiFab::Multiply() 287 0.01185 0.01459 0.01592 0.24% MLPoisson::define() 14 0.01181 0.01338 0.01457 0.22% FabArray::Xpay() 1013 0.01227 0.01306 0.01445 0.22% MLMG::prepareForSolve() 14 0.009818 0.0119 0.01398 0.21% amrex::Add() 575 0.0114 0.01185 0.01223 0.18% MLPoisson::FFlux() 3408 0.0116 0.01178 0.01198 0.18% MLMG::ResNormInf() 152 0.009606 0.01013 0.01109 0.17% FillPatchInterp(MF) 44 0.001947 0.007299 0.01096 0.16% Castro::errorEst() 15 0.009344 0.009593 0.01019 0.15% MLMG::mgVcycle_down::2 106 0.008969 0.009187 0.009975 0.15% MultiFab::max() 54 0.003319 0.00669 0.008866 0.13% FabArrayBase::TheFPinfo() 49 0.001218 0.00508 0.007492 0.11% FPinfo::FPinfo() 9 0.00114 0.005003 0.007415 0.11% DistributionMapping::LeastUsedCPUs() 9 0.00108 0.004939 0.00733 0.11% MLMG::getGradSolution() 14 0.006232 0.006585 0.006877 0.10% MLCellLinOp::compGrad() 28 0.006215 0.006566 0.006857 0.10% MLCellLinOp::defineAuxData() 14 0.005081 0.005372 0.006155 0.09% Castro::apply_tagging_restrictions() 15 0.005321 0.005803 0.006122 0.09% Gravity::update_max_rhs() 1 0.0006192 0.004172 0.006106 0.09% Castro::sum_integrated_quantities() 1 0.005744 0.005857 0.005923 0.09% FabArrayBase::getCPC() 3662 0.005198 0.005425 0.005884 0.09% MLCellLinOp::defineBC() 14 0.005022 0.005257 0.0055 0.08% FabArray::norminf(mask) 46 0.004724 0.004789 0.004923 0.07% MLMG::mgVcycle_down::3 106 0.001265 0.001764 0.004496 0.07% Gravity::average_fine_ec_onto_crse_ec() 14 0.003213 0.004034 0.00439 0.07% MLMG::MLResNormInf() 32 0.003935 0.004041 0.004179 0.06% MLLinOp::define() 14 0.001242 0.002703 0.004133 0.06% MLLinOp::defineGrids() 14 0.001224 0.002684 0.004113 0.06% Castro::enforce_min_density() 33 0.003068 0.003393 0.003914 0.06% FabArray::norminf() 174 0.00303 0.003345 0.00382 0.06% MLMG::actualBottomSolve() 106 2.126e-05 0.0004881 0.003742 0.06% MLLinOp::makeSubCommunicator() 14 0.0008593 0.002288 0.003672 0.05% MLMG::mgVcycle_up::3 106 0.0009367 0.001286 0.003564 0.05% MLCGSolver::bicgstab 13 0 0.000428 0.003424 0.05% BndryData::define() 42 0.003035 0.003154 0.003334 0.05% average_down_faces 84 0.001936 0.002777 0.00315 0.05% MLMG::mgVcycle_down::4 106 0.001143 0.001319 0.00229 0.03% Castro::enforce_consistent_e() 3 0.001047 0.001403 0.002108 0.03% Castro::volWgtSum() 46 0.001632 0.001789 0.002097 0.03% FabArrayBase::CPC::define() 624 0.001665 0.001754 0.00201 0.03% MLMG::mgVcycle_up::4 106 0.001081 0.001216 0.001909 0.03% MLMG::MLRhsNormInf() 14 0.001761 0.00179 0.001852 0.03% FabArray::mult() 34 0.001107 0.001401 0.001728 0.03% StateDataPhysBCFunct::() 259 0.001342 0.001394 0.001433 0.02% StateData::FillBoundary(geom) 8 0.001196 0.001245 0.001295 0.02% FabArrayBase::getFB() 5552 0.001005 0.001081 0.001238 0.02% Castro::build_fine_mask() 55 0.0006798 0.0008121 0.001121 0.02% AMRErrorTag::operator() 15 0.0009179 0.0009266 0.0009414 0.01% DistributionMapping::KnapSackDoIt() 2 4.827e-05 0.0004748 0.0006796 0.01% TagBoxArray::collate() 15 0.0002812 0.0003604 0.0006429 0.01% MLPoisson::prepareForSolve() 14 0.0003732 0.0004127 0.0005325 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004732 0.0004933 0.0005297 0.01% MLCellLinOp::prepareForSolve() 14 0.0003581 0.0003978 0.0005183 0.01% FabArray::setDomainBndry() 259 0.0003718 0.000417 0.0004689 0.01% MLCellLinOp::setLevelBC() 28 0.0003256 0.0003605 0.0004639 0.01% MLCGSolver::ParallelAllReduce 81 0 3.942e-05 0.0003154 0.00% Castro::locWgtSum() 6 0.000185 0.0001923 0.0002044 0.00% FabArrayBase::FB::FB() 35 7.815e-05 8.882e-05 0.0001388 0.00% amrex::Dot() 54 0 1.66e-05 0.0001328 0.00% OwnerMask() 15 9.224e-05 0.0001032 0.000113 0.00% AmrMesh-cluster 1 0 1.29e-05 0.0001032 0.00% Castro::volProductSum() 2 7.968e-05 8.562e-05 9.722e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.725e-05 7.747e-05 8.693e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.59e-05 6.68e-05 8.539e-05 0.00% FabArray::Saxpy() 27 0 9.773e-06 7.818e-05 0.00% FabArray::LinComb() 27 0 9.751e-06 7.801e-05 0.00% makeSFC 42 4.415e-05 5.297e-05 6.164e-05 0.00% ClusterList::intersect() 1 0 6.95e-06 5.56e-05 0.00% BoxList::parallelComplementIn() 30 2.145e-05 2.759e-05 4.484e-05 0.00% Amr::writeSmallPlotFile() 1 2.923e-05 3.158e-05 3.65e-05 0.00% BoxList::complementIn 30 9.931e-06 1.591e-05 3.285e-05 0.00% DistributionMapping::Distribute() 46 2.201e-05 2.44e-05 2.787e-05 0.00% Castro::enforce_speed_limit() 33 1.132e-05 1.372e-05 1.903e-05 0.00% FabArray::RecvLayoutMask() 14 1.645e-05 1.73e-05 1.871e-05 0.00% knapsack() 2 1.107e-05 1.281e-05 1.757e-05 0.00% ClusterList::chop() 1 0 2.112e-06 1.689e-05 0.00% Amr::initSubcycle() 1 8.926e-06 1.079e-05 1.334e-05 0.00% Castro::apply_problem_tags() 15 8.104e-06 8.61e-06 9.544e-06 0.00% Gravity::set_mass_offset() 1 1.034e-06 2.811e-06 4.939e-06 0.00% Castro::gwstrain() 2 1.175e-06 1.348e-06 1.499e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 16 B 21 B 25 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.08-49-g22908d8ad214) finalized