MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.05-12-g1a96800dc229) initialized Starting run at 06:25:16 UTC on 2023-05-15. Successfully read inputs file ... Castro git describe: 23.05-7-gb73e45af4 AMReX git describe: 23.05-12-g1a96800dc Microphysics git describe: 23.05-4-g0685d31f reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002855918 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.123657624 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001548326 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002207946 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001084957 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001071841 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001080719 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001087175 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001119587 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001081118 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001081121 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001059128 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001074159 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001071566 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001083301 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.236070128 seconds Ending run at 06:25:22 UTC on 2023-05-15. Run time = 6.438359748 Run time without initialization = 0.000283657 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.438 ... 6.438 ... 6.438 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2267 1.2267 1.2267 19.05% Gravity::fill_multipole_BCs() 14 1.141 1.162 1.179 18.32% Castro::post_init() 2 0.9826 0.9849 0.9865 15.32% Castro::computeTemp() 36 0.6782 0.7438 0.8175 12.70% Castro::reset_internal_energy(Fab) 654 0.3827 0.4186 0.4594 7.13% FabArray::ParallelCopy_finish() 2952 0.07851 0.2746 0.4363 6.78% MLPoisson::Fsmooth() 5088 0.2386 0.2514 0.2594 4.03% Castro::normalize_species() 33 0.1649 0.1763 0.1973 3.06% Castro::initData() 3 0.113 0.1297 0.1506 2.34% Castro::derive() 97 0.139 0.1416 0.1437 2.23% amrex::Copy() 975 0.1291 0.1327 0.1357 2.11% Castro::initMFs() 16 0.09733 0.1083 0.1242 1.93% FillBoundary_finish() 5552 0.05736 0.0709 0.09031 1.40% StateData::define() 64 0.05561 0.06181 0.07107 1.10% amrex::average_down 844 0.04311 0.04732 0.05126 0.80% FabArray::setVal() 1769 0.04168 0.04618 0.04875 0.76% FillBoundary_nowait() 5552 0.0401 0.04255 0.04481 0.70% MLCellLinOp::applyBC() 6294 0.03299 0.0351 0.03802 0.59% VisMF::Write(FabArray) 2 0.02989 0.031 0.03338 0.52% FabArray::ParallelCopy_nowait() 2952 0.0235 0.02613 0.03161 0.49% Castro::estTimeStep() 1 0.02207 0.02358 0.02682 0.42% MLPoisson::Fapply() 1040 0.02388 0.02538 0.02661 0.41% MLMG::addInterpCorrection() 530 0.01948 0.02033 0.02165 0.34% Amr::regrid() 14 0.01396 0.01624 0.01911 0.30% MLCellLinOp::reflux() 138 0.01677 0.0176 0.01834 0.28% FillPatchIterator::Initialize 215 0.01562 0.01688 0.01777 0.28% Castro::buildMetrics() 16 0.01217 0.01347 0.01536 0.24% FabArray::Xpay() 1013 0.01214 0.01271 0.01386 0.22% MultiFab::Multiply() 287 0.01241 0.01281 0.01324 0.21% MLCellLinOp::updateSolBC() 120 0.01057 0.01166 0.01236 0.19% MLPoisson::FFlux() 3408 0.01124 0.01172 0.01216 0.19% amrex::Add() 575 0.0109 0.01134 0.01207 0.19% MLCellLinOp::updateCorBC() 106 0.009562 0.01052 0.01122 0.17% Castro::Castro() 16 0.008682 0.009561 0.01101 0.17% FillPatchInterp(MF) 44 0.001707 0.006454 0.009527 0.15% Amr::writePlotFile() 1 0.005496 0.007924 0.009066 0.14% MLMG::interpCorrection_1 106 0.006251 0.006989 0.007622 0.12% AmrMesh::MakeNewGrids() 15 0.006372 0.006531 0.006631 0.10% Castro::apply_tagging_restrictions() 15 0.005661 0.005968 0.006129 0.10% MultiFab::max() 54 0.003349 0.00453 0.00521 0.08% MLMG::prepareForSolve() 14 0.004746 0.004938 0.005196 0.08% FabArray::norminf(mask) 46 0.004823 0.005007 0.005192 0.08% MLMG::ResNormInf() 152 0.002992 0.003737 0.004431 0.07% MLLinOp::makeSubCommunicator() 14 0.0008602 0.002399 0.004285 0.07% MLCellLinOp::defineAuxData() 14 0.003861 0.003964 0.00412 0.06% FabArrayBase::getCPC() 3662 0.003542 0.003604 0.003762 0.06% FabArray::norminf() 174 0.002927 0.003354 0.003649 0.06% Gravity::multilevel_solve_for_new_phi() 14 0.002717 0.002941 0.003436 0.05% MLCellLinOp::compGrad() 28 0.003213 0.003296 0.003365 0.05% Castro::enforce_min_density() 33 0.002526 0.002654 0.002859 0.04% BndryData::define() 42 0.002357 0.002432 0.002555 0.04% Gravity::get_new_grav_vector() 4 0.001933 0.002137 0.002464 0.04% FabArray::FillBoundary() 5552 0.001963 0.00205 0.002219 0.03% Gravity::actual_solve_with_mlmg() 14 0.001913 0.002008 0.002177 0.03% MLCellLinOp::defineBC() 14 0.001809 0.001948 0.002027 0.03% FabArrayBase::CPC::define() 624 0.001549 0.001727 0.001993 0.03% MLCellLinOp::smooth() 2544 0.001656 0.001764 0.001841 0.03% DistributionMapping::LeastUsedCPUs() 9 0.00026 0.001208 0.001827 0.03% Castro::volWgtSum() 46 0.001666 0.001704 0.001772 0.03% FabArray::mult() 34 0.001164 0.001336 0.001635 0.03% Castro::enforce_consistent_e() 3 0.0009748 0.001183 0.00142 0.02% MLCGSolver::bicgstab 13 0 0.0001759 0.001407 0.02% FillPatchTwoLevels 126 0.0006668 0.001088 0.001355 0.02% FabArray::ParallelCopy() 2952 0.00118 0.00122 0.001305 0.02% average_down_faces 84 0.0009942 0.001124 0.001228 0.02% FabArrayBase::getFB() 5552 0.001093 0.001148 0.001227 0.02% StateData::FillBoundary(geom) 8 0.001126 0.001152 0.001177 0.02% AMRErrorTag::operator() 15 0.0009345 0.0009378 0.0009401 0.01% Gravity::actual_multilevel_solve() 14 0.0008219 0.0008612 0.0009144 0.01% Castro::build_fine_mask() 55 0.0006282 0.0007371 0.0008662 0.01% Castro::sum_integrated_quantities() 1 0.0004696 0.0006497 0.0008014 0.01% MLMG::solve() 14 0.0003698 0.0005294 0.0006591 0.01% MLCellLinOp::apply() 1040 0.0004253 0.000473 0.0006341 0.01% TagBoxArray::collate() 15 0.0002518 0.000322 0.0005624 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000479 0.0004914 0.0005136 0.01% Amr::grid_places() 15 0.0003442 0.0003842 0.0005033 0.01% main() 1 0.0003829 0.0004272 0.0005003 0.01% MLMG::mgVcycle() 318 0.0004001 0.0004339 0.0004859 0.01% MLCellLinOp::correctionResidual() 755 0.0003869 0.0004161 0.000473 0.01% MLCellLinOp::prepareForSolve() 14 0.0003608 0.0003839 0.0004513 0.01% MLMG::MLResNormInf() 32 0.000135 0.0002748 0.0004358 0.01% FabArray::setDomainBndry() 259 0.0003829 0.0003974 0.0004085 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002678 0.0003085 0.0003636 0.01% MLLinOp::defineGrids() 14 0.0002717 0.0003195 0.0003605 0.01% MLCellLinOp::setLevelBC() 28 0.0003276 0.0003382 0.0003533 0.01% MLMG::oneIter() 106 0.0002613 0.0002846 0.000333 0.01% MLCGSolver::ParallelAllReduce 81 0 3.946e-05 0.0003157 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002582 0.0002848 0.0002966 0.00% MLMG::actualBottomSolve() 106 2.077e-05 5.778e-05 0.0002937 0.00% MLMG::mgVcycle_bottom 318 0.0002264 0.0002415 0.0002546 0.00% Castro::locWgtSum() 6 0.0001875 0.0001953 0.0002285 0.00% MLCellLinOp::solutionResidual() 258 0.0001841 0.000194 0.0002058 0.00% FillPatchSingleLevel 259 0.0001608 0.0001693 0.0001893 0.00% MLMG:computeResOfCorrection() 530 0.0001544 0.0001688 0.0001893 0.00% Castro::init(old) 13 0.0001592 0.0001721 0.0001889 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001545 0.0001697 0.0001819 0.00% StateDataPhysBCFunct::() 259 0.0001418 0.000151 0.000161 0.00% AmrLevel::AmrLevel(dm) 16 0.0001258 0.0001441 0.0001609 0.00% MLMG::mgVcycle_down::0 106 0.0001288 0.0001405 0.0001606 0.00% FabArrayBase::FB::FB() 35 7.82e-05 8.983e-05 0.0001435 0.00% MLMG::miniCycle() 212 8.575e-05 0.0001025 0.0001389 0.00% MLMG::mgVcycle_down::1 106 0.0001075 0.0001111 0.0001198 0.00% FPinfo::FPinfo() 9 7.926e-05 9.284e-05 0.0001198 0.00% amrex::Dot() 54 0 1.491e-05 0.0001193 0.00% Gravity::update_max_rhs() 1 7.903e-05 9.592e-05 0.0001136 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.509e-05 9.528e-05 0.0001097 0.00% OwnerMask() 15 8.922e-05 9.889e-05 0.0001091 0.00% TagBoxArray::mapPRD 15 9.189e-05 9.743e-05 0.0001033 0.00% Castro::volProductSum() 2 8.511e-05 8.875e-05 9.666e-05 0.00% MLMG::mgVcycle_down::3 106 7.491e-05 8.374e-05 9.616e-05 0.00% Amr::FinalizeInit() 1 8.064e-06 2.459e-05 9.366e-05 0.00% Castro::post_regrid() 30 5.754e-05 7.586e-05 9.282e-05 0.00% MLMG::mgVcycle_down::2 106 8.067e-05 8.472e-05 8.851e-05 0.00% FabArrayBase::TheFPinfo() 49 6.656e-05 7.321e-05 8.696e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.086e-05 6.811e-05 8.523e-05 0.00% FabArray::LinComb() 27 0 1.019e-05 8.15e-05 0.00% FabArray::Saxpy() 27 0 9.991e-06 7.993e-05 0.00% MLMG::mgVcycle_down::4 106 6.91e-05 7.423e-05 7.77e-05 0.00% Castro::clean_state() 33 6.099e-05 6.63e-05 7.532e-05 0.00% MLMG::mgVcycle_up::0 106 6.639e-05 6.986e-05 7.528e-05 0.00% MLMG::mgVcycle_up::4 106 6.261e-05 6.791e-05 7.326e-05 0.00% MLMG::mgVcycle_up::1 106 5.638e-05 6.119e-05 7.235e-05 0.00% Castro::errorEst() 15 4.681e-05 5.206e-05 7.225e-05 0.00% ClusterList::intersect() 1 0 8.647e-06 6.918e-05 0.00% Castro::avgDown(state_indx) 60 5.492e-05 6.103e-05 6.479e-05 0.00% MLMG::computeResidual() 106 5.312e-05 5.911e-05 6.476e-05 0.00% MLMG::mgVcycle_up::3 106 5.124e-05 5.686e-05 6.111e-05 0.00% Amr::writeSmallPlotFile() 1 2.975e-05 3.387e-05 5.956e-05 0.00% MLMG::mgVcycle_up::2 106 5.256e-05 5.612e-05 5.934e-05 0.00% amrex::average_down_w_geom 60 4.625e-05 5.213e-05 5.777e-05 0.00% Amr::defBaseLevel() 1 1.867e-05 4.366e-05 5.652e-05 0.00% MLMG::computeMLResidual() 32 3.792e-05 4.19e-05 5.025e-05 0.00% Castro::avgDown() 15 3.472e-05 3.942e-05 4.714e-05 0.00% MLPoisson::define() 14 3.229e-05 3.626e-05 4.036e-05 0.00% makeSFC 42 2.534e-05 3.084e-05 3.84e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.193e-05 2.392e-05 2.733e-05 0.00% AmrMesh-cluster 1 0 3.348e-06 2.679e-05 0.00% Amr::initSubcycle() 1 9.022e-06 1.213e-05 2.624e-05 0.00% MLLinOp::define() 14 1.989e-05 2.302e-05 2.551e-05 0.00% DistributionMapping::Distribute() 46 2.207e-05 2.289e-05 2.428e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.885e-05 2.085e-05 2.23e-05 0.00% BoxList::parallelComplementIn() 30 1.049e-05 1.249e-05 1.927e-05 0.00% Amr::bldFineLevels() 1 1.53e-05 1.657e-05 1.886e-05 0.00% MLMG::getGradSolution() 14 1.582e-05 1.763e-05 1.832e-05 0.00% FabArray::RecvLayoutMask() 14 1.618e-05 1.686e-05 1.789e-05 0.00% BoxList::complementIn 30 1.011e-05 1.222e-05 1.756e-05 0.00% ClusterList::chop() 1 0 2.179e-06 1.744e-05 0.00% MLPoisson::prepareForSolve() 14 1.136e-05 1.3e-05 1.425e-05 0.00% Castro::enforce_speed_limit() 33 1.126e-05 1.262e-05 1.36e-05 0.00% knapsack() 2 1.067e-05 1.187e-05 1.296e-05 0.00% MLMG::MLRhsNormInf() 14 8.19e-06 8.524e-06 8.933e-06 0.00% Castro::apply_problem_tags() 15 6.029e-06 6.625e-06 7.232e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.067e-06 4.832e-06 5.151e-06 0.00% Amr::InitializeInit() 1 2.122e-06 2.779e-06 4.911e-06 0.00% Gravity::set_mass_offset() 1 8.92e-07 2.434e-06 4.903e-06 0.00% Castro::computeInitialDt() 1 1.571e-06 2.323e-06 2.83e-06 0.00% Amr::init() 1 1.716e-06 1.965e-06 2.18e-06 0.00% Amr::initialInit() 1 1.175e-06 1.428e-06 1.874e-06 0.00% Castro::gwstrain() 2 9.26e-07 1.271e-06 1.606e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.438 6.438 6.438 100.00% Amr::init() 1 5.211 5.211 5.211 80.94% Amr::initialInit() 1 4.975 4.975 4.975 77.27% Amr::FinalizeInit() 1 4.865 4.867 4.87 75.64% Castro::post_init() 2 3.615 3.739 3.826 59.43% Gravity::multilevel_solve_for_new_phi() 14 1.809 1.829 1.849 28.71% Gravity::actual_multilevel_solve() 14 1.806 1.826 1.846 28.67% Gravity::solve_phi_with_mlmg() 14 1.8 1.82 1.84 28.57% Castro::computeTemp() 36 1.061 1.163 1.277 19.84% Amr::regrid() 14 1.194 1.225 1.248 19.39% Amr::InitAmr() 1 1.227 1.227 1.227 19.05% Castro::clean_state() 33 1.033 1.116 1.21 18.80% Gravity::fill_multipole_BCs() 14 1.142 1.163 1.181 18.34% Amr::bldFineLevels() 1 0.882 0.9523 1.053 16.35% Castro::post_regrid() 30 0.7993 0.8453 0.8841 13.73% Castro::initData() 3 0.5542 0.6398 0.7568 11.75% Gravity::actual_solve_with_mlmg() 14 0.6545 0.656 0.658 10.22% MLMG::solve() 14 0.6358 0.6362 0.6366 9.89% MLMG::oneIter() 106 0.5632 0.5638 0.5642 8.76% FabArray::ParallelCopy() 2952 0.1299 0.3288 0.4888 7.59% Castro::reset_internal_energy(MultiFab) 36 0.383 0.419 0.4596 7.14% Castro::reset_internal_energy(Fab) 654 0.3827 0.4186 0.4594 7.13% FabArray::ParallelCopy_finish() 2952 0.07851 0.2746 0.4363 6.78% MLMG::mgVcycle() 318 0.4285 0.4301 0.4311 6.70% MLCellLinOp::smooth() 2544 0.3594 0.3617 0.3676 5.71% amrex::average_down 844 0.07693 0.2005 0.2901 4.51% MLPoisson::Fsmooth() 5088 0.2386 0.2514 0.2594 4.03% Castro::avgDown() 15 0.04657 0.1702 0.2592 4.03% Castro::avgDown(state_indx) 60 0.04653 0.1701 0.2592 4.03% amrex::average_down_w_geom 60 0.04647 0.1701 0.2591 4.02% Amr::writePlotFile() 1 0.2362 0.2363 0.2364 3.67% Castro::derive() 97 0.1981 0.1983 0.1985 3.08% Castro::normalize_species() 33 0.1649 0.1763 0.1973 3.06% Castro::Castro() 16 0.1363 0.1518 0.1716 2.67% MLCellLinOp::applyBC() 6294 0.1408 0.1518 0.1665 2.59% Amr::grid_places() 15 0.01945 0.08951 0.141 2.19% AmrMesh::MakeNewGrids() 15 0.01907 0.08913 0.1406 2.18% amrex::Copy() 975 0.1291 0.1327 0.1357 2.11% FabArray::FillBoundary() 5552 0.1043 0.1167 0.1336 2.07% Castro::initMFs() 16 0.09733 0.1083 0.1242 1.93% TagBoxArray::mapPRD 15 0.002274 0.07225 0.1236 1.92% MLMG::mgVcycle_down::0 106 0.1197 0.1205 0.1218 1.89% MLMG::mgVcycle_bottom 318 0.1148 0.1167 0.1206 1.87% MLMG::miniCycle() 212 0.1149 0.1163 0.1173 1.82% MLMG::mgVcycle_up::0 106 0.112 0.1124 0.1128 1.75% Amr::InitializeInit() 1 0.105 0.1082 0.1098 1.70% Amr::defBaseLevel() 1 0.105 0.1082 0.1098 1.70% FillPatchIterator::Initialize 215 0.08678 0.09076 0.09369 1.46% FillBoundary_finish() 5552 0.05736 0.0709 0.09031 1.40% MLMG::computeResWithCrseSolFineCor() 106 0.07275 0.07393 0.07528 1.17% AmrLevel::AmrLevel(dm) 16 0.05576 0.06196 0.0712 1.11% StateData::define() 64 0.05561 0.06181 0.07107 1.10% MLCellLinOp::apply() 1040 0.05772 0.06003 0.06204 0.96% FillPatchSingleLevel 259 0.05116 0.05615 0.06024 0.94% MLCellLinOp::correctionResidual() 755 0.05617 0.05772 0.05969 0.93% FabArray::ParallelCopy_nowait() 2952 0.05016 0.05293 0.0591 0.92% MLCellLinOp::solutionResidual() 258 0.0534 0.05549 0.05698 0.89% FillPatchTwoLevels 126 0.04453 0.04769 0.05038 0.78% MLCellLinOp::reflux() 138 0.04785 0.0493 0.05028 0.78% FabArray::setVal() 1769 0.04168 0.04618 0.04875 0.76% Castro::init(old) 13 0.04426 0.04638 0.04867 0.76% FillBoundary_nowait() 5552 0.04129 0.04379 0.04604 0.72% MLMG::addInterpCorrection() 530 0.02138 0.03217 0.0348 0.54% VisMF::Write(FabArray) 2 0.02989 0.031 0.03338 0.52% MLMG::computeResWithCrseCorFineCor() 106 0.0302 0.03137 0.03186 0.49% MLMG::computeResidual() 106 0.0272 0.02823 0.0287 0.45% Castro::computeInitialDt() 1 0.02207 0.02358 0.02682 0.42% Castro::estTimeStep() 1 0.02207 0.02358 0.02682 0.42% MLPoisson::Fapply() 1040 0.02388 0.02538 0.02661 0.41% MLMG::mgVcycle_down::1 106 0.02363 0.02423 0.02464 0.38% MLMG::computeMLResidual() 32 0.02072 0.02125 0.02183 0.34% MLCellLinOp::updateSolBC() 120 0.02012 0.02089 0.02159 0.34% MLMG::mgVcycle_up::2 106 0.009061 0.01972 0.02151 0.33% MLMG::mgVcycle_up::1 106 0.02104 0.02118 0.02136 0.33% MLCellLinOp::updateCorBC() 106 0.0182 0.01904 0.01954 0.30% MLMG:computeResOfCorrection() 530 0.018 0.0184 0.0189 0.29% Gravity::get_new_grav_vector() 4 0.01792 0.01822 0.01889 0.29% Castro::buildMetrics() 16 0.01349 0.015 0.01709 0.27% MLPoisson::define() 14 0.01144 0.01292 0.0147 0.23% FabArray::Xpay() 1013 0.01214 0.01271 0.01386 0.22% MultiFab::Multiply() 287 0.01241 0.01281 0.01324 0.21% MLPoisson::FFlux() 3408 0.01124 0.01172 0.01216 0.19% amrex::Add() 575 0.0109 0.01134 0.01207 0.19% MLMG::interpCorrection_1 106 0.00977 0.0107 0.01186 0.18% MLMG::ResNormInf() 152 0.009555 0.01023 0.01104 0.17% MLMG::mgVcycle_down::2 106 0.009226 0.009392 0.01027 0.16% MLMG::prepareForSolve() 14 0.009766 0.01003 0.01025 0.16% Castro::errorEst() 15 0.009545 0.009783 0.01 0.16% FillPatchInterp(MF) 44 0.001707 0.006454 0.009527 0.15% Castro::apply_tagging_restrictions() 15 0.005661 0.005968 0.006129 0.10% FabArrayBase::getCPC() 3662 0.005115 0.005331 0.005755 0.09% MLCellLinOp::defineAuxData() 14 0.004842 0.005003 0.005294 0.08% MultiFab::max() 54 0.003349 0.00453 0.00521 0.08% MLCellLinOp::defineBC() 14 0.00484 0.005067 0.005198 0.08% FabArray::norminf(mask) 46 0.004823 0.005007 0.005192 0.08% Castro::sum_integrated_quantities() 1 0.004799 0.004846 0.004944 0.08% MLLinOp::define() 14 0.00127 0.002814 0.004739 0.07% MLLinOp::defineGrids() 14 0.001247 0.002791 0.004714 0.07% MLMG::getGradSolution() 14 0.004506 0.004592 0.004699 0.07% MLCellLinOp::compGrad() 28 0.004488 0.004574 0.00468 0.07% MLMG::mgVcycle_down::3 106 0.001331 0.001809 0.004489 0.07% MLLinOp::makeSubCommunicator() 14 0.0008602 0.002399 0.004285 0.07% MLMG::MLResNormInf() 32 0.003957 0.004086 0.004225 0.07% MLMG::actualBottomSolve() 106 2.077e-05 0.0004863 0.003722 0.06% FabArray::norminf() 174 0.002927 0.003354 0.003649 0.06% MLMG::mgVcycle_up::3 106 0.0009012 0.001282 0.003575 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.00321 0.003334 0.0035 0.05% MLCGSolver::bicgstab 13 0 0.0004221 0.003377 0.05% BndryData::define() 42 0.002907 0.002995 0.003135 0.05% Castro::enforce_min_density() 33 0.002526 0.002654 0.002859 0.04% MLMG::mgVcycle_down::4 106 0.001124 0.001327 0.002275 0.04% average_down_faces 84 0.001935 0.002031 0.002222 0.03% FabArrayBase::CPC::define() 624 0.001549 0.001727 0.001993 0.03% MLMG::MLRhsNormInf() 14 0.001778 0.001866 0.001936 0.03% MLMG::mgVcycle_up::4 106 0.001084 0.00123 0.001923 0.03% FabArrayBase::TheFPinfo() 49 0.0004123 0.001331 0.001922 0.03% FPinfo::FPinfo() 9 0.0003392 0.001258 0.001855 0.03% DistributionMapping::LeastUsedCPUs() 9 0.00026 0.001208 0.001827 0.03% Castro::volWgtSum() 46 0.001671 0.001709 0.001778 0.03% FabArray::mult() 34 0.001164 0.001336 0.001635 0.03% Gravity::update_max_rhs() 1 0.0006216 0.001034 0.001478 0.02% Castro::enforce_consistent_e() 3 0.0009748 0.001183 0.00142 0.02% FabArrayBase::getFB() 5552 0.001177 0.001238 0.001371 0.02% StateDataPhysBCFunct::() 259 0.001267 0.001303 0.001338 0.02% StateData::FillBoundary(geom) 8 0.001126 0.001152 0.001177 0.02% AMRErrorTag::operator() 15 0.0009345 0.0009378 0.0009401 0.01% Castro::build_fine_mask() 55 0.0006282 0.0007371 0.0008662 0.01% DistributionMapping::KnapSackDoIt() 2 4.337e-05 0.000312 0.0005893 0.01% TagBoxArray::collate() 15 0.0002518 0.000322 0.0005624 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000479 0.0004914 0.0005136 0.01% MLPoisson::prepareForSolve() 14 0.0003735 0.0003969 0.0004655 0.01% MLCellLinOp::prepareForSolve() 14 0.0003608 0.0003839 0.0004513 0.01% FabArray::setDomainBndry() 259 0.0003829 0.0003974 0.0004085 0.01% MLCGSolver::ParallelAllReduce 81 0 4.834e-05 0.0003867 0.01% MLCellLinOp::setLevelBC() 28 0.0003276 0.0003382 0.0003533 0.01% Castro::locWgtSum() 6 0.0001882 0.0001959 0.0002289 0.00% FabArrayBase::FB::FB() 35 7.82e-05 8.983e-05 0.0001435 0.00% amrex::Dot() 54 0 1.491e-05 0.0001193 0.00% AmrMesh-cluster 1 0 1.417e-05 0.0001134 0.00% OwnerMask() 15 8.922e-05 9.889e-05 0.0001091 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 5.747e-05 8.653e-05 9.952e-05 0.00% Castro::volProductSum() 2 8.532e-05 8.896e-05 9.691e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.521e-05 7.206e-05 8.281e-05 0.00% FabArray::LinComb() 27 0 1.019e-05 8.15e-05 0.00% FabArray::Saxpy() 27 0 9.991e-06 7.993e-05 0.00% ClusterList::intersect() 1 0 8.647e-06 6.918e-05 0.00% Amr::writeSmallPlotFile() 1 2.975e-05 3.387e-05 5.956e-05 0.00% makeSFC 42 4.249e-05 4.814e-05 5.548e-05 0.00% BoxList::parallelComplementIn() 30 2.089e-05 2.471e-05 3.683e-05 0.00% Amr::initSubcycle() 1 9.022e-06 1.213e-05 2.624e-05 0.00% DistributionMapping::Distribute() 46 2.207e-05 2.289e-05 2.428e-05 0.00% FabArray::RecvLayoutMask() 14 1.618e-05 1.686e-05 1.789e-05 0.00% BoxList::complementIn 30 1.011e-05 1.222e-05 1.756e-05 0.00% ClusterList::chop() 1 0 2.179e-06 1.744e-05 0.00% Castro::enforce_speed_limit() 33 1.126e-05 1.262e-05 1.36e-05 0.00% knapsack() 2 1.067e-05 1.187e-05 1.296e-05 0.00% Castro::apply_problem_tags() 15 6.029e-06 6.625e-06 7.232e-06 0.00% Gravity::set_mass_offset() 1 8.92e-07 2.434e-06 4.903e-06 0.00% Castro::gwstrain() 2 9.26e-07 1.271e-06 1.606e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 23 B 48 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.05-12-g1a96800dc229) finalized