MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.10-13-gecaa14456e3f) initialized Starting run at 07:09:57 UTC on 2023-10-12. Successfully read inputs file ... Castro git describe: 23.10-34-gd2ace11ff AMReX git describe: 23.10-13-gecaa14456 Microphysics git describe: 23.10-6-g657406dc reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002690697 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.11699023 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001445335 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002099609 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.006113401 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001093601 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001073355 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001103631 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.0010692 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001070472 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001158494 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001080489 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00108983 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001137497 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001085239 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.256287621 seconds Ending run at 07:10:04 UTC on 2023-10-12. Run time = 6.474284637 Run time without initialization = 0.000372847 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.474 ... 6.474 ... 6.474 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2233 1.2233 1.2233 18.89% Gravity::fill_multipole_BCs() 14 1.127 1.138 1.149 17.74% Castro::post_init() 2 1.014 1.02 1.023 15.80% Castro::computeTemp() 36 0.6936 0.7397 0.8093 12.50% Castro::reset_internal_energy(Fab) 654 0.3945 0.4214 0.4624 7.14% FabArray::ParallelCopy_finish() 2952 0.1136 0.3034 0.4373 6.76% MLPoisson::Fsmooth() 5088 0.2362 0.2481 0.2611 4.03% Castro::normalize_species() 33 0.1662 0.1739 0.1862 2.88% Castro::initData() 3 0.1142 0.1298 0.1543 2.38% AmrLevel::derive() 97 0.1393 0.1425 0.1497 2.31% amrex::Copy() 975 0.1284 0.1312 0.1357 2.10% Castro::initMFs() 16 0.08913 0.1005 0.1134 1.75% FillBoundary_finish() 5552 0.06517 0.0858 0.1046 1.62% StateData::define() 64 0.05089 0.05748 0.06449 1.00% FabArray::setVal() 1769 0.04232 0.0457 0.04919 0.76% amrex::average_down 844 0.04283 0.04647 0.04901 0.76% FillBoundary_nowait() 5552 0.03993 0.04206 0.04404 0.68% MLCellLinOp::applyBC() 6294 0.03351 0.03649 0.03856 0.60% FabArray::ParallelCopy_nowait() 2952 0.02311 0.02647 0.03146 0.49% VisMF::Write(FabArray) 2 0.02744 0.02824 0.03104 0.48% FillPatchIterator::Initialize 215 0.01557 0.01892 0.02848 0.44% Castro::estTimeStep() 1 0.02198 0.02434 0.0266 0.41% MLPoisson::Fapply() 1040 0.02377 0.02502 0.02618 0.40% Amr::writePlotFile() 1 0.005256 0.01163 0.02561 0.40% MLMG::addInterpCorrection() 530 0.01925 0.0198 0.02058 0.32% MLCellLinOp::reflux() 138 0.01766 0.01826 0.01899 0.29% Castro::buildMetrics() 16 0.01121 0.01247 0.0141 0.22% FabArray::Xpay() 1013 0.01196 0.01305 0.01359 0.21% Amr::regrid() 14 0.009198 0.011 0.01328 0.21% MLCellLinOp::updateSolBC() 120 0.01054 0.0117 0.01273 0.20% MultiFab::Multiply() 287 0.009891 0.0117 0.01267 0.20% amrex::Add() 575 0.01066 0.01146 0.01222 0.19% MLPoisson::FFlux() 3408 0.01136 0.01159 0.01185 0.18% MLCellLinOp::updateCorBC() 106 0.009449 0.01057 0.0117 0.18% FillPatchInterp(MF) 44 0.002007 0.007322 0.01089 0.17% Castro::Castro() 16 0.008014 0.008885 0.01013 0.16% DistributionMapping::LeastUsedCPUs() 9 0.00178 0.00733 0.009858 0.15% MLMG::interpCorrection_1 106 0.006325 0.007015 0.007563 0.12% MLMG::prepareForSolve() 14 0.004745 0.00536 0.006956 0.11% AmrMesh::MakeNewGrids() 15 0.006229 0.006315 0.006415 0.10% Castro::apply_tagging_restrictions() 15 0.005423 0.005824 0.006095 0.09% FabArray::norminf(mask) 46 0.004765 0.004792 0.004818 0.07% Gravity::multilevel_solve_for_new_phi() 14 0.002682 0.003308 0.004782 0.07% MLMG::ResNormInf() 152 0.003332 0.003952 0.004682 0.07% MLCellLinOp::defineAuxData() 14 0.003922 0.004062 0.004312 0.07% MLLinOp::makeSubCommunicator() 14 0.0007044 0.00251 0.004174 0.06% Castro::enforce_min_density() 33 0.003335 0.003525 0.003774 0.06% FabArrayBase::getCPC() 3662 0.003458 0.003566 0.003713 0.06% FabArray::norminf() 174 0.002939 0.003219 0.00362 0.06% MLCellLinOp::compGrad() 28 0.003234 0.003342 0.003483 0.05% MultiFab::max() 54 0.002744 0.003138 0.00345 0.05% BndryData::define() 42 0.002466 0.002611 0.002831 0.04% Gravity::get_new_grav_vector() 4 0.001735 0.002062 0.002457 0.04% FabArray::FillBoundary() 5552 0.001976 0.002114 0.00224 0.03% Gravity::actual_solve_with_mlmg() 14 0.001889 0.001992 0.002218 0.03% MLCellLinOp::defineBC() 14 0.001792 0.001934 0.002048 0.03% FabArrayBase::CPC::define() 624 0.001594 0.001724 0.001946 0.03% MLCellLinOp::smooth() 2544 0.001659 0.00176 0.001888 0.03% FabArray::mult() 34 0.001179 0.001376 0.001776 0.03% Castro::volWgtSum() 46 0.001662 0.001699 0.001739 0.03% FillPatchTwoLevels 126 0.0006723 0.001201 0.001599 0.02% MLCGSolver::bicgstab 13 0 0.0001877 0.001501 0.02% Castro::enforce_consistent_e() 3 0.0009269 0.001112 0.00137 0.02% StateData::FillBoundary(geom) 8 0.001238 0.001278 0.001313 0.02% FabArray::ParallelCopy() 2952 0.001202 0.001242 0.001291 0.02% average_down_faces 84 0.0009997 0.001101 0.001192 0.02% FabArrayBase::getFB() 5552 0.0009455 0.001021 0.001121 0.02% Gravity::actual_multilevel_solve() 14 0.0007677 0.0008858 0.001035 0.02% AMRErrorTag::operator() 15 0.0009127 0.0009322 0.000946 0.01% Castro::build_fine_mask() 55 0.0006175 0.0007269 0.0008758 0.01% Castro::sum_integrated_quantities() 1 0.0004869 0.0006782 0.0007937 0.01% MLMG::solve() 14 0.0004633 0.0004999 0.0005884 0.01% MLCellLinOp::apply() 1040 0.0004356 0.0004691 0.0005862 0.01% AmrLevel::FillPatch() 215 0.0004841 0.0005106 0.0005464 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004702 0.0004857 0.0005084 0.01% main() 1 0.0003405 0.0004092 0.0005067 0.01% TagBoxArray::collate() 15 0.0002388 0.0003128 0.0005017 0.01% MLMG::mgVcycle() 318 0.0004263 0.0004507 0.0004892 0.01% MLCellLinOp::correctionResidual() 755 0.0003928 0.0004237 0.0004716 0.01% FabArray::setDomainBndry() 259 0.0003719 0.0004037 0.0004341 0.01% MLCellLinOp::prepareForSolve() 14 0.0003506 0.0003815 0.0004317 0.01% Amr::grid_places() 15 0.0002849 0.0003324 0.0004295 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002929 0.0003378 0.0003907 0.01% MLCellLinOp::setLevelBC() 28 0.0003295 0.0003459 0.0003594 0.01% MLMG::oneIter() 106 0.0002694 0.0002845 0.0003319 0.01% MLLinOp::defineGrids() 14 0.0002478 0.0002899 0.0003276 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002776 0.0002863 0.0002962 0.00% MLMG::MLResNormInf() 32 0.0001585 0.0002111 0.0002801 0.00% MLMG::mgVcycle_bottom 318 0.0002116 0.0002322 0.0002617 0.00% MLMG::actualBottomSolve() 106 2.405e-05 5.427e-05 0.0002528 0.00% MLCGSolver::ParallelAllReduce 81 0 2.873e-05 0.0002298 0.00% Castro::locWgtSum() 6 0.0001846 0.0001961 0.0002182 0.00% MLCellLinOp::solutionResidual() 258 0.0001782 0.000192 0.0002117 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001608 0.0001767 0.0001905 0.00% MLMG:computeResOfCorrection() 530 0.0001641 0.0001738 0.0001841 0.00% AmrLevel::AmrLevel(dm) 16 0.0001361 0.0001539 0.0001723 0.00% StateDataPhysBCFunct::() 259 0.0001415 0.0001492 0.0001656 0.00% MLMG::mgVcycle_down::0 106 0.0001347 0.0001476 0.0001641 0.00% FillPatchSingleLevel 259 0.0001345 0.0001425 0.0001481 0.00% MLMG::mgVcycle_down::1 106 0.0001105 0.0001208 0.0001385 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001088 0.000123 0.0001372 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001175 0.0001263 0.000137 0.00% amrex::Dot() 54 0 1.698e-05 0.0001359 0.00% FabArrayBase::FB::FB() 35 7.67e-05 8.889e-05 0.0001339 0.00% Gravity::update_max_rhs() 1 7.994e-05 0.0001033 0.0001177 0.00% OwnerMask() 15 8.813e-05 9.88e-05 0.0001117 0.00% FabArray::Saxpy() 27 0 1.335e-05 0.0001068 0.00% MLMG::miniCycle() 212 8.273e-05 9.246e-05 0.0001057 0.00% FPinfo::FPinfo() 9 7.148e-05 8.055e-05 0.0001029 0.00% TagBoxArray::mapPRD 15 8.974e-05 9.275e-05 0.0001015 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.292e-05 8.817e-05 0.0001013 0.00% Castro::post_regrid() 30 5.941e-05 7.237e-05 9.59e-05 0.00% MLMG::mgVcycle_down::3 106 7.671e-05 8.679e-05 9.429e-05 0.00% MLMG::mgVcycle_down::2 106 8.144e-05 8.743e-05 9.39e-05 0.00% Castro::volProductSum() 2 8.193e-05 8.608e-05 9.174e-05 0.00% MLMG::mgVcycle_down::4 106 7.245e-05 7.732e-05 8.989e-05 0.00% Castro::derive() 97 6.362e-05 7.375e-05 8.886e-05 0.00% Castro::avgDown(state_indx) 60 6.275e-05 7.176e-05 8.734e-05 0.00% MLMG::mgVcycle_up::0 106 6.886e-05 7.489e-05 8.44e-05 0.00% FabArrayBase::TheFPinfo() 49 6.089e-05 6.82e-05 7.74e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.352e-05 6.945e-05 7.709e-05 0.00% Amr::FinalizeInit() 1 7.337e-06 2.251e-05 7.545e-05 0.00% FabArray::LinComb() 27 0 9.202e-06 7.362e-05 0.00% MLMG::mgVcycle_up::2 106 5.435e-05 6.009e-05 7.32e-05 0.00% Castro::clean_state() 33 6.121e-05 6.628e-05 7.202e-05 0.00% MLMG::mgVcycle_up::4 106 6.266e-05 6.637e-05 7.199e-05 0.00% MLMG::mgVcycle_up::1 106 6.26e-05 6.616e-05 7.119e-05 0.00% Castro::errorEst() 15 4.627e-05 5.528e-05 7.106e-05 0.00% amrex::average_down_w_geom 60 3.789e-05 4.465e-05 6.634e-05 0.00% MLMG::mgVcycle_up::3 106 5.439e-05 5.785e-05 6.358e-05 0.00% MLMG::computeResidual() 106 5.306e-05 5.87e-05 6.313e-05 0.00% ClusterList::intersect() 1 0 6.888e-06 5.51e-05 0.00% Amr::defBaseLevel() 1 2.702e-05 3.836e-05 5.441e-05 0.00% Castro::init(old) 13 4.271e-05 4.667e-05 5.124e-05 0.00% makeSFC 42 2.987e-05 3.631e-05 4.755e-05 0.00% MLPoisson::define() 14 3.793e-05 4.21e-05 4.691e-05 0.00% Castro::avgDown() 15 3.443e-05 3.912e-05 4.39e-05 0.00% MLMG::computeMLResidual() 32 3.746e-05 3.963e-05 4.286e-05 0.00% Amr::writeSmallPlotFile() 1 3.103e-05 3.174e-05 3.288e-05 0.00% DistributionMapping::Distribute() 46 2.062e-05 2.311e-05 2.805e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.023e-05 2.273e-05 2.569e-05 0.00% AmrMesh-cluster 1 0 3.199e-06 2.559e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.452e-05 1.96e-05 2.459e-05 0.00% Amr::bldFineLevels() 1 1.378e-05 1.663e-05 2.456e-05 0.00% Amr::initialInit() 1 1.139e-06 5.863e-06 2.272e-05 0.00% MLLinOp::define() 14 1.398e-05 1.814e-05 2.248e-05 0.00% MLMG::getGradSolution() 14 1.726e-05 1.821e-05 1.922e-05 0.00% BoxList::parallelComplementIn() 30 1.113e-05 1.286e-05 1.887e-05 0.00% Castro::enforce_speed_limit() 33 1.087e-05 1.307e-05 1.856e-05 0.00% FabArray::RecvLayoutMask() 14 1.607e-05 1.664e-05 1.719e-05 0.00% ClusterList::chop() 1 0 2.116e-06 1.692e-05 0.00% BoxList::complementIn 30 1.102e-05 1.228e-05 1.545e-05 0.00% MLPoisson::prepareForSolve() 14 1.021e-05 1.202e-05 1.343e-05 0.00% knapsack() 2 1.045e-05 1.169e-05 1.251e-05 0.00% Amr::initSubcycle() 1 9.067e-06 1.022e-05 1.059e-05 0.00% Castro::apply_problem_tags() 15 7.92e-06 8.767e-06 1.014e-05 0.00% MLMG::MLRhsNormInf() 14 8.491e-06 8.611e-06 8.785e-06 0.00% Amr::init() 1 1.586e-06 2.74e-06 7.775e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.145e-06 4.694e-06 5.593e-06 0.00% Amr::InitializeInit() 1 2.18e-06 2.712e-06 4.246e-06 0.00% Gravity::set_mass_offset() 1 7.75e-07 1.98e-06 3.764e-06 0.00% Castro::computeInitialDt() 1 1.672e-06 1.939e-06 2.232e-06 0.00% Castro::gwstrain() 2 9.15e-07 1.239e-06 1.486e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.474 6.474 6.474 100.00% Amr::init() 1 5.25 5.25 5.25 81.10% Amr::initialInit() 1 4.994 4.994 4.994 77.14% Amr::FinalizeInit() 1 4.885 4.887 4.889 75.52% Castro::post_init() 2 3.664 3.775 3.854 59.52% Gravity::multilevel_solve_for_new_phi() 14 1.814 1.826 1.837 28.38% Gravity::actual_multilevel_solve() 14 1.809 1.822 1.834 28.33% Gravity::solve_phi_with_mlmg() 14 1.803 1.816 1.828 28.24% Castro::computeTemp() 36 1.09 1.161 1.27 19.62% Amr::regrid() 14 1.215 1.231 1.251 19.32% Amr::InitAmr() 1 1.223 1.223 1.223 18.89% Castro::clean_state() 33 1.056 1.11 1.193 18.43% Gravity::fill_multipole_BCs() 14 1.128 1.14 1.15 17.76% Amr::bldFineLevels() 1 0.8759 0.937 1.025 15.83% Castro::post_regrid() 30 0.813 0.8403 0.8795 13.58% Castro::initData() 3 0.5704 0.6418 0.7516 11.61% Gravity::actual_solve_with_mlmg() 14 0.6739 0.6756 0.6774 10.46% MLMG::solve() 14 0.655 0.6554 0.6557 10.13% MLMG::oneIter() 106 0.5786 0.5799 0.5811 8.98% FabArray::ParallelCopy() 2952 0.1713 0.3564 0.4881 7.54% Castro::reset_internal_energy(MultiFab) 36 0.3948 0.4217 0.4627 7.15% Castro::reset_internal_energy(Fab) 654 0.3945 0.4214 0.4624 7.14% MLMG::mgVcycle() 318 0.439 0.4408 0.4426 6.84% FabArray::ParallelCopy_finish() 2952 0.1136 0.3034 0.4373 6.76% MLCellLinOp::smooth() 2544 0.3662 0.3688 0.3749 5.79% amrex::average_down 844 0.07651 0.1894 0.2702 4.17% MLPoisson::Fsmooth() 5088 0.2362 0.2481 0.2611 4.03% Amr::writePlotFile() 1 0.2565 0.2566 0.2566 3.96% Castro::avgDown() 15 0.04459 0.1583 0.2386 3.68% Castro::avgDown(state_indx) 60 0.04456 0.1583 0.2385 3.68% amrex::average_down_w_geom 60 0.04449 0.1582 0.2385 3.68% Castro::derive() 97 0.2055 0.2181 0.2218 3.43% AmrLevel::derive() 97 0.2055 0.218 0.2217 3.42% Castro::normalize_species() 33 0.1662 0.1739 0.1862 2.88% MLCellLinOp::applyBC() 6294 0.1494 0.1676 0.1828 2.82% AmrLevel::FillPatch() 215 0.1204 0.1542 0.1661 2.57% Castro::Castro() 16 0.1283 0.1419 0.1586 2.45% FabArray::FillBoundary() 5552 0.1112 0.1311 0.1484 2.29% FillPatchIterator::Initialize 215 0.09791 0.13 0.1419 2.19% amrex::Copy() 975 0.1284 0.1312 0.1357 2.10% Amr::grid_places() 15 0.02417 0.09188 0.1344 2.08% AmrMesh::MakeNewGrids() 15 0.02385 0.09154 0.1341 2.07% MLMG::mgVcycle_bottom 318 0.1203 0.1219 0.1257 1.94% MLMG::mgVcycle_down::0 106 0.1221 0.1231 0.124 1.92% MLMG::miniCycle() 212 0.1204 0.1216 0.1229 1.90% TagBoxArray::mapPRD 15 0.006941 0.07496 0.1172 1.81% Castro::initMFs() 16 0.08913 0.1005 0.1134 1.75% MLMG::mgVcycle_up::0 106 0.1117 0.1124 0.1132 1.75% Amr::InitializeInit() 1 0.1044 0.1067 0.1091 1.68% Amr::defBaseLevel() 1 0.1044 0.1067 0.1091 1.68% FillBoundary_finish() 5552 0.06517 0.0858 0.1046 1.62% FillPatchSingleLevel 259 0.04876 0.07954 0.098 1.51% MLMG::computeResWithCrseSolFineCor() 106 0.07559 0.07676 0.07779 1.20% FillPatchIterator::FillFromTwoLevels() 126 0.05078 0.06585 0.07267 1.12% FillPatchTwoLevels 126 0.05064 0.06572 0.07254 1.12% Castro::init(old) 13 0.05142 0.06423 0.06947 1.07% MLCellLinOp::apply() 1040 0.06041 0.06431 0.0669 1.03% AmrLevel::AmrLevel(dm) 16 0.05104 0.05763 0.06463 1.00% StateData::define() 64 0.05089 0.05748 0.06449 1.00% MLCellLinOp::correctionResidual() 755 0.05943 0.06127 0.06266 0.97% MLCellLinOp::solutionResidual() 258 0.05724 0.05957 0.06173 0.95% FabArray::ParallelCopy_nowait() 2952 0.04904 0.05177 0.05643 0.87% FillPatchIterator::FillFromLevel0() 89 0.01967 0.04489 0.05414 0.84% MLCellLinOp::reflux() 138 0.04993 0.05154 0.05256 0.81% FabArray::setVal() 1769 0.04232 0.0457 0.04919 0.76% FillBoundary_nowait() 5552 0.04097 0.04317 0.04516 0.70% MLMG::computeResWithCrseCorFineCor() 106 0.03263 0.0333 0.034 0.53% MLMG::addInterpCorrection() 530 0.02143 0.0319 0.03389 0.52% VisMF::Write(FabArray) 2 0.02744 0.02824 0.03104 0.48% MLMG::computeResidual() 106 0.02864 0.02976 0.03076 0.48% Castro::computeInitialDt() 1 0.02198 0.02434 0.0266 0.41% Castro::estTimeStep() 1 0.02198 0.02434 0.0266 0.41% MLMG::mgVcycle_down::1 106 0.02501 0.02582 0.0265 0.41% MLPoisson::Fapply() 1040 0.02377 0.02502 0.02618 0.40% MLCellLinOp::updateSolBC() 120 0.02056 0.02299 0.02465 0.38% MLMG::computeMLResidual() 32 0.02108 0.02275 0.02351 0.36% MLMG::mgVcycle_up::1 106 0.02148 0.02164 0.0218 0.34% MLMG::mgVcycle_up::2 106 0.009001 0.01985 0.02168 0.33% Gravity::get_new_grav_vector() 4 0.01931 0.0202 0.02084 0.32% MLCellLinOp::updateCorBC() 106 0.01896 0.01994 0.02067 0.32% MLMG:computeResOfCorrection() 530 0.01884 0.0196 0.02002 0.31% Castro::buildMetrics() 16 0.01259 0.01403 0.01587 0.25% MLPoisson::define() 14 0.01174 0.01328 0.01484 0.23% FabArray::Xpay() 1013 0.01196 0.01305 0.01359 0.21% MLMG::interpCorrection_1 106 0.01061 0.01192 0.01303 0.20% MultiFab::Multiply() 287 0.009891 0.0117 0.01267 0.20% amrex::Add() 575 0.01066 0.01146 0.01222 0.19% MLPoisson::FFlux() 3408 0.01136 0.01159 0.01185 0.18% MLMG::prepareForSolve() 14 0.00952 0.01024 0.01174 0.18% FillPatchInterp(MF) 44 0.002007 0.007322 0.01089 0.17% MLMG::ResNormInf() 152 0.009688 0.01019 0.01081 0.17% MLMG::mgVcycle_down::2 106 0.009633 0.009853 0.0108 0.17% Castro::errorEst() 15 0.009279 0.00968 0.01033 0.16% FabArrayBase::TheFPinfo() 49 0.001906 0.007456 0.01001 0.15% FPinfo::FPinfo() 9 0.001834 0.007388 0.009937 0.15% DistributionMapping::LeastUsedCPUs() 9 0.00178 0.00733 0.009858 0.15% Castro::apply_tagging_restrictions() 15 0.005423 0.005824 0.006095 0.09% FabArrayBase::getCPC() 3662 0.0051 0.00529 0.005543 0.09% MLCellLinOp::defineBC() 14 0.00501 0.005242 0.005521 0.09% MLCellLinOp::defineAuxData() 14 0.004906 0.005097 0.005353 0.08% Castro::sum_integrated_quantities() 1 0.004921 0.004965 0.005049 0.08% FabArray::norminf(mask) 46 0.004765 0.004792 0.004818 0.07% MLMG::getGradSolution() 14 0.004591 0.00467 0.004743 0.07% MLCellLinOp::compGrad() 28 0.004573 0.004652 0.004724 0.07% MLLinOp::define() 14 0.001065 0.002895 0.004613 0.07% MLLinOp::defineGrids() 14 0.001049 0.002877 0.004594 0.07% MLMG::mgVcycle_down::3 106 0.001296 0.001798 0.004538 0.07% MLLinOp::makeSubCommunicator() 14 0.0007044 0.00251 0.004174 0.06% MLMG::MLResNormInf() 32 0.00382 0.003879 0.003956 0.06% Castro::enforce_min_density() 33 0.003335 0.003525 0.003774 0.06% MLMG::actualBottomSolve() 106 2.405e-05 0.0004929 0.003762 0.06% MLMG::mgVcycle_up::3 106 0.0009429 0.001311 0.00365 0.06% FabArray::norminf() 174 0.002939 0.003219 0.00362 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003247 0.00337 0.003553 0.05% MLCGSolver::bicgstab 13 0 0.0004322 0.003458 0.05% MultiFab::max() 54 0.002744 0.003138 0.00345 0.05% BndryData::define() 42 0.003034 0.003183 0.003434 0.05% MLMG::mgVcycle_down::4 106 0.00115 0.001372 0.002436 0.04% average_down_faces 84 0.001895 0.001991 0.002165 0.03% FabArrayBase::CPC::define() 624 0.001594 0.001724 0.001946 0.03% MLMG::mgVcycle_up::4 106 0.00111 0.001249 0.001943 0.03% MLMG::MLRhsNormInf() 14 0.001733 0.001772 0.001797 0.03% FabArray::mult() 34 0.001179 0.001376 0.001776 0.03% Castro::volWgtSum() 46 0.001667 0.001704 0.001745 0.03% StateDataPhysBCFunct::() 259 0.00139 0.001427 0.001458 0.02% Castro::enforce_consistent_e() 3 0.0009269 0.001112 0.00137 0.02% StateData::FillBoundary(geom) 8 0.001238 0.001278 0.001313 0.02% FabArrayBase::getFB() 5552 0.001023 0.00111 0.001255 0.02% Gravity::update_max_rhs() 1 0.0006182 0.0008807 0.001001 0.02% AMRErrorTag::operator() 15 0.0009127 0.0009322 0.000946 0.01% Castro::build_fine_mask() 55 0.0006175 0.0007269 0.0008758 0.01% DistributionMapping::KnapSackDoIt() 2 7.08e-05 0.000342 0.0006904 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004702 0.0004857 0.0005084 0.01% TagBoxArray::collate() 15 0.0002388 0.0003128 0.0005017 0.01% MLPoisson::prepareForSolve() 14 0.0003634 0.0003935 0.0004426 0.01% FabArray::setDomainBndry() 259 0.0003719 0.0004037 0.0004341 0.01% MLCellLinOp::prepareForSolve() 14 0.0003506 0.0003815 0.0004317 0.01% MLCellLinOp::setLevelBC() 28 0.0003295 0.0003459 0.0003594 0.01% MLCGSolver::ParallelAllReduce 81 0 3.915e-05 0.0003132 0.00% Castro::locWgtSum() 6 0.0001852 0.0001967 0.0002189 0.00% amrex::Dot() 54 0 1.698e-05 0.0001359 0.00% FabArrayBase::FB::FB() 35 7.67e-05 8.889e-05 0.0001339 0.00% OwnerMask() 15 8.813e-05 9.88e-05 0.0001117 0.00% FabArray::Saxpy() 27 0 1.335e-05 0.0001068 0.00% AmrMesh-cluster 1 0 1.22e-05 9.762e-05 0.00% Castro::volProductSum() 2 8.211e-05 8.631e-05 9.196e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.678e-05 7.668e-05 9.176e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.231e-05 6.414e-05 7.855e-05 0.00% FabArray::LinComb() 27 0 9.202e-06 7.362e-05 0.00% makeSFC 42 4.597e-05 5.395e-05 6.705e-05 0.00% ClusterList::intersect() 1 0 6.888e-06 5.51e-05 0.00% Amr::writeSmallPlotFile() 1 3.103e-05 3.174e-05 3.288e-05 0.00% BoxList::parallelComplementIn() 30 2.215e-05 2.515e-05 3.091e-05 0.00% DistributionMapping::Distribute() 46 2.062e-05 2.311e-05 2.805e-05 0.00% Castro::enforce_speed_limit() 33 1.087e-05 1.307e-05 1.856e-05 0.00% FabArray::RecvLayoutMask() 14 1.607e-05 1.664e-05 1.719e-05 0.00% ClusterList::chop() 1 0 2.116e-06 1.692e-05 0.00% BoxList::complementIn 30 1.102e-05 1.228e-05 1.545e-05 0.00% knapsack() 2 1.045e-05 1.169e-05 1.251e-05 0.00% Amr::initSubcycle() 1 9.067e-06 1.022e-05 1.059e-05 0.00% Castro::apply_problem_tags() 15 7.92e-06 8.767e-06 1.014e-05 0.00% Gravity::set_mass_offset() 1 7.75e-07 1.98e-06 3.764e-06 0.00% Castro::gwstrain() 2 9.15e-07 1.239e-06 1.486e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 20 B 28 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-13-gecaa14456e3f) finalized