MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.08-22-g346a4d1c915f) initialized Starting run at 07:07:45 UTC on 2023-08-08. Successfully read inputs file ... Castro git describe: 23.08 AMReX git describe: 23.08-22-g346a4d1c9 Microphysics git describe: 23.08-3-g3d2714f8 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.00287488 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.112514594 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001896331 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001929562 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001094581 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001088501 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001082467 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001060363 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001096475 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001124287 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001108527 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001093306 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001118067 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001081572 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001070332 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.235569209 seconds Ending run at 07:07:52 UTC on 2023-08-08. Run time = 6.559864194 Run time without initialization = 0.000276452 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.56 ... 6.56 ... 6.56 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.4281 1.4281 1.4281 21.77% Gravity::fill_multipole_BCs() 14 1.125 1.14 1.154 17.59% Castro::post_init() 2 0.9726 0.9735 0.9748 14.86% Castro::computeTemp() 36 0.6903 0.7363 0.8017 12.22% Castro::reset_internal_energy(Fab) 654 0.3861 0.4179 0.4605 7.02% FabArray::ParallelCopy_finish() 2952 0.06386 0.2627 0.3883 5.92% MLPoisson::Fsmooth() 5088 0.2293 0.2386 0.2537 3.87% Castro::normalize_species() 33 0.1644 0.173 0.1851 2.82% Castro::initData() 3 0.1159 0.1291 0.1502 2.29% AmrLevel::derive() 97 0.1388 0.1399 0.1414 2.16% amrex::Copy() 975 0.1323 0.133 0.1344 2.05% Castro::initMFs() 16 0.09897 0.1088 0.1249 1.90% FillBoundary_finish() 5552 0.0475 0.0667 0.08153 1.24% StateData::define() 64 0.05676 0.06225 0.07167 1.09% amrex::average_down 844 0.04289 0.04658 0.05036 0.77% FabArray::setVal() 1769 0.04253 0.04595 0.0483 0.74% FillBoundary_nowait() 5552 0.03905 0.04188 0.04694 0.72% MLCellLinOp::applyBC() 6294 0.033 0.03486 0.03797 0.58% VisMF::Write(FabArray) 2 0.0314 0.03191 0.03434 0.52% FabArray::ParallelCopy_nowait() 2952 0.02289 0.02576 0.03221 0.49% MLPoisson::Fapply() 1040 0.02339 0.0246 0.02611 0.40% Castro::estTimeStep() 1 0.02214 0.02343 0.02495 0.38% MLMG::addInterpCorrection() 530 0.01906 0.01933 0.01998 0.30% Amr::regrid() 14 0.01419 0.01624 0.01943 0.30% FillPatchIterator::Initialize 215 0.01636 0.01688 0.01764 0.27% MLCellLinOp::reflux() 138 0.01645 0.01683 0.01711 0.26% Castro::buildMetrics() 16 0.01235 0.01361 0.01557 0.24% FabArray::Xpay() 1013 0.01206 0.01276 0.01359 0.21% MultiFab::Multiply() 287 0.01264 0.01292 0.01309 0.20% MLCellLinOp::updateSolBC() 120 0.01053 0.01156 0.01219 0.19% FillPatchInterp(MF) 44 0.001923 0.007324 0.01199 0.18% amrex::Add() 575 0.01065 0.01122 0.01178 0.18% MLPoisson::FFlux() 3408 0.01103 0.01122 0.01144 0.17% Castro::Castro() 16 0.008773 0.009626 0.01131 0.17% MLCellLinOp::updateCorBC() 106 0.009543 0.01045 0.01115 0.17% Amr::writePlotFile() 1 0.005517 0.007916 0.008409 0.13% MLMG::interpCorrection_1 106 0.006299 0.006946 0.007759 0.12% AmrMesh::MakeNewGrids() 15 0.006157 0.006278 0.006424 0.10% Castro::apply_tagging_restrictions() 15 0.005497 0.005922 0.006312 0.10% MLMG::prepareForSolve() 14 0.004787 0.004919 0.005052 0.08% FabArray::norminf(mask) 46 0.004735 0.004761 0.004788 0.07% MLMG::ResNormInf() 152 0.003126 0.003888 0.004537 0.07% MLCellLinOp::defineAuxData() 14 0.003856 0.003919 0.004116 0.06% FabArray::norminf() 174 0.002974 0.003332 0.00374 0.06% FabArrayBase::getCPC() 3662 0.003365 0.003452 0.003542 0.05% MLCellLinOp::compGrad() 28 0.003193 0.003251 0.003383 0.05% MultiFab::max() 54 0.002837 0.003154 0.003373 0.05% MLLinOp::makeSubCommunicator() 14 0.0006902 0.001971 0.003368 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002668 0.002923 0.003218 0.05% Castro::enforce_min_density() 33 0.002699 0.00284 0.00303 0.05% BndryData::define() 42 0.002256 0.002337 0.00245 0.04% Gravity::get_new_grav_vector() 4 0.0019 0.002099 0.002419 0.04% FabArray::FillBoundary() 5552 0.001904 0.001981 0.002155 0.03% Gravity::actual_solve_with_mlmg() 14 0.001883 0.001949 0.002127 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0003665 0.001355 0.002082 0.03% MLCellLinOp::defineBC() 14 0.001833 0.001944 0.002023 0.03% FabArrayBase::CPC::define() 624 0.001547 0.001698 0.001934 0.03% MLCellLinOp::smooth() 2544 0.001642 0.001716 0.001818 0.03% Castro::volWgtSum() 46 0.001655 0.001705 0.00174 0.03% FabArray::mult() 34 0.001149 0.00129 0.001553 0.02% MLCGSolver::bicgstab 13 0 0.0001861 0.001488 0.02% FillPatchTwoLevels 126 0.0006976 0.001113 0.001342 0.02% StateData::FillBoundary(geom) 8 0.001198 0.001256 0.001342 0.02% FabArray::ParallelCopy() 2952 0.001198 0.001256 0.00134 0.02% Castro::enforce_consistent_e() 3 0.001001 0.001131 0.001314 0.02% average_down_faces 84 0.001044 0.001131 0.00123 0.02% FabArrayBase::getFB() 5552 0.0009416 0.0009876 0.001097 0.02% AMRErrorTag::operator() 15 0.0009373 0.0009574 0.0009916 0.02% Gravity::actual_multilevel_solve() 14 0.000778 0.0008629 0.0009552 0.01% Castro::sum_integrated_quantities() 1 0.00057 0.0007459 0.0008942 0.01% Castro::build_fine_mask() 55 0.0007227 0.0007837 0.0008869 0.01% TagBoxArray::collate() 15 0.0002723 0.0004325 0.0007772 0.01% MLCellLinOp::apply() 1040 0.0004354 0.000468 0.0006187 0.01% AmrLevel::FillPatch() 215 0.0004964 0.0005091 0.0005244 0.01% MLMG::solve() 14 0.0003957 0.0004388 0.0005166 0.01% Amr::grid_places() 15 0.0003319 0.0003801 0.0005053 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004622 0.0004842 0.0005023 0.01% MLMG::mgVcycle() 318 0.0003956 0.0004375 0.0004826 0.01% main() 1 0.000366 0.0003962 0.0004617 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002761 0.0003493 0.0004447 0.01% MLCellLinOp::correctionResidual() 755 0.0003732 0.0003919 0.0004444 0.01% MLCellLinOp::prepareForSolve() 14 0.0003495 0.0003721 0.0004307 0.01% FabArray::setDomainBndry() 259 0.0003807 0.0004038 0.0004238 0.01% MLLinOp::defineGrids() 14 0.0002544 0.0003016 0.0003769 0.01% MLCellLinOp::setLevelBC() 28 0.0003177 0.0003418 0.0003681 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002819 0.0002904 0.0003145 0.00% MLMG::oneIter() 106 0.0002676 0.0002767 0.0003001 0.00% MLMG::MLResNormInf() 32 0.0001609 0.000198 0.0002733 0.00% MLMG::mgVcycle_bottom 318 0.0002296 0.0002424 0.0002722 0.00% MLMG::actualBottomSolve() 106 2.248e-05 5.682e-05 0.0002693 0.00% MLCGSolver::ParallelAllReduce 81 0 3.036e-05 0.0002429 0.00% OwnerMask() 15 8.868e-05 0.0001243 0.0002231 0.00% Castro::locWgtSum() 6 0.0001846 0.0001989 0.0002143 0.00% AmrLevel::AmrLevel(dm) 16 0.0001329 0.0001665 0.0001957 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001565 0.000172 0.0001947 0.00% MLCellLinOp::solutionResidual() 258 0.0001747 0.0001852 0.0001922 0.00% MLMG:computeResOfCorrection() 530 0.0001557 0.0001634 0.0001781 0.00% MLMG::mgVcycle_down::0 106 0.0001352 0.0001487 0.0001695 0.00% StateDataPhysBCFunct::() 259 0.0001453 0.0001511 0.0001586 0.00% FillPatchSingleLevel 259 0.0001361 0.0001446 0.0001534 0.00% MLMG::miniCycle() 212 8.845e-05 0.0001091 0.0001466 0.00% FabArrayBase::FB::FB() 35 7.53e-05 8.727e-05 0.0001438 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001096 0.0001197 0.0001335 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001174 0.000125 0.0001324 0.00% Gravity::update_max_rhs() 1 8.659e-05 9.928e-05 0.00013 0.00% MLMG::mgVcycle_down::1 106 0.0001076 0.0001158 0.0001206 0.00% amrex::Dot() 54 0 1.474e-05 0.0001179 0.00% TagBoxArray::mapPRD 15 9.134e-05 0.0001015 0.0001166 0.00% FPinfo::FPinfo() 9 7.227e-05 8.781e-05 0.0001163 0.00% Amr::FinalizeInit() 1 7.214e-06 2.572e-05 0.000116 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.097e-05 8.779e-05 0.0001021 0.00% Castro::volProductSum() 2 8.219e-05 8.673e-05 9.582e-05 0.00% MLMG::mgVcycle_down::3 106 7.566e-05 8.21e-05 9.153e-05 0.00% MLMG::mgVcycle_down::4 106 6.807e-05 7.288e-05 8.827e-05 0.00% MLMG::mgVcycle_down::2 106 8.169e-05 8.409e-05 8.567e-05 0.00% Castro::post_regrid() 30 5.692e-05 6.857e-05 8.543e-05 0.00% FabArray::LinComb() 27 0 1.049e-05 8.394e-05 0.00% FabArray::Saxpy() 27 0 1.032e-05 8.258e-05 0.00% Castro::clean_state() 33 6.067e-05 6.949e-05 8.037e-05 0.00% Castro::avgDown(state_indx) 60 6.691e-05 7.323e-05 7.858e-05 0.00% MLMG::mgVcycle_up::0 106 6.538e-05 6.913e-05 7.744e-05 0.00% FabArrayBase::TheFPinfo() 49 6.072e-05 6.77e-05 7.634e-05 0.00% MLMG::mgVcycle_up::4 106 6.498e-05 6.955e-05 7.576e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.642e-05 6.758e-05 7.539e-05 0.00% Castro::derive() 97 6.251e-05 6.604e-05 7.108e-05 0.00% MLMG::mgVcycle_up::1 106 5.759e-05 6.136e-05 6.959e-05 0.00% Castro::errorEst() 15 4.574e-05 5.209e-05 6.885e-05 0.00% MLMG::mgVcycle_up::2 106 5.563e-05 5.863e-05 6.775e-05 0.00% MLMG::mgVcycle_up::3 106 5.637e-05 5.797e-05 6.29e-05 0.00% ClusterList::intersect() 1 0 7.657e-06 6.125e-05 0.00% MLMG::computeResidual() 106 5.465e-05 5.799e-05 6.058e-05 0.00% Castro::init(old) 13 4.4e-05 4.798e-05 5.512e-05 0.00% amrex::average_down_w_geom 60 3.941e-05 4.273e-05 5.029e-05 0.00% Amr::bldFineLevels() 1 1.453e-05 2.753e-05 4.853e-05 0.00% MLPoisson::define() 14 3.742e-05 4.259e-05 4.811e-05 0.00% BoxList::complementIn 30 9.861e-06 1.598e-05 4.632e-05 0.00% makeSFC 42 2.633e-05 3.384e-05 4.441e-05 0.00% Castro::avgDown() 15 3.56e-05 3.856e-05 4.253e-05 0.00% MLMG::computeMLResidual() 32 3.577e-05 3.703e-05 3.962e-05 0.00% Amr::writeSmallPlotFile() 1 2.903e-05 2.994e-05 3.125e-05 0.00% BoxList::parallelComplementIn() 30 1.011e-05 1.321e-05 2.866e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.093e-05 2.415e-05 2.856e-05 0.00% FabArray::RecvLayoutMask() 14 1.638e-05 1.815e-05 2.778e-05 0.00% AmrMesh-cluster 1 0 3.409e-06 2.727e-05 0.00% DistributionMapping::Distribute() 46 1.92e-05 2.211e-05 2.696e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.556e-05 2.16e-05 2.318e-05 0.00% Amr::defBaseLevel() 1 1.399e-05 1.751e-05 2.131e-05 0.00% MLLinOp::define() 14 1.604e-05 1.829e-05 1.99e-05 0.00% MLMG::getGradSolution() 14 1.579e-05 1.754e-05 1.901e-05 0.00% ClusterList::chop() 1 0 1.835e-06 1.468e-05 0.00% MLPoisson::prepareForSolve() 14 1.211e-05 1.315e-05 1.462e-05 0.00% Castro::enforce_speed_limit() 33 1.043e-05 1.166e-05 1.368e-05 0.00% knapsack() 2 1.027e-05 1.158e-05 1.288e-05 0.00% Amr::initSubcycle() 1 8.622e-06 9.91e-06 1.104e-05 0.00% Amr::initialInit() 1 9.95e-07 2.638e-06 9.422e-06 0.00% MLMG::MLRhsNormInf() 14 8.1e-06 8.48e-06 9.315e-06 0.00% Castro::apply_problem_tags() 15 7.84e-06 8.35e-06 8.81e-06 0.00% DistributionMapping::KnapSackDoIt() 2 3.712e-06 4.464e-06 5.788e-06 0.00% Gravity::set_mass_offset() 1 9.11e-07 4.087e-06 5.449e-06 0.00% Amr::InitializeInit() 1 1.839e-06 2.594e-06 4.994e-06 0.00% Castro::computeInitialDt() 1 1.83e-06 2.295e-06 2.981e-06 0.00% Amr::init() 1 1.731e-06 2.101e-06 2.294e-06 0.00% Castro::gwstrain() 2 1.11e-06 1.401e-06 1.799e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.56 6.56 6.56 100.00% Amr::init() 1 5.131 5.131 5.131 78.22% Amr::initialInit() 1 4.895 4.895 4.896 74.63% Amr::FinalizeInit() 1 4.785 4.786 4.788 72.99% Castro::post_init() 2 3.554 3.667 3.737 56.96% Gravity::multilevel_solve_for_new_phi() 14 1.771 1.785 1.798 27.40% Gravity::actual_multilevel_solve() 14 1.768 1.782 1.795 27.36% Gravity::solve_phi_with_mlmg() 14 1.762 1.775 1.789 27.26% Amr::InitAmr() 1 1.428 1.428 1.428 21.77% Castro::computeTemp() 36 1.077 1.154 1.258 19.18% Amr::regrid() 14 1.185 1.21 1.225 18.67% Castro::clean_state() 33 1.042 1.106 1.187 18.09% Gravity::fill_multipole_BCs() 14 1.127 1.142 1.156 17.62% Amr::bldFineLevels() 1 0.8897 0.9443 1.035 15.78% Castro::post_regrid() 30 0.8018 0.8376 0.8753 13.34% Castro::initData() 3 0.5722 0.6359 0.74 11.28% Gravity::actual_solve_with_mlmg() 14 0.6318 0.6332 0.6347 9.68% MLMG::solve() 14 0.6136 0.6141 0.6143 9.36% MLMG::oneIter() 106 0.5423 0.543 0.5435 8.29% Castro::reset_internal_energy(MultiFab) 36 0.3864 0.4182 0.461 7.03% Castro::reset_internal_energy(Fab) 654 0.3861 0.4179 0.4605 7.02% FabArray::ParallelCopy() 2952 0.124 0.3168 0.4413 6.73% MLMG::mgVcycle() 318 0.4079 0.4091 0.4112 6.27% FabArray::ParallelCopy_finish() 2952 0.06386 0.2627 0.3883 5.92% MLCellLinOp::smooth() 2544 0.3405 0.3421 0.3492 5.32% amrex::average_down 844 0.07511 0.1903 0.2612 3.98% MLPoisson::Fsmooth() 5088 0.2293 0.2386 0.2537 3.87% Amr::writePlotFile() 1 0.2357 0.2359 0.2359 3.60% Castro::avgDown() 15 0.04567 0.1602 0.2301 3.51% Castro::avgDown(state_indx) 60 0.04563 0.1601 0.23 3.51% amrex::average_down_w_geom 60 0.04555 0.16 0.2299 3.51% Castro::derive() 97 0.1968 0.1969 0.1971 3.00% AmrLevel::derive() 97 0.1967 0.1968 0.197 3.00% Castro::normalize_species() 33 0.1644 0.173 0.1851 2.82% Castro::Castro() 16 0.1387 0.1522 0.1716 2.62% MLCellLinOp::applyBC() 6294 0.1358 0.1465 0.1579 2.41% amrex::Copy() 975 0.1323 0.133 0.1344 2.05% Amr::grid_places() 15 0.0201 0.08685 0.1297 1.98% AmrMesh::MakeNewGrids() 15 0.01969 0.08647 0.1294 1.97% Castro::initMFs() 16 0.09897 0.1088 0.1249 1.90% FabArray::FillBoundary() 5552 0.09784 0.1116 0.1243 1.89% AmrLevel::FillPatch() 215 0.1153 0.1174 0.119 1.81% MLMG::mgVcycle_bottom 318 0.1123 0.1138 0.1186 1.81% MLMG::miniCycle() 212 0.1125 0.1134 0.115 1.75% TagBoxArray::mapPRD 15 0.002898 0.06988 0.113 1.72% MLMG::mgVcycle_down::0 106 0.1113 0.1118 0.1124 1.71% Amr::InitializeInit() 1 0.1075 0.109 0.1103 1.68% Amr::defBaseLevel() 1 0.1075 0.109 0.1103 1.68% MLMG::mgVcycle_up::0 106 0.1051 0.1054 0.1057 1.61% FillPatchIterator::Initialize 215 0.08943 0.09196 0.09414 1.44% FillBoundary_finish() 5552 0.0475 0.0667 0.08153 1.24% MLMG::computeResWithCrseSolFineCor() 106 0.07131 0.07336 0.07465 1.14% AmrLevel::AmrLevel(dm) 16 0.05695 0.06241 0.0718 1.09% StateData::define() 64 0.05676 0.06225 0.07167 1.09% MLCellLinOp::apply() 1040 0.05903 0.0604 0.06223 0.95% MLCellLinOp::correctionResidual() 755 0.05713 0.05805 0.05933 0.90% FabArray::ParallelCopy_nowait() 2952 0.05018 0.05288 0.05881 0.90% FillPatchSingleLevel 259 0.05206 0.05494 0.05702 0.87% MLCellLinOp::solutionResidual() 258 0.0531 0.05532 0.05662 0.86% FillPatchIterator::FillFromTwoLevels() 126 0.04674 0.04907 0.05199 0.79% FillPatchTwoLevels 126 0.04661 0.04894 0.05187 0.79% MLCellLinOp::reflux() 138 0.04628 0.04809 0.04874 0.74% Castro::init(old) 13 0.04435 0.04609 0.04869 0.74% FabArray::setVal() 1769 0.04253 0.04595 0.0483 0.74% FillBoundary_nowait() 5552 0.04013 0.04296 0.04818 0.73% VisMF::Write(FabArray) 2 0.0314 0.03191 0.03434 0.52% MLMG::addInterpCorrection() 530 0.02144 0.0314 0.03309 0.50% MLMG::computeResWithCrseCorFineCor() 106 0.03154 0.03225 0.0328 0.50% MLMG::computeResidual() 106 0.027 0.02811 0.02854 0.44% FillPatchIterator::FillFromLevel0() 89 0.02463 0.02566 0.02705 0.41% MLPoisson::Fapply() 1040 0.02339 0.0246 0.02611 0.40% Castro::computeInitialDt() 1 0.02214 0.02343 0.02495 0.38% Castro::estTimeStep() 1 0.02214 0.02343 0.02495 0.38% MLMG::mgVcycle_down::1 106 0.02252 0.02305 0.02323 0.35% MLCellLinOp::updateSolBC() 120 0.01987 0.02034 0.02105 0.32% MLMG::mgVcycle_up::2 106 0.008814 0.0194 0.02097 0.32% MLMG::mgVcycle_up::1 106 0.02057 0.0207 0.0208 0.32% MLMG::computeMLResidual() 32 0.01983 0.02042 0.02079 0.32% Gravity::get_new_grav_vector() 4 0.01886 0.01972 0.02037 0.31% MLCellLinOp::updateCorBC() 106 0.01869 0.01936 0.0201 0.31% MLMG:computeResOfCorrection() 530 0.01769 0.01807 0.01844 0.28% Castro::buildMetrics() 16 0.01375 0.01515 0.01718 0.26% MLPoisson::define() 14 0.01105 0.01236 0.01373 0.21% FabArray::Xpay() 1013 0.01206 0.01276 0.01359 0.21% MultiFab::Multiply() 287 0.01264 0.01292 0.01309 0.20% FillPatchInterp(MF) 44 0.001923 0.007324 0.01199 0.18% amrex::Add() 575 0.01065 0.01122 0.01178 0.18% MLMG::interpCorrection_1 106 0.00968 0.01056 0.0115 0.18% MLPoisson::FFlux() 3408 0.01103 0.01122 0.01144 0.17% MLMG::ResNormInf() 152 0.009642 0.01017 0.01079 0.16% MLMG::prepareForSolve() 14 0.009657 0.009901 0.01019 0.16% Castro::errorEst() 15 0.009145 0.009634 0.01008 0.15% MLMG::mgVcycle_down::2 106 0.00886 0.009082 0.009691 0.15% Castro::apply_tagging_restrictions() 15 0.005497 0.005922 0.006312 0.10% FabArrayBase::getCPC() 3662 0.004965 0.00515 0.00538 0.08% MLCellLinOp::defineAuxData() 14 0.004913 0.004987 0.00531 0.08% Castro::sum_integrated_quantities() 1 0.004966 0.004992 0.005075 0.08% MLCellLinOp::defineBC() 14 0.004848 0.004963 0.005055 0.08% FabArray::norminf(mask) 46 0.004735 0.004761 0.004788 0.07% MLMG::getGradSolution() 14 0.004408 0.004491 0.004618 0.07% MLCellLinOp::compGrad() 28 0.004389 0.004474 0.004602 0.07% MLMG::mgVcycle_down::3 106 0.001248 0.001724 0.004469 0.07% MLMG::MLResNormInf() 32 0.003751 0.003808 0.003908 0.06% MLLinOp::define() 14 0.001046 0.002366 0.003859 0.06% MLLinOp::defineGrids() 14 0.001029 0.002347 0.003839 0.06% MLMG::actualBottomSolve() 106 2.248e-05 0.0004919 0.00375 0.06% FabArray::norminf() 174 0.002974 0.003332 0.00374 0.06% MLMG::mgVcycle_up::3 106 0.000927 0.001268 0.003621 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003289 0.003437 0.003529 0.05% MLCGSolver::bicgstab 13 0 0.0004287 0.003429 0.05% MultiFab::max() 54 0.002837 0.003154 0.003373 0.05% MLLinOp::makeSubCommunicator() 14 0.0006902 0.001971 0.003368 0.05% Castro::enforce_min_density() 33 0.002699 0.00284 0.00303 0.05% BndryData::define() 42 0.002794 0.002891 0.003012 0.05% MLMG::mgVcycle_down::4 106 0.001121 0.001304 0.002418 0.04% FabArrayBase::TheFPinfo() 49 0.0004969 0.001486 0.002235 0.03% FPinfo::FPinfo() 9 0.0004315 0.001418 0.002163 0.03% average_down_faces 84 0.001883 0.002042 0.002143 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0003665 0.001355 0.002082 0.03% FabArrayBase::CPC::define() 624 0.001547 0.001698 0.001934 0.03% MLMG::mgVcycle_up::4 106 0.001108 0.001217 0.001926 0.03% MLMG::MLRhsNormInf() 14 0.001764 0.001806 0.001829 0.03% Castro::volWgtSum() 46 0.001659 0.00171 0.001745 0.03% FabArray::mult() 34 0.001149 0.00129 0.001553 0.02% StateDataPhysBCFunct::() 259 0.001348 0.001408 0.001493 0.02% StateData::FillBoundary(geom) 8 0.001198 0.001256 0.001342 0.02% Castro::enforce_consistent_e() 3 0.001001 0.001131 0.001314 0.02% FabArrayBase::getFB() 5552 0.001018 0.001075 0.00124 0.02% Gravity::update_max_rhs() 1 0.0006119 0.000902 0.001066 0.02% AMRErrorTag::operator() 15 0.0009373 0.0009574 0.0009916 0.02% Castro::build_fine_mask() 55 0.0007227 0.0007837 0.0008869 0.01% DistributionMapping::KnapSackDoIt() 2 4.218e-05 0.0004297 0.0008161 0.01% TagBoxArray::collate() 15 0.0002723 0.0004325 0.0007772 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004622 0.0004842 0.0005023 0.01% MLPoisson::prepareForSolve() 14 0.0003625 0.0003852 0.0004428 0.01% MLCellLinOp::prepareForSolve() 14 0.0003495 0.0003721 0.0004307 0.01% FabArray::setDomainBndry() 259 0.0003807 0.0004038 0.0004238 0.01% MLCellLinOp::setLevelBC() 28 0.0003177 0.0003418 0.0003681 0.01% MLCGSolver::ParallelAllReduce 81 0 3.907e-05 0.0003126 0.00% OwnerMask() 15 8.868e-05 0.0001243 0.0002231 0.00% Castro::locWgtSum() 6 0.0001851 0.0001994 0.0002149 0.00% FabArrayBase::FB::FB() 35 7.53e-05 8.727e-05 0.0001438 0.00% amrex::Dot() 54 0 1.474e-05 0.0001179 0.00% AmrMesh-cluster 1 0 1.29e-05 0.0001032 0.00% Castro::volProductSum() 2 8.239e-05 8.694e-05 9.602e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.445e-05 7.451e-05 9.394e-05 0.00% FabArray::LinComb() 27 0 1.049e-05 8.394e-05 0.00% FabArray::Saxpy() 27 0 1.032e-05 8.258e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.601e-05 6.829e-05 7.996e-05 0.00% BoxList::parallelComplementIn() 30 2.025e-05 2.919e-05 7.498e-05 0.00% makeSFC 42 4.001e-05 5.036e-05 6.538e-05 0.00% ClusterList::intersect() 1 0 7.657e-06 6.125e-05 0.00% BoxList::complementIn 30 9.861e-06 1.598e-05 4.632e-05 0.00% Amr::writeSmallPlotFile() 1 2.903e-05 2.994e-05 3.125e-05 0.00% FabArray::RecvLayoutMask() 14 1.638e-05 1.815e-05 2.778e-05 0.00% DistributionMapping::Distribute() 46 1.92e-05 2.211e-05 2.696e-05 0.00% ClusterList::chop() 1 0 1.835e-06 1.468e-05 0.00% Castro::enforce_speed_limit() 33 1.043e-05 1.166e-05 1.368e-05 0.00% knapsack() 2 1.027e-05 1.158e-05 1.288e-05 0.00% Amr::initSubcycle() 1 8.622e-06 9.91e-06 1.104e-05 0.00% Castro::apply_problem_tags() 15 7.84e-06 8.35e-06 8.81e-06 0.00% Gravity::set_mass_offset() 1 9.11e-07 4.087e-06 5.449e-06 0.00% Castro::gwstrain() 2 1.11e-06 1.401e-06 1.799e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 16 B 19 B 24 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.08-22-g346a4d1c915f) finalized