MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.04-24-g27ef4ea56945) initialized Starting run at 18:59:41 UTC on 2023-04-13. Successfully read inputs file ... Castro git describe: 23.04-12-g099efffb3 AMReX git describe: 23.04-24-g27ef4ea56 Microphysics git describe: 23.04-4-gabda4ae3 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002722175 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.120437456 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001587538 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002382669 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001158397 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001140992 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001137166 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001162267 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001182594 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001192427 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001196749 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001144482 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001165428 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001121484 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001137569 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225826e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 2.373778793e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.284381237e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.577115472e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.233479531 seconds Ending run at 18:59:47 UTC on 2023-04-13. Run time = 6.498668127 Run time without initialization = 0.0002975309999 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.499 ... 6.499 ... 6.499 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.2811 1.2811 1.2811 19.71% Gravity::fill_multipole_BCs() 14 1.186 1.2 1.214 18.67% Castro::post_init() 2 0.9512 0.9525 0.9533 14.67% Castro::computeTemp() 36 0.6898 0.732 0.8 12.31% Castro::reset_internal_energy(Fab) 654 0.3867 0.4121 0.4586 7.06% FabArray::ParallelCopy_finish() 2952 0.05367 0.2711 0.3921 6.03% MLPoisson::Fsmooth() 5088 0.2368 0.2447 0.2569 3.95% Castro::normalize_species() 33 0.163 0.173 0.1865 2.87% Castro::initData() 3 0.1119 0.126 0.1487 2.29% Castro::derive() 97 0.1387 0.1399 0.142 2.19% amrex::Copy() 975 0.1308 0.1337 0.1367 2.10% Castro::initMFs() 16 0.09834 0.1092 0.1254 1.93% FillBoundary_finish() 5552 0.05104 0.06652 0.0783 1.20% StateData::define() 64 0.05639 0.06198 0.07146 1.10% amrex::average_down 844 0.04078 0.044 0.05088 0.78% FabArray::setVal() 1769 0.04369 0.0458 0.04894 0.75% FillBoundary_nowait() 5552 0.04053 0.04202 0.04555 0.70% Castro::sum_integrated_quantities() 1 0.04491 0.04504 0.04515 0.69% MLCellLinOp::applyBC() 6294 0.03496 0.03632 0.0399 0.61% VisMF::Write(FabArray) 2 0.029 0.02967 0.03165 0.49% FabArray::ParallelCopy_nowait() 2952 0.02328 0.02579 0.03154 0.49% MLPoisson::Fapply() 1040 0.02401 0.02525 0.02791 0.43% Castro::estTimeStep() 1 0.02209 0.02448 0.02671 0.41% Amr::regrid() 14 0.01414 0.0168 0.02101 0.32% MLCellLinOp::reflux() 138 0.01764 0.01824 0.01996 0.31% Castro::buildMetrics() 16 0.01226 0.01447 0.01842 0.28% FillPatchIterator::Initialize 215 0.01601 0.01714 0.01808 0.28% MLMG::addInterpCorrection() 530 0.01703 0.01723 0.01773 0.27% FabArray::Xpay() 1013 0.01215 0.01278 0.01367 0.21% MultiFab::Multiply() 287 0.01213 0.01291 0.01347 0.21% amrex::Add() 575 0.0106 0.01121 0.01225 0.19% MLCellLinOp::updateSolBC() 120 0.01055 0.01145 0.01204 0.19% Castro::Castro() 16 0.008699 0.009644 0.01144 0.18% MLPoisson::FFlux() 3408 0.0111 0.01123 0.01137 0.18% MLCellLinOp::updateCorBC() 106 0.009431 0.01033 0.01081 0.17% FillPatchInterp(MF) 44 0.001674 0.006534 0.009929 0.15% Amr::writePlotFile() 1 0.005614 0.007993 0.008534 0.13% AmrMesh::MakeNewGrids() 15 0.007489 0.007632 0.007744 0.12% MLMG::interpCorrection_1 106 0.006372 0.006937 0.007634 0.12% MLLinOp::makeSubCommunicator() 14 0.001326 0.004095 0.006292 0.10% Castro::apply_tagging_restrictions() 15 0.005742 0.005893 0.006143 0.09% MLMG::prepareForSolve() 14 0.004766 0.004908 0.005196 0.08% FabArray::norminf(mask) 46 0.004706 0.004726 0.004746 0.07% MLCellLinOp::defineAuxData() 14 0.003801 0.003902 0.004177 0.06% MLMG::ResNormInf() 152 0.002737 0.003554 0.004158 0.06% FabArray::norminf() 174 0.002935 0.003279 0.003711 0.06% FabArrayBase::getCPC() 3662 0.003376 0.003487 0.003621 0.06% MultiFab::max() 54 0.002849 0.00318 0.003499 0.05% MLCellLinOp::compGrad() 28 0.003159 0.003264 0.003354 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002777 0.003029 0.00335 0.05% MLCellLinOp::smooth() 2544 0.001659 0.001896 0.003128 0.05% Castro::enforce_min_density() 33 0.002452 0.002574 0.002735 0.04% Gravity::get_new_grav_vector() 4 0.001856 0.002094 0.002432 0.04% BndryData::define() 42 0.002229 0.002324 0.002383 0.04% MLCellLinOp::defineBC() 14 0.001809 0.001955 0.002291 0.04% FabArray::FillBoundary() 5552 0.001922 0.001991 0.002232 0.03% DistributionMapping::LeastUsedCPUs() 9 9.006e-05 0.001375 0.002201 0.03% Gravity::actual_solve_with_mlmg() 14 0.001871 0.001939 0.002162 0.03% FabArrayBase::CPC::define() 624 0.001577 0.001725 0.001974 0.03% Castro::volWgtSum() 46 0.0017 0.001747 0.001936 0.03% FabArray::mult() 34 0.0011 0.001303 0.001601 0.02% MLCGSolver::bicgstab 13 0 0.0001788 0.00143 0.02% FillPatchTwoLevels 126 0.0006491 0.001094 0.001403 0.02% Castro::enforce_consistent_e() 3 0.0009908 0.001155 0.001328 0.02% FabArray::ParallelCopy() 2952 0.001137 0.001183 0.001247 0.02% StateData::FillBoundary(geom) 8 0.001138 0.001167 0.00123 0.02% average_down_faces 84 0.001065 0.001131 0.001219 0.02% FabArrayBase::getFB() 5552 0.001028 0.001073 0.001188 0.02% AMRErrorTag::operator() 15 0.0009327 0.0009471 0.0009596 0.01% Gravity::actual_multilevel_solve() 14 0.0008069 0.0008842 0.0009466 0.01% Castro::build_fine_mask() 55 0.0006514 0.0007385 0.0008123 0.01% MLCellLinOp::apply() 1040 0.0004199 0.000459 0.0006026 0.01% MLMG::solve() 14 0.0004123 0.0004815 0.0005451 0.01% MLCGSolver::ParallelAllReduce 81 0 6.671e-05 0.0005337 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004562 0.0004776 0.0005149 0.01% MLCellLinOp::correctionResidual() 755 0.0003855 0.0004152 0.0005087 0.01% main() 1 0.0003756 0.0004399 0.0004842 0.01% Amr::grid_places() 15 0.0003302 0.0003688 0.0004758 0.01% MLMG::mgVcycle() 318 0.0003916 0.000416 0.0004628 0.01% MLCellLinOp::prepareForSolve() 14 0.0003401 0.0003705 0.0004503 0.01% FabArray::setDomainBndry() 259 0.0003674 0.0004063 0.0004342 0.01% TagBoxArray::collate() 15 0.0002255 0.0002964 0.0004103 0.01% MLLinOp::defineGrids() 14 0.0002571 0.0003156 0.0003694 0.01% MLCellLinOp::setLevelBC() 28 0.0003305 0.0003476 0.0003637 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002474 0.0002796 0.0003411 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002703 0.0002914 0.000324 0.00% MLMG::MLResNormInf() 32 0.000127 0.0002196 0.0002853 0.00% MLMG::oneIter() 106 0.0002608 0.0002714 0.0002817 0.00% MLMG::actualBottomSolve() 106 2.174e-05 5.382e-05 0.000263 0.00% MLMG::mgVcycle_bottom 318 0.0002028 0.0002245 0.0002431 0.00% MLCellLinOp::solutionResidual() 258 0.0001874 0.0001975 0.0002081 0.00% Castro::locWgtSum() 6 0.0001845 0.0001866 0.0001887 0.00% FillPatchSingleLevel 259 0.0001547 0.0001653 0.0001812 0.00% MLMG:computeResOfCorrection() 530 0.0001466 0.0001591 0.0001775 0.00% Castro::init(old) 13 0.0001547 0.0001651 0.0001775 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001498 0.0001569 0.0001711 0.00% StateDataPhysBCFunct::() 259 0.0001402 0.0001492 0.0001556 0.00% AmrLevel::AmrLevel(dm) 16 0.0001348 0.0001415 0.0001498 0.00% MLMG::mgVcycle_down::0 106 0.0001275 0.000133 0.0001381 0.00% FabArrayBase::FB::FB() 35 7.71e-05 8.889e-05 0.0001343 0.00% amrex::Dot() 54 0 1.485e-05 0.0001188 0.00% MLMG::miniCycle() 212 8.168e-05 9.266e-05 0.000117 0.00% MLMG::mgVcycle_down::1 106 0.0001047 0.0001117 0.0001164 0.00% Amr::FinalizeInit() 1 6.47e-06 2.148e-05 0.0001156 0.00% Gravity::update_max_rhs() 1 7.565e-05 9.287e-05 0.0001096 0.00% OwnerMask() 15 8.803e-05 9.817e-05 0.0001084 0.00% FPinfo::FPinfo() 9 7.887e-05 9.113e-05 0.0001078 0.00% MLMG::mgVcycle_down::4 106 6.834e-05 7.471e-05 0.0001042 0.00% TagBoxArray::mapPRD 15 9.028e-05 9.521e-05 0.0001017 0.00% Castro::volProductSum() 2 8.349e-05 9.053e-05 9.966e-05 0.00% Castro::post_regrid() 30 6.013e-05 7.694e-05 9.624e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.24e-05 8.575e-05 9.231e-05 0.00% MLMG::mgVcycle_down::3 106 7.406e-05 7.973e-05 8.653e-05 0.00% MLMG::mgVcycle_down::2 106 7.982e-05 8.334e-05 8.624e-05 0.00% FabArray::Saxpy() 27 0 1.013e-05 8.106e-05 0.00% FabArray::LinComb() 27 0 1.001e-05 8.009e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.331e-05 6.787e-05 7.729e-05 0.00% MLMG::mgVcycle_up::4 106 6.225e-05 6.687e-05 7.61e-05 0.00% MLMG::mgVcycle_up::1 106 5.664e-05 6.488e-05 7.555e-05 0.00% FabArrayBase::TheFPinfo() 49 6.139e-05 6.628e-05 7.385e-05 0.00% Castro::clean_state() 33 5.924e-05 6.495e-05 7.194e-05 0.00% Castro::avgDown(state_indx) 60 5.48e-05 6.268e-05 7.18e-05 0.00% MLMG::mgVcycle_up::0 106 6.427e-05 6.733e-05 7.152e-05 0.00% amrex::average_down_w_geom 60 4.905e-05 5.574e-05 7.014e-05 0.00% ClusterList::intersect() 1 0 8.618e-06 6.894e-05 0.00% MLMG::computeResidual() 106 5.5e-05 5.933e-05 6.267e-05 0.00% Castro::avgDown() 15 3.438e-05 4.183e-05 6.222e-05 0.00% MLMG::mgVcycle_up::3 106 5.154e-05 5.481e-05 6.019e-05 0.00% Castro::errorEst() 15 4.527e-05 4.877e-05 5.773e-05 0.00% MLMG::mgVcycle_up::2 106 5.007e-05 5.282e-05 5.601e-05 0.00% Amr::writeSmallPlotFile() 1 2.905e-05 3.205e-05 5.05e-05 0.00% MLPoisson::define() 14 3.301e-05 3.779e-05 4.574e-05 0.00% MLMG::computeMLResidual() 32 3.619e-05 3.982e-05 4.317e-05 0.00% makeSFC 42 2.842e-05 3.327e-05 4.031e-05 0.00% Amr::defBaseLevel() 1 1.997e-05 2.873e-05 4.001e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.702e-05 2.405e-05 4.001e-05 0.00% Amr::bldFineLevels() 1 1.57e-05 2.159e-05 3.846e-05 0.00% Amr::initialInit() 1 1.202e-06 5.131e-06 3.115e-05 0.00% MLLinOp::define() 14 2.165e-05 2.488e-05 2.766e-05 0.00% DistributionMapping::Distribute() 46 2.187e-05 2.516e-05 2.744e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 1.986e-05 2.371e-05 2.693e-05 0.00% MLMG::getGradSolution() 14 1.718e-05 1.981e-05 2.634e-05 0.00% AmrMesh-cluster 1 0 3.14e-06 2.512e-05 0.00% Castro::apply_problem_tags() 15 5.939e-06 8.39e-06 2.249e-05 0.00% FabArray::RecvLayoutMask() 14 1.567e-05 1.692e-05 2.019e-05 0.00% ClusterList::chop() 1 0 2.188e-06 1.75e-05 0.00% BoxList::complementIn 30 9.84e-06 1.203e-05 1.461e-05 0.00% MLPoisson::prepareForSolve() 14 1.225e-05 1.313e-05 1.432e-05 0.00% BoxList::parallelComplementIn() 30 1.031e-05 1.156e-05 1.37e-05 0.00% Castro::enforce_speed_limit() 33 1.063e-05 1.178e-05 1.313e-05 0.00% knapsack() 2 1.064e-05 1.143e-05 1.233e-05 0.00% Amr::initSubcycle() 1 9.119e-06 9.741e-06 1.031e-05 0.00% MLMG::MLRhsNormInf() 14 7.755e-06 8.162e-06 9.059e-06 0.00% Amr::InitializeInit() 1 2.109e-06 3.144e-06 6.274e-06 0.00% Castro::gwstrain() 2 1.036e-06 1.781e-06 5.458e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.367e-06 4.769e-06 5.423e-06 0.00% Castro::computeInitialDt() 1 1.865e-06 2.377e-06 3.049e-06 0.00% Amr::init() 1 1.774e-06 2.063e-06 2.304e-06 0.00% Gravity::set_mass_offset() 1 8.93e-07 1.071e-06 1.401e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.499 6.499 6.499 100.00% Amr::init() 1 5.217 5.217 5.217 80.28% Amr::initialInit() 1 4.983 4.983 4.983 76.68% Amr::FinalizeInit() 1 4.875 4.877 4.879 75.08% Castro::post_init() 2 3.646 3.758 3.826 58.87% Gravity::multilevel_solve_for_new_phi() 14 1.845 1.857 1.869 28.76% Gravity::actual_multilevel_solve() 14 1.842 1.854 1.866 28.71% Gravity::solve_phi_with_mlmg() 14 1.836 1.848 1.86 28.62% Amr::InitAmr() 1 1.281 1.281 1.281 19.71% Castro::computeTemp() 36 1.078 1.144 1.259 19.37% Amr::regrid() 14 1.196 1.217 1.236 19.02% Gravity::fill_multipole_BCs() 14 1.188 1.202 1.215 18.70% Castro::clean_state() 33 1.042 1.097 1.186 18.25% Amr::bldFineLevels() 1 0.89 0.9445 1.034 15.91% Castro::post_regrid() 30 0.8024 0.8328 0.8761 13.48% Castro::initData() 3 0.5598 0.6265 0.7353 11.31% Gravity::actual_solve_with_mlmg() 14 0.6429 0.6456 0.6479 9.97% MLMG::solve() 14 0.6234 0.6244 0.6246 9.61% MLMG::oneIter() 106 0.5529 0.5534 0.5539 8.52% Castro::reset_internal_energy(MultiFab) 36 0.387 0.4124 0.4589 7.06% Castro::reset_internal_energy(Fab) 654 0.3867 0.4121 0.4586 7.06% FabArray::ParallelCopy() 2952 0.1136 0.3257 0.4458 6.86% MLMG::mgVcycle() 318 0.4164 0.4177 0.4197 6.46% FabArray::ParallelCopy_finish() 2952 0.05367 0.2711 0.3921 6.03% MLCellLinOp::smooth() 2544 0.3476 0.3501 0.3571 5.49% MLPoisson::Fsmooth() 5088 0.2368 0.2447 0.2569 3.95% amrex::average_down 844 0.07422 0.1876 0.2546 3.92% Amr::writePlotFile() 1 0.2336 0.2338 0.2338 3.60% Castro::avgDown() 15 0.04487 0.1575 0.2243 3.45% Castro::avgDown(state_indx) 60 0.04481 0.1574 0.2243 3.45% amrex::average_down_w_geom 60 0.04474 0.1574 0.2242 3.45% Castro::derive() 97 0.1967 0.197 0.1973 3.04% Castro::normalize_species() 33 0.163 0.173 0.1865 2.87% Castro::Castro() 16 0.1404 0.1537 0.1768 2.72% MLCellLinOp::applyBC() 6294 0.14 0.148 0.157 2.42% Amr::grid_places() 15 0.01997 0.09299 0.1384 2.13% AmrMesh::MakeNewGrids() 15 0.01949 0.09262 0.1381 2.12% amrex::Copy() 975 0.1308 0.1337 0.1367 2.10% Castro::initMFs() 16 0.09834 0.1092 0.1254 1.93% FabArray::FillBoundary() 5552 0.1001 0.1117 0.1221 1.88% MLMG::mgVcycle_bottom 318 0.1148 0.1166 0.1214 1.87% TagBoxArray::mapPRD 15 0.001441 0.0748 0.1202 1.85% MLMG::mgVcycle_down::0 106 0.1166 0.1174 0.1185 1.82% MLMG::miniCycle() 212 0.115 0.1162 0.1176 1.81% Amr::InitializeInit() 1 0.104 0.1062 0.1087 1.67% Amr::defBaseLevel() 1 0.104 0.1062 0.1086 1.67% MLMG::mgVcycle_up::0 106 0.1048 0.1051 0.1053 1.62% FillPatchIterator::Initialize 215 0.08833 0.09201 0.09483 1.46% FillBoundary_finish() 5552 0.05104 0.06652 0.0783 1.20% MLMG::computeResWithCrseSolFineCor() 106 0.07417 0.07593 0.07752 1.19% AmrLevel::AmrLevel(dm) 16 0.05654 0.06213 0.0716 1.10% StateData::define() 64 0.05639 0.06198 0.07146 1.10% MLCellLinOp::apply() 1040 0.05862 0.06093 0.06264 0.96% MLCellLinOp::correctionResidual() 755 0.05907 0.05994 0.06183 0.95% FillPatchSingleLevel 259 0.05041 0.05565 0.06033 0.93% FabArray::ParallelCopy_nowait() 2952 0.05107 0.05344 0.05865 0.90% MLCellLinOp::solutionResidual() 258 0.05416 0.05515 0.05658 0.87% MLCellLinOp::reflux() 138 0.04928 0.05077 0.05202 0.80% FillPatchTwoLevels 126 0.04491 0.04882 0.05188 0.80% Castro::init(old) 13 0.04486 0.04742 0.05006 0.77% Castro::sum_integrated_quantities() 1 0.04934 0.04936 0.04942 0.76% FabArray::setVal() 1769 0.04369 0.0458 0.04894 0.75% FillBoundary_nowait() 5552 0.04169 0.04318 0.04687 0.72% MLMG::computeResWithCrseCorFineCor() 106 0.03193 0.0327 0.03436 0.53% VisMF::Write(FabArray) 2 0.029 0.02967 0.03165 0.49% MLMG::addInterpCorrection() 530 0.01926 0.02976 0.03148 0.48% MLMG::computeResidual() 106 0.02654 0.02756 0.02801 0.43% MLPoisson::Fapply() 1040 0.02401 0.02525 0.02791 0.43% Castro::computeInitialDt() 1 0.02209 0.02448 0.02672 0.41% Castro::estTimeStep() 1 0.02209 0.02448 0.02671 0.41% MLMG::mgVcycle_down::1 106 0.02294 0.0234 0.02379 0.37% MLMG::computeMLResidual() 32 0.02018 0.02117 0.02167 0.33% MLMG::mgVcycle_up::2 106 0.008795 0.0199 0.02154 0.33% MLCellLinOp::updateSolBC() 120 0.01946 0.02058 0.02142 0.33% MLCellLinOp::updateCorBC() 106 0.01923 0.02025 0.02097 0.32% MLMG::mgVcycle_up::1 106 0.02035 0.02042 0.02049 0.32% Castro::buildMetrics() 16 0.01372 0.01631 0.02019 0.31% Gravity::get_new_grav_vector() 4 0.01779 0.0182 0.01893 0.29% MLMG:computeResOfCorrection() 530 0.01791 0.01814 0.01841 0.28% MLPoisson::define() 14 0.01165 0.01447 0.01651 0.25% FabArray::Xpay() 1013 0.01215 0.01278 0.01367 0.21% MultiFab::Multiply() 287 0.01213 0.01291 0.01347 0.21% amrex::Add() 575 0.0106 0.01121 0.01225 0.19% MLPoisson::FFlux() 3408 0.0111 0.01123 0.01137 0.18% MLMG::interpCorrection_1 106 0.009759 0.01055 0.01133 0.17% MLMG::prepareForSolve() 14 0.009713 0.009993 0.01056 0.16% MLMG::ResNormInf() 152 0.009276 0.009792 0.01035 0.16% Castro::errorEst() 15 0.009447 0.009644 0.009981 0.15% FillPatchInterp(MF) 44 0.001674 0.006534 0.009929 0.15% MLMG::mgVcycle_down::2 106 0.008808 0.008993 0.009651 0.15% MLLinOp::define() 14 0.001701 0.004512 0.006747 0.10% MLLinOp::defineGrids() 14 0.001678 0.004487 0.006723 0.10% MLLinOp::makeSubCommunicator() 14 0.001326 0.004095 0.006292 0.10% Castro::apply_tagging_restrictions() 15 0.005742 0.005893 0.006143 0.09% FabArrayBase::getCPC() 3662 0.004953 0.005212 0.005549 0.09% MLCellLinOp::defineAuxData() 14 0.004831 0.004961 0.005389 0.08% MLCellLinOp::defineBC() 14 0.004741 0.004958 0.005369 0.08% FabArray::norminf(mask) 46 0.004706 0.004726 0.004746 0.07% MLMG::getGradSolution() 14 0.004452 0.004526 0.004628 0.07% MLCellLinOp::compGrad() 28 0.004434 0.004506 0.004609 0.07% MLMG::mgVcycle_down::3 106 0.001269 0.001721 0.004592 0.07% MLMG::actualBottomSolve() 106 2.174e-05 0.000519 0.003985 0.06% MLMG::MLResNormInf() 32 0.003757 0.003826 0.003906 0.06% FabArray::norminf() 174 0.002935 0.003279 0.003711 0.06% MLMG::mgVcycle_up::3 106 0.0008873 0.001263 0.003702 0.06% MLCGSolver::bicgstab 13 0 0.0004587 0.00367 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003215 0.003406 0.003543 0.05% MultiFab::max() 54 0.002849 0.00318 0.003499 0.05% BndryData::define() 42 0.002771 0.002877 0.002935 0.05% Castro::enforce_min_density() 33 0.002452 0.002574 0.002735 0.04% MLMG::mgVcycle_down::4 106 0.001122 0.001307 0.002358 0.04% FabArrayBase::TheFPinfo() 49 0.0002268 0.001493 0.002315 0.04% FPinfo::FPinfo() 9 0.0001619 0.001426 0.002249 0.03% average_down_faces 84 0.001854 0.002064 0.002209 0.03% DistributionMapping::LeastUsedCPUs() 9 9.006e-05 0.001375 0.002201 0.03% FabArrayBase::CPC::define() 624 0.001577 0.001725 0.001974 0.03% Castro::volWgtSum() 46 0.001705 0.001752 0.001943 0.03% MLMG::mgVcycle_up::4 106 0.001067 0.001205 0.001938 0.03% MLMG::MLRhsNormInf() 14 0.001736 0.001762 0.001786 0.03% FabArray::mult() 34 0.0011 0.001303 0.001601 0.02% StateDataPhysBCFunct::() 259 0.001292 0.001316 0.001377 0.02% Castro::enforce_consistent_e() 3 0.0009908 0.001155 0.001328 0.02% FabArrayBase::getFB() 5552 0.001108 0.001162 0.001323 0.02% StateData::FillBoundary(geom) 8 0.001138 0.001167 0.00123 0.02% Gravity::update_max_rhs() 1 0.000617 0.0008882 0.001055 0.02% AMRErrorTag::operator() 15 0.0009327 0.0009471 0.0009596 0.01% Castro::build_fine_mask() 55 0.0006514 0.0007385 0.0008123 0.01% DistributionMapping::KnapSackDoIt() 2 4.178e-05 0.0003196 0.0007051 0.01% MLCGSolver::ParallelAllReduce 81 0 7.514e-05 0.0006011 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004562 0.0004776 0.0005149 0.01% MLPoisson::prepareForSolve() 14 0.0003527 0.0003836 0.0004634 0.01% MLCellLinOp::prepareForSolve() 14 0.0003401 0.0003705 0.0004503 0.01% FabArray::setDomainBndry() 259 0.0003674 0.0004063 0.0004342 0.01% TagBoxArray::collate() 15 0.0002255 0.0002964 0.0004103 0.01% MLCellLinOp::setLevelBC() 28 0.0003305 0.0003476 0.0003637 0.01% Castro::locWgtSum() 6 0.0001851 0.0001871 0.0001893 0.00% FabArrayBase::FB::FB() 35 7.71e-05 8.889e-05 0.0001343 0.00% amrex::Dot() 54 0 1.485e-05 0.0001188 0.00% AmrMesh-cluster 1 0 1.395e-05 0.0001116 0.00% OwnerMask() 15 8.803e-05 9.817e-05 0.0001084 0.00% Castro::volProductSum() 2 8.372e-05 9.074e-05 9.989e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 5.905e-05 8.6e-05 9.966e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.469e-05 7.642e-05 8.47e-05 0.00% FabArray::Saxpy() 27 0 1.013e-05 8.106e-05 0.00% FabArray::LinComb() 27 0 1.001e-05 8.009e-05 0.00% ClusterList::intersect() 1 0 8.618e-06 6.894e-05 0.00% makeSFC 42 4.483e-05 5.271e-05 6.006e-05 0.00% Amr::writeSmallPlotFile() 1 2.905e-05 3.205e-05 5.05e-05 0.00% BoxList::parallelComplementIn() 30 2.029e-05 2.358e-05 2.776e-05 0.00% DistributionMapping::Distribute() 46 2.187e-05 2.516e-05 2.744e-05 0.00% Castro::apply_problem_tags() 15 5.939e-06 8.39e-06 2.249e-05 0.00% FabArray::RecvLayoutMask() 14 1.567e-05 1.692e-05 2.019e-05 0.00% ClusterList::chop() 1 0 2.188e-06 1.75e-05 0.00% BoxList::complementIn 30 9.84e-06 1.203e-05 1.461e-05 0.00% Castro::enforce_speed_limit() 33 1.063e-05 1.178e-05 1.313e-05 0.00% knapsack() 2 1.064e-05 1.143e-05 1.233e-05 0.00% Amr::initSubcycle() 1 9.119e-06 9.741e-06 1.031e-05 0.00% Castro::gwstrain() 2 1.036e-06 1.781e-06 5.458e-06 0.00% Gravity::set_mass_offset() 1 8.93e-07 1.071e-06 1.401e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 18 B 21 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.04-24-g27ef4ea56945) finalized