MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.07-13-gb41f85ab36ac) initialized Starting run at 06:19:41 UTC on 2023-07-11. Successfully read inputs file ... Castro git describe: 23.07-14-g10cafd240 AMReX git describe: 23.07-13-gb41f85ab3 Microphysics git describe: 23.07-21-gffe836cf reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.003304904 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.155183439 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001567882 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001888325 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001165482 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001181955 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001147706 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001182041 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001386369 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001162986 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001244543 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001188469 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001187352 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001175612 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001232172 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.250787765 seconds Ending run at 06:19:51 UTC on 2023-07-11. Run time = 10.84389155 Run time without initialization = 0.0003424629999 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 10.84 ... 10.84 ... 10.84 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::initMFs() 16 4.1555 4.1735 4.1952 38.69% Gravity::fill_multipole_BCs() 14 1.149 1.16 1.178 10.86% Amr::InitAmr() 1 1.152 1.152 1.152 10.62% Castro::post_init() 2 1.093 1.095 1.098 10.13% Castro::computeTemp() 36 0.7138 0.7544 0.8242 7.60% FabArray::ParallelCopy_finish() 2952 0.1024 0.3877 0.6039 5.57% Castro::reset_internal_energy(Fab) 654 0.4023 0.433 0.4767 4.40% MLPoisson::Fsmooth() 5088 0.2483 0.2551 0.2672 2.46% Castro::normalize_species() 33 0.169 0.1803 0.1957 1.81% Castro::initData() 3 0.1152 0.1301 0.1541 1.42% AmrLevel::derive() 97 0.1395 0.1461 0.1505 1.39% amrex::Copy() 975 0.1365 0.1407 0.1446 1.33% FabArray::setVal() 1769 0.04858 0.09173 0.1302 1.20% FillBoundary_finish() 5552 0.06826 0.08847 0.09918 0.91% StateData::define() 64 0.05823 0.07261 0.09193 0.85% amrex::average_down 844 0.04619 0.05174 0.05916 0.55% FabArray::ParallelCopy_nowait() 2952 0.02476 0.03499 0.04745 0.44% FillBoundary_nowait() 5552 0.04135 0.04366 0.04648 0.43% MLCellLinOp::applyBC() 6294 0.03367 0.03652 0.03959 0.37% FillPatchIterator::Initialize 215 0.01591 0.02734 0.0378 0.35% Castro::estTimeStep() 1 0.02232 0.02881 0.03731 0.34% VisMF::Write(FabArray) 2 0.03029 0.03099 0.03347 0.31% MLPoisson::Fapply() 1040 0.02571 0.02683 0.02891 0.27% Amr::regrid() 14 0.01747 0.02041 0.02437 0.22% Castro::Castro() 16 0.009103 0.01662 0.02389 0.22% MLMG::addInterpCorrection() 530 0.01988 0.02041 0.02093 0.19% Castro::buildMetrics() 16 0.01246 0.01589 0.01987 0.18% MLCellLinOp::reflux() 138 0.01728 0.01803 0.01916 0.18% FabArray::Xpay() 1013 0.01247 0.01424 0.01592 0.15% MultiFab::Multiply() 287 0.01256 0.0142 0.01559 0.14% amrex::Add() 575 0.01147 0.01218 0.01325 0.12% Amr::writePlotFile() 1 0.007717 0.01043 0.01325 0.12% DistributionMapping::LeastUsedCPUs() 9 0.0006385 0.007193 0.01313 0.12% MLCellLinOp::updateSolBC() 120 0.01099 0.01195 0.01271 0.12% MLPoisson::FFlux() 3408 0.01125 0.01186 0.01267 0.12% MLCellLinOp::updateCorBC() 106 0.009841 0.0107 0.01136 0.10% FillPatchInterp(MF) 44 0.001754 0.006602 0.009819 0.09% MLMG::prepareForSolve() 14 0.005196 0.007308 0.009771 0.09% MultiFab::max() 54 0.003425 0.007166 0.00968 0.09% MLMG::interpCorrection_1 106 0.006495 0.007176 0.007938 0.07% AmrMesh::MakeNewGrids() 15 0.007518 0.007693 0.007838 0.07% Castro::apply_tagging_restrictions() 15 0.005619 0.005995 0.006348 0.06% Gravity::multilevel_solve_for_new_phi() 14 0.002948 0.004629 0.005934 0.05% FabArray::norminf(mask) 46 0.004857 0.005102 0.005288 0.05% MLMG::ResNormInf() 152 0.003077 0.004298 0.005285 0.05% MLCellLinOp::defineAuxData() 14 0.004083 0.004219 0.004356 0.04% MLLinOp::makeSubCommunicator() 14 0.001371 0.002791 0.004344 0.04% Gravity::get_new_grav_vector() 4 0.001822 0.002593 0.004292 0.04% FabArray::norminf() 174 0.003147 0.003471 0.004072 0.04% MLCellLinOp::compGrad() 28 0.003329 0.003651 0.0039 0.04% FabArrayBase::getCPC() 3662 0.003631 0.00377 0.003898 0.04% Castro::enforce_min_density() 33 0.002664 0.003011 0.003373 0.03% BndryData::define() 42 0.002365 0.002463 0.002593 0.02% Gravity::actual_solve_with_mlmg() 14 0.002112 0.002283 0.002539 0.02% FabArray::FillBoundary() 5552 0.002039 0.002172 0.002366 0.02% MLCellLinOp::defineBC() 14 0.001853 0.002011 0.0021 0.02% FabArrayBase::CPC::define() 624 0.001623 0.001768 0.002007 0.02% MLCellLinOp::smooth() 2544 0.001734 0.001816 0.001977 0.02% Castro::volWgtSum() 46 0.001624 0.001772 0.001831 0.02% Castro::enforce_consistent_e() 3 0.001081 0.001325 0.001671 0.02% MLCGSolver::bicgstab 13 0 0.0002034 0.001627 0.02% FabArray::mult() 34 0.001092 0.001284 0.001526 0.01% Castro::sum_integrated_quantities() 1 0.0006754 0.0009816 0.001523 0.01% FillPatchTwoLevels 126 0.0007068 0.001156 0.001424 0.01% FabArray::ParallelCopy() 2952 0.00125 0.001312 0.001374 0.01% StateData::FillBoundary(geom) 8 0.001209 0.001278 0.00133 0.01% average_down_faces 84 0.001112 0.001162 0.001267 0.01% FabArrayBase::getFB() 5552 0.0009991 0.001063 0.001191 0.01% Gravity::update_max_rhs() 1 8.763e-05 0.0002954 0.001169 0.01% AMRErrorTag::operator() 15 0.0009378 0.0009702 0.001016 0.01% Gravity::actual_multilevel_solve() 14 0.0008322 0.0009314 0.001005 0.01% Castro::build_fine_mask() 55 0.0007391 0.0008028 0.0008616 0.01% MLMG::solve() 14 0.000549 0.0006832 0.0008335 0.01% TagBoxArray::collate() 15 0.0002716 0.0003651 0.0007304 0.01% MLCellLinOp::apply() 1040 0.0004552 0.0005075 0.0006257 0.01% AmrLevel::FillPatch() 215 0.0004942 0.0005304 0.0005635 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004817 0.0005007 0.0005348 0.00% Amr::grid_places() 15 0.0003583 0.0003959 0.0005342 0.00% MLCellLinOp::prepareForSolve() 14 0.0003821 0.000437 0.0005126 0.00% main() 1 0.0003591 0.0004354 0.0005062 0.00% MLMG::mgVcycle() 318 0.0004358 0.0004599 0.0004931 0.00% MLCellLinOp::setLevelBC() 28 0.0003538 0.0004087 0.0004824 0.00% MLCellLinOp::correctionResidual() 755 0.0003923 0.0004282 0.0004733 0.00% MLMG::MLResNormInf() 32 0.0001726 0.0003488 0.0004727 0.00% FabArray::setDomainBndry() 259 0.0003829 0.0004045 0.0004271 0.00% MLLinOp::defineGrids() 14 0.0003034 0.0003353 0.0003759 0.00% MLMG::actualBottomSolve() 106 2.445e-05 6.738e-05 0.0003498 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0003069 0.0003238 0.0003477 0.00% Castro::reset_internal_energy(MultiFab) 36 0.0003057 0.0003175 0.0003447 0.00% MLCGSolver::ParallelAllReduce 81 0 4.198e-05 0.0003358 0.00% MLMG::oneIter() 106 0.0002715 0.0003062 0.0003356 0.00% MLMG::mgVcycle_bottom 318 0.0002432 0.0002591 0.0002708 0.00% Castro::locWgtSum() 6 0.0001824 0.0001995 0.000245 0.00% MLCellLinOp::solutionResidual() 258 0.0001915 0.000207 0.0002254 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001722 0.0001837 0.000194 0.00% MLMG:computeResOfCorrection() 530 0.000158 0.0001702 0.0001922 0.00% FillPatchSingleLevel 259 0.0001392 0.0001475 0.0001797 0.00% AmrLevel::AmrLevel(dm) 16 0.0001387 0.0001613 0.0001738 0.00% StateDataPhysBCFunct::() 259 0.0001484 0.0001564 0.0001668 0.00% MLMG::mgVcycle_down::0 106 0.0001323 0.0001417 0.000155 0.00% FabArrayBase::FB::FB() 35 7.723e-05 9.203e-05 0.0001456 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001199 0.0001269 0.0001421 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001109 0.0001261 0.0001388 0.00% MLMG::mgVcycle_down::1 106 0.0001137 0.0001231 0.0001375 0.00% amrex::Dot() 54 0 1.691e-05 0.0001353 0.00% MLMG::miniCycle() 212 9.344e-05 0.0001051 0.0001168 0.00% OwnerMask() 15 9.133e-05 0.0001027 0.0001144 0.00% Castro::volProductSum() 2 7.726e-05 9.378e-05 0.0001118 0.00% Gravity::solve_phi_with_mlmg() 14 6.99e-05 8.127e-05 0.0001098 0.00% TagBoxArray::mapPRD 15 9.851e-05 0.0001015 0.0001063 0.00% MLMG::mgVcycle_down::2 106 8.427e-05 9.254e-05 0.0001024 0.00% MLMG::mgVcycle_down::3 106 7.982e-05 8.825e-05 9.846e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.065e-05 8.594e-05 9.798e-05 0.00% Castro::post_regrid() 30 7.176e-05 7.937e-05 9.65e-05 0.00% FabArray::Saxpy() 27 0 1.187e-05 9.499e-05 0.00% FPinfo::FPinfo() 9 6.856e-05 7.642e-05 9.053e-05 0.00% Amr::FinalizeInit() 1 8.672e-06 2.5e-05 8.901e-05 0.00% Castro::avgDown(state_indx) 60 6.954e-05 7.613e-05 8.828e-05 0.00% FabArray::LinComb() 27 0 1.088e-05 8.708e-05 0.00% Castro::clean_state() 33 6.798e-05 7.348e-05 8.608e-05 0.00% Castro::derive() 97 6.246e-05 7.096e-05 8.517e-05 0.00% MLMG::mgVcycle_down::4 106 7.297e-05 7.715e-05 8.454e-05 0.00% FabArrayBase::TheFPinfo() 49 7.162e-05 7.71e-05 8.294e-05 0.00% MLMG::mgVcycle_up::4 106 6.588e-05 7.324e-05 7.808e-05 0.00% MLMG::mgVcycle_up::0 106 6.565e-05 7.14e-05 7.598e-05 0.00% MLPoisson::define() 14 3.778e-05 5.796e-05 7.529e-05 0.00% MLMG::mgVcycle_up::1 106 5.91e-05 6.773e-05 7.513e-05 0.00% MLMG::mgVcycle_up::3 106 5.685e-05 6.482e-05 7.239e-05 0.00% MLMG::computeResidual() 106 6.108e-05 6.705e-05 7.134e-05 0.00% MLMG::mgVcycle_up::2 106 5.684e-05 6.175e-05 6.585e-05 0.00% Castro::avgDown() 15 3.741e-05 5.265e-05 6.397e-05 0.00% ClusterList::intersect() 1 0 7.594e-06 6.075e-05 0.00% MLMG::computeMLResidual() 32 4.608e-05 5.036e-05 5.55e-05 0.00% amrex::average_down_w_geom 60 4.195e-05 4.73e-05 5.482e-05 0.00% Castro::init(old) 13 4.586e-05 4.853e-05 5.047e-05 0.00% Castro::errorEst() 15 4.295e-05 4.574e-05 5.014e-05 0.00% makeSFC 42 2.761e-05 3.531e-05 4.372e-05 0.00% Amr::bldFineLevels() 1 1.459e-05 2.018e-05 3.452e-05 0.00% MLLinOp::define() 14 1.604e-05 2.019e-05 3.366e-05 0.00% Amr::writeSmallPlotFile() 1 2.974e-05 3.086e-05 3.223e-05 0.00% AmrMesh-cluster 1 0 3.794e-06 3.035e-05 0.00% DistributionMapping::Distribute() 46 2.27e-05 2.676e-05 2.964e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.276e-05 2.593e-05 2.881e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.567e-05 2.162e-05 2.446e-05 0.00% FabArray::RecvLayoutMask() 14 1.702e-05 1.854e-05 2.428e-05 0.00% Amr::defBaseLevel() 1 1.558e-05 1.963e-05 2.411e-05 0.00% MLMG::getGradSolution() 14 1.905e-05 2.056e-05 2.292e-05 0.00% ClusterList::chop() 1 0 2.405e-06 1.924e-05 0.00% MLPoisson::prepareForSolve() 14 1.169e-05 1.422e-05 1.7e-05 0.00% Castro::enforce_speed_limit() 33 1.24e-05 1.33e-05 1.435e-05 0.00% BoxList::complementIn 30 1.01e-05 1.163e-05 1.344e-05 0.00% knapsack() 2 1.036e-05 1.165e-05 1.341e-05 0.00% BoxList::parallelComplementIn() 30 1e-05 1.125e-05 1.263e-05 0.00% MLMG::MLRhsNormInf() 14 8.401e-06 9.409e-06 1.233e-05 0.00% Amr::initSubcycle() 1 8.198e-06 9.341e-06 1.03e-05 0.00% Amr::initialInit() 1 1.187e-06 2.597e-06 9.693e-06 0.00% Castro::apply_problem_tags() 15 7.686e-06 8.362e-06 9.565e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.195e-06 4.548e-06 5.145e-06 0.00% Amr::InitializeInit() 1 2.056e-06 2.744e-06 4.192e-06 0.00% Gravity::set_mass_offset() 1 9.71e-07 2.74e-06 4.068e-06 0.00% Amr::init() 1 1.854e-06 2.268e-06 3.454e-06 0.00% Castro::computeInitialDt() 1 1.684e-06 2.282e-06 2.749e-06 0.00% Castro::gwstrain() 2 1.139e-06 1.355e-06 1.789e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.84 10.84 10.84 100.00% Amr::init() 1 9.692 9.692 9.692 89.38% Amr::initialInit() 1 9.441 9.441 9.441 87.06% Amr::FinalizeInit() 1 9.32 9.327 9.335 86.09% Amr::regrid() 14 5.366 5.408 5.462 50.37% Amr::bldFineLevels() 1 5.001 5.11 5.237 48.30% Castro::Castro() 16 4.2 4.269 4.335 39.98% Castro::initMFs() 16 4.155 4.173 4.195 38.69% Castro::post_init() 2 3.884 4.033 4.158 38.34% Gravity::multilevel_solve_for_new_phi() 14 1.866 1.877 1.892 17.44% Gravity::actual_multilevel_solve() 14 1.861 1.872 1.889 17.42% Gravity::solve_phi_with_mlmg() 14 1.854 1.866 1.882 17.35% Castro::computeTemp() 36 1.116 1.188 1.301 12.00% Castro::clean_state() 33 1.085 1.141 1.23 11.34% Gravity::fill_multipole_BCs() 14 1.15 1.162 1.179 10.88% Amr::InitAmr() 1 1.152 1.152 1.152 10.62% Castro::post_regrid() 30 0.8408 0.8676 0.9101 8.39% Castro::initData() 3 0.5741 0.6497 0.7635 7.04% Gravity::actual_solve_with_mlmg() 14 0.7013 0.7029 0.7047 6.50% MLMG::solve() 14 0.6808 0.6813 0.6817 6.29% FabArray::ParallelCopy() 2952 0.1779 0.45 0.6568 6.06% FabArray::ParallelCopy_finish() 2952 0.1024 0.3877 0.6039 5.57% MLMG::oneIter() 106 0.5979 0.5987 0.5994 5.53% Castro::reset_internal_energy(MultiFab) 36 0.4026 0.4333 0.477 4.40% Castro::reset_internal_energy(Fab) 654 0.4023 0.433 0.4767 4.40% MLMG::mgVcycle() 318 0.4493 0.4507 0.4518 4.17% amrex::average_down 844 0.1101 0.2602 0.3852 3.55% MLCellLinOp::smooth() 2544 0.375 0.3775 0.3831 3.53% Castro::avgDown() 15 0.07741 0.228 0.3524 3.25% Castro::avgDown(state_indx) 60 0.07735 0.228 0.3523 3.25% amrex::average_down_w_geom 60 0.07727 0.2279 0.3523 3.25% MLPoisson::Fsmooth() 5088 0.2483 0.2551 0.2672 2.46% Amr::writePlotFile() 1 0.2509 0.2511 0.2511 2.32% Castro::derive() 97 0.2087 0.2109 0.2128 1.96% AmrLevel::derive() 97 0.2086 0.2109 0.2127 1.96% Castro::normalize_species() 33 0.169 0.1803 0.1957 1.81% MLCellLinOp::applyBC() 6294 0.1561 0.172 0.1793 1.65% AmrLevel::FillPatch() 215 0.1463 0.1652 0.1783 1.64% Amr::grid_places() 15 0.02113 0.115 0.1749 1.61% AmrMesh::MakeNewGrids() 15 0.02073 0.1146 0.1745 1.61% TagBoxArray::mapPRD 15 0.001974 0.09646 0.1563 1.44% FillPatchIterator::Initialize 215 0.122 0.1399 0.1537 1.42% FabArray::FillBoundary() 5552 0.1167 0.1355 0.1449 1.34% amrex::Copy() 975 0.1365 0.1407 0.1446 1.33% FabArray::setVal() 1769 0.04858 0.09173 0.1302 1.20% MLMG::mgVcycle_down::0 106 0.1246 0.1254 0.1267 1.17% MLMG::mgVcycle_bottom 318 0.1175 0.1194 0.1237 1.14% Amr::InitializeInit() 1 0.1054 0.1139 0.1204 1.11% Amr::defBaseLevel() 1 0.1054 0.1139 0.1204 1.11% MLMG::miniCycle() 212 0.1176 0.1191 0.1199 1.11% MLMG::mgVcycle_up::0 106 0.1172 0.1176 0.1179 1.09% FillPatchSingleLevel 259 0.05762 0.08307 0.1069 0.99% FillBoundary_finish() 5552 0.06826 0.08847 0.09918 0.91% FillPatchIterator::FillFromTwoLevels() 126 0.0616 0.08081 0.09864 0.91% FillPatchTwoLevels 126 0.06148 0.08068 0.09852 0.91% AmrLevel::AmrLevel(dm) 16 0.0584 0.07277 0.09207 0.85% StateData::define() 64 0.05823 0.07261 0.09193 0.85% MLMG::computeResWithCrseSolFineCor() 106 0.08015 0.08186 0.08305 0.77% Castro::init(old) 13 0.05817 0.07238 0.08138 0.75% FabArray::ParallelCopy_nowait() 2952 0.04994 0.06102 0.07414 0.68% MLCellLinOp::apply() 1040 0.06613 0.06762 0.06953 0.64% MLCellLinOp::correctionResidual() 755 0.06335 0.06482 0.06668 0.61% MLCellLinOp::solutionResidual() 258 0.0601 0.06231 0.06415 0.59% MLCellLinOp::reflux() 138 0.0516 0.05408 0.05566 0.51% FillBoundary_nowait() 5552 0.04243 0.04482 0.04782 0.44% FillPatchIterator::FillFromLevel0() 89 0.02226 0.03138 0.04346 0.40% Castro::computeInitialDt() 1 0.02232 0.02881 0.03731 0.34% Castro::estTimeStep() 1 0.02232 0.02881 0.03731 0.34% Gravity::get_new_grav_vector() 4 0.03289 0.03462 0.03644 0.34% MLMG::computeResWithCrseCorFineCor() 106 0.03307 0.03445 0.03519 0.32% MLMG::addInterpCorrection() 530 0.02242 0.03338 0.03517 0.32% VisMF::Write(FabArray) 2 0.03029 0.03099 0.03347 0.31% MLMG::computeResidual() 106 0.02943 0.0307 0.03142 0.29% MLPoisson::Fapply() 1040 0.02571 0.02683 0.02891 0.27% MLMG::mgVcycle_down::1 106 0.02683 0.02725 0.02764 0.25% MLMG::computeMLResidual() 32 0.02324 0.02528 0.0273 0.25% MLCellLinOp::updateSolBC() 120 0.02237 0.02411 0.02653 0.24% MLMG::mgVcycle_up::2 106 0.009931 0.02163 0.02368 0.22% MLMG::mgVcycle_up::1 106 0.02243 0.02253 0.02261 0.21% Castro::buildMetrics() 16 0.01419 0.01791 0.02239 0.21% MLMG:computeResOfCorrection() 530 0.02016 0.02068 0.02127 0.20% MLCellLinOp::updateCorBC() 106 0.01947 0.0206 0.02115 0.20% FabArray::Xpay() 1013 0.01247 0.01424 0.01592 0.15% MultiFab::Multiply() 287 0.01256 0.0142 0.01559 0.14% MLPoisson::define() 14 0.01247 0.01379 0.01544 0.14% MLMG::prepareForSolve() 14 0.01068 0.01274 0.01503 0.14% MLMG::interpCorrection_1 106 0.01184 0.01302 0.01421 0.13% FabArrayBase::TheFPinfo() 49 0.0007463 0.007312 0.01327 0.12% amrex::Add() 575 0.01147 0.01218 0.01325 0.12% FPinfo::FPinfo() 9 0.0006747 0.007235 0.01319 0.12% DistributionMapping::LeastUsedCPUs() 9 0.0006385 0.007193 0.01313 0.12% MLPoisson::FFlux() 3408 0.01125 0.01186 0.01267 0.12% MLMG::ResNormInf() 152 0.01018 0.01098 0.01178 0.11% MLMG::mgVcycle_down::2 106 0.01013 0.01034 0.01128 0.10% Castro::errorEst() 15 0.009228 0.009857 0.01044 0.10% FillPatchInterp(MF) 44 0.001754 0.006602 0.009819 0.09% MultiFab::max() 54 0.003425 0.007166 0.00968 0.09% Gravity::update_max_rhs() 1 0.0007382 0.004571 0.00683 0.06% Castro::apply_tagging_restrictions() 15 0.005619 0.005995 0.006348 0.06% FabArrayBase::getCPC() 3662 0.005254 0.005538 0.005836 0.05% MLCellLinOp::defineAuxData() 14 0.005148 0.005327 0.005612 0.05% Castro::sum_integrated_quantities() 1 0.005422 0.005465 0.005568 0.05% MLCellLinOp::defineBC() 14 0.005003 0.00518 0.005312 0.05% MLMG::getGradSolution() 14 0.004878 0.005111 0.005307 0.05% FabArray::norminf(mask) 46 0.004857 0.005102 0.005288 0.05% MLCellLinOp::compGrad() 28 0.004859 0.00509 0.005287 0.05% MLLinOp::define() 14 0.001785 0.003228 0.00483 0.04% MLMG::mgVcycle_down::3 106 0.001364 0.001882 0.004816 0.04% MLLinOp::defineGrids() 14 0.001768 0.003208 0.004796 0.04% MLMG::MLResNormInf() 32 0.004178 0.00427 0.00442 0.04% MLLinOp::makeSubCommunicator() 14 0.001371 0.002791 0.004344 0.04% MLMG::actualBottomSolve() 106 2.445e-05 0.0005473 0.004189 0.04% FabArray::norminf() 174 0.003147 0.003471 0.004072 0.04% MLMG::mgVcycle_up::3 106 0.0009612 0.001382 0.003871 0.04% MLCGSolver::bicgstab 13 0 0.0004727 0.003782 0.03% Gravity::average_fine_ec_onto_crse_ec() 14 0.003258 0.003511 0.003677 0.03% Castro::enforce_min_density() 33 0.002664 0.003011 0.003373 0.03% BndryData::define() 42 0.002906 0.003037 0.00319 0.03% MLMG::mgVcycle_down::4 106 0.001196 0.001429 0.002533 0.02% average_down_faces 84 0.002043 0.00226 0.002427 0.02% MLMG::mgVcycle_up::4 106 0.001123 0.001298 0.00202 0.02% FabArrayBase::CPC::define() 624 0.001623 0.001768 0.002007 0.02% MLMG::MLRhsNormInf() 14 0.0018 0.00189 0.001959 0.02% Castro::volWgtSum() 46 0.001629 0.001777 0.001837 0.02% Castro::enforce_consistent_e() 3 0.001081 0.001325 0.001671 0.02% FabArray::mult() 34 0.001092 0.001284 0.001526 0.01% StateDataPhysBCFunct::() 259 0.001376 0.001435 0.001494 0.01% FabArrayBase::getFB() 5552 0.001086 0.001155 0.001337 0.01% StateData::FillBoundary(geom) 8 0.001209 0.001278 0.00133 0.01% AMRErrorTag::operator() 15 0.0009378 0.0009702 0.001016 0.01% Castro::build_fine_mask() 55 0.0007391 0.0008028 0.0008616 0.01% DistributionMapping::KnapSackDoIt() 2 3.635e-05 0.0003211 0.0007854 0.01% TagBoxArray::collate() 15 0.0002716 0.0003651 0.0007304 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004817 0.0005007 0.0005348 0.00% MLPoisson::prepareForSolve() 14 0.000394 0.0004512 0.0005243 0.00% MLCellLinOp::prepareForSolve() 14 0.0003821 0.000437 0.0005126 0.00% MLCellLinOp::setLevelBC() 28 0.0003538 0.0004087 0.0004824 0.00% FabArray::setDomainBndry() 259 0.0003829 0.0004045 0.0004271 0.00% MLCGSolver::ParallelAllReduce 81 0 5.222e-05 0.0004178 0.00% Castro::locWgtSum() 6 0.000183 0.0002001 0.0002455 0.00% FabArrayBase::FB::FB() 35 7.723e-05 9.203e-05 0.0001456 0.00% amrex::Dot() 54 0 1.691e-05 0.0001353 0.00% OwnerMask() 15 9.133e-05 0.0001027 0.0001144 0.00% Castro::volProductSum() 2 7.742e-05 9.4e-05 0.000112 0.00% AmrMesh-cluster 1 0 1.379e-05 0.0001103 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.551e-05 7.831e-05 9.575e-05 0.00% FabArray::Saxpy() 27 0 1.187e-05 9.499e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.826e-05 8.213e-05 9.369e-05 0.00% FabArray::LinComb() 27 0 1.088e-05 8.708e-05 0.00% makeSFC 42 4.55e-05 5.62e-05 6.539e-05 0.00% ClusterList::intersect() 1 0 7.594e-06 6.075e-05 0.00% Amr::writeSmallPlotFile() 1 2.974e-05 3.086e-05 3.223e-05 0.00% DistributionMapping::Distribute() 46 2.27e-05 2.676e-05 2.964e-05 0.00% BoxList::parallelComplementIn() 30 2.01e-05 2.288e-05 2.479e-05 0.00% FabArray::RecvLayoutMask() 14 1.702e-05 1.854e-05 2.428e-05 0.00% ClusterList::chop() 1 0 2.405e-06 1.924e-05 0.00% Castro::enforce_speed_limit() 33 1.24e-05 1.33e-05 1.435e-05 0.00% BoxList::complementIn 30 1.01e-05 1.163e-05 1.344e-05 0.00% knapsack() 2 1.036e-05 1.165e-05 1.341e-05 0.00% Amr::initSubcycle() 1 8.198e-06 9.341e-06 1.03e-05 0.00% Castro::apply_problem_tags() 15 7.686e-06 8.362e-06 9.565e-06 0.00% Gravity::set_mass_offset() 1 9.71e-07 2.74e-06 4.068e-06 0.00% Castro::gwstrain() 2 1.139e-06 1.355e-06 1.789e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 10 B 12 B 18 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.07-13-gb41f85ab36ac) finalized