MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.08-4-g67b8a5b04b7f) initialized Starting run at 06:21:40 UTC on 2023-08-03. Successfully read inputs file ... Castro git describe: 23.08 AMReX git describe: 23.08-4-g67b8a5b04 Microphysics git describe: 23.08 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002804581 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.12078651 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001614607 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001969666 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001114619 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001049376 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001052284 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001034501 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001059752 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001062777 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001053659 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001087686 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001068926 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001083603 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001096335 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.854157957 seconds Ending run at 06:21:48 UTC on 2023-08-03. Run time = 7.907991313 Run time without initialization = 0.000279198 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 7.908 ... 7.908 ... 7.908 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1639 1.1737 1.1867 15.01% Amr::InitAmr() 1 1.142 1.142 1.142 14.45% Castro::post_init() 2 1.003 1.004 1.005 12.71% Castro::sum_integrated_quantities() 1 0.8847 0.8849 0.8851 11.19% Castro::computeTemp() 36 0.6906 0.7437 0.8212 10.38% Amr::writePlotFile() 1 0.5976 0.5999 0.6007 7.60% Castro::reset_internal_energy(Fab) 654 0.3867 0.4197 0.4682 5.92% FabArray::ParallelCopy_finish() 2952 0.06189 0.2776 0.418 5.29% MLPoisson::Fsmooth() 5088 0.2435 0.2525 0.2716 3.43% Castro::normalize_species() 33 0.1641 0.1729 0.1856 2.35% Castro::initData() 3 0.1112 0.1283 0.1531 1.94% AmrLevel::derive() 97 0.1387 0.1413 0.1456 1.84% amrex::Copy() 975 0.1302 0.1332 0.1371 1.73% Castro::initMFs() 16 0.09815 0.1081 0.1247 1.58% FillBoundary_finish() 5552 0.06279 0.08821 0.1023 1.29% StateData::define() 64 0.0563 0.06188 0.07126 0.90% VisMF::Write(FabArray) 2 0.05434 0.05502 0.05756 0.73% amrex::average_down 844 0.04427 0.04732 0.05142 0.65% FabArray::setVal() 1769 0.04236 0.04685 0.05006 0.63% FillBoundary_nowait() 5552 0.03906 0.04274 0.04785 0.61% MLCellLinOp::applyBC() 6294 0.03297 0.03519 0.03886 0.49% FabArray::ParallelCopy_nowait() 2952 0.02278 0.02631 0.03278 0.41% Castro::estTimeStep() 1 0.02213 0.02436 0.02786 0.35% MLPoisson::Fapply() 1040 0.02452 0.02555 0.02752 0.35% MLMG::addInterpCorrection() 530 0.01694 0.01749 0.01853 0.23% Amr::regrid() 14 0.01392 0.0158 0.01843 0.23% MLCellLinOp::reflux() 138 0.01621 0.01692 0.01817 0.23% FillPatchIterator::Initialize 215 0.0154 0.01689 0.01771 0.22% Castro::buildMetrics() 16 0.01227 0.01352 0.01558 0.20% FabArray::Xpay() 1013 0.01227 0.01341 0.01462 0.18% MultiFab::Multiply() 287 0.01283 0.01311 0.0137 0.17% MLPoisson::FFlux() 3408 0.01138 0.01186 0.01266 0.16% amrex::Add() 575 0.01074 0.01162 0.01265 0.16% MLCellLinOp::updateSolBC() 120 0.01079 0.01175 0.01253 0.16% MLCellLinOp::updateCorBC() 106 0.009716 0.01064 0.01181 0.15% FillPatchInterp(MF) 44 0.001965 0.007335 0.01121 0.14% Castro::Castro() 16 0.008664 0.009548 0.01088 0.14% MLMG::interpCorrection_1 106 0.006434 0.00706 0.007428 0.09% MLLinOp::makeSubCommunicator() 14 0.0005549 0.004247 0.006683 0.08% AmrMesh::MakeNewGrids() 15 0.006244 0.00633 0.006466 0.08% Castro::apply_tagging_restrictions() 15 0.005588 0.005958 0.006368 0.08% MLMG::prepareForSolve() 14 0.00482 0.005101 0.00535 0.07% FabArray::norminf(mask) 46 0.004823 0.00502 0.005241 0.07% MLMG::ResNormInf() 152 0.003034 0.00421 0.00518 0.07% MLCellLinOp::defineAuxData() 14 0.003956 0.004032 0.004305 0.05% FabArray::norminf() 174 0.003098 0.003382 0.004051 0.05% Gravity::get_new_grav_vector() 4 0.00181 0.002305 0.003743 0.05% FabArrayBase::getCPC() 3662 0.003413 0.003555 0.003718 0.05% MLCellLinOp::compGrad() 28 0.003205 0.003307 0.003555 0.04% MultiFab::max() 54 0.002798 0.003199 0.00338 0.04% Gravity::multilevel_solve_for_new_phi() 14 0.0027 0.002982 0.00331 0.04% DistributionMapping::LeastUsedCPUs() 9 8.158e-05 0.002256 0.003138 0.04% Castro::enforce_min_density() 33 0.002776 0.002907 0.003095 0.04% BndryData::define() 42 0.002318 0.002437 0.002546 0.03% Gravity::actual_solve_with_mlmg() 14 0.001859 0.002058 0.002463 0.03% FabArray::FillBoundary() 5552 0.001939 0.00205 0.002292 0.03% MLCellLinOp::defineBC() 14 0.001886 0.002001 0.002214 0.03% FabArrayBase::CPC::define() 624 0.001621 0.001778 0.002202 0.03% MLCellLinOp::smooth() 2544 0.001686 0.001787 0.001996 0.03% average_down_faces 84 0.001112 0.001296 0.00183 0.02% Castro::volWgtSum() 46 0.001684 0.001758 0.001817 0.02% FabArray::mult() 34 0.001133 0.001372 0.001669 0.02% MLCGSolver::bicgstab 13 0 0.000196 0.001568 0.02% FillPatchTwoLevels 126 0.000687 0.001131 0.001543 0.02% StateData::FillBoundary(geom) 8 0.001241 0.001303 0.001427 0.02% FabArray::ParallelCopy() 2952 0.001223 0.001278 0.001359 0.02% Castro::enforce_consistent_e() 3 0.0009485 0.001185 0.001351 0.02% FabArrayBase::getFB() 5552 0.0009314 0.001012 0.001166 0.01% AMRErrorTag::operator() 15 0.0009417 0.0009635 0.0009844 0.01% Gravity::actual_multilevel_solve() 14 0.0007798 0.0008653 0.0009468 0.01% Castro::build_fine_mask() 55 0.0007153 0.000786 0.0008941 0.01% MLMG::solve() 14 0.0004241 0.0005939 0.0007238 0.01% MLCellLinOp::apply() 1040 0.0004304 0.0004748 0.0006029 0.01% TagBoxArray::collate() 15 0.0002283 0.0003169 0.0005495 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004637 0.0004932 0.000534 0.01% AmrLevel::FillPatch() 215 0.0004864 0.0005076 0.0005224 0.01% MLMG::mgVcycle() 318 0.0004189 0.0004459 0.0005096 0.01% MLMG::MLResNormInf() 32 0.0001419 0.0003052 0.0005016 0.01% MLCellLinOp::prepareForSolve() 14 0.0003769 0.0003949 0.0004638 0.01% MLCellLinOp::correctionResidual() 755 0.0003908 0.000418 0.0004613 0.01% Amr::grid_places() 15 0.0003218 0.0003558 0.0004517 0.01% main() 1 0.0003558 0.0003897 0.0004311 0.01% FabArray::setDomainBndry() 259 0.0003676 0.0003956 0.0004207 0.01% MLCellLinOp::setLevelBC() 28 0.0003383 0.0003648 0.00039 0.00% Castro::reset_internal_energy(MultiFab) 36 0.0002888 0.0003319 0.0003849 0.00% MLLinOp::defineGrids() 14 0.0002633 0.000318 0.0003806 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002736 0.0002933 0.0003363 0.00% MLMG::oneIter() 106 0.0002546 0.0002799 0.0003005 0.00% MLMG::actualBottomSolve() 106 2.118e-05 5.595e-05 0.000283 0.00% MLCGSolver::ParallelAllReduce 81 0 3.264e-05 0.0002611 0.00% MLMG::mgVcycle_bottom 318 0.000237 0.000246 0.0002543 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001668 0.0001775 0.0002047 0.00% MLCellLinOp::solutionResidual() 258 0.0001746 0.0001939 0.0002035 0.00% Castro::locWgtSum() 6 0.0001832 0.0001894 0.0001962 0.00% AmrLevel::AmrLevel(dm) 16 0.0001486 0.0001681 0.000182 0.00% MLMG:computeResOfCorrection() 530 0.0001548 0.0001635 0.0001767 0.00% FabArrayBase::FB::FB() 35 7.399e-05 9.434e-05 0.0001612 0.00% StateDataPhysBCFunct::() 259 0.0001383 0.0001451 0.0001589 0.00% MLMG::mgVcycle_down::0 106 0.000131 0.0001396 0.0001506 0.00% FillPatchSingleLevel 259 0.0001325 0.0001377 0.0001478 0.00% Gravity::update_max_rhs() 1 9.271e-05 0.0001137 0.0001425 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001153 0.0001244 0.0001318 0.00% FillPatchIterator::FillFromLevel0() 89 0.000114 0.000119 0.0001246 0.00% MLMG::mgVcycle_down::1 106 0.0001057 0.0001122 0.0001241 0.00% amrex::Dot() 54 0 1.504e-05 0.0001203 0.00% MLMG::miniCycle() 212 8.683e-05 9.947e-05 0.0001138 0.00% OwnerMask() 15 9.467e-05 0.0001035 0.0001135 0.00% TagBoxArray::mapPRD 15 9.478e-05 9.949e-05 0.0001126 0.00% Amr::FinalizeInit() 1 9.198e-06 3.09e-05 0.000111 0.00% Castro::post_regrid() 30 6.584e-05 8.563e-05 0.0001086 0.00% MLMG::mgVcycle_down::2 106 8.16e-05 8.684e-05 9.579e-05 0.00% FPinfo::FPinfo() 9 6.905e-05 8.152e-05 9.568e-05 0.00% Castro::volProductSum() 2 8.221e-05 8.733e-05 9.149e-05 0.00% MLMG::mgVcycle_down::4 106 6.841e-05 7.548e-05 9.132e-05 0.00% FabArray::LinComb() 27 0 1.138e-05 9.103e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.064e-05 8.353e-05 8.749e-05 0.00% MLMG::mgVcycle_down::3 106 7.33e-05 7.9e-05 8.605e-05 0.00% FabArray::Saxpy() 27 0 9.951e-06 7.961e-05 0.00% Castro::derive() 97 6.447e-05 6.933e-05 7.943e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.035e-05 6.986e-05 7.819e-05 0.00% Castro::errorEst() 15 4.815e-05 6.513e-05 7.747e-05 0.00% FabArrayBase::TheFPinfo() 49 6.186e-05 6.675e-05 7.551e-05 0.00% Castro::clean_state() 33 6.365e-05 6.824e-05 7.52e-05 0.00% MLMG::mgVcycle_up::0 106 6.586e-05 6.894e-05 7.427e-05 0.00% Castro::avgDown(state_indx) 60 6.525e-05 6.939e-05 7.351e-05 0.00% MLMG::mgVcycle_up::1 106 6.093e-05 6.379e-05 7.232e-05 0.00% MLMG::mgVcycle_up::4 106 6.138e-05 6.539e-05 7.07e-05 0.00% MLMG::mgVcycle_up::2 106 5.602e-05 5.974e-05 6.991e-05 0.00% MLMG::mgVcycle_up::3 106 5.685e-05 6.048e-05 6.623e-05 0.00% MLMG::computeResidual() 106 5.342e-05 5.76e-05 6.105e-05 0.00% ClusterList::intersect() 1 0 7.153e-06 5.723e-05 0.00% amrex::average_down_w_geom 60 3.997e-05 4.541e-05 5.557e-05 0.00% Castro::init(old) 13 4.416e-05 4.765e-05 4.949e-05 0.00% makeSFC 42 2.805e-05 3.468e-05 4.594e-05 0.00% Castro::avgDown() 15 3.607e-05 4.101e-05 4.455e-05 0.00% MLPoisson::define() 14 3.852e-05 4.096e-05 4.426e-05 0.00% MLMG::computeMLResidual() 32 3.524e-05 4.057e-05 4.354e-05 0.00% Amr::writeSmallPlotFile() 1 2.915e-05 3.062e-05 3.52e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.087e-05 2.64e-05 3.408e-05 0.00% DistributionMapping::Distribute() 46 2.235e-05 2.449e-05 2.758e-05 0.00% AmrMesh-cluster 1 0 3.397e-06 2.718e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.568e-05 2.207e-05 2.479e-05 0.00% Amr::defBaseLevel() 1 1.293e-05 1.791e-05 2.371e-05 0.00% MLLinOp::define() 14 1.533e-05 1.899e-05 2.145e-05 0.00% MLMG::getGradSolution() 14 1.708e-05 1.885e-05 2.136e-05 0.00% Amr::bldFineLevels() 1 1.551e-05 1.675e-05 1.892e-05 0.00% FabArray::RecvLayoutMask() 14 1.643e-05 1.725e-05 1.83e-05 0.00% ClusterList::chop() 1 0 2.006e-06 1.605e-05 0.00% MLPoisson::prepareForSolve() 14 1.219e-05 1.303e-05 1.443e-05 0.00% BoxList::complementIn 30 1.111e-05 1.228e-05 1.398e-05 0.00% knapsack() 2 1.021e-05 1.181e-05 1.313e-05 0.00% Amr::initSubcycle() 1 8.574e-06 1.025e-05 1.308e-05 0.00% Castro::enforce_speed_limit() 33 1.032e-05 1.209e-05 1.297e-05 0.00% BoxList::parallelComplementIn() 30 1.037e-05 1.089e-05 1.153e-05 0.00% MLMG::MLRhsNormInf() 14 8.281e-06 8.834e-06 9.351e-06 0.00% Castro::apply_problem_tags() 15 7.771e-06 8.668e-06 9.298e-06 0.00% DistributionMapping::KnapSackDoIt() 2 3.919e-06 4.549e-06 4.909e-06 0.00% Amr::InitializeInit() 1 1.847e-06 2.471e-06 4.279e-06 0.00% Gravity::set_mass_offset() 1 9.02e-07 1.588e-06 3.56e-06 0.00% Castro::gwstrain() 2 1.023e-06 1.381e-06 2.968e-06 0.00% Amr::init() 1 1.764e-06 2.341e-06 2.904e-06 0.00% Castro::computeInitialDt() 1 1.906e-06 2.301e-06 2.663e-06 0.00% Amr::initialInit() 1 1.24e-06 1.432e-06 1.681e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 7.908 7.908 7.908 100.00% Amr::init() 1 6.765 6.765 6.765 85.55% Amr::initialInit() 1 5.911 5.911 5.911 74.74% Amr::FinalizeInit() 1 5.801 5.803 5.806 73.42% Castro::post_init() 2 4.559 4.677 4.763 60.23% Gravity::multilevel_solve_for_new_phi() 14 1.859 1.868 1.883 23.81% Gravity::actual_multilevel_solve() 14 1.856 1.865 1.88 23.77% Gravity::solve_phi_with_mlmg() 14 1.848 1.858 1.873 23.68% Castro::computeTemp() 36 1.078 1.164 1.29 16.31% Amr::regrid() 14 1.206 1.223 1.25 15.81% Castro::clean_state() 33 1.049 1.112 1.21 15.30% Gravity::fill_multipole_BCs() 14 1.165 1.175 1.188 15.03% Amr::InitAmr() 1 1.142 1.142 1.142 14.45% Amr::bldFineLevels() 1 0.8813 0.9493 1.043 13.20% Castro::post_regrid() 30 0.8144 0.8447 0.8948 11.32% Castro::sum_integrated_quantities() 1 0.8892 0.8893 0.8893 11.25% Amr::writePlotFile() 1 0.8543 0.8545 0.8545 10.81% Castro::initData() 3 0.556 0.6372 0.7511 9.50% Gravity::actual_solve_with_mlmg() 14 0.6786 0.6819 0.6842 8.65% MLMG::solve() 14 0.6587 0.6597 0.6599 8.35% MLMG::oneIter() 106 0.5831 0.5842 0.585 7.40% FabArray::ParallelCopy() 2952 0.121 0.332 0.47 5.94% Castro::reset_internal_energy(MultiFab) 36 0.387 0.42 0.4685 5.92% Castro::reset_internal_energy(Fab) 654 0.3867 0.4197 0.4682 5.92% MLMG::mgVcycle() 318 0.4405 0.442 0.4449 5.63% FabArray::ParallelCopy_finish() 2952 0.06189 0.2776 0.418 5.29% MLCellLinOp::smooth() 2544 0.3722 0.3738 0.382 4.83% amrex::average_down 844 0.07868 0.1976 0.2848 3.60% MLPoisson::Fsmooth() 5088 0.2435 0.2525 0.2716 3.43% Castro::avgDown() 15 0.04619 0.1643 0.2504 3.17% Castro::avgDown(state_indx) 60 0.04614 0.1643 0.2504 3.17% amrex::average_down_w_geom 60 0.04607 0.1642 0.2503 3.17% Castro::derive() 97 0.2 0.2003 0.2006 2.54% AmrLevel::derive() 97 0.1999 0.2002 0.2005 2.54% Castro::normalize_species() 33 0.1641 0.1729 0.1856 2.35% MLCellLinOp::applyBC() 6294 0.1516 0.1693 0.1781 2.25% Castro::Castro() 16 0.1379 0.1517 0.1717 2.17% FabArray::FillBoundary() 5552 0.1128 0.1341 0.1444 1.83% Amr::grid_places() 15 0.01871 0.09009 0.1376 1.74% AmrMesh::MakeNewGrids() 15 0.01826 0.08973 0.1372 1.74% amrex::Copy() 975 0.1302 0.1332 0.1371 1.73% MLMG::mgVcycle_bottom 318 0.1204 0.1221 0.1273 1.61% AmrLevel::FillPatch() 215 0.1141 0.1195 0.1248 1.58% Castro::initMFs() 16 0.09815 0.1081 0.1247 1.58% MLMG::mgVcycle_down::0 106 0.1214 0.1228 0.1239 1.57% MLMG::miniCycle() 212 0.1205 0.1218 0.1236 1.56% TagBoxArray::mapPRD 15 0.001847 0.07314 0.1207 1.53% MLMG::mgVcycle_up::0 106 0.1096 0.111 0.1118 1.41% Amr::InitializeInit() 1 0.1043 0.1078 0.11 1.39% Amr::defBaseLevel() 1 0.1043 0.1078 0.11 1.39% FillBoundary_finish() 5552 0.06279 0.08821 0.1023 1.29% FillPatchIterator::Initialize 215 0.08903 0.09428 0.09962 1.26% MLMG::computeResWithCrseSolFineCor() 106 0.07672 0.07888 0.08026 1.01% AmrLevel::AmrLevel(dm) 16 0.05648 0.06205 0.07141 0.90% StateData::define() 64 0.0563 0.06188 0.07126 0.90% MLCellLinOp::apply() 1040 0.06319 0.06497 0.06622 0.84% FillPatchSingleLevel 259 0.04917 0.05657 0.06389 0.81% MLCellLinOp::correctionResidual() 755 0.06081 0.0619 0.06295 0.80% MLCellLinOp::solutionResidual() 258 0.05651 0.05814 0.06013 0.76% FabArray::ParallelCopy_nowait() 2952 0.04964 0.05311 0.05783 0.73% VisMF::Write(FabArray) 2 0.05434 0.05502 0.05756 0.73% FillPatchIterator::FillFromTwoLevels() 126 0.0462 0.04942 0.05355 0.68% FillPatchTwoLevels 126 0.04607 0.0493 0.05343 0.68% MLCellLinOp::reflux() 138 0.04823 0.05098 0.05256 0.66% FabArray::setVal() 1769 0.04236 0.04685 0.05006 0.63% Castro::init(old) 13 0.04415 0.04629 0.04943 0.63% FillBoundary_nowait() 5552 0.0401 0.04385 0.04918 0.62% MLMG::computeResWithCrseCorFineCor() 106 0.03252 0.03301 0.03357 0.42% MLMG::addInterpCorrection() 530 0.02007 0.03041 0.03274 0.41% FillPatchIterator::FillFromLevel0() 89 0.02413 0.02762 0.0314 0.40% MLMG::computeResidual() 106 0.02791 0.02956 0.03063 0.39% Castro::computeInitialDt() 1 0.02213 0.02436 0.02787 0.35% Castro::estTimeStep() 1 0.02213 0.02436 0.02786 0.35% MLPoisson::Fapply() 1040 0.02452 0.02555 0.02752 0.35% MLMG::mgVcycle_down::1 106 0.02492 0.02598 0.02674 0.34% MLMG::mgVcycle_up::2 106 0.01092 0.02235 0.02419 0.31% MLMG::mgVcycle_up::1 106 0.02123 0.02173 0.02252 0.28% MLCellLinOp::updateSolBC() 120 0.02098 0.02155 0.02251 0.28% MLMG::computeMLResidual() 32 0.02082 0.02158 0.02204 0.28% Gravity::get_new_grav_vector() 4 0.01922 0.01998 0.02061 0.26% MLCellLinOp::updateCorBC() 106 0.01866 0.01957 0.02014 0.25% MLMG:computeResOfCorrection() 530 0.01902 0.01978 0.02006 0.25% MLPoisson::define() 14 0.01206 0.01496 0.01724 0.22% Castro::buildMetrics() 16 0.01372 0.01503 0.01716 0.22% FabArray::Xpay() 1013 0.01227 0.01341 0.01462 0.18% MultiFab::Multiply() 287 0.01283 0.01311 0.0137 0.17% MLPoisson::FFlux() 3408 0.01138 0.01186 0.01266 0.16% amrex::Add() 575 0.01074 0.01162 0.01265 0.16% MLMG::interpCorrection_1 106 0.01021 0.01127 0.01223 0.15% MLMG::ResNormInf() 152 0.009795 0.01073 0.01142 0.14% MLMG::prepareForSolve() 14 0.01053 0.01081 0.01126 0.14% FillPatchInterp(MF) 44 0.001965 0.007335 0.01121 0.14% MLMG::mgVcycle_down::2 106 0.009581 0.009907 0.01062 0.13% Castro::errorEst() 15 0.009352 0.009684 0.01005 0.13% MLLinOp::define() 14 0.0009214 0.004664 0.007179 0.09% MLLinOp::defineGrids() 14 0.0009041 0.004645 0.007157 0.09% MLLinOp::makeSubCommunicator() 14 0.0005549 0.004247 0.006683 0.08% Castro::apply_tagging_restrictions() 15 0.005588 0.005958 0.006368 0.08% FabArrayBase::getCPC() 3662 0.00506 0.005333 0.005806 0.07% MLCellLinOp::defineAuxData() 14 0.004987 0.005119 0.005568 0.07% MLCellLinOp::defineBC() 14 0.004974 0.005137 0.005536 0.07% FabArray::norminf(mask) 46 0.004823 0.00502 0.005241 0.07% MLMG::getGradSolution() 14 0.004724 0.004796 0.005078 0.06% MLCellLinOp::compGrad() 28 0.004704 0.004777 0.00506 0.06% MLMG::mgVcycle_down::3 106 0.001264 0.001734 0.00466 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.004042 0.004325 0.004526 0.06% MLMG::MLResNormInf() 32 0.004076 0.004133 0.004254 0.05% FabArray::norminf() 174 0.003098 0.003382 0.004051 0.05% MLMG::actualBottomSolve() 106 2.118e-05 0.0005076 0.003897 0.05% MLMG::mgVcycle_up::3 106 0.0009135 0.001318 0.003833 0.05% MLCGSolver::bicgstab 13 0 0.0004449 0.003559 0.05% MultiFab::max() 54 0.002798 0.003199 0.00338 0.04% FabArrayBase::TheFPinfo() 49 0.0002025 0.002374 0.003261 0.04% FPinfo::FPinfo() 9 0.0001398 0.002308 0.003191 0.04% BndryData::define() 42 0.002865 0.003006 0.003139 0.04% DistributionMapping::LeastUsedCPUs() 9 8.158e-05 0.002256 0.003138 0.04% Castro::enforce_min_density() 33 0.002776 0.002907 0.003095 0.04% average_down_faces 84 0.002554 0.002816 0.003044 0.04% MLMG::mgVcycle_down::4 106 0.001105 0.001342 0.00253 0.03% FabArrayBase::CPC::define() 624 0.001621 0.001778 0.002202 0.03% MLMG::mgVcycle_up::4 106 0.001085 0.001231 0.001987 0.03% MLMG::MLRhsNormInf() 14 0.001822 0.001873 0.001956 0.02% Castro::volWgtSum() 46 0.001689 0.001764 0.001826 0.02% FabArray::mult() 34 0.001133 0.001372 0.001669 0.02% StateDataPhysBCFunct::() 259 0.0014 0.001448 0.001581 0.02% StateData::FillBoundary(geom) 8 0.001241 0.001303 0.001427 0.02% Castro::enforce_consistent_e() 3 0.0009485 0.001185 0.001351 0.02% FabArrayBase::getFB() 5552 0.001011 0.001106 0.001327 0.02% Gravity::update_max_rhs() 1 0.0006174 0.0009514 0.001095 0.01% AMRErrorTag::operator() 15 0.0009417 0.0009635 0.0009844 0.01% Castro::build_fine_mask() 55 0.0007153 0.000786 0.0008941 0.01% DistributionMapping::KnapSackDoIt() 2 3.872e-05 0.0003914 0.0008219 0.01% TagBoxArray::collate() 15 0.0002283 0.0003169 0.0005495 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004637 0.0004932 0.000534 0.01% MLPoisson::prepareForSolve() 14 0.0003902 0.000408 0.000476 0.01% MLCellLinOp::prepareForSolve() 14 0.0003769 0.0003949 0.0004638 0.01% FabArray::setDomainBndry() 259 0.0003676 0.0003956 0.0004207 0.01% MLCellLinOp::setLevelBC() 28 0.0003383 0.0003648 0.00039 0.00% MLCGSolver::ParallelAllReduce 81 0 4.135e-05 0.0003308 0.00% Castro::locWgtSum() 6 0.0001837 0.00019 0.0001967 0.00% FabArrayBase::FB::FB() 35 7.399e-05 9.434e-05 0.0001612 0.00% amrex::Dot() 54 0 1.504e-05 0.0001203 0.00% OwnerMask() 15 9.467e-05 0.0001035 0.0001135 0.00% AmrMesh-cluster 1 0 1.256e-05 0.0001005 0.00% MLLinOp::makeAgglomeratedDMap 14 6.804e-05 7.996e-05 9.353e-05 0.00% Castro::volProductSum() 2 8.237e-05 8.753e-05 9.166e-05 0.00% FabArray::LinComb() 27 0 1.138e-05 9.103e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.672e-05 7.39e-05 8.052e-05 0.00% FabArray::Saxpy() 27 0 9.951e-06 7.961e-05 0.00% makeSFC 42 4.495e-05 5.356e-05 6.55e-05 0.00% ClusterList::intersect() 1 0 7.153e-06 5.723e-05 0.00% Amr::writeSmallPlotFile() 1 2.915e-05 3.062e-05 3.52e-05 0.00% DistributionMapping::Distribute() 46 2.235e-05 2.449e-05 2.758e-05 0.00% BoxList::parallelComplementIn() 30 2.149e-05 2.316e-05 2.548e-05 0.00% FabArray::RecvLayoutMask() 14 1.643e-05 1.725e-05 1.83e-05 0.00% ClusterList::chop() 1 0 2.006e-06 1.605e-05 0.00% BoxList::complementIn 30 1.111e-05 1.228e-05 1.398e-05 0.00% knapsack() 2 1.021e-05 1.181e-05 1.313e-05 0.00% Amr::initSubcycle() 1 8.574e-06 1.025e-05 1.308e-05 0.00% Castro::enforce_speed_limit() 33 1.032e-05 1.209e-05 1.297e-05 0.00% Castro::apply_problem_tags() 15 7.771e-06 8.668e-06 9.298e-06 0.00% Gravity::set_mass_offset() 1 9.02e-07 1.588e-06 3.56e-06 0.00% Castro::gwstrain() 2 1.023e-06 1.381e-06 2.968e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 14 B 15 B 17 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.08-4-g67b8a5b04b7f) finalized