Initializing AMReX (24.02-1-g296ed40e16ae)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.02-1-g296ed40e16ae) initialized Starting run at 08:04:48 UTC on 2024-02-05. Successfully read inputs file ... Castro git describe: 24.02-2-gcff739306 AMReX git describe: 24.02-1-g296ed40e1 Microphysics git describe: 24.02-5-g56253c93 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.00259082 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.139592147 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001520832 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002047765 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001209993 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00117052 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00114729 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001167738 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001181931 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001193131 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001178144 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001158271 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001151252 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001179888 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001160438 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.226237271 seconds Ending run at 08:04:54 UTC on 2024-02-05. Run time = 6.539041063 Run time without initialization = 0.000278078 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.539 ... 6.539 ... 6.539 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1672 1.1766 1.1845 18.11% Amr::InitAmr() 1 1.182 1.182 1.182 18.08% Castro::post_init() 2 1.033 1.034 1.035 15.83% Castro::computeTemp() 36 0.7501 0.8223 0.9147 13.99% Castro::reset_internal_energy(Fab) 654 0.4054 0.4506 0.5171 7.91% FabArray::ParallelCopy_finish() 2952 0.05751 0.3071 0.4705 7.20% MLPoisson::Fsmooth() 5088 0.1983 0.2057 0.2196 3.36% Castro::normalize_species() 33 0.1626 0.1745 0.1924 2.94% Castro::initData() 3 0.1167 0.1373 0.1676 2.56% AmrLevel::derive() 97 0.1406 0.1433 0.1458 2.23% amrex::Copy() 948 0.1278 0.1325 0.1351 2.07% Castro::initMFs() 16 0.09039 0.0999 0.1163 1.78% FillBoundary_finish() 5539 0.0473 0.0644 0.08007 1.22% StateData::define() 64 0.05199 0.0573 0.06658 1.02% FabArray::setVal() 1755 0.0391 0.04917 0.05328 0.81% amrex::average_down 844 0.04166 0.0454 0.05114 0.78% FillBoundary_nowait() 5539 0.0401 0.0432 0.04569 0.70% Castro::estTimeStep() 1 0.02234 0.03508 0.04052 0.62% MLCellLinOp::applyBC() 6281 0.03252 0.03586 0.03953 0.60% FabArray::ParallelCopy_nowait() 2952 0.02401 0.02623 0.03012 0.46% MLPoisson::Fapply() 1027 0.02409 0.0254 0.02759 0.42% MLCellLinOp::reflux() 138 0.01865 0.01948 0.02055 0.31% VisMF::Write(FabArray) 2 0.01714 0.01781 0.01992 0.30% MLMG::addInterpCorrection() 530 0.01822 0.01881 0.01971 0.30% FillPatchIterator::Initialize 215 0.01633 0.01706 0.0177 0.27% FabArray::Xpay() 1000 0.01175 0.01305 0.01469 0.22% Castro::buildMetrics() 16 0.01124 0.01246 0.01451 0.22% Amr::regrid() 14 0.009134 0.01062 0.01349 0.21% MultiFab::Multiply() 287 0.01237 0.0128 0.01314 0.20% amrex::Add() 562 0.01078 0.0116 0.01273 0.19% MLPoisson::FFlux() 3408 0.01117 0.0118 0.01246 0.19% MLCellLinOp::updateSolBC() 120 0.01028 0.01115 0.01191 0.18% MLCellLinOp::updateCorBC() 106 0.009506 0.01009 0.01067 0.16% Castro::Castro() 16 0.008021 0.009111 0.01065 0.16% FillPatchInterp(MF) 44 0.001873 0.006842 0.01017 0.16% Amr::writePlotFile() 1 0.005426 0.007668 0.008228 0.13% MLMG::interpCorrection_1 106 0.006068 0.006951 0.007918 0.12% AmrMesh::MakeNewGrids() 15 0.007467 0.007568 0.007738 0.12% Castro::apply_tagging_restrictions() 15 0.005732 0.006286 0.006707 0.10% MLMG::prepareForSolve() 14 0.004644 0.005035 0.005279 0.08% FabArray::norminf(mask) 46 0.004665 0.004918 0.005175 0.08% MLMG::ResNormInf() 152 0.002781 0.004259 0.005129 0.08% MLLinOp::makeSubCommunicator() 14 0.000366 0.002522 0.004507 0.07% MLCellLinOp::defineAuxData() 14 0.003952 0.004044 0.004262 0.07% FabArray::norminf() 188 0.003093 0.003431 0.004109 0.06% FabArrayBase::getCPC() 3662 0.003372 0.003505 0.003616 0.06% Castro::enforce_min_density() 33 0.003052 0.003242 0.003532 0.05% MultiFab::max() 54 0.002752 0.003226 0.003452 0.05% MLCellLinOp::compGrad() 28 0.003159 0.003285 0.003442 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002581 0.002786 0.002933 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0003661 0.001535 0.002673 0.04% BndryData::define() 42 0.002377 0.002437 0.002543 0.04% Gravity::get_new_grav_vector() 4 0.001809 0.002104 0.002471 0.04% Gravity::actual_solve_with_mlmg() 14 0.001945 0.002094 0.002426 0.04% FabArray::FillBoundary() 5539 0.001932 0.002048 0.002218 0.03% FabArrayBase::CPC::define() 624 0.001649 0.001767 0.002068 0.03% MLCellLinOp::defineBC() 14 0.001729 0.001885 0.001975 0.03% MLCellLinOp::smooth() 2544 0.001644 0.0017 0.001792 0.03% Castro::volWgtSum() 46 0.001611 0.001676 0.001714 0.03% FabArray::mult() 34 0.001122 0.001296 0.001467 0.02% Castro::enforce_consistent_e() 3 0.000978 0.001203 0.001452 0.02% average_down_faces 84 0.001131 0.001219 0.001334 0.02% FillPatchTwoLevels 126 0.0006906 0.001107 0.001329 0.02% FabArray::ParallelCopy() 2952 0.001171 0.00122 0.001256 0.02% StateData::FillBoundary(geom) 8 0.001054 0.001089 0.001169 0.02% FabArrayBase::getFB() 5539 0.000967 0.001021 0.001158 0.02% MLCGSolver::bicgstab 13 0 0.0001397 0.001118 0.02% AMRErrorTag::operator() 15 0.000917 0.0009438 0.0009594 0.01% MLMG::solve() 14 0.000337 0.0006029 0.0008775 0.01% Gravity::actual_multilevel_solve() 14 0.0007889 0.000812 0.0008466 0.01% Castro::build_fine_mask() 55 0.0006178 0.0006665 0.0007054 0.01% Castro::sum_integrated_quantities() 1 0.0005233 0.0006035 0.0006911 0.01% AmrLevel::FillPatch() 215 0.0004863 0.000511 0.0005514 0.01% MLCellLinOp::apply() 1027 0.0004067 0.0004422 0.0005487 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004582 0.0004792 0.0005151 0.01% MLCellLinOp::prepareForSolve() 14 0.0003547 0.0003845 0.0004589 0.01% Amr::grid_places() 15 0.000302 0.000338 0.000457 0.01% main() 1 0.0003807 0.0004074 0.0004434 0.01% MLMG::mgVcycle() 318 0.0004032 0.0004264 0.0004429 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003346 0.0003947 0.0004304 0.01% MLMG::MLResNormInf() 32 0.0001078 0.0002871 0.0004202 0.01% MLCellLinOp::correctionResidual() 742 0.0003624 0.0003865 0.0004074 0.01% FabArray::setDomainBndry() 259 0.0003336 0.0003666 0.0004026 0.01% TagBoxArray::collate() 15 0.0002451 0.0002943 0.0003973 0.01% MLLinOp::defineGrids() 14 0.0002804 0.0003278 0.000378 0.01% MLCellLinOp::setLevelBC() 28 0.0003217 0.0003443 0.0003717 0.01% MLMG::actualBottomSolve() 106 2.031e-05 5.868e-05 0.0003096 0.00% MLMG::oneIter() 106 0.0002743 0.000293 0.0003068 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.000274 0.0002833 0.000297 0.00% MLMG::mgVcycle_bottom 318 0.0002275 0.0002424 0.0002641 0.00% MLCGSolver::ParallelAllReduce 95 0 3.05e-05 0.000244 0.00% Castro::locWgtSum() 6 0.0001976 0.0002039 0.0002092 0.00% MLCellLinOp::solutionResidual() 258 0.0001717 0.0001858 0.0002025 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.000176 0.0001849 0.0001978 0.00% AmrLevel::AmrLevel(dm) 16 0.0001417 0.0001615 0.0001974 0.00% StateDataPhysBCFunct::() 259 0.0001511 0.0001589 0.000176 0.00% FillPatchSingleLevel 259 0.0001365 0.0001438 0.0001664 0.00% MLMG:computeResOfCorrection() 530 0.0001541 0.0001584 0.0001644 0.00% MLMG::mgVcycle_down::0 106 0.0001214 0.0001312 0.000148 0.00% FabArrayBase::FB::FB() 35 8.049e-05 9.726e-05 0.0001462 0.00% Gravity::update_max_rhs() 1 9.312e-05 0.0001092 0.0001407 0.00% amrex::Dot() 54 0 1.664e-05 0.0001331 0.00% FPinfo::FPinfo() 9 7.461e-05 9.551e-05 0.0001325 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001195 0.0001264 0.0001317 0.00% FabArray::Saxpy() 54 0 1.629e-05 0.0001303 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001152 0.0001207 0.0001294 0.00% MLMG::mgVcycle_down::1 106 0.0001072 0.0001116 0.0001187 0.00% MLMG::miniCycle() 212 8.251e-05 9.663e-05 0.0001173 0.00% OwnerMask() 15 9.047e-05 9.886e-05 0.0001105 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.039e-05 8.645e-05 0.0001056 0.00% MLMG::mgVcycle_down::2 106 8.229e-05 8.754e-05 0.000103 0.00% TagBoxArray::mapPRD 15 9.336e-05 9.773e-05 0.0001011 0.00% MLMG::mgVcycle_down::3 106 7.512e-05 8.52e-05 0.0001004 0.00% MLMG::mgVcycle_down::4 106 6.846e-05 7.65e-05 8.924e-05 0.00% Castro::post_regrid() 30 7.109e-05 7.963e-05 8.882e-05 0.00% Castro::volProductSum() 2 8.132e-05 8.483e-05 8.738e-05 0.00% Amr::FinalizeInit() 1 1.934e-05 3.126e-05 8.371e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.765e-05 6.865e-05 8.339e-05 0.00% MLMG::mgVcycle_up::4 106 6.473e-05 7.085e-05 7.857e-05 0.00% FabArrayBase::TheFPinfo() 49 6.262e-05 6.779e-05 7.502e-05 0.00% Castro::avgDown(state_indx) 60 6.258e-05 6.761e-05 7.422e-05 0.00% MLMG::mgVcycle_up::1 106 5.905e-05 6.318e-05 7.28e-05 0.00% Castro::clean_state() 33 6.342e-05 6.696e-05 7.183e-05 0.00% Castro::derive() 97 6.041e-05 6.451e-05 7.156e-05 0.00% MLMG::mgVcycle_up::0 106 6.315e-05 6.654e-05 7.04e-05 0.00% MLMG::computeResidual() 106 5.261e-05 5.931e-05 6.915e-05 0.00% MLMG::mgVcycle_up::3 106 5.403e-05 5.814e-05 6.486e-05 0.00% ClusterList::intersect() 1 0 7.679e-06 6.143e-05 0.00% MLMG::mgVcycle_up::2 106 5.329e-05 5.647e-05 6.087e-05 0.00% Castro::errorEst() 15 4.22e-05 4.737e-05 5.938e-05 0.00% Amr::defBaseLevel() 1 2.957e-05 4.151e-05 5.542e-05 0.00% MLMG::computeMLResidual() 32 3.713e-05 4.186e-05 5.313e-05 0.00% amrex::average_down_w_geom 60 3.952e-05 4.518e-05 5.077e-05 0.00% Castro::init(old) 13 4.398e-05 4.671e-05 5.034e-05 0.00% Castro::avgDown() 15 3.42e-05 4.107e-05 4.979e-05 0.00% makeSFC 42 2.698e-05 3.544e-05 4.595e-05 0.00% MLPoisson::define() 14 3.495e-05 4.055e-05 4.412e-05 0.00% Amr::bldFineLevels() 1 1.543e-05 2.78e-05 4.2e-05 0.00% Amr::writeSmallPlotFile() 1 3.328e-05 3.454e-05 3.572e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.326e-05 2.629e-05 2.9e-05 0.00% DistributionMapping::Distribute() 46 2.223e-05 2.4e-05 2.794e-05 0.00% AmrMesh-cluster 1 0 3.448e-06 2.758e-05 0.00% Amr::initialInit() 1 1.416e-06 4.61e-06 2.56e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.769e-05 1.985e-05 2.216e-05 0.00% MLLinOp::define() 14 1.495e-05 1.828e-05 2.164e-05 0.00% MLMG::getGradSolution() 14 1.693e-05 1.836e-05 1.978e-05 0.00% FabArray::RecvLayoutMask() 14 1.642e-05 1.714e-05 1.785e-05 0.00% ClusterList::chop() 1 0 2.041e-06 1.632e-05 0.00% knapsack() 2 1.095e-05 1.225e-05 1.492e-05 0.00% BoxList::complementIn 30 1.075e-05 1.222e-05 1.428e-05 0.00% MLPoisson::prepareForSolve() 14 1.14e-05 1.234e-05 1.338e-05 0.00% Castro::enforce_speed_limit() 33 1.075e-05 1.221e-05 1.311e-05 0.00% BoxList::parallelComplementIn() 30 1.082e-05 1.121e-05 1.19e-05 0.00% Amr::initSubcycle() 1 9.887e-06 1.067e-05 1.167e-05 0.00% Castro::apply_problem_tags() 15 7.658e-06 8.092e-06 8.534e-06 0.00% MLMG::MLRhsNormInf() 14 7.37e-06 8.024e-06 8.515e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.492e-06 5.196e-06 6.74e-06 0.00% Amr::InitializeInit() 1 2.01e-06 3.077e-06 5.745e-06 0.00% Gravity::set_mass_offset() 1 7.03e-07 2.136e-06 3.953e-06 0.00% Amr::init() 1 1.659e-06 2.128e-06 3.677e-06 0.00% Castro::computeInitialDt() 1 1.244e-06 1.835e-06 2.356e-06 0.00% Castro::gwstrain() 2 8.58e-07 1.124e-06 1.675e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.539 6.539 6.539 100.00% Amr::init() 1 5.356 5.356 5.356 81.91% Amr::initialInit() 1 5.13 5.13 5.13 78.45% Amr::FinalizeInit() 1 5.004 5.016 5.022 76.79% Castro::post_init() 2 3.671 3.812 3.916 59.89% Gravity::multilevel_solve_for_new_phi() 14 1.784 1.795 1.801 27.55% Gravity::actual_multilevel_solve() 14 1.781 1.792 1.799 27.51% Gravity::solve_phi_with_mlmg() 14 1.775 1.786 1.792 27.41% Castro::computeTemp() 36 1.156 1.273 1.432 21.90% Amr::regrid() 14 1.281 1.306 1.35 20.65% Castro::clean_state() 33 1.112 1.203 1.327 20.29% Gravity::fill_multipole_BCs() 14 1.169 1.178 1.186 18.14% Amr::InitAmr() 1 1.182 1.182 1.182 18.08% Amr::bldFineLevels() 1 0.924 1.006 1.117 17.08% Castro::post_regrid() 30 0.8677 0.9139 0.9814 15.01% Castro::initData() 3 0.585 0.6891 0.8311 12.71% Gravity::actual_solve_with_mlmg() 14 0.6056 0.6074 0.6093 9.32% MLMG::solve() 14 0.5868 0.5873 0.5875 8.98% FabArray::ParallelCopy() 2952 0.1163 0.3618 0.5275 8.07% Castro::reset_internal_energy(MultiFab) 36 0.4058 0.451 0.5175 7.91% Castro::reset_internal_energy(Fab) 654 0.4054 0.4506 0.5171 7.91% MLMG::oneIter() 106 0.5133 0.5142 0.5148 7.87% FabArray::ParallelCopy_finish() 2952 0.05751 0.3071 0.4705 7.20% MLMG::mgVcycle() 318 0.3764 0.3771 0.3778 5.78% amrex::average_down 844 0.07577 0.2174 0.3217 4.92% MLCellLinOp::smooth() 2544 0.307 0.3091 0.3144 4.81% Castro::avgDown() 15 0.04497 0.1868 0.2914 4.46% Castro::avgDown(state_indx) 60 0.04493 0.1867 0.2914 4.46% amrex::average_down_w_geom 60 0.04486 0.1866 0.2913 4.45% Amr::writePlotFile() 1 0.2264 0.2265 0.2265 3.46% MLPoisson::Fsmooth() 5088 0.1983 0.2057 0.2196 3.36% Castro::derive() 97 0.2017 0.2019 0.202 3.09% AmrLevel::derive() 97 0.2016 0.2018 0.2019 3.09% Castro::normalize_species() 33 0.1626 0.1745 0.1924 2.94% Castro::Castro() 16 0.1263 0.1441 0.1654 2.53% Amr::grid_places() 15 0.02004 0.1004 0.1578 2.41% AmrMesh::MakeNewGrids() 15 0.01971 0.1001 0.1574 2.41% MLCellLinOp::applyBC() 6281 0.135 0.1466 0.1574 2.41% TagBoxArray::mapPRD 15 0.001689 0.08199 0.14 2.14% amrex::Copy() 948 0.1278 0.1325 0.1351 2.07% Amr::InitializeInit() 1 0.108 0.1134 0.1262 1.93% Amr::defBaseLevel() 1 0.108 0.1134 0.1262 1.93% FabArray::FillBoundary() 5539 0.09651 0.1108 0.1249 1.91% AmrLevel::FillPatch() 215 0.1186 0.1205 0.1224 1.87% Castro::initMFs() 16 0.09039 0.0999 0.1163 1.78% MLMG::mgVcycle_down::0 106 0.1047 0.1052 0.1058 1.62% MLMG::mgVcycle_bottom 318 0.09888 0.09999 0.1036 1.58% MLMG::miniCycle() 212 0.099 0.09975 0.1007 1.54% FillPatchIterator::Initialize 215 0.09378 0.09497 0.09688 1.48% MLMG::mgVcycle_up::0 106 0.09396 0.09418 0.09464 1.45% FillBoundary_finish() 5539 0.0473 0.0644 0.08007 1.22% MLMG::computeResWithCrseSolFineCor() 106 0.07615 0.07748 0.07862 1.20% AmrLevel::AmrLevel(dm) 16 0.05216 0.05747 0.06672 1.02% StateData::define() 64 0.05199 0.0573 0.06658 1.02% MLCellLinOp::apply() 1027 0.05897 0.06018 0.06088 0.93% FillPatchSingleLevel 259 0.05546 0.05838 0.06081 0.93% MLCellLinOp::correctionResidual() 742 0.05693 0.0582 0.05919 0.91% FabArray::ParallelCopy_nowait() 2952 0.05144 0.05353 0.05754 0.88% MLCellLinOp::solutionResidual() 258 0.05365 0.05509 0.05627 0.86% MLCellLinOp::reflux() 138 0.05158 0.05345 0.0544 0.83% FillPatchIterator::FillFromTwoLevels() 126 0.04735 0.05073 0.0534 0.82% FabArray::setVal() 1755 0.0391 0.04917 0.05328 0.81% FillPatchTwoLevels 126 0.04723 0.0506 0.05327 0.81% Castro::init(old) 13 0.04608 0.04866 0.05146 0.79% FillBoundary_nowait() 5539 0.04118 0.04431 0.04699 0.72% Castro::computeInitialDt() 1 0.02234 0.03508 0.04052 0.62% Castro::estTimeStep() 1 0.02234 0.03508 0.04052 0.62% MLMG::computeResWithCrseCorFineCor() 106 0.0304 0.03147 0.03226 0.49% MLMG::addInterpCorrection() 530 0.02122 0.03047 0.03204 0.49% FillPatchIterator::FillFromLevel0() 89 0.02435 0.02686 0.02928 0.45% MLMG::computeResidual() 106 0.0269 0.0281 0.02871 0.44% MLPoisson::Fapply() 1027 0.02409 0.0254 0.02759 0.42% MLMG::mgVcycle_down::1 106 0.02229 0.023 0.0235 0.36% MLMG::computeMLResidual() 32 0.02088 0.02164 0.02223 0.34% MLCellLinOp::updateSolBC() 120 0.01984 0.02064 0.02163 0.33% MLMG::mgVcycle_up::2 106 0.009213 0.01953 0.0212 0.32% VisMF::Write(FabArray) 2 0.01714 0.01781 0.01992 0.30% MLMG::mgVcycle_up::1 106 0.01957 0.01966 0.01977 0.30% MLCellLinOp::updateCorBC() 106 0.01783 0.01893 0.01974 0.30% Gravity::get_new_grav_vector() 4 0.01845 0.0187 0.01935 0.30% MLMG:computeResOfCorrection() 530 0.01834 0.01874 0.01906 0.29% Castro::buildMetrics() 16 0.01267 0.01413 0.01635 0.25% MLPoisson::define() 14 0.01121 0.01309 0.01494 0.23% FabArray::Xpay() 1000 0.01175 0.01305 0.01469 0.22% MultiFab::Multiply() 287 0.01237 0.0128 0.01314 0.20% amrex::Add() 562 0.01078 0.0116 0.01273 0.19% MLPoisson::FFlux() 3408 0.01117 0.0118 0.01246 0.19% MLMG::interpCorrection_1 106 0.009268 0.01064 0.01165 0.18% MLMG::ResNormInf() 152 0.009961 0.01078 0.01152 0.18% Castro::errorEst() 15 0.009376 0.009985 0.01049 0.16% MLMG::prepareForSolve() 14 0.009644 0.009956 0.01038 0.16% FillPatchInterp(MF) 44 0.001873 0.006842 0.01017 0.16% MLMG::mgVcycle_down::2 106 0.009094 0.009325 0.01014 0.16% Castro::apply_tagging_restrictions() 15 0.005732 0.006286 0.006707 0.10% FabArrayBase::getCPC() 3662 0.005082 0.005272 0.005633 0.09% MLCellLinOp::defineAuxData() 14 0.004976 0.005089 0.005477 0.08% FabArray::norminf(mask) 46 0.004665 0.004918 0.005175 0.08% MLCellLinOp::defineBC() 14 0.004875 0.005017 0.005164 0.08% MLLinOp::define() 14 0.0007599 0.002948 0.005 0.08% MLLinOp::defineGrids() 14 0.0007431 0.00293 0.004978 0.08% Castro::sum_integrated_quantities() 1 0.00484 0.004864 0.004924 0.08% MLMG::getGradSolution() 14 0.004482 0.004574 0.00473 0.07% MLCellLinOp::compGrad() 28 0.004463 0.004556 0.004712 0.07% MLMG::mgVcycle_down::3 106 0.001291 0.001788 0.00461 0.07% MLLinOp::makeSubCommunicator() 14 0.000366 0.002522 0.004507 0.07% MLMG::MLResNormInf() 32 0.003937 0.004055 0.004249 0.06% FabArray::norminf() 188 0.003093 0.003431 0.004109 0.06% MLMG::mgVcycle_up::3 106 0.0009581 0.001337 0.003759 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003259 0.003538 0.003741 0.06% Castro::enforce_min_density() 33 0.003052 0.003242 0.003532 0.05% MultiFab::max() 54 0.002752 0.003226 0.003452 0.05% BndryData::define() 42 0.002923 0.002999 0.003102 0.05% MLMG::actualBottomSolve() 106 2.031e-05 0.0003989 0.003031 0.05% FabArrayBase::TheFPinfo() 49 0.000497 0.001675 0.002829 0.04% FPinfo::FPinfo() 9 0.0004344 0.001608 0.002759 0.04% DistributionMapping::LeastUsedCPUs() 9 0.0003661 0.001535 0.002673 0.04% MLCGSolver::bicgstab 13 0 0.000333 0.002664 0.04% average_down_faces 84 0.002028 0.0023 0.002527 0.04% MLMG::mgVcycle_down::4 106 0.001166 0.001368 0.002512 0.04% FabArrayBase::CPC::define() 624 0.001649 0.001767 0.002068 0.03% MLMG::mgVcycle_up::4 106 0.001114 0.001263 0.00201 0.03% MLMG::MLRhsNormInf() 14 0.001707 0.001814 0.001936 0.03% Castro::volWgtSum() 46 0.001616 0.001681 0.001719 0.03% FabArray::mult() 34 0.001122 0.001296 0.001467 0.02% Castro::enforce_consistent_e() 3 0.000978 0.001203 0.001452 0.02% StateDataPhysBCFunct::() 259 0.001205 0.001248 0.001321 0.02% FabArrayBase::getFB() 5539 0.001056 0.001119 0.001304 0.02% Gravity::update_max_rhs() 1 0.0006823 0.0009939 0.001267 0.02% StateData::FillBoundary(geom) 8 0.001054 0.001089 0.001169 0.02% AMRErrorTag::operator() 15 0.000917 0.0009438 0.0009594 0.01% Castro::build_fine_mask() 55 0.0006178 0.0006665 0.0007054 0.01% DistributionMapping::KnapSackDoIt() 2 4.053e-05 0.0003342 0.0006454 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004582 0.0004792 0.0005151 0.01% MLPoisson::prepareForSolve() 14 0.0003661 0.0003969 0.0004704 0.01% MLCellLinOp::prepareForSolve() 14 0.0003547 0.0003845 0.0004589 0.01% FabArray::setDomainBndry() 259 0.0003336 0.0003666 0.0004026 0.01% TagBoxArray::collate() 15 0.0002451 0.0002943 0.0003973 0.01% MLCellLinOp::setLevelBC() 28 0.0003217 0.0003443 0.0003717 0.01% MLCGSolver::ParallelAllReduce 95 0 3.999e-05 0.0003199 0.00% Castro::locWgtSum() 6 0.0001982 0.0002044 0.0002097 0.00% FabArrayBase::FB::FB() 35 8.049e-05 9.726e-05 0.0001462 0.00% amrex::Dot() 54 0 1.664e-05 0.0001331 0.00% FabArray::Saxpy() 54 0 1.629e-05 0.0001303 0.00% OwnerMask() 15 9.047e-05 9.886e-05 0.0001105 0.00% AmrMesh-cluster 1 0 1.317e-05 0.0001053 0.00% MLLinOp::makeAgglomeratedDMap 14 6.672e-05 8.012e-05 9.28e-05 0.00% Castro::volProductSum() 2 8.146e-05 8.503e-05 8.758e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.586e-05 6.567e-05 8.112e-05 0.00% makeSFC 42 4.346e-05 5.382e-05 6.425e-05 0.00% ClusterList::intersect() 1 0 7.679e-06 6.143e-05 0.00% Amr::writeSmallPlotFile() 1 3.328e-05 3.454e-05 3.572e-05 0.00% DistributionMapping::Distribute() 46 2.223e-05 2.4e-05 2.794e-05 0.00% BoxList::parallelComplementIn() 30 2.183e-05 2.343e-05 2.538e-05 0.00% FabArray::RecvLayoutMask() 14 1.642e-05 1.714e-05 1.785e-05 0.00% ClusterList::chop() 1 0 2.041e-06 1.632e-05 0.00% knapsack() 2 1.095e-05 1.225e-05 1.492e-05 0.00% BoxList::complementIn 30 1.075e-05 1.222e-05 1.428e-05 0.00% Castro::enforce_speed_limit() 33 1.075e-05 1.221e-05 1.311e-05 0.00% Amr::initSubcycle() 1 9.887e-06 1.067e-05 1.167e-05 0.00% Castro::apply_problem_tags() 15 7.658e-06 8.092e-06 8.534e-06 0.00% Gravity::set_mass_offset() 1 7.03e-07 2.136e-06 3.953e-06 0.00% Castro::gwstrain() 2 8.58e-07 1.124e-06 1.675e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 18 B 20 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.02-1-g296ed40e16ae) finalized