Initializing AMReX (24.02-34-g3525b4a3f27e)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.02-34-g3525b4a3f27e) initialized Starting run at 08:25:15 UTC on 2024-03-04. Successfully read inputs file ... Castro git describe: 24.02-27-g465a83f5a AMReX git describe: 24.02-34-g3525b4a3f Microphysics git describe: 24.03-1-gce331bc8 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.003094017 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.121283844 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001656844 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002100429 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001188705 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001204883 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001218555 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001204716 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001228111 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001203739 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001225288 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001216258 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00120911 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001243566 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001218256 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.224384579 seconds Ending run at 08:25:22 UTC on 2024-03-04. Run time = 6.391325334 Run time without initialization = 0.0002910960002 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.391 ... 6.391 ... 6.391 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1449 1.1610 1.1809 18.48% Amr::InitAmr() 1 1.134 1.134 1.134 17.74% Castro::post_init() 2 0.9823 0.9834 0.9841 15.40% Castro::computeTemp() 36 0.7614 0.8141 0.8838 13.83% Castro::reset_internal_energy(Fab) 654 0.4008 0.4361 0.4833 7.56% FabArray::ParallelCopy_finish() 2952 0.0607 0.2732 0.4112 6.43% MLPoisson::Fsmooth() 5088 0.2336 0.2412 0.251 3.93% Castro::normalize_species() 33 0.1615 0.1721 0.1845 2.89% Castro::initData() 3 0.1172 0.1347 0.1573 2.46% AmrLevel::derive() 97 0.1389 0.1414 0.1441 2.25% amrex::Copy() 948 0.1291 0.1337 0.1353 2.12% Castro::initMFs() 16 0.08891 0.09962 0.1146 1.79% FillBoundary_finish() 5539 0.04833 0.06016 0.07501 1.17% StateData::define() 64 0.05075 0.05732 0.06545 1.02% Castro::estTimeStep() 1 0.0268 0.04768 0.05525 0.86% amrex::average_down 844 0.04176 0.04567 0.04992 0.78% FabArray::setVal() 1755 0.04026 0.04461 0.04832 0.76% FillBoundary_nowait() 5539 0.03951 0.04208 0.04482 0.70% MLCellLinOp::applyBC() 6281 0.03193 0.03412 0.03725 0.58% FabArray::ParallelCopy_nowait() 2952 0.02391 0.02613 0.03154 0.49% MLPoisson::Fapply() 1027 0.02315 0.0242 0.02542 0.40% VisMF::Write(FabArray) 2 0.0171 0.01749 0.01954 0.31% MLCellLinOp::reflux() 138 0.01803 0.01853 0.01917 0.30% FillPatchIterator::Initialize 215 0.01613 0.01701 0.01755 0.27% MLMG::addInterpCorrection() 530 0.01595 0.01614 0.01663 0.26% Castro::buildMetrics() 16 0.01108 0.01257 0.01439 0.23% Amr::regrid() 14 0.009551 0.01135 0.01363 0.21% FabArray::Xpay() 1000 0.01182 0.01253 0.01346 0.21% MultiFab::Multiply() 287 0.01269 0.01291 0.01328 0.21% MLCellLinOp::updateSolBC() 120 0.0098 0.01085 0.01199 0.19% amrex::Add() 562 0.01062 0.01113 0.01185 0.19% MLPoisson::FFlux() 3408 0.011 0.01118 0.01141 0.18% Castro::Castro() 16 0.007987 0.0089 0.01045 0.16% MLCellLinOp::updateCorBC() 106 0.008848 0.009683 0.01019 0.16% FillPatchInterp(MF) 44 0.001831 0.006738 0.01011 0.16% Amr::writePlotFile() 1 0.005519 0.007848 0.008311 0.13% AmrMesh::MakeNewGrids() 15 0.00764 0.007807 0.008106 0.13% MLMG::interpCorrection_1 106 0.006282 0.006949 0.007584 0.12% Castro::apply_tagging_restrictions() 15 0.005788 0.006353 0.006874 0.11% MLLinOp::makeSubCommunicator() 14 0.0004539 0.003415 0.005474 0.09% MLMG::prepareForSolve() 14 0.004743 0.004947 0.005174 0.08% FabArray::norminf(mask) 46 0.004648 0.004715 0.004783 0.07% MLCellLinOp::defineAuxData() 14 0.003941 0.004022 0.004227 0.07% MLMG::ResNormInf() 152 0.002599 0.003456 0.004197 0.07% FabArray::norminf() 188 0.002889 0.003212 0.003625 0.06% MultiFab::max() 54 0.002823 0.003261 0.00359 0.06% FabArrayBase::getCPC() 3662 0.003362 0.003458 0.003561 0.06% Castro::enforce_min_density() 33 0.003052 0.003194 0.003416 0.05% MLCellLinOp::compGrad() 28 0.003106 0.003264 0.003392 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002627 0.002852 0.003097 0.05% BndryData::define() 42 0.002474 0.002555 0.002647 0.04% Gravity::get_new_grav_vector() 4 0.001807 0.002102 0.002508 0.04% Gravity::actual_solve_with_mlmg() 14 0.002032 0.002098 0.002364 0.04% FabArray::FillBoundary() 5539 0.001936 0.00202 0.002109 0.03% FabArrayBase::CPC::define() 624 0.001604 0.00174 0.001977 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0003926 0.001335 0.001975 0.03% MLCellLinOp::defineBC() 14 0.0017 0.001814 0.001871 0.03% MLCellLinOp::smooth() 2544 0.001654 0.001703 0.00174 0.03% Castro::volWgtSum() 46 0.001659 0.001685 0.001736 0.03% FabArray::mult() 34 0.001144 0.001324 0.001679 0.03% Castro::enforce_consistent_e() 3 0.001024 0.001181 0.001387 0.02% FillPatchTwoLevels 126 0.0006765 0.001113 0.00136 0.02% FabArray::ParallelCopy() 2952 0.001189 0.001213 0.001258 0.02% average_down_faces 84 0.001045 0.001126 0.001192 0.02% StateData::FillBoundary(geom) 8 0.001075 0.0011 0.001139 0.02% FabArrayBase::getFB() 5539 0.0009396 0.0009976 0.001061 0.02% MLCGSolver::bicgstab 13 0 0.0001316 0.001053 0.02% AMRErrorTag::operator() 15 0.000912 0.0009373 0.0009695 0.02% Gravity::actual_multilevel_solve() 14 0.0007401 0.0008165 0.0008709 0.01% TagBoxArray::collate() 15 0.0001972 0.0003344 0.0007946 0.01% Castro::sum_integrated_quantities() 1 0.0005937 0.0006735 0.0007826 0.01% Castro::build_fine_mask() 55 0.0006286 0.0006951 0.0007435 0.01% MLMG::solve() 14 0.0003941 0.0004925 0.0005524 0.01% MLCellLinOp::apply() 1027 0.0004255 0.0004528 0.0005468 0.01% AmrLevel::FillPatch() 215 0.000494 0.000514 0.0005269 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003483 0.0003999 0.0005234 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004465 0.000464 0.0004859 0.01% MLMG::mgVcycle() 318 0.0003863 0.0004184 0.0004707 0.01% main() 1 0.0003822 0.0004134 0.0004634 0.01% Amr::grid_places() 15 0.0002991 0.000343 0.0004612 0.01% MLCellLinOp::prepareForSolve() 14 0.0003498 0.0003747 0.0004461 0.01% MLCellLinOp::correctionResidual() 742 0.0003919 0.0004102 0.0004252 0.01% FabArray::setDomainBndry() 259 0.0003481 0.0003647 0.0003806 0.01% MLLinOp::defineGrids() 14 0.0002659 0.0003078 0.0003708 0.01% MLCellLinOp::setLevelBC() 28 0.0003187 0.0003401 0.0003574 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002784 0.0002927 0.0003205 0.01% MLMG::oneIter() 106 0.0002591 0.0002805 0.0003087 0.00% MLMG::actualBottomSolve() 106 1.977e-05 5.628e-05 0.0002979 0.00% MLMG::MLResNormInf() 32 0.0001643 0.0002028 0.0002877 0.00% MLMG::mgVcycle_bottom 318 0.0002156 0.0002388 0.0002528 0.00% Castro::locWgtSum() 6 0.0002062 0.0002145 0.0002329 0.00% MLCGSolver::ParallelAllReduce 95 0 2.909e-05 0.0002327 0.00% MLCellLinOp::solutionResidual() 258 0.0001762 0.0001887 0.0002058 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001619 0.0001759 0.0001899 0.00% MLMG:computeResOfCorrection() 530 0.0001584 0.000165 0.0001732 0.00% StateDataPhysBCFunct::() 259 0.0001487 0.0001548 0.0001633 0.00% MLMG::mgVcycle_down::0 106 0.0001341 0.0001433 0.0001588 0.00% AmrLevel::AmrLevel(dm) 16 0.0001321 0.000148 0.0001569 0.00% FillPatchSingleLevel 259 0.0001307 0.0001395 0.0001464 0.00% FabArrayBase::FB::FB() 35 7.707e-05 9.287e-05 0.000143 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001244 0.0001303 0.0001396 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001158 0.0001249 0.0001381 0.00% amrex::Dot() 54 0 1.655e-05 0.0001324 0.00% Gravity::update_max_rhs() 1 8.447e-05 0.0001077 0.0001315 0.00% FabArray::Saxpy() 54 0 1.561e-05 0.0001249 0.00% MLMG::mgVcycle_down::1 106 0.0001134 0.0001172 0.0001193 0.00% OwnerMask() 15 8.986e-05 0.0001024 0.000116 0.00% Amr::FinalizeInit() 1 7.942e-06 3.274e-05 0.0001159 0.00% FPinfo::FPinfo() 9 7.85e-05 8.926e-05 0.0001078 0.00% Castro::post_regrid() 30 6.102e-05 7.841e-05 0.0001034 0.00% TagBoxArray::mapPRD 15 9.319e-05 9.827e-05 0.0001027 0.00% MLMG::miniCycle() 212 8.778e-05 9.38e-05 0.000102 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.538e-05 8.777e-05 9.253e-05 0.00% Castro::errorEst() 15 4.451e-05 5.715e-05 9.111e-05 0.00% MLMG::mgVcycle_down::2 106 8.318e-05 8.55e-05 9.098e-05 0.00% MLMG::mgVcycle_down::3 106 7.187e-05 7.928e-05 8.923e-05 0.00% Castro::clean_state() 33 6.394e-05 7.036e-05 8.647e-05 0.00% Castro::volProductSum() 2 7.8e-05 8.242e-05 8.602e-05 0.00% MLMG::mgVcycle_down::4 106 6.887e-05 7.293e-05 8.408e-05 0.00% MLMG::mgVcycle_up::4 106 6.475e-05 6.925e-05 7.75e-05 0.00% Castro::avgDown(state_indx) 60 6.572e-05 7.095e-05 7.631e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.899e-05 6.874e-05 7.482e-05 0.00% FabArrayBase::TheFPinfo() 49 5.985e-05 6.838e-05 7.414e-05 0.00% MLMG::mgVcycle_up::0 106 6.629e-05 6.937e-05 7.329e-05 0.00% MLMG::mgVcycle_up::1 106 5.918e-05 6.185e-05 6.965e-05 0.00% Castro::derive() 97 6.142e-05 6.346e-05 6.58e-05 0.00% MLMG::computeResidual() 106 5.626e-05 5.983e-05 6.387e-05 0.00% ClusterList::intersect() 1 0 7.894e-06 6.315e-05 0.00% MLMG::mgVcycle_up::3 106 5.448e-05 5.757e-05 6.272e-05 0.00% MLMG::mgVcycle_up::2 106 5.361e-05 5.586e-05 5.843e-05 0.00% amrex::average_down_w_geom 60 4.098e-05 4.766e-05 5.631e-05 0.00% Castro::init(old) 13 4.472e-05 4.722e-05 5.166e-05 0.00% MLPoisson::define() 14 3.847e-05 4.549e-05 5.015e-05 0.00% makeSFC 42 2.806e-05 3.43e-05 4.891e-05 0.00% Castro::avgDown() 15 3.494e-05 4.203e-05 4.687e-05 0.00% Amr::defBaseLevel() 1 1.961e-05 3.592e-05 4.625e-05 0.00% MLMG::getGradSolution() 14 1.508e-05 2.013e-05 4.422e-05 0.00% MLMG::computeMLResidual() 32 3.656e-05 3.828e-05 4.148e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.7e-05 2.915e-05 4.111e-05 0.00% Amr::writeSmallPlotFile() 1 3.237e-05 3.384e-05 3.505e-05 0.00% AmrMesh-cluster 1 0 3.88e-06 3.104e-05 0.00% Amr::bldFineLevels() 1 1.424e-05 2.081e-05 3.019e-05 0.00% BoxList::parallelComplementIn() 30 1.051e-05 1.355e-05 2.899e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.278e-05 2.454e-05 2.716e-05 0.00% DistributionMapping::Distribute() 46 2.313e-05 2.41e-05 2.503e-05 0.00% Amr::InitializeInit() 1 2.1e-06 4.746e-06 2.163e-05 0.00% MLLinOp::define() 14 1.398e-05 1.677e-05 2.069e-05 0.00% ClusterList::chop() 1 0 2.388e-06 1.91e-05 0.00% FabArray::RecvLayoutMask() 14 1.609e-05 1.679e-05 1.816e-05 0.00% Castro::apply_problem_tags() 15 7.21e-06 9.188e-06 1.475e-05 0.00% MLPoisson::prepareForSolve() 14 1.125e-05 1.283e-05 1.442e-05 0.00% BoxList::complementIn 30 1.013e-05 1.214e-05 1.422e-05 0.00% Castro::enforce_speed_limit() 33 1.046e-05 1.153e-05 1.341e-05 0.00% knapsack() 2 1.059e-05 1.143e-05 1.286e-05 0.00% Amr::initSubcycle() 1 9.982e-06 1.092e-05 1.199e-05 0.00% MLMG::MLRhsNormInf() 14 8.491e-06 9.026e-06 9.953e-06 0.00% Castro::gwstrain() 2 1.028e-06 2.378e-06 9.414e-06 0.00% DistributionMapping::KnapSackDoIt() 2 3.927e-06 4.697e-06 5.114e-06 0.00% Gravity::set_mass_offset() 1 8.89e-07 2.215e-06 3.861e-06 0.00% Castro::computeInitialDt() 1 1.426e-06 1.892e-06 2.577e-06 0.00% Amr::init() 1 1.662e-06 2.016e-06 2.319e-06 0.00% Amr::initialInit() 1 1.14e-06 1.561e-06 2.202e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.391 6.391 6.391 100.00% Amr::init() 1 5.257 5.257 5.257 82.25% Amr::initialInit() 1 5.032 5.032 5.032 78.74% Amr::FinalizeInit() 1 4.899 4.92 4.927 77.09% Castro::post_init() 2 3.605 3.727 3.801 59.48% Gravity::multilevel_solve_for_new_phi() 14 1.779 1.796 1.815 28.41% Gravity::actual_multilevel_solve() 14 1.776 1.794 1.813 28.36% Gravity::solve_phi_with_mlmg() 14 1.77 1.787 1.806 28.26% Castro::computeTemp() 36 1.163 1.251 1.366 21.38% Amr::regrid() 14 1.256 1.274 1.292 20.21% Castro::clean_state() 33 1.111 1.181 1.267 19.83% Gravity::fill_multipole_BCs() 14 1.146 1.163 1.183 18.50% Amr::InitAmr() 1 1.134 1.134 1.134 17.74% Amr::bldFineLevels() 1 0.9251 0.9838 1.081 16.91% Castro::post_regrid() 30 0.8574 0.8953 0.9377 14.67% Castro::initData() 3 0.6006 0.6786 0.7935 12.41% Gravity::actual_solve_with_mlmg() 14 0.6214 0.6241 0.6263 9.80% MLMG::solve() 14 0.6028 0.6032 0.6034 9.44% MLMG::oneIter() 106 0.5323 0.5328 0.5332 8.34% Castro::reset_internal_energy(MultiFab) 36 0.4012 0.4365 0.4837 7.57% Castro::reset_internal_energy(Fab) 654 0.4008 0.4361 0.4833 7.56% FabArray::ParallelCopy() 2952 0.1212 0.3281 0.4631 7.25% FabArray::ParallelCopy_finish() 2952 0.0607 0.2732 0.4112 6.43% MLMG::mgVcycle() 318 0.4009 0.4017 0.4027 6.30% MLCellLinOp::smooth() 2544 0.3375 0.3395 0.3451 5.40% amrex::average_down 844 0.07536 0.1971 0.2723 4.26% MLPoisson::Fsmooth() 5088 0.2336 0.2412 0.251 3.93% Castro::avgDown() 15 0.0456 0.1676 0.2423 3.79% Castro::avgDown(state_indx) 60 0.04556 0.1675 0.2423 3.79% amrex::average_down_w_geom 60 0.0455 0.1674 0.2422 3.79% Amr::writePlotFile() 1 0.2245 0.2247 0.2247 3.52% Castro::derive() 97 0.2002 0.2003 0.2007 3.14% AmrLevel::derive() 97 0.2001 0.2003 0.2006 3.14% Castro::normalize_species() 33 0.1615 0.1721 0.1845 2.89% Castro::Castro() 16 0.128 0.1408 0.1606 2.51% MLCellLinOp::applyBC() 6281 0.1328 0.1395 0.1496 2.34% Amr::grid_places() 15 0.02107 0.09382 0.1406 2.20% AmrMesh::MakeNewGrids() 15 0.02073 0.09348 0.1403 2.20% amrex::Copy() 948 0.1291 0.1337 0.1353 2.12% Amr::InitializeInit() 1 0.1051 0.1127 0.1336 2.09% Amr::defBaseLevel() 1 0.1051 0.1127 0.1336 2.09% TagBoxArray::mapPRD 15 0.001799 0.075 0.122 1.91% AmrLevel::FillPatch() 215 0.1145 0.1172 0.1201 1.88% FabArray::FillBoundary() 5539 0.09576 0.1054 0.1176 1.84% Castro::initMFs() 16 0.08891 0.09962 0.1146 1.79% MLMG::mgVcycle_bottom 318 0.1096 0.1109 0.1143 1.79% MLMG::mgVcycle_down::0 106 0.1114 0.112 0.1129 1.77% MLMG::miniCycle() 212 0.1098 0.1107 0.1116 1.75% MLMG::mgVcycle_up::0 106 0.1028 0.1031 0.1034 1.62% FillPatchIterator::Initialize 215 0.0878 0.09104 0.09482 1.48% FillBoundary_finish() 5539 0.04833 0.06016 0.07501 1.17% MLMG::computeResWithCrseSolFineCor() 106 0.07136 0.07285 0.07394 1.16% AmrLevel::AmrLevel(dm) 16 0.05091 0.05747 0.06559 1.03% StateData::define() 64 0.05075 0.05732 0.06545 1.02% FillPatchSingleLevel 259 0.05112 0.05528 0.06018 0.94% MLCellLinOp::apply() 1027 0.05643 0.05836 0.0601 0.94% FabArray::ParallelCopy_nowait() 2952 0.05069 0.05375 0.05919 0.93% MLCellLinOp::correctionResidual() 742 0.05416 0.05543 0.05673 0.89% MLCellLinOp::solutionResidual() 258 0.05206 0.05398 0.05535 0.87% Castro::computeInitialDt() 1 0.0268 0.04768 0.05525 0.86% Castro::estTimeStep() 1 0.0268 0.04768 0.05525 0.86% FillPatchIterator::FillFromTwoLevels() 126 0.04355 0.04706 0.05047 0.79% FillPatchTwoLevels 126 0.04343 0.04693 0.05034 0.79% MLCellLinOp::reflux() 138 0.04768 0.04923 0.05023 0.79% FabArray::setVal() 1755 0.04026 0.04461 0.04832 0.76% Castro::init(old) 13 0.04301 0.04536 0.04806 0.75% FillBoundary_nowait() 5539 0.04057 0.04317 0.04588 0.72% MLMG::computeResWithCrseCorFineCor() 106 0.02956 0.03034 0.0308 0.48% FillPatchIterator::FillFromLevel0() 89 0.02466 0.02664 0.02889 0.45% MLMG::addInterpCorrection() 530 0.01804 0.02711 0.02849 0.45% MLMG::computeResidual() 106 0.02677 0.02773 0.02811 0.44% MLPoisson::Fapply() 1027 0.02315 0.0242 0.02542 0.40% MLMG::mgVcycle_down::1 106 0.02234 0.02264 0.02312 0.36% MLMG::computeMLResidual() 32 0.02003 0.02073 0.02117 0.33% MLCellLinOp::updateSolBC() 120 0.01944 0.01983 0.02056 0.32% MLMG::mgVcycle_up::1 106 0.01982 0.02 0.0201 0.31% MLMG::mgVcycle_up::2 106 0.008383 0.01809 0.01959 0.31% VisMF::Write(FabArray) 2 0.0171 0.01749 0.01954 0.31% MLCellLinOp::updateCorBC() 106 0.01751 0.01817 0.01896 0.30% Gravity::get_new_grav_vector() 4 0.01775 0.01823 0.01891 0.30% MLMG:computeResOfCorrection() 530 0.01723 0.01763 0.01816 0.28% Castro::buildMetrics() 16 0.0124 0.01409 0.0162 0.25% MLPoisson::define() 14 0.0113 0.01394 0.01605 0.25% FabArray::Xpay() 1000 0.01182 0.01253 0.01346 0.21% MultiFab::Multiply() 287 0.01269 0.01291 0.01328 0.21% amrex::Add() 562 0.01062 0.01113 0.01185 0.19% MLPoisson::FFlux() 3408 0.011 0.01118 0.01141 0.18% MLMG::interpCorrection_1 106 0.009628 0.01057 0.01138 0.18% Castro::errorEst() 15 0.009452 0.01011 0.01067 0.17% MLMG::prepareForSolve() 14 0.00968 0.00992 0.01024 0.16% MLMG::ResNormInf() 152 0.009028 0.00959 0.01023 0.16% FillPatchInterp(MF) 44 0.001831 0.006738 0.01011 0.16% MLMG::mgVcycle_down::2 106 0.008888 0.009055 0.009839 0.15% Castro::apply_tagging_restrictions() 15 0.005788 0.006353 0.006874 0.11% MLLinOp::define() 14 0.0008302 0.003817 0.005962 0.09% MLLinOp::defineGrids() 14 0.0008152 0.0038 0.005941 0.09% FabArrayBase::getCPC() 3662 0.004966 0.005198 0.005498 0.09% MLLinOp::makeSubCommunicator() 14 0.0004539 0.003415 0.005474 0.09% MLCellLinOp::defineAuxData() 14 0.004918 0.005036 0.005367 0.08% MLCellLinOp::defineBC() 14 0.004931 0.00504 0.005141 0.08% Castro::sum_integrated_quantities() 1 0.004982 0.005001 0.005085 0.08% FabArray::norminf(mask) 46 0.004648 0.004715 0.004783 0.07% MLMG::getGradSolution() 14 0.004415 0.004526 0.004651 0.07% MLCellLinOp::compGrad() 28 0.004398 0.004505 0.004636 0.07% MLMG::mgVcycle_down::3 106 0.001325 0.001754 0.004433 0.07% MLMG::MLResNormInf() 32 0.00371 0.003797 0.003949 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.00335 0.003534 0.003658 0.06% FabArray::norminf() 188 0.002889 0.003212 0.003625 0.06% MultiFab::max() 54 0.002823 0.003261 0.00359 0.06% MLMG::mgVcycle_up::3 106 0.0009253 0.001263 0.003515 0.05% Castro::enforce_min_density() 33 0.003052 0.003194 0.003416 0.05% BndryData::define() 42 0.003014 0.003103 0.003199 0.05% MLMG::actualBottomSolve() 106 1.977e-05 0.0003766 0.002861 0.04% MLCGSolver::bicgstab 13 0 0.0003142 0.002513 0.04% MLMG::mgVcycle_down::4 106 0.001146 0.00131 0.002372 0.04% average_down_faces 84 0.001892 0.002127 0.002303 0.04% FabArrayBase::TheFPinfo() 49 0.0005257 0.001465 0.002123 0.03% FPinfo::FPinfo() 9 0.0004658 0.001396 0.002052 0.03% FabArrayBase::CPC::define() 624 0.001604 0.00174 0.001977 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0003926 0.001335 0.001975 0.03% MLMG::mgVcycle_up::4 106 0.001073 0.001196 0.001878 0.03% MLMG::MLRhsNormInf() 14 0.001744 0.001785 0.001832 0.03% Castro::volWgtSum() 46 0.001664 0.00169 0.001741 0.03% FabArray::mult() 34 0.001144 0.001324 0.001679 0.03% Castro::enforce_consistent_e() 3 0.001024 0.001181 0.001387 0.02% StateDataPhysBCFunct::() 259 0.001232 0.001255 0.001293 0.02% Gravity::update_max_rhs() 1 0.0006398 0.0009177 0.001206 0.02% FabArrayBase::getFB() 5539 0.001017 0.00109 0.001204 0.02% StateData::FillBoundary(geom) 8 0.001075 0.0011 0.001139 0.02% AMRErrorTag::operator() 15 0.000912 0.0009373 0.0009695 0.02% TagBoxArray::collate() 15 0.0001972 0.0003344 0.0007946 0.01% Castro::build_fine_mask() 55 0.0006286 0.0006951 0.0007435 0.01% DistributionMapping::KnapSackDoIt() 2 4.581e-05 0.0003403 0.0005779 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004465 0.000464 0.0004859 0.01% MLPoisson::prepareForSolve() 14 0.0003611 0.0003875 0.0004574 0.01% MLCellLinOp::prepareForSolve() 14 0.0003498 0.0003747 0.0004461 0.01% FabArray::setDomainBndry() 259 0.0003481 0.0003647 0.0003806 0.01% MLCellLinOp::setLevelBC() 28 0.0003187 0.0003401 0.0003574 0.01% MLCGSolver::ParallelAllReduce 95 0 3.923e-05 0.0003138 0.00% Castro::locWgtSum() 6 0.0002067 0.0002161 0.0002335 0.00% FabArrayBase::FB::FB() 35 7.707e-05 9.287e-05 0.000143 0.00% amrex::Dot() 54 0 1.655e-05 0.0001324 0.00% FabArray::Saxpy() 54 0 1.561e-05 0.0001249 0.00% OwnerMask() 15 8.986e-05 0.0001024 0.000116 0.00% AmrMesh-cluster 1 0 1.416e-05 0.0001133 0.00% MLLinOp::makeAgglomeratedDMap 14 6.983e-05 7.74e-05 9.61e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 5.938e-05 7.862e-05 9.066e-05 0.00% Castro::volProductSum() 2 7.82e-05 8.266e-05 8.622e-05 0.00% makeSFC 42 4.534e-05 5.285e-05 6.894e-05 0.00% ClusterList::intersect() 1 0 7.894e-06 6.315e-05 0.00% BoxList::parallelComplementIn() 30 2.099e-05 2.569e-05 3.912e-05 0.00% Amr::writeSmallPlotFile() 1 3.237e-05 3.384e-05 3.505e-05 0.00% DistributionMapping::Distribute() 46 2.313e-05 2.41e-05 2.503e-05 0.00% ClusterList::chop() 1 0 2.388e-06 1.91e-05 0.00% FabArray::RecvLayoutMask() 14 1.609e-05 1.679e-05 1.816e-05 0.00% Castro::apply_problem_tags() 15 7.21e-06 9.188e-06 1.475e-05 0.00% BoxList::complementIn 30 1.013e-05 1.214e-05 1.422e-05 0.00% Castro::enforce_speed_limit() 33 1.046e-05 1.153e-05 1.341e-05 0.00% knapsack() 2 1.059e-05 1.143e-05 1.286e-05 0.00% Amr::initSubcycle() 1 9.982e-06 1.092e-05 1.199e-05 0.00% Castro::gwstrain() 2 1.028e-06 2.378e-06 9.414e-06 0.00% Gravity::set_mass_offset() 1 8.89e-07 2.215e-06 3.861e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 19 B 20 B 23 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.02-34-g3525b4a3f27e) finalized