Initializing AMReX (23.12-5-gefd77ffab39c)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.12-5-gefd77ffab39c) initialized Starting run at 07:38:11 UTC on 2023-12-05. Successfully read inputs file ... Castro git describe: 23.11-12-g4f728c49f AMReX git describe: 23.12-5-gefd77ffab Microphysics git describe: 23.12 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002656127 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.149103718 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001572228 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001913175 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001140923 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001917181 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001135415 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001163981 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00127061 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001103662 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001159767 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001172348 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001101404 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001163308 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001122064 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.24045043 seconds Ending run at 07:38:18 UTC on 2023-12-05. Run time = 6.878405537 Run time without initialization = 0.0003679750002 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.878 ... 6.878 ... 6.878 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1749 1.2057 1.2322 17.91% Amr::InitAmr() 1 1.186 1.186 1.186 17.24% Castro::post_init() 2 1.088 1.094 1.104 16.05% Castro::computeTemp() 36 0.7647 0.8314 0.9206 13.38% FabArray::ParallelCopy_finish() 2952 0.1426 0.3807 0.5395 7.84% Castro::reset_internal_energy(Fab) 654 0.4109 0.448 0.5018 7.30% MLPoisson::Fsmooth() 5088 0.2363 0.2494 0.2623 3.81% Castro::normalize_species() 33 0.168 0.1773 0.1925 2.80% Castro::initData() 3 0.1263 0.1414 0.1613 2.35% AmrLevel::derive() 97 0.1402 0.1435 0.1475 2.14% amrex::Copy() 948 0.1215 0.1342 0.1458 2.12% Castro::initMFs() 16 0.09966 0.1209 0.1432 2.08% FillBoundary_finish() 5552 0.07071 0.08494 0.1048 1.52% FabArray::setVal() 1769 0.05444 0.07433 0.1043 1.52% StateData::define() 64 0.05291 0.06456 0.08197 1.19% amrex::average_down 844 0.04681 0.05025 0.05547 0.81% FillBoundary_nowait() 5552 0.04152 0.04385 0.04639 0.67% MLCellLinOp::applyBC() 6294 0.03452 0.03658 0.03992 0.58% FabArray::ParallelCopy_nowait() 2952 0.0266 0.03209 0.03614 0.53% VisMF::Write(FabArray) 2 0.02917 0.02986 0.03215 0.47% Castro::estTimeStep() 1 0.02218 0.02593 0.03157 0.46% MLPoisson::Fapply() 1040 0.0231 0.02511 0.02654 0.39% FillPatchIterator::Initialize 215 0.01678 0.02031 0.02477 0.36% Castro::Castro() 16 0.008876 0.0125 0.02057 0.30% Castro::buildMetrics() 16 0.01166 0.01447 0.01837 0.27% MLCellLinOp::reflux() 138 0.01626 0.01698 0.01769 0.26% MLMG::addInterpCorrection() 530 0.01607 0.01667 0.01759 0.26% MultiFab::Multiply() 287 0.01071 0.01334 0.01657 0.24% Amr::regrid() 14 0.01218 0.01397 0.01608 0.23% FabArray::Xpay() 1013 0.0123 0.01321 0.01439 0.21% amrex::Add() 575 0.01132 0.01249 0.01426 0.21% MLPoisson::FFlux() 3408 0.01109 0.01177 0.01225 0.18% MLCellLinOp::updateSolBC() 120 0.01024 0.0113 0.01195 0.17% Amr::writePlotFile() 1 0.005722 0.009014 0.0114 0.17% MLCellLinOp::updateCorBC() 106 0.009373 0.01033 0.01125 0.16% DistributionMapping::LeastUsedCPUs() 9 0.001314 0.00648 0.01029 0.15% FillPatchInterp(MF) 44 0.001842 0.006825 0.01026 0.15% MLMG::prepareForSolve() 14 0.005097 0.006644 0.008985 0.13% MultiFab::max() 54 0.003032 0.006527 0.008317 0.12% MLMG::interpCorrection_1 106 0.006505 0.007118 0.007652 0.11% Gravity::multilevel_solve_for_new_phi() 14 0.002754 0.004235 0.007189 0.10% Castro::apply_tagging_restrictions() 15 0.00587 0.006377 0.006922 0.10% MLLinOp::makeSubCommunicator() 14 0.00211 0.004312 0.006857 0.10% AmrMesh::MakeNewGrids() 15 0.006265 0.006366 0.006493 0.09% MLMG::ResNormInf() 152 0.00292 0.004173 0.005357 0.08% FabArray::norminf(mask) 46 0.004729 0.004962 0.005196 0.08% MLCellLinOp::defineAuxData() 14 0.004167 0.00424 0.004377 0.06% FabArrayBase::getCPC() 3662 0.003469 0.003885 0.004264 0.06% FabArray::norminf() 188 0.002951 0.003422 0.003865 0.06% MLCellLinOp::compGrad() 28 0.003159 0.003446 0.003676 0.05% Gravity::get_new_grav_vector() 4 0.001609 0.002394 0.003525 0.05% Castro::enforce_min_density() 33 0.002562 0.002819 0.003269 0.05% BndryData::define() 42 0.002525 0.002643 0.002803 0.04% Gravity::actual_solve_with_mlmg() 14 0.001997 0.002156 0.002467 0.04% FabArray::FillBoundary() 5552 0.002054 0.002205 0.002312 0.03% Castro::enforce_consistent_e() 3 0.001026 0.001391 0.002042 0.03% FabArrayBase::CPC::define() 624 0.001642 0.001775 0.00203 0.03% MLCellLinOp::defineBC() 14 0.001846 0.001944 0.001993 0.03% MLCellLinOp::smooth() 2544 0.001685 0.00179 0.001961 0.03% Gravity::actual_multilevel_solve() 14 0.0007747 0.0009914 0.00191 0.03% FabArray::mult() 34 0.001033 0.001337 0.001723 0.03% Castro::volWgtSum() 46 0.001604 0.001666 0.001719 0.02% FillPatchTwoLevels 126 0.00068 0.001126 0.001418 0.02% average_down_faces 84 0.00108 0.001192 0.00131 0.02% FabArray::ParallelCopy() 2952 0.001212 0.001247 0.001275 0.02% MLCGSolver::bicgstab 13 0 0.0001563 0.001251 0.02% StateData::FillBoundary(geom) 8 0.001063 0.001109 0.001153 0.02% AMRErrorTag::operator() 15 0.001078 0.001113 0.001144 0.02% FabArrayBase::getFB() 5552 0.0009677 0.001027 0.001131 0.02% MLMG::solve() 14 0.0004336 0.0006731 0.0008614 0.01% Castro::reset_internal_energy(MultiFab) 36 0.000324 0.0004605 0.000857 0.01% MLCellLinOp::apply() 1040 0.0004162 0.0004809 0.0008295 0.01% Castro::sum_integrated_quantities() 1 0.0004997 0.0006664 0.000798 0.01% Castro::build_fine_mask() 55 0.0006445 0.0006935 0.0007489 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005004 0.0005308 0.0005803 0.01% AmrLevel::FillPatch() 215 0.0004888 0.0005193 0.0005517 0.01% MLCellLinOp::prepareForSolve() 14 0.0003712 0.0004147 0.0005225 0.01% TagBoxArray::collate() 15 0.000264 0.0003164 0.0005156 0.01% main() 1 0.0003876 0.0004655 0.0005107 0.01% Amr::grid_places() 15 0.000324 0.0003578 0.0004934 0.01% MLCellLinOp::correctionResidual() 755 0.0003881 0.0004226 0.00047 0.01% MLMG::mgVcycle() 318 0.0004031 0.0004228 0.0004481 0.01% MLMG::MLResNormInf() 32 0.0001437 0.0003086 0.0004472 0.01% MLLinOp::defineGrids() 14 0.0002736 0.0003256 0.0004006 0.01% FabArray::setDomainBndry() 259 0.0003435 0.0003628 0.0003965 0.01% MLCellLinOp::setLevelBC() 28 0.0003375 0.0003613 0.0003787 0.01% MLMG::actualBottomSolve() 106 2.231e-05 6.449e-05 0.000337 0.00% MLMG::oneIter() 106 0.0002835 0.0002992 0.0003161 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002799 0.0002941 0.0003082 0.00% MLMG::mgVcycle_bottom 318 0.0002367 0.0002523 0.0002646 0.00% MLCGSolver::ParallelAllReduce 95 0 3.293e-05 0.0002634 0.00% Gravity::update_max_rhs() 1 8.373e-05 0.0001414 0.0002431 0.00% Castro::locWgtSum() 6 0.0001986 0.0002067 0.0002173 0.00% MLCellLinOp::solutionResidual() 258 0.0001932 0.0001984 0.0002094 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001618 0.0001795 0.0001979 0.00% MLMG:computeResOfCorrection() 530 0.0001627 0.0001683 0.0001742 0.00% StateDataPhysBCFunct::() 259 0.0001492 0.0001559 0.0001648 0.00% AmrLevel::AmrLevel(dm) 16 0.0001321 0.0001524 0.0001597 0.00% MLMG::mgVcycle_down::0 106 0.0001325 0.0001412 0.0001587 0.00% FabArrayBase::FB::FB() 35 8.034e-05 9.741e-05 0.0001517 0.00% FillPatchSingleLevel 259 0.0001371 0.0001431 0.0001493 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001191 0.0001276 0.0001373 0.00% Castro::post_regrid() 30 6.659e-05 8.456e-05 0.0001373 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001149 0.0001209 0.0001306 0.00% MLMG::mgVcycle_down::1 106 0.0001145 0.0001227 0.0001295 0.00% FabArray::Saxpy() 54 0 1.604e-05 0.0001283 0.00% amrex::Dot() 54 0 1.537e-05 0.000123 0.00% Amr::FinalizeInit() 1 1.429e-05 3.407e-05 0.0001126 0.00% MLMG::mgVcycle_down::3 106 7.803e-05 9.318e-05 0.0001106 0.00% OwnerMask() 15 9.66e-05 0.0001028 0.0001092 0.00% MLMG::miniCycle() 212 9.198e-05 9.71e-05 0.000107 0.00% FPinfo::FPinfo() 9 7.859e-05 8.819e-05 0.0001038 0.00% TagBoxArray::mapPRD 15 9.349e-05 9.728e-05 0.0001025 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.128e-05 9.044e-05 0.0001008 0.00% Castro::volProductSum() 2 7.864e-05 8.615e-05 9.599e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.864e-05 7.853e-05 9.509e-05 0.00% MLMG::mgVcycle_down::2 106 8.569e-05 8.997e-05 9.33e-05 0.00% Castro::clean_state() 33 6.674e-05 7.53e-05 8.764e-05 0.00% MLMG::mgVcycle_down::4 106 7.049e-05 7.916e-05 8.675e-05 0.00% Castro::avgDown(state_indx) 60 6.557e-05 7.144e-05 8.062e-05 0.00% amrex::average_down_w_geom 60 4.318e-05 4.992e-05 7.968e-05 0.00% FabArrayBase::TheFPinfo() 49 6.623e-05 7.221e-05 7.789e-05 0.00% Castro::derive() 97 6.189e-05 6.73e-05 7.416e-05 0.00% MLMG::mgVcycle_up::0 106 6.725e-05 7.067e-05 7.361e-05 0.00% MLMG::mgVcycle_up::4 106 6.354e-05 6.757e-05 7.212e-05 0.00% ClusterList::intersect() 1 0 8.339e-06 6.671e-05 0.00% Castro::avgDown() 15 3.811e-05 4.865e-05 6.667e-05 0.00% MLMG::mgVcycle_up::3 106 5.334e-05 5.936e-05 6.567e-05 0.00% MLMG::computeResidual() 106 5.77e-05 6.109e-05 6.536e-05 0.00% MLMG::mgVcycle_up::1 106 6.107e-05 6.214e-05 6.447e-05 0.00% MLPoisson::define() 14 4.137e-05 5.08e-05 5.983e-05 0.00% MLMG::mgVcycle_up::2 106 5.223e-05 5.601e-05 5.907e-05 0.00% Castro::init(old) 13 4.402e-05 4.94e-05 5.869e-05 0.00% Amr::defBaseLevel() 1 2.657e-05 4.078e-05 5.533e-05 0.00% Castro::errorEst() 15 4.406e-05 4.681e-05 5.187e-05 0.00% makeSFC 42 3.054e-05 3.734e-05 4.749e-05 0.00% MLMG::computeMLResidual() 32 3.64e-05 4.035e-05 4.235e-05 0.00% Amr::writeSmallPlotFile() 1 3.251e-05 3.326e-05 3.403e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.266e-05 2.599e-05 3.096e-05 0.00% AmrMesh-cluster 1 0 3.792e-06 3.033e-05 0.00% DistributionMapping::Distribute() 46 2.183e-05 2.521e-05 2.833e-05 0.00% Amr::initialInit() 1 1.211e-06 5.437e-06 2.48e-05 0.00% Castro::enforce_speed_limit() 33 1.246e-05 1.502e-05 2.387e-05 0.00% MLLinOp::define() 14 1.758e-05 1.994e-05 2.339e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.872e-05 2.057e-05 2.231e-05 0.00% MLMG::getGradSolution() 14 1.705e-05 1.904e-05 2.116e-05 0.00% BoxList::parallelComplementIn() 30 1.045e-05 1.249e-05 2.099e-05 0.00% BoxList::complementIn 30 1.011e-05 1.334e-05 1.96e-05 0.00% ClusterList::chop() 1 0 2.32e-06 1.856e-05 0.00% Amr::bldFineLevels() 1 1.61e-05 1.754e-05 1.852e-05 0.00% FabArray::RecvLayoutMask() 14 1.587e-05 1.674e-05 1.79e-05 0.00% knapsack() 2 1.08e-05 1.2e-05 1.45e-05 0.00% MLPoisson::prepareForSolve() 14 1.146e-05 1.256e-05 1.364e-05 0.00% Amr::initSubcycle() 1 1.044e-05 1.091e-05 1.131e-05 0.00% MLMG::MLRhsNormInf() 14 8.067e-06 9.077e-06 9.929e-06 0.00% Castro::apply_problem_tags() 15 7.625e-06 8.363e-06 9.591e-06 0.00% Amr::InitializeInit() 1 1.972e-06 2.964e-06 6.543e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.3e-06 4.763e-06 5.79e-06 0.00% Gravity::set_mass_offset() 1 9.13e-07 3.559e-06 5.008e-06 0.00% Amr::init() 1 1.87e-06 2.322e-06 2.834e-06 0.00% Castro::computeInitialDt() 1 1.411e-06 1.892e-06 2.256e-06 0.00% Castro::gwstrain() 2 8.76e-07 1.332e-06 1.91e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.878 6.878 6.878 100.00% Amr::init() 1 5.692 5.692 5.692 82.75% Amr::initialInit() 1 5.451 5.451 5.451 79.25% Amr::FinalizeInit() 1 5.331 5.335 5.341 77.64% Castro::post_init() 2 3.914 4.067 4.167 60.58% Gravity::multilevel_solve_for_new_phi() 14 1.87 1.905 1.932 28.09% Gravity::actual_multilevel_solve() 14 1.868 1.901 1.928 28.02% Gravity::solve_phi_with_mlmg() 14 1.861 1.894 1.921 27.93% Amr::regrid() 14 1.363 1.388 1.428 20.76% Castro::computeTemp() 36 1.179 1.28 1.423 20.69% Castro::clean_state() 33 1.127 1.211 1.326 19.27% Gravity::fill_multipole_BCs() 14 1.176 1.207 1.234 17.94% Amr::bldFineLevels() 1 0.9911 1.076 1.207 17.55% Amr::InitAmr() 1 1.186 1.186 1.186 17.24% Castro::post_regrid() 30 0.8691 0.9198 0.9819 14.27% Castro::initData() 3 0.6339 0.7094 0.8171 11.88% Gravity::actual_solve_with_mlmg() 14 0.6844 0.6865 0.6891 10.02% MLMG::solve() 14 0.6632 0.6637 0.6639 9.65% FabArray::ParallelCopy() 2952 0.2028 0.4403 0.5974 8.68% MLMG::oneIter() 106 0.5802 0.5813 0.5821 8.46% FabArray::ParallelCopy_finish() 2952 0.1426 0.3807 0.5395 7.84% Castro::reset_internal_energy(MultiFab) 36 0.4113 0.4485 0.5023 7.30% Castro::reset_internal_energy(Fab) 654 0.4109 0.448 0.5018 7.30% MLMG::mgVcycle() 318 0.4342 0.4354 0.4372 6.36% MLCellLinOp::smooth() 2544 0.367 0.3689 0.3754 5.46% amrex::average_down 844 0.1074 0.2591 0.3546 5.16% Castro::avgDown() 15 0.07622 0.2261 0.3228 4.69% Castro::avgDown(state_indx) 60 0.07618 0.226 0.3228 4.69% amrex::average_down_w_geom 60 0.07611 0.226 0.3227 4.69% MLPoisson::Fsmooth() 5088 0.2363 0.2494 0.2623 3.81% Castro::Castro() 16 0.1463 0.1823 0.2454 3.57% Amr::writePlotFile() 1 0.2406 0.2407 0.2408 3.50% Castro::derive() 97 0.2008 0.2029 0.2046 2.97% AmrLevel::derive() 97 0.2008 0.2028 0.2045 2.97% Castro::normalize_species() 33 0.168 0.1773 0.1925 2.80% MLCellLinOp::applyBC() 6294 0.1601 0.1687 0.1854 2.69% Amr::grid_places() 15 0.02001 0.1083 0.1672 2.43% AmrMesh::MakeNewGrids() 15 0.01969 0.1079 0.1668 2.43% AmrLevel::FillPatch() 215 0.1406 0.1519 0.161 2.34% FabArray::FillBoundary() 5552 0.1206 0.1321 0.1508 2.19% TagBoxArray::mapPRD 15 0.002953 0.09063 0.1494 2.17% amrex::Copy() 948 0.1215 0.1342 0.1458 2.12% Castro::initMFs() 16 0.09966 0.1209 0.1432 2.08% FillPatchIterator::Initialize 215 0.1174 0.1271 0.1373 2.00% MLMG::mgVcycle_bottom 318 0.1197 0.1207 0.1249 1.82% MLMG::mgVcycle_down::0 106 0.1202 0.121 0.122 1.77% MLMG::miniCycle() 212 0.1198 0.1204 0.1215 1.77% Amr::InitializeInit() 1 0.1105 0.1162 0.1199 1.74% Amr::defBaseLevel() 1 0.1105 0.1162 0.1199 1.74% MLMG::mgVcycle_up::0 106 0.1088 0.1091 0.1096 1.59% FillBoundary_finish() 5552 0.07071 0.08494 0.1048 1.52% FabArray::setVal() 1769 0.05444 0.07433 0.1043 1.52% FillPatchSingleLevel 259 0.06803 0.07939 0.09438 1.37% FillPatchIterator::FillFromTwoLevels() 126 0.05592 0.07692 0.08448 1.23% FillPatchTwoLevels 126 0.05579 0.07679 0.08435 1.23% AmrLevel::AmrLevel(dm) 16 0.05306 0.06471 0.08212 1.19% StateData::define() 64 0.05291 0.06456 0.08197 1.19% MLMG::computeResWithCrseSolFineCor() 106 0.07742 0.07945 0.08181 1.19% Castro::init(old) 13 0.05197 0.06933 0.07758 1.13% MLCellLinOp::apply() 1040 0.06397 0.06591 0.0676 0.98% MLCellLinOp::solutionResidual() 258 0.06171 0.06366 0.06685 0.97% MLCellLinOp::correctionResidual() 755 0.05899 0.06193 0.06333 0.92% FabArray::ParallelCopy_nowait() 2952 0.05423 0.05837 0.0616 0.90% MLCellLinOp::reflux() 138 0.04926 0.05217 0.05346 0.78% FillBoundary_nowait() 5552 0.04261 0.04497 0.04767 0.69% FillPatchIterator::FillFromLevel0() 89 0.02423 0.02952 0.03643 0.53% MLMG::computeResWithCrseCorFineCor() 106 0.03225 0.0342 0.03467 0.50% VisMF::Write(FabArray) 2 0.02917 0.02986 0.03215 0.47% MLMG::computeResidual() 106 0.02839 0.03039 0.03187 0.46% Castro::computeInitialDt() 1 0.02218 0.02593 0.03157 0.46% Castro::estTimeStep() 1 0.02218 0.02593 0.03157 0.46% MLMG::addInterpCorrection() 530 0.01908 0.02908 0.03086 0.45% Gravity::get_new_grav_vector() 4 0.02712 0.02932 0.03035 0.44% MLCellLinOp::updateSolBC() 120 0.02321 0.02578 0.02799 0.41% MLMG::computeMLResidual() 32 0.02424 0.02631 0.02772 0.40% MLPoisson::Fapply() 1040 0.0231 0.02511 0.02654 0.39% MLMG::mgVcycle_down::1 106 0.02498 0.02602 0.02648 0.38% MLMG::mgVcycle_up::1 106 0.02229 0.0224 0.0225 0.33% MLMG::mgVcycle_up::2 106 0.009027 0.02003 0.02189 0.32% MLCellLinOp::updateCorBC() 106 0.01941 0.02013 0.02073 0.30% Castro::buildMetrics() 16 0.01343 0.01626 0.02037 0.30% MLMG:computeResOfCorrection() 530 0.01876 0.01919 0.01966 0.29% MLPoisson::define() 14 0.01323 0.01541 0.01783 0.26% MultiFab::Multiply() 287 0.01071 0.01334 0.01657 0.24% FabArray::Xpay() 1013 0.0123 0.01321 0.01439 0.21% MLMG::prepareForSolve() 14 0.01031 0.01217 0.01432 0.21% amrex::Add() 575 0.01132 0.01249 0.01426 0.21% MLMG::interpCorrection_1 106 0.01151 0.01237 0.01321 0.19% MLPoisson::FFlux() 3408 0.01109 0.01177 0.01225 0.18% MLMG::ResNormInf() 152 0.009454 0.0107 0.01207 0.18% Castro::errorEst() 15 0.009608 0.01034 0.0113 0.16% MLMG::mgVcycle_down::2 106 0.009478 0.009939 0.01086 0.16% FabArrayBase::TheFPinfo() 49 0.001438 0.006611 0.01044 0.15% FPinfo::FPinfo() 9 0.001368 0.006539 0.01037 0.15% DistributionMapping::LeastUsedCPUs() 9 0.001314 0.00648 0.01029 0.15% FillPatchInterp(MF) 44 0.001842 0.006825 0.01026 0.15% MultiFab::max() 54 0.003032 0.006527 0.008317 0.12% MLLinOp::define() 14 0.0025 0.00474 0.007379 0.11% MLLinOp::defineGrids() 14 0.002483 0.00472 0.007358 0.11% Castro::apply_tagging_restrictions() 15 0.00587 0.006377 0.006922 0.10% MLLinOp::makeSubCommunicator() 14 0.00211 0.004312 0.006857 0.10% FabArrayBase::getCPC() 3662 0.005212 0.00566 0.00612 0.09% Gravity::update_max_rhs() 1 0.0008005 0.003876 0.00558 0.08% MLCellLinOp::defineAuxData() 14 0.005186 0.005298 0.005573 0.08% MLCellLinOp::defineBC() 14 0.005134 0.005326 0.005486 0.08% FabArray::norminf(mask) 46 0.004729 0.004962 0.005196 0.08% MLMG::getGradSolution() 14 0.004692 0.0049 0.005114 0.07% MLCellLinOp::compGrad() 28 0.004672 0.004881 0.005093 0.07% Castro::sum_integrated_quantities() 1 0.004884 0.004904 0.004952 0.07% MLMG::mgVcycle_down::3 106 0.001323 0.001832 0.004724 0.07% MLMG::MLResNormInf() 32 0.004051 0.004132 0.004243 0.06% FabArray::norminf() 188 0.002951 0.003422 0.003865 0.06% MLMG::mgVcycle_up::3 106 0.0009228 0.001315 0.003767 0.05% Gravity::average_fine_ec_onto_crse_ec() 14 0.00311 0.003405 0.003617 0.05% MLMG::actualBottomSolve() 106 2.231e-05 0.0004697 0.003578 0.05% BndryData::define() 42 0.003098 0.00325 0.003436 0.05% Castro::enforce_min_density() 33 0.002562 0.002819 0.003269 0.05% MLCGSolver::bicgstab 13 0 0.0003981 0.003185 0.05% MLMG::mgVcycle_down::4 106 0.001144 0.001371 0.002483 0.04% average_down_faces 84 0.001967 0.002222 0.002473 0.04% Castro::enforce_consistent_e() 3 0.001026 0.001391 0.002042 0.03% FabArrayBase::CPC::define() 624 0.001642 0.001775 0.00203 0.03% MLMG::mgVcycle_up::4 106 0.001098 0.001261 0.002028 0.03% MLMG::MLRhsNormInf() 14 0.001762 0.001849 0.001955 0.03% Castro::volWgtSum() 46 0.001609 0.001672 0.001724 0.03% FabArray::mult() 34 0.001033 0.001337 0.001723 0.03% StateDataPhysBCFunct::() 259 0.001217 0.001265 0.001311 0.02% FabArrayBase::getFB() 5552 0.001057 0.001124 0.001283 0.02% StateData::FillBoundary(geom) 8 0.001063 0.001109 0.001153 0.02% AMRErrorTag::operator() 15 0.001078 0.001113 0.001144 0.02% DistributionMapping::KnapSackDoIt() 2 0.0001197 0.0006027 0.001126 0.02% Castro::build_fine_mask() 55 0.0006445 0.0006935 0.0007489 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005004 0.0005308 0.0005803 0.01% MLPoisson::prepareForSolve() 14 0.0003846 0.0004273 0.0005358 0.01% MLCellLinOp::prepareForSolve() 14 0.0003712 0.0004147 0.0005225 0.01% TagBoxArray::collate() 15 0.000264 0.0003164 0.0005156 0.01% FabArray::setDomainBndry() 259 0.0003435 0.0003628 0.0003965 0.01% MLCellLinOp::setLevelBC() 28 0.0003375 0.0003613 0.0003787 0.01% MLCGSolver::ParallelAllReduce 95 0 4.174e-05 0.0003339 0.00% Castro::locWgtSum() 6 0.0001992 0.0002073 0.0002177 0.00% FabArrayBase::FB::FB() 35 8.034e-05 9.741e-05 0.0001517 0.00% FabArray::Saxpy() 54 0 1.604e-05 0.0001283 0.00% amrex::Dot() 54 0 1.537e-05 0.000123 0.00% AmrMesh-cluster 1 0 1.445e-05 0.0001156 0.00% OwnerMask() 15 9.66e-05 0.0001028 0.0001092 0.00% MLLinOp::makeAgglomeratedDMap 14 7.028e-05 8.265e-05 0.0001007 0.00% Castro::volProductSum() 2 7.894e-05 8.637e-05 9.625e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 5.311e-05 7.275e-05 7.856e-05 0.00% makeSFC 42 4.762e-05 5.666e-05 6.975e-05 0.00% ClusterList::intersect() 1 0 8.339e-06 6.671e-05 0.00% BoxList::parallelComplementIn() 30 2.055e-05 2.583e-05 4.059e-05 0.00% Amr::writeSmallPlotFile() 1 3.251e-05 3.326e-05 3.403e-05 0.00% DistributionMapping::Distribute() 46 2.183e-05 2.521e-05 2.833e-05 0.00% Castro::enforce_speed_limit() 33 1.246e-05 1.502e-05 2.387e-05 0.00% BoxList::complementIn 30 1.011e-05 1.334e-05 1.96e-05 0.00% ClusterList::chop() 1 0 2.32e-06 1.856e-05 0.00% FabArray::RecvLayoutMask() 14 1.587e-05 1.674e-05 1.79e-05 0.00% knapsack() 2 1.08e-05 1.2e-05 1.45e-05 0.00% Amr::initSubcycle() 1 1.044e-05 1.091e-05 1.131e-05 0.00% Castro::apply_problem_tags() 15 7.625e-06 8.363e-06 9.591e-06 0.00% Gravity::set_mass_offset() 1 9.13e-07 3.559e-06 5.008e-06 0.00% Castro::gwstrain() 2 8.76e-07 1.332e-06 1.91e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 15 B 17 B 19 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.12-5-gefd77ffab39c) finalized