MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.09-26-gd45933c3616d) initialized Starting run at 06:37:17 UTC on 2023-09-28. Successfully read inputs file ... Castro git describe: 23.09-34-g7561a65ab AMReX git describe: 23.09-26-gd45933c36 Microphysics git describe: 23.09-15-g2261118f reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.003019928 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.174313138 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001597442 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001905675 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001048586 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001061899 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001081017 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00109387 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001041075 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001084616 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001035244 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001050191 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001051899 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001039952 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001048223 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.272650687 seconds Ending run at 06:37:24 UTC on 2023-09-28. Run time = 7.441126213 Run time without initialization = 0.000244071 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 7.441 ... 7.441 ... 7.441 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 2.0636 2.0636 2.0636 27.73% Gravity::fill_multipole_BCs() 14 1.133 1.153 1.173 15.77% Castro::post_init() 2 1.013 1.014 1.015 13.64% Castro::computeTemp() 36 0.6972 0.7506 0.8506 11.43% Castro::reset_internal_energy(Fab) 654 0.3981 0.4295 0.4932 6.63% FabArray::ParallelCopy_finish() 2952 0.06271 0.3385 0.4928 6.62% MLPoisson::Fsmooth() 5088 0.2419 0.2511 0.2676 3.60% Castro::normalize_species() 33 0.1651 0.1745 0.1941 2.61% Castro::initData() 3 0.1161 0.1315 0.1665 2.24% AmrLevel::derive() 97 0.1394 0.142 0.1445 1.94% amrex::Copy() 975 0.1353 0.1383 0.1426 1.92% Castro::initMFs() 16 0.09016 0.1063 0.1301 1.75% FillBoundary_finish() 5552 0.05034 0.06982 0.08136 1.09% StateData::define() 64 0.05156 0.05925 0.07494 1.01% VisMF::Write(FabArray) 2 0.0205 0.05869 0.0667 0.90% amrex::average_down 844 0.04352 0.0502 0.05551 0.75% Amr::writePlotFile() 1 0.005266 0.01313 0.05144 0.69% FabArray::setVal() 1769 0.04512 0.0477 0.0505 0.68% FillBoundary_nowait() 5552 0.03959 0.04297 0.04774 0.64% Castro::estTimeStep() 1 0.02602 0.04133 0.04456 0.60% MLCellLinOp::applyBC() 6294 0.03829 0.03923 0.04317 0.58% FabArray::ParallelCopy_nowait() 2952 0.02347 0.02664 0.0335 0.45% MLPoisson::Fapply() 1040 0.02504 0.02579 0.02752 0.37% MLCellLinOp::reflux() 138 0.01878 0.0195 0.02027 0.27% MLMG::addInterpCorrection() 530 0.01727 0.01772 0.01867 0.25% FillPatchIterator::Initialize 215 0.01642 0.0173 0.01798 0.24% Castro::buildMetrics() 16 0.01127 0.01338 0.0171 0.23% Amr::regrid() 14 0.01322 0.01465 0.01695 0.23% FabArray::Xpay() 1013 0.01195 0.01284 0.0136 0.18% amrex::Add() 575 0.01158 0.01265 0.01349 0.18% MultiFab::Multiply() 287 0.01292 0.01312 0.01328 0.18% MLPoisson::FFlux() 3408 0.01157 0.01196 0.01246 0.17% MLCellLinOp::updateSolBC() 120 0.0108 0.01166 0.01225 0.16% MLCellLinOp::updateCorBC() 106 0.009802 0.01056 0.01109 0.15% FillPatchInterp(MF) 44 0.00197 0.007334 0.01108 0.15% Castro::Castro() 16 0.008082 0.008874 0.01075 0.14% MLMG::interpCorrection_1 106 0.00649 0.007101 0.007818 0.11% AmrMesh::MakeNewGrids() 15 0.00624 0.006347 0.006441 0.09% MLMG::ResNormInf() 152 0.00248 0.00423 0.006356 0.09% DistributionMapping::LeastUsedCPUs() 9 0.0001939 0.003547 0.006332 0.09% Castro::apply_tagging_restrictions() 15 0.005537 0.00588 0.006246 0.08% MLMG::prepareForSolve() 14 0.004945 0.005091 0.005237 0.07% FabArray::norminf(mask) 46 0.004893 0.005029 0.005175 0.07% MLLinOp::makeSubCommunicator() 14 0.0003792 0.002387 0.004519 0.06% MLCellLinOp::defineAuxData() 14 0.003891 0.00396 0.004184 0.06% Castro::enforce_min_density() 33 0.003315 0.00355 0.003933 0.05% FabArray::norminf() 174 0.003093 0.003372 0.003897 0.05% MultiFab::max() 54 0.00291 0.00332 0.003724 0.05% FabArrayBase::getCPC() 3662 0.003477 0.003542 0.003612 0.05% MLCellLinOp::compGrad() 28 0.003223 0.003327 0.003441 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002696 0.002995 0.003397 0.05% Gravity::get_new_grav_vector() 4 0.001869 0.002115 0.002509 0.03% BndryData::define() 42 0.002295 0.002365 0.00244 0.03% Gravity::actual_solve_with_mlmg() 14 0.001998 0.00207 0.002322 0.03% FabArray::FillBoundary() 5552 0.001964 0.002046 0.002221 0.03% MLCellLinOp::defineBC() 14 0.001903 0.001988 0.002057 0.03% FabArrayBase::CPC::define() 624 0.001645 0.001749 0.002011 0.03% MLCellLinOp::smooth() 2544 0.001728 0.001775 0.001865 0.03% Castro::volWgtSum() 46 0.001663 0.001699 0.001719 0.02% FabArray::mult() 34 0.001164 0.001345 0.001714 0.02% MLCGSolver::bicgstab 13 0 0.0002063 0.001651 0.02% Castro::enforce_consistent_e() 3 0.001011 0.001172 0.001591 0.02% StateData::FillBoundary(geom) 8 0.001249 0.0013 0.001391 0.02% FillPatchTwoLevels 126 0.0006744 0.001107 0.00139 0.02% FabArray::ParallelCopy() 2952 0.00124 0.001263 0.001318 0.02% average_down_faces 84 0.001106 0.001166 0.001278 0.02% FabArrayBase::getFB() 5552 0.0009536 0.001022 0.001176 0.02% AMRErrorTag::operator() 15 0.0009206 0.0009447 0.0009652 0.01% Gravity::actual_multilevel_solve() 14 0.0007927 0.0008714 0.0009272 0.01% Castro::sum_integrated_quantities() 1 0.0004987 0.0006601 0.0008747 0.01% TagBoxArray::collate() 15 0.0002074 0.000334 0.0008199 0.01% Castro::build_fine_mask() 55 0.0006329 0.0007167 0.000799 0.01% MLCellLinOp::apply() 1040 0.0004256 0.0004615 0.0006195 0.01% MLMG::solve() 14 0.0004006 0.0005149 0.0005993 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004714 0.0004963 0.0005375 0.01% AmrLevel::FillPatch() 215 0.0004917 0.0005111 0.0005353 0.01% MLMG::mgVcycle() 318 0.0004309 0.0004648 0.0005125 0.01% MLCellLinOp::correctionResidual() 755 0.0003903 0.0004205 0.0004761 0.01% MLCellLinOp::prepareForSolve() 14 0.0003548 0.0003799 0.0004563 0.01% FabArray::setDomainBndry() 259 0.0003895 0.0004117 0.0004412 0.01% Amr::grid_places() 15 0.0003151 0.0003433 0.000436 0.01% main() 1 0.0003607 0.0003735 0.0003919 0.01% MLCellLinOp::setLevelBC() 28 0.0003291 0.0003495 0.0003868 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002554 0.000287 0.0003325 0.00% MLLinOp::defineGrids() 14 0.0002526 0.0002894 0.000321 0.00% MLMG::MLResNormInf() 32 0.0001071 0.0002312 0.0003162 0.00% MLMG::oneIter() 106 0.0002595 0.0002736 0.0003102 0.00% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002734 0.0002839 0.0002933 0.00% MLMG::actualBottomSolve() 106 2.273e-05 5.58e-05 0.0002806 0.00% MLMG::mgVcycle_bottom 318 0.0002325 0.0002618 0.0002778 0.00% MLCGSolver::ParallelAllReduce 81 0 3.463e-05 0.0002771 0.00% Castro::locWgtSum() 6 0.0001869 0.0001929 0.0002007 0.00% MLCellLinOp::solutionResidual() 258 0.0001786 0.0001877 0.0001973 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001658 0.0001727 0.0001806 0.00% MLMG:computeResOfCorrection() 530 0.000149 0.0001562 0.0001661 0.00% MLMG::mgVcycle_down::0 106 0.0001338 0.0001404 0.0001581 0.00% AmrLevel::AmrLevel(dm) 16 0.0001328 0.0001442 0.0001551 0.00% StateDataPhysBCFunct::() 259 0.0001351 0.0001403 0.0001482 0.00% FillPatchSingleLevel 259 0.0001368 0.0001402 0.0001467 0.00% FabArrayBase::FB::FB() 35 7.507e-05 8.862e-05 0.0001402 0.00% amrex::Dot() 54 0 1.708e-05 0.0001366 0.00% Gravity::update_max_rhs() 1 7.76e-05 0.0001001 0.0001345 0.00% MLMG::miniCycle() 212 9.776e-05 0.0001134 0.0001298 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001207 0.000126 0.0001298 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001134 0.0001203 0.0001288 0.00% MLMG::mgVcycle_down::1 106 0.0001098 0.0001134 0.0001188 0.00% MLMG::mgVcycle_down::2 106 8.242e-05 9.456e-05 0.0001118 0.00% OwnerMask() 15 8.585e-05 9.572e-05 0.0001054 0.00% TagBoxArray::mapPRD 15 9.277e-05 9.963e-05 0.0001051 0.00% FPinfo::FPinfo() 9 6.906e-05 7.84e-05 0.0001042 0.00% MLMG::mgVcycle_down::3 106 7.523e-05 8.423e-05 0.0001036 0.00% FabArray::LinComb() 27 0 1.257e-05 0.0001005 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.484e-05 8.94e-05 9.754e-05 0.00% FabArray::Saxpy() 27 0 1.161e-05 9.291e-05 0.00% Castro::volProductSum() 2 8.432e-05 8.677e-05 9.158e-05 0.00% MLMG::mgVcycle_down::4 106 6.994e-05 7.455e-05 8.555e-05 0.00% Castro::avgDown(state_indx) 60 6.657e-05 7.256e-05 7.975e-05 0.00% MLMG::mgVcycle_up::2 106 5.427e-05 6.167e-05 7.849e-05 0.00% MLMG::mgVcycle_up::4 106 6.67e-05 7.037e-05 7.697e-05 0.00% Amr::FinalizeInit() 1 6.692e-06 1.602e-05 7.694e-05 0.00% MLMG::mgVcycle_up::0 106 6.823e-05 7.06e-05 7.454e-05 0.00% MLMG::mgVcycle_up::1 106 6.09e-05 6.36e-05 7.323e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.179e-05 6.571e-05 7.22e-05 0.00% Castro::derive() 97 6.297e-05 6.587e-05 7.203e-05 0.00% Castro::clean_state() 33 6.013e-05 6.594e-05 7.141e-05 0.00% MLMG::mgVcycle_up::3 106 5.641e-05 6.029e-05 7.05e-05 0.00% FabArrayBase::TheFPinfo() 49 6.245e-05 6.69e-05 7.043e-05 0.00% Castro::post_regrid() 30 5.843e-05 6.197e-05 6.844e-05 0.00% ClusterList::intersect() 1 0 7.725e-06 6.18e-05 0.00% MLMG::computeResidual() 106 5.639e-05 5.902e-05 6.157e-05 0.00% Amr::defBaseLevel() 1 2.166e-05 4.617e-05 5.811e-05 0.00% Castro::errorEst() 15 4.469e-05 4.686e-05 5.235e-05 0.00% Castro::init(old) 13 4.383e-05 4.63e-05 5.055e-05 0.00% MLMG::computeMLResidual() 32 3.598e-05 4.217e-05 4.844e-05 0.00% amrex::average_down_w_geom 60 3.967e-05 4.353e-05 4.787e-05 0.00% MLPoisson::define() 14 3.569e-05 4.055e-05 4.643e-05 0.00% Castro::avgDown() 15 3.354e-05 3.679e-05 4.259e-05 0.00% makeSFC 42 2.61e-05 3.277e-05 3.711e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.652e-05 2.579e-05 3.17e-05 0.00% Amr::writeSmallPlotFile() 1 2.937e-05 3.038e-05 3.143e-05 0.00% AmrMesh-cluster 1 0 3.847e-06 3.078e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.083e-05 2.304e-05 2.622e-05 0.00% DistributionMapping::Distribute() 46 2.144e-05 2.345e-05 2.589e-05 0.00% MLLinOp::define() 14 1.624e-05 2.051e-05 2.453e-05 0.00% Castro::gwstrain() 2 1.024e-06 3.649e-06 1.999e-05 0.00% FabArray::RecvLayoutMask() 14 1.706e-05 1.775e-05 1.894e-05 0.00% MLMG::getGradSolution() 14 1.624e-05 1.701e-05 1.835e-05 0.00% knapsack() 2 1.058e-05 1.24e-05 1.815e-05 0.00% ClusterList::chop() 1 0 2.196e-06 1.757e-05 0.00% Amr::bldFineLevels() 1 1.445e-05 1.51e-05 1.582e-05 0.00% MLPoisson::prepareForSolve() 14 1.229e-05 1.333e-05 1.404e-05 0.00% Castro::enforce_speed_limit() 33 1.009e-05 1.186e-05 1.374e-05 0.00% BoxList::parallelComplementIn() 30 1.104e-05 1.184e-05 1.271e-05 0.00% BoxList::complementIn 30 9.945e-06 1.117e-05 1.211e-05 0.00% Amr::initSubcycle() 1 8.54e-06 9.323e-06 1.168e-05 0.00% MLMG::MLRhsNormInf() 14 8.408e-06 8.953e-06 9.353e-06 0.00% Castro::apply_problem_tags() 15 8.256e-06 8.685e-06 9.05e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.178e-06 4.553e-06 4.872e-06 0.00% Amr::InitializeInit() 1 1.824e-06 2.503e-06 4.594e-06 0.00% Castro::computeInitialDt() 1 1.403e-06 1.921e-06 2.7e-06 0.00% Amr::init() 1 1.595e-06 1.883e-06 2.605e-06 0.00% Amr::initialInit() 1 1.177e-06 1.349e-06 1.743e-06 0.00% Gravity::set_mass_offset() 1 9.32e-07 1.065e-06 1.384e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 7.441 7.441 7.441 100.00% Amr::init() 1 5.377 5.377 5.377 72.26% Amr::initialInit() 1 5.104 5.104 5.104 68.60% Amr::FinalizeInit() 1 4.981 4.996 4.999 67.18% Castro::post_init() 2 3.661 3.788 3.872 52.03% Amr::InitAmr() 1 2.064 2.064 2.064 27.73% Gravity::multilevel_solve_for_new_phi() 14 1.812 1.831 1.852 24.89% Gravity::actual_multilevel_solve() 14 1.809 1.828 1.849 24.85% Gravity::solve_phi_with_mlmg() 14 1.803 1.822 1.843 24.76% Castro::computeTemp() 36 1.099 1.18 1.344 18.06% Amr::regrid() 14 1.266 1.282 1.304 17.53% Castro::clean_state() 33 1.065 1.127 1.249 16.79% Gravity::fill_multipole_BCs() 14 1.134 1.154 1.175 15.79% Amr::bldFineLevels() 1 0.9445 1.012 1.113 14.95% Castro::post_regrid() 30 0.8226 0.8529 0.9047 12.16% Castro::initData() 3 0.5736 0.6513 0.819 11.01% Gravity::actual_solve_with_mlmg() 14 0.6657 0.6675 0.6697 9.00% MLMG::solve() 14 0.6469 0.6475 0.6478 8.71% MLMG::oneIter() 106 0.5699 0.5721 0.5736 7.71% FabArray::ParallelCopy() 2952 0.1249 0.3941 0.5473 7.35% Castro::reset_internal_energy(MultiFab) 36 0.3984 0.4298 0.4936 6.63% Castro::reset_internal_energy(Fab) 654 0.3981 0.4295 0.4932 6.63% FabArray::ParallelCopy_finish() 2952 0.06271 0.3385 0.4928 6.62% MLMG::mgVcycle() 318 0.4302 0.4317 0.4344 5.84% MLCellLinOp::smooth() 2544 0.3592 0.3613 0.3693 4.96% amrex::average_down 844 0.08451 0.2122 0.2979 4.00% Amr::writePlotFile() 1 0.2728 0.2729 0.2729 3.67% MLPoisson::Fsmooth() 5088 0.2419 0.2511 0.2676 3.60% Castro::avgDown() 15 0.05372 0.1802 0.2643 3.55% Castro::avgDown(state_indx) 60 0.05368 0.1801 0.2642 3.55% amrex::average_down_w_geom 60 0.05361 0.1801 0.2641 3.55% Castro::derive() 97 0.2014 0.2018 0.2021 2.72% AmrLevel::derive() 97 0.2013 0.2017 0.202 2.72% Castro::normalize_species() 33 0.1651 0.1745 0.1941 2.61% Amr::grid_places() 15 0.01905 0.1405 0.1913 2.57% AmrMesh::MakeNewGrids() 15 0.01862 0.1401 0.191 2.57% Castro::Castro() 16 0.1298 0.1499 0.1796 2.41% TagBoxArray::mapPRD 15 0.00221 0.1236 0.1748 2.35% MLCellLinOp::applyBC() 6294 0.1448 0.1552 0.1652 2.22% amrex::Copy() 975 0.1353 0.1383 0.1426 1.92% Castro::initMFs() 16 0.09016 0.1063 0.1301 1.75% AmrLevel::FillPatch() 215 0.1135 0.1218 0.1276 1.72% FabArray::FillBoundary() 5552 0.1016 0.1159 0.1268 1.70% MLMG::mgVcycle_bottom 318 0.1172 0.1185 0.1243 1.67% Amr::InitializeInit() 1 0.1049 0.1081 0.1234 1.66% Amr::defBaseLevel() 1 0.1049 0.1081 0.1234 1.66% MLMG::mgVcycle_down::0 106 0.1206 0.1215 0.1224 1.64% MLMG::miniCycle() 212 0.1173 0.1182 0.1204 1.62% MLMG::mgVcycle_up::0 106 0.1078 0.108 0.1084 1.46% FillPatchIterator::Initialize 215 0.08679 0.09561 0.1021 1.37% FillBoundary_finish() 5552 0.05034 0.06982 0.08136 1.09% MLMG::computeResWithCrseSolFineCor() 106 0.07688 0.0784 0.07951 1.07% AmrLevel::AmrLevel(dm) 16 0.05171 0.0594 0.07507 1.01% StateData::define() 64 0.05156 0.05925 0.07494 1.01% VisMF::Write(FabArray) 2 0.0205 0.05869 0.0667 0.90% MLCellLinOp::apply() 1040 0.05867 0.06197 0.06366 0.86% FillPatchSingleLevel 259 0.05058 0.0568 0.0623 0.84% FabArray::ParallelCopy_nowait() 2952 0.05162 0.05431 0.06085 0.82% MLCellLinOp::solutionResidual() 258 0.05696 0.0586 0.06003 0.81% MLCellLinOp::correctionResidual() 755 0.05715 0.05867 0.06 0.81% FillPatchIterator::FillFromTwoLevels() 126 0.04291 0.05081 0.05648 0.76% FillPatchTwoLevels 126 0.04279 0.05068 0.05636 0.76% MLCellLinOp::reflux() 138 0.05301 0.05404 0.05496 0.74% FabArray::setVal() 1769 0.04512 0.0477 0.0505 0.68% Castro::init(old) 13 0.04317 0.0464 0.04913 0.66% FillBoundary_nowait() 5552 0.04063 0.04408 0.04906 0.66% Castro::computeInitialDt() 1 0.02602 0.04133 0.04456 0.60% Castro::estTimeStep() 1 0.02602 0.04133 0.04456 0.60% MLMG::addInterpCorrection() 530 0.02036 0.03127 0.03311 0.44% MLMG::computeResWithCrseCorFineCor() 106 0.03078 0.03181 0.03253 0.44% MLMG::computeResidual() 106 0.02888 0.03017 0.03224 0.43% FillPatchIterator::FillFromLevel0() 89 0.02523 0.02714 0.02946 0.40% MLPoisson::Fapply() 1040 0.02504 0.02579 0.02752 0.37% MLMG::mgVcycle_down::1 106 0.02453 0.02521 0.02574 0.35% Gravity::get_new_grav_vector() 4 0.02306 0.02349 0.02441 0.33% MLCellLinOp::updateSolBC() 120 0.02141 0.02257 0.02377 0.32% MLMG::mgVcycle_up::2 106 0.009683 0.02169 0.02361 0.32% MLMG::computeMLResidual() 32 0.02121 0.02187 0.02246 0.30% MLMG::mgVcycle_up::1 106 0.02073 0.02085 0.02096 0.28% MLCellLinOp::updateCorBC() 106 0.01817 0.01935 0.02003 0.27% MLMG:computeResOfCorrection() 530 0.01837 0.01875 0.01916 0.26% Castro::buildMetrics() 16 0.01276 0.01508 0.01907 0.26% MLPoisson::define() 14 0.0114 0.01289 0.01494 0.20% FabArray::Xpay() 1013 0.01195 0.01284 0.0136 0.18% amrex::Add() 575 0.01158 0.01265 0.01349 0.18% MultiFab::Multiply() 287 0.01292 0.01312 0.01328 0.18% MLMG::ResNormInf() 152 0.009484 0.01076 0.01289 0.17% MLPoisson::FFlux() 3408 0.01157 0.01196 0.01246 0.17% MLMG::interpCorrection_1 106 0.009741 0.01073 0.01162 0.16% FillPatchInterp(MF) 44 0.00197 0.007334 0.01108 0.15% MLMG::prepareForSolve() 14 0.009748 0.009992 0.01053 0.14% MLMG::mgVcycle_down::2 106 0.009299 0.009486 0.0101 0.14% Castro::errorEst() 15 0.009228 0.009564 0.009943 0.13% FabArrayBase::TheFPinfo() 49 0.0003208 0.003667 0.006478 0.09% FPinfo::FPinfo() 9 0.0002533 0.0036 0.006408 0.09% DistributionMapping::LeastUsedCPUs() 9 0.0001939 0.003547 0.006332 0.09% Castro::apply_tagging_restrictions() 15 0.005537 0.00588 0.006246 0.08% FabArrayBase::getCPC() 3662 0.005133 0.005291 0.005608 0.08% MLCellLinOp::defineAuxData() 14 0.00493 0.005024 0.005438 0.07% MLCellLinOp::defineBC() 14 0.00492 0.005055 0.005192 0.07% FabArray::norminf(mask) 46 0.004893 0.005029 0.005175 0.07% Castro::sum_integrated_quantities() 1 0.004851 0.004894 0.004968 0.07% MLLinOp::define() 14 0.0007371 0.002771 0.004943 0.07% MLLinOp::defineGrids() 14 0.0007208 0.00275 0.004919 0.07% MLMG::mgVcycle_down::3 106 0.001327 0.001826 0.004913 0.07% MLMG::getGradSolution() 14 0.00455 0.004622 0.004718 0.06% MLCellLinOp::compGrad() 28 0.004532 0.004605 0.004702 0.06% MLLinOp::makeSubCommunicator() 14 0.0003792 0.002387 0.004519 0.06% MLMG::MLResNormInf() 32 0.003984 0.004063 0.004236 0.06% MLMG::actualBottomSolve() 106 2.273e-05 0.0005379 0.004137 0.06% MLMG::mgVcycle_up::3 106 0.0009588 0.00137 0.004071 0.05% Castro::enforce_min_density() 33 0.003315 0.00355 0.003933 0.05% FabArray::norminf() 174 0.003093 0.003372 0.003897 0.05% MLCGSolver::bicgstab 13 0 0.0004753 0.003802 0.05% MultiFab::max() 54 0.00291 0.00332 0.003724 0.05% Gravity::average_fine_ec_onto_crse_ec() 14 0.003176 0.003371 0.00347 0.05% BndryData::define() 42 0.002841 0.002939 0.00304 0.04% MLMG::mgVcycle_down::4 106 0.001159 0.001362 0.002509 0.03% average_down_faces 84 0.001962 0.002134 0.002266 0.03% MLMG::mgVcycle_up::4 106 0.001135 0.001285 0.002093 0.03% FabArrayBase::CPC::define() 624 0.001645 0.001749 0.002011 0.03% MLMG::MLRhsNormInf() 14 0.001822 0.001865 0.001929 0.03% Castro::volWgtSum() 46 0.001668 0.001705 0.001725 0.02% FabArray::mult() 34 0.001164 0.001345 0.001714 0.02% Castro::enforce_consistent_e() 3 0.001011 0.001172 0.001591 0.02% StateDataPhysBCFunct::() 259 0.001389 0.00144 0.001531 0.02% StateData::FillBoundary(geom) 8 0.001249 0.0013 0.001391 0.02% FabArrayBase::getFB() 5552 0.001033 0.001111 0.001316 0.02% Gravity::update_max_rhs() 1 0.0006404 0.0009519 0.001184 0.02% AMRErrorTag::operator() 15 0.0009206 0.0009447 0.0009652 0.01% TagBoxArray::collate() 15 0.0002074 0.000334 0.0008199 0.01% Castro::build_fine_mask() 55 0.0006329 0.0007167 0.000799 0.01% DistributionMapping::KnapSackDoIt() 2 3.633e-05 0.0002743 0.0005578 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004714 0.0004963 0.0005375 0.01% MLPoisson::prepareForSolve() 14 0.0003671 0.0003932 0.0004694 0.01% MLCellLinOp::prepareForSolve() 14 0.0003548 0.0003799 0.0004563 0.01% FabArray::setDomainBndry() 259 0.0003895 0.0004117 0.0004412 0.01% MLCellLinOp::setLevelBC() 28 0.0003291 0.0003495 0.0003868 0.01% MLCGSolver::ParallelAllReduce 81 0 4.465e-05 0.0003572 0.00% Castro::locWgtSum() 6 0.0001876 0.0001935 0.0002012 0.00% FabArrayBase::FB::FB() 35 7.507e-05 8.862e-05 0.0001402 0.00% amrex::Dot() 54 0 1.708e-05 0.0001366 0.00% AmrMesh-cluster 1 0 1.377e-05 0.0001101 0.00% OwnerMask() 15 8.585e-05 9.572e-05 0.0001054 0.00% FabArray::LinComb() 27 0 1.257e-05 0.0001005 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 4.884e-05 7.358e-05 9.991e-05 0.00% FabArray::Saxpy() 27 0 1.161e-05 9.291e-05 0.00% Castro::volProductSum() 2 8.459e-05 8.7e-05 9.192e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.315e-05 7.382e-05 8.063e-05 0.00% ClusterList::intersect() 1 0 7.725e-06 6.18e-05 0.00% makeSFC 42 4.231e-05 5.079e-05 5.609e-05 0.00% Amr::writeSmallPlotFile() 1 2.937e-05 3.038e-05 3.143e-05 0.00% DistributionMapping::Distribute() 46 2.144e-05 2.345e-05 2.589e-05 0.00% BoxList::parallelComplementIn() 30 2.206e-05 2.301e-05 2.402e-05 0.00% Castro::gwstrain() 2 1.024e-06 3.649e-06 1.999e-05 0.00% FabArray::RecvLayoutMask() 14 1.706e-05 1.775e-05 1.894e-05 0.00% knapsack() 2 1.058e-05 1.24e-05 1.815e-05 0.00% ClusterList::chop() 1 0 2.196e-06 1.757e-05 0.00% Castro::enforce_speed_limit() 33 1.009e-05 1.186e-05 1.374e-05 0.00% BoxList::complementIn 30 9.945e-06 1.117e-05 1.211e-05 0.00% Amr::initSubcycle() 1 8.54e-06 9.323e-06 1.168e-05 0.00% Castro::apply_problem_tags() 15 8.256e-06 8.685e-06 9.05e-06 0.00% Gravity::set_mass_offset() 1 9.32e-07 1.065e-06 1.384e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 13 B 16 B 22 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.09-26-gd45933c3616d) finalized