Initializing AMReX (23.11-17-g9e35dc19489d)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.11-17-g9e35dc19489d) initialized Starting run at 07:39:32 UTC on 2023-11-23. Successfully read inputs file ... Castro git describe: 23.11-7-gbc5fe8d25 AMReX git describe: 23.11-17-g9e35dc194 Microphysics git describe: 23.11-11-g5ab809ab reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002715365 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.153906554 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001904395 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.006343821 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001474545 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00142286 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001516206 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001280062 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.003408142 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001255379 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001454915 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001248107 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001500779 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001317402 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001323837 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225831e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 3.358028537e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.197535671e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.57479959e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.296875216 seconds Ending run at 07:39:39 UTC on 2023-11-23. Run time = 6.911410572 Run time without initialization = 0.0005006319998 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.911 ... 6.911 ... 6.911 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1314 1.1587 1.1821 17.10% Amr::InitAmr() 1 1.145 1.145 1.145 16.57% Castro::post_init() 2 1.05 1.058 1.063 15.38% Castro::computeTemp() 36 0.7605 0.8155 0.8863 12.82% FabArray::ParallelCopy_finish() 2952 0.1258 0.429 0.65 9.40% Castro::reset_internal_energy(Fab) 654 0.4087 0.4409 0.4824 6.98% amrex::Copy() 948 0.2124 0.2289 0.2463 3.56% MLPoisson::Fsmooth() 5088 0.1939 0.2005 0.2082 3.01% Castro::normalize_species() 33 0.1612 0.174 0.1924 2.78% Castro::initData() 3 0.1221 0.1435 0.1795 2.60% Castro::initMFs() 16 0.0993 0.1333 0.1773 2.57% AmrLevel::derive() 97 0.1467 0.1516 0.1554 2.25% StateData::define() 64 0.05545 0.07125 0.09095 1.32% FabArray::setVal() 1769 0.0591 0.07352 0.08947 1.29% FillBoundary_finish() 5552 0.05577 0.06849 0.08333 1.21% amrex::average_down 844 0.04696 0.05296 0.05929 0.86% FabArray::ParallelCopy_nowait() 2952 0.02822 0.03783 0.05217 0.75% FillBoundary_nowait() 5552 0.04137 0.04374 0.04785 0.69% MLCellLinOp::applyBC() 6294 0.03298 0.03604 0.03989 0.58% FillPatchIterator::Initialize 215 0.02713 0.03304 0.03833 0.55% Castro::estTimeStep() 1 0.0241 0.03058 0.03785 0.55% VisMF::Write(FabArray) 2 0.02753 0.03054 0.03522 0.51% MLPoisson::Fapply() 1040 0.0273 0.02958 0.03336 0.48% MultiFab::Multiply() 287 0.02098 0.02507 0.02794 0.40% Amr::regrid() 14 0.01528 0.01767 0.02085 0.30% Castro::buildMetrics() 16 0.013 0.01653 0.02013 0.29% Amr::writePlotFile() 1 0.01346 0.01714 0.01923 0.28% FabArray::Xpay() 1013 0.01783 0.01832 0.01876 0.27% MLCellLinOp::reflux() 138 0.01685 0.01751 0.01809 0.26% MLMG::addInterpCorrection() 530 0.01605 0.01624 0.0166 0.24% amrex::Add() 575 0.0127 0.01415 0.01538 0.22% Castro::Castro() 16 0.009402 0.01196 0.0153 0.22% DistributionMapping::LeastUsedCPUs() 9 0.0007413 0.006112 0.01287 0.19% MLMG::prepareForSolve() 14 0.008111 0.01005 0.01242 0.18% MLPoisson::FFlux() 3408 0.01126 0.01169 0.01206 0.17% MLCellLinOp::updateSolBC() 120 0.009833 0.01091 0.01141 0.17% MLCellLinOp::updateCorBC() 106 0.008919 0.009845 0.01036 0.15% FillPatchInterp(MF) 44 0.001892 0.006853 0.01019 0.15% Gravity::multilevel_solve_for_new_phi() 14 0.002868 0.005444 0.008635 0.12% MLMG::interpCorrection_1 106 0.006446 0.007414 0.008361 0.12% MLCellLinOp::compGrad() 28 0.005917 0.006658 0.007993 0.12% MLLinOp::makeSubCommunicator() 14 0.002755 0.005417 0.007543 0.11% MultiFab::max() 54 0.00334 0.005853 0.007445 0.11% Castro::apply_tagging_restrictions() 15 0.005847 0.00631 0.006798 0.10% AmrMesh::MakeNewGrids() 15 0.00628 0.006411 0.006515 0.09% MLCellLinOp::defineAuxData() 14 0.004281 0.004951 0.006175 0.09% Gravity::get_new_grav_vector() 4 0.003102 0.004358 0.006064 0.09% MLMG::ResNormInf() 152 0.002663 0.00421 0.005202 0.08% FabArray::norminf(mask) 46 0.004708 0.004751 0.004791 0.07% FabArrayBase::getCPC() 3662 0.00361 0.003872 0.004068 0.06% FabArray::norminf() 188 0.003018 0.003373 0.003929 0.06% Castro::enforce_min_density() 33 0.002524 0.002946 0.003379 0.05% BndryData::define() 42 0.002508 0.002774 0.003116 0.05% FabArray::mult() 34 0.001576 0.002014 0.002763 0.04% Gravity::actual_solve_with_mlmg() 14 0.002117 0.002387 0.002697 0.04% Castro::volWgtSum() 46 0.001986 0.002262 0.002528 0.04% MLCellLinOp::defineBC() 14 0.001866 0.002152 0.002408 0.03% FillPatchTwoLevels 126 0.0008617 0.001634 0.002293 0.03% FabArrayBase::CPC::define() 624 0.001661 0.001887 0.002223 0.03% Gravity::actual_multilevel_solve() 14 0.0009075 0.001486 0.002188 0.03% FabArray::FillBoundary() 5552 0.001928 0.001985 0.002101 0.03% Castro::enforce_consistent_e() 3 0.001037 0.001455 0.001995 0.03% MLCellLinOp::smooth() 2544 0.001611 0.001649 0.001702 0.02% average_down_faces 84 0.001228 0.001447 0.001662 0.02% Castro::sum_integrated_quantities() 1 0.0005542 0.001047 0.001546 0.02% FabArray::ParallelCopy() 2952 0.00124 0.001274 0.001387 0.02% StateData::FillBoundary(geom) 8 0.00113 0.001183 0.00127 0.02% AMRErrorTag::operator() 15 0.001093 0.001128 0.001219 0.02% Castro::build_fine_mask() 55 0.000761 0.0009696 0.001208 0.02% MLCGSolver::bicgstab 13 0 0.0001466 0.001173 0.02% FabArrayBase::getFB() 5552 0.0009897 0.001039 0.001144 0.02% MLMG::solve() 14 0.0004557 0.0006322 0.0008784 0.01% MLCellLinOp::setLevelBC() 28 0.0004582 0.0006106 0.0007658 0.01% MLCellLinOp::prepareForSolve() 14 0.0004284 0.0005804 0.0007531 0.01% AmrLevel::FillPatch() 215 0.0006479 0.0006809 0.0007189 0.01% main() 1 0.0003657 0.0005156 0.0006324 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005118 0.0005501 0.0005986 0.01% MLCellLinOp::apply() 1040 0.0004194 0.0004648 0.000598 0.01% FabArray::setDomainBndry() 259 0.0004461 0.0005001 0.0005826 0.01% Amr::grid_places() 15 0.0003447 0.0003724 0.0004783 0.01% MLCellLinOp::correctionResidual() 755 0.0003994 0.0004205 0.0004732 0.01% MLMG::MLResNormInf() 32 0.0001804 0.0003334 0.0004685 0.01% MLMG::mgVcycle() 318 0.0004043 0.0004242 0.0004454 0.01% MLLinOp::defineGrids() 14 0.0002948 0.0003454 0.0004282 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003281 0.0003829 0.0004109 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002927 0.0003317 0.0003894 0.01% TagBoxArray::collate() 15 0.0002295 0.0002868 0.0003719 0.01% MLMG::oneIter() 106 0.0002968 0.0003122 0.0003342 0.00% MLMG::actualBottomSolve() 106 1.973e-05 5.528e-05 0.0002856 0.00% MLMG::mgVcycle_bottom 318 0.0002259 0.000242 0.0002667 0.00% Castro::locWgtSum() 6 0.0001974 0.0002118 0.0002433 0.00% MLCGSolver::ParallelAllReduce 95 0 2.975e-05 0.000238 0.00% MLCellLinOp::solutionResidual() 258 0.0001923 0.0002037 0.0002325 0.00% StateDataPhysBCFunct::() 259 0.0001742 0.0001942 0.0002107 0.00% Gravity::update_max_rhs() 1 7.502e-05 0.0001288 0.0002084 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.000152 0.0001788 0.0001974 0.00% AmrLevel::AmrLevel(dm) 16 0.0001591 0.0001771 0.0001892 0.00% FillPatchSingleLevel 259 0.0001567 0.0001683 0.0001885 0.00% MLMG:computeResOfCorrection() 530 0.0001556 0.0001651 0.0001808 0.00% FillPatchIterator::FillFromLevel0() 89 0.0001357 0.0001592 0.0001807 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001598 0.0001722 0.0001801 0.00% FabArrayBase::FB::FB() 35 8.075e-05 9.712e-05 0.0001627 0.00% MLMG::mgVcycle_down::0 106 0.0001389 0.0001443 0.0001517 0.00% MLMG::miniCycle() 212 8.575e-05 0.0001018 0.0001338 0.00% Castro::volProductSum() 2 8.683e-05 0.00011 0.0001325 0.00% OwnerMask() 15 9.435e-05 0.0001112 0.0001296 0.00% Amr::writeSmallPlotFile() 1 3.467e-05 4.902e-05 0.0001267 0.00% FPinfo::FPinfo() 9 8.621e-05 9.67e-05 0.0001213 0.00% MLMG::mgVcycle_down::1 106 0.0001082 0.0001141 0.000119 0.00% FabArray::Saxpy() 54 0 1.424e-05 0.0001139 0.00% amrex::Dot() 54 0 1.415e-05 0.0001132 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.395e-05 9.268e-05 0.0001127 0.00% Castro::post_regrid() 30 6.598e-05 8.757e-05 0.0001109 0.00% Amr::FinalizeInit() 1 7.902e-06 2.562e-05 0.0001063 0.00% TagBoxArray::mapPRD 15 9.249e-05 9.849e-05 0.0001062 0.00% Castro::avgDown(state_indx) 60 8.473e-05 9.499e-05 0.0001027 0.00% Castro::derive() 97 7.652e-05 8.79e-05 9.906e-05 0.00% MLMG::mgVcycle_down::3 106 7.615e-05 8.434e-05 9.696e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.46e-05 8.214e-05 9.687e-05 0.00% FabArrayBase::TheFPinfo() 49 8.402e-05 9.072e-05 9.684e-05 0.00% MLMG::mgVcycle_down::4 106 6.871e-05 7.368e-05 9.281e-05 0.00% MLMG::mgVcycle_down::2 106 8.2e-05 8.672e-05 9.2e-05 0.00% Castro::init(old) 13 7.509e-05 8.062e-05 9.114e-05 0.00% Castro::clean_state() 33 6.57e-05 7.523e-05 8.563e-05 0.00% Castro::errorEst() 15 4.681e-05 6.352e-05 8.5e-05 0.00% Castro::avgDown() 15 5.323e-05 6.635e-05 7.687e-05 0.00% amrex::average_down_w_geom 60 5.203e-05 6.344e-05 7.464e-05 0.00% MLMG::mgVcycle_up::0 106 6.08e-05 6.508e-05 7.286e-05 0.00% MLMG::mgVcycle_up::4 106 6.113e-05 6.513e-05 7.164e-05 0.00% ClusterList::intersect() 1 0 8.86e-06 7.088e-05 0.00% MLMG::computeResidual() 106 5.212e-05 5.788e-05 6.475e-05 0.00% MLMG::mgVcycle_up::1 106 5.589e-05 6.042e-05 6.469e-05 0.00% MLPoisson::define() 14 4.408e-05 5.41e-05 6.353e-05 0.00% MLMG::computeMLResidual() 32 4.074e-05 4.972e-05 6.329e-05 0.00% MLMG::mgVcycle_up::3 106 5.378e-05 5.76e-05 6.329e-05 0.00% MLMG::mgVcycle_up::2 106 5.235e-05 5.403e-05 5.663e-05 0.00% makeSFC 42 2.84e-05 3.736e-05 4.914e-05 0.00% Amr::defBaseLevel() 1 2.657e-05 3.389e-05 4.493e-05 0.00% DistributionMapping::Distribute() 46 2.045e-05 2.657e-05 4.085e-05 0.00% AmrMesh-cluster 1 0 5.025e-06 4.02e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.57e-05 2.153e-05 3.811e-05 0.00% BoxList::parallelComplementIn() 30 1.174e-05 1.617e-05 3.396e-05 0.00% Amr::bldFineLevels() 1 1.409e-05 1.975e-05 3.345e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.238e-05 2.614e-05 3.179e-05 0.00% BoxList::complementIn 30 1.411e-05 1.748e-05 3.023e-05 0.00% Amr::initialInit() 1 1.121e-06 5.056e-06 3.006e-05 0.00% MLMG::getGradSolution() 14 1.794e-05 2.287e-05 2.946e-05 0.00% FabArray::RecvLayoutMask() 14 1.584e-05 1.795e-05 2.367e-05 0.00% MLLinOp::define() 14 1.681e-05 1.954e-05 2.349e-05 0.00% ClusterList::chop() 1 0 2.808e-06 2.246e-05 0.00% Castro::enforce_speed_limit() 33 1.159e-05 1.425e-05 2.035e-05 0.00% MLPoisson::prepareForSolve() 14 1.196e-05 1.464e-05 1.958e-05 0.00% knapsack() 2 1.061e-05 1.239e-05 1.37e-05 0.00% Amr::initSubcycle() 1 9.528e-06 1.056e-05 1.162e-05 0.00% Castro::apply_problem_tags() 15 8.334e-06 9.245e-06 1.045e-05 0.00% Castro::gwstrain() 2 9.96e-07 2.607e-06 9.502e-06 0.00% MLMG::MLRhsNormInf() 14 8.18e-06 8.648e-06 9.28e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.032e-06 4.929e-06 8.022e-06 0.00% Amr::InitializeInit() 1 1.949e-06 3.509e-06 7.961e-06 0.00% Gravity::set_mass_offset() 1 1.14e-06 3.226e-06 5.9e-06 0.00% Amr::init() 1 1.691e-06 2.409e-06 4.155e-06 0.00% Castro::computeInitialDt() 1 1.364e-06 1.771e-06 2.178e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.911 6.911 6.911 100.00% Amr::init() 1 5.766 5.766 5.766 83.42% Amr::initialInit() 1 5.469 5.469 5.469 79.13% Amr::FinalizeInit() 1 5.343 5.35 5.357 77.51% Castro::post_init() 2 3.941 4.097 4.201 60.79% Gravity::multilevel_solve_for_new_phi() 14 1.791 1.815 1.835 26.54% Gravity::actual_multilevel_solve() 14 1.784 1.809 1.831 26.50% Gravity::solve_phi_with_mlmg() 14 1.776 1.801 1.824 26.39% Amr::regrid() 14 1.388 1.429 1.468 21.24% Castro::computeTemp() 36 1.17 1.257 1.369 19.81% Castro::clean_state() 33 1.114 1.187 1.28 18.52% Amr::bldFineLevels() 1 0.9709 1.06 1.193 17.26% Gravity::fill_multipole_BCs() 14 1.134 1.161 1.184 17.13% Amr::InitAmr() 1 1.145 1.145 1.145 16.57% Castro::post_regrid() 30 0.8582 0.901 0.9467 13.70% Castro::initData() 3 0.6133 0.7008 0.8333 12.06% FabArray::ParallelCopy() 2952 0.2197 0.508 0.7208 10.43% FabArray::ParallelCopy_finish() 2952 0.1258 0.429 0.65 9.40% Gravity::actual_solve_with_mlmg() 14 0.6371 0.6399 0.6417 9.28% MLMG::solve() 14 0.6077 0.6103 0.6117 8.85% MLMG::oneIter() 106 0.5193 0.5198 0.5204 7.53% Castro::reset_internal_energy(MultiFab) 36 0.409 0.4413 0.4828 6.99% Castro::reset_internal_energy(Fab) 654 0.4087 0.4409 0.4824 6.98% amrex::average_down 844 0.1193 0.2766 0.3861 5.59% MLMG::mgVcycle() 318 0.3665 0.3685 0.37 5.35% Castro::avgDown() 15 0.0886 0.2439 0.3524 5.10% Castro::avgDown(state_indx) 60 0.08853 0.2438 0.3523 5.10% amrex::average_down_w_geom 60 0.08843 0.2437 0.3522 5.10% MLCellLinOp::smooth() 2544 0.2993 0.3029 0.3063 4.43% Amr::writePlotFile() 1 0.297 0.2972 0.2972 4.30% Castro::derive() 97 0.2458 0.2495 0.2517 3.64% AmrLevel::derive() 97 0.2457 0.2494 0.2516 3.64% Castro::Castro() 16 0.1502 0.1942 0.2486 3.60% amrex::Copy() 948 0.2124 0.2289 0.2463 3.56% AmrLevel::FillPatch() 215 0.2104 0.2299 0.2455 3.55% MLPoisson::Fsmooth() 5088 0.1939 0.2005 0.2082 3.01% FillPatchIterator::Initialize 215 0.1632 0.1885 0.2073 3.00% Castro::normalize_species() 33 0.1612 0.174 0.1924 2.78% Amr::grid_places() 15 0.02246 0.1167 0.1797 2.60% AmrMesh::MakeNewGrids() 15 0.02198 0.1163 0.1794 2.60% Castro::initMFs() 16 0.0993 0.1333 0.1773 2.57% TagBoxArray::mapPRD 15 0.003474 0.09796 0.1622 2.35% MLCellLinOp::applyBC() 6294 0.1455 0.1514 0.1614 2.34% FillPatchSingleLevel 259 0.09279 0.1242 0.1482 2.14% FabArray::FillBoundary() 5552 0.1056 0.1154 0.1278 1.85% Amr::InitializeInit() 1 0.1115 0.1188 0.1252 1.81% Amr::defBaseLevel() 1 0.1115 0.1188 0.1252 1.81% FillPatchIterator::FillFromTwoLevels() 126 0.08581 0.1083 0.1216 1.76% FillPatchTwoLevels 126 0.08565 0.1081 0.1214 1.76% Castro::init(old) 13 0.08893 0.1056 0.1156 1.67% MLMG::mgVcycle_bottom 318 0.09951 0.1012 0.1039 1.50% MLMG::mgVcycle_down::0 106 0.1011 0.1019 0.1028 1.49% MLMG::miniCycle() 212 0.09963 0.1009 0.1018 1.47% FabArray::ParallelCopy_nowait() 2952 0.06946 0.07771 0.0926 1.34% MLMG::mgVcycle_up::0 106 0.09071 0.09099 0.09141 1.32% AmrLevel::AmrLevel(dm) 16 0.05561 0.07143 0.09112 1.32% StateData::define() 64 0.05545 0.07125 0.09095 1.32% FabArray::setVal() 1769 0.0591 0.07352 0.08947 1.29% FillBoundary_finish() 5552 0.05577 0.06849 0.08333 1.21% MLMG::computeResWithCrseSolFineCor() 106 0.08072 0.08207 0.08322 1.20% MLCellLinOp::apply() 1040 0.06561 0.06787 0.07185 1.04% MLCellLinOp::correctionResidual() 755 0.06434 0.06648 0.06913 1.00% MLCellLinOp::solutionResidual() 258 0.06138 0.06432 0.06701 0.97% FillPatchIterator::FillFromLevel0() 89 0.03712 0.0468 0.05816 0.84% MLCellLinOp::reflux() 138 0.05165 0.05438 0.05605 0.81% FillBoundary_nowait() 5552 0.04253 0.04488 0.04898 0.71% Gravity::get_new_grav_vector() 4 0.03574 0.03713 0.03877 0.56% MLMG::computeResWithCrseCorFineCor() 106 0.03529 0.037 0.03797 0.55% Castro::computeInitialDt() 1 0.0241 0.03058 0.03785 0.55% Castro::estTimeStep() 1 0.0241 0.03058 0.03785 0.55% VisMF::Write(FabArray) 2 0.02753 0.03054 0.03522 0.51% MLPoisson::Fapply() 1040 0.0273 0.02958 0.03336 0.48% MLMG::computeMLResidual() 32 0.02613 0.02938 0.03226 0.47% MLMG::computeResidual() 106 0.02898 0.02973 0.03064 0.44% MLMG::addInterpCorrection() 530 0.01801 0.02755 0.02912 0.42% MultiFab::Multiply() 287 0.02098 0.02507 0.02794 0.40% MLCellLinOp::updateSolBC() 120 0.02114 0.02442 0.02785 0.40% Castro::buildMetrics() 16 0.01448 0.01834 0.02246 0.32% MLMG::mgVcycle_down::1 106 0.02129 0.02172 0.02217 0.32% MLCellLinOp::updateCorBC() 106 0.01854 0.01963 0.02045 0.30% MLMG::mgVcycle_up::2 106 0.008485 0.01849 0.02007 0.29% MLPoisson::define() 14 0.01371 0.01767 0.02006 0.29% MLMG::prepareForSolve() 14 0.01674 0.01803 0.01983 0.29% MLMG::mgVcycle_up::1 106 0.01893 0.01912 0.01924 0.28% MLMG:computeResOfCorrection() 530 0.01803 0.01842 0.01916 0.28% FabArray::Xpay() 1013 0.01783 0.01832 0.01876 0.27% amrex::Add() 575 0.0127 0.01415 0.01538 0.22% MLMG::interpCorrection_1 106 0.01048 0.01199 0.01368 0.20% FabArrayBase::TheFPinfo() 49 0.0008804 0.006238 0.01301 0.19% FPinfo::FPinfo() 9 0.0007845 0.006147 0.01291 0.19% DistributionMapping::LeastUsedCPUs() 9 0.0007413 0.006112 0.01287 0.19% Castro::errorEst() 15 0.01013 0.01132 0.01246 0.18% MLPoisson::FFlux() 3408 0.01126 0.01169 0.01206 0.17% MLMG::ResNormInf() 152 0.009332 0.01051 0.01121 0.16% FillPatchInterp(MF) 44 0.001892 0.006853 0.01019 0.15% MLMG::mgVcycle_down::2 106 0.008874 0.009086 0.009907 0.14% MLMG::getGradSolution() 14 0.008629 0.008945 0.009359 0.14% MLCellLinOp::compGrad() 28 0.008603 0.008922 0.009338 0.14% MLLinOp::define() 14 0.003143 0.005866 0.008017 0.12% MLLinOp::defineGrids() 14 0.003126 0.005847 0.007997 0.12% MLLinOp::makeSubCommunicator() 14 0.002755 0.005417 0.007543 0.11% MLCellLinOp::defineAuxData() 14 0.005293 0.006052 0.007524 0.11% MultiFab::max() 54 0.00334 0.005853 0.007445 0.11% Castro::sum_integrated_quantities() 1 0.006651 0.006875 0.007045 0.10% Castro::apply_tagging_restrictions() 15 0.005847 0.00631 0.006798 0.10% MLCellLinOp::defineBC() 14 0.005106 0.005702 0.006394 0.09% FabArrayBase::getCPC() 3662 0.005342 0.005759 0.006269 0.09% DistributionMapping::KnapSackDoIt() 2 0.0001561 0.001323 0.004981 0.07% FabArray::norminf(mask) 46 0.004708 0.004751 0.004791 0.07% Gravity::average_fine_ec_onto_crse_ec() 14 0.003904 0.004217 0.004464 0.06% MLMG::mgVcycle_down::3 106 0.001345 0.001776 0.004393 0.06% Gravity::update_max_rhs() 1 0.0007074 0.002921 0.004167 0.06% MLMG::MLResNormInf() 32 0.003811 0.003971 0.004117 0.06% FabArray::norminf() 188 0.003018 0.003373 0.003929 0.06% BndryData::define() 42 0.003109 0.003393 0.003788 0.05% MLMG::mgVcycle_up::3 106 0.0009261 0.001253 0.003407 0.05% Castro::enforce_min_density() 33 0.002524 0.002946 0.003379 0.05% MLMG::actualBottomSolve() 106 1.973e-05 0.0004405 0.003367 0.05% average_down_faces 84 0.002482 0.002772 0.003109 0.04% MLCGSolver::bicgstab 13 0 0.0003783 0.003027 0.04% FabArray::mult() 34 0.001576 0.002014 0.002763 0.04% Castro::volWgtSum() 46 0.001992 0.002268 0.002535 0.04% MLMG::mgVcycle_down::4 106 0.001148 0.001335 0.002393 0.03% FabArrayBase::CPC::define() 624 0.001661 0.001887 0.002223 0.03% Castro::enforce_consistent_e() 3 0.001037 0.001455 0.001995 0.03% MLMG::MLRhsNormInf() 14 0.001751 0.001814 0.001898 0.03% MLMG::mgVcycle_up::4 106 0.001075 0.001197 0.001839 0.03% StateDataPhysBCFunct::() 259 0.001309 0.001377 0.001471 0.02% FabArrayBase::getFB() 5552 0.001077 0.001136 0.001307 0.02% StateData::FillBoundary(geom) 8 0.00113 0.001183 0.00127 0.02% AMRErrorTag::operator() 15 0.001093 0.001128 0.001219 0.02% Castro::build_fine_mask() 55 0.000761 0.0009696 0.001208 0.02% MLPoisson::prepareForSolve() 14 0.0004412 0.000595 0.0007681 0.01% MLCellLinOp::setLevelBC() 28 0.0004582 0.0006106 0.0007658 0.01% MLCellLinOp::prepareForSolve() 14 0.0004284 0.0005804 0.0007531 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005118 0.0005501 0.0005986 0.01% FabArray::setDomainBndry() 259 0.0004461 0.0005001 0.0005826 0.01% TagBoxArray::collate() 15 0.0002295 0.0002868 0.0003719 0.01% MLCGSolver::ParallelAllReduce 95 0 3.751e-05 0.0003001 0.00% Castro::locWgtSum() 6 0.0001979 0.0002123 0.0002439 0.00% FabArrayBase::FB::FB() 35 8.075e-05 9.712e-05 0.0001627 0.00% AmrMesh-cluster 1 0 1.669e-05 0.0001335 0.00% Castro::volProductSum() 2 8.705e-05 0.0001103 0.0001327 0.00% OwnerMask() 15 9.435e-05 0.0001112 0.0001296 0.00% Amr::writeSmallPlotFile() 1 3.467e-05 4.902e-05 0.0001267 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 8.686e-05 0.0001066 0.000116 0.00% FabArray::Saxpy() 54 0 1.424e-05 0.0001139 0.00% amrex::Dot() 54 0 1.415e-05 0.0001132 0.00% MLLinOp::makeAgglomeratedDMap 14 6.793e-05 8.402e-05 0.0001024 0.00% ClusterList::intersect() 1 0 8.86e-06 7.088e-05 0.00% makeSFC 42 4.395e-05 5.788e-05 7.062e-05 0.00% BoxList::parallelComplementIn() 30 2.639e-05 3.365e-05 6.419e-05 0.00% DistributionMapping::Distribute() 46 2.045e-05 2.657e-05 4.085e-05 0.00% BoxList::complementIn 30 1.411e-05 1.748e-05 3.023e-05 0.00% FabArray::RecvLayoutMask() 14 1.584e-05 1.795e-05 2.367e-05 0.00% ClusterList::chop() 1 0 2.808e-06 2.246e-05 0.00% Castro::enforce_speed_limit() 33 1.159e-05 1.425e-05 2.035e-05 0.00% knapsack() 2 1.061e-05 1.239e-05 1.37e-05 0.00% Amr::initSubcycle() 1 9.528e-06 1.056e-05 1.162e-05 0.00% Castro::apply_problem_tags() 15 8.334e-06 9.245e-06 1.045e-05 0.00% Castro::gwstrain() 2 9.96e-07 2.607e-06 9.502e-06 0.00% Gravity::set_mass_offset() 1 1.14e-06 3.226e-06 5.9e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 19 B 26 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.11-17-g9e35dc19489d) finalized