MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.02-42-gd8e6401642ff) initialized Starting run at 08:03:10 UTC on 2023-02-22. Successfully read inputs file ... Castro git describe: 23.01-38-g5a867ca5c AMReX git describe: 23.02-42-gd8e640164 Microphysics git describe: 23.02-16-g3e0cd993 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002517797 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.115988719 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001501958 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001827891 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001079894 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001069683 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001065163 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001068433 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00107662 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001082533 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001085259 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001077505 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001110455 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001050722 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001079518 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225826e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 2.373778793e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.284381237e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.577115472e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.234625777 seconds Ending run at 08:03:16 UTC on 2023-02-22. Run time = 6.350143921 Run time without initialization = 0.000256836 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.35 ... 6.35 ... 6.35 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.2197 1.2372 1.2516 19.71% Amr::InitAmr() 1 1.195 1.195 1.195 18.82% Castro::post_init() 2 0.9242 0.9264 0.928 14.61% Castro::computeTemp() 36 0.7004 0.7446 0.8138 12.82% Castro::reset_internal_energy(Fab) 654 0.3854 0.4125 0.455 7.17% FabArray::ParallelCopy_finish() 2952 0.06174 0.2618 0.3812 6.00% MLPoisson::Fsmooth() 5088 0.2024 0.2102 0.2156 3.40% Castro::normalize_species() 33 0.1664 0.175 0.1879 2.96% Castro::initData() 3 0.1152 0.1291 0.1507 2.37% amrex::Copy() 975 0.1329 0.1369 0.1404 2.21% Castro::derive() 97 0.1359 0.1378 0.1391 2.19% Castro::initMFs() 16 0.09478 0.1048 0.1205 1.90% FillBoundary_finish() 5552 0.05363 0.06365 0.07582 1.19% StateData::define() 64 0.05442 0.06011 0.06897 1.09% amrex::average_down 844 0.04439 0.04755 0.05244 0.83% FabArray::setVal() 1769 0.04294 0.046 0.05009 0.79% FillBoundary_nowait() 5552 0.04181 0.04316 0.0444 0.70% MLCellLinOp::applyBC() 6294 0.03562 0.03717 0.04002 0.63% VisMF::Write(FabArray) 2 0.02985 0.03088 0.03315 0.52% FabArray::ParallelCopy_nowait() 2952 0.02366 0.02644 0.03222 0.51% MLPoisson::Fapply() 1040 0.02403 0.02528 0.02645 0.42% Castro::estTimeStep() 1 0.02174 0.02327 0.02584 0.41% Amr::regrid() 14 0.01383 0.01546 0.0194 0.31% MLMG::addInterpCorrection() 530 0.01721 0.01781 0.01829 0.29% FillPatchIterator::Initialize 215 0.01608 0.0175 0.0181 0.29% MLCellLinOp::reflux() 138 0.01586 0.01639 0.01703 0.27% Castro::buildMetrics() 16 0.01191 0.01314 0.01506 0.24% FabArray::Xpay() 1013 0.01198 0.01298 0.01441 0.23% MultiFab::Multiply() 287 0.01248 0.01305 0.01339 0.21% MLPoisson::FFlux() 3408 0.01138 0.01191 0.01311 0.21% MLCellLinOp::updateSolBC() 120 0.01078 0.01165 0.01242 0.20% amrex::Add() 575 0.0109 0.01145 0.01238 0.19% MLCellLinOp::updateCorBC() 106 0.009722 0.0105 0.01116 0.18% Castro::Castro() 16 0.008449 0.009242 0.0108 0.17% FillPatchInterp(MF) 44 0.001692 0.006515 0.009586 0.15% Amr::writePlotFile() 1 0.0056 0.007965 0.008725 0.14% MLMG::interpCorrection_1 106 0.006388 0.007029 0.007624 0.12% AmrMesh::MakeNewGrids() 15 0.006331 0.006489 0.006533 0.10% MLLinOp::makeSubCommunicator() 14 0.0001942 0.004043 0.006456 0.10% Castro::apply_tagging_restrictions() 15 0.006004 0.006178 0.006367 0.10% MLMG::prepareForSolve() 14 0.004886 0.004991 0.005285 0.08% FabArray::norminf(mask) 46 0.004786 0.004985 0.005188 0.08% MLMG::ResNormInf() 152 0.002964 0.003848 0.004558 0.07% MLCellLinOp::defineAuxData() 14 0.003838 0.003936 0.004093 0.06% MultiFab::max() 54 0.002758 0.003412 0.003859 0.06% FabArray::norminf() 174 0.003023 0.003391 0.003819 0.06% FabArrayBase::getCPC() 3662 0.00346 0.003553 0.003594 0.06% MLCellLinOp::compGrad() 28 0.003171 0.003321 0.003485 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002637 0.002969 0.003469 0.05% Castro::enforce_min_density() 33 0.00246 0.002625 0.002816 0.04% Gravity::get_new_grav_vector() 4 0.001863 0.002109 0.002524 0.04% BndryData::define() 42 0.00224 0.002364 0.00245 0.04% DistributionMapping::LeastUsedCPUs() 9 0.00037 0.001465 0.00238 0.04% Gravity::actual_solve_with_mlmg() 14 0.001932 0.00203 0.002307 0.04% FabArray::FillBoundary() 5552 0.002016 0.002074 0.0022 0.03% MLCellLinOp::defineBC() 14 0.00184 0.001938 0.00203 0.03% FabArrayBase::CPC::define() 624 0.001632 0.001729 0.001967 0.03% MLCellLinOp::smooth() 2544 0.001639 0.001697 0.001789 0.03% Castro::volWgtSum() 46 0.001703 0.001724 0.001777 0.03% FabArray::mult() 34 0.00117 0.001339 0.001673 0.03% MLCGSolver::bicgstab 13 0 0.000189 0.001512 0.02% FillPatchTwoLevels 126 0.0006502 0.0011 0.00145 0.02% Castro::enforce_consistent_e() 3 0.0009975 0.001176 0.001425 0.02% FabArray::ParallelCopy() 2952 0.001218 0.001261 0.001324 0.02% average_down_faces 84 0.001082 0.00118 0.001309 0.02% FabArrayBase::getFB() 5552 0.001077 0.001132 0.001227 0.02% StateData::FillBoundary(geom) 8 0.001121 0.001169 0.001224 0.02% AMRErrorTag::operator() 15 0.0009459 0.0009551 0.0009708 0.02% Gravity::actual_multilevel_solve() 14 0.0007899 0.0008651 0.0009579 0.02% Castro::build_fine_mask() 55 0.000633 0.0007132 0.0008523 0.01% Castro::sum_integrated_quantities() 1 0.0006773 0.0007667 0.0008273 0.01% MLMG::solve() 14 0.0003713 0.0005517 0.0007281 0.01% MLCellLinOp::apply() 1040 0.0004429 0.0004737 0.0006034 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005062 0.0005256 0.0005444 0.01% MLCGSolver::ParallelAllReduce 81 0 6.379e-05 0.0005103 0.01% MLCellLinOp::correctionResidual() 755 0.0003857 0.0004067 0.0005007 0.01% Amr::grid_places() 15 0.0003354 0.0003778 0.0004917 0.01% main() 1 0.0003522 0.0003922 0.0004681 0.01% MLCellLinOp::prepareForSolve() 14 0.0003473 0.0003796 0.0004649 0.01% MLMG::mgVcycle() 318 0.0004217 0.0004394 0.0004617 0.01% FabArray::setDomainBndry() 259 0.000371 0.0004014 0.0004162 0.01% MLLinOp::defineGrids() 14 0.0002831 0.0003192 0.0004104 0.01% MLMG::MLResNormInf() 32 0.0001605 0.0002679 0.0003783 0.01% MLCellLinOp::setLevelBC() 28 0.0003304 0.000346 0.0003639 0.01% TagBoxArray::collate() 15 0.0002704 0.0003086 0.0003574 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002574 0.0003144 0.0003412 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002763 0.0002857 0.0002957 0.00% MLMG::oneIter() 106 0.0002565 0.0002675 0.0002955 0.00% MLMG::actualBottomSolve() 106 2.223e-05 5.528e-05 0.0002737 0.00% MLMG::mgVcycle_bottom 318 0.0002194 0.0002379 0.0002534 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001755 0.0001894 0.0002003 0.00% FillPatchSingleLevel 259 0.0001599 0.0001727 0.0001966 0.00% Castro::locWgtSum() 6 0.0001853 0.000191 0.0001958 0.00% MLCellLinOp::solutionResidual() 258 0.0001676 0.0001844 0.0001942 0.00% Castro::init(old) 13 0.0001616 0.0001704 0.0001816 0.00% StateDataPhysBCFunct::() 259 0.0001426 0.0001564 0.0001701 0.00% MLMG:computeResOfCorrection() 530 0.000148 0.0001536 0.0001599 0.00% FabArrayBase::FB::FB() 35 8.663e-05 9.774e-05 0.0001563 0.00% MLMG::mgVcycle_down::0 106 0.0001353 0.0001433 0.0001523 0.00% AmrLevel::AmrLevel(dm) 16 0.0001148 0.0001277 0.0001511 0.00% amrex::Dot() 54 0 1.664e-05 0.0001331 0.00% Gravity::update_max_rhs() 1 7.614e-05 0.0001034 0.0001295 0.00% MLMG::miniCycle() 212 8.552e-05 0.0001008 0.0001291 0.00% MLMG::mgVcycle_down::1 106 0.0001066 0.0001125 0.0001191 0.00% Amr::FinalizeInit() 1 6.322e-06 3.153e-05 0.0001141 0.00% OwnerMask() 15 8.508e-05 9.487e-05 0.0001125 0.00% FPinfo::FPinfo() 9 7.504e-05 8.749e-05 0.0001061 0.00% TagBoxArray::mapPRD 15 8.821e-05 9.329e-05 9.939e-05 0.00% Castro::post_regrid() 30 5.889e-05 7.549e-05 9.908e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 7.91e-05 8.418e-05 9.777e-05 0.00% MLMG::mgVcycle_down::2 106 8.013e-05 8.588e-05 9.569e-05 0.00% FabArray::Saxpy() 27 0 1.193e-05 9.547e-05 0.00% FabArray::LinComb() 27 0 1.169e-05 9.355e-05 0.00% Castro::volProductSum() 2 8.484e-05 8.727e-05 9.018e-05 0.00% MLMG::mgVcycle_down::3 106 7.196e-05 8.06e-05 8.676e-05 0.00% MLMG::mgVcycle_down::4 106 6.882e-05 7.29e-05 8.045e-05 0.00% MLMG::mgVcycle_up::0 106 6.795e-05 7.195e-05 8.042e-05 0.00% Castro::avgDown(state_indx) 60 5.86e-05 6.812e-05 8.015e-05 0.00% MLMG::mgVcycle_up::4 106 6.735e-05 7.116e-05 7.914e-05 0.00% FabArrayBase::TheFPinfo() 49 6.008e-05 6.424e-05 7.493e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.313e-05 6.989e-05 7.41e-05 0.00% MLMG::mgVcycle_up::3 106 5.376e-05 5.95e-05 7.06e-05 0.00% Castro::clean_state() 33 5.736e-05 6.222e-05 6.857e-05 0.00% MLMG::mgVcycle_up::1 106 5.717e-05 6.192e-05 6.588e-05 0.00% ClusterList::intersect() 1 0 8.152e-06 6.522e-05 0.00% MLMG::mgVcycle_up::2 106 5.243e-05 5.584e-05 6.492e-05 0.00% MLMG::computeResidual() 106 5.446e-05 5.866e-05 6.076e-05 0.00% Castro::errorEst() 15 4.503e-05 5.015e-05 5.666e-05 0.00% amrex::average_down_w_geom 60 3.908e-05 4.463e-05 5.572e-05 0.00% Amr::defBaseLevel() 1 2.744e-05 4.024e-05 5.502e-05 0.00% Castro::avgDown() 15 3.296e-05 3.902e-05 5.079e-05 0.00% MLMG::computeMLResidual() 32 3.98e-05 4.234e-05 5.055e-05 0.00% MLPoisson::define() 14 3.057e-05 3.72e-05 4.789e-05 0.00% makeSFC 42 2.825e-05 3.51e-05 4.616e-05 0.00% Amr::initialInit() 1 9.12e-07 6.412e-06 3.568e-05 0.00% Amr::bldFineLevels() 1 1.478e-05 2.42e-05 3.424e-05 0.00% Amr::writeSmallPlotFile() 1 2.84e-05 2.935e-05 3.11e-05 0.00% AmrMesh-cluster 1 0 3.814e-06 3.051e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.085e-05 2.355e-05 2.841e-05 0.00% DistributionMapping::Distribute() 46 2.082e-05 2.439e-05 2.825e-05 0.00% MLLinOp::define() 14 1.45e-05 1.801e-05 2.308e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.641e-05 2.001e-05 2.226e-05 0.00% FabArray::RecvLayoutMask() 14 1.569e-05 1.631e-05 1.837e-05 0.00% MLMG::getGradSolution() 14 1.65e-05 1.727e-05 1.768e-05 0.00% MLPoisson::prepareForSolve() 14 1.168e-05 1.374e-05 1.696e-05 0.00% ClusterList::chop() 1 0 2.017e-06 1.614e-05 0.00% Castro::enforce_speed_limit() 33 1.17e-05 1.278e-05 1.369e-05 0.00% BoxList::parallelComplementIn() 30 1.06e-05 1.166e-05 1.354e-05 0.00% BoxList::complementIn 30 1.05e-05 1.159e-05 1.327e-05 0.00% knapsack() 2 1.007e-05 1.134e-05 1.263e-05 0.00% Amr::initSubcycle() 1 9.035e-06 1.016e-05 1.108e-05 0.00% MLMG::MLRhsNormInf() 14 7.711e-06 8.324e-06 8.874e-06 0.00% Castro::apply_problem_tags() 15 5.676e-06 6.19e-06 6.826e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.446e-06 4.78e-06 5.151e-06 0.00% Amr::InitializeInit() 1 2.024e-06 2.768e-06 4.549e-06 0.00% Castro::computeInitialDt() 1 2.022e-06 2.195e-06 2.431e-06 0.00% Amr::init() 1 1.395e-06 1.752e-06 2.05e-06 0.00% Castro::gwstrain() 2 1.037e-06 1.277e-06 1.701e-06 0.00% Gravity::set_mass_offset() 1 1.014e-06 1.214e-06 1.529e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.35 6.35 6.35 100.00% Amr::init() 1 5.155 5.155 5.155 81.18% Amr::initialInit() 1 4.92 4.92 4.92 77.48% Amr::FinalizeInit() 1 4.812 4.814 4.816 75.84% Castro::post_init() 2 3.586 3.697 3.769 59.35% Gravity::multilevel_solve_for_new_phi() 14 1.843 1.86 1.877 29.56% Gravity::actual_multilevel_solve() 14 1.841 1.857 1.874 29.51% Gravity::solve_phi_with_mlmg() 14 1.834 1.851 1.868 29.41% Castro::computeTemp() 36 1.086 1.157 1.269 19.99% Gravity::fill_multipole_BCs() 14 1.221 1.239 1.253 19.73% Amr::regrid() 14 1.198 1.218 1.24 19.53% Castro::clean_state() 33 1.053 1.111 1.199 18.88% Amr::InitAmr() 1 1.195 1.195 1.195 18.82% Amr::bldFineLevels() 1 0.884 0.9411 1.03 16.22% Castro::post_regrid() 30 0.8131 0.8434 0.885 13.94% Castro::initData() 3 0.5631 0.6344 0.7363 11.60% Gravity::actual_solve_with_mlmg() 14 0.6075 0.6113 0.6139 9.67% MLMG::solve() 14 0.5894 0.5898 0.59 9.29% MLMG::oneIter() 106 0.517 0.5176 0.5181 8.16% Castro::reset_internal_energy(MultiFab) 36 0.3857 0.4128 0.4554 7.17% Castro::reset_internal_energy(Fab) 654 0.3854 0.4125 0.455 7.17% FabArray::ParallelCopy() 2952 0.1233 0.3179 0.4368 6.88% MLMG::mgVcycle() 318 0.3831 0.384 0.3849 6.06% FabArray::ParallelCopy_finish() 2952 0.06174 0.2618 0.3812 6.00% MLCellLinOp::smooth() 2544 0.3132 0.3146 0.3192 5.03% amrex::average_down 844 0.07789 0.189 0.2606 4.10% Amr::writePlotFile() 1 0.2348 0.2349 0.2349 3.70% Castro::avgDown() 15 0.04659 0.157 0.228 3.59% Castro::avgDown(state_indx) 60 0.04656 0.157 0.2279 3.59% amrex::average_down_w_geom 60 0.04649 0.1569 0.2279 3.59% MLPoisson::Fsmooth() 5088 0.2024 0.2102 0.2156 3.40% Castro::derive() 97 0.1965 0.1969 0.1972 3.11% Castro::normalize_species() 33 0.1664 0.175 0.1879 2.96% Castro::Castro() 16 0.1357 0.1475 0.1684 2.65% MLCellLinOp::applyBC() 6294 0.1388 0.1473 0.1571 2.47% amrex::Copy() 975 0.1329 0.1369 0.1404 2.21% Amr::grid_places() 15 0.01843 0.08795 0.133 2.09% AmrMesh::MakeNewGrids() 15 0.01794 0.08757 0.1326 2.09% FabArray::FillBoundary() 5552 0.1013 0.1101 0.1215 1.91% Castro::initMFs() 16 0.09478 0.1048 0.1205 1.90% TagBoxArray::mapPRD 15 0.001083 0.07061 0.1157 1.82% MLMG::mgVcycle_down::0 106 0.1073 0.1081 0.1087 1.71% Amr::InitializeInit() 1 0.1038 0.1063 0.1079 1.70% Amr::defBaseLevel() 1 0.1038 0.1063 0.1079 1.70% MLMG::mgVcycle_bottom 318 0.101 0.102 0.1058 1.67% MLMG::miniCycle() 212 0.1011 0.1016 0.102 1.61% FillPatchIterator::Initialize 215 0.09034 0.09314 0.09551 1.50% MLMG::mgVcycle_up::0 106 0.09421 0.09454 0.09497 1.50% FillBoundary_finish() 5552 0.05363 0.06365 0.07582 1.19% MLMG::computeResWithCrseSolFineCor() 106 0.07338 0.07433 0.07525 1.18% AmrLevel::AmrLevel(dm) 16 0.05455 0.06024 0.06909 1.09% StateData::define() 64 0.05442 0.06011 0.06897 1.09% MLCellLinOp::apply() 1040 0.05883 0.06094 0.06266 0.99% FillPatchSingleLevel 259 0.0541 0.05736 0.06262 0.99% MLCellLinOp::correctionResidual() 755 0.05704 0.05873 0.06132 0.97% FabArray::ParallelCopy_nowait() 2952 0.05199 0.05475 0.06023 0.95% MLCellLinOp::solutionResidual() 258 0.05369 0.05547 0.05702 0.90% FillPatchTwoLevels 126 0.04592 0.04881 0.0519 0.82% MLCellLinOp::reflux() 138 0.04806 0.0493 0.05023 0.79% FabArray::setVal() 1769 0.04294 0.046 0.05009 0.79% Castro::init(old) 13 0.04508 0.04729 0.04983 0.78% FillBoundary_nowait() 5552 0.04297 0.04439 0.04563 0.72% VisMF::Write(FabArray) 2 0.02985 0.03088 0.03315 0.52% MLMG::computeResWithCrseCorFineCor() 106 0.0301 0.03136 0.03196 0.50% MLMG::addInterpCorrection() 530 0.01937 0.02994 0.03184 0.50% MLMG::computeResidual() 106 0.02706 0.02827 0.02882 0.45% MLPoisson::Fapply() 1040 0.02403 0.02528 0.02645 0.42% Castro::computeInitialDt() 1 0.02174 0.02328 0.02584 0.41% Castro::estTimeStep() 1 0.02174 0.02327 0.02584 0.41% MLMG::mgVcycle_down::1 106 0.02311 0.02348 0.02384 0.38% MLCellLinOp::updateSolBC() 120 0.01991 0.02081 0.02159 0.34% MLMG::mgVcycle_up::2 106 0.008686 0.01971 0.02143 0.34% MLMG::computeMLResidual() 32 0.02018 0.02092 0.02134 0.34% MLMG::mgVcycle_up::1 106 0.02062 0.02074 0.02081 0.33% MLMG:computeResOfCorrection() 530 0.018 0.01917 0.01988 0.31% MLCellLinOp::updateCorBC() 106 0.01828 0.01894 0.01948 0.31% Gravity::get_new_grav_vector() 4 0.01799 0.01836 0.01903 0.30% Castro::buildMetrics() 16 0.01336 0.01471 0.01691 0.27% MLPoisson::define() 14 0.01091 0.01452 0.01687 0.27% FabArray::Xpay() 1013 0.01198 0.01298 0.01441 0.23% MultiFab::Multiply() 287 0.01248 0.01305 0.01339 0.21% MLPoisson::FFlux() 3408 0.01138 0.01191 0.01311 0.21% amrex::Add() 575 0.0109 0.01145 0.01238 0.19% MLMG::interpCorrection_1 106 0.00964 0.01075 0.01172 0.18% MLMG::ResNormInf() 152 0.0097 0.01036 0.01124 0.18% MLMG::prepareForSolve() 14 0.009678 0.009916 0.01043 0.16% Castro::errorEst() 15 0.009802 0.009936 0.01024 0.16% MLMG::mgVcycle_down::2 106 0.009107 0.009349 0.01024 0.16% FillPatchInterp(MF) 44 0.001692 0.006515 0.009586 0.15% MLLinOp::define() 14 0.0005631 0.004457 0.006984 0.11% MLLinOp::defineGrids() 14 0.0005454 0.004439 0.006963 0.11% MLLinOp::makeSubCommunicator() 14 0.0001942 0.004043 0.006456 0.10% Castro::apply_tagging_restrictions() 15 0.006004 0.006178 0.006367 0.10% FabArrayBase::getCPC() 3662 0.005101 0.005282 0.005554 0.09% MLCellLinOp::defineAuxData() 14 0.004887 0.005008 0.005311 0.08% MLCellLinOp::defineBC() 14 0.00491 0.005022 0.005216 0.08% FabArray::norminf(mask) 46 0.004786 0.004985 0.005188 0.08% Castro::sum_integrated_quantities() 1 0.005057 0.005084 0.00516 0.08% MLMG::getGradSolution() 14 0.004528 0.004645 0.004779 0.08% MLCellLinOp::compGrad() 28 0.004511 0.004627 0.004761 0.07% MLMG::mgVcycle_down::3 106 0.001379 0.001798 0.004445 0.07% MLMG::MLResNormInf() 32 0.003984 0.004075 0.004208 0.07% MLMG::actualBottomSolve() 106 2.223e-05 0.0005316 0.004084 0.06% MultiFab::max() 54 0.002758 0.003412 0.003859 0.06% FabArray::norminf() 174 0.003023 0.003391 0.003819 0.06% MLCGSolver::bicgstab 13 0 0.0004699 0.003759 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003311 0.003458 0.00357 0.06% MLMG::mgVcycle_up::3 106 0.0009377 0.001305 0.003553 0.06% BndryData::define() 42 0.002808 0.002956 0.003049 0.05% Castro::enforce_min_density() 33 0.00246 0.002625 0.002816 0.04% FabArrayBase::TheFPinfo() 49 0.0004872 0.001571 0.002499 0.04% MLMG::mgVcycle_down::4 106 0.001156 0.001348 0.002441 0.04% FPinfo::FPinfo() 9 0.0004263 0.001507 0.002439 0.04% DistributionMapping::LeastUsedCPUs() 9 0.00037 0.001465 0.00238 0.04% average_down_faces 84 0.002014 0.002159 0.002301 0.04% FabArrayBase::CPC::define() 624 0.001632 0.001729 0.001967 0.03% MLMG::MLRhsNormInf() 14 0.001774 0.001855 0.001944 0.03% MLMG::mgVcycle_up::4 106 0.0011 0.001231 0.001917 0.03% Castro::volWgtSum() 46 0.001707 0.001729 0.001783 0.03% FabArray::mult() 34 0.00117 0.001339 0.001673 0.03% Gravity::update_max_rhs() 1 0.0006135 0.001074 0.001447 0.02% Castro::enforce_consistent_e() 3 0.0009975 0.001176 0.001425 0.02% FabArrayBase::getFB() 5552 0.001167 0.001229 0.001383 0.02% StateDataPhysBCFunct::() 259 0.001264 0.001325 0.001378 0.02% StateData::FillBoundary(geom) 8 0.001121 0.001169 0.001224 0.02% AMRErrorTag::operator() 15 0.0009459 0.0009551 0.0009708 0.02% Castro::build_fine_mask() 55 0.000633 0.0007132 0.0008523 0.01% MLCGSolver::ParallelAllReduce 81 0 7.338e-05 0.0005871 0.01% DistributionMapping::KnapSackDoIt() 2 5.01e-05 0.0003258 0.0005498 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0005062 0.0005256 0.0005444 0.01% MLPoisson::prepareForSolve() 14 0.0003593 0.0003934 0.0004774 0.01% MLCellLinOp::prepareForSolve() 14 0.0003473 0.0003796 0.0004649 0.01% FabArray::setDomainBndry() 259 0.000371 0.0004014 0.0004162 0.01% MLCellLinOp::setLevelBC() 28 0.0003304 0.000346 0.0003639 0.01% TagBoxArray::collate() 15 0.0002704 0.0003086 0.0003574 0.01% Castro::locWgtSum() 6 0.0001858 0.0001916 0.0001964 0.00% FabArrayBase::FB::FB() 35 8.663e-05 9.774e-05 0.0001563 0.00% amrex::Dot() 54 0 1.664e-05 0.0001331 0.00% OwnerMask() 15 8.508e-05 9.487e-05 0.0001125 0.00% AmrMesh-cluster 1 0 1.398e-05 0.0001119 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 5.808e-05 8.715e-05 0.0001037 0.00% MLLinOp::makeAgglomeratedDMap 14 6.624e-05 7.711e-05 9.617e-05 0.00% FabArray::Saxpy() 27 0 1.193e-05 9.547e-05 0.00% FabArray::LinComb() 27 0 1.169e-05 9.355e-05 0.00% Castro::volProductSum() 2 8.504e-05 8.748e-05 9.04e-05 0.00% makeSFC 42 4.414e-05 5.356e-05 6.776e-05 0.00% ClusterList::intersect() 1 0 8.152e-06 6.522e-05 0.00% Amr::writeSmallPlotFile() 1 2.84e-05 2.935e-05 3.11e-05 0.00% DistributionMapping::Distribute() 46 2.082e-05 2.439e-05 2.825e-05 0.00% BoxList::parallelComplementIn() 30 2.122e-05 2.325e-05 2.568e-05 0.00% FabArray::RecvLayoutMask() 14 1.569e-05 1.631e-05 1.837e-05 0.00% ClusterList::chop() 1 0 2.017e-06 1.614e-05 0.00% Castro::enforce_speed_limit() 33 1.17e-05 1.278e-05 1.369e-05 0.00% BoxList::complementIn 30 1.05e-05 1.159e-05 1.327e-05 0.00% knapsack() 2 1.007e-05 1.134e-05 1.263e-05 0.00% Amr::initSubcycle() 1 9.035e-06 1.016e-05 1.108e-05 0.00% Castro::apply_problem_tags() 15 5.676e-06 6.19e-06 6.826e-06 0.00% Castro::gwstrain() 2 1.037e-06 1.277e-06 1.701e-06 0.00% Gravity::set_mass_offset() 1 1.014e-06 1.214e-06 1.529e-06 0.00% -------------------------------------------------------------------------------------------- Cpu (amrex_mempool) Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 16 B 18 B 22 B 8192 KiB 8192 KiB 8192 KiB amrex_mempool_init() 8 8 8674 B 10 KiB 12 KiB 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.02-42-gd8e6401642ff) finalized