MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.03-11-g0f4f9877c81e) initialized Starting run at 07:10:13 UTC on 2023-03-16. Successfully read inputs file ... Castro git describe: 23.03-8-g17ee5df0a AMReX git describe: 23.03-11-g0f4f9877c Microphysics git describe: 23.03-13-ga480b6a9 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.00248516 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.109634846 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001390565 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.002643107 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001078422 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001132855 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001078676 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001063466 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001061727 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00108532 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001094197 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001075986 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001100747 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00153373 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.004178223 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225826e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 2.373778793e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.284381237e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.577115472e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.261231677 seconds Ending run at 07:10:20 UTC on 2023-03-16. Run time = 6.503325868 Run time without initialization = 0.0003514810001 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.503 ... 6.503 ... 6.503 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.2125 1.2228 1.2329 18.96% Amr::InitAmr() 1 1.192 1.192 1.192 18.33% Castro::post_init() 2 0.9988 1.006 1.008 15.51% Castro::computeTemp() 36 0.6924 0.7352 0.8009 12.31% Castro::reset_internal_energy(Fab) 654 0.3916 0.4183 0.4567 7.02% FabArray::ParallelCopy_finish() 2952 0.1142 0.2938 0.4226 6.50% MLPoisson::Fsmooth() 5088 0.2251 0.2345 0.2439 3.75% Castro::normalize_species() 33 0.1642 0.174 0.1866 2.87% Castro::initData() 3 0.1152 0.1302 0.154 2.37% Castro::derive() 97 0.1387 0.1426 0.1505 2.31% amrex::Copy() 975 0.1288 0.1325 0.1379 2.12% Castro::initMFs() 16 0.09635 0.1085 0.1263 1.94% FillBoundary_finish() 5552 0.06522 0.07437 0.09254 1.42% StateData::define() 64 0.05516 0.06236 0.0728 1.12% amrex::average_down 844 0.0421 0.04598 0.05088 0.78% FabArray::setVal() 1769 0.04139 0.04542 0.04758 0.73% FillBoundary_nowait() 5552 0.03882 0.04247 0.04572 0.70% Castro::estTimeStep() 1 0.02074 0.03578 0.04224 0.65% MLCellLinOp::applyBC() 6294 0.03502 0.03671 0.03944 0.61% VisMF::Write(FabArray) 2 0.03208 0.03261 0.03499 0.54% FabArray::ParallelCopy_nowait() 2952 0.02341 0.0261 0.03095 0.48% MLPoisson::Fapply() 1040 0.02365 0.02487 0.02675 0.41% FillPatchIterator::Initialize 215 0.01514 0.01874 0.02673 0.41% Amr::writePlotFile() 1 0.005128 0.01163 0.02627 0.40% MLMG::addInterpCorrection() 530 0.01926 0.01947 0.01996 0.31% MLCellLinOp::reflux() 138 0.01861 0.01925 0.01972 0.30% Amr::regrid() 14 0.01329 0.01567 0.01907 0.29% FabArray::Xpay() 1013 0.01176 0.01342 0.01669 0.26% Castro::buildMetrics() 16 0.01204 0.01356 0.01588 0.24% MultiFab::Multiply() 287 0.01245 0.01281 0.01297 0.20% MLPoisson::FFlux() 3408 0.0112 0.01167 0.01213 0.19% amrex::Add() 575 0.01053 0.01125 0.01206 0.19% MLCellLinOp::updateSolBC() 120 0.01044 0.01146 0.01201 0.18% MLCellLinOp::updateCorBC() 106 0.009421 0.01041 0.01101 0.17% Castro::Castro() 16 0.008614 0.00962 0.011 0.17% FillPatchInterp(MF) 44 0.001703 0.006427 0.009523 0.15% MLMG::interpCorrection_1 106 0.006326 0.006981 0.007635 0.12% MLMG::prepareForSolve() 14 0.004747 0.005195 0.006896 0.11% AmrMesh::MakeNewGrids() 15 0.006346 0.006428 0.006516 0.10% Castro::apply_tagging_restrictions() 15 0.005957 0.006178 0.00645 0.10% MLLinOp::makeSubCommunicator() 14 0.0002535 0.004001 0.006112 0.09% FabArray::norminf(mask) 46 0.004727 0.004848 0.004949 0.08% MLMG::ResNormInf() 152 0.00295 0.003719 0.004591 0.07% MLCellLinOp::compGrad() 28 0.003155 0.003441 0.004499 0.07% MLCellLinOp::defineAuxData() 14 0.003759 0.003896 0.004152 0.06% Gravity::multilevel_solve_for_new_phi() 14 0.002745 0.003031 0.003868 0.06% FabArray::norminf() 174 0.002967 0.003273 0.003727 0.06% FabArrayBase::getCPC() 3662 0.003403 0.003529 0.003621 0.06% MultiFab::max() 54 0.002877 0.003218 0.003415 0.05% Gravity::get_new_grav_vector() 4 0.001899 0.002368 0.003135 0.05% Castro::enforce_min_density() 33 0.00252 0.002639 0.002829 0.04% BndryData::define() 42 0.002274 0.002415 0.002585 0.04% Gravity::actual_solve_with_mlmg() 14 0.00188 0.002026 0.002218 0.03% FabArray::FillBoundary() 5552 0.001951 0.002006 0.002084 0.03% Castro::sum_integrated_quantities() 1 0.0003747 0.001661 0.002069 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0005326 0.001273 0.002024 0.03% MLCellLinOp::defineBC() 14 0.001787 0.001932 0.002002 0.03% FabArrayBase::CPC::define() 624 0.001592 0.001707 0.001939 0.03% MLCellLinOp::smooth() 2544 0.001648 0.001684 0.001715 0.03% Castro::volWgtSum() 46 0.00166 0.001679 0.001711 0.03% MLMG::MLResNormInf() 32 0.0002573 0.0008051 0.001674 0.03% FabArray::mult() 34 0.001158 0.001319 0.001621 0.02% MLCGSolver::bicgstab 13 0 0.0001853 0.001483 0.02% Castro::enforce_consistent_e() 3 0.001028 0.001183 0.00139 0.02% StateData::FillBoundary(geom) 8 0.001265 0.001307 0.001345 0.02% FillPatchTwoLevels 126 0.0006747 0.0011 0.001308 0.02% FabArrayBase::getFB() 5552 0.001091 0.001135 0.001246 0.02% FabArray::ParallelCopy() 2952 0.00118 0.001217 0.001245 0.02% average_down_faces 84 0.001014 0.001099 0.001182 0.02% AMRErrorTag::operator() 15 0.0009405 0.0009599 0.0009889 0.02% Gravity::actual_multilevel_solve() 14 0.0007841 0.0008448 0.0009508 0.01% Castro::build_fine_mask() 55 0.0006405 0.0007123 0.0007914 0.01% MLMG::solve() 14 0.0004213 0.0005601 0.0007188 0.01% MLCellLinOp::apply() 1040 0.0004427 0.0004719 0.0006064 0.01% main() 1 0.0004027 0.0004646 0.0005399 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000465 0.0004827 0.0005172 0.01% MLMG::mgVcycle() 318 0.0003923 0.0004457 0.0005049 0.01% Amr::grid_places() 15 0.0003454 0.0003891 0.0004786 0.01% MLCGSolver::ParallelAllReduce 81 0 5.885e-05 0.0004708 0.01% MLCellLinOp::correctionResidual() 755 0.0003912 0.0004057 0.0004611 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0002726 0.0003421 0.0004488 0.01% MLCellLinOp::prepareForSolve() 14 0.0003504 0.0003753 0.0004381 0.01% FabArray::setDomainBndry() 259 0.0003592 0.0003861 0.0004274 0.01% TagBoxArray::collate() 15 0.0002292 0.0003038 0.0004083 0.01% MLLinOp::defineGrids() 14 0.000261 0.0003164 0.0003606 0.01% MLCellLinOp::setLevelBC() 28 0.0003188 0.0003363 0.0003493 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002773 0.0002906 0.000303 0.00% MLMG::oneIter() 106 0.0002543 0.0002768 0.0002968 0.00% MLMG::actualBottomSolve() 106 2.235e-05 5.581e-05 0.0002776 0.00% MLCellLinOp::solutionResidual() 258 0.0001741 0.0001935 0.0002591 0.00% MLMG::mgVcycle_bottom 318 0.0002154 0.0002326 0.0002581 0.00% Castro::locWgtSum() 6 0.0001836 0.000189 0.0001982 0.00% Castro::init(old) 13 0.0001463 0.0001662 0.0001961 0.00% MLMG:computeResOfCorrection() 530 0.000149 0.0001606 0.0001799 0.00% FillPatchSingleLevel 259 0.0001561 0.0001676 0.0001777 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001509 0.0001638 0.0001765 0.00% MLMG::mgVcycle_down::0 106 0.0001414 0.0001527 0.0001756 0.00% AmrLevel::AmrLevel(dm) 16 0.0001245 0.0001538 0.0001673 0.00% StateDataPhysBCFunct::() 259 0.000137 0.0001449 0.0001629 0.00% FabArrayBase::FB::FB() 35 7.77e-05 8.959e-05 0.0001385 0.00% amrex::Dot() 54 0 1.642e-05 0.0001313 0.00% Gravity::update_max_rhs() 1 8.277e-05 0.0001018 0.0001307 0.00% FPinfo::FPinfo() 9 8.382e-05 9.376e-05 0.0001301 0.00% MLMG::mgVcycle_down::1 106 0.0001115 0.0001186 0.0001265 0.00% MLMG::miniCycle() 212 8.818e-05 9.888e-05 0.0001223 0.00% OwnerMask() 15 8.903e-05 0.0001048 0.0001157 0.00% TagBoxArray::mapPRD 15 9.452e-05 9.93e-05 0.0001049 0.00% MLMG::mgVcycle_down::2 106 8.214e-05 8.699e-05 0.0001044 0.00% FabArray::LinComb() 27 0 1.295e-05 0.0001036 0.00% Castro::post_regrid() 30 6.105e-05 7.222e-05 9.532e-05 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.462e-05 8.715e-05 9.453e-05 0.00% Castro::clean_state() 33 6.109e-05 6.72e-05 8.733e-05 0.00% Castro::volProductSum() 2 8.053e-05 8.416e-05 8.724e-05 0.00% Castro::avgDown(state_indx) 60 6.186e-05 7.044e-05 8.683e-05 0.00% MLMG::mgVcycle_down::3 106 7.233e-05 7.784e-05 8.656e-05 0.00% Castro::errorEst() 15 4.463e-05 5.504e-05 8.654e-05 0.00% FabArray::Saxpy() 27 0 1.076e-05 8.608e-05 0.00% Gravity::solve_phi_with_mlmg() 14 5.986e-05 6.795e-05 8.172e-05 0.00% Amr::FinalizeInit() 1 6.984e-06 2.716e-05 8.095e-05 0.00% MLMG::mgVcycle_up::4 106 6.479e-05 6.911e-05 7.647e-05 0.00% MLMG::mgVcycle_down::4 106 6.797e-05 6.988e-05 7.484e-05 0.00% MLMG::mgVcycle_up::0 106 6.677e-05 6.983e-05 7.319e-05 0.00% MLMG::computeMLResidual() 32 3.665e-05 4.321e-05 7.095e-05 0.00% MLMG::computeResidual() 106 5.655e-05 6.052e-05 7.015e-05 0.00% MLMG::mgVcycle_up::1 106 5.64e-05 5.96e-05 6.782e-05 0.00% FabArrayBase::TheFPinfo() 49 5.939e-05 6.345e-05 6.706e-05 0.00% MLMG::mgVcycle_up::3 106 5.225e-05 5.506e-05 6.435e-05 0.00% ClusterList::intersect() 1 0 7.642e-06 6.113e-05 0.00% MLMG::mgVcycle_up::2 106 5.339e-05 5.477e-05 5.606e-05 0.00% Amr::defBaseLevel() 1 1.952e-05 3.689e-05 5.599e-05 0.00% amrex::average_down_w_geom 60 3.648e-05 4.39e-05 5.423e-05 0.00% MLPoisson::define() 14 3.116e-05 3.707e-05 4.475e-05 0.00% Castro::avgDown() 15 3.34e-05 3.686e-05 4.334e-05 0.00% makeSFC 42 2.725e-05 3.247e-05 3.77e-05 0.00% Amr::writeSmallPlotFile() 1 2.981e-05 3.075e-05 3.168e-05 0.00% MLLinOp::define() 14 1.903e-05 2.171e-05 3.131e-05 0.00% DistributionMapping::Distribute() 46 2.249e-05 2.53e-05 3.109e-05 0.00% AmrMesh-cluster 1 0 3.818e-06 3.055e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.256e-05 2.34e-05 2.537e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.703e-05 2.03e-05 2.491e-05 0.00% MLMG::getGradSolution() 14 1.687e-05 1.797e-05 1.958e-05 0.00% Amr::bldFineLevels() 1 1.457e-05 1.601e-05 1.778e-05 0.00% FabArray::RecvLayoutMask() 14 1.511e-05 1.59e-05 1.736e-05 0.00% ClusterList::chop() 1 0 2.088e-06 1.671e-05 0.00% MLPoisson::prepareForSolve() 14 1.244e-05 1.381e-05 1.627e-05 0.00% Castro::enforce_speed_limit() 33 1.222e-05 1.377e-05 1.581e-05 0.00% Amr::initSubcycle() 1 8.592e-06 1.074e-05 1.412e-05 0.00% BoxList::parallelComplementIn() 30 1.1e-05 1.156e-05 1.255e-05 0.00% knapsack() 2 1.058e-05 1.12e-05 1.195e-05 0.00% BoxList::complementIn 30 9.694e-06 1.061e-05 1.186e-05 0.00% MLMG::MLRhsNormInf() 14 8.321e-06 8.924e-06 9.478e-06 0.00% Castro::apply_problem_tags() 15 5.558e-06 6.369e-06 6.713e-06 0.00% DistributionMapping::KnapSackDoIt() 2 3.933e-06 4.417e-06 5.114e-06 0.00% Amr::InitializeInit() 1 2.081e-06 2.866e-06 4.069e-06 0.00% Amr::init() 1 1.546e-06 2.297e-06 2.896e-06 0.00% Castro::computeInitialDt() 1 1.62e-06 2.112e-06 2.712e-06 0.00% Castro::gwstrain() 2 8.6e-07 1.283e-06 1.862e-06 0.00% Gravity::set_mass_offset() 1 9.13e-07 1.182e-06 1.556e-06 0.00% Amr::initialInit() 1 1.197e-06 1.406e-06 1.539e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.503 6.503 6.503 100.00% Amr::init() 1 5.311 5.311 5.311 81.66% Amr::initialInit() 1 5.049 5.049 5.049 77.64% Amr::FinalizeInit() 1 4.924 4.939 4.945 76.04% Castro::post_init() 2 3.701 3.813 3.88 59.66% Gravity::multilevel_solve_for_new_phi() 14 1.869 1.884 1.895 29.14% Gravity::actual_multilevel_solve() 14 1.867 1.881 1.893 29.10% Gravity::solve_phi_with_mlmg() 14 1.86 1.874 1.886 29.01% Castro::computeTemp() 36 1.084 1.154 1.258 19.34% Amr::regrid() 14 1.204 1.225 1.251 19.24% Gravity::fill_multipole_BCs() 14 1.214 1.224 1.234 18.98% Amr::InitAmr() 1 1.192 1.192 1.192 18.33% Castro::clean_state() 33 1.054 1.108 1.186 18.23% Amr::bldFineLevels() 1 0.8834 0.9378 1.029 15.82% Castro::post_regrid() 30 0.8134 0.8426 0.8807 13.54% Castro::initData() 3 0.5652 0.6315 0.7357 11.31% Gravity::actual_solve_with_mlmg() 14 0.6458 0.6496 0.6515 10.02% MLMG::solve() 14 0.6267 0.6271 0.6274 9.65% MLMG::oneIter() 106 0.5456 0.5463 0.5466 8.40% FabArray::ParallelCopy() 2952 0.1726 0.347 0.4745 7.30% Castro::reset_internal_energy(MultiFab) 36 0.3921 0.4187 0.457 7.03% Castro::reset_internal_energy(Fab) 654 0.3916 0.4183 0.4567 7.02% FabArray::ParallelCopy_finish() 2952 0.1142 0.2938 0.4226 6.50% MLMG::mgVcycle() 318 0.406 0.4091 0.4108 6.32% MLCellLinOp::smooth() 2544 0.3379 0.3412 0.3479 5.35% Amr::writePlotFile() 1 0.2614 0.2615 0.2615 4.02% amrex::average_down 844 0.07411 0.1889 0.2573 3.96% MLPoisson::Fsmooth() 5088 0.2251 0.2345 0.2439 3.75% Castro::avgDown() 15 0.04556 0.1596 0.2266 3.48% Castro::avgDown(state_indx) 60 0.04553 0.1596 0.2266 3.48% amrex::average_down_w_geom 60 0.04546 0.1595 0.2265 3.48% Castro::derive() 97 0.2063 0.2186 0.2222 3.42% Castro::normalize_species() 33 0.1642 0.174 0.1866 2.87% Castro::Castro() 16 0.1359 0.1516 0.1739 2.67% MLCellLinOp::applyBC() 6294 0.1495 0.1568 0.1696 2.61% amrex::Copy() 975 0.1288 0.1325 0.1379 2.12% FabArray::FillBoundary() 5552 0.1124 0.1201 0.1345 2.07% Amr::grid_places() 15 0.02251 0.08931 0.1273 1.96% FillPatchIterator::Initialize 215 0.09373 0.1173 0.127 1.95% AmrMesh::MakeNewGrids() 15 0.02215 0.08892 0.1269 1.95% Castro::initMFs() 16 0.09635 0.1085 0.1263 1.94% Amr::InitializeInit() 1 0.1041 0.1105 0.1255 1.93% Amr::defBaseLevel() 1 0.1041 0.1105 0.1255 1.93% MLMG::mgVcycle_bottom 318 0.1083 0.1115 0.1164 1.79% MLMG::mgVcycle_down::0 106 0.113 0.1138 0.1146 1.76% MLMG::miniCycle() 212 0.1085 0.1112 0.1126 1.73% TagBoxArray::mapPRD 15 0.005577 0.07201 0.1098 1.69% MLMG::mgVcycle_up::0 106 0.1039 0.1042 0.1048 1.61% FillPatchSingleLevel 259 0.04887 0.07866 0.09477 1.46% FillBoundary_finish() 5552 0.06522 0.07437 0.09254 1.42% MLMG::computeResWithCrseSolFineCor() 106 0.07526 0.07686 0.07805 1.20% AmrLevel::AmrLevel(dm) 16 0.05533 0.06251 0.07295 1.12% StateData::define() 64 0.05516 0.06236 0.0728 1.12% MLCellLinOp::apply() 1040 0.05922 0.06234 0.06639 1.02% MLCellLinOp::correctionResidual() 755 0.05848 0.06059 0.06276 0.97% MLCellLinOp::solutionResidual() 258 0.05579 0.05743 0.06227 0.96% MLCellLinOp::reflux() 138 0.05361 0.05659 0.05829 0.90% FabArray::ParallelCopy_nowait() 2952 0.04913 0.05193 0.05722 0.88% FillPatchTwoLevels 126 0.04642 0.05193 0.0561 0.86% Castro::init(old) 13 0.04548 0.05064 0.05424 0.83% FabArray::setVal() 1769 0.04139 0.04542 0.04758 0.73% FillBoundary_nowait() 5552 0.04 0.04369 0.04693 0.72% Castro::computeInitialDt() 1 0.02074 0.03578 0.04224 0.65% Castro::estTimeStep() 1 0.02074 0.03578 0.04224 0.65% VisMF::Write(FabArray) 2 0.03208 0.03261 0.03499 0.54% MLMG::computeResWithCrseCorFineCor() 106 0.0304 0.03233 0.03429 0.53% MLMG::addInterpCorrection() 530 0.02139 0.03183 0.03357 0.52% MLMG::computeMLResidual() 32 0.02777 0.02918 0.02992 0.46% MLMG::computeResidual() 106 0.0272 0.0281 0.02859 0.44% MLPoisson::Fapply() 1040 0.02365 0.02487 0.02675 0.41% MLMG::mgVcycle_down::1 106 0.02342 0.02466 0.02527 0.39% MLCellLinOp::updateSolBC() 120 0.02138 0.02249 0.02329 0.36% Gravity::get_new_grav_vector() 4 0.02002 0.02086 0.02142 0.33% MLMG::mgVcycle_up::2 106 0.008383 0.01945 0.02113 0.32% MLMG::mgVcycle_up::1 106 0.02018 0.02025 0.02034 0.31% MLCellLinOp::updateCorBC() 106 0.01825 0.01923 0.02008 0.31% MLMG:computeResOfCorrection() 530 0.01788 0.01833 0.01958 0.30% Castro::buildMetrics() 16 0.01339 0.01511 0.01772 0.27% FabArray::Xpay() 1013 0.01176 0.01342 0.01669 0.26% MLPoisson::define() 14 0.01067 0.0144 0.01636 0.25% MultiFab::Multiply() 287 0.01245 0.01281 0.01297 0.20% MLPoisson::FFlux() 3408 0.0112 0.01167 0.01213 0.19% amrex::Add() 575 0.01053 0.01125 0.01206 0.19% MLMG::interpCorrection_1 106 0.009893 0.01093 0.01183 0.18% MLMG::prepareForSolve() 14 0.009729 0.01036 0.01169 0.18% MLMG::ResNormInf() 152 0.009502 0.01003 0.01077 0.17% Castro::errorEst() 15 0.009613 0.009929 0.01017 0.16% MLMG::mgVcycle_down::2 106 0.009033 0.009187 0.009931 0.15% FillPatchInterp(MF) 44 0.001703 0.006427 0.009523 0.15% MLLinOp::define() 14 0.0006307 0.004414 0.006567 0.10% MLLinOp::defineGrids() 14 0.0006104 0.004392 0.006546 0.10% Castro::apply_tagging_restrictions() 15 0.005957 0.006178 0.00645 0.10% MLLinOp::makeSubCommunicator() 14 0.0002535 0.004001 0.006112 0.09% Castro::sum_integrated_quantities() 1 0.005924 0.00598 0.006076 0.09% MLMG::getGradSolution() 14 0.005605 0.005707 0.005856 0.09% MLCellLinOp::compGrad() 28 0.005588 0.005689 0.005836 0.09% FabArrayBase::getCPC() 3662 0.005055 0.005235 0.005482 0.08% MLMG::MLResNormInf() 32 0.004035 0.004511 0.00544 0.08% MLCellLinOp::defineAuxData() 14 0.004735 0.004919 0.005165 0.08% MLCellLinOp::defineBC() 14 0.004825 0.005029 0.00513 0.08% FabArray::norminf(mask) 46 0.004727 0.004848 0.004949 0.08% MLMG::mgVcycle_down::3 106 0.001256 0.001726 0.004511 0.07% MLMG::actualBottomSolve() 106 2.235e-05 0.0005259 0.004038 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.00337 0.003596 0.003813 0.06% FabArray::norminf() 174 0.002967 0.003273 0.003727 0.06% MLCGSolver::bicgstab 13 0 0.0004635 0.003708 0.06% MLMG::mgVcycle_up::3 106 0.0009153 0.001271 0.003639 0.06% MultiFab::max() 54 0.002877 0.003218 0.003415 0.05% BndryData::define() 42 0.002806 0.002971 0.003156 0.05% Castro::enforce_min_density() 33 0.00252 0.002639 0.002829 0.04% average_down_faces 84 0.002056 0.002294 0.002463 0.04% MLMG::mgVcycle_down::4 106 0.001134 0.001307 0.002381 0.04% FabArrayBase::TheFPinfo() 49 0.0006513 0.00138 0.002163 0.03% FPinfo::FPinfo() 9 0.0005914 0.001316 0.002098 0.03% DistributionMapping::LeastUsedCPUs() 9 0.0005326 0.001273 0.002024 0.03% FabArrayBase::CPC::define() 624 0.001592 0.001707 0.001939 0.03% MLMG::mgVcycle_up::4 106 0.0011 0.001205 0.001898 0.03% MLMG::MLRhsNormInf() 14 0.001732 0.001807 0.001855 0.03% Castro::volWgtSum() 46 0.001665 0.001684 0.001717 0.03% FabArray::mult() 34 0.001158 0.001319 0.001621 0.02% StateDataPhysBCFunct::() 259 0.001404 0.001451 0.001493 0.02% Castro::enforce_consistent_e() 3 0.001028 0.001183 0.00139 0.02% FabArrayBase::getFB() 5552 0.001175 0.001225 0.001384 0.02% StateData::FillBoundary(geom) 8 0.001265 0.001307 0.001345 0.02% Gravity::update_max_rhs() 1 0.0005919 0.0009119 0.001154 0.02% AMRErrorTag::operator() 15 0.0009405 0.0009599 0.0009889 0.02% Castro::build_fine_mask() 55 0.0006405 0.0007123 0.0007914 0.01% MLCGSolver::ParallelAllReduce 81 0 6.886e-05 0.0005509 0.01% DistributionMapping::KnapSackDoIt() 2 3.757e-05 0.0003544 0.0005441 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.000465 0.0004827 0.0005172 0.01% MLPoisson::prepareForSolve() 14 0.0003649 0.0003891 0.0004514 0.01% MLCellLinOp::prepareForSolve() 14 0.0003504 0.0003753 0.0004381 0.01% FabArray::setDomainBndry() 259 0.0003592 0.0003861 0.0004274 0.01% TagBoxArray::collate() 15 0.0002292 0.0003038 0.0004083 0.01% MLCellLinOp::setLevelBC() 28 0.0003188 0.0003363 0.0003493 0.01% Castro::locWgtSum() 6 0.0001841 0.0001896 0.0001988 0.00% FabArrayBase::FB::FB() 35 7.77e-05 8.959e-05 0.0001385 0.00% amrex::Dot() 54 0 1.642e-05 0.0001313 0.00% OwnerMask() 15 8.903e-05 0.0001048 0.0001157 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 6.758e-05 9.197e-05 0.0001146 0.00% AmrMesh-cluster 1 0 1.355e-05 0.0001084 0.00% FabArray::LinComb() 27 0 1.295e-05 0.0001036 0.00% Castro::volProductSum() 2 8.073e-05 8.438e-05 8.749e-05 0.00% FabArray::Saxpy() 27 0 1.076e-05 8.608e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 6.88e-05 7.539e-05 8.563e-05 0.00% makeSFC 42 4.624e-05 5.199e-05 6.161e-05 0.00% ClusterList::intersect() 1 0 7.642e-06 6.113e-05 0.00% Amr::writeSmallPlotFile() 1 2.981e-05 3.075e-05 3.168e-05 0.00% DistributionMapping::Distribute() 46 2.249e-05 2.53e-05 3.109e-05 0.00% BoxList::parallelComplementIn() 30 2.083e-05 2.218e-05 2.323e-05 0.00% FabArray::RecvLayoutMask() 14 1.511e-05 1.59e-05 1.736e-05 0.00% ClusterList::chop() 1 0 2.088e-06 1.671e-05 0.00% Castro::enforce_speed_limit() 33 1.222e-05 1.377e-05 1.581e-05 0.00% Amr::initSubcycle() 1 8.592e-06 1.074e-05 1.412e-05 0.00% knapsack() 2 1.058e-05 1.12e-05 1.195e-05 0.00% BoxList::complementIn 30 9.694e-06 1.061e-05 1.186e-05 0.00% Castro::apply_problem_tags() 15 5.558e-06 6.369e-06 6.713e-06 0.00% Castro::gwstrain() 2 8.6e-07 1.283e-06 1.862e-06 0.00% Gravity::set_mass_offset() 1 9.13e-07 1.182e-06 1.556e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 16 B 18 B 20 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.03-11-g0f4f9877c81e) finalized