MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.03-12-gadcf4d4721b4) initialized Starting run at 18:18:54 UTC on 2023-03-16. Successfully read inputs file ... Castro git describe: 23.03-15-gc99e6fbe6 AMReX git describe: 23.03-12-gadcf4d472 Microphysics git describe: 23.03-15-gf8fb1850 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0006897957295 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006897957295 grid_places() time: 0.002510855 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.112123887 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 27 grids 884736 cells 42.1875 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Now regridding at level lbase = 0 grid_places() time: 0.001443151 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 163840 cells 7.8125 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 32 x 16 Relaxation iterations completed: 1 L-infinity norm of residual (relative to old state): 0.9989762608 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -3.124305956e+51 Internal energy: 2.436922647e+50 Virial error: 0.7660034566 Mass: 6.318509172 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00201902 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 2 L-infinity norm of residual (relative to old state): 0.9279058977 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -6.67850462e+50 Internal energy: 1.437332213e+50 Virial error: 0.3543469856 Mass: 3.906872525 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00109639 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 3 L-infinity norm of residual (relative to old state): 0.7274381815 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.541614827e+50 Internal energy: 8.137035244e+49 Virial error: 0.03954346396 Mass: 1.897844596 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001075643 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 4 L-infinity norm of residual (relative to old state): 0.422397066 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.155509991e+50 Internal energy: 7.709619679e+49 Virial error: 0.07301098743 Mass: 1.824999774 solar masses Now regridding at level lbase = 0 grid_places() time: 0.00108356 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 5 L-infinity norm of residual (relative to old state): 0.1636021093 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -2.022705738e+50 Internal energy: 7.549212217e+49 Virial error: 0.1196703616 Mass: 1.79765548 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001077113 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 6 L-infinity norm of residual (relative to old state): 0.05463665804 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.975079248e+50 Internal energy: 7.490161061e+49 Virial error: 0.1377003328 Mass: 1.787603551 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001179575 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 7 L-infinity norm of residual (relative to old state): 0.02057466715 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.9579391e+50 Internal energy: 7.468777332e+49 Virial error: 0.1443835001 Mass: 1.783968613 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001062834 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 8 L-infinity norm of residual (relative to old state): 0.007452617698 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.951802533e+50 Internal energy: 7.461117376e+49 Virial error: 0.1468041335 Mass: 1.782667786 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001216419 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 9 L-infinity norm of residual (relative to old state): 0.002655581458 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.949616885e+50 Internal energy: 7.458390948e+49 Virial error: 0.1476702429 Mass: 1.782205054 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001085862 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 10 L-infinity norm of residual (relative to old state): 0.0009395966873 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948841216e+50 Internal energy: 7.457424042e+49 Virial error: 0.1479781906 Mass: 1.782041006 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001089781 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 11 L-infinity norm of residual (relative to old state): 0.0003312401846 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948566562e+50 Internal energy: 7.457081878e+49 Virial error: 0.1480873206 Mass: 1.781982964 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001101191 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 12 L-infinity norm of residual (relative to old state): 0.0001164660774 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.948469459e+50 Internal energy: 7.456960981e+49 Virial error: 0.148125922 Mass: 1.781962456 solar masses Now regridding at level lbase = 0 grid_places() time: 0.001095128 new finest: 1 Castro::numpts_1d at level 1 is 229 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Relaxation iterations completed: 13 L-infinity norm of residual (relative to old state): 4.095225826e-05 Rotational period (s): 0 Kinetic energy: 0 Potential energy: -1.94843517e+50 Internal energy: 7.456918333e+49 Virial error: 0.1481395608 Mass: 1.781955219 solar masses Relaxation completed! TIME= 0 MASS = 8.352245583e+32 TIME= 0 XMOM = 0 TIME= 0 YMOM = 0 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = 0 TIME= 0 ANG MOM Y = 0 TIME= 0 ANG MOM Z = 0 TIME= 0 RHO*e = 2.118052636e+49 TIME= 0 RHO*K = 0 TIME= 0 RHO*E = 2.118052636e+49 TIME= 0 RHO*PHI = -8.163063831e+49 TIME= 0 TOTAL ENERGY= -1.963479279e+49 TIME= 0 CENTER OF MASS X-LOC = 2.373778793e-07 TIME= 0 CENTER OF MASS X-VEL = 0 TIME= 0 CENTER OF MASS Y-LOC = 4.284381237e-06 TIME= 0 CENTER OF MASS Y-VEL = 0 TIME= 0 CENTER OF MASS Z-LOC = 1.577115472e-05 TIME= 0 CENTER OF MASS Z-VEL = 0 TIME= 0 MAXIMUM TEMPERATURE = 32885673.5 TIME= 0 MAXIMUM DENSITY = 1351900 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 8 grids 32768 cells 1.5625 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 PLOTFILE: file = scf-test_plt00000 Write plotfile time = 0.237670488 seconds Ending run at 18:19:01 UTC on 2023-03-16. Run time = 6.373679429 Run time without initialization = 0.000263204 Average number of zones advanced per microsecond: 0.000 Average number of zones advanced per microsecond per rank: 0.000 TinyProfiler total time across processes [min...avg...max]: 6.374 ... 6.374 ... 6.374 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Gravity::fill_multipole_BCs() 14 1.1951 1.2101 1.2285 19.27% Amr::InitAmr() 1 1.194 1.194 1.194 18.73% Castro::post_init() 2 0.9642 0.9658 0.9664 15.16% Castro::computeTemp() 36 0.6951 0.737 0.8018 12.58% Castro::reset_internal_energy(Fab) 654 0.3924 0.4172 0.4592 7.20% FabArray::ParallelCopy_finish() 2952 0.05587 0.26 0.3892 6.11% MLPoisson::Fsmooth() 5088 0.2248 0.2326 0.245 3.84% Castro::normalize_species() 33 0.1647 0.1732 0.1853 2.91% Castro::initData() 3 0.1163 0.1291 0.1504 2.36% Castro::derive() 97 0.1395 0.1414 0.1452 2.28% amrex::Copy() 975 0.1301 0.1335 0.1371 2.15% Castro::initMFs() 16 0.09654 0.1071 0.1232 1.93% FillBoundary_finish() 5552 0.04483 0.06012 0.07205 1.13% StateData::define() 64 0.05543 0.06131 0.07029 1.10% amrex::average_down 844 0.04241 0.04558 0.05161 0.81% FabArray::setVal() 1769 0.04233 0.04591 0.04909 0.77% FillBoundary_nowait() 5552 0.04074 0.04236 0.04539 0.71% MLCellLinOp::applyBC() 6294 0.03484 0.03642 0.04004 0.63% VisMF::Write(FabArray) 2 0.03203 0.03269 0.0348 0.55% FabArray::ParallelCopy_nowait() 2952 0.02345 0.02609 0.03076 0.48% MLPoisson::Fapply() 1040 0.02341 0.0244 0.02591 0.41% Castro::estTimeStep() 1 0.02182 0.02221 0.02259 0.35% MLMG::addInterpCorrection() 530 0.01909 0.01929 0.0201 0.32% MLCellLinOp::reflux() 138 0.01857 0.01895 0.01926 0.30% Amr::regrid() 14 0.01406 0.016 0.01882 0.30% FillPatchIterator::Initialize 215 0.01566 0.0171 0.01853 0.29% Castro::buildMetrics() 16 0.01198 0.01331 0.01517 0.24% FabArray::Xpay() 1013 0.01218 0.01269 0.01388 0.22% MultiFab::Multiply() 287 0.01267 0.01281 0.01312 0.21% amrex::Add() 575 0.01062 0.01124 0.01239 0.19% MLCellLinOp::updateSolBC() 120 0.01048 0.01142 0.0119 0.19% MLPoisson::FFlux() 3408 0.01129 0.01146 0.01165 0.18% Castro::Castro() 16 0.00873 0.009492 0.0111 0.17% MLCellLinOp::updateCorBC() 106 0.009449 0.01032 0.01075 0.17% FillPatchInterp(MF) 44 0.001672 0.006381 0.009537 0.15% Amr::writePlotFile() 1 0.005597 0.007899 0.008608 0.14% MLMG::interpCorrection_1 106 0.006312 0.007142 0.008281 0.13% AmrMesh::MakeNewGrids() 15 0.006381 0.00647 0.006635 0.10% Castro::apply_tagging_restrictions() 15 0.005881 0.006169 0.006457 0.10% MLMG::prepareForSolve() 14 0.004678 0.004925 0.005112 0.08% MLLinOp::makeSubCommunicator() 14 0.0009303 0.002902 0.004885 0.08% FabArray::norminf(mask) 46 0.004749 0.004781 0.004815 0.08% MLMG::ResNormInf() 152 0.00242 0.003545 0.004212 0.07% MLCellLinOp::defineAuxData() 14 0.003811 0.003873 0.00404 0.06% FabArrayBase::getCPC() 3662 0.003441 0.003542 0.003666 0.06% FabArray::norminf() 174 0.003006 0.003227 0.003635 0.06% MultiFab::max() 54 0.002884 0.003294 0.003602 0.06% MLCellLinOp::compGrad() 28 0.003156 0.003253 0.003357 0.05% Gravity::multilevel_solve_for_new_phi() 14 0.002668 0.002846 0.002994 0.05% Castro::enforce_min_density() 33 0.002536 0.002654 0.002853 0.04% BndryData::define() 42 0.002252 0.002352 0.002424 0.04% Gravity::get_new_grav_vector() 4 0.001887 0.002085 0.00241 0.04% Gravity::actual_solve_with_mlmg() 14 0.001895 0.001986 0.002202 0.03% FabArray::FillBoundary() 5552 0.001928 0.001995 0.002142 0.03% DistributionMapping::LeastUsedCPUs() 9 8.696e-05 0.001263 0.002098 0.03% MLCellLinOp::defineBC() 14 0.001786 0.001922 0.001981 0.03% FabArrayBase::CPC::define() 624 0.001566 0.001731 0.001922 0.03% MLCellLinOp::smooth() 2544 0.001645 0.001692 0.001834 0.03% Castro::volWgtSum() 46 0.001714 0.001758 0.001811 0.03% FabArray::mult() 34 0.001157 0.001316 0.001617 0.03% Castro::enforce_consistent_e() 3 0.001045 0.001225 0.001471 0.02% MLCGSolver::bicgstab 13 0 0.0001832 0.001466 0.02% FillPatchTwoLevels 126 0.0006694 0.00111 0.001372 0.02% StateData::FillBoundary(geom) 8 0.001248 0.001297 0.001351 0.02% FabArray::ParallelCopy() 2952 0.001174 0.001201 0.001265 0.02% FabArrayBase::getFB() 5552 0.001068 0.001118 0.001248 0.02% average_down_faces 84 0.001014 0.001114 0.001193 0.02% AMRErrorTag::operator() 15 0.0009372 0.0009585 0.0009807 0.02% Gravity::actual_multilevel_solve() 14 0.0007823 0.0008237 0.0008556 0.01% Castro::build_fine_mask() 55 0.0006372 0.0007288 0.0007893 0.01% Castro::sum_integrated_quantities() 1 0.0005059 0.0005725 0.0006477 0.01% MLMG::solve() 14 0.0004814 0.0005519 0.0006311 0.01% MLCellLinOp::apply() 1040 0.000425 0.0004678 0.0006021 0.01% MLCGSolver::ParallelAllReduce 81 0 6.533e-05 0.0005227 0.01% Amr::grid_places() 15 0.0003578 0.0003941 0.0005109 0.01% MLMG::mgVcycle() 318 0.0003951 0.0004303 0.0005064 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004574 0.0004743 0.0004927 0.01% MLCellLinOp::correctionResidual() 755 0.0003858 0.0004121 0.0004875 0.01% Castro::reset_internal_energy(MultiFab) 36 0.0003036 0.0003614 0.0004605 0.01% MLCellLinOp::prepareForSolve() 14 0.000356 0.0003807 0.0004508 0.01% main() 1 0.0003978 0.0004196 0.0004491 0.01% FabArray::setDomainBndry() 259 0.0003838 0.0004052 0.0004271 0.01% MLLinOp::defineGrids() 14 0.0002608 0.0003127 0.000401 0.01% MLCellLinOp::setLevelBC() 28 0.0003239 0.0003552 0.0003805 0.01% MLMG::MLResNormInf() 32 0.0002004 0.0002495 0.0003613 0.01% TagBoxArray::collate() 15 0.0002516 0.0003072 0.0003462 0.01% Gravity::average_fine_ec_onto_crse_ec() 14 0.0002698 0.0002927 0.0003158 0.00% MLMG::oneIter() 106 0.000257 0.0002819 0.0003021 0.00% MLMG::actualBottomSolve() 106 2.255e-05 5.839e-05 0.0002972 0.00% MLMG::mgVcycle_bottom 318 0.0002102 0.00025 0.0002776 0.00% MLCellLinOp::solutionResidual() 258 0.0001758 0.0001921 0.000228 0.00% Castro::locWgtSum() 6 0.0001867 0.0001948 0.0001994 0.00% FillPatchSingleLevel 259 0.0001558 0.0001711 0.0001902 0.00% MLMG::computeResWithCrseSolFineCor() 106 0.0001587 0.0001655 0.0001792 0.00% Castro::init(old) 13 0.000149 0.0001662 0.0001761 0.00% MLMG:computeResOfCorrection() 530 0.0001454 0.0001586 0.0001749 0.00% MLMG::mgVcycle_down::0 106 0.0001383 0.0001463 0.0001703 0.00% AmrLevel::AmrLevel(dm) 16 0.0001422 0.0001523 0.0001665 0.00% StateDataPhysBCFunct::() 259 0.0001331 0.0001426 0.0001542 0.00% FabArrayBase::FB::FB() 35 7.922e-05 9.956e-05 0.000137 0.00% Gravity::update_max_rhs() 1 8.899e-05 0.000105 0.0001304 0.00% MLMG::mgVcycle_down::1 106 0.0001068 0.0001142 0.0001278 0.00% MLMG::miniCycle() 212 8.505e-05 9.773e-05 0.000125 0.00% amrex::Dot() 54 0 1.553e-05 0.0001242 0.00% FPinfo::FPinfo() 9 7.384e-05 9.158e-05 0.0001213 0.00% OwnerMask() 15 8.749e-05 9.943e-05 0.00011 0.00% TagBoxArray::mapPRD 15 9.397e-05 9.696e-05 0.0001011 0.00% MLMG::computeResWithCrseCorFineCor() 106 8.394e-05 9.006e-05 9.977e-05 0.00% MLMG::mgVcycle_down::3 106 7.301e-05 8.047e-05 9.559e-05 0.00% MLMG::mgVcycle_down::2 106 8.215e-05 8.618e-05 9.364e-05 0.00% Castro::volProductSum() 2 8.6e-05 8.751e-05 9.167e-05 0.00% Amr::FinalizeInit() 1 7.541e-06 2.836e-05 8.582e-05 0.00% Castro::avgDown(state_indx) 60 6.476e-05 7.31e-05 8.581e-05 0.00% MLMG::mgVcycle_down::4 106 6.752e-05 7.241e-05 8.525e-05 0.00% Castro::post_regrid() 30 6.354e-05 7.435e-05 8.29e-05 0.00% FabArray::LinComb() 27 0 1.031e-05 8.248e-05 0.00% Castro::errorEst() 15 4.76e-05 5.477e-05 8.111e-05 0.00% FabArray::Saxpy() 27 0 9.504e-06 7.603e-05 0.00% MLMG::mgVcycle_up::4 106 6.465e-05 7.047e-05 7.559e-05 0.00% MLMG::mgVcycle_up::0 106 6.535e-05 6.828e-05 7.498e-05 0.00% Gravity::solve_phi_with_mlmg() 14 6.265e-05 6.859e-05 7.408e-05 0.00% Castro::clean_state() 33 6.468e-05 6.863e-05 7.202e-05 0.00% FabArrayBase::TheFPinfo() 49 6.082e-05 6.538e-05 6.944e-05 0.00% MLMG::mgVcycle_up::1 106 5.422e-05 5.902e-05 6.718e-05 0.00% MLMG::computeResidual() 106 5.546e-05 5.888e-05 6.497e-05 0.00% MLMG::mgVcycle_up::3 106 5.158e-05 5.444e-05 6.323e-05 0.00% ClusterList::intersect() 1 0 7.497e-06 5.998e-05 0.00% MLMG::mgVcycle_up::2 106 5.218e-05 5.379e-05 5.712e-05 0.00% Castro::avgDown() 15 3.241e-05 4.014e-05 5.268e-05 0.00% Amr::defBaseLevel() 1 2.654e-05 4.249e-05 5.201e-05 0.00% MLMG::computeMLResidual() 32 3.789e-05 4.289e-05 5.176e-05 0.00% MLPoisson::define() 14 3.345e-05 3.921e-05 4.965e-05 0.00% amrex::average_down_w_geom 60 3.839e-05 4.282e-05 4.683e-05 0.00% makeSFC 42 2.542e-05 3.471e-05 4.329e-05 0.00% Amr::bldFineLevels() 1 1.711e-05 2.518e-05 3.419e-05 0.00% MLLinOp::makeAgglomeratedDMap 14 2.164e-05 2.468e-05 3.105e-05 0.00% AmrMesh-cluster 1 0 3.816e-06 3.052e-05 0.00% Amr::writeSmallPlotFile() 1 2.928e-05 2.974e-05 3.039e-05 0.00% DistributionMapping::Distribute() 46 2.37e-05 2.516e-05 2.677e-05 0.00% MLLinOp::define() 14 1.884e-05 2.167e-05 2.397e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 1.71e-05 2.015e-05 2.365e-05 0.00% MLMG::getGradSolution() 14 1.655e-05 1.815e-05 2.028e-05 0.00% ClusterList::chop() 1 0 2.393e-06 1.915e-05 0.00% FabArray::RecvLayoutMask() 14 1.466e-05 1.558e-05 1.725e-05 0.00% MLPoisson::prepareForSolve() 14 1.125e-05 1.342e-05 1.457e-05 0.00% Castro::enforce_speed_limit() 33 1.094e-05 1.233e-05 1.382e-05 0.00% Amr::initialInit() 1 1.362e-06 3.155e-06 1.36e-05 0.00% knapsack() 2 1.076e-05 1.148e-05 1.23e-05 0.00% BoxList::parallelComplementIn() 30 1.07e-05 1.142e-05 1.186e-05 0.00% Amr::init() 1 1.913e-06 4.729e-06 1.15e-05 0.00% BoxList::complementIn 30 8.823e-06 1.03e-05 1.141e-05 0.00% Amr::initSubcycle() 1 9.5e-06 1.023e-05 1.062e-05 0.00% MLMG::MLRhsNormInf() 14 8.284e-06 8.73e-06 9.564e-06 0.00% Castro::apply_problem_tags() 15 5.735e-06 6.588e-06 7.731e-06 0.00% Amr::InitializeInit() 1 2.546e-06 3.126e-06 5.033e-06 0.00% DistributionMapping::KnapSackDoIt() 2 4.199e-06 4.569e-06 5.018e-06 0.00% Castro::computeInitialDt() 1 1.961e-06 2.549e-06 3.448e-06 0.00% Castro::gwstrain() 2 7.6e-07 1.195e-06 1.827e-06 0.00% Gravity::set_mass_offset() 1 9.86e-07 1.234e-06 1.361e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 6.374 6.374 6.374 100.00% Amr::init() 1 5.179 5.179 5.179 81.26% Amr::initialInit() 1 4.941 4.941 4.942 77.53% Amr::FinalizeInit() 1 4.833 4.834 4.834 75.84% Castro::post_init() 2 3.614 3.722 3.788 59.44% Gravity::multilevel_solve_for_new_phi() 14 1.834 1.847 1.864 29.24% Gravity::actual_multilevel_solve() 14 1.831 1.844 1.861 29.20% Gravity::solve_phi_with_mlmg() 14 1.825 1.838 1.855 29.10% Castro::computeTemp() 36 1.089 1.155 1.261 19.79% Amr::regrid() 14 1.203 1.216 1.236 19.39% Gravity::fill_multipole_BCs() 14 1.197 1.212 1.23 19.30% Amr::InitAmr() 1 1.194 1.194 1.194 18.73% Castro::clean_state() 33 1.056 1.107 1.189 18.66% Amr::bldFineLevels() 1 0.8857 0.9396 1.026 16.10% Castro::post_regrid() 30 0.815 0.8403 0.8803 13.81% Castro::initData() 3 0.5685 0.6331 0.7359 11.55% Gravity::actual_solve_with_mlmg() 14 0.6239 0.626 0.628 9.85% MLMG::solve() 14 0.6054 0.6059 0.6062 9.51% MLMG::oneIter() 106 0.5336 0.5343 0.535 8.39% Castro::reset_internal_energy(MultiFab) 36 0.3927 0.4176 0.4596 7.21% Castro::reset_internal_energy(Fab) 654 0.3924 0.4172 0.4592 7.20% FabArray::ParallelCopy() 2952 0.115 0.3143 0.4412 6.92% MLMG::mgVcycle() 318 0.3991 0.4003 0.4018 6.30% FabArray::ParallelCopy_finish() 2952 0.05587 0.26 0.3892 6.11% MLCellLinOp::smooth() 2544 0.3307 0.3328 0.3388 5.32% amrex::average_down 844 0.07651 0.1847 0.2532 3.97% MLPoisson::Fsmooth() 5088 0.2248 0.2326 0.245 3.84% Amr::writePlotFile() 1 0.2378 0.238 0.238 3.73% Castro::avgDown() 15 0.04721 0.1557 0.2234 3.51% Castro::avgDown(state_indx) 60 0.04716 0.1556 0.2234 3.50% amrex::average_down_w_geom 60 0.0471 0.1556 0.2233 3.50% Castro::derive() 97 0.198 0.1982 0.1983 3.11% Castro::normalize_species() 33 0.1647 0.1732 0.1853 2.91% Castro::Castro() 16 0.1355 0.15 0.1707 2.68% MLCellLinOp::applyBC() 6294 0.1338 0.1421 0.1511 2.37% amrex::Copy() 975 0.1301 0.1335 0.1371 2.15% Amr::grid_places() 15 0.01942 0.08677 0.1298 2.04% AmrMesh::MakeNewGrids() 15 0.01905 0.08637 0.1294 2.03% Castro::initMFs() 16 0.09654 0.1071 0.1232 1.93% FabArray::FillBoundary() 5552 0.09375 0.1057 0.1162 1.82% MLMG::mgVcycle_bottom 318 0.1069 0.1085 0.1132 1.78% TagBoxArray::mapPRD 15 0.002274 0.06943 0.1121 1.76% MLMG::mgVcycle_down::0 106 0.1108 0.1113 0.1119 1.76% MLMG::miniCycle() 212 0.107 0.1081 0.1094 1.72% Amr::InitializeInit() 1 0.1073 0.1077 0.1081 1.70% Amr::defBaseLevel() 1 0.1073 0.1077 0.1081 1.70% MLMG::mgVcycle_up::0 106 0.1031 0.1033 0.1036 1.63% FillPatchIterator::Initialize 215 0.08848 0.0919 0.09518 1.49% MLMG::computeResWithCrseSolFineCor() 106 0.07282 0.07417 0.07531 1.18% FillBoundary_finish() 5552 0.04483 0.06012 0.07205 1.13% AmrLevel::AmrLevel(dm) 16 0.05558 0.06146 0.07044 1.11% StateData::define() 64 0.05543 0.06131 0.07029 1.10% FillPatchSingleLevel 259 0.05152 0.0567 0.06252 0.98% MLCellLinOp::apply() 1040 0.05718 0.05891 0.06058 0.95% MLCellLinOp::correctionResidual() 755 0.05693 0.05775 0.05864 0.92% FabArray::ParallelCopy_nowait() 2952 0.05055 0.05307 0.05785 0.91% MLCellLinOp::solutionResidual() 258 0.05298 0.05474 0.05652 0.89% FillPatchTwoLevels 126 0.04472 0.04884 0.05167 0.81% MLCellLinOp::reflux() 138 0.04881 0.05066 0.05155 0.81% Castro::init(old) 13 0.04553 0.04775 0.04967 0.78% FabArray::setVal() 1769 0.04233 0.04591 0.04909 0.77% FillBoundary_nowait() 5552 0.04195 0.04358 0.04678 0.73% VisMF::Write(FabArray) 2 0.03203 0.03269 0.0348 0.55% MLMG::addInterpCorrection() 530 0.02162 0.03196 0.03357 0.53% MLMG::computeResWithCrseCorFineCor() 106 0.03123 0.03188 0.03244 0.51% MLMG::computeResidual() 106 0.02658 0.02773 0.02829 0.44% MLPoisson::Fapply() 1040 0.02341 0.0244 0.02591 0.41% MLMG::mgVcycle_down::1 106 0.02231 0.02256 0.02276 0.36% Castro::computeInitialDt() 1 0.02182 0.02221 0.0226 0.35% Castro::estTimeStep() 1 0.02182 0.02221 0.02259 0.35% MLMG::computeMLResidual() 32 0.02086 0.02156 0.02212 0.35% MLCellLinOp::updateSolBC() 120 0.01987 0.02067 0.02154 0.34% MLMG::mgVcycle_up::2 106 0.00847 0.01975 0.02144 0.34% MLCellLinOp::updateCorBC() 106 0.01824 0.01968 0.02063 0.32% MLMG::mgVcycle_up::1 106 0.02003 0.02008 0.02012 0.32% Gravity::get_new_grav_vector() 4 0.01739 0.01795 0.0186 0.29% MLMG:computeResOfCorrection() 530 0.01761 0.01793 0.01831 0.29% Castro::buildMetrics() 16 0.01329 0.01481 0.01695 0.27% MLPoisson::define() 14 0.01133 0.0132 0.01506 0.24% FabArray::Xpay() 1013 0.01218 0.01269 0.01388 0.22% MultiFab::Multiply() 287 0.01267 0.01281 0.01312 0.21% amrex::Add() 575 0.01062 0.01124 0.01239 0.19% MLMG::interpCorrection_1 106 0.009719 0.01081 0.01204 0.19% MLPoisson::FFlux() 3408 0.01129 0.01146 0.01165 0.18% MLMG::ResNormInf() 152 0.008923 0.009762 0.01046 0.16% MLMG::prepareForSolve() 14 0.009733 0.009957 0.01028 0.16% Castro::errorEst() 15 0.00964 0.009918 0.01027 0.16% MLMG::mgVcycle_down::2 106 0.008726 0.008925 0.009722 0.15% FillPatchInterp(MF) 44 0.001672 0.006381 0.009537 0.15% Castro::apply_tagging_restrictions() 15 0.005881 0.006169 0.006457 0.10% FabArrayBase::getCPC() 3662 0.005048 0.005273 0.005588 0.09% MLLinOp::define() 14 0.0013 0.003315 0.005312 0.08% MLLinOp::defineGrids() 14 0.001279 0.003293 0.005291 0.08% MLCellLinOp::defineAuxData() 14 0.004789 0.004883 0.005173 0.08% MLCellLinOp::defineBC() 14 0.004761 0.00496 0.005087 0.08% Castro::sum_integrated_quantities() 1 0.004815 0.004858 0.004933 0.08% MLLinOp::makeSubCommunicator() 14 0.0009303 0.002902 0.004885 0.08% FabArray::norminf(mask) 46 0.004749 0.004781 0.004815 0.08% MLMG::getGradSolution() 14 0.004428 0.004508 0.004601 0.07% MLMG::mgVcycle_down::3 106 0.001301 0.001748 0.004584 0.07% MLCellLinOp::compGrad() 28 0.004411 0.004489 0.004582 0.07% MLMG::actualBottomSolve() 106 2.255e-05 0.0005264 0.004041 0.06% MLMG::MLResNormInf() 32 0.003818 0.00389 0.00402 0.06% MLMG::mgVcycle_up::3 106 0.0009047 0.001263 0.003713 0.06% MLCGSolver::bicgstab 13 0 0.0004617 0.003694 0.06% FabArray::norminf() 174 0.003006 0.003227 0.003635 0.06% MultiFab::max() 54 0.002884 0.003294 0.003602 0.06% Gravity::average_fine_ec_onto_crse_ec() 14 0.003281 0.003438 0.003571 0.06% BndryData::define() 42 0.002797 0.002905 0.003012 0.05% Castro::enforce_min_density() 33 0.002536 0.002654 0.002853 0.04% MLMG::mgVcycle_down::4 106 0.001127 0.001294 0.002321 0.04% FabArrayBase::TheFPinfo() 49 0.0002109 0.001393 0.002231 0.03% FPinfo::FPinfo() 9 0.0001477 0.001328 0.002161 0.03% DistributionMapping::LeastUsedCPUs() 9 8.696e-05 0.001263 0.002098 0.03% average_down_faces 84 0.001813 0.001965 0.002048 0.03% MLMG::mgVcycle_up::4 106 0.00108 0.001201 0.001961 0.03% FabArrayBase::CPC::define() 624 0.001566 0.001731 0.001922 0.03% Castro::volWgtSum() 46 0.001726 0.001766 0.001824 0.03% MLMG::MLRhsNormInf() 14 0.00175 0.001787 0.001812 0.03% FabArray::mult() 34 0.001157 0.001316 0.001617 0.03% StateDataPhysBCFunct::() 259 0.001388 0.00144 0.001491 0.02% Castro::enforce_consistent_e() 3 0.001045 0.001225 0.001471 0.02% FabArrayBase::getFB() 5552 0.001165 0.001217 0.001385 0.02% StateData::FillBoundary(geom) 8 0.001248 0.001297 0.001351 0.02% Gravity::update_max_rhs() 1 0.0006044 0.000998 0.001223 0.02% AMRErrorTag::operator() 15 0.0009372 0.0009585 0.0009807 0.02% Castro::build_fine_mask() 55 0.0006372 0.0007288 0.0007893 0.01% DistributionMapping::KnapSackDoIt() 2 3.911e-05 0.0003744 0.0007255 0.01% MLCGSolver::ParallelAllReduce 81 0 7.432e-05 0.0005945 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 868 0.0004574 0.0004743 0.0004927 0.01% MLPoisson::prepareForSolve() 14 0.0003683 0.0003941 0.000462 0.01% MLCellLinOp::prepareForSolve() 14 0.000356 0.0003807 0.0004508 0.01% FabArray::setDomainBndry() 259 0.0003838 0.0004052 0.0004271 0.01% MLCellLinOp::setLevelBC() 28 0.0003239 0.0003552 0.0003805 0.01% TagBoxArray::collate() 15 0.0002516 0.0003072 0.0003462 0.01% Castro::locWgtSum() 6 0.0001874 0.0001954 0.0002001 0.00% FabArrayBase::FB::FB() 35 7.922e-05 9.956e-05 0.000137 0.00% amrex::Dot() 54 0 1.553e-05 0.0001242 0.00% OwnerMask() 15 8.749e-05 9.943e-05 0.00011 0.00% AmrMesh-cluster 1 0 1.371e-05 0.0001096 0.00% MLLinOp::makeAgglomeratedDMap 14 6.793e-05 7.887e-05 9.488e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 4 5.101e-05 6.847e-05 9.217e-05 0.00% Castro::volProductSum() 2 8.619e-05 8.771e-05 9.186e-05 0.00% FabArray::LinComb() 27 0 1.031e-05 8.248e-05 0.00% FabArray::Saxpy() 27 0 9.504e-06 7.603e-05 0.00% makeSFC 42 4.62e-05 5.42e-05 6.437e-05 0.00% ClusterList::intersect() 1 0 7.497e-06 5.998e-05 0.00% Amr::writeSmallPlotFile() 1 2.928e-05 2.974e-05 3.039e-05 0.00% DistributionMapping::Distribute() 46 2.37e-05 2.516e-05 2.677e-05 0.00% BoxList::parallelComplementIn() 30 1.993e-05 2.171e-05 2.327e-05 0.00% ClusterList::chop() 1 0 2.393e-06 1.915e-05 0.00% FabArray::RecvLayoutMask() 14 1.466e-05 1.558e-05 1.725e-05 0.00% Castro::enforce_speed_limit() 33 1.094e-05 1.233e-05 1.382e-05 0.00% knapsack() 2 1.076e-05 1.148e-05 1.23e-05 0.00% BoxList::complementIn 30 8.823e-06 1.03e-05 1.141e-05 0.00% Amr::initSubcycle() 1 9.5e-06 1.023e-05 1.062e-05 0.00% Castro::apply_problem_tags() 15 5.735e-06 6.588e-06 7.731e-06 0.00% Castro::gwstrain() 2 7.6e-07 1.195e-06 1.827e-06 0.00% Gravity::set_mass_offset() 1 9.86e-07 1.234e-06 1.361e-06 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 17 B 22 B 45 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.03-12-gadcf4d4721b4) finalized