MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.05-27-gd65dd906bd53) initialized Starting run at 05:37:59 UTC on 2023-05-24. Successfully read inputs file ... Castro git describe: 23.05-25-g99ae92958 AMReX git describe: 23.05-27-gd65dd906b Microphysics git describe: 23.05-12-g1f8fd85f reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.01543531 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.355877317 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.338606228 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.329957708 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.33215536 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.331475474 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.369799143 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.341330229 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.317578254 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.316124013 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.317918037 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010288975 seconds Ending run at 05:38:02 UTC on 2023-05-24. Run time = 3.569598896 Run time without initialization = 3.368690038 Average number of zones advanced per microsecond: 0.778 Average number of zones advanced per microsecond per rank: 0.097 TinyProfiler total time across processes [min...avg...max]: 3.568 ... 3.569 ... 3.57 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.3019 2.3668 2.4147 67.65% Gravity::make_radial_gravity() 21 0.3265 0.3357 0.3531 9.89% Castro::do_advance_ctu() 10 0.02747 0.07481 0.1421 3.98% Castro::initData() 1 0.03988 0.08269 0.1335 3.74% Castro::estTimeStep() 21 0.0218 0.07766 0.1238 3.47% FabArray::ParallelCopy_finish() 41 0.03778 0.05834 0.1026 2.87% amrex::Copy() 193 0.06152 0.07679 0.09057 2.54% FabArray::setVal() 143 0.05419 0.06885 0.07807 2.19% Castro::reset_internal_energy(Fab) 1008 0.0478 0.04995 0.05155 1.44% FabArray::ParallelCopy_nowait() 41 0.03602 0.04201 0.04456 1.25% Castro::normalize_species() 62 0.04145 0.04183 0.04241 1.19% FillPatchIterator::Initialize 41 0.02798 0.03466 0.04199 1.18% StateData::FillBoundary(geom) 41 0.03287 0.03496 0.03813 1.07% Gravity::interpolate_monopole_grav() 21 0.02811 0.02883 0.02951 0.83% Castro::construct_new_gravity_source() 10 0.02169 0.02425 0.02596 0.73% Castro::computeTemp() 63 0.01819 0.01976 0.02039 0.57% Castro::initialize_do_advance() 10 0.01155 0.01686 0.01839 0.52% VisMF::Write(FabArray) 2 0.01332 0.01388 0.01649 0.46% Castro::initialize_advance() 10 0.003736 0.01082 0.01486 0.42% FabArray::Saxpy() 20 0.01224 0.01409 0.01481 0.41% FabArray::setDomainBndry() 41 0.01003 0.01209 0.01415 0.40% MultiFab::contains_nan() 20 0.01098 0.01195 0.0127 0.36% Amr::writePlotFile() 2 0.006748 0.009487 0.01111 0.31% Castro::construct_old_gravity_source() 10 0.00733 0.01018 0.01085 0.30% Castro::initMFs() 1 0.007063 0.007529 0.008186 0.23% main() 1 0.004958 0.005997 0.006746 0.19% Castro::construct_new_source() 50 0.0056 0.006401 0.006711 0.19% StateData::define() 4 0.005978 0.006329 0.006684 0.19% Castro::enforce_min_density() 62 0.005774 0.006074 0.006368 0.18% Castro::swap_state_time_levels() 10 0.003476 0.004555 0.004937 0.14% Gravity::get_new_grav_vector() 11 0.002953 0.00373 0.004196 0.12% Gravity::get_old_grav_vector() 10 0.001737 0.002258 0.002672 0.07% Amr::coarseTimeStep() 10 0.001751 0.00214 0.002633 0.07% Castro::finalize_do_advance() 10 0.000591 0.00161 0.002019 0.06% Castro::buildMetrics() 1 0.00167 0.001774 0.001879 0.05% Castro::expand_state() 10 0.0006967 0.000856 0.0009858 0.03% Amr::timeStep() 10 0.0001891 0.0002664 0.0006481 0.02% Amr::InitAmr() 1 0.0002761 0.0003016 0.0004067 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002915 0.0003116 0.0003632 0.01% Castro::clean_state() 62 0.000138 0.0001541 0.0001719 0.00% StateDataPhysBCFunct::() 41 8.248e-05 0.0001217 0.0001669 0.00% DistributionMapping::LeastUsedCPUs() 1 6.283e-06 0.0001082 0.0001348 0.00% Castro::finalize_advance() 10 9.964e-05 0.0001139 0.0001223 0.00% FillPatchSingleLevel 41 7.022e-05 8.411e-05 0.0001159 0.00% Castro::enforce_consistent_e() 1 8.078e-05 8.792e-05 9.423e-05 0.00% Castro::Castro() 1 5.895e-05 7.412e-05 9.334e-05 0.00% Amr::FinalizeInit() 1 4.275e-06 1.638e-05 9.082e-05 0.00% FabArray::ParallelCopy() 41 7.047e-05 7.622e-05 8.668e-05 0.00% FabArrayBase::getCPC() 41 4.71e-05 5.978e-05 7.794e-05 0.00% Castro::construct_old_source() 50 4.333e-05 6.493e-05 7.607e-05 0.00% Castro::do_new_sources() 10 5.41e-05 6.54e-05 7.556e-05 0.00% Amr::writeSmallPlotFile() 1 2.825e-05 5.216e-05 7.534e-05 0.00% Castro::do_old_sources() 10 5.47e-05 6.244e-05 7.406e-05 0.00% Castro::apply_source_to_state() 20 4.666e-05 5.198e-05 5.822e-05 0.00% Castro::subcycle_advance_ctu() 10 3.746e-05 4.638e-05 5.663e-05 0.00% Castro::advance() 10 3.827e-05 4.443e-05 5.178e-05 0.00% Castro::construct_old_gravity() 10 3.38e-05 4.024e-05 5.162e-05 0.00% Castro::construct_new_gravity() 10 3.613e-05 3.952e-05 4.807e-05 0.00% Amr::defBaseLevel() 1 2.408e-05 3.268e-05 4.11e-05 0.00% Castro::enforce_speed_limit() 62 2.511e-05 2.814e-05 3.256e-05 0.00% FabArrayBase::CPC::define() 2 1.989e-05 2.411e-05 3.219e-05 0.00% Castro::check_for_nan() 20 2.012e-05 2.326e-05 2.664e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.283e-05 1.631e-05 1.995e-05 0.00% Castro::post_timestep() 10 1.204e-05 1.474e-05 1.777e-05 0.00% Gravity::swapTimeLevels() 10 1.144e-05 1.368e-05 1.585e-05 0.00% Gravity::set_mass_offset() 10 9.481e-06 1.081e-05 1.277e-05 0.00% Castro::computeNewDt() 9 8.206e-06 1.028e-05 1.15e-05 0.00% Amr::initSubcycle() 1 8.889e-06 9.828e-06 1.059e-05 0.00% Castro::create_source_corrector() 10 7.266e-06 8.926e-06 9.948e-06 0.00% Castro::FluxRegCrseInit 10 8.054e-06 8.583e-06 9.3e-06 0.00% Castro::post_regrid() 1 2.462e-06 3.536e-06 7.497e-06 0.00% Castro::retry_advance_ctu() 10 4.908e-06 5.404e-06 6.479e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.512e-06 4.519e-06 5.821e-06 0.00% Amr::InitializeInit() 1 2.022e-06 2.586e-06 4.819e-06 0.00% Castro::computeInitialDt() 2 3.001e-06 3.896e-06 4.768e-06 0.00% Castro::post_init() 1 2.372e-06 3.543e-06 4.439e-06 0.00% Castro::FluxRegFineAdd() 10 2.008e-06 2.431e-06 2.916e-06 0.00% Amr::init() 1 1.784e-06 2.146e-06 2.682e-06 0.00% Amr::initialInit() 1 1.347e-06 1.647e-06 2.049e-06 0.00% DistributionMapping::Distribute() 1 8.21e-07 9.796e-07 1.06e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.568 3.569 3.57 100.00% Amr::coarseTimeStep() 10 3.352 3.352 3.352 93.89% Amr::timeStep() 10 3.34 3.34 3.34 93.58% Castro::advance() 10 3.323 3.324 3.324 93.13% Castro::subcycle_advance_ctu() 10 3.244 3.25 3.269 91.57% Castro::do_advance_ctu() 10 3.244 3.25 3.269 91.57% Castro::construct_ctu_hydro_source() 10 2.302 2.367 2.415 67.65% Gravity::make_radial_gravity() 21 0.3435 0.3526 0.3663 10.26% Castro::construct_old_gravity() 10 0.2078 0.2175 0.2296 6.43% Gravity::get_old_grav_vector() 10 0.2066 0.2167 0.2291 6.42% Gravity::get_new_grav_vector() 11 0.2191 0.2205 0.2213 6.20% FillPatchIterator::Initialize 41 0.1686 0.1824 0.213 5.97% Amr::init() 1 0.2004 0.2005 0.2005 5.62% Castro::construct_new_gravity() 10 0.1953 0.1961 0.1969 5.51% Amr::initialInit() 1 0.1847 0.1849 0.1851 5.18% Castro::initialize_do_advance() 10 0.1678 0.1753 0.1827 5.12% FillPatchSingleLevel 41 0.116 0.1357 0.1736 4.86% Amr::InitializeInit() 1 0.06141 0.1049 0.1568 4.39% Amr::defBaseLevel() 1 0.06141 0.1049 0.1568 4.39% Castro::expand_state() 10 0.1191 0.1282 0.1417 3.97% FabArray::ParallelCopy() 41 0.08161 0.1005 0.1388 3.89% Castro::initData() 1 0.04425 0.08676 0.1375 3.85% Castro::estTimeStep() 21 0.0218 0.07766 0.1238 3.47% Amr::FinalizeInit() 1 0.02819 0.07995 0.1236 3.46% Castro::clean_state() 62 0.1134 0.1171 0.1187 3.33% FabArray::ParallelCopy_finish() 41 0.03778 0.05834 0.1026 2.87% Castro::computeInitialDt() 2 0.00212 0.05401 0.09753 2.73% amrex::Copy() 193 0.06152 0.07679 0.09057 2.54% FabArray::setVal() 143 0.05419 0.06885 0.07807 2.19% Castro::initialize_advance() 10 0.05072 0.07068 0.07689 2.15% Castro::computeTemp() 63 0.0663 0.07001 0.07105 1.99% Castro::do_new_sources() 10 0.06092 0.06432 0.06887 1.93% Castro::reset_internal_energy(MultiFab) 63 0.04811 0.05026 0.05187 1.45% Castro::reset_internal_energy(Fab) 1008 0.0478 0.04995 0.05155 1.44% Castro::do_old_sources() 10 0.03953 0.04696 0.05147 1.44% FabArray::ParallelCopy_nowait() 41 0.03613 0.04209 0.04465 1.25% Castro::normalize_species() 62 0.04145 0.04183 0.04241 1.19% StateDataPhysBCFunct::() 41 0.03299 0.03508 0.03822 1.07% StateData::FillBoundary(geom) 41 0.03287 0.03496 0.03813 1.07% Castro::construct_new_source() 50 0.02729 0.03065 0.03262 0.91% Gravity::interpolate_monopole_grav() 21 0.02811 0.02883 0.02951 0.83% Amr::writePlotFile() 2 0.02576 0.02598 0.02621 0.73% Castro::construct_new_gravity_source() 10 0.02169 0.02425 0.02596 0.73% Castro::post_init() 1 0.02489 0.02533 0.02558 0.72% VisMF::Write(FabArray) 2 0.01332 0.01388 0.01649 0.46% Castro::post_timestep() 10 0.01551 0.016 0.01641 0.46% Castro::apply_source_to_state() 20 0.01229 0.01414 0.01486 0.42% FabArray::Saxpy() 20 0.01224 0.01409 0.01481 0.41% FabArray::setDomainBndry() 41 0.01003 0.01209 0.01415 0.40% Castro::check_for_nan() 20 0.01101 0.01197 0.01272 0.36% MultiFab::contains_nan() 20 0.01098 0.01195 0.0127 0.36% Castro::Castro() 1 0.01097 0.01165 0.0125 0.35% Castro::construct_old_source() 50 0.007373 0.01025 0.01092 0.31% Castro::construct_old_gravity_source() 10 0.00733 0.01018 0.01085 0.30% Castro::computeNewDt() 9 0.008444 0.008453 0.008461 0.24% Castro::initMFs() 1 0.007063 0.007529 0.008186 0.23% AmrLevel::AmrLevel(dm) 1 0.005991 0.006346 0.006703 0.19% StateData::define() 4 0.005978 0.006329 0.006684 0.19% Castro::enforce_min_density() 62 0.005774 0.006074 0.006368 0.18% Castro::swap_state_time_levels() 10 0.003476 0.004555 0.004937 0.14% Castro::finalize_advance() 10 0.003048 0.00328 0.003505 0.10% Castro::buildMetrics() 1 0.001792 0.001921 0.002051 0.06% Castro::finalize_do_advance() 10 0.000591 0.00161 0.002019 0.06% Castro::post_regrid() 1 0.001559 0.001667 0.001879 0.05% Amr::InitAmr() 1 0.0002858 0.0003114 0.0004156 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.062e-05 0.0001137 0.0001417 0.00% DistributionMapping::LeastUsedCPUs() 1 6.283e-06 0.0001082 0.0001348 0.00% FabArrayBase::getCPC() 41 6.718e-05 8.389e-05 0.0001101 0.00% Castro::enforce_consistent_e() 1 8.078e-05 8.792e-05 9.423e-05 0.00% Amr::writeSmallPlotFile() 1 2.825e-05 5.216e-05 7.534e-05 0.00% Castro::enforce_speed_limit() 62 2.511e-05 2.814e-05 3.256e-05 0.00% FabArrayBase::CPC::define() 2 1.989e-05 2.411e-05 3.219e-05 0.00% Gravity::swapTimeLevels() 10 1.144e-05 1.368e-05 1.585e-05 0.00% Gravity::set_mass_offset() 10 9.481e-06 1.081e-05 1.277e-05 0.00% Amr::initSubcycle() 1 8.889e-06 9.828e-06 1.059e-05 0.00% Castro::create_source_corrector() 10 7.266e-06 8.926e-06 9.948e-06 0.00% Castro::FluxRegCrseInit 10 8.054e-06 8.583e-06 9.3e-06 0.00% Castro::retry_advance_ctu() 10 4.908e-06 5.404e-06 6.479e-06 0.00% Castro::FluxRegFineAdd() 10 2.008e-06 2.431e-06 2.916e-06 0.00% DistributionMapping::Distribute() 1 8.21e-07 9.796e-07 1.06e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 31 B 33 B 38 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.05-27-gd65dd906bd53) finalized