MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.06-25-g239d4d899334) initialized Starting run at 00:25:06 UTC on 2023-06-25. Successfully read inputs file ... Castro git describe: 23.06-36-g90afb40ca AMReX git describe: 23.06-25-g239d4d899 Microphysics git describe: 23.06-35-gf4897945 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.015643413 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.365834131 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.3553328 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.338379183 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.336400969 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.359673558 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.350668739 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.317291611 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.313599023 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.317328493 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.315360422 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 1.421854856 seconds Ending run at 00:25:11 UTC on 2023-06-25. Run time = 4.984859986 Run time without initialization = 4.799167843 Average number of zones advanced per microsecond: 0.546 Average number of zones advanced per microsecond per rank: 0.068 TinyProfiler total time across processes [min...avg...max]: 4.984 ... 4.985 ... 4.985 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.3183 2.3816 2.4102 48.35% VisMF::Write(FabArray) 2 0.01227 0.719 1.428 28.64% Amr::writePlotFile() 2 0.006881 0.7158 1.423 28.54% Gravity::make_radial_gravity() 21 0.315 0.3227 0.3285 6.59% Castro::estTimeStep() 21 0.02148 0.07275 0.1225 2.46% Castro::initData() 1 0.03856 0.07844 0.1177 2.36% check_for_negative_density() 10 0.02379 0.05231 0.1177 2.36% FabArray::setVal() 143 0.06557 0.07897 0.09217 1.85% amrex::Copy() 193 0.07635 0.08277 0.0914 1.83% FabArray::ParallelCopy_finish() 41 0.03331 0.05634 0.07165 1.44% Castro::reset_internal_energy(Fab) 1008 0.04853 0.04987 0.05071 1.02% FabArray::ParallelCopy_nowait() 41 0.04128 0.04434 0.04585 0.92% Castro::normalize_species() 62 0.04108 0.0426 0.04474 0.90% FillPatchIterator::Initialize 41 0.03028 0.03646 0.04065 0.82% StateData::FillBoundary(geom) 41 0.03608 0.03808 0.04025 0.81% Castro::construct_new_gravity_source() 10 0.02338 0.02786 0.03273 0.66% Gravity::interpolate_monopole_grav() 21 0.02835 0.02915 0.0313 0.63% Castro::initialize_do_advance() 10 0.01634 0.01987 0.0232 0.47% Castro::computeTemp() 63 0.01866 0.01978 0.02044 0.41% Castro::initialize_advance() 10 0.009891 0.01277 0.01564 0.31% FabArray::Saxpy() 20 0.01407 0.01464 0.01545 0.31% FabArray::setDomainBndry() 41 0.009786 0.01257 0.01387 0.28% MultiFab::contains_nan() 20 0.01131 0.01219 0.01301 0.26% Castro::construct_old_gravity_source() 10 0.0105 0.01081 0.01131 0.23% Castro::initMFs() 1 0.006868 0.007253 0.008575 0.17% Castro::construct_new_source() 50 0.006237 0.006525 0.006856 0.14% main() 1 0.005783 0.006371 0.006693 0.13% Castro::enforce_min_density() 62 0.00591 0.006256 0.006683 0.13% StateData::define() 4 0.0057 0.00597 0.006525 0.13% Castro::swap_state_time_levels() 10 0.003516 0.004774 0.005254 0.11% Gravity::get_new_grav_vector() 11 0.003272 0.003969 0.004322 0.09% Amr::coarseTimeStep() 10 0.001576 0.002288 0.002971 0.06% Gravity::get_old_grav_vector() 10 0.001707 0.002163 0.002622 0.05% Castro::finalize_do_advance() 10 0.001706 0.002077 0.002471 0.05% Castro::buildMetrics() 1 0.001631 0.001719 0.001898 0.04% Castro::expand_state() 10 0.000732 0.0009044 0.001076 0.02% Amr::timeStep() 10 0.0001677 0.0002287 0.0004798 0.01% Amr::InitAmr() 1 0.00025 0.0002835 0.0004072 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002872 0.0003046 0.0003412 0.01% Castro::do_old_sources() 10 0.0001621 0.0001748 0.0001854 0.00% Castro::clean_state() 62 0.0001489 0.0001567 0.0001726 0.00% DistributionMapping::LeastUsedCPUs() 1 5.781e-06 0.0001389 0.0001644 0.00% Castro::do_advance_ctu() 10 0.0001015 0.0001269 0.0001524 0.00% StateDataPhysBCFunct::() 41 9.679e-05 0.0001118 0.0001374 0.00% Castro::finalize_advance() 10 8.897e-05 0.0001076 0.0001336 0.00% Amr::FinalizeInit() 1 4.965e-06 1.906e-05 0.0001104 0.00% Castro::Castro() 1 5.545e-05 7.423e-05 9.979e-05 0.00% Castro::enforce_consistent_e() 1 7.973e-05 8.784e-05 9.958e-05 0.00% FabArray::ParallelCopy() 41 7.129e-05 8.005e-05 9.333e-05 0.00% Castro::construct_old_source() 50 5.95e-05 7.196e-05 8.331e-05 0.00% FillPatchSingleLevel 41 7.227e-05 7.576e-05 8.215e-05 0.00% Castro::do_new_sources() 10 6.001e-05 7.059e-05 8.071e-05 0.00% Castro::advance() 10 3.747e-05 4.664e-05 7.975e-05 0.00% Amr::writeSmallPlotFile() 1 3.041e-05 5.183e-05 6.616e-05 0.00% FabArrayBase::getCPC() 41 5.039e-05 5.739e-05 6.57e-05 0.00% Castro::construct_new_gravity() 10 3.693e-05 4.619e-05 6.073e-05 0.00% Castro::subcycle_advance_ctu() 10 4.453e-05 5.242e-05 6.025e-05 0.00% Castro::construct_old_gravity() 10 4.008e-05 4.707e-05 5.971e-05 0.00% Castro::apply_source_to_state() 20 4.158e-05 4.702e-05 5.046e-05 0.00% Castro::post_timestep() 10 1.523e-05 2.168e-05 3.693e-05 0.00% AmrLevel::AmrLevel(dm) 1 2.206e-05 2.924e-05 3.456e-05 0.00% Castro::enforce_speed_limit() 62 2.49e-05 2.758e-05 3.179e-05 0.00% FabArrayBase::CPC::define() 2 2.152e-05 2.495e-05 3.124e-05 0.00% Castro::check_for_nan() 20 2.213e-05 2.433e-05 2.905e-05 0.00% Amr::defBaseLevel() 1 1.167e-05 1.559e-05 2.335e-05 0.00% Gravity::swapTimeLevels() 10 1.359e-05 1.592e-05 1.97e-05 0.00% Castro::create_source_corrector() 10 8.251e-06 1.01e-05 1.825e-05 0.00% Gravity::set_mass_offset() 10 9.986e-06 1.18e-05 1.394e-05 0.00% Castro::computeNewDt() 9 9.237e-06 1.083e-05 1.23e-05 0.00% Castro::FluxRegCrseInit 10 7.361e-06 8.91e-06 1.016e-05 0.00% Amr::initSubcycle() 1 8.15e-06 8.943e-06 9.857e-06 0.00% Castro::retry_advance_ctu() 10 6.55e-06 7.471e-06 8.012e-06 0.00% Amr::init() 1 1.762e-06 2.899e-06 7.647e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.687e-06 5.608e-06 7.477e-06 0.00% Castro::computeInitialDt() 2 4.241e-06 4.768e-06 5.105e-06 0.00% Castro::post_init() 1 3.338e-06 4.025e-06 4.838e-06 0.00% Amr::InitializeInit() 1 1.837e-06 2.562e-06 4.829e-06 0.00% Castro::post_regrid() 1 2.098e-06 3.202e-06 4.452e-06 0.00% Amr::initialInit() 1 1.472e-06 1.942e-06 2.632e-06 0.00% Castro::FluxRegFineAdd() 10 1.976e-06 2.133e-06 2.478e-06 0.00% DistributionMapping::Distribute() 1 8.82e-07 1.016e-06 1.165e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 4.984 4.985 4.985 100.00% Amr::coarseTimeStep() 10 3.371 3.371 3.371 67.62% Amr::timeStep() 10 3.358 3.359 3.36 67.39% Castro::advance() 10 3.341 3.343 3.343 67.07% Castro::subcycle_advance_ctu() 10 3.247 3.258 3.269 65.58% Castro::do_advance_ctu() 10 3.247 3.258 3.269 65.58% Castro::construct_ctu_hydro_source() 10 2.452 2.456 2.459 49.32% Amr::writePlotFile() 2 1.438 1.438 1.438 28.84% VisMF::Write(FabArray) 2 0.01227 0.719 1.428 28.64% Gravity::make_radial_gravity() 21 0.3322 0.3402 0.3467 6.96% Gravity::get_new_grav_vector() 11 0.2308 0.2316 0.2323 4.66% Castro::construct_new_gravity() 10 0.2049 0.2059 0.207 4.15% FillPatchIterator::Initialize 41 0.1689 0.1881 0.2068 4.15% Castro::construct_old_gravity() 10 0.1947 0.1999 0.2046 4.10% Gravity::get_old_grav_vector() 10 0.1935 0.199 0.204 4.09% Castro::initialize_do_advance() 10 0.1719 0.1844 0.1967 3.95% Amr::init() 1 0.1851 0.1853 0.1853 3.72% Amr::initialInit() 1 0.1693 0.1695 0.1697 3.40% FillPatchSingleLevel 41 0.1146 0.1391 0.1557 3.12% Castro::expand_state() 10 0.1133 0.1264 0.1411 2.83% Amr::InitializeInit() 1 0.06063 0.1001 0.1402 2.81% Amr::defBaseLevel() 1 0.06063 0.1001 0.1402 2.81% Castro::estTimeStep() 21 0.02148 0.07275 0.1225 2.46% Castro::initData() 1 0.04214 0.08248 0.1216 2.44% Castro::clean_state() 62 0.1156 0.1181 0.121 2.43% check_for_negative_density() 10 0.02379 0.05231 0.1177 2.36% FabArray::ParallelCopy() 41 0.07786 0.1008 0.1164 2.34% Amr::FinalizeInit() 1 0.02921 0.06938 0.1088 2.18% Castro::do_old_sources() 10 0.09423 0.09819 0.1028 2.06% FabArray::setVal() 143 0.06557 0.07897 0.09217 1.85% amrex::Copy() 193 0.07635 0.08277 0.0914 1.83% Castro::initialize_advance() 10 0.06969 0.08093 0.0911 1.83% Castro::do_new_sources() 10 0.06154 0.07265 0.08445 1.69% Castro::computeInitialDt() 2 0.002045 0.04206 0.08156 1.64% FabArray::ParallelCopy_finish() 41 0.03331 0.05634 0.07165 1.44% Castro::computeTemp() 63 0.06877 0.06995 0.07144 1.43% Castro::reset_internal_energy(MultiFab) 63 0.04882 0.05017 0.051 1.02% Castro::reset_internal_energy(Fab) 1008 0.04853 0.04987 0.05071 1.02% FabArray::ParallelCopy_nowait() 41 0.04136 0.04442 0.04592 0.92% Castro::normalize_species() 62 0.04108 0.0426 0.04474 0.90% StateDataPhysBCFunct::() 41 0.03619 0.0382 0.04036 0.81% StateData::FillBoundary(geom) 41 0.03608 0.03808 0.04025 0.81% Castro::construct_new_source() 50 0.02975 0.03439 0.03948 0.79% Castro::finalize_do_advance() 10 0.01202 0.02426 0.03652 0.73% Castro::construct_new_gravity_source() 10 0.02338 0.02786 0.03273 0.66% Gravity::interpolate_monopole_grav() 21 0.02835 0.02915 0.0313 0.63% Castro::post_init() 1 0.02648 0.02669 0.02693 0.54% Castro::post_timestep() 10 0.01554 0.01607 0.01647 0.33% Castro::apply_source_to_state() 20 0.01412 0.01469 0.01549 0.31% FabArray::Saxpy() 20 0.01407 0.01464 0.01545 0.31% FabArray::setDomainBndry() 41 0.009786 0.01257 0.01387 0.28% Castro::check_for_nan() 20 0.01134 0.01222 0.01304 0.26% MultiFab::contains_nan() 20 0.01131 0.01219 0.01301 0.26% Castro::Castro() 1 0.01095 0.01148 0.01249 0.25% Castro::construct_old_source() 50 0.01057 0.01088 0.01138 0.23% Castro::construct_old_gravity_source() 10 0.0105 0.01081 0.01131 0.23% Castro::initMFs() 1 0.006868 0.007253 0.008575 0.17% Castro::computeNewDt() 9 0.00851 0.008519 0.008526 0.17% Castro::enforce_min_density() 62 0.00591 0.006256 0.006683 0.13% AmrLevel::AmrLevel(dm) 1 0.00573 0.005999 0.00656 0.13% StateData::define() 4 0.0057 0.00597 0.006525 0.13% Castro::swap_state_time_levels() 10 0.003516 0.004774 0.005254 0.11% Castro::finalize_advance() 10 0.002981 0.003804 0.004635 0.09% Castro::buildMetrics() 1 0.00175 0.001849 0.00204 0.04% Castro::post_regrid() 1 0.001579 0.001671 0.00174 0.03% Amr::InitAmr() 1 0.0002582 0.0002924 0.0004157 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.035e-05 0.0001455 0.0001725 0.00% DistributionMapping::LeastUsedCPUs() 1 5.781e-06 0.0001389 0.0001644 0.00% Castro::enforce_consistent_e() 1 7.973e-05 8.784e-05 9.958e-05 0.00% FabArrayBase::getCPC() 41 7.388e-05 8.234e-05 9.257e-05 0.00% Amr::writeSmallPlotFile() 1 3.041e-05 5.183e-05 6.616e-05 0.00% Castro::enforce_speed_limit() 62 2.49e-05 2.758e-05 3.179e-05 0.00% FabArrayBase::CPC::define() 2 2.152e-05 2.495e-05 3.124e-05 0.00% Gravity::swapTimeLevels() 10 1.359e-05 1.592e-05 1.97e-05 0.00% Castro::create_source_corrector() 10 8.251e-06 1.01e-05 1.825e-05 0.00% Gravity::set_mass_offset() 10 9.986e-06 1.18e-05 1.394e-05 0.00% Castro::FluxRegCrseInit 10 7.361e-06 8.91e-06 1.016e-05 0.00% Amr::initSubcycle() 1 8.15e-06 8.943e-06 9.857e-06 0.00% Castro::retry_advance_ctu() 10 6.55e-06 7.471e-06 8.012e-06 0.00% Castro::FluxRegFineAdd() 10 1.976e-06 2.133e-06 2.478e-06 0.00% DistributionMapping::Distribute() 1 8.82e-07 1.016e-06 1.165e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 22 B 24 B 27 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.06-25-g239d4d899334) finalized