MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.03-1-gb96f6e5bd13d) initialized Starting run at 06:41:09 UTC on 2023-03-02. Successfully read inputs file ... Castro git describe: 23.03 AMReX git describe: 23.03-1-gb96f6e5bd Microphysics git describe: 23.03 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.016229234 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.380194891 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.383913163 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.328547596 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.327585574 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.357679071 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.330607382 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.312966545 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.313117627 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.312491832 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.313427289 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.048096544 seconds Ending run at 06:41:13 UTC on 2023-03-02. Run time = 3.597734274 Run time without initialization = 3.41600647 Average number of zones advanced per microsecond: 0.767 Average number of zones advanced per microsecond per rank: 0.096 TinyProfiler total time across processes [min...avg...max]: 3.596 ... 3.597 ... 3.598 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.3322 2.3671 2.4186 67.22% Gravity::make_radial_gravity() 21 0.315 0.3238 0.3356 9.33% Castro::do_advance_ctu() 10 0.05703 0.1105 0.1438 4.00% Castro::initData() 1 0.03881 0.0766 0.113 3.14% Castro::estTimeStep() 21 0.0364 0.06681 0.09621 2.67% FabArray::setVal() 143 0.06388 0.07053 0.08043 2.24% amrex::Copy() 193 0.06176 0.07186 0.07816 2.17% FabArray::ParallelCopy_finish() 41 0.03301 0.04741 0.07253 2.02% Castro::reset_internal_energy(Fab) 1008 0.04853 0.04978 0.0507 1.41% Amr::writePlotFile() 2 0.04446 0.04713 0.04809 1.34% FabArray::ParallelCopy_nowait() 41 0.03689 0.04129 0.04331 1.20% Castro::normalize_species() 62 0.04126 0.04193 0.04291 1.19% StateData::FillBoundary(geom) 41 0.03249 0.03515 0.03847 1.07% FillPatchIterator::Initialize 41 0.02981 0.03346 0.03604 1.00% Castro::construct_new_gravity_source() 10 0.02357 0.02632 0.03052 0.85% Gravity::interpolate_monopole_grav() 21 0.02767 0.02796 0.0282 0.78% Castro::computeTemp() 63 0.01869 0.01995 0.02103 0.58% Castro::initialize_do_advance() 10 0.01291 0.01739 0.01971 0.55% VisMF::Write(FabArray) 2 0.01383 0.01458 0.01727 0.48% FabArray::Saxpy() 20 0.01245 0.014 0.01486 0.41% Castro::initialize_advance() 10 0.008447 0.01116 0.01413 0.39% MultiFab::contains_nan() 20 0.01054 0.01115 0.01197 0.33% FabArray::setDomainBndry() 41 0.007872 0.01022 0.01171 0.33% Castro::construct_old_gravity_source() 10 0.007698 0.01024 0.01074 0.30% Castro::initMFs() 1 0.007006 0.00748 0.00886 0.25% main() 1 0.005084 0.00598 0.006587 0.18% StateData::define() 4 0.0057 0.005937 0.006546 0.18% Castro::construct_new_source() 50 0.005897 0.006297 0.006522 0.18% Castro::enforce_min_density() 62 0.005844 0.006102 0.00648 0.18% Gravity::get_new_grav_vector() 11 0.003081 0.003826 0.005848 0.16% Castro::swap_state_time_levels() 10 0.003351 0.004466 0.004701 0.13% Gravity::get_old_grav_vector() 10 0.001708 0.002371 0.002778 0.08% Amr::coarseTimeStep() 10 0.001109 0.002036 0.002714 0.08% Castro::buildMetrics() 1 0.001611 0.001692 0.001896 0.05% Castro::finalize_do_advance() 10 0.0006562 0.001459 0.001826 0.05% Castro::expand_state() 10 0.000693 0.0008819 0.0009622 0.03% Amr::InitAmr() 1 0.0002625 0.0002986 0.0004122 0.01% Amr::timeStep() 10 0.0001643 0.0002276 0.0003896 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002763 0.000291 0.0003113 0.01% Castro::clean_state() 62 0.0001386 0.0001593 0.0001791 0.00% DistributionMapping::LeastUsedCPUs() 1 7.609e-06 0.0001223 0.0001504 0.00% Castro::Castro() 1 6.79e-05 8.457e-05 0.00014 0.00% StateDataPhysBCFunct::() 41 8.184e-05 0.0001016 0.0001274 0.00% Castro::finalize_advance() 10 8.106e-05 9.395e-05 0.000114 0.00% Castro::enforce_consistent_e() 1 7.526e-05 9.054e-05 0.0001089 0.00% FabArray::ParallelCopy() 41 6.415e-05 7.38e-05 9.161e-05 0.00% Amr::FinalizeInit() 1 3.883e-06 1.539e-05 8.176e-05 0.00% Castro::construct_old_source() 50 5.627e-05 6.781e-05 8.086e-05 0.00% Castro::subcycle_advance_ctu() 10 3.689e-05 5.772e-05 8.027e-05 0.00% Amr::writeSmallPlotFile() 1 2.502e-05 6.034e-05 7.983e-05 0.00% FillPatchSingleLevel 41 6.082e-05 6.934e-05 7.853e-05 0.00% Castro::do_old_sources() 10 5.691e-05 6.381e-05 7.566e-05 0.00% Castro::do_new_sources() 10 5.725e-05 6.28e-05 7.259e-05 0.00% FabArrayBase::getCPC() 41 4.283e-05 5.498e-05 6.38e-05 0.00% Castro::advance() 10 3.292e-05 4.145e-05 5.34e-05 0.00% Castro::apply_source_to_state() 20 3.027e-05 3.993e-05 4.549e-05 0.00% Amr::defBaseLevel() 1 3.082e-05 3.976e-05 4.547e-05 0.00% Castro::construct_old_gravity() 10 3.53e-05 3.87e-05 4.419e-05 0.00% Castro::construct_new_gravity() 10 3.462e-05 3.844e-05 4.261e-05 0.00% Castro::post_timestep() 10 1.552e-05 2.474e-05 3.441e-05 0.00% FabArrayBase::CPC::define() 2 2.131e-05 2.445e-05 3.23e-05 0.00% Castro::enforce_speed_limit() 62 2.17e-05 2.493e-05 2.764e-05 0.00% Castro::check_for_nan() 20 1.92e-05 2.255e-05 2.586e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.059e-05 1.429e-05 1.916e-05 0.00% Gravity::swapTimeLevels() 10 9.584e-06 1.104e-05 1.19e-05 0.00% Gravity::set_mass_offset() 10 8.69e-06 1.009e-05 1.129e-05 0.00% Castro::create_source_corrector() 10 8.27e-06 9.665e-06 1.059e-05 0.00% Amr::initSubcycle() 1 8.761e-06 9.466e-06 1.04e-05 0.00% Castro::computeNewDt() 9 7.555e-06 8.951e-06 9.783e-06 0.00% Castro::FluxRegCrseInit 10 6.785e-06 8.141e-06 9.777e-06 0.00% Amr::initialInit() 1 1.022e-06 2.277e-06 9.318e-06 0.00% Castro::retry_advance_ctu() 10 4.641e-06 6.142e-06 7.086e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.661e-06 5.037e-06 6.367e-06 0.00% Amr::InitializeInit() 1 1.968e-06 2.77e-06 5.764e-06 0.00% Castro::computeInitialDt() 2 3.338e-06 4.223e-06 5.285e-06 0.00% Castro::post_init() 1 2.966e-06 3.916e-06 4.815e-06 0.00% Castro::post_regrid() 1 1.845e-06 3.197e-06 4.374e-06 0.00% Castro::FluxRegFineAdd() 10 1.766e-06 2.296e-06 2.752e-06 0.00% Amr::init() 1 1.719e-06 2.236e-06 2.632e-06 0.00% DistributionMapping::Distribute() 1 9.08e-07 1.111e-06 1.313e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.596 3.597 3.598 100.00% Amr::coarseTimeStep() 10 3.361 3.361 3.361 93.43% Amr::timeStep() 10 3.349 3.35 3.351 93.13% Castro::advance() 10 3.333 3.333 3.334 92.67% Castro::subcycle_advance_ctu() 10 3.25 3.256 3.26 90.61% Castro::do_advance_ctu() 10 3.25 3.256 3.26 90.60% Castro::construct_ctu_hydro_source() 10 2.332 2.367 2.419 67.22% Gravity::make_radial_gravity() 21 0.3311 0.3407 0.3501 9.73% Gravity::get_new_grav_vector() 11 0.222 0.2244 0.2258 6.27% Castro::construct_old_gravity() 10 0.1925 0.1974 0.2039 5.67% Gravity::get_old_grav_vector() 10 0.1918 0.1967 0.2033 5.65% Castro::construct_new_gravity() 10 0.1965 0.1982 0.199 5.53% Amr::init() 1 0.1811 0.1813 0.1813 5.04% FillPatchIterator::Initialize 41 0.1558 0.1679 0.1807 5.02% Castro::initialize_do_advance() 10 0.1551 0.1634 0.17 4.72% Amr::initialInit() 1 0.1647 0.1649 0.1652 4.59% FillPatchSingleLevel 41 0.1139 0.1242 0.143 3.97% Amr::InitializeInit() 1 0.06066 0.09828 0.135 3.75% Amr::defBaseLevel() 1 0.06066 0.09828 0.135 3.75% Castro::expand_state() 10 0.1058 0.1159 0.1226 3.41% Castro::clean_state() 62 0.1139 0.1172 0.1193 3.32% Castro::initData() 1 0.0434 0.08059 0.1171 3.26% FabArray::ParallelCopy() 41 0.07648 0.08885 0.1096 3.05% Amr::FinalizeInit() 1 0.02987 0.06665 0.1046 2.91% Castro::estTimeStep() 21 0.0364 0.06681 0.09621 2.67% FabArray::setVal() 143 0.06388 0.07053 0.08043 2.24% Castro::initialize_advance() 10 0.06966 0.07346 0.07947 2.21% amrex::Copy() 193 0.06176 0.07186 0.07816 2.17% Castro::computeInitialDt() 2 0.002195 0.03893 0.07659 2.13% Castro::do_new_sources() 10 0.06081 0.06694 0.07621 2.12% FabArray::ParallelCopy_finish() 41 0.03301 0.04741 0.07253 2.02% Castro::computeTemp() 63 0.06751 0.07002 0.072 2.00% Amr::writePlotFile() 2 0.06424 0.0645 0.06474 1.80% Castro::reset_internal_energy(MultiFab) 63 0.04881 0.05007 0.05097 1.42% Castro::reset_internal_energy(Fab) 1008 0.04853 0.04978 0.0507 1.41% Castro::do_old_sources() 10 0.0407 0.04526 0.04656 1.29% FabArray::ParallelCopy_nowait() 41 0.03697 0.04137 0.0434 1.21% Castro::normalize_species() 62 0.04126 0.04193 0.04291 1.19% StateDataPhysBCFunct::() 41 0.03257 0.03525 0.03856 1.07% StateData::FillBoundary(geom) 41 0.03249 0.03515 0.03847 1.07% Castro::construct_new_source() 50 0.02974 0.03262 0.03704 1.03% Castro::construct_new_gravity_source() 10 0.02357 0.02632 0.03052 0.85% Gravity::interpolate_monopole_grav() 21 0.02767 0.02796 0.0282 0.78% Castro::post_init() 1 0.0271 0.02731 0.02759 0.77% VisMF::Write(FabArray) 2 0.01383 0.01458 0.01727 0.48% Castro::post_timestep() 10 0.01555 0.01609 0.01659 0.46% Castro::apply_source_to_state() 20 0.01248 0.01404 0.01491 0.41% FabArray::Saxpy() 20 0.01245 0.014 0.01486 0.41% Castro::Castro() 1 0.01122 0.01157 0.0124 0.34% Castro::check_for_nan() 20 0.01056 0.01117 0.01199 0.33% MultiFab::contains_nan() 20 0.01054 0.01115 0.01197 0.33% FabArray::setDomainBndry() 41 0.007872 0.01022 0.01171 0.33% Castro::construct_old_source() 50 0.007755 0.01031 0.01082 0.30% Castro::construct_old_gravity_source() 10 0.007698 0.01024 0.01074 0.30% Castro::initMFs() 1 0.007006 0.00748 0.00886 0.25% Castro::computeNewDt() 9 0.008513 0.008523 0.008533 0.24% AmrLevel::AmrLevel(dm) 1 0.005713 0.005951 0.00656 0.18% StateData::define() 4 0.0057 0.005937 0.006546 0.18% Castro::enforce_min_density() 62 0.005844 0.006102 0.00648 0.18% Castro::swap_state_time_levels() 10 0.003351 0.004466 0.004701 0.13% Castro::finalize_advance() 10 0.00296 0.003408 0.003867 0.11% Castro::buildMetrics() 1 0.001733 0.001822 0.002042 0.06% Castro::post_regrid() 1 0.001517 0.001646 0.001976 0.05% Castro::finalize_do_advance() 10 0.0006562 0.001459 0.001826 0.05% Amr::InitAmr() 1 0.0002715 0.000308 0.0004214 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.218e-05 0.0001285 0.0001578 0.00% DistributionMapping::LeastUsedCPUs() 1 7.609e-06 0.0001223 0.0001504 0.00% Castro::enforce_consistent_e() 1 7.526e-05 9.054e-05 0.0001089 0.00% FabArrayBase::getCPC() 41 6.537e-05 7.943e-05 8.899e-05 0.00% Amr::writeSmallPlotFile() 1 2.502e-05 6.034e-05 7.983e-05 0.00% FabArrayBase::CPC::define() 2 2.131e-05 2.445e-05 3.23e-05 0.00% Castro::enforce_speed_limit() 62 2.17e-05 2.493e-05 2.764e-05 0.00% Gravity::swapTimeLevels() 10 9.584e-06 1.104e-05 1.19e-05 0.00% Gravity::set_mass_offset() 10 8.69e-06 1.009e-05 1.129e-05 0.00% Castro::create_source_corrector() 10 8.27e-06 9.665e-06 1.059e-05 0.00% Amr::initSubcycle() 1 8.761e-06 9.466e-06 1.04e-05 0.00% Castro::FluxRegCrseInit 10 6.785e-06 8.141e-06 9.777e-06 0.00% Castro::retry_advance_ctu() 10 4.641e-06 6.142e-06 7.086e-06 0.00% Castro::FluxRegFineAdd() 10 1.766e-06 2.296e-06 2.752e-06 0.00% DistributionMapping::Distribute() 1 9.08e-07 1.111e-06 1.313e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 26 B 32 B 57 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.03-1-gb96f6e5bd13d) finalized