MPI initialized with 8 MPI processes
MPI initialized with thread support level 3
AMReX (23.06-1-g08326158c80e) initialized
Starting run at 19:36:12 UTC on 2023-06-04.
Successfully read inputs file ...
Castro git describe: 23.06-10-g5dbaf1fe1
AMReX git describe: 23.06-1-g08326158c
Microphysics git describe: 23.06-2-g726fe1e2
reading extern runtime parameters ...
3 Species:
C12 O16 Mg24
Successfully read inputs file ...
INITIAL GRIDS
Level 0 8 grids 262144 cells 100 % of domain
smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32
PLOTFILE: file = dustcollapse-3d-monopole_plt00000
Write plotfile time = 0.0157439 seconds
[Level 0 step 1] ADVANCE with dt = 4.541742215e-05
[Level 0 step 1] Advanced 262144 cells
[STEP 1] Coarse TimeStep time: 0.367971042
[STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05
[Level 0 step 2] ADVANCE with dt = 4.768829326e-05
[Level 0 step 2] Advanced 262144 cells
[STEP 2] Coarse TimeStep time: 0.347838113
[STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05
[Level 0 step 3] ADVANCE with dt = 5.007270792e-05
[Level 0 step 3] Advanced 262144 cells
[STEP 3] Coarse TimeStep time: 0.333392617
[STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05
[Level 0 step 4] ADVANCE with dt = 5.257634331e-05
[Level 0 step 4] Advanced 262144 cells
[STEP 4] Coarse TimeStep time: 0.333109603
[STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05
[Level 0 step 5] ADVANCE with dt = 5.520516048e-05
[Level 0 step 5] Advanced 262144 cells
[STEP 5] Coarse TimeStep time: 0.362878091
[STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05
[Level 0 step 6] ADVANCE with dt = 5.79654185e-05
[Level 0 step 6] Advanced 262144 cells
[STEP 6] Coarse TimeStep time: 0.354390582
[STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05
[Level 0 step 7] ADVANCE with dt = 6.086368943e-05
[Level 0 step 7] Advanced 262144 cells
[STEP 7] Coarse TimeStep time: 0.312772049
[STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05
[Level 0 step 8] ADVANCE with dt = 6.39068739e-05
[Level 0 step 8] Advanced 262144 cells
[STEP 8] Coarse TimeStep time: 0.313119736
[STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05
[Level 0 step 9] ADVANCE with dt = 6.71022176e-05
[Level 0 step 9] Advanced 262144 cells
[STEP 9] Coarse TimeStep time: 0.313650462
[STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05
[Level 0 step 10] ADVANCE with dt = 7.045732848e-05
[Level 0 step 10] Advanced 262144 cells
[STEP 10] Coarse TimeStep time: 0.31413015
[STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05
PLOTFILE: file = dustcollapse-3d-monopole_plt00010
Write plotfile time = 0.010311331 seconds
Ending run at 19:36:16 UTC on 2023-06-04.
Run time = 3.574985868
Run time without initialization = 3.371122312
Average number of zones advanced per microsecond: 0.778
Average number of zones advanced per microsecond per rank: 0.097
TinyProfiler total time across processes [min...avg...max]: 3.574 ... 3.575 ... 3.575
-------------------------------------------------------------------------------------------
Name NCalls Excl. Min Excl. Avg Excl. Max Max %
-------------------------------------------------------------------------------------------
Castro::construct_ctu_hydro_source() 10 2.3133 2.3638 2.3880 66.79%
Gravity::make_radial_gravity() 21 0.3151 0.3273 0.3447 9.64%
Castro::estTimeStep() 21 0.0244 0.07695 0.1266 3.54%
Castro::initData() 1 0.03857 0.07737 0.1158 3.24%
check_for_negative_density() 10 0.0332 0.05824 0.112 3.13%
FabArray::setVal() 143 0.06411 0.07601 0.0922 2.58%
FabArray::ParallelCopy_finish() 41 0.04075 0.06335 0.09175 2.57%
amrex::Copy() 193 0.06313 0.07486 0.08265 2.31%
Castro::reset_internal_energy(Fab) 1008 0.04818 0.04961 0.05086 1.42%
FabArray::ParallelCopy_nowait() 41 0.03645 0.04224 0.04482 1.25%
Castro::normalize_species() 62 0.04096 0.04227 0.04449 1.24%
StateData::FillBoundary(geom) 41 0.03323 0.03743 0.04356 1.22%
FillPatchIterator::Initialize 41 0.02871 0.03595 0.04274 1.20%
Castro::construct_new_gravity_source() 10 0.02281 0.02661 0.03361 0.94%
Gravity::interpolate_monopole_grav() 21 0.02791 0.0285 0.03086 0.86%
Castro::initialize_do_advance() 10 0.01188 0.01869 0.02323 0.65%
Amr::InitAmr() 1 0.0002671 0.002924 0.02147 0.60%
DistributionMapping::LeastUsedCPUs() 1 9.931e-06 0.01854 0.02119 0.59%
Castro::computeTemp() 63 0.01957 0.01993 0.02035 0.57%
VisMF::Write(FabArray) 2 0.01301 0.01395 0.01661 0.46%
FabArray::Saxpy() 20 0.01239 0.01457 0.01576 0.44%
Castro::initialize_advance() 10 0.008598 0.01151 0.01553 0.43%
FabArray::setDomainBndry() 41 0.008731 0.01181 0.01333 0.37%
MultiFab::contains_nan() 20 0.01002 0.01104 0.01234 0.35%
Amr::writePlotFile() 2 0.006812 0.00965 0.01153 0.32%
Castro::construct_old_gravity_source() 10 0.007568 0.01038 0.01118 0.31%
Castro::initMFs() 1 0.006996 0.007084 0.007416 0.21%
main() 1 0.005995 0.00643 0.006879 0.19%
Castro::construct_new_source() 50 0.00573 0.006175 0.006365 0.18%
Castro::enforce_min_density() 62 0.005674 0.005942 0.006252 0.17%
StateData::define() 4 0.005743 0.005782 0.005811 0.16%
Castro::swap_state_time_levels() 10 0.003365 0.004467 0.004962 0.14%
Gravity::get_new_grav_vector() 11 0.003008 0.003761 0.004076 0.11%
Amr::coarseTimeStep() 10 0.001078 0.002598 0.003541 0.10%
Gravity::get_old_grav_vector() 10 0.001826 0.002546 0.002915 0.08%
Castro::finalize_do_advance() 10 0.0006769 0.001531 0.001906 0.05%
Castro::buildMetrics() 1 0.001623 0.001642 0.001659 0.05%
Castro::expand_state() 10 0.0007434 0.0009416 0.001173 0.03%
Amr::timeStep() 10 0.0001876 0.0002433 0.0004222 0.01%
Castro::reset_internal_energy(MultiFab) 63 0.0002753 0.0002876 0.0003055 0.01%
Castro::do_advance_ctu() 10 0.0001931 0.0002373 0.0002825 0.01%
Castro::clean_state() 62 0.0001405 0.0001493 0.0001689 0.00%
Castro::finalize_advance() 10 7.906e-05 0.0001058 0.0001338 0.00%
StateDataPhysBCFunct::() 41 7.958e-05 9.549e-05 0.0001207 0.00%
Castro::Castro() 1 7.877e-05 8.935e-05 0.0001054 0.00%
Castro::enforce_consistent_e() 1 8.11e-05 9.126e-05 0.0001024 0.00%
FabArray::ParallelCopy() 41 6.59e-05 7.354e-05 8.407e-05 0.00%
FillPatchSingleLevel 41 5.854e-05 7.186e-05 8.101e-05 0.00%
Amr::FinalizeInit() 1 3.808e-06 1.38e-05 7.942e-05 0.00%
Castro::construct_old_source() 50 4.905e-05 6.417e-05 7.812e-05 0.00%
FabArrayBase::getCPC() 41 4.099e-05 5.417e-05 7.682e-05 0.00%
Castro::do_old_sources() 10 4.445e-05 5.829e-05 7.579e-05 0.00%
Castro::do_new_sources() 10 4.945e-05 6.342e-05 7.146e-05 0.00%
Amr::writeSmallPlotFile() 1 2.523e-05 4.419e-05 5.983e-05 0.00%
Amr::defBaseLevel() 1 3.898e-05 4.563e-05 5.62e-05 0.00%
Castro::apply_source_to_state() 20 3.796e-05 4.551e-05 5.043e-05 0.00%
Castro::advance() 10 3.654e-05 4.193e-05 4.865e-05 0.00%
Castro::subcycle_advance_ctu() 10 3.298e-05 4.291e-05 4.829e-05 0.00%
Castro::construct_new_gravity() 10 3.259e-05 3.874e-05 4.504e-05 0.00%
Castro::construct_old_gravity() 10 3.448e-05 3.808e-05 4.378e-05 0.00%
Castro::enforce_speed_limit() 62 2.269e-05 2.697e-05 3.472e-05 0.00%
FabArrayBase::CPC::define() 2 1.97e-05 2.547e-05 3.442e-05 0.00%
Castro::check_for_nan() 20 2.115e-05 2.348e-05 2.567e-05 0.00%
AmrLevel::AmrLevel(dm) 1 1.271e-05 1.636e-05 2.241e-05 0.00%
Castro::post_timestep() 10 1.275e-05 1.525e-05 1.67e-05 0.00%
Castro::FluxRegCrseInit 10 7.118e-06 1.023e-05 1.572e-05 0.00%
Gravity::swapTimeLevels() 10 1.24e-05 1.365e-05 1.567e-05 0.00%
Gravity::set_mass_offset() 10 9.879e-06 1.162e-05 1.336e-05 0.00%
Castro::computeNewDt() 9 8.212e-06 1.041e-05 1.265e-05 0.00%
Castro::retry_advance_ctu() 10 5.404e-06 6.79e-06 1.176e-05 0.00%
Castro::create_source_corrector() 10 7.152e-06 8.731e-06 1.051e-05 0.00%
Amr::initSubcycle() 1 9.071e-06 9.408e-06 9.84e-06 0.00%
Amr::initialInit() 1 1.321e-06 2.687e-06 8.951e-06 0.00%
Castro::FluxRegFineAdd() 10 2.39e-06 5.333e-06 8.392e-06 0.00%
DistributionMapping::SFCProcessorMapDoIt() 1 3.714e-06 5.011e-06 6.905e-06 0.00%
Amr::InitializeInit() 1 2.086e-06 2.74e-06 5.505e-06 0.00%
Castro::computeInitialDt() 2 3.929e-06 4.349e-06 5.024e-06 0.00%
Castro::post_init() 1 2.593e-06 3.352e-06 3.941e-06 0.00%
Castro::post_regrid() 1 1.785e-06 2.716e-06 3.433e-06 0.00%
Amr::init() 1 1.654e-06 1.963e-06 2.326e-06 0.00%
DistributionMapping::Distribute() 1 8.69e-07 1.008e-06 1.274e-06 0.00%
-------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------
Name NCalls Incl. Min Incl. Avg Incl. Max Max %
-------------------------------------------------------------------------------------------
main() 1 3.574 3.575 3.575 100.00%
Amr::coarseTimeStep() 10 3.354 3.354 3.354 93.82%
Amr::timeStep() 10 3.341 3.342 3.343 93.52%
Castro::advance() 10 3.325 3.326 3.327 93.06%
Castro::subcycle_advance_ctu() 10 3.234 3.245 3.253 90.99%
Castro::do_advance_ctu() 10 3.234 3.245 3.253 90.99%
Castro::construct_ctu_hydro_source() 10 2.313 2.364 2.388 66.79%
Gravity::make_radial_gravity() 21 0.3321 0.345 0.3591 10.05%
Gravity::get_new_grav_vector() 11 0.2295 0.2306 0.2315 6.47%
Castro::construct_old_gravity() 10 0.1934 0.2036 0.2153 6.02%
Gravity::get_old_grav_vector() 10 0.192 0.2027 0.2146 6.00%
Castro::construct_new_gravity() 10 0.2053 0.2057 0.2067 5.78%
Amr::init() 1 0.1822 0.2008 0.2034 5.69%
FillPatchIterator::Initialize 41 0.1742 0.1911 0.2022 5.66%
Castro::initialize_do_advance() 10 0.1672 0.1802 0.1919 5.37%
Amr::initialInit() 1 0.1664 0.1848 0.1877 5.25%
FillPatchSingleLevel 41 0.1197 0.1433 0.1618 4.53%
Amr::InitializeInit() 1 0.06265 0.1178 0.1591 4.45%
Amr::defBaseLevel() 1 0.06265 0.1178 0.1591 4.45%
Castro::expand_state() 10 0.1149 0.1312 0.1434 4.01%
FabArray::ParallelCopy() 41 0.083 0.1057 0.1284 3.59%
Castro::estTimeStep() 21 0.0244 0.07695 0.1266 3.54%
Castro::clean_state() 62 0.1144 0.1173 0.1207 3.38%
Castro::initData() 1 0.0427 0.08153 0.1198 3.35%
check_for_negative_density() 10 0.0332 0.05824 0.112 3.13%
Amr::FinalizeInit() 1 0.02841 0.06697 0.1062 2.97%
FabArray::setVal() 143 0.06411 0.07601 0.0922 2.58%
FabArray::ParallelCopy_finish() 41 0.04075 0.06335 0.09175 2.57%
Castro::initialize_advance() 10 0.06928 0.07683 0.08821 2.47%
Castro::do_new_sources() 10 0.05943 0.06946 0.08607 2.41%
amrex::Copy() 193 0.06313 0.07486 0.08265 2.31%
Castro::computeInitialDt() 2 0.002035 0.04065 0.07965 2.23%
Castro::computeTemp() 63 0.06832 0.06983 0.07084 1.98%
Castro::reset_internal_energy(MultiFab) 63 0.04846 0.0499 0.05116 1.43%
Castro::reset_internal_energy(Fab) 1008 0.04818 0.04961 0.05086 1.42%
Castro::do_old_sources() 10 0.0401 0.04532 0.04662 1.30%
FabArray::ParallelCopy_nowait() 41 0.03656 0.04232 0.04489 1.26%
Castro::normalize_species() 62 0.04096 0.04227 0.04449 1.24%
StateDataPhysBCFunct::() 41 0.03335 0.03752 0.04366 1.22%
StateData::FillBoundary(geom) 41 0.03323 0.03743 0.04356 1.22%
Castro::construct_new_source() 50 0.02899 0.03279 0.03997 1.12%
Castro::construct_new_gravity_source() 10 0.02281 0.02661 0.03361 0.94%
Gravity::interpolate_monopole_grav() 21 0.02791 0.0285 0.03086 0.86%
Amr::writePlotFile() 2 0.02613 0.02635 0.02662 0.74%
Castro::post_init() 1 0.02553 0.02577 0.02596 0.73%
Amr::InitAmr() 1 0.0002767 0.002933 0.02148 0.60%
DistributionMapping::SFCProcessorMapDoIt() 1 1.457e-05 0.01855 0.0212 0.59%
DistributionMapping::LeastUsedCPUs() 1 9.931e-06 0.01854 0.02119 0.59%
VisMF::Write(FabArray) 2 0.01301 0.01395 0.01661 0.46%
Castro::post_timestep() 10 0.01549 0.01582 0.01616 0.45%
Castro::apply_source_to_state() 20 0.01244 0.01461 0.0158 0.44%
FabArray::Saxpy() 20 0.01239 0.01457 0.01576 0.44%
FabArray::setDomainBndry() 41 0.008731 0.01181 0.01333 0.37%
Castro::check_for_nan() 20 0.01004 0.01106 0.01236 0.35%
MultiFab::contains_nan() 20 0.01002 0.01104 0.01234 0.35%
Castro::Castro() 1 0.01176 0.01192 0.01227 0.34%
Castro::construct_old_source() 50 0.007617 0.01044 0.01125 0.31%
Castro::construct_old_gravity_source() 10 0.007568 0.01038 0.01118 0.31%
Castro::computeNewDt() 9 0.008467 0.008472 0.008479 0.24%
Castro::initMFs() 1 0.006996 0.007084 0.007416 0.21%
Castro::enforce_min_density() 62 0.005674 0.005942 0.006252 0.17%
AmrLevel::AmrLevel(dm) 1 0.005758 0.005799 0.005824 0.16%
StateData::define() 4 0.005743 0.005782 0.005811 0.16%
Castro::swap_state_time_levels() 10 0.003365 0.004467 0.004962 0.14%
Castro::finalize_advance() 10 0.002969 0.003833 0.004877 0.14%
Castro::finalize_do_advance() 10 0.0006769 0.001531 0.001906 0.05%
Castro::buildMetrics() 1 0.001752 0.001777 0.001802 0.05%
Castro::post_regrid() 1 0.001571 0.001618 0.001657 0.05%
FabArrayBase::getCPC() 41 6.672e-05 7.963e-05 0.0001112 0.00%
Castro::enforce_consistent_e() 1 8.11e-05 9.126e-05 0.0001024 0.00%
Amr::writeSmallPlotFile() 1 2.523e-05 4.419e-05 5.983e-05 0.00%
Castro::enforce_speed_limit() 62 2.269e-05 2.697e-05 3.472e-05 0.00%
FabArrayBase::CPC::define() 2 1.97e-05 2.547e-05 3.442e-05 0.00%
Castro::FluxRegCrseInit 10 7.118e-06 1.023e-05 1.572e-05 0.00%
Gravity::swapTimeLevels() 10 1.24e-05 1.365e-05 1.567e-05 0.00%
Gravity::set_mass_offset() 10 9.879e-06 1.162e-05 1.336e-05 0.00%
Castro::retry_advance_ctu() 10 5.404e-06 6.79e-06 1.176e-05 0.00%
Castro::create_source_corrector() 10 7.152e-06 8.731e-06 1.051e-05 0.00%
Amr::initSubcycle() 1 9.071e-06 9.408e-06 9.84e-06 0.00%
Castro::FluxRegFineAdd() 10 2.39e-06 5.333e-06 8.392e-06 0.00%
DistributionMapping::Distribute() 1 8.69e-07 1.008e-06 1.274e-06 0.00%
-------------------------------------------------------------------------------------------
Unused ParmParse Variables:
[TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2]
[TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2]
Pinned Memory Usage:
---------------------------------------------------------------------------------------------------------------------
Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max
---------------------------------------------------------------------------------------------------------------------
The_Pinned_Arena::Initialize() 8 8 29 B 39 B 89 B 8192 KiB 8192 KiB 8192 KiB
---------------------------------------------------------------------------------------------------------------------
AMReX (23.06-1-g08326158c80e) finalized