Initializing AMReX (24.04-18-ge293ff685199)...
MPI initialized with 8 MPI processes
MPI initialized with thread support level 3
AMReX (24.04-18-ge293ff685199) initialized
Starting run at 05:34:21 UTC on 2024-04-16.
Successfully read inputs file ...
Castro git describe: 24.04-14-g3d76cd5a0
AMReX git describe: 24.04-18-ge293ff685
Microphysics git describe: 24.04-7-gd4312a6c
reading extern runtime parameters ...
3 Species:
C12 O16 Mg24
Successfully read inputs file ...
INITIAL GRIDS
Level 0 8 grids 262144 cells 100 % of domain
smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32
PLOTFILE: file = dustcollapse-3d-monopole_plt00000
Write plotfile time = 0.014305233 seconds
[Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05
[Level 0 step 1] Advanced 262144 cells
[STEP 1] Coarse TimeStep time: 0.346099757
[STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05
[Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05
[Level 0 step 2] Advanced 262144 cells
[STEP 2] Coarse TimeStep time: 0.361717446
[STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05
[Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05
[Level 0 step 3] Advanced 262144 cells
[STEP 3] Coarse TimeStep time: 0.329776976
[STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05
[Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05
[Level 0 step 4] Advanced 262144 cells
[STEP 4] Coarse TimeStep time: 0.355433213
[STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05
[Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05
[Level 0 step 5] Advanced 262144 cells
[STEP 5] Coarse TimeStep time: 0.361866214
[STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05
[Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05
[Level 0 step 6] Advanced 262144 cells
[STEP 6] Coarse TimeStep time: 0.311206387
[STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05
[Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05
[Level 0 step 7] Advanced 262144 cells
[STEP 7] Coarse TimeStep time: 0.309696408
[STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05
[Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05
[Level 0 step 8] Advanced 262144 cells
[STEP 8] Coarse TimeStep time: 0.310532501
[STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05
[Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05
[Level 0 step 9] Advanced 262144 cells
[STEP 9] Coarse TimeStep time: 0.30903144
[STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05
[Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05
[Level 0 step 10] Advanced 262144 cells
[STEP 10] Coarse TimeStep time: 0.332298419
[STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05
PLOTFILE: file = dustcollapse-3d-monopole_plt00010
Write plotfile time = 0.007403616 seconds
Ending run at 05:34:25 UTC on 2024-04-16.
Run time = 3.53120066
Run time without initialization = 3.33983431
Average number of zones advanced per microsecond: 0.785
Average number of zones advanced per microsecond per rank: 0.098
TinyProfiler total time across processes [min...avg...max]: 3.531 ... 3.531 ... 3.531
-------------------------------------------------------------------------------------------
Name NCalls Excl. Min Excl. Avg Excl. Max Max %
-------------------------------------------------------------------------------------------
Castro::construct_ctu_hydro_source() 10 2.2676 2.3374 2.4036 68.07%
Gravity::make_radial_gravity() 21 0.2954 0.3108 0.3319 9.40%
check_for_negative_density() 10 0.03368 0.1041 0.1801 5.10%
Castro::initData() 1 0.04968 0.08945 0.1278 3.62%
Castro::estTimeStep() 21 0.0369 0.07525 0.1246 3.53%
amrex::Copy() 193 0.05856 0.07861 0.09488 2.69%
FabArray::ParallelCopy_finish() 41 0.04417 0.06222 0.09168 2.60%
FabArray::setVal() 143 0.0617 0.06811 0.0801 2.27%
Castro::reset_internal_energy(Fab) 1008 0.04537 0.04737 0.05052 1.43%
Castro::normalize_species() 62 0.0416 0.04225 0.04278 1.21%
FabArray::ParallelCopy_nowait() 41 0.03258 0.03878 0.04172 1.18%
StateData::FillBoundary(geom) 41 0.02807 0.03187 0.03491 0.99%
FillPatchIterator::Initialize 41 0.02826 0.03247 0.03444 0.98%
Gravity::interpolate_monopole_grav() 21 0.02733 0.02948 0.03201 0.91%
Castro::construct_new_gravity_source() 10 0.02171 0.02454 0.02803 0.79%
FabArray::setDomainBndry() 41 0.009605 0.01337 0.023 0.65%
Castro::initialize_do_advance() 10 0.01291 0.01675 0.02045 0.58%
Castro::computeTemp() 63 0.01842 0.01933 0.02016 0.57%
FabArray::Saxpy() 20 0.01124 0.01188 0.01299 0.37%
Castro::initialize_advance() 10 0.005435 0.009796 0.01228 0.35%
Amr::writePlotFile() 2 0.007643 0.01029 0.01228 0.35%
VisMF::Write(FabArray) 2 0.008509 0.009256 0.01176 0.33%
MultiFab::contains_nan() 20 0.009576 0.01043 0.01125 0.32%
Castro::construct_old_gravity_source() 10 0.006445 0.008533 0.009207 0.26%
Castro::initMFs() 1 0.006515 0.007303 0.007827 0.22%
Castro::enforce_min_density() 62 0.007101 0.007405 0.007726 0.22%
StateData::define() 4 0.005545 0.006263 0.006891 0.20%
Castro::construct_new_source() 50 0.005312 0.005754 0.005905 0.17%
Castro::swap_state_time_levels() 10 0.002796 0.003838 0.004225 0.12%
main() 1 0.003307 0.003736 0.003986 0.11%
Gravity::get_new_grav_vector() 11 0.00275 0.003488 0.003897 0.11%
Amr::coarseTimeStep() 10 0.001737 0.00239 0.002871 0.08%
Gravity::get_old_grav_vector() 10 0.001513 0.002025 0.002382 0.07%
Castro::buildMetrics() 1 0.001539 0.001735 0.002098 0.06%
Castro::finalize_do_advance() 10 0.0004371 0.0008732 0.001045 0.03%
AmrLevel::FillPatch() 41 0.0007269 0.00095 0.00104 0.03%
Amr::InitAmr() 1 0.0003497 0.0004068 0.0004997 0.01%
Amr::timeStep() 10 0.0001599 0.0002263 0.0004912 0.01%
Castro::reset_internal_energy(MultiFab) 63 0.0002889 0.0003087 0.0003525 0.01%
DistributionMapping::LeastUsedCPUs() 1 2.47e-05 0.0001236 0.000274 0.01%
Castro::do_advance_ctu() 10 0.0001496 0.0001685 0.0001888 0.01%
Castro::clean_state() 62 0.0001455 0.0001591 0.0001722 0.00%
FillPatchIterator::FillFromLevel0() 41 0.0001055 0.0001221 0.0001604 0.00%
StateDataPhysBCFunct::() 41 0.000105 0.00012 0.0001386 0.00%
Castro::finalize_advance() 10 0.0001091 0.0001167 0.0001221 0.00%
FabArray::ParallelCopy() 41 7.416e-05 8.931e-05 0.0001129 0.00%
Castro::Castro() 1 7.768e-05 8.801e-05 0.0001005 0.00%
Castro::enforce_consistent_e() 1 7.829e-05 8.473e-05 0.0001005 0.00%
Castro::do_old_sources() 10 7.522e-05 8.738e-05 9.878e-05 0.00%
Amr::FinalizeInit() 1 3.726e-06 1.609e-05 9.515e-05 0.00%
Castro::construct_old_source() 50 5.942e-05 7.292e-05 8.739e-05 0.00%
FillPatchSingleLevel 41 7.05e-05 7.667e-05 8.672e-05 0.00%
FabArrayBase::getCPC() 41 5.749e-05 6.618e-05 7.393e-05 0.00%
Castro::do_new_sources() 10 5.298e-05 5.892e-05 6.675e-05 0.00%
Castro::subcycle_advance_ctu() 10 4.822e-05 5.319e-05 6.365e-05 0.00%
Amr::writeSmallPlotFile() 1 3.345e-05 5.088e-05 6.016e-05 0.00%
Castro::advance() 10 3.647e-05 4.454e-05 5.287e-05 0.00%
Amr::defBaseLevel() 1 4.276e-05 4.923e-05 5.278e-05 0.00%
Castro::apply_source_to_state() 20 3.464e-05 4.092e-05 5.032e-05 0.00%
Castro::construct_old_gravity() 10 3.234e-05 3.651e-05 4.064e-05 0.00%
Castro::construct_new_gravity() 10 3.319e-05 3.53e-05 4.023e-05 0.00%
Castro::enforce_speed_limit() 62 2.395e-05 2.736e-05 3.194e-05 0.00%
FabArrayBase::CPC::define() 2 2.319e-05 2.605e-05 3.171e-05 0.00%
Castro::expand_state() 10 1.846e-05 2.384e-05 2.833e-05 0.00%
Castro::check_for_nan() 20 2.018e-05 2.265e-05 2.72e-05 0.00%
Castro::post_timestep() 10 1.41e-05 1.786e-05 2.218e-05 0.00%
Gravity::set_mass_offset() 10 1.1e-05 1.576e-05 2.156e-05 0.00%
Castro::post_init() 1 8.875e-06 1.047e-05 1.599e-05 0.00%
AmrLevel::AmrLevel(dm) 1 9.337e-06 1.24e-05 1.499e-05 0.00%
Amr::initSubcycle() 1 1.018e-05 1.138e-05 1.212e-05 0.00%
Gravity::swapTimeLevels() 10 7.036e-06 9.425e-06 1.172e-05 0.00%
Castro::computeNewDt() 9 7.305e-06 9.471e-06 1.137e-05 0.00%
Castro::FluxRegCrseInit 10 7.016e-06 8.111e-06 9.996e-06 0.00%
Castro::create_source_corrector() 10 7.142e-06 8.554e-06 9.686e-06 0.00%
Castro::retry_advance_ctu() 10 6.239e-06 7.958e-06 9.422e-06 0.00%
Amr::InitializeInit() 1 3.115e-06 4.63e-06 9.354e-06 0.00%
DistributionMapping::SFCProcessorMapDoIt() 1 3.731e-06 5.255e-06 9.352e-06 0.00%
Castro::computeInitialDt() 2 3.498e-06 4.636e-06 8.389e-06 0.00%
Amr::initialInit() 1 1.474e-06 2.646e-06 7.444e-06 0.00%
Castro::post_regrid() 1 2.272e-06 3.489e-06 4.526e-06 0.00%
Castro::FluxRegFineAdd() 10 1.993e-06 2.415e-06 3.45e-06 0.00%
Amr::init() 1 1.917e-06 2.242e-06 2.695e-06 0.00%
DistributionMapping::Distribute() 1 1.101e-06 1.203e-06 1.339e-06 0.00%
-------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------
Name NCalls Incl. Min Incl. Avg Incl. Max Max %
-------------------------------------------------------------------------------------------
main() 1 3.531 3.531 3.531 100.00%
Amr::coarseTimeStep() 10 3.329 3.329 3.329 94.26%
Amr::timeStep() 10 3.315 3.316 3.317 93.92%
Castro::advance() 10 3.299 3.3 3.301 93.47%
Castro::subcycle_advance_ctu() 10 3.218 3.226 3.232 91.53%
Castro::do_advance_ctu() 10 3.218 3.226 3.232 91.53%
Castro::construct_ctu_hydro_source() 10 2.458 2.462 2.468 69.89%
Gravity::make_radial_gravity() 21 0.3166 0.3282 0.3445 9.76%
Gravity::get_new_grav_vector() 11 0.2234 0.2241 0.2253 6.38%
AmrLevel::FillPatch() 41 0.199 0.2115 0.2232 6.32%
Castro::construct_old_gravity() 10 0.1826 0.1918 0.2047 5.80%
Gravity::get_old_grav_vector() 10 0.1815 0.1908 0.2037 5.77%
Castro::construct_new_gravity() 10 0.201 0.2016 0.2026 5.74%
Amr::init() 1 0.1907 0.1908 0.1908 5.40%
FillPatchIterator::Initialize 41 0.1649 0.1792 0.1907 5.40%
Castro::initialize_do_advance() 10 0.1633 0.1714 0.1827 5.17%
check_for_negative_density() 10 0.03368 0.1041 0.1801 5.10%
Amr::initialInit() 1 0.1758 0.1762 0.1764 5.00%
FillPatchIterator::FillFromLevel0() 41 0.1204 0.1334 0.1528 4.33%
FillPatchSingleLevel 41 0.1203 0.1333 0.1527 4.32%
Amr::InitializeInit() 1 0.06876 0.1106 0.1502 4.25%
Amr::defBaseLevel() 1 0.06875 0.1106 0.1502 4.25%
Castro::initData() 1 0.05326 0.09309 0.1315 3.73%
Castro::expand_state() 10 0.1082 0.1183 0.1298 3.67%
Castro::estTimeStep() 21 0.0369 0.07525 0.1246 3.53%
FabArray::ParallelCopy() 41 0.08607 0.1012 0.1244 3.52%
Castro::clean_state() 62 0.1127 0.116 0.1196 3.39%
Amr::FinalizeInit() 1 0.02553 0.06561 0.1074 3.04%
Castro::do_old_sources() 10 0.09281 0.09471 0.0967 2.74%
amrex::Copy() 193 0.05856 0.07861 0.09488 2.69%
FabArray::ParallelCopy_finish() 41 0.04417 0.06222 0.09168 2.60%
Castro::computeInitialDt() 2 0.0022 0.04185 0.08364 2.37%
FabArray::setVal() 143 0.0617 0.06811 0.0801 2.27%
Castro::initialize_advance() 10 0.06336 0.06991 0.07847 2.22%
Castro::do_new_sources() 10 0.058 0.0645 0.07515 2.13%
Castro::computeTemp() 63 0.0641 0.06701 0.06978 1.98%
Castro::reset_internal_energy(MultiFab) 63 0.04568 0.04768 0.05087 1.44%
Castro::reset_internal_energy(Fab) 1008 0.04537 0.04737 0.05052 1.43%
Castro::normalize_species() 62 0.0416 0.04225 0.04278 1.21%
FabArray::ParallelCopy_nowait() 41 0.03268 0.03887 0.04182 1.18%
StateDataPhysBCFunct::() 41 0.02819 0.03199 0.03504 0.99%
StateData::FillBoundary(geom) 41 0.02807 0.03187 0.03491 0.99%
Castro::construct_new_source() 50 0.02757 0.03029 0.03394 0.96%
Castro::finalize_do_advance() 10 0.01411 0.02521 0.03286 0.93%
Gravity::interpolate_monopole_grav() 21 0.02733 0.02948 0.03201 0.91%
Castro::construct_new_gravity_source() 10 0.02171 0.02454 0.02803 0.79%
Castro::post_init() 1 0.02315 0.02337 0.02352 0.67%
FabArray::setDomainBndry() 41 0.009605 0.01337 0.023 0.65%
Amr::writePlotFile() 2 0.02192 0.02204 0.02247 0.64%
Castro::post_timestep() 10 0.01563 0.01603 0.01645 0.47%
Castro::apply_source_to_state() 20 0.01128 0.01192 0.01303 0.37%
FabArray::Saxpy() 20 0.01124 0.01188 0.01299 0.37%
Castro::Castro() 1 0.009851 0.01108 0.0121 0.34%
VisMF::Write(FabArray) 2 0.008509 0.009256 0.01176 0.33%
Castro::check_for_nan() 20 0.009601 0.01045 0.01128 0.32%
MultiFab::contains_nan() 20 0.009576 0.01043 0.01125 0.32%
Castro::construct_old_source() 50 0.006513 0.008605 0.009295 0.26%
Castro::construct_old_gravity_source() 10 0.006445 0.008533 0.009207 0.26%
Castro::computeNewDt() 9 0.009061 0.009071 0.009078 0.26%
Castro::initMFs() 1 0.006515 0.007303 0.007827 0.22%
Castro::enforce_min_density() 62 0.007101 0.007405 0.007726 0.22%
AmrLevel::AmrLevel(dm) 1 0.005554 0.006276 0.006902 0.20%
StateData::define() 4 0.005545 0.006263 0.006891 0.20%
Castro::swap_state_time_levels() 10 0.002796 0.003838 0.004225 0.12%
Castro::finalize_advance() 10 0.002913 0.003479 0.004178 0.12%
Castro::buildMetrics() 1 0.00167 0.001878 0.002248 0.06%
Castro::post_regrid() 1 0.001319 0.001511 0.001618 0.05%
Amr::InitAmr() 1 0.0003606 0.0004182 0.0005101 0.01%
DistributionMapping::SFCProcessorMapDoIt() 1 2.953e-05 0.00013 0.0002847 0.01%
DistributionMapping::LeastUsedCPUs() 1 2.47e-05 0.0001236 0.000274 0.01%
Castro::enforce_consistent_e() 1 7.829e-05 8.473e-05 0.0001005 0.00%
FabArrayBase::getCPC() 41 8.121e-05 9.223e-05 9.954e-05 0.00%
Amr::writeSmallPlotFile() 1 3.345e-05 5.088e-05 6.016e-05 0.00%
Castro::enforce_speed_limit() 62 2.395e-05 2.736e-05 3.194e-05 0.00%
FabArrayBase::CPC::define() 2 2.319e-05 2.605e-05 3.171e-05 0.00%
Gravity::set_mass_offset() 10 1.1e-05 1.576e-05 2.156e-05 0.00%
Amr::initSubcycle() 1 1.018e-05 1.138e-05 1.212e-05 0.00%
Gravity::swapTimeLevels() 10 7.036e-06 9.425e-06 1.172e-05 0.00%
Castro::FluxRegCrseInit 10 7.016e-06 8.111e-06 9.996e-06 0.00%
Castro::create_source_corrector() 10 7.142e-06 8.554e-06 9.686e-06 0.00%
Castro::retry_advance_ctu() 10 6.239e-06 7.958e-06 9.422e-06 0.00%
Castro::FluxRegFineAdd() 10 1.993e-06 2.415e-06 3.45e-06 0.00%
DistributionMapping::Distribute() 1 1.101e-06 1.203e-06 1.339e-06 0.00%
-------------------------------------------------------------------------------------------
Unused ParmParse Variables:
[TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2]
[TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2]
Pinned Memory Usage:
---------------------------------------------------------------------------------------------------------------------
Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max
---------------------------------------------------------------------------------------------------------------------
The_Pinned_Arena::Initialize() 8 8 34 B 39 B 45 B 8192 KiB 8192 KiB 8192 KiB
---------------------------------------------------------------------------------------------------------------------
AMReX (24.04-18-ge293ff685199) finalized