MPI initialized with 8 MPI processes
MPI initialized with thread support level 3
AMReX (23.06-18-g96b811d2cb9f) initialized
Starting run at 05:33:25 UTC on 2023-06-14.
Successfully read inputs file ...
Castro git describe: 23.06-18-g53c2f9115
AMReX git describe: 23.06-18-g96b811d2c
Microphysics git describe: 23.06-13-gcfd8eaa1
reading extern runtime parameters ...
3 Species:
C12 O16 Mg24
Successfully read inputs file ...
INITIAL GRIDS
Level 0 8 grids 262144 cells 100 % of domain
smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32
PLOTFILE: file = dustcollapse-3d-monopole_plt00000
Write plotfile time = 0.015654308 seconds
[Level 0 step 1] ADVANCE with dt = 4.541742215e-05
[Level 0 step 1] Advanced 262144 cells
[STEP 1] Coarse TimeStep time: 0.353691764
[STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05
[Level 0 step 2] ADVANCE with dt = 4.768829326e-05
[Level 0 step 2] Advanced 262144 cells
[STEP 2] Coarse TimeStep time: 0.367079297
[STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05
[Level 0 step 3] ADVANCE with dt = 5.007270792e-05
[Level 0 step 3] Advanced 262144 cells
[STEP 3] Coarse TimeStep time: 0.3348171
[STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05
[Level 0 step 4] ADVANCE with dt = 5.257634331e-05
[Level 0 step 4] Advanced 262144 cells
[STEP 4] Coarse TimeStep time: 0.335141899
[STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05
[Level 0 step 5] ADVANCE with dt = 5.520516048e-05
[Level 0 step 5] Advanced 262144 cells
[STEP 5] Coarse TimeStep time: 0.36410867
[STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05
[Level 0 step 6] ADVANCE with dt = 5.79654185e-05
[Level 0 step 6] Advanced 262144 cells
[STEP 6] Coarse TimeStep time: 0.359398002
[STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05
[Level 0 step 7] ADVANCE with dt = 6.086368943e-05
[Level 0 step 7] Advanced 262144 cells
[STEP 7] Coarse TimeStep time: 0.316329916
[STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05
[Level 0 step 8] ADVANCE with dt = 6.39068739e-05
[Level 0 step 8] Advanced 262144 cells
[STEP 8] Coarse TimeStep time: 0.313165151
[STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05
[Level 0 step 9] ADVANCE with dt = 6.71022176e-05
[Level 0 step 9] Advanced 262144 cells
[STEP 9] Coarse TimeStep time: 0.316096895
[STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05
[Level 0 step 10] ADVANCE with dt = 7.045732848e-05
[Level 0 step 10] Advanced 262144 cells
[STEP 10] Coarse TimeStep time: 0.315767289
[STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05
PLOTFILE: file = dustcollapse-3d-monopole_plt00010
Write plotfile time = 0.010134587 seconds
Ending run at 05:33:29 UTC on 2023-06-14.
Run time = 3.583648446
Run time without initialization = 3.393143685
Average number of zones advanced per microsecond: 0.773
Average number of zones advanced per microsecond per rank: 0.097
TinyProfiler total time across processes [min...avg...max]: 3.582 ... 3.583 ... 3.584
-------------------------------------------------------------------------------------------
Name NCalls Excl. Min Excl. Avg Excl. Max Max %
-------------------------------------------------------------------------------------------
Castro::construct_ctu_hydro_source() 10 2.3204 2.3585 2.4278 67.75%
Gravity::make_radial_gravity() 21 0.3194 0.3373 0.3532 9.86%
check_for_negative_density() 10 0.01679 0.09238 0.1304 3.64%
Castro::estTimeStep() 21 0.02558 0.08096 0.1289 3.60%
Castro::initData() 1 0.03838 0.0783 0.1207 3.37%
FabArray::setVal() 143 0.062 0.07324 0.09083 2.53%
FabArray::ParallelCopy_finish() 41 0.04361 0.06185 0.09029 2.52%
amrex::Copy() 193 0.06168 0.07267 0.08195 2.29%
Castro::reset_internal_energy(Fab) 1008 0.04842 0.04998 0.05175 1.44%
Castro::normalize_species() 62 0.04061 0.04215 0.04525 1.26%
FabArray::ParallelCopy_nowait() 41 0.03605 0.04052 0.0422 1.18%
StateData::FillBoundary(geom) 41 0.03231 0.036 0.0407 1.14%
FillPatchIterator::Initialize 41 0.02882 0.03326 0.03623 1.01%
Castro::construct_new_gravity_source() 10 0.02221 0.02533 0.03137 0.88%
Gravity::interpolate_monopole_grav() 21 0.02785 0.02844 0.02974 0.83%
Castro::initialize_do_advance() 10 0.012 0.01833 0.02315 0.65%
Castro::computeTemp() 63 0.01959 0.01996 0.02066 0.58%
VisMF::Write(FabArray) 2 0.01293 0.01367 0.01642 0.46%
FabArray::Saxpy() 20 0.01149 0.01368 0.01574 0.44%
Castro::initialize_advance() 10 0.004041 0.01054 0.01487 0.41%
MultiFab::contains_nan() 20 0.0112 0.01213 0.01309 0.37%
FabArray::setDomainBndry() 41 0.008657 0.01099 0.01263 0.35%
Amr::writePlotFile() 2 0.006831 0.009877 0.01177 0.33%
Castro::construct_old_gravity_source() 10 0.007465 0.01003 0.01097 0.31%
Castro::initMFs() 1 0.007141 0.007538 0.009089 0.25%
StateData::define() 4 0.005851 0.006064 0.006716 0.19%
main() 1 0.005281 0.006152 0.006697 0.19%
Castro::enforce_min_density() 62 0.005891 0.00614 0.006496 0.18%
Castro::construct_new_source() 50 0.005731 0.006191 0.006437 0.18%
Amr::coarseTimeStep() 10 0.001587 0.003634 0.005115 0.14%
Castro::swap_state_time_levels() 10 0.003362 0.004474 0.004844 0.14%
Gravity::get_new_grav_vector() 11 0.003176 0.003693 0.004067 0.11%
Gravity::get_old_grav_vector() 10 0.001724 0.002317 0.002677 0.07%
Castro::finalize_do_advance() 10 0.000694 0.001642 0.002015 0.06%
Castro::buildMetrics() 1 0.001663 0.001731 0.001962 0.05%
Castro::expand_state() 10 0.000641 0.000873 0.001105 0.03%
Amr::InitAmr() 1 0.0002668 0.0002964 0.0004225 0.01%
Amr::timeStep() 10 0.0001742 0.000247 0.0004181 0.01%
Castro::reset_internal_energy(MultiFab) 63 0.0002821 0.0003006 0.0003197 0.01%
Castro::do_old_sources() 10 0.0001253 0.0001485 0.000187 0.01%
Castro::clean_state() 62 0.0001417 0.0001513 0.0001645 0.00%
DistributionMapping::LeastUsedCPUs() 1 8.165e-06 0.0001274 0.0001524 0.00%
Castro::finalize_advance() 10 0.0001043 0.0001157 0.0001249 0.00%
StateDataPhysBCFunct::() 41 9.245e-05 0.0001051 0.0001247 0.00%
Castro::enforce_consistent_e() 1 8.032e-05 9.045e-05 0.0001215 0.00%
Castro::do_advance_ctu() 10 7.991e-05 9.454e-05 0.0001112 0.00%
Castro::Castro() 1 5.787e-05 8.049e-05 0.0001027 0.00%
FabArray::ParallelCopy() 41 7.472e-05 7.928e-05 8.327e-05 0.00%
Amr::FinalizeInit() 1 3.555e-06 1.412e-05 8.126e-05 0.00%
FillPatchSingleLevel 41 6.679e-05 7.33e-05 7.957e-05 0.00%
Amr::writeSmallPlotFile() 1 2.653e-05 5.416e-05 7.561e-05 0.00%
Castro::construct_old_source() 50 4.794e-05 6.51e-05 7.408e-05 0.00%
FabArrayBase::getCPC() 41 4.75e-05 6.117e-05 7.213e-05 0.00%
Castro::do_new_sources() 10 5.187e-05 6.108e-05 6.715e-05 0.00%
Amr::defBaseLevel() 1 2.468e-05 3.533e-05 5.778e-05 0.00%
Castro::advance() 10 3.828e-05 4.731e-05 5.741e-05 0.00%
Castro::apply_source_to_state() 20 4.269e-05 4.677e-05 5.719e-05 0.00%
Castro::subcycle_advance_ctu() 10 4.129e-05 4.883e-05 5.594e-05 0.00%
Castro::construct_new_gravity() 10 3.305e-05 3.954e-05 4.705e-05 0.00%
Castro::construct_old_gravity() 10 3.41e-05 3.803e-05 4.455e-05 0.00%
AmrLevel::AmrLevel(dm) 1 1.279e-05 2.18e-05 2.889e-05 0.00%
FabArrayBase::CPC::define() 2 2.112e-05 2.483e-05 2.838e-05 0.00%
Castro::enforce_speed_limit() 62 2.363e-05 2.547e-05 2.828e-05 0.00%
Castro::post_timestep() 10 1.335e-05 1.613e-05 2.793e-05 0.00%
Castro::check_for_nan() 20 1.888e-05 2.072e-05 2.367e-05 0.00%
Gravity::swapTimeLevels() 10 1.193e-05 1.38e-05 1.62e-05 0.00%
Castro::FluxRegCrseInit 10 6.887e-06 1.01e-05 1.551e-05 0.00%
Gravity::set_mass_offset() 10 9.612e-06 1.161e-05 1.355e-05 0.00%
Castro::computeNewDt() 9 7.915e-06 1.024e-05 1.153e-05 0.00%
Castro::create_source_corrector() 10 7.52e-06 8.67e-06 1.062e-05 0.00%
Amr::initSubcycle() 1 9.108e-06 9.461e-06 9.956e-06 0.00%
Castro::retry_advance_ctu() 10 6.219e-06 7.108e-06 8.727e-06 0.00%
DistributionMapping::SFCProcessorMapDoIt() 1 4.117e-06 5.177e-06 7.619e-06 0.00%
Amr::InitializeInit() 1 2.108e-06 2.667e-06 5.48e-06 0.00%
Castro::computeInitialDt() 2 2.868e-06 3.961e-06 5.279e-06 0.00%
Castro::post_regrid() 1 1.617e-06 2.671e-06 3.853e-06 0.00%
Castro::post_init() 1 2.681e-06 3.182e-06 3.601e-06 0.00%
Amr::init() 1 1.818e-06 2.156e-06 2.739e-06 0.00%
Castro::FluxRegFineAdd() 10 1.883e-06 2.176e-06 2.524e-06 0.00%
Amr::initialInit() 1 1.243e-06 1.647e-06 2.296e-06 0.00%
DistributionMapping::Distribute() 1 8.91e-07 1.091e-06 1.793e-06 0.00%
-------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------
Name NCalls Incl. Min Incl. Avg Incl. Max Max %
-------------------------------------------------------------------------------------------
main() 1 3.582 3.583 3.584 100.00%
Amr::coarseTimeStep() 10 3.376 3.376 3.376 94.21%
Amr::timeStep() 10 3.361 3.363 3.365 93.89%
Castro::advance() 10 3.346 3.347 3.348 93.43%
Castro::subcycle_advance_ctu() 10 3.256 3.268 3.277 91.44%
Castro::do_advance_ctu() 10 3.256 3.268 3.277 91.44%
Castro::construct_ctu_hydro_source() 10 2.466 2.472 2.477 69.12%
Gravity::make_radial_gravity() 21 0.3381 0.3544 0.3672 10.25%
Gravity::get_new_grav_vector() 11 0.2347 0.2362 0.2376 6.63%
Castro::construct_old_gravity() 10 0.1948 0.2058 0.2164 6.04%
Gravity::get_old_grav_vector() 10 0.1937 0.2049 0.2158 6.02%
Castro::construct_new_gravity() 10 0.2086 0.2094 0.2102 5.87%
FillPatchIterator::Initialize 41 0.1578 0.183 0.1971 5.50%
Amr::init() 1 0.1899 0.1901 0.1901 5.30%
Castro::initialize_do_advance() 10 0.165 0.1793 0.19 5.30%
Amr::initialInit() 1 0.1738 0.1741 0.1743 4.86%
FillPatchSingleLevel 41 0.1184 0.1387 0.1596 4.45%
Amr::InitializeInit() 1 0.06095 0.1005 0.1437 4.01%
Amr::defBaseLevel() 1 0.06094 0.1005 0.1437 4.01%
Castro::expand_state() 10 0.1056 0.1232 0.135 3.77%
check_for_negative_density() 10 0.01679 0.09238 0.1304 3.64%
Castro::estTimeStep() 21 0.02558 0.08096 0.1289 3.60%
FabArray::ParallelCopy() 41 0.08483 0.1025 0.1265 3.53%
Castro::initData() 1 0.04199 0.0824 0.1241 3.46%
Castro::clean_state() 62 0.1143 0.1177 0.1237 3.45%
Amr::FinalizeInit() 1 0.03022 0.07359 0.1134 3.16%
Castro::do_old_sources() 10 0.09072 0.09466 0.1003 2.80%
FabArray::setVal() 143 0.062 0.07324 0.09083 2.53%
FabArray::ParallelCopy_finish() 41 0.04361 0.06185 0.09029 2.52%
Castro::initialize_advance() 10 0.06473 0.07449 0.0872 2.43%
Castro::computeInitialDt() 2 0.002586 0.04581 0.08536 2.38%
Castro::do_new_sources() 10 0.05909 0.06704 0.08216 2.29%
amrex::Copy() 193 0.06168 0.07267 0.08195 2.29%
Castro::computeTemp() 63 0.06832 0.07024 0.0727 2.03%
Castro::reset_internal_energy(MultiFab) 63 0.0487 0.05028 0.05205 1.45%
Castro::reset_internal_energy(Fab) 1008 0.04842 0.04998 0.05175 1.44%
Castro::normalize_species() 62 0.04061 0.04215 0.04525 1.26%
FabArray::ParallelCopy_nowait() 41 0.03614 0.04061 0.04228 1.18%
StateDataPhysBCFunct::() 41 0.03242 0.0361 0.04082 1.14%
StateData::FillBoundary(geom) 41 0.03231 0.036 0.0407 1.14%
Castro::construct_new_source() 50 0.02836 0.03153 0.03781 1.06%
Castro::finalize_do_advance() 10 0.01383 0.02837 0.03703 1.03%
Castro::construct_new_gravity_source() 10 0.02221 0.02533 0.03137 0.88%
Gravity::interpolate_monopole_grav() 21 0.02785 0.02844 0.02974 0.83%
Castro::post_init() 1 0.02718 0.02776 0.02803 0.78%
Amr::writePlotFile() 2 0.02596 0.02619 0.02652 0.74%
Castro::post_timestep() 10 0.01532 0.01584 0.01653 0.46%
VisMF::Write(FabArray) 2 0.01293 0.01367 0.01642 0.46%
Castro::apply_source_to_state() 20 0.01154 0.01373 0.0158 0.44%
FabArray::Saxpy() 20 0.01149 0.01368 0.01574 0.44%
Castro::check_for_nan() 20 0.01122 0.01215 0.01311 0.37%
MultiFab::contains_nan() 20 0.0112 0.01213 0.01309 0.37%
Castro::Castro() 1 0.01146 0.01182 0.0127 0.35%
FabArray::setDomainBndry() 41 0.008657 0.01099 0.01263 0.35%
Castro::construct_old_source() 50 0.007513 0.01009 0.01103 0.31%
Castro::construct_old_gravity_source() 10 0.007465 0.01003 0.01097 0.31%
Castro::initMFs() 1 0.007141 0.007538 0.009089 0.25%
Castro::computeNewDt() 9 0.008439 0.008446 0.008453 0.24%
AmrLevel::AmrLevel(dm) 1 0.00587 0.006086 0.006745 0.19%
StateData::define() 4 0.005851 0.006064 0.006716 0.19%
Castro::enforce_min_density() 62 0.005891 0.00614 0.006496 0.18%
Castro::finalize_advance() 10 0.002963 0.003964 0.005701 0.16%
Castro::swap_state_time_levels() 10 0.003362 0.004474 0.004844 0.14%
Castro::buildMetrics() 1 0.00179 0.001865 0.002121 0.06%
Castro::post_regrid() 1 0.001515 0.001646 0.001914 0.05%
Amr::InitAmr() 1 0.0002763 0.0003059 0.0004316 0.01%
DistributionMapping::SFCProcessorMapDoIt() 1 1.33e-05 0.0001337 0.0001607 0.00%
DistributionMapping::LeastUsedCPUs() 1 8.165e-06 0.0001274 0.0001524 0.00%
Castro::enforce_consistent_e() 1 8.032e-05 9.045e-05 0.0001215 0.00%
FabArrayBase::getCPC() 41 7.08e-05 8.6e-05 9.864e-05 0.00%
Amr::writeSmallPlotFile() 1 2.653e-05 5.416e-05 7.561e-05 0.00%
FabArrayBase::CPC::define() 2 2.112e-05 2.483e-05 2.838e-05 0.00%
Castro::enforce_speed_limit() 62 2.363e-05 2.547e-05 2.828e-05 0.00%
Gravity::swapTimeLevels() 10 1.193e-05 1.38e-05 1.62e-05 0.00%
Castro::FluxRegCrseInit 10 6.887e-06 1.01e-05 1.551e-05 0.00%
Gravity::set_mass_offset() 10 9.612e-06 1.161e-05 1.355e-05 0.00%
Castro::create_source_corrector() 10 7.52e-06 8.67e-06 1.062e-05 0.00%
Amr::initSubcycle() 1 9.108e-06 9.461e-06 9.956e-06 0.00%
Castro::retry_advance_ctu() 10 6.219e-06 7.108e-06 8.727e-06 0.00%
Castro::FluxRegFineAdd() 10 1.883e-06 2.176e-06 2.524e-06 0.00%
DistributionMapping::Distribute() 1 8.91e-07 1.091e-06 1.793e-06 0.00%
-------------------------------------------------------------------------------------------
Unused ParmParse Variables:
[TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2]
[TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2]
Pinned Memory Usage:
---------------------------------------------------------------------------------------------------------------------
Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max
---------------------------------------------------------------------------------------------------------------------
The_Pinned_Arena::Initialize() 8 8 29 B 36 B 44 B 8192 KiB 8192 KiB 8192 KiB
---------------------------------------------------------------------------------------------------------------------
AMReX (23.06-18-g96b811d2cb9f) finalized