MPI initialized with 8 MPI processes
MPI initialized with thread support level 3
AMReX (23.06-15-gcc7a5c1171bb) initialized
Starting run at 01:49:54 UTC on 2023-06-10.
Successfully read inputs file ...
Castro git describe: 23.06-17-g29b4f6d62
AMReX git describe: 23.06-15-gcc7a5c117
Microphysics git describe: 23.06-10-g3b44dee2
reading extern runtime parameters ...
3 Species:
C12 O16 Mg24
Successfully read inputs file ...
INITIAL GRIDS
Level 0 8 grids 262144 cells 100 % of domain
smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32
PLOTFILE: file = dustcollapse-3d-monopole_plt00000
Write plotfile time = 0.016099285 seconds
[Level 0 step 1] ADVANCE with dt = 4.541742215e-05
[Level 0 step 1] Advanced 262144 cells
[STEP 1] Coarse TimeStep time: 0.37221058
[STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05
[Level 0 step 2] ADVANCE with dt = 4.768829326e-05
[Level 0 step 2] Advanced 262144 cells
[STEP 2] Coarse TimeStep time: 0.353887847
[STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05
[Level 0 step 3] ADVANCE with dt = 5.007270792e-05
[Level 0 step 3] Advanced 262144 cells
[STEP 3] Coarse TimeStep time: 0.337653105
[STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05
[Level 0 step 4] ADVANCE with dt = 5.257634331e-05
[Level 0 step 4] Advanced 262144 cells
[STEP 4] Coarse TimeStep time: 0.336562723
[STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05
[Level 0 step 5] ADVANCE with dt = 5.520516048e-05
[Level 0 step 5] Advanced 262144 cells
[STEP 5] Coarse TimeStep time: 0.360096432
[STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05
[Level 0 step 6] ADVANCE with dt = 5.79654185e-05
[Level 0 step 6] Advanced 262144 cells
[STEP 6] Coarse TimeStep time: 0.350652172
[STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05
[Level 0 step 7] ADVANCE with dt = 6.086368943e-05
[Level 0 step 7] Advanced 262144 cells
[STEP 7] Coarse TimeStep time: 0.314626618
[STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05
[Level 0 step 8] ADVANCE with dt = 6.39068739e-05
[Level 0 step 8] Advanced 262144 cells
[STEP 8] Coarse TimeStep time: 0.314314531
[STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05
[Level 0 step 9] ADVANCE with dt = 6.71022176e-05
[Level 0 step 9] Advanced 262144 cells
[STEP 9] Coarse TimeStep time: 0.312092001
[STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05
[Level 0 step 10] ADVANCE with dt = 7.045732848e-05
[Level 0 step 10] Advanced 262144 cells
[STEP 10] Coarse TimeStep time: 0.312715397
[STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998]
STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05
PLOTFILE: file = dustcollapse-3d-monopole_plt00010
Write plotfile time = 0.010329126 seconds
Ending run at 01:49:58 UTC on 2023-06-10.
Run time = 3.563348161
Run time without initialization = 3.382806457
Average number of zones advanced per microsecond: 0.775
Average number of zones advanced per microsecond per rank: 0.097
TinyProfiler total time across processes [min...avg...max]: 3.562 ... 3.563 ... 3.563
-------------------------------------------------------------------------------------------
Name NCalls Excl. Min Excl. Avg Excl. Max Max %
-------------------------------------------------------------------------------------------
Castro::construct_ctu_hydro_source() 10 2.3158 2.3609 2.4126 67.70%
Gravity::make_radial_gravity() 21 0.3212 0.3345 0.3483 9.77%
check_for_negative_density() 10 0.01913 0.07567 0.1216 3.41%
Castro::estTimeStep() 21 0.02097 0.0683 0.1178 3.31%
Castro::initData() 1 0.03831 0.07772 0.1112 3.12%
FabArray::setVal() 143 0.06335 0.07476 0.09039 2.54%
FabArray::ParallelCopy_finish() 41 0.03565 0.05887 0.08876 2.49%
amrex::Copy() 193 0.06465 0.07485 0.08344 2.34%
Castro::reset_internal_energy(Fab) 1008 0.04856 0.04982 0.05143 1.44%
FabArray::ParallelCopy_nowait() 41 0.03653 0.04201 0.04413 1.24%
Castro::normalize_species() 62 0.04105 0.04213 0.04345 1.22%
StateData::FillBoundary(geom) 41 0.03452 0.03778 0.04143 1.16%
FillPatchIterator::Initialize 41 0.0292 0.03554 0.03965 1.11%
Castro::construct_new_gravity_source() 10 0.02246 0.02617 0.0314 0.88%
Gravity::interpolate_monopole_grav() 21 0.02827 0.02929 0.03118 0.87%
Castro::initialize_do_advance() 10 0.01196 0.01872 0.02281 0.64%
Castro::computeTemp() 63 0.01965 0.02023 0.02088 0.59%
VisMF::Write(FabArray) 2 0.01318 0.01408 0.0171 0.48%
FabArray::Saxpy() 20 0.01242 0.01472 0.01576 0.44%
Castro::initialize_advance() 10 0.008684 0.01162 0.01524 0.43%
FabArray::setDomainBndry() 41 0.008628 0.0118 0.0132 0.37%
MultiFab::contains_nan() 20 0.01022 0.01123 0.01276 0.36%
Amr::writePlotFile() 2 0.006769 0.01019 0.01135 0.32%
Castro::construct_old_gravity_source() 10 0.007607 0.01041 0.01121 0.31%
Castro::initMFs() 1 0.006916 0.007226 0.00905 0.25%
main() 1 0.005254 0.006244 0.006876 0.19%
StateData::define() 4 0.005764 0.005898 0.006612 0.19%
Castro::enforce_min_density() 62 0.005838 0.006066 0.006406 0.18%
Castro::construct_new_source() 50 0.005712 0.006181 0.006375 0.18%
Castro::swap_state_time_levels() 10 0.003381 0.00456 0.00545 0.15%
Gravity::get_new_grav_vector() 11 0.002975 0.003768 0.004227 0.12%
Amr::coarseTimeStep() 10 0.001174 0.002594 0.003603 0.10%
Gravity::get_old_grav_vector() 10 0.001873 0.002548 0.002877 0.08%
Castro::buildMetrics() 1 0.001619 0.001674 0.001918 0.05%
Castro::finalize_do_advance() 10 0.0006958 0.00147 0.001751 0.05%
Castro::expand_state() 10 0.0005968 0.000712 0.0008401 0.02%
Amr::timeStep() 10 0.0001797 0.0002445 0.0004258 0.01%
Amr::InitAmr() 1 0.0002662 0.0002933 0.0004059 0.01%
Castro::reset_internal_energy(MultiFab) 63 0.00028 0.0002893 0.0003032 0.01%
Castro::do_old_sources() 10 0.0001269 0.000141 0.0001684 0.00%
Castro::clean_state() 62 0.0001377 0.0001427 0.0001486 0.00%
Castro::do_advance_ctu() 10 7.094e-05 9.853e-05 0.0001413 0.00%
DistributionMapping::LeastUsedCPUs() 1 7.501e-06 0.0001092 0.00013 0.00%
Castro::finalize_advance() 10 8.768e-05 0.0001024 0.0001216 0.00%
StateDataPhysBCFunct::() 41 7.955e-05 9.69e-05 0.0001199 0.00%
Castro::enforce_consistent_e() 1 7.636e-05 8.893e-05 0.0001041 0.00%
Castro::Castro() 1 6.211e-05 7.772e-05 9.451e-05 0.00%
Castro::construct_old_source() 50 4.843e-05 6.75e-05 9.377e-05 0.00%
FabArray::ParallelCopy() 41 6.882e-05 7.75e-05 8.406e-05 0.00%
FabArrayBase::getCPC() 41 4.304e-05 6.369e-05 8.332e-05 0.00%
Castro::advance() 10 3.354e-05 4.63e-05 8.24e-05 0.00%
Amr::FinalizeInit() 1 4.401e-06 1.374e-05 6.95e-05 0.00%
Castro::do_new_sources() 10 5.095e-05 6.109e-05 6.898e-05 0.00%
FillPatchSingleLevel 41 6.166e-05 6.504e-05 6.884e-05 0.00%
Amr::writeSmallPlotFile() 1 2.559e-05 5.441e-05 6.549e-05 0.00%
Amr::defBaseLevel() 1 3.239e-05 4.536e-05 5.269e-05 0.00%
Castro::subcycle_advance_ctu() 10 3.923e-05 4.667e-05 4.987e-05 0.00%
Castro::construct_new_gravity() 10 3.388e-05 4.048e-05 4.927e-05 0.00%
Castro::apply_source_to_state() 20 3.915e-05 4.451e-05 4.84e-05 0.00%
Castro::construct_old_gravity() 10 2.977e-05 3.843e-05 4.627e-05 0.00%
FabArrayBase::CPC::define() 2 2.021e-05 2.523e-05 3.305e-05 0.00%
Castro::enforce_speed_limit() 62 2.306e-05 2.649e-05 3.125e-05 0.00%
Gravity::swapTimeLevels() 10 1.284e-05 1.583e-05 3.106e-05 0.00%
Castro::check_for_nan() 20 2.019e-05 2.303e-05 2.539e-05 0.00%
AmrLevel::AmrLevel(dm) 1 1.423e-05 2.035e-05 2.464e-05 0.00%
Castro::post_timestep() 10 1.221e-05 1.381e-05 1.494e-05 0.00%
Gravity::set_mass_offset() 10 9.886e-06 1.135e-05 1.346e-05 0.00%
Castro::computeNewDt() 9 8.571e-06 1.069e-05 1.231e-05 0.00%
Castro::create_source_corrector() 10 7.127e-06 9.09e-06 1.203e-05 0.00%
Amr::initSubcycle() 1 8.847e-06 9.321e-06 1.04e-05 0.00%
Castro::FluxRegCrseInit 10 7.444e-06 8.522e-06 9.666e-06 0.00%
Castro::retry_advance_ctu() 10 6.868e-06 7.921e-06 9.03e-06 0.00%
Amr::init() 1 1.833e-06 2.955e-06 8.736e-06 0.00%
DistributionMapping::SFCProcessorMapDoIt() 1 3.878e-06 5.136e-06 7.078e-06 0.00%
Amr::InitializeInit() 1 1.794e-06 2.549e-06 5.049e-06 0.00%
Castro::computeInitialDt() 2 3.278e-06 4.164e-06 4.915e-06 0.00%
Castro::post_regrid() 1 1.575e-06 2.928e-06 4.018e-06 0.00%
Castro::post_init() 1 3.195e-06 3.56e-06 3.973e-06 0.00%
Castro::FluxRegFineAdd() 10 1.81e-06 2.08e-06 2.406e-06 0.00%
Amr::initialInit() 1 1.647e-06 1.806e-06 2.269e-06 0.00%
DistributionMapping::Distribute() 1 8.98e-07 1.048e-06 1.185e-06 0.00%
-------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------
Name NCalls Incl. Min Incl. Avg Incl. Max Max %
-------------------------------------------------------------------------------------------
main() 1 3.562 3.563 3.563 100.00%
Amr::coarseTimeStep() 10 3.366 3.366 3.366 94.45%
Amr::timeStep() 10 3.352 3.353 3.355 94.14%
Castro::advance() 10 3.336 3.337 3.338 93.68%
Castro::subcycle_advance_ctu() 10 3.245 3.256 3.264 91.59%
Castro::do_advance_ctu() 10 3.245 3.256 3.264 91.59%
Castro::construct_ctu_hydro_source() 10 2.453 2.458 2.46 69.03%
Gravity::make_radial_gravity() 21 0.3376 0.3522 0.3633 10.19%
Gravity::get_new_grav_vector() 11 0.2321 0.2332 0.234 6.57%
Castro::construct_old_gravity() 10 0.1973 0.2088 0.2177 6.11%
Gravity::get_old_grav_vector() 10 0.196 0.2079 0.2171 6.09%
Castro::construct_new_gravity() 10 0.2055 0.206 0.2065 5.79%
FillPatchIterator::Initialize 41 0.169 0.1863 0.2009 5.64%
Castro::initialize_do_advance() 10 0.1718 0.1831 0.1964 5.51%
Amr::init() 1 0.18 0.1801 0.1801 5.05%
Amr::initialInit() 1 0.1632 0.1636 0.1639 4.60%
FillPatchSingleLevel 41 0.1174 0.139 0.1611 4.52%
Castro::expand_state() 10 0.1124 0.1267 0.1393 3.91%
Amr::InitializeInit() 1 0.0597 0.09954 0.1328 3.73%
Amr::defBaseLevel() 1 0.05969 0.09953 0.1328 3.73%
FabArray::ParallelCopy() 41 0.07873 0.101 0.1255 3.52%
check_for_negative_density() 10 0.01913 0.07567 0.1216 3.41%
Castro::clean_state() 62 0.1149 0.1178 0.1212 3.40%
Castro::estTimeStep() 21 0.02097 0.0683 0.1178 3.31%
Castro::initData() 1 0.04228 0.08182 0.1155 3.24%
Amr::FinalizeInit() 1 0.03033 0.06402 0.1037 2.91%
Castro::do_old_sources() 10 0.09322 0.09531 0.0996 2.79%
FabArray::setVal() 143 0.06335 0.07476 0.09039 2.54%
FabArray::ParallelCopy_finish() 41 0.03565 0.05887 0.08876 2.49%
Castro::initialize_advance() 10 0.06977 0.07681 0.08799 2.47%
amrex::Copy() 193 0.06465 0.07485 0.08344 2.34%
Castro::do_new_sources() 10 0.0596 0.06856 0.08179 2.30%
Castro::computeInitialDt() 2 0.002167 0.03546 0.07532 2.11%
Castro::computeTemp() 63 0.06863 0.07033 0.07259 2.04%
Castro::reset_internal_energy(MultiFab) 63 0.04884 0.05011 0.05171 1.45%
Castro::reset_internal_energy(Fab) 1008 0.04856 0.04982 0.05143 1.44%
FabArray::ParallelCopy_nowait() 41 0.03665 0.0421 0.04421 1.24%
Castro::normalize_species() 62 0.04105 0.04213 0.04345 1.22%
StateDataPhysBCFunct::() 41 0.03463 0.03788 0.04152 1.17%
StateData::FillBoundary(geom) 41 0.03452 0.03778 0.04143 1.16%
Castro::construct_new_source() 50 0.02862 0.03236 0.03768 1.06%
Castro::finalize_do_advance() 10 0.01179 0.02581 0.03563 1.00%
Castro::construct_new_gravity_source() 10 0.02246 0.02617 0.0314 0.88%
Gravity::interpolate_monopole_grav() 21 0.02827 0.02929 0.03118 0.87%
Castro::post_init() 1 0.02778 0.02814 0.02852 0.80%
Amr::writePlotFile() 2 0.02668 0.02699 0.02739 0.77%
VisMF::Write(FabArray) 2 0.01318 0.01408 0.0171 0.48%
Castro::post_timestep() 10 0.01559 0.01596 0.01643 0.46%
Castro::apply_source_to_state() 20 0.01246 0.01476 0.01581 0.44%
FabArray::Saxpy() 20 0.01242 0.01472 0.01576 0.44%
FabArray::setDomainBndry() 41 0.008628 0.0118 0.0132 0.37%
Castro::check_for_nan() 20 0.01025 0.01126 0.01278 0.36%
MultiFab::contains_nan() 20 0.01022 0.01123 0.01276 0.36%
Castro::Castro() 1 0.01142 0.01163 0.01251 0.35%
Castro::construct_old_source() 50 0.007655 0.01048 0.01129 0.32%
Castro::construct_old_gravity_source() 10 0.007607 0.01041 0.01121 0.31%
Castro::initMFs() 1 0.006916 0.007226 0.00905 0.25%
Castro::computeNewDt() 9 0.008509 0.008515 0.008522 0.24%
AmrLevel::AmrLevel(dm) 1 0.005785 0.005918 0.006634 0.19%
StateData::define() 4 0.005764 0.005898 0.006612 0.19%
Castro::enforce_min_density() 62 0.005838 0.006066 0.006406 0.18%
Castro::swap_state_time_levels() 10 0.003381 0.00456 0.00545 0.15%
Castro::finalize_advance() 10 0.002983 0.003787 0.004598 0.13%
Castro::buildMetrics() 1 0.001739 0.0018 0.002065 0.06%
Castro::post_regrid() 1 0.001528 0.00162 0.00187 0.05%
Amr::InitAmr() 1 0.0002751 0.0003026 0.0004151 0.01%
DistributionMapping::SFCProcessorMapDoIt() 1 1.251e-05 0.0001154 0.0001378 0.00%
DistributionMapping::LeastUsedCPUs() 1 7.501e-06 0.0001092 0.00013 0.00%
FabArrayBase::getCPC() 41 6.72e-05 8.892e-05 0.0001164 0.00%
Castro::enforce_consistent_e() 1 7.636e-05 8.893e-05 0.0001041 0.00%
Amr::writeSmallPlotFile() 1 2.559e-05 5.441e-05 6.549e-05 0.00%
FabArrayBase::CPC::define() 2 2.021e-05 2.523e-05 3.305e-05 0.00%
Castro::enforce_speed_limit() 62 2.306e-05 2.649e-05 3.125e-05 0.00%
Gravity::swapTimeLevels() 10 1.284e-05 1.583e-05 3.106e-05 0.00%
Gravity::set_mass_offset() 10 9.886e-06 1.135e-05 1.346e-05 0.00%
Castro::create_source_corrector() 10 7.127e-06 9.09e-06 1.203e-05 0.00%
Amr::initSubcycle() 1 8.847e-06 9.321e-06 1.04e-05 0.00%
Castro::FluxRegCrseInit 10 7.444e-06 8.522e-06 9.666e-06 0.00%
Castro::retry_advance_ctu() 10 6.868e-06 7.921e-06 9.03e-06 0.00%
Castro::FluxRegFineAdd() 10 1.81e-06 2.08e-06 2.406e-06 0.00%
DistributionMapping::Distribute() 1 8.98e-07 1.048e-06 1.185e-06 0.00%
-------------------------------------------------------------------------------------------
Unused ParmParse Variables:
[TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2]
[TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2]
Pinned Memory Usage:
---------------------------------------------------------------------------------------------------------------------
Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max
---------------------------------------------------------------------------------------------------------------------
The_Pinned_Arena::Initialize() 8 8 29 B 33 B 37 B 8192 KiB 8192 KiB 8192 KiB
---------------------------------------------------------------------------------------------------------------------
AMReX (23.06-15-gcc7a5c1171bb) finalized