MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.04-41-gcf6b46bd95a3) initialized Starting run at 05:22:44 UTC on 2023-05-01. Successfully read inputs file ... Castro git describe: 23.04-24-g81e05558c AMReX git describe: 23.04-41-gcf6b46bd9 Microphysics git describe: 23.04-10-gac4fffe4 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.017244827 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.369351505 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.407940088 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.384978152 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.332558458 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.379526589 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.328327321 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.320026118 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.313355598 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.312966441 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.315906395 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010350701 seconds Ending run at 05:22:47 UTC on 2023-05-01. Run time = 3.69505428 Run time without initialization = 3.482220602 Average number of zones advanced per microsecond: 0.753 Average number of zones advanced per microsecond per rank: 0.094 TinyProfiler total time across processes [min...avg...max]: 3.694 ... 3.695 ... 3.695 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.3432 2.4075 2.4919 67.44% Gravity::make_radial_gravity() 21 0.3324 0.3438 0.3543 9.59% Castro::do_advance_ctu() 10 0.06482 0.1515 0.2175 5.89% Castro::estTimeStep() 21 0.02334 0.08437 0.1378 3.73% Castro::initData() 1 0.04016 0.0857 0.1355 3.67% amrex::Copy() 193 0.06281 0.07206 0.08096 2.19% FabArray::setVal() 143 0.06008 0.06518 0.07184 1.94% FabArray::ParallelCopy_finish() 41 0.03877 0.04712 0.06604 1.79% Castro::reset_internal_energy(Fab) 1008 0.04829 0.0505 0.05147 1.39% Castro::normalize_species() 62 0.04184 0.04268 0.04435 1.20% FabArray::ParallelCopy_nowait() 41 0.0385 0.04201 0.04337 1.17% StateData::FillBoundary(geom) 41 0.03397 0.03739 0.04055 1.10% FillPatchIterator::Initialize 41 0.03151 0.03539 0.03749 1.01% Gravity::interpolate_monopole_grav() 21 0.02824 0.02877 0.02934 0.79% Castro::construct_new_gravity_source() 10 0.02291 0.02431 0.02646 0.72% Castro::computeTemp() 63 0.01973 0.02049 0.02089 0.57% Castro::initialize_do_advance() 10 0.01342 0.01818 0.0197 0.53% VisMF::Write(FabArray) 2 0.01408 0.01493 0.01787 0.48% Castro::initialize_advance() 10 0.009473 0.01158 0.01528 0.41% FabArray::Saxpy() 20 0.01258 0.01392 0.01479 0.40% FabArray::setDomainBndry() 41 0.009169 0.01175 0.01299 0.35% MultiFab::contains_nan() 20 0.01114 0.01201 0.01271 0.34% Castro::construct_old_gravity_source() 10 0.008257 0.01024 0.01087 0.29% Amr::writePlotFile() 2 0.007227 0.009719 0.01068 0.29% Castro::initMFs() 1 0.007026 0.008376 0.01059 0.29% StateData::define() 4 0.005819 0.006756 0.00858 0.23% Castro::construct_new_source() 50 0.00578 0.006293 0.006528 0.18% Castro::enforce_min_density() 62 0.005742 0.006056 0.006379 0.17% main() 1 0.005512 0.005934 0.006206 0.17% Castro::swap_state_time_levels() 10 0.00343 0.004775 0.005506 0.15% Gravity::get_new_grav_vector() 11 0.003049 0.003799 0.004112 0.11% Amr::coarseTimeStep() 10 0.00131 0.00221 0.003033 0.08% Gravity::get_old_grav_vector() 10 0.001734 0.002419 0.002832 0.08% Castro::buildMetrics() 1 0.001655 0.00196 0.002458 0.07% Castro::finalize_do_advance() 10 0.0006754 0.001798 0.002266 0.06% Castro::expand_state() 10 0.0007827 0.0008272 0.0009372 0.03% Amr::InitAmr() 1 0.0002828 0.000394 0.0005299 0.01% Amr::timeStep() 10 0.0001852 0.0002407 0.000505 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002973 0.000309 0.0003234 0.01% DistributionMapping::LeastUsedCPUs() 1 6.752e-06 0.0001796 0.0003042 0.01% Castro::clean_state() 62 0.0001388 0.0001494 0.0001625 0.00% StateDataPhysBCFunct::() 41 8.242e-05 9.609e-05 0.0001325 0.00% Castro::finalize_advance() 10 7.377e-05 0.0001003 0.0001238 0.00% Castro::enforce_consistent_e() 1 8.046e-05 9.167e-05 9.869e-05 0.00% Castro::do_new_sources() 10 5.853e-05 6.976e-05 8.156e-05 0.00% Castro::construct_old_source() 50 4.35e-05 6.216e-05 7.761e-05 0.00% FillPatchSingleLevel 41 6.385e-05 7.06e-05 7.658e-05 0.00% FabArray::ParallelCopy() 41 6.596e-05 7.119e-05 7.656e-05 0.00% Amr::FinalizeInit() 1 4.037e-06 1.417e-05 7.629e-05 0.00% Castro::do_old_sources() 10 5.192e-05 6.252e-05 7.396e-05 0.00% Castro::Castro() 1 5.573e-05 6.425e-05 7.236e-05 0.00% FabArrayBase::getCPC() 41 4.206e-05 4.729e-05 5.954e-05 0.00% Amr::writeSmallPlotFile() 1 2.802e-05 3.563e-05 5.934e-05 0.00% Castro::subcycle_advance_ctu() 10 3.506e-05 4.497e-05 5.149e-05 0.00% Castro::apply_source_to_state() 20 3.746e-05 4.415e-05 5.128e-05 0.00% Castro::construct_new_gravity() 10 3.389e-05 3.953e-05 4.812e-05 0.00% Castro::construct_old_gravity() 10 3.177e-05 3.961e-05 4.656e-05 0.00% Castro::advance() 10 3.104e-05 3.985e-05 4.439e-05 0.00% Amr::defBaseLevel() 1 1.684e-05 2.321e-05 3.724e-05 0.00% AmrLevel::AmrLevel(dm) 1 2.624e-05 2.934e-05 3.39e-05 0.00% Castro::enforce_speed_limit() 62 2.258e-05 2.577e-05 3.178e-05 0.00% Amr::initSubcycle() 1 9.04e-06 1.686e-05 3.074e-05 0.00% FabArrayBase::CPC::define() 2 2.011e-05 2.486e-05 2.796e-05 0.00% Castro::check_for_nan() 20 2.029e-05 2.299e-05 2.672e-05 0.00% Gravity::swapTimeLevels() 10 8.676e-06 1.433e-05 2.33e-05 0.00% Castro::post_timestep() 10 1.29e-05 1.567e-05 2.222e-05 0.00% Gravity::set_mass_offset() 10 9.063e-06 1.134e-05 1.71e-05 0.00% Castro::computeNewDt() 9 9.494e-06 1.07e-05 1.361e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.869e-06 5.657e-06 1.345e-05 0.00% Castro::create_source_corrector() 10 6.842e-06 9.503e-06 1.169e-05 0.00% Castro::FluxRegCrseInit 10 7.379e-06 8.239e-06 9.144e-06 0.00% Castro::retry_advance_ctu() 10 4.028e-06 5.831e-06 8.633e-06 0.00% Castro::computeInitialDt() 2 3.681e-06 4.4e-06 5.851e-06 0.00% Castro::post_regrid() 1 1.86e-06 3.407e-06 5.746e-06 0.00% Amr::InitializeInit() 1 2.207e-06 3.132e-06 5.503e-06 0.00% Castro::post_init() 1 2.781e-06 3.603e-06 5.197e-06 0.00% Amr::init() 1 2.065e-06 2.438e-06 2.7e-06 0.00% Castro::FluxRegFineAdd() 10 2.247e-06 2.431e-06 2.609e-06 0.00% Amr::initialInit() 1 1.262e-06 1.631e-06 2.042e-06 0.00% DistributionMapping::Distribute() 1 8.46e-07 1.098e-06 1.358e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.694 3.695 3.695 100.00% Amr::coarseTimeStep() 10 3.466 3.466 3.466 93.79% Amr::timeStep() 10 3.452 3.453 3.454 93.46% Castro::advance() 10 3.435 3.436 3.437 93.00% Castro::subcycle_advance_ctu() 10 3.358 3.362 3.367 91.13% Castro::do_advance_ctu() 10 3.358 3.362 3.367 91.13% Castro::construct_ctu_hydro_source() 10 2.343 2.408 2.492 67.44% Gravity::make_radial_gravity() 21 0.3494 0.3609 0.3727 10.09% Gravity::get_new_grav_vector() 11 0.2269 0.2281 0.2294 6.21% Castro::construct_old_gravity() 10 0.2091 0.2176 0.2281 6.17% Gravity::get_old_grav_vector() 10 0.2083 0.217 0.2275 6.16% Amr::init() 1 0.2121 0.2122 0.2124 5.75% Castro::construct_new_gravity() 10 0.1988 0.1994 0.2001 5.42% Amr::initialInit() 1 0.1948 0.1954 0.1957 5.30% FillPatchIterator::Initialize 41 0.1656 0.174 0.1836 4.97% Castro::initialize_do_advance() 10 0.1629 0.1669 0.173 4.68% Amr::InitializeInit() 1 0.06038 0.1088 0.1627 4.40% Amr::defBaseLevel() 1 0.06038 0.1088 0.1627 4.40% FillPatchSingleLevel 41 0.1217 0.1268 0.1428 3.87% Castro::initData() 1 0.04388 0.08963 0.1391 3.76% Castro::estTimeStep() 21 0.02334 0.08437 0.1378 3.73% Amr::FinalizeInit() 1 0.03252 0.08661 0.1344 3.64% Castro::expand_state() 10 0.1131 0.1177 0.1232 3.33% Castro::clean_state() 62 0.1156 0.1192 0.1224 3.31% FabArray::ParallelCopy() 41 0.08217 0.08928 0.1047 2.83% Castro::computeInitialDt() 2 0.002247 0.05632 0.1047 2.83% amrex::Copy() 193 0.06281 0.07206 0.08096 2.19% Castro::initialize_advance() 10 0.06583 0.07059 0.07471 2.02% Castro::computeTemp() 63 0.06834 0.0713 0.07267 1.97% FabArray::setVal() 143 0.06008 0.06518 0.07184 1.94% Castro::do_new_sources() 10 0.06022 0.06474 0.0715 1.94% FabArray::ParallelCopy_finish() 41 0.03877 0.04712 0.06604 1.79% Castro::reset_internal_energy(MultiFab) 63 0.04861 0.05081 0.05178 1.40% Castro::reset_internal_energy(Fab) 1008 0.04829 0.0505 0.05147 1.39% Castro::do_old_sources() 10 0.04305 0.04533 0.0471 1.27% Castro::normalize_species() 62 0.04184 0.04268 0.04435 1.20% FabArray::ParallelCopy_nowait() 41 0.03857 0.04208 0.04345 1.18% StateDataPhysBCFunct::() 41 0.03407 0.03749 0.04065 1.10% StateData::FillBoundary(geom) 41 0.03397 0.03739 0.04055 1.10% Castro::construct_new_source() 50 0.02928 0.03061 0.03299 0.89% Castro::post_init() 1 0.02932 0.02982 0.03008 0.81% Gravity::interpolate_monopole_grav() 21 0.02824 0.02877 0.02934 0.79% Amr::writePlotFile() 2 0.02712 0.02732 0.02785 0.75% Castro::construct_new_gravity_source() 10 0.02291 0.02431 0.02646 0.72% VisMF::Write(FabArray) 2 0.01408 0.01493 0.01787 0.48% Castro::post_timestep() 10 0.016 0.01644 0.01728 0.47% Castro::Castro() 1 0.01046 0.01213 0.01489 0.40% Castro::apply_source_to_state() 20 0.01261 0.01396 0.01483 0.40% FabArray::Saxpy() 20 0.01258 0.01392 0.01479 0.40% FabArray::setDomainBndry() 41 0.009169 0.01175 0.01299 0.35% Castro::check_for_nan() 20 0.01116 0.01203 0.01273 0.34% MultiFab::contains_nan() 20 0.01114 0.01201 0.01271 0.34% Castro::construct_old_source() 50 0.008301 0.0103 0.01095 0.30% Castro::construct_old_gravity_source() 10 0.008257 0.01024 0.01087 0.29% Castro::initMFs() 1 0.007026 0.008376 0.01059 0.29% Castro::computeNewDt() 9 0.009575 0.009584 0.009592 0.26% AmrLevel::AmrLevel(dm) 1 0.005845 0.006786 0.008613 0.23% StateData::define() 4 0.005819 0.006756 0.00858 0.23% Castro::enforce_min_density() 62 0.005742 0.006056 0.006379 0.17% Castro::swap_state_time_levels() 10 0.00343 0.004775 0.005506 0.15% Castro::finalize_advance() 10 0.002933 0.003087 0.003241 0.09% Castro::buildMetrics() 1 0.001782 0.002132 0.002688 0.07% Castro::finalize_do_advance() 10 0.0006754 0.001798 0.002266 0.06% Castro::post_regrid() 1 0.001553 0.001714 0.002005 0.05% Amr::InitAmr() 1 0.0002923 0.0004109 0.0005555 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.271e-05 0.0001863 0.0003188 0.01% DistributionMapping::LeastUsedCPUs() 1 6.752e-06 0.0001796 0.0003042 0.01% Castro::enforce_consistent_e() 1 8.046e-05 9.167e-05 9.869e-05 0.00% FabArrayBase::getCPC() 41 6.345e-05 7.215e-05 8.001e-05 0.00% Amr::writeSmallPlotFile() 1 2.802e-05 3.563e-05 5.934e-05 0.00% Castro::enforce_speed_limit() 62 2.258e-05 2.577e-05 3.178e-05 0.00% Amr::initSubcycle() 1 9.04e-06 1.686e-05 3.074e-05 0.00% FabArrayBase::CPC::define() 2 2.011e-05 2.486e-05 2.796e-05 0.00% Gravity::swapTimeLevels() 10 8.676e-06 1.433e-05 2.33e-05 0.00% Gravity::set_mass_offset() 10 9.063e-06 1.134e-05 1.71e-05 0.00% Castro::create_source_corrector() 10 6.842e-06 9.503e-06 1.169e-05 0.00% Castro::FluxRegCrseInit 10 7.379e-06 8.239e-06 9.144e-06 0.00% Castro::retry_advance_ctu() 10 4.028e-06 5.831e-06 8.633e-06 0.00% Castro::FluxRegFineAdd() 10 2.247e-06 2.431e-06 2.609e-06 0.00% DistributionMapping::Distribute() 1 8.46e-07 1.098e-06 1.358e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 29 B 36 B 51 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.04-41-gcf6b46bd95a3) finalized