Initializing AMReX (24.04-6-g771c439170bf)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.04-6-g771c439170bf) initialized Starting run at 05:24:48 UTC on 2024-04-04. Successfully read inputs file ... Castro git describe: 24.04-2-ga882a0395 AMReX git describe: 24.04-6-g771c43917 Microphysics git describe: 24.04-1-gab9345c2 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.014915858 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.349472699 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.34397125 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.324489171 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.325026229 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.377335438 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.312746622 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.308640743 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.308792022 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.30950827 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.308089238 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.007519407 seconds Ending run at 05:24:52 UTC on 2024-04-04. Run time = 3.49030858 Run time without initialization = 3.280591891 Average number of zones advanced per microsecond: 0.799 Average number of zones advanced per microsecond per rank: 0.100 TinyProfiler total time across processes [min...avg...max]: 3.49 ... 3.49 ... 3.49 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2844 2.3208 2.3688 67.87% Gravity::make_radial_gravity() 21 0.2901 0.3027 0.318 9.11% Castro::initData() 1 0.05268 0.0964 0.144 4.13% Castro::estTimeStep() 21 0.0287 0.07464 0.1222 3.50% FabArray::ParallelCopy_finish() 41 0.04024 0.0662 0.1132 3.24% check_for_negative_density() 10 0.02579 0.07644 0.1112 3.19% amrex::Copy() 193 0.06717 0.07845 0.09231 2.64% FabArray::setVal() 143 0.05396 0.07023 0.09184 2.63% Castro::reset_internal_energy(Fab) 1008 0.04577 0.04847 0.05805 1.66% FabArray::ParallelCopy_nowait() 41 0.0327 0.03977 0.04519 1.29% Castro::normalize_species() 62 0.04124 0.04158 0.04203 1.20% FillPatchIterator::Initialize 41 0.02626 0.0324 0.03919 1.12% StateData::FillBoundary(geom) 41 0.02848 0.03035 0.03268 0.94% Gravity::interpolate_monopole_grav() 21 0.02721 0.0289 0.0298 0.85% Castro::construct_new_gravity_source() 10 0.02232 0.02339 0.02477 0.71% Castro::initialize_do_advance() 10 0.01141 0.018 0.02269 0.65% Castro::computeTemp() 63 0.01915 0.01987 0.02053 0.59% FabArray::setDomainBndry() 41 0.008461 0.0125 0.01826 0.52% FabArray::Saxpy() 20 0.01061 0.01192 0.01328 0.38% Amr::writePlotFile() 2 0.007839 0.01079 0.01309 0.37% Castro::initialize_advance() 10 0.005339 0.01052 0.01291 0.37% VisMF::Write(FabArray) 2 0.008503 0.009521 0.01218 0.35% MultiFab::contains_nan() 20 0.009604 0.01033 0.01095 0.31% Castro::construct_old_gravity_source() 10 0.006718 0.008755 0.009452 0.27% Castro::initMFs() 1 0.007312 0.007447 0.00755 0.22% StateData::define() 4 0.00601 0.006227 0.006541 0.19% Castro::construct_new_source() 50 0.005963 0.006231 0.006498 0.19% Castro::enforce_min_density() 62 0.005689 0.005913 0.006479 0.19% Castro::swap_state_time_levels() 10 0.002643 0.003744 0.004116 0.12% main() 1 0.003187 0.003694 0.003994 0.11% Gravity::get_new_grav_vector() 11 0.002774 0.003461 0.003841 0.11% Gravity::get_old_grav_vector() 10 0.00143 0.001911 0.002275 0.07% Amr::coarseTimeStep() 10 0.001239 0.001675 0.002226 0.06% Castro::buildMetrics() 1 0.001667 0.001763 0.001906 0.05% AmrLevel::FillPatch() 41 0.0006895 0.001023 0.001184 0.03% Castro::finalize_do_advance() 10 0.0003868 0.0009812 0.001155 0.03% Amr::InitAmr() 1 0.0003938 0.0004292 0.0006355 0.02% Amr::timeStep() 10 0.0001665 0.0002307 0.0005052 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002736 0.0002941 0.0003634 0.01% DistributionMapping::LeastUsedCPUs() 1 3.425e-05 0.0002374 0.0002842 0.01% Castro::do_advance_ctu() 10 0.0001596 0.0001779 0.0002089 0.01% Castro::clean_state() 62 0.000146 0.0001585 0.0001905 0.01% Castro::Castro() 1 0.0001147 0.0001248 0.0001456 0.00% StateDataPhysBCFunct::() 41 8.888e-05 0.0001078 0.0001311 0.00% Castro::finalize_advance() 10 9.384e-05 0.000116 0.0001309 0.00% FillPatchIterator::FillFromLevel0() 41 9.95e-05 0.0001108 0.0001247 0.00% Castro::enforce_consistent_e() 1 8.201e-05 8.979e-05 0.0001019 0.00% Castro::construct_old_source() 50 6.647e-05 7.828e-05 0.0001016 0.00% Castro::subcycle_advance_ctu() 10 3.488e-05 5.012e-05 9.793e-05 0.00% FabArray::ParallelCopy() 41 7.916e-05 8.79e-05 9.774e-05 0.00% Castro::do_old_sources() 10 7.684e-05 8.537e-05 9.712e-05 0.00% FillPatchSingleLevel 41 7.182e-05 8.008e-05 9.699e-05 0.00% Amr::FinalizeInit() 1 3.996e-06 1.523e-05 9.042e-05 0.00% Castro::do_new_sources() 10 5.057e-05 5.992e-05 6.74e-05 0.00% FabArrayBase::getCPC() 41 5.304e-05 6.113e-05 6.691e-05 0.00% Amr::defBaseLevel() 1 4.516e-05 5.563e-05 6.428e-05 0.00% Amr::writeSmallPlotFile() 1 3.439e-05 4.892e-05 6.101e-05 0.00% Castro::advance() 10 4.067e-05 4.54e-05 5.59e-05 0.00% Castro::apply_source_to_state() 20 4.07e-05 4.575e-05 5.496e-05 0.00% Castro::expand_state() 10 2.332e-05 2.874e-05 4.835e-05 0.00% Castro::construct_new_gravity() 10 3.077e-05 3.624e-05 4.256e-05 0.00% Castro::construct_old_gravity() 10 3.586e-05 3.882e-05 4.04e-05 0.00% Castro::enforce_speed_limit() 62 3.013e-05 3.306e-05 3.751e-05 0.00% FabArrayBase::CPC::define() 2 2.666e-05 2.838e-05 3.216e-05 0.00% Castro::check_for_nan() 20 1.873e-05 2.21e-05 2.779e-05 0.00% Castro::post_timestep() 10 1.416e-05 1.912e-05 2.386e-05 0.00% Gravity::set_mass_offset() 10 1.254e-05 1.676e-05 2.351e-05 0.00% AmrLevel::AmrLevel(dm) 1 9.968e-06 1.285e-05 1.655e-05 0.00% Castro::post_init() 1 9.047e-06 1.265e-05 1.582e-05 0.00% Gravity::swapTimeLevels() 10 6.367e-06 1.003e-05 1.336e-05 0.00% Amr::initSubcycle() 1 1.163e-05 1.215e-05 1.267e-05 0.00% Castro::computeNewDt() 9 8.357e-06 9.991e-06 1.14e-05 0.00% Castro::FluxRegCrseInit 10 7.064e-06 8.572e-06 1.004e-05 0.00% Castro::retry_advance_ctu() 10 6.818e-06 7.972e-06 9.479e-06 0.00% Castro::create_source_corrector() 10 6.515e-06 7.452e-06 8.571e-06 0.00% Amr::InitializeInit() 1 3.075e-06 3.982e-06 8.098e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.975e-06 5.459e-06 7.175e-06 0.00% Castro::computeInitialDt() 2 3.7e-06 4.14e-06 4.795e-06 0.00% Castro::post_regrid() 1 2.416e-06 3.21e-06 3.774e-06 0.00% Castro::FluxRegFineAdd() 10 1.733e-06 2.215e-06 2.723e-06 0.00% Amr::init() 1 1.874e-06 2.185e-06 2.608e-06 0.00% Amr::initialInit() 1 1.629e-06 2.03e-06 2.472e-06 0.00% DistributionMapping::Distribute() 1 1.138e-06 1.482e-06 2.076e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.49 3.49 3.49 100.00% Amr::coarseTimeStep() 10 3.269 3.269 3.269 93.66% Amr::timeStep() 10 3.257 3.257 3.258 93.33% Castro::advance() 10 3.241 3.241 3.242 92.88% Castro::subcycle_advance_ctu() 10 3.146 3.166 3.183 91.19% Castro::do_advance_ctu() 10 3.146 3.166 3.183 91.19% Castro::construct_ctu_hydro_source() 10 2.415 2.418 2.419 69.32% Gravity::make_radial_gravity() 21 0.3064 0.3189 0.3315 9.50% AmrLevel::FillPatch() 41 0.1822 0.2145 0.2384 6.83% Gravity::get_new_grav_vector() 11 0.2073 0.2087 0.2098 6.01% FillPatchIterator::Initialize 41 0.1516 0.1817 0.2098 6.01% Amr::init() 1 0.2089 0.2091 0.2091 5.99% Castro::construct_old_gravity() 10 0.1837 0.1933 0.2044 5.86% Gravity::get_old_grav_vector() 10 0.1826 0.1925 0.2038 5.84% Amr::initialInit() 1 0.1934 0.1938 0.1939 5.56% Castro::initialize_do_advance() 10 0.1581 0.18 0.191 5.47% Castro::construct_new_gravity() 10 0.1851 0.1859 0.1866 5.35% FillPatchIterator::FillFromLevel0() 41 0.1099 0.1368 0.1751 5.02% FillPatchSingleLevel 41 0.1098 0.1367 0.175 5.01% Amr::InitializeInit() 1 0.0754 0.1195 0.1671 4.79% Amr::defBaseLevel() 1 0.07539 0.1195 0.1671 4.79% Castro::initData() 1 0.05664 0.1006 0.1487 4.26% FabArray::ParallelCopy() 41 0.07921 0.1061 0.146 4.18% Castro::expand_state() 10 0.1022 0.1261 0.139 3.98% Castro::clean_state() 62 0.1127 0.1153 0.1257 3.60% Castro::estTimeStep() 21 0.0287 0.07464 0.1222 3.50% Amr::FinalizeInit() 1 0.02679 0.07428 0.1183 3.39% FabArray::ParallelCopy_finish() 41 0.04024 0.0662 0.1132 3.24% check_for_negative_density() 10 0.02579 0.07644 0.1112 3.19% Castro::do_old_sources() 10 0.09194 0.0956 0.09965 2.86% Castro::computeInitialDt() 2 0.002495 0.05008 0.09395 2.69% amrex::Copy() 193 0.06717 0.07845 0.09231 2.64% Castro::initialize_advance() 10 0.05473 0.07199 0.09205 2.64% FabArray::setVal() 143 0.05396 0.07023 0.09184 2.63% Castro::computeTemp() 63 0.06567 0.06864 0.07894 2.26% Castro::do_new_sources() 10 0.05814 0.0617 0.06564 1.88% Castro::reset_internal_energy(MultiFab) 63 0.04605 0.04877 0.05841 1.67% Castro::reset_internal_energy(Fab) 1008 0.04577 0.04847 0.05805 1.66% FabArray::ParallelCopy_nowait() 41 0.0328 0.03986 0.04527 1.30% Castro::normalize_species() 62 0.04124 0.04158 0.04203 1.20% StateDataPhysBCFunct::() 41 0.0286 0.03046 0.0328 0.94% StateData::FillBoundary(geom) 41 0.02848 0.03035 0.03268 0.94% Castro::construct_new_source() 50 0.02847 0.02962 0.03118 0.89% Gravity::interpolate_monopole_grav() 21 0.02721 0.0289 0.0298 0.85% Castro::construct_new_gravity_source() 10 0.02232 0.02339 0.02477 0.71% Castro::post_init() 1 0.02354 0.02376 0.02395 0.69% Amr::writePlotFile() 2 0.02278 0.02295 0.02337 0.67% Castro::finalize_do_advance() 10 0.01187 0.01656 0.02028 0.58% FabArray::setDomainBndry() 41 0.008461 0.0125 0.01826 0.52% Castro::post_timestep() 10 0.01531 0.01573 0.01606 0.46% Castro::apply_source_to_state() 20 0.01065 0.01197 0.01333 0.38% FabArray::Saxpy() 20 0.01061 0.01192 0.01328 0.38% Castro::Castro() 1 0.01171 0.01233 0.01262 0.36% VisMF::Write(FabArray) 2 0.008503 0.009521 0.01218 0.35% Castro::check_for_nan() 20 0.009624 0.01035 0.01097 0.31% MultiFab::contains_nan() 20 0.009604 0.01033 0.01095 0.31% Castro::construct_old_source() 50 0.006785 0.008834 0.009538 0.27% Castro::construct_old_gravity_source() 10 0.006718 0.008755 0.009452 0.27% Castro::computeNewDt() 9 0.008972 0.008997 0.00901 0.26% Castro::initMFs() 1 0.007312 0.007447 0.00755 0.22% AmrLevel::AmrLevel(dm) 1 0.006021 0.00624 0.006558 0.19% StateData::define() 4 0.00601 0.006227 0.006541 0.19% Castro::enforce_min_density() 62 0.005689 0.005913 0.006479 0.19% Castro::swap_state_time_levels() 10 0.002643 0.003744 0.004116 0.12% Castro::finalize_advance() 10 0.003049 0.00322 0.003409 0.10% Castro::buildMetrics() 1 0.001804 0.00191 0.002057 0.06% Castro::post_regrid() 1 0.001388 0.001566 0.001872 0.05% Amr::InitAmr() 1 0.0004063 0.0004414 0.0006478 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 4.264e-05 0.0002444 0.0002924 0.01% DistributionMapping::LeastUsedCPUs() 1 3.425e-05 0.0002374 0.0002842 0.01% Castro::enforce_consistent_e() 1 8.201e-05 8.979e-05 0.0001019 0.00% FabArrayBase::getCPC() 41 8.008e-05 8.951e-05 9.706e-05 0.00% Amr::writeSmallPlotFile() 1 3.439e-05 4.892e-05 6.101e-05 0.00% Castro::enforce_speed_limit() 62 3.013e-05 3.306e-05 3.751e-05 0.00% FabArrayBase::CPC::define() 2 2.666e-05 2.838e-05 3.216e-05 0.00% Gravity::set_mass_offset() 10 1.254e-05 1.676e-05 2.351e-05 0.00% Gravity::swapTimeLevels() 10 6.367e-06 1.003e-05 1.336e-05 0.00% Amr::initSubcycle() 1 1.163e-05 1.215e-05 1.267e-05 0.00% Castro::FluxRegCrseInit 10 7.064e-06 8.572e-06 1.004e-05 0.00% Castro::retry_advance_ctu() 10 6.818e-06 7.972e-06 9.479e-06 0.00% Castro::create_source_corrector() 10 6.515e-06 7.452e-06 8.571e-06 0.00% Castro::FluxRegFineAdd() 10 1.733e-06 2.215e-06 2.723e-06 0.00% DistributionMapping::Distribute() 1 1.138e-06 1.482e-06 2.076e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 38 B 43 B 50 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-6-g771c439170bf) finalized