MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.09-9-g078905a16294) initialized Starting run at 05:35:36 UTC on 2023-09-15. Successfully read inputs file ... Castro git describe: 23.09-5-g0aabe1705 AMReX git describe: 23.09-9-g078905a16 Microphysics git describe: 23.09-9-gdfc865b7 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.014897462 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.366228317 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.354293037 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.328118994 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.329414915 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.349569313 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.344071587 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.312728744 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.313821145 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.314440793 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.313919338 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.009580118 seconds Ending run at 05:35:40 UTC on 2023-09-15. Run time = 3.565238418 Run time without initialization = 3.342125163 Average number of zones advanced per microsecond: 0.784 Average number of zones advanced per microsecond per rank: 0.098 TinyProfiler total time across processes [min...avg...max]: 3.564 ... 3.565 ... 3.565 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2987 2.3433 2.3887 67.00% Gravity::make_radial_gravity() 21 0.3141 0.3223 0.3377 9.47% Castro::initData() 1 0.04668 0.0912 0.1529 4.29% Castro::estTimeStep() 21 0.04051 0.09897 0.1522 4.27% check_for_negative_density() 10 0.03362 0.08327 0.131 3.67% FabArray::ParallelCopy_finish() 41 0.03361 0.05835 0.08736 2.45% amrex::Copy() 193 0.06146 0.07666 0.08497 2.38% FabArray::setVal() 143 0.06119 0.07074 0.08471 2.38% Castro::reset_internal_energy(Fab) 1008 0.04747 0.04877 0.04988 1.40% Castro::normalize_species() 62 0.04111 0.04227 0.04353 1.22% FabArray::ParallelCopy_nowait() 41 0.03482 0.04013 0.04218 1.18% StateData::FillBoundary(geom) 41 0.03278 0.03594 0.04023 1.13% FillPatchIterator::Initialize 41 0.02802 0.03184 0.03558 1.00% Gravity::interpolate_monopole_grav() 21 0.02836 0.02897 0.0308 0.86% Castro::construct_new_gravity_source() 10 0.02245 0.02556 0.03001 0.84% Castro::initialize_do_advance() 10 0.01226 0.01725 0.02104 0.59% Castro::computeTemp() 63 0.01905 0.0197 0.01999 0.56% VisMF::Write(FabArray) 2 0.01262 0.01316 0.01543 0.43% Castro::initialize_advance() 10 0.004104 0.01032 0.01395 0.39% FabArray::Saxpy() 20 0.01089 0.01315 0.01393 0.39% MultiFab::contains_nan() 20 0.01082 0.01167 0.01266 0.36% FabArray::setDomainBndry() 41 0.008764 0.01102 0.01257 0.35% Castro::construct_old_gravity_source() 10 0.007092 0.00964 0.01034 0.29% Castro::initMFs() 1 0.006333 0.007932 0.009653 0.27% Amr::writePlotFile() 2 0.006514 0.008776 0.009424 0.26% StateData::define() 4 0.005232 0.006848 0.007977 0.22% Castro::enforce_min_density() 62 0.007266 0.007423 0.00763 0.21% Castro::construct_new_source() 50 0.005684 0.006217 0.006437 0.18% main() 1 0.003559 0.004569 0.005162 0.14% Castro::swap_state_time_levels() 10 0.003104 0.004103 0.004335 0.12% Gravity::get_new_grav_vector() 11 0.002954 0.003568 0.003976 0.11% Amr::coarseTimeStep() 10 0.001437 0.002266 0.00285 0.08% Castro::buildMetrics() 1 0.001512 0.001977 0.002301 0.06% Gravity::get_old_grav_vector() 10 0.001424 0.001908 0.002271 0.06% Castro::finalize_do_advance() 10 0.000485 0.001196 0.001519 0.04% AmrLevel::FillPatch() 41 0.0007439 0.0008421 0.0009421 0.03% StateDataPhysBCFunct::() 41 9.202e-05 0.0001749 0.0006929 0.02% Amr::InitAmr() 1 0.0003123 0.0004011 0.0004806 0.01% Amr::timeStep() 10 0.0001735 0.0002238 0.0004319 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002847 0.0002979 0.0003122 0.01% Castro::do_advance_ctu() 10 0.000133 0.0001696 0.0002303 0.01% DistributionMapping::LeastUsedCPUs() 1 6.766e-06 0.0001007 0.0001949 0.01% Castro::clean_state() 62 0.0001422 0.0001537 0.0001674 0.00% Castro::enforce_consistent_e() 1 8.564e-05 0.0001002 0.0001459 0.00% FillPatchIterator::FillFromLevel0() 41 0.0001003 0.0001169 0.0001368 0.00% Castro::Castro() 1 5.713e-05 7.664e-05 0.0001184 0.00% Castro::finalize_advance() 10 8.277e-05 0.0001021 0.0001145 0.00% Castro::do_old_sources() 10 7.189e-05 8.584e-05 0.0001043 0.00% FabArray::ParallelCopy() 41 6.399e-05 7.386e-05 8.865e-05 0.00% FillPatchSingleLevel 41 6.001e-05 6.739e-05 8.067e-05 0.00% Castro::construct_old_source() 50 4.927e-05 6.658e-05 7.811e-05 0.00% Castro::do_new_sources() 10 4.997e-05 6.381e-05 7.018e-05 0.00% Castro::construct_new_gravity() 10 3.286e-05 4.21e-05 6.899e-05 0.00% Amr::FinalizeInit() 1 4.097e-06 1.346e-05 6.721e-05 0.00% FabArrayBase::getCPC() 41 3.881e-05 5.01e-05 6.59e-05 0.00% Castro::subcycle_advance_ctu() 10 3.889e-05 5.091e-05 6.414e-05 0.00% Castro::apply_source_to_state() 20 4.186e-05 4.911e-05 6.236e-05 0.00% Amr::writeSmallPlotFile() 1 2.997e-05 4.902e-05 6.223e-05 0.00% Castro::advance() 10 3.755e-05 4.386e-05 5.124e-05 0.00% Castro::construct_old_gravity() 10 3.981e-05 4.348e-05 4.986e-05 0.00% Amr::defBaseLevel() 1 2.292e-05 3.453e-05 3.955e-05 0.00% FabArrayBase::CPC::define() 2 2.102e-05 2.674e-05 3.275e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.744e-05 2.477e-05 3.175e-05 0.00% Castro::enforce_speed_limit() 62 2.558e-05 2.872e-05 3.149e-05 0.00% Castro::expand_state() 10 2.058e-05 2.312e-05 2.496e-05 0.00% Castro::check_for_nan() 20 1.898e-05 2.052e-05 2.218e-05 0.00% Amr::initSubcycle() 1 8.472e-06 1.291e-05 1.656e-05 0.00% Castro::post_timestep() 10 1.141e-05 1.4e-05 1.578e-05 0.00% Gravity::swapTimeLevels() 10 9.356e-06 1.222e-05 1.444e-05 0.00% Castro::computeNewDt() 9 8.36e-06 1.071e-05 1.238e-05 0.00% Gravity::set_mass_offset() 10 8.592e-06 1.018e-05 1.147e-05 0.00% Castro::post_init() 1 2.901e-06 4.49e-06 1.112e-05 0.00% Castro::create_source_corrector() 10 7.983e-06 8.638e-06 1.052e-05 0.00% Amr::init() 1 1.998e-06 3.127e-06 9.02e-06 0.00% Castro::retry_advance_ctu() 10 6.341e-06 7.42e-06 8.561e-06 0.00% Castro::FluxRegCrseInit 10 6.459e-06 7.469e-06 8.486e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.009e-06 5.514e-06 7.687e-06 0.00% Amr::InitializeInit() 1 2.119e-06 3.295e-06 7.131e-06 0.00% Castro::computeInitialDt() 2 3.819e-06 4.609e-06 5.064e-06 0.00% Castro::post_regrid() 1 2.225e-06 3.57e-06 4.306e-06 0.00% Castro::FluxRegFineAdd() 10 2.205e-06 2.357e-06 2.607e-06 0.00% Amr::initialInit() 1 1.453e-06 1.763e-06 2.392e-06 0.00% DistributionMapping::Distribute() 1 1.04e-06 1.33e-06 1.448e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.564 3.565 3.565 100.00% Amr::coarseTimeStep() 10 3.327 3.327 3.327 93.33% Amr::timeStep() 10 3.314 3.315 3.316 93.00% Castro::advance() 10 3.298 3.299 3.3 92.55% Castro::subcycle_advance_ctu() 10 3.211 3.221 3.23 90.59% Castro::do_advance_ctu() 10 3.211 3.221 3.23 90.59% Castro::construct_ctu_hydro_source() 10 2.444 2.448 2.453 68.79% Gravity::make_radial_gravity() 21 0.3303 0.3386 0.3507 9.84% Gravity::get_new_grav_vector() 11 0.227 0.2281 0.2296 6.44% Amr::init() 1 0.2225 0.2226 0.2227 6.25% AmrLevel::FillPatch() 41 0.1905 0.2074 0.221 6.20% Amr::initialInit() 1 0.2074 0.2076 0.2081 5.84% Castro::construct_old_gravity() 10 0.1911 0.1963 0.2066 5.79% Gravity::get_old_grav_vector() 10 0.19 0.1955 0.206 5.78% Castro::construct_new_gravity() 10 0.201 0.2018 0.2031 5.70% FillPatchIterator::Initialize 41 0.1605 0.1778 0.1922 5.39% Castro::initialize_do_advance() 10 0.164 0.1742 0.1813 5.08% Amr::InitializeInit() 1 0.06797 0.1138 0.1774 4.98% Amr::defBaseLevel() 1 0.06797 0.1138 0.1774 4.98% Castro::initData() 1 0.05098 0.09526 0.1573 4.41% FillPatchIterator::FillFromLevel0() 41 0.116 0.1349 0.1554 4.36% FillPatchSingleLevel 41 0.1158 0.1348 0.1553 4.36% Castro::estTimeStep() 21 0.04051 0.09897 0.1522 4.27% Amr::FinalizeInit() 1 0.0302 0.0938 0.1395 3.91% check_for_negative_density() 10 0.03362 0.08327 0.131 3.67% Castro::expand_state() 10 0.1062 0.1194 0.128 3.59% FabArray::ParallelCopy() 41 0.07542 0.09864 0.1223 3.43% Castro::clean_state() 62 0.1147 0.1176 0.1203 3.38% Castro::computeInitialDt() 2 0.002481 0.06618 0.1121 3.14% Castro::do_old_sources() 10 0.09073 0.09276 0.09588 2.69% FabArray::ParallelCopy_finish() 41 0.03361 0.05835 0.08736 2.45% amrex::Copy() 193 0.06146 0.07666 0.08497 2.38% FabArray::setVal() 143 0.06119 0.07074 0.08471 2.38% Castro::initialize_advance() 10 0.06428 0.07347 0.08376 2.35% Castro::do_new_sources() 10 0.05941 0.06742 0.07963 2.23% Castro::computeTemp() 63 0.06694 0.06876 0.07009 1.97% Castro::reset_internal_energy(MultiFab) 63 0.04776 0.04906 0.05019 1.41% Castro::reset_internal_energy(Fab) 1008 0.04747 0.04877 0.04988 1.40% Castro::normalize_species() 62 0.04111 0.04227 0.04353 1.22% FabArray::ParallelCopy_nowait() 41 0.03491 0.04021 0.04225 1.18% StateDataPhysBCFunct::() 41 0.03288 0.03612 0.04032 1.13% StateData::FillBoundary(geom) 41 0.03278 0.03594 0.04023 1.13% Castro::construct_new_source() 50 0.02871 0.03178 0.03642 1.02% Castro::finalize_do_advance() 10 0.01213 0.025 0.03403 0.95% Gravity::interpolate_monopole_grav() 21 0.02836 0.02897 0.0308 0.86% Castro::construct_new_gravity_source() 10 0.02245 0.02556 0.03001 0.84% Castro::post_init() 1 0.02693 0.0272 0.02779 0.78% Amr::writePlotFile() 2 0.02409 0.0246 0.02487 0.70% Castro::post_timestep() 10 0.0159 0.01609 0.01631 0.46% VisMF::Write(FabArray) 2 0.01262 0.01316 0.01543 0.43% Castro::apply_source_to_state() 20 0.01094 0.0132 0.01398 0.39% FabArray::Saxpy() 20 0.01089 0.01315 0.01393 0.39% Castro::Castro() 1 0.009224 0.01155 0.0138 0.39% Castro::check_for_nan() 20 0.01084 0.01169 0.01268 0.36% MultiFab::contains_nan() 20 0.01082 0.01167 0.01266 0.36% FabArray::setDomainBndry() 41 0.008764 0.01102 0.01257 0.35% Castro::construct_old_source() 50 0.007142 0.009707 0.0104 0.29% Castro::construct_old_gravity_source() 10 0.007092 0.00964 0.01034 0.29% Castro::initMFs() 1 0.006333 0.007932 0.009653 0.27% Castro::computeNewDt() 9 0.008998 0.00901 0.009018 0.25% AmrLevel::AmrLevel(dm) 1 0.005251 0.006873 0.008002 0.22% StateData::define() 4 0.005232 0.006848 0.007977 0.22% Castro::enforce_min_density() 62 0.007266 0.007423 0.00763 0.21% Castro::finalize_advance() 10 0.003146 0.00381 0.004604 0.13% Castro::swap_state_time_levels() 10 0.003104 0.004103 0.004335 0.12% Castro::buildMetrics() 1 0.001637 0.002159 0.00252 0.07% Castro::post_regrid() 1 0.00158 0.001649 0.001841 0.05% Amr::InitAmr() 1 0.0003224 0.000414 0.0004972 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.208e-05 0.0001075 0.0002037 0.01% DistributionMapping::LeastUsedCPUs() 1 6.766e-06 0.0001007 0.0001949 0.01% Castro::enforce_consistent_e() 1 8.564e-05 0.0001002 0.0001459 0.00% FabArrayBase::getCPC() 41 6.262e-05 7.684e-05 9.194e-05 0.00% Amr::writeSmallPlotFile() 1 2.997e-05 4.902e-05 6.223e-05 0.00% FabArrayBase::CPC::define() 2 2.102e-05 2.674e-05 3.275e-05 0.00% Castro::enforce_speed_limit() 62 2.558e-05 2.872e-05 3.149e-05 0.00% Amr::initSubcycle() 1 8.472e-06 1.291e-05 1.656e-05 0.00% Gravity::swapTimeLevels() 10 9.356e-06 1.222e-05 1.444e-05 0.00% Gravity::set_mass_offset() 10 8.592e-06 1.018e-05 1.147e-05 0.00% Castro::create_source_corrector() 10 7.983e-06 8.638e-06 1.052e-05 0.00% Castro::retry_advance_ctu() 10 6.341e-06 7.42e-06 8.561e-06 0.00% Castro::FluxRegCrseInit 10 6.459e-06 7.469e-06 8.486e-06 0.00% Castro::FluxRegFineAdd() 10 2.205e-06 2.357e-06 2.607e-06 0.00% DistributionMapping::Distribute() 1 1.04e-06 1.33e-06 1.448e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 32 B 35 B 37 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.09-9-g078905a16294) finalized