MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.09) initialized Starting run at 05:21:50 UTC on 2023-09-05. Successfully read inputs file ... Castro git describe: 23.09 AMReX git describe: 23.09 Microphysics git describe: 23.08-19-gbb8d2a2b reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.013537294 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.35678007 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.336503278 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.352115737 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.330828353 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.340708755 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.349729121 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.309309109 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.310059797 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.30948268 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.310605307 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.056690848 seconds Ending run at 05:21:54 UTC on 2023-09-05. Run time = 3.571215181 Run time without initialization = 3.368085949 Average number of zones advanced per microsecond: 0.778 Average number of zones advanced per microsecond per rank: 0.097 TinyProfiler total time across processes [min...avg...max]: 3.57 ... 3.571 ... 3.571 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2774 2.3222 2.3809 66.67% Gravity::make_radial_gravity() 21 0.3088 0.3175 0.3312 9.27% check_for_negative_density() 10 0.02508 0.08828 0.1377 3.86% Castro::initData() 1 0.03827 0.08667 0.1337 3.74% Castro::estTimeStep() 21 0.03535 0.08439 0.1316 3.68% FabArray::ParallelCopy_finish() 41 0.03495 0.06094 0.09593 2.69% amrex::Copy() 193 0.06442 0.07775 0.08864 2.48% FabArray::setVal() 143 0.06229 0.07021 0.08047 2.25% Amr::writePlotFile() 2 0.05301 0.05556 0.05781 1.62% Castro::reset_internal_energy(Fab) 1008 0.04713 0.04839 0.05044 1.41% Castro::normalize_species() 62 0.04051 0.04197 0.04338 1.21% StateData::FillBoundary(geom) 41 0.03349 0.03737 0.0414 1.16% FabArray::ParallelCopy_nowait() 41 0.03284 0.03939 0.04136 1.16% FillPatchIterator::Initialize 41 0.02605 0.03161 0.03788 1.06% Gravity::interpolate_monopole_grav() 21 0.02807 0.0283 0.02844 0.80% Castro::construct_new_gravity_source() 10 0.02091 0.02366 0.02542 0.71% Castro::initialize_do_advance() 10 0.01146 0.01741 0.02238 0.63% Castro::computeTemp() 63 0.01749 0.01919 0.01987 0.56% FabArray::Saxpy() 20 0.01098 0.01335 0.01806 0.51% VisMF::Write(FabArray) 2 0.01128 0.01237 0.01467 0.41% Castro::initialize_advance() 10 0.004143 0.01033 0.01379 0.39% FabArray::setDomainBndry() 41 0.008165 0.01117 0.01269 0.36% MultiFab::contains_nan() 20 0.01071 0.01141 0.01233 0.35% Castro::initMFs() 1 0.006035 0.008125 0.01068 0.30% Castro::construct_old_gravity_source() 10 0.006691 0.009362 0.01 0.28% StateData::define() 4 0.005029 0.0067 0.008796 0.25% Castro::enforce_min_density() 62 0.00704 0.007332 0.007645 0.21% Castro::construct_new_source() 50 0.006264 0.006529 0.006837 0.19% main() 1 0.003348 0.004386 0.004651 0.13% Castro::swap_state_time_levels() 10 0.00308 0.004022 0.004399 0.12% Gravity::get_new_grav_vector() 11 0.002767 0.00349 0.00393 0.11% Amr::coarseTimeStep() 10 0.001934 0.002804 0.003919 0.11% Castro::buildMetrics() 1 0.001463 0.001944 0.002503 0.07% Gravity::get_old_grav_vector() 10 0.00162 0.001919 0.002284 0.06% Castro::finalize_do_advance() 10 0.0004296 0.001065 0.001315 0.04% AmrLevel::FillPatch() 41 0.0006574 0.000773 0.0008995 0.03% Amr::InitAmr() 1 0.000254 0.0004095 0.0006024 0.02% Amr::timeStep() 10 0.0002085 0.0002638 0.0005054 0.01% DistributionMapping::LeastUsedCPUs() 1 7.784e-06 0.0002167 0.0003965 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002882 0.0003078 0.0003576 0.01% Castro::do_advance_ctu() 10 0.0001428 0.0001908 0.0002275 0.01% Castro::clean_state() 62 0.0001503 0.0001699 0.0001979 0.01% FillPatchIterator::FillFromLevel0() 41 0.0001154 0.0001359 0.0001836 0.01% Castro::finalize_advance() 10 9.145e-05 0.0001107 0.0001301 0.00% Castro::do_old_sources() 10 8.782e-05 9.933e-05 0.0001151 0.00% StateDataPhysBCFunct::() 41 8.559e-05 0.000103 0.0001146 0.00% Castro::enforce_consistent_e() 1 7.599e-05 8.844e-05 0.0001138 0.00% Castro::do_new_sources() 10 5.533e-05 6.838e-05 0.0001059 0.00% Castro::Castro() 1 5.36e-05 7.307e-05 9.999e-05 0.00% FabArray::ParallelCopy() 41 7.139e-05 8.158e-05 9.433e-05 0.00% Castro::apply_source_to_state() 20 4.788e-05 5.824e-05 9.051e-05 0.00% Amr::writeSmallPlotFile() 1 2.844e-05 6.048e-05 8.807e-05 0.00% Castro::construct_old_source() 50 5.677e-05 7.163e-05 8.221e-05 0.00% Amr::FinalizeInit() 1 4.171e-06 1.376e-05 7.836e-05 0.00% FillPatchSingleLevel 41 6.083e-05 6.878e-05 7.535e-05 0.00% Castro::subcycle_advance_ctu() 10 4.561e-05 5.187e-05 6.623e-05 0.00% FabArrayBase::getCPC() 41 4.584e-05 5.437e-05 6.11e-05 0.00% Castro::advance() 10 3.947e-05 4.921e-05 5.732e-05 0.00% Castro::construct_old_gravity() 10 4.366e-05 4.83e-05 5.273e-05 0.00% Castro::construct_new_gravity() 10 3.616e-05 4.111e-05 4.443e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.946e-05 2.792e-05 3.619e-05 0.00% Castro::enforce_speed_limit() 62 2.627e-05 3.156e-05 3.557e-05 0.00% Amr::defBaseLevel() 1 2.222e-05 2.882e-05 3.24e-05 0.00% FabArrayBase::CPC::define() 2 1.979e-05 2.475e-05 3.063e-05 0.00% Castro::expand_state() 10 2.273e-05 2.624e-05 3.05e-05 0.00% Castro::check_for_nan() 20 1.813e-05 2.112e-05 2.297e-05 0.00% Amr::initSubcycle() 1 8.259e-06 1.353e-05 2.012e-05 0.00% Castro::post_timestep() 10 1.379e-05 1.586e-05 1.789e-05 0.00% Gravity::swapTimeLevels() 10 7.885e-06 1.318e-05 1.687e-05 0.00% Castro::FluxRegCrseInit 10 6.406e-06 8.349e-06 1.418e-05 0.00% Castro::computeNewDt() 9 9.223e-06 1.149e-05 1.335e-05 0.00% Gravity::set_mass_offset() 10 1.035e-05 1.135e-05 1.264e-05 0.00% Castro::create_source_corrector() 10 7.713e-06 9.025e-06 1.187e-05 0.00% Castro::retry_advance_ctu() 10 6.685e-06 7.331e-06 8.084e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.948e-06 4.812e-06 5.639e-06 0.00% Amr::InitializeInit() 1 1.913e-06 2.747e-06 5.434e-06 0.00% Castro::computeInitialDt() 2 3.587e-06 4.048e-06 4.79e-06 0.00% Castro::post_init() 1 3.046e-06 3.545e-06 4.077e-06 0.00% Amr::init() 1 1.633e-06 2.511e-06 3.663e-06 0.00% Castro::post_regrid() 1 1.757e-06 2.667e-06 3.462e-06 0.00% Castro::FluxRegFineAdd() 10 2.061e-06 2.32e-06 2.73e-06 0.00% Amr::initialInit() 1 1.056e-06 1.668e-06 2.228e-06 0.00% DistributionMapping::Distribute() 1 8.6e-07 1.341e-06 1.656e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.57 3.571 3.571 100.00% Amr::coarseTimeStep() 10 3.307 3.307 3.307 92.60% Amr::timeStep() 10 3.293 3.294 3.295 92.25% Castro::advance() 10 3.276 3.278 3.279 91.82% Castro::subcycle_advance_ctu() 10 3.191 3.201 3.209 89.87% Castro::do_advance_ctu() 10 3.191 3.201 3.209 89.86% Castro::construct_ctu_hydro_source() 10 2.427 2.432 2.437 68.24% Gravity::make_radial_gravity() 21 0.325 0.3336 0.344 9.63% AmrLevel::FillPatch() 41 0.1858 0.211 0.2312 6.47% Gravity::get_new_grav_vector() 11 0.2181 0.2198 0.2216 6.21% Castro::construct_old_gravity() 10 0.191 0.1977 0.2067 5.79% Gravity::get_old_grav_vector() 10 0.1904 0.1969 0.2061 5.77% Amr::init() 1 0.2024 0.2026 0.2028 5.68% FillPatchIterator::Initialize 41 0.1571 0.1809 0.1989 5.57% Castro::construct_new_gravity() 10 0.1949 0.1961 0.1976 5.53% Amr::initialInit() 1 0.1885 0.1888 0.1891 5.30% Castro::initialize_do_advance() 10 0.1654 0.1761 0.1864 5.22% FillPatchIterator::FillFromLevel0() 41 0.1169 0.1382 0.1628 4.56% FillPatchSingleLevel 41 0.1167 0.138 0.1626 4.55% Amr::InitializeInit() 1 0.05671 0.1093 0.1614 4.52% Amr::defBaseLevel() 1 0.05671 0.1092 0.1614 4.52% check_for_negative_density() 10 0.02508 0.08828 0.1377 3.86% Castro::initData() 1 0.04193 0.09041 0.1374 3.85% Castro::expand_state() 10 0.1076 0.1221 0.1333 3.73% Amr::FinalizeInit() 1 0.0273 0.0795 0.1324 3.71% Castro::estTimeStep() 21 0.03535 0.08439 0.1316 3.68% FabArray::ParallelCopy() 41 0.07515 0.1005 0.1289 3.61% Castro::clean_state() 62 0.1149 0.1164 0.1195 3.35% Castro::computeInitialDt() 2 0.00214 0.05446 0.1072 3.00% Castro::do_old_sources() 10 0.09181 0.09608 0.1013 2.84% FabArray::ParallelCopy_finish() 41 0.03495 0.06094 0.09593 2.69% amrex::Copy() 193 0.06442 0.07775 0.08864 2.48% Castro::initialize_advance() 10 0.06327 0.0725 0.08206 2.30% FabArray::setVal() 143 0.06229 0.07021 0.08047 2.25% Castro::do_new_sources() 10 0.06066 0.06542 0.0738 2.07% Amr::writePlotFile() 2 0.07038 0.07057 0.07081 1.98% Castro::computeTemp() 63 0.0656 0.06789 0.06981 1.95% Castro::reset_internal_energy(MultiFab) 63 0.04744 0.0487 0.05074 1.42% Castro::reset_internal_energy(Fab) 1008 0.04713 0.04839 0.05044 1.41% Castro::normalize_species() 62 0.04051 0.04197 0.04338 1.21% StateDataPhysBCFunct::() 41 0.03359 0.03747 0.0415 1.16% FabArray::ParallelCopy_nowait() 41 0.03292 0.03947 0.04142 1.16% StateData::FillBoundary(geom) 41 0.03349 0.03737 0.0414 1.16% Castro::construct_new_source() 50 0.02774 0.03019 0.03207 0.90% Gravity::interpolate_monopole_grav() 21 0.02807 0.0283 0.02844 0.80% Castro::finalize_do_advance() 10 0.01318 0.02185 0.02667 0.75% Castro::construct_new_gravity_source() 10 0.02091 0.02366 0.02542 0.71% Castro::post_init() 1 0.02432 0.02455 0.02471 0.69% Castro::apply_source_to_state() 20 0.01104 0.01341 0.01815 0.51% FabArray::Saxpy() 20 0.01098 0.01335 0.01806 0.51% Castro::post_timestep() 10 0.01507 0.01594 0.0166 0.46% Castro::Castro() 1 0.009272 0.01186 0.01511 0.42% VisMF::Write(FabArray) 2 0.01128 0.01237 0.01467 0.41% FabArray::setDomainBndry() 41 0.008165 0.01117 0.01269 0.36% Castro::check_for_nan() 20 0.01074 0.01143 0.01235 0.35% MultiFab::contains_nan() 20 0.01071 0.01141 0.01233 0.35% Castro::initMFs() 1 0.006035 0.008125 0.01068 0.30% Castro::construct_old_source() 50 0.006748 0.009433 0.01008 0.28% Castro::construct_old_gravity_source() 10 0.006691 0.009362 0.01 0.28% Castro::computeNewDt() 9 0.009158 0.009168 0.009175 0.26% AmrLevel::AmrLevel(dm) 1 0.005049 0.006728 0.008828 0.25% StateData::define() 4 0.005029 0.0067 0.008796 0.25% Castro::enforce_min_density() 62 0.00704 0.007332 0.007645 0.21% Castro::finalize_advance() 10 0.002893 0.004226 0.005519 0.15% Castro::swap_state_time_levels() 10 0.00308 0.004022 0.004399 0.12% Castro::buildMetrics() 1 0.001601 0.002133 0.002757 0.08% Castro::post_regrid() 1 0.001453 0.00159 0.001639 0.05% Amr::InitAmr() 1 0.0002629 0.000423 0.0006194 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.292e-05 0.0002228 0.0004034 0.01% DistributionMapping::LeastUsedCPUs() 1 7.784e-06 0.0002167 0.0003965 0.01% Castro::enforce_consistent_e() 1 7.599e-05 8.844e-05 0.0001138 0.00% Amr::writeSmallPlotFile() 1 2.844e-05 6.048e-05 8.807e-05 0.00% FabArrayBase::getCPC() 41 6.865e-05 7.912e-05 8.764e-05 0.00% Castro::enforce_speed_limit() 62 2.627e-05 3.156e-05 3.557e-05 0.00% FabArrayBase::CPC::define() 2 1.979e-05 2.475e-05 3.063e-05 0.00% Amr::initSubcycle() 1 8.259e-06 1.353e-05 2.012e-05 0.00% Gravity::swapTimeLevels() 10 7.885e-06 1.318e-05 1.687e-05 0.00% Castro::FluxRegCrseInit 10 6.406e-06 8.349e-06 1.418e-05 0.00% Gravity::set_mass_offset() 10 1.035e-05 1.135e-05 1.264e-05 0.00% Castro::create_source_corrector() 10 7.713e-06 9.025e-06 1.187e-05 0.00% Castro::retry_advance_ctu() 10 6.685e-06 7.331e-06 8.084e-06 0.00% Castro::FluxRegFineAdd() 10 2.061e-06 2.32e-06 2.73e-06 0.00% DistributionMapping::Distribute() 1 8.6e-07 1.341e-06 1.656e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 31 B 37 B 47 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.09) finalized