Initializing AMReX (23.11-10-g15a0bb9a8c1b)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.11-10-g15a0bb9a8c1b) initialized Starting run at 06:22:09 UTC on 2023-11-15. Successfully read inputs file ... Castro git describe: 23.11-6-gb720d68fa AMReX git describe: 23.11-10-g15a0bb9a8 Microphysics git describe: 23.11-6-g2383aa27 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.019050076 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.454921084 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.413434555 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.398161825 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.402603698 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.426755479 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.400822747 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.400375463 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.398130471 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.400098792 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.424947127 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.043588612 seconds Ending run at 06:22:13 UTC on 2023-11-15. Run time = 4.372850691 Run time without initialization = 4.172758714 Average number of zones advanced per microsecond: 0.628 Average number of zones advanced per microsecond per rank: 0.079 TinyProfiler total time across processes [min...avg...max]: 4.372 ... 4.373 ... 4.373 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.4871 2.7732 3.0115 68.87% check_for_negative_density() 10 0.01852 0.2669 0.5585 12.77% Gravity::make_radial_gravity() 21 0.2977 0.3183 0.3366 7.70% amrex::Copy() 193 0.1009 0.1186 0.1347 3.08% Castro::initData() 1 0.04801 0.08597 0.121 2.77% Castro::estTimeStep() 21 0.02291 0.06586 0.1126 2.58% FabArray::setVal() 143 0.09171 0.1026 0.1114 2.55% FabArray::ParallelCopy_finish() 41 0.05494 0.06951 0.09152 2.09% FabArray::ParallelCopy_nowait() 41 0.05959 0.06246 0.06599 1.51% FillPatchIterator::Initialize 41 0.04839 0.05469 0.05997 1.37% Castro::reset_internal_energy(Fab) 1008 0.04995 0.05264 0.05467 1.25% StateData::FillBoundary(geom) 41 0.03528 0.04188 0.04993 1.14% Amr::writePlotFile() 2 0.03813 0.04264 0.04455 1.02% Castro::normalize_species() 62 0.04265 0.04323 0.04411 1.01% Castro::construct_new_gravity_source() 10 0.02773 0.03081 0.03424 0.78% Gravity::interpolate_monopole_grav() 21 0.02733 0.0296 0.03124 0.71% Castro::initialize_do_advance() 10 0.02389 0.02618 0.02959 0.68% Castro::computeTemp() 63 0.02085 0.02206 0.02394 0.55% FabArray::setDomainBndry() 41 0.01581 0.01944 0.02342 0.54% FabArray::Saxpy() 20 0.018 0.01912 0.02067 0.47% VisMF::Write(FabArray) 2 0.01381 0.01513 0.02023 0.46% Castro::initialize_advance() 10 0.01497 0.0163 0.01766 0.40% MultiFab::contains_nan() 20 0.01342 0.01498 0.01662 0.38% Castro::construct_old_gravity_source() 10 0.01481 0.0154 0.01606 0.37% Castro::initMFs() 1 0.008148 0.008753 0.01037 0.24% Castro::enforce_min_density() 62 0.008126 0.008599 0.009164 0.21% Castro::construct_new_source() 50 0.006828 0.007916 0.008843 0.20% main() 1 0.007307 0.007807 0.008166 0.19% StateData::define() 4 0.006954 0.007268 0.007764 0.18% Castro::swap_state_time_levels() 10 0.00485 0.006227 0.006497 0.15% Gravity::get_new_grav_vector() 11 0.003997 0.005244 0.006426 0.15% Gravity::get_old_grav_vector() 10 0.002595 0.002956 0.003409 0.08% Amr::coarseTimeStep() 10 0.001016 0.001855 0.002773 0.06% Castro::buildMetrics() 1 0.00196 0.002049 0.002213 0.05% Castro::finalize_do_advance() 10 0.001055 0.001486 0.001896 0.04% AmrLevel::FillPatch() 41 0.001179 0.001398 0.001759 0.04% Amr::timeStep() 10 0.0001996 0.0002681 0.0006181 0.01% Amr::InitAmr() 1 0.0002709 0.0003103 0.0004231 0.01% Castro::reset_internal_energy(MultiFab) 63 0.000326 0.0003373 0.0003561 0.01% Castro::clean_state() 62 0.0001812 0.0002015 0.0002267 0.01% Castro::do_advance_ctu() 10 0.0001797 0.0002114 0.0002262 0.01% FillPatchIterator::FillFromLevel0() 41 0.0001454 0.0001698 0.0001939 0.00% StateDataPhysBCFunct::() 41 0.000131 0.0001526 0.0001822 0.00% Castro::Castro() 1 6.908e-05 0.0001179 0.0001624 0.00% Castro::do_old_sources() 10 0.0001267 0.0001381 0.0001542 0.00% Castro::finalize_advance() 10 0.0001044 0.0001283 0.000153 0.00% Castro::construct_old_source() 50 9.614e-05 0.0001161 0.00015 0.00% DistributionMapping::LeastUsedCPUs() 1 8.119e-06 0.0001017 0.0001434 0.00% FabArray::ParallelCopy() 41 0.0001083 0.0001193 0.0001325 0.00% Castro::enforce_consistent_e() 1 8.733e-05 0.0001062 0.0001304 0.00% Amr::FinalizeInit() 1 5.282e-06 1.964e-05 0.000112 0.00% FillPatchSingleLevel 41 8.995e-05 9.756e-05 0.0001052 0.00% FabArrayBase::getCPC() 41 6.89e-05 8.261e-05 9.307e-05 0.00% Castro::subcycle_advance_ctu() 10 6.65e-05 8.113e-05 9.12e-05 0.00% Castro::do_new_sources() 10 7.553e-05 8.15e-05 8.639e-05 0.00% Castro::apply_source_to_state() 20 6.682e-05 7.294e-05 8.247e-05 0.00% Castro::advance() 10 5.22e-05 6.106e-05 6.89e-05 0.00% Castro::expand_state() 10 3.135e-05 4.661e-05 6.501e-05 0.00% Castro::construct_new_gravity() 10 3.5e-05 4.75e-05 6.191e-05 0.00% Castro::construct_old_gravity() 10 4.514e-05 5.063e-05 6.034e-05 0.00% Amr::writeSmallPlotFile() 1 2.998e-05 4.697e-05 5.92e-05 0.00% Castro::enforce_speed_limit() 62 3.218e-05 3.789e-05 4.625e-05 0.00% FabArrayBase::CPC::define() 2 2.707e-05 3.428e-05 4.43e-05 0.00% Amr::defBaseLevel() 1 2.755e-05 3.458e-05 4.107e-05 0.00% Castro::check_for_nan() 20 2.577e-05 3.008e-05 3.643e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.832e-05 2.014e-05 2.554e-05 0.00% Castro::post_timestep() 10 1.484e-05 1.784e-05 2.318e-05 0.00% Gravity::set_mass_offset() 10 9.171e-06 1.391e-05 2.309e-05 0.00% Castro::post_init() 1 1.534e-05 1.771e-05 2.154e-05 0.00% Gravity::swapTimeLevels() 10 1.229e-05 1.504e-05 2.002e-05 0.00% Amr::initSubcycle() 1 1.002e-05 1.173e-05 1.849e-05 0.00% Castro::create_source_corrector() 10 1.231e-05 1.481e-05 1.772e-05 0.00% Castro::FluxRegCrseInit 10 5.773e-06 9.142e-06 1.344e-05 0.00% Castro::retry_advance_ctu() 10 6.648e-06 8.211e-06 1.057e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.615e-06 6.061e-06 1.048e-05 0.00% Castro::computeNewDt() 9 7.675e-06 8.466e-06 9.747e-06 0.00% Amr::InitializeInit() 1 2.032e-06 3.43e-06 9.19e-06 0.00% Castro::computeInitialDt() 2 4.176e-06 4.61e-06 4.966e-06 0.00% Castro::post_regrid() 1 1.615e-06 3.515e-06 4.854e-06 0.00% Amr::init() 1 2.281e-06 2.933e-06 4.695e-06 0.00% Castro::FluxRegFineAdd() 10 1.954e-06 2.746e-06 3.124e-06 0.00% Amr::initialInit() 1 1.846e-06 2.489e-06 3.112e-06 0.00% DistributionMapping::Distribute() 1 8.2e-07 1.078e-06 1.504e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 4.372 4.373 4.373 100.00% Amr::coarseTimeStep() 10 4.121 4.121 4.121 94.24% Amr::timeStep() 10 4.108 4.109 4.11 93.98% Castro::advance() 10 4.092 4.093 4.094 93.61% Castro::subcycle_advance_ctu() 10 3.982 3.987 3.995 91.35% Castro::do_advance_ctu() 10 3.982 3.987 3.995 91.35% Castro::construct_ctu_hydro_source() 10 3.054 3.063 3.069 70.17% check_for_negative_density() 10 0.01852 0.2669 0.5585 12.77% Gravity::make_radial_gravity() 21 0.3218 0.3439 0.3644 8.33% AmrLevel::FillPatch() 41 0.2798 0.297 0.3103 7.10% FillPatchIterator::Initialize 41 0.2376 0.2486 0.2575 5.89% Castro::initialize_do_advance() 10 0.2224 0.2371 0.2517 5.76% Castro::construct_old_gravity() 10 0.2022 0.2194 0.2347 5.37% Gravity::get_old_grav_vector() 10 0.2014 0.2185 0.2338 5.35% Gravity::get_new_grav_vector() 11 0.2331 0.2333 0.2335 5.34% Castro::construct_new_gravity() 10 0.2051 0.2059 0.2065 4.72% Amr::init() 1 0.1995 0.1996 0.1997 4.57% FillPatchIterator::FillFromLevel0() 41 0.1688 0.1745 0.1885 4.31% FillPatchSingleLevel 41 0.1687 0.1743 0.1883 4.31% Castro::expand_state() 10 0.1488 0.1646 0.1825 4.17% Amr::initialInit() 1 0.1803 0.1805 0.1807 4.13% FabArray::ParallelCopy() 41 0.1207 0.1322 0.1519 3.47% Amr::InitializeInit() 1 0.07685 0.1142 0.1491 3.41% Amr::defBaseLevel() 1 0.07685 0.1142 0.1491 3.41% Castro::do_old_sources() 10 0.1374 0.141 0.1477 3.38% amrex::Copy() 193 0.1009 0.1186 0.1347 3.08% Castro::clean_state() 62 0.1225 0.1261 0.1311 3.00% Castro::initData() 1 0.05233 0.09112 0.127 2.90% Castro::estTimeStep() 21 0.02291 0.06586 0.1126 2.58% FabArray::setVal() 143 0.09171 0.1026 0.1114 2.55% Castro::initialize_advance() 10 0.09305 0.1013 0.1063 2.43% Amr::FinalizeInit() 1 0.03142 0.06627 0.1034 2.36% FabArray::ParallelCopy_finish() 41 0.05494 0.06951 0.09152 2.09% Castro::do_new_sources() 10 0.06916 0.07699 0.08401 1.92% Castro::computeTemp() 63 0.07175 0.07503 0.07891 1.80% Castro::computeInitialDt() 2 0.002281 0.0371 0.07439 1.70% FabArray::ParallelCopy_nowait() 41 0.05968 0.06258 0.0661 1.51% Amr::writePlotFile() 2 0.06255 0.06278 0.06292 1.44% Castro::reset_internal_energy(MultiFab) 63 0.05029 0.05297 0.05501 1.26% Castro::reset_internal_energy(Fab) 1008 0.04995 0.05264 0.05467 1.25% StateDataPhysBCFunct::() 41 0.03542 0.04204 0.05009 1.15% StateData::FillBoundary(geom) 41 0.03528 0.04188 0.04993 1.14% Castro::normalize_species() 62 0.04265 0.04323 0.04411 1.01% Castro::construct_new_source() 50 0.03456 0.03872 0.04282 0.98% Castro::construct_new_gravity_source() 10 0.02773 0.03081 0.03424 0.78% Gravity::interpolate_monopole_grav() 21 0.02733 0.0296 0.03124 0.71% Castro::finalize_do_advance() 10 0.01277 0.02125 0.03043 0.70% Castro::post_init() 1 0.0285 0.02872 0.02886 0.66% FabArray::setDomainBndry() 41 0.01581 0.01944 0.02342 0.54% Castro::apply_source_to_state() 20 0.01807 0.01919 0.02075 0.47% FabArray::Saxpy() 20 0.018 0.01912 0.02067 0.47% VisMF::Write(FabArray) 2 0.01381 0.01513 0.02023 0.46% Castro::Castro() 1 0.01481 0.01566 0.01703 0.39% Castro::check_for_nan() 20 0.01345 0.01501 0.01665 0.38% MultiFab::contains_nan() 20 0.01342 0.01498 0.01662 0.38% Castro::construct_old_source() 50 0.01493 0.01552 0.01621 0.37% Castro::post_timestep() 10 0.01577 0.01604 0.01616 0.37% Castro::construct_old_gravity_source() 10 0.01481 0.0154 0.01606 0.37% Castro::initMFs() 1 0.008148 0.008753 0.01037 0.24% Castro::enforce_min_density() 62 0.008126 0.008599 0.009164 0.21% Castro::computeNewDt() 9 0.009009 0.009016 0.009029 0.21% AmrLevel::AmrLevel(dm) 1 0.006972 0.007288 0.007782 0.18% StateData::define() 4 0.006954 0.007268 0.007764 0.18% Castro::swap_state_time_levels() 10 0.00485 0.006227 0.006497 0.15% Castro::finalize_advance() 10 0.003862 0.004418 0.004879 0.11% Castro::buildMetrics() 1 0.002087 0.002195 0.00239 0.05% Castro::post_regrid() 1 0.001606 0.00168 0.001775 0.04% Amr::InitAmr() 1 0.0002816 0.000322 0.0004331 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.255e-05 0.0001088 0.000151 0.00% DistributionMapping::LeastUsedCPUs() 1 8.119e-06 0.0001017 0.0001434 0.00% Castro::enforce_consistent_e() 1 8.733e-05 0.0001062 0.0001304 0.00% FabArrayBase::getCPC() 41 9.598e-05 0.0001169 0.0001282 0.00% Amr::writeSmallPlotFile() 1 2.998e-05 4.697e-05 5.92e-05 0.00% Castro::enforce_speed_limit() 62 3.218e-05 3.789e-05 4.625e-05 0.00% FabArrayBase::CPC::define() 2 2.707e-05 3.428e-05 4.43e-05 0.00% Gravity::set_mass_offset() 10 9.171e-06 1.391e-05 2.309e-05 0.00% Gravity::swapTimeLevels() 10 1.229e-05 1.504e-05 2.002e-05 0.00% Amr::initSubcycle() 1 1.002e-05 1.173e-05 1.849e-05 0.00% Castro::create_source_corrector() 10 1.231e-05 1.481e-05 1.772e-05 0.00% Castro::FluxRegCrseInit 10 5.773e-06 9.142e-06 1.344e-05 0.00% Castro::retry_advance_ctu() 10 6.648e-06 8.211e-06 1.057e-05 0.00% Castro::FluxRegFineAdd() 10 1.954e-06 2.746e-06 3.124e-06 0.00% DistributionMapping::Distribute() 1 8.2e-07 1.078e-06 1.504e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 26 B 28 B 32 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.11-10-g15a0bb9a8c1b) finalized