Initializing AMReX (v2024-27-ga9b452ab5e8b)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (v2024-27-ga9b452ab5e8b) initialized Starting run at 05:32:33 UTC on 2024-03-21. Successfully read inputs file ... Castro git describe: 24.03-25-g09bde5fae AMReX git describe: v2024-27-ga9b452ab5 Microphysics git describe: 24.03-20-gb934b16f reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.015245047 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.363753259 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.344982703 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.337183603 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.365269613 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.342175066 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.311649006 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.312206134 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.313473687 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.31354028 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.313465699 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.007763945 seconds Ending run at 05:32:37 UTC on 2024-03-21. Run time = 3.540734043 Run time without initialization = 3.329977252 Average number of zones advanced per microsecond: 0.787 Average number of zones advanced per microsecond per rank: 0.098 TinyProfiler total time across processes [min...avg...max]: 3.54 ... 3.541 ... 3.541 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2671 2.3704 2.4237 68.45% Gravity::make_radial_gravity() 21 0.2916 0.3025 0.3229 9.12% check_for_negative_density() 10 0.0273 0.08349 0.1891 5.34% Castro::initData() 1 0.05709 0.1007 0.143 4.04% Castro::estTimeStep() 21 0.02573 0.07432 0.1261 3.56% amrex::Copy() 193 0.06457 0.07815 0.08498 2.40% FabArray::ParallelCopy_finish() 41 0.03956 0.05418 0.07939 2.24% FabArray::setVal() 143 0.06263 0.06812 0.07891 2.23% Castro::reset_internal_energy(Fab) 1008 0.04663 0.04874 0.05094 1.44% Castro::normalize_species() 62 0.04128 0.04318 0.04704 1.33% FabArray::ParallelCopy_nowait() 41 0.0343 0.04003 0.04168 1.18% StateData::FillBoundary(geom) 41 0.02937 0.03195 0.03436 0.97% FillPatchIterator::Initialize 41 0.02876 0.03192 0.03321 0.94% Gravity::interpolate_monopole_grav() 21 0.02752 0.029 0.03053 0.86% Castro::construct_new_gravity_source() 10 0.02017 0.02369 0.02627 0.74% Castro::computeTemp() 63 0.01952 0.02023 0.02092 0.59% Castro::initialize_do_advance() 10 0.0136 0.01767 0.02035 0.57% FabArray::Saxpy() 20 0.01007 0.01194 0.0126 0.36% VisMF::Write(FabArray) 2 0.008642 0.009405 0.01259 0.36% FabArray::setDomainBndry() 41 0.007087 0.01032 0.01224 0.35% Castro::initialize_advance() 10 0.00554 0.009726 0.01203 0.34% Amr::writePlotFile() 2 0.0084 0.01058 0.01163 0.33% MultiFab::contains_nan() 20 0.009015 0.009902 0.01096 0.31% Castro::construct_old_gravity_source() 10 0.006775 0.008923 0.009528 0.27% Castro::initMFs() 1 0.007218 0.007434 0.00832 0.23% Amr::coarseTimeStep() 10 0.002181 0.005956 0.007257 0.20% Castro::enforce_min_density() 62 0.005702 0.006065 0.006379 0.18% Castro::construct_new_source() 50 0.005374 0.006002 0.006227 0.18% StateData::define() 4 0.005818 0.005938 0.006045 0.17% Gravity::get_new_grav_vector() 11 0.002766 0.004134 0.005506 0.16% Castro::swap_state_time_levels() 10 0.001949 0.003874 0.004468 0.13% main() 1 0.003377 0.003575 0.003824 0.11% Gravity::get_old_grav_vector() 10 0.001476 0.002014 0.002396 0.07% Castro::buildMetrics() 1 0.001696 0.001735 0.001776 0.05% Castro::finalize_do_advance() 10 0.0004617 0.0008721 0.001047 0.03% AmrLevel::FillPatch() 41 0.0007802 0.0008503 0.0009936 0.03% Amr::InitAmr() 1 0.0003946 0.0004305 0.0005999 0.02% Amr::timeStep() 10 0.0001692 0.0002087 0.0003714 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002787 0.0002952 0.0003134 0.01% DistributionMapping::LeastUsedCPUs() 1 2.671e-05 0.0001952 0.0002299 0.01% Castro::clean_state() 62 0.0001501 0.0001749 0.0001978 0.01% Castro::do_advance_ctu() 10 0.0001488 0.0001583 0.0001922 0.01% Castro::Castro() 1 8.819e-05 0.0001215 0.0001443 0.00% FillPatchIterator::FillFromLevel0() 41 0.0001031 0.0001203 0.000137 0.00% Castro::enforce_consistent_e() 1 9.527e-05 0.0001078 0.0001259 0.00% Castro::finalize_advance() 10 0.0001012 0.00011 0.000119 0.00% Castro::do_old_sources() 10 8.127e-05 9.962e-05 0.0001144 0.00% StateDataPhysBCFunct::() 41 9.429e-05 0.0001014 0.000107 0.00% FabArray::ParallelCopy() 41 7.311e-05 8.179e-05 9.757e-05 0.00% Castro::construct_old_source() 50 5.822e-05 7.542e-05 8.91e-05 0.00% FillPatchSingleLevel 41 7.029e-05 8.047e-05 8.572e-05 0.00% Castro::do_new_sources() 10 5.473e-05 6.274e-05 7.187e-05 0.00% Amr::FinalizeInit() 1 4.174e-06 1.384e-05 7.031e-05 0.00% FabArrayBase::getCPC() 41 5.151e-05 6.037e-05 6.981e-05 0.00% Amr::writeSmallPlotFile() 1 3.137e-05 4.747e-05 5.847e-05 0.00% Castro::apply_source_to_state() 20 4.093e-05 4.66e-05 5.022e-05 0.00% Castro::advance() 10 4.375e-05 4.637e-05 4.854e-05 0.00% Castro::subcycle_advance_ctu() 10 3.626e-05 4.306e-05 4.756e-05 0.00% Amr::defBaseLevel() 1 3.739e-05 4.184e-05 4.606e-05 0.00% Castro::construct_old_gravity() 10 3.321e-05 3.763e-05 4.462e-05 0.00% Castro::construct_new_gravity() 10 3.574e-05 3.89e-05 4.452e-05 0.00% FabArrayBase::CPC::define() 2 2.63e-05 3.107e-05 4.078e-05 0.00% Castro::expand_state() 10 1.998e-05 2.543e-05 3.631e-05 0.00% Castro::enforce_speed_limit() 62 2.427e-05 2.782e-05 3.149e-05 0.00% Castro::check_for_nan() 20 2.23e-05 2.298e-05 2.42e-05 0.00% Gravity::set_mass_offset() 10 1.079e-05 1.295e-05 1.89e-05 0.00% Castro::retry_advance_ctu() 10 5.908e-06 8.365e-06 1.89e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.406e-05 1.534e-05 1.778e-05 0.00% Castro::post_timestep() 10 1.195e-05 1.413e-05 1.518e-05 0.00% Gravity::swapTimeLevels() 10 8.464e-06 1.074e-05 1.278e-05 0.00% Amr::initSubcycle() 1 1.11e-05 1.136e-05 1.175e-05 0.00% Castro::computeNewDt() 9 8.055e-06 9.364e-06 1.154e-05 0.00% Castro::FluxRegCrseInit 10 6.699e-06 7.792e-06 1.149e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.453e-06 6.861e-06 1.11e-05 0.00% Castro::create_source_corrector() 10 7.119e-06 8.28e-06 9.852e-06 0.00% Castro::post_init() 1 2.546e-06 4.878e-06 8.891e-06 0.00% Castro::post_regrid() 1 2.41e-06 3.524e-06 5.508e-06 0.00% Amr::InitializeInit() 1 2e-06 2.667e-06 5.436e-06 0.00% Castro::computeInitialDt() 2 3.303e-06 4.188e-06 4.828e-06 0.00% Castro::FluxRegFineAdd() 10 1.913e-06 2.358e-06 3.004e-06 0.00% Amr::init() 1 1.584e-06 1.988e-06 2.628e-06 0.00% Amr::initialInit() 1 1.301e-06 1.651e-06 2.018e-06 0.00% DistributionMapping::Distribute() 1 1.033e-06 1.198e-06 1.616e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.54 3.541 3.541 100.00% Amr::coarseTimeStep() 10 3.318 3.318 3.318 93.72% Amr::timeStep() 10 3.301 3.302 3.306 93.36% Castro::advance() 10 3.285 3.285 3.286 92.81% Castro::subcycle_advance_ctu() 10 3.204 3.213 3.221 90.98% Castro::do_advance_ctu() 10 3.204 3.213 3.221 90.98% Castro::construct_ctu_hydro_source() 10 2.475 2.476 2.478 69.97% Gravity::make_radial_gravity() 21 0.307 0.319 0.3365 9.50% Gravity::get_new_grav_vector() 11 0.2176 0.2191 0.221 6.24% Amr::init() 1 0.21 0.2102 0.2102 5.94% AmrLevel::FillPatch() 41 0.1922 0.2005 0.2079 5.87% Castro::construct_old_gravity() 10 0.1792 0.1854 0.1982 5.60% Gravity::get_old_grav_vector() 10 0.1786 0.1848 0.1973 5.57% Amr::initialInit() 1 0.1946 0.1953 0.1959 5.53% Castro::construct_new_gravity() 10 0.1923 0.1936 0.1949 5.50% check_for_negative_density() 10 0.0273 0.08349 0.1891 5.34% FillPatchIterator::Initialize 41 0.1582 0.1689 0.1799 5.08% Castro::initialize_do_advance() 10 0.1627 0.1671 0.1718 4.85% Amr::InitializeInit() 1 0.07973 0.1235 0.1659 4.68% Amr::defBaseLevel() 1 0.07972 0.1235 0.1659 4.68% Castro::initData() 1 0.06165 0.1051 0.1478 4.17% FillPatchIterator::FillFromLevel0() 41 0.1151 0.1266 0.1436 4.05% FillPatchSingleLevel 41 0.115 0.1265 0.1434 4.05% Castro::estTimeStep() 21 0.02573 0.07432 0.1261 3.56% Castro::clean_state() 62 0.1132 0.1177 0.1227 3.47% Castro::expand_state() 10 0.1056 0.1134 0.1193 3.37% Amr::FinalizeInit() 1 0.02912 0.07181 0.1159 3.27% FabArray::ParallelCopy() 41 0.0808 0.09438 0.1139 3.22% Castro::do_old_sources() 10 0.08981 0.09147 0.09353 2.64% Castro::computeInitialDt() 2 0.002663 0.04497 0.08876 2.51% amrex::Copy() 193 0.06457 0.07815 0.08498 2.40% FabArray::ParallelCopy_finish() 41 0.03956 0.05418 0.07939 2.24% FabArray::setVal() 143 0.06263 0.06812 0.07891 2.23% Castro::initialize_advance() 10 0.05987 0.0687 0.07724 2.18% Castro::computeTemp() 63 0.06644 0.06926 0.07217 2.04% Castro::do_new_sources() 10 0.05328 0.06332 0.07104 2.01% Castro::reset_internal_energy(MultiFab) 63 0.04691 0.04903 0.05125 1.45% Castro::reset_internal_energy(Fab) 1008 0.04663 0.04874 0.05094 1.44% Castro::normalize_species() 62 0.04128 0.04318 0.04704 1.33% FabArray::ParallelCopy_nowait() 41 0.0344 0.04012 0.04176 1.18% StateDataPhysBCFunct::() 41 0.02947 0.03205 0.03446 0.97% StateData::FillBoundary(geom) 41 0.02937 0.03195 0.03436 0.97% Castro::construct_new_source() 50 0.02555 0.02969 0.03234 0.91% Castro::finalize_do_advance() 10 0.01237 0.02084 0.03093 0.87% Gravity::interpolate_monopole_grav() 21 0.02752 0.029 0.03053 0.86% Castro::post_init() 1 0.02581 0.02646 0.02701 0.76% Castro::construct_new_gravity_source() 10 0.02017 0.02369 0.02627 0.74% Amr::writePlotFile() 2 0.02212 0.02269 0.02328 0.66% Castro::post_timestep() 10 0.0154 0.01624 0.01911 0.54% Castro::Castro() 1 0.0119 0.01222 0.01306 0.37% Castro::apply_source_to_state() 20 0.01012 0.01199 0.01265 0.36% FabArray::Saxpy() 20 0.01007 0.01194 0.0126 0.36% VisMF::Write(FabArray) 2 0.008642 0.009405 0.01259 0.36% FabArray::setDomainBndry() 41 0.007087 0.01032 0.01224 0.35% Castro::check_for_nan() 20 0.009038 0.009925 0.01098 0.31% MultiFab::contains_nan() 20 0.009015 0.009902 0.01096 0.31% Castro::construct_old_source() 50 0.006833 0.008998 0.009613 0.27% Castro::construct_old_gravity_source() 10 0.006775 0.008923 0.009528 0.27% Castro::computeNewDt() 9 0.00938 0.0094 0.009421 0.27% Castro::initMFs() 1 0.007218 0.007434 0.00832 0.23% Castro::enforce_min_density() 62 0.005702 0.006065 0.006379 0.18% AmrLevel::AmrLevel(dm) 1 0.005834 0.005954 0.006059 0.17% StateData::define() 4 0.005818 0.005938 0.006045 0.17% Castro::finalize_advance() 10 0.003125 0.003646 0.004791 0.14% Castro::swap_state_time_levels() 10 0.001949 0.003874 0.004468 0.13% Castro::buildMetrics() 1 0.001839 0.001873 0.001915 0.05% Castro::post_regrid() 1 0.001547 0.001654 0.001887 0.05% Amr::InitAmr() 1 0.0004057 0.0004419 0.0006113 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 3.259e-05 0.0002033 0.0002373 0.01% DistributionMapping::LeastUsedCPUs() 1 2.671e-05 0.0001952 0.0002299 0.01% Castro::enforce_consistent_e() 1 9.527e-05 0.0001078 0.0001259 0.00% FabArrayBase::getCPC() 41 7.845e-05 9.144e-05 0.0001036 0.00% Amr::writeSmallPlotFile() 1 3.137e-05 4.747e-05 5.847e-05 0.00% FabArrayBase::CPC::define() 2 2.63e-05 3.107e-05 4.078e-05 0.00% Castro::enforce_speed_limit() 62 2.427e-05 2.782e-05 3.149e-05 0.00% Gravity::set_mass_offset() 10 1.079e-05 1.295e-05 1.89e-05 0.00% Castro::retry_advance_ctu() 10 5.908e-06 8.365e-06 1.89e-05 0.00% Gravity::swapTimeLevels() 10 8.464e-06 1.074e-05 1.278e-05 0.00% Amr::initSubcycle() 1 1.11e-05 1.136e-05 1.175e-05 0.00% Castro::FluxRegCrseInit 10 6.699e-06 7.792e-06 1.149e-05 0.00% Castro::create_source_corrector() 10 7.119e-06 8.28e-06 9.852e-06 0.00% Castro::FluxRegFineAdd() 10 1.913e-06 2.358e-06 3.004e-06 0.00% DistributionMapping::Distribute() 1 1.033e-06 1.198e-06 1.616e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 38 B 41 B 47 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-27-ga9b452ab5e8b) finalized