MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.02-50-g32a65ffa8aba) initialized Starting run at 06:41:22 UTC on 2023-03-01. Successfully read inputs file ... Castro git describe: 23.01-47-g97cf48985 AMReX git describe: 23.02-50-g32a65ffa8 Microphysics git describe: 23.02-16-g3e0cd993 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.016236029 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.362839762 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.363259526 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.339348627 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.339065186 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.362874346 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.335439375 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.316903462 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.317017317 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.318164584 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.317199097 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.0492256 seconds Ending run at 06:41:25 UTC on 2023-03-01. Run time = 3.62334041 Run time without initialization = 3.428592358 Average number of zones advanced per microsecond: 0.765 Average number of zones advanced per microsecond per rank: 0.096 TinyProfiler total time across processes [min...avg...max]: 3.622 ... 3.623 ... 3.623 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2897 2.3782 2.4282 67.01% Gravity::make_radial_gravity() 21 0.3199 0.3268 0.3363 9.28% Castro::do_advance_ctu() 10 0.03474 0.08448 0.1775 4.90% Castro::initData() 1 0.03944 0.08024 0.1257 3.47% Castro::estTimeStep() 21 0.0259 0.0774 0.1253 3.46% FabArray::setVal() 143 0.06724 0.07393 0.08282 2.29% amrex::Copy() 193 0.07015 0.07516 0.0821 2.27% FabArray::ParallelCopy_finish() 41 0.03417 0.04589 0.05574 1.54% Castro::reset_internal_energy(Fab) 1008 0.04936 0.05066 0.05194 1.43% Amr::writePlotFile() 2 0.0455 0.04852 0.04927 1.36% FabArray::ParallelCopy_nowait() 41 0.04048 0.04337 0.04491 1.24% Castro::normalize_species() 62 0.04167 0.04264 0.04447 1.23% StateData::FillBoundary(geom) 41 0.03295 0.03764 0.04027 1.11% FillPatchIterator::Initialize 41 0.02987 0.03573 0.03833 1.06% Castro::construct_new_gravity_source() 10 0.02405 0.02688 0.02979 0.82% Gravity::interpolate_monopole_grav() 21 0.02787 0.02842 0.02884 0.80% Castro::computeTemp() 63 0.01898 0.02018 0.02142 0.59% Castro::initialize_do_advance() 10 0.01447 0.01845 0.0212 0.59% VisMF::Write(FabArray) 2 0.01368 0.01431 0.01719 0.47% FabArray::Saxpy() 20 0.01431 0.01491 0.01516 0.42% Castro::initialize_advance() 10 0.009516 0.01198 0.01501 0.41% FabArray::setDomainBndry() 41 0.008759 0.01149 0.01296 0.36% MultiFab::contains_nan() 20 0.0105 0.0114 0.01234 0.34% Castro::construct_old_gravity_source() 10 0.009687 0.01088 0.01129 0.31% Castro::initMFs() 1 0.007022 0.00743 0.008571 0.24% Castro::construct_new_source() 50 0.00639 0.006514 0.006631 0.18% StateData::define() 4 0.005763 0.005967 0.006524 0.18% main() 1 0.005401 0.006016 0.006476 0.18% Castro::enforce_min_density() 62 0.005917 0.006166 0.006431 0.18% Gravity::get_new_grav_vector() 11 0.003131 0.004245 0.005789 0.16% Castro::swap_state_time_levels() 10 0.003559 0.004811 0.005046 0.14% Gravity::get_old_grav_vector() 10 0.001977 0.002535 0.002925 0.08% Amr::coarseTimeStep() 10 0.001113 0.002274 0.002817 0.08% Castro::finalize_do_advance() 10 0.001508 0.00204 0.002341 0.06% Castro::buildMetrics() 1 0.001646 0.001705 0.001871 0.05% Castro::expand_state() 10 0.001018 0.00122 0.001383 0.04% Amr::InitAmr() 1 0.000261 0.0002944 0.0004226 0.01% Amr::timeStep() 10 0.0001726 0.000234 0.0004084 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002833 0.0003006 0.000342 0.01% Castro::clean_state() 62 0.0001585 0.0001705 0.0001923 0.01% DistributionMapping::LeastUsedCPUs() 1 7.131e-06 0.0001368 0.0001653 0.00% StateDataPhysBCFunct::() 41 8.517e-05 9.655e-05 0.0001171 0.00% Castro::finalize_advance() 10 8.607e-05 9.52e-05 0.0001134 0.00% Castro::Castro() 1 5.71e-05 7.654e-05 0.0001098 0.00% FillPatchSingleLevel 41 7.295e-05 8.045e-05 9.901e-05 0.00% Castro::enforce_consistent_e() 1 8.015e-05 8.902e-05 9.56e-05 0.00% Castro::construct_old_source() 50 5.648e-05 7.441e-05 9.019e-05 0.00% FabArray::ParallelCopy() 41 7.033e-05 7.764e-05 8.866e-05 0.00% Amr::writeSmallPlotFile() 1 2.667e-05 6.217e-05 8.467e-05 0.00% FabArrayBase::getCPC() 41 5.353e-05 6.319e-05 8.075e-05 0.00% Castro::do_new_sources() 10 5.616e-05 6.416e-05 7.563e-05 0.00% Amr::FinalizeInit() 1 3.947e-06 1.315e-05 7.251e-05 0.00% Castro::do_old_sources() 10 5.52e-05 6.513e-05 7.203e-05 0.00% Castro::construct_old_gravity() 10 3.443e-05 4.36e-05 5.949e-05 0.00% Castro::subcycle_advance_ctu() 10 3.799e-05 4.648e-05 5.867e-05 0.00% Castro::construct_new_gravity() 10 3.545e-05 3.933e-05 5.359e-05 0.00% Castro::apply_source_to_state() 20 4.594e-05 4.885e-05 5.318e-05 0.00% Castro::advance() 10 3.954e-05 4.175e-05 4.482e-05 0.00% Amr::defBaseLevel() 1 2.691e-05 3.355e-05 4.381e-05 0.00% FabArrayBase::CPC::define() 2 1.98e-05 2.604e-05 3.914e-05 0.00% Castro::post_timestep() 10 1.29e-05 2.562e-05 3.433e-05 0.00% Castro::enforce_speed_limit() 62 2.626e-05 3.034e-05 3.373e-05 0.00% Castro::check_for_nan() 20 1.986e-05 2.317e-05 2.72e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.565e-05 2.07e-05 2.433e-05 0.00% Gravity::swapTimeLevels() 10 1.057e-05 1.263e-05 1.595e-05 0.00% Gravity::set_mass_offset() 10 8.876e-06 1.06e-05 1.285e-05 0.00% Castro::create_source_corrector() 10 8.352e-06 9.694e-06 1.167e-05 0.00% Amr::initSubcycle() 1 9.104e-06 9.663e-06 1.076e-05 0.00% Castro::computeNewDt() 9 7.514e-06 8.854e-06 1.006e-05 0.00% Castro::FluxRegCrseInit 10 7.233e-06 8.715e-06 9.919e-06 0.00% Castro::post_init() 1 2.617e-06 4.516e-06 9.744e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.664e-06 4.644e-06 6.943e-06 0.00% Castro::retry_advance_ctu() 10 4.538e-06 5.429e-06 6.091e-06 0.00% Amr::InitializeInit() 1 1.909e-06 2.967e-06 5.546e-06 0.00% Castro::computeInitialDt() 2 2.925e-06 3.955e-06 5.339e-06 0.00% Castro::post_regrid() 1 1.575e-06 2.608e-06 3.845e-06 0.00% Castro::FluxRegFineAdd() 10 1.762e-06 2.143e-06 2.898e-06 0.00% Amr::init() 1 1.633e-06 2.038e-06 2.693e-06 0.00% DistributionMapping::Distribute() 1 9.97e-07 1.178e-06 1.729e-06 0.00% Amr::initialInit() 1 1.062e-06 1.333e-06 1.606e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.622 3.623 3.623 100.00% Amr::coarseTimeStep() 10 3.373 3.373 3.373 93.09% Amr::timeStep() 10 3.36 3.361 3.362 92.79% Castro::advance() 10 3.344 3.344 3.345 92.32% Castro::subcycle_advance_ctu() 10 3.26 3.265 3.269 90.23% Castro::do_advance_ctu() 10 3.26 3.265 3.269 90.23% Castro::construct_ctu_hydro_source() 10 2.29 2.378 2.428 67.01% Gravity::make_radial_gravity() 21 0.337 0.3439 0.3514 9.70% Gravity::get_new_grav_vector() 11 0.2246 0.2265 0.2284 6.30% Castro::construct_old_gravity() 10 0.1948 0.2029 0.209 5.77% Gravity::get_old_grav_vector() 10 0.1941 0.2021 0.2082 5.75% Castro::construct_new_gravity() 10 0.1999 0.2011 0.2022 5.58% Amr::init() 1 0.1942 0.1943 0.1943 5.36% FillPatchIterator::Initialize 41 0.1658 0.1745 0.1871 5.16% Castro::initialize_do_advance() 10 0.156 0.1691 0.181 4.99% Amr::initialInit() 1 0.1776 0.1778 0.1779 4.91% Amr::InitializeInit() 1 0.06098 0.1022 0.1486 4.10% Amr::defBaseLevel() 1 0.06098 0.1022 0.1486 4.10% FillPatchSingleLevel 41 0.1172 0.1272 0.1369 3.78% Castro::expand_state() 10 0.1116 0.12 0.1325 3.66% Castro::initData() 1 0.04357 0.0844 0.1295 3.57% Castro::estTimeStep() 21 0.0259 0.0774 0.1253 3.46% Castro::clean_state() 62 0.1165 0.1192 0.1225 3.38% Amr::FinalizeInit() 1 0.02927 0.07562 0.1169 3.23% FabArray::ParallelCopy() 41 0.07907 0.08943 0.09648 2.66% Castro::computeInitialDt() 2 0.002062 0.04849 0.0897 2.48% FabArray::setVal() 143 0.06724 0.07393 0.08282 2.29% amrex::Copy() 193 0.07015 0.07516 0.0821 2.27% Castro::initialize_advance() 10 0.07187 0.07593 0.08104 2.24% Castro::do_new_sources() 10 0.06261 0.06977 0.07836 2.16% Castro::computeTemp() 63 0.06929 0.07114 0.07367 2.03% Amr::writePlotFile() 2 0.06567 0.06581 0.06603 1.82% FabArray::ParallelCopy_finish() 41 0.03417 0.04589 0.05574 1.54% Castro::reset_internal_energy(MultiFab) 63 0.04965 0.05096 0.05225 1.44% Castro::reset_internal_energy(Fab) 1008 0.04936 0.05066 0.05194 1.43% Castro::do_old_sources() 10 0.04605 0.04723 0.04789 1.32% FabArray::ParallelCopy_nowait() 41 0.04058 0.04346 0.04499 1.24% Castro::normalize_species() 62 0.04167 0.04264 0.04447 1.23% StateDataPhysBCFunct::() 41 0.03307 0.03773 0.04036 1.11% StateData::FillBoundary(geom) 41 0.03295 0.03764 0.04027 1.11% Castro::construct_new_source() 50 0.0305 0.0334 0.0364 1.00% Castro::construct_new_gravity_source() 10 0.02405 0.02688 0.02979 0.82% Gravity::interpolate_monopole_grav() 21 0.02787 0.02842 0.02884 0.80% Castro::post_init() 1 0.02636 0.02652 0.02664 0.74% VisMF::Write(FabArray) 2 0.01368 0.01431 0.01719 0.47% Castro::post_timestep() 10 0.0159 0.01624 0.01658 0.46% Castro::apply_source_to_state() 20 0.01436 0.01496 0.01521 0.42% FabArray::Saxpy() 20 0.01431 0.01491 0.01516 0.42% FabArray::setDomainBndry() 41 0.008759 0.01149 0.01296 0.36% Castro::Castro() 1 0.01128 0.01161 0.0124 0.34% Castro::check_for_nan() 20 0.01052 0.01142 0.01237 0.34% MultiFab::contains_nan() 20 0.0105 0.0114 0.01234 0.34% Castro::construct_old_source() 50 0.009772 0.01095 0.01135 0.31% Castro::construct_old_gravity_source() 10 0.009687 0.01088 0.01129 0.31% Castro::computeNewDt() 9 0.008719 0.008731 0.008739 0.24% Castro::initMFs() 1 0.007022 0.00743 0.008571 0.24% AmrLevel::AmrLevel(dm) 1 0.005782 0.005987 0.006548 0.18% StateData::define() 4 0.005763 0.005967 0.006524 0.18% Castro::enforce_min_density() 62 0.005917 0.006166 0.006431 0.18% Castro::swap_state_time_levels() 10 0.003559 0.004811 0.005046 0.14% Castro::finalize_advance() 10 0.002912 0.003377 0.003825 0.11% Castro::finalize_do_advance() 10 0.001508 0.00204 0.002341 0.06% Castro::buildMetrics() 1 0.001783 0.001853 0.00204 0.06% Castro::post_regrid() 1 0.001619 0.00167 0.001712 0.05% Amr::InitAmr() 1 0.0002701 0.000304 0.0004322 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.188e-05 0.0001426 0.0001732 0.00% DistributionMapping::LeastUsedCPUs() 1 7.131e-06 0.0001368 0.0001653 0.00% FabArrayBase::getCPC() 41 7.416e-05 8.923e-05 0.0001029 0.00% Castro::enforce_consistent_e() 1 8.015e-05 8.902e-05 9.56e-05 0.00% Amr::writeSmallPlotFile() 1 2.667e-05 6.217e-05 8.467e-05 0.00% FabArrayBase::CPC::define() 2 1.98e-05 2.604e-05 3.914e-05 0.00% Castro::enforce_speed_limit() 62 2.626e-05 3.034e-05 3.373e-05 0.00% Gravity::swapTimeLevels() 10 1.057e-05 1.263e-05 1.595e-05 0.00% Gravity::set_mass_offset() 10 8.876e-06 1.06e-05 1.285e-05 0.00% Castro::create_source_corrector() 10 8.352e-06 9.694e-06 1.167e-05 0.00% Amr::initSubcycle() 1 9.104e-06 9.663e-06 1.076e-05 0.00% Castro::FluxRegCrseInit 10 7.233e-06 8.715e-06 9.919e-06 0.00% Castro::retry_advance_ctu() 10 4.538e-06 5.429e-06 6.091e-06 0.00% Castro::FluxRegFineAdd() 10 1.762e-06 2.143e-06 2.898e-06 0.00% DistributionMapping::Distribute() 1 9.97e-07 1.178e-06 1.729e-06 0.00% ------------------------------------------------------------------------------------------- Cpu (amrex_mempool) Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 27 B 31 B 36 B 8192 KiB 8192 KiB 8192 KiB amrex_mempool_init() 8 8 15 KiB 15 KiB 17 KiB 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] AMReX (23.02-50-g32a65ffa8aba) finalized