MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.04-28-g9718b9c135ed) initialized Starting run at 05:37:49 UTC on 2023-04-24. Successfully read inputs file ... Castro git describe: 23.04-16-gb19bc8626 AMReX git describe: 23.04-28-g9718b9c13 Microphysics git describe: 23.04-4-gabda4ae3 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.015249605 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.358891871 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.345942445 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.338416753 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.337157733 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.36237607 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.352046625 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.316844671 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.315971598 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.31626651 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.315249961 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010152028 seconds Ending run at 05:37:52 UTC on 2023-04-24. Run time = 3.571579086 Run time without initialization = 3.376860078 Average number of zones advanced per microsecond: 0.776 Average number of zones advanced per microsecond per rank: 0.097 TinyProfiler total time across processes [min...avg...max]: 3.57 ... 3.571 ... 3.572 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2396 2.3560 2.4362 68.21% Gravity::make_radial_gravity() 21 0.3231 0.3292 0.3455 9.67% Castro::do_advance_ctu() 10 0.01025 0.09103 0.2107 5.90% Castro::estTimeStep() 21 0.04019 0.08109 0.1293 3.62% Castro::initData() 1 0.04138 0.08146 0.1272 3.56% FabArray::ParallelCopy_finish() 41 0.03641 0.05919 0.09209 2.58% FabArray::setVal() 143 0.06214 0.07219 0.08586 2.40% amrex::Copy() 193 0.06044 0.07172 0.07921 2.22% Castro::reset_internal_energy(Fab) 1008 0.0491 0.04966 0.05118 1.43% Castro::normalize_species() 62 0.04176 0.04234 0.04303 1.20% FabArray::ParallelCopy_nowait() 41 0.03572 0.04078 0.04197 1.18% StateData::FillBoundary(geom) 41 0.0321 0.03598 0.0392 1.10% FillPatchIterator::Initialize 41 0.02851 0.03364 0.0381 1.07% Castro::construct_new_gravity_source() 10 0.02278 0.026 0.0309 0.87% Gravity::interpolate_monopole_grav() 21 0.0277 0.0289 0.03046 0.85% Castro::initialize_do_advance() 10 0.01184 0.01787 0.02288 0.64% Castro::computeTemp() 63 0.01875 0.01972 0.02044 0.57% VisMF::Write(FabArray) 2 0.01286 0.01379 0.01635 0.46% FabArray::Saxpy() 20 0.01237 0.01447 0.01615 0.45% Castro::initialize_advance() 10 0.004122 0.01034 0.01444 0.40% MultiFab::contains_nan() 20 0.01089 0.01209 0.01285 0.36% FabArray::setDomainBndry() 41 0.008536 0.01119 0.01254 0.35% Amr::writePlotFile() 2 0.006564 0.009371 0.0115 0.32% Castro::construct_old_gravity_source() 10 0.00743 0.01013 0.01078 0.30% Castro::initMFs() 1 0.007427 0.007933 0.008482 0.24% StateData::define() 4 0.005985 0.006382 0.006822 0.19% main() 1 0.005318 0.006328 0.0068 0.19% Castro::construct_new_source() 50 0.005579 0.006172 0.006405 0.18% Castro::enforce_min_density() 62 0.005713 0.005987 0.006364 0.18% Castro::swap_state_time_levels() 10 0.003367 0.004436 0.004817 0.13% Amr::coarseTimeStep() 10 0.001797 0.003008 0.00411 0.12% Gravity::get_new_grav_vector() 11 0.003014 0.003589 0.003913 0.11% Gravity::get_old_grav_vector() 10 0.00185 0.002248 0.002617 0.07% Castro::finalize_do_advance() 10 0.0005828 0.001745 0.002179 0.06% Castro::buildMetrics() 1 0.001721 0.001831 0.001959 0.05% Castro::expand_state() 10 0.0006407 0.0009056 0.001039 0.03% Amr::InitAmr() 1 0.0002839 0.0003233 0.000439 0.01% Amr::timeStep() 10 0.0001893 0.0002411 0.0003918 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002882 0.0003049 0.000329 0.01% Castro::clean_state() 62 0.0001403 0.0001532 0.0001913 0.01% DistributionMapping::LeastUsedCPUs() 1 6.826e-06 0.0001165 0.0001462 0.00% StateDataPhysBCFunct::() 41 9.041e-05 0.000107 0.0001307 0.00% Castro::finalize_advance() 10 9.785e-05 0.0001076 0.0001228 0.00% Castro::enforce_consistent_e() 1 8.307e-05 9.179e-05 0.0001092 0.00% Amr::FinalizeInit() 1 3.939e-06 1.529e-05 9.055e-05 0.00% Castro::do_new_sources() 10 5.432e-05 6.533e-05 7.973e-05 0.00% FillPatchSingleLevel 41 6.568e-05 7.022e-05 7.765e-05 0.00% Castro::construct_old_source() 50 4.397e-05 6.401e-05 7.718e-05 0.00% Castro::Castro() 1 5.993e-05 6.563e-05 7.319e-05 0.00% FabArrayBase::getCPC() 41 4.304e-05 5.921e-05 7.221e-05 0.00% FabArray::ParallelCopy() 41 6.513e-05 6.816e-05 7.075e-05 0.00% Amr::writeSmallPlotFile() 1 2.515e-05 4.924e-05 6.815e-05 0.00% Castro::do_old_sources() 10 4.89e-05 5.97e-05 6.631e-05 0.00% Castro::apply_source_to_state() 20 4.058e-05 4.682e-05 5.572e-05 0.00% Castro::subcycle_advance_ctu() 10 4.082e-05 4.436e-05 4.947e-05 0.00% Castro::construct_new_gravity() 10 3.599e-05 4.148e-05 4.941e-05 0.00% Castro::advance() 10 3.584e-05 4.07e-05 4.599e-05 0.00% Castro::construct_old_gravity() 10 3.662e-05 4.046e-05 4.435e-05 0.00% AmrLevel::AmrLevel(dm) 1 2.358e-05 2.896e-05 3.394e-05 0.00% FabArrayBase::CPC::define() 2 2.004e-05 2.378e-05 2.81e-05 0.00% Castro::enforce_speed_limit() 62 2.34e-05 2.597e-05 2.804e-05 0.00% Amr::defBaseLevel() 1 1.789e-05 2.143e-05 2.642e-05 0.00% Castro::check_for_nan() 20 2.212e-05 2.382e-05 2.641e-05 0.00% Gravity::swapTimeLevels() 10 1.013e-05 1.302e-05 1.706e-05 0.00% Castro::post_timestep() 10 1.368e-05 1.497e-05 1.594e-05 0.00% Gravity::set_mass_offset() 10 9.056e-06 1.133e-05 1.335e-05 0.00% Castro::computeNewDt() 9 9.703e-06 1.149e-05 1.311e-05 0.00% Castro::create_source_corrector() 10 7.72e-06 9.496e-06 1.171e-05 0.00% Amr::initSubcycle() 1 8.831e-06 9.758e-06 1.045e-05 0.00% Castro::FluxRegCrseInit 10 7.033e-06 8.704e-06 9.425e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.738e-06 4.889e-06 6.903e-06 0.00% Castro::retry_advance_ctu() 10 4.59e-06 5.323e-06 5.815e-06 0.00% Amr::InitializeInit() 1 1.865e-06 2.514e-06 4.824e-06 0.00% Castro::post_init() 1 2.7e-06 3.367e-06 4.409e-06 0.00% Castro::computeInitialDt() 2 3.252e-06 3.714e-06 4.027e-06 0.00% Castro::post_regrid() 1 1.954e-06 2.758e-06 3.904e-06 0.00% Amr::init() 1 2.022e-06 2.432e-06 2.887e-06 0.00% Castro::FluxRegFineAdd() 10 1.862e-06 2.356e-06 2.802e-06 0.00% Amr::initialInit() 1 1.307e-06 1.766e-06 2.5e-06 0.00% DistributionMapping::Distribute() 1 7.8e-07 9.925e-07 1.172e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.57 3.571 3.572 100.00% Amr::coarseTimeStep() 10 3.36 3.36 3.36 94.07% Amr::timeStep() 10 3.346 3.347 3.349 93.75% Castro::advance() 10 3.33 3.331 3.332 93.29% Castro::subcycle_advance_ctu() 10 3.242 3.254 3.262 91.32% Castro::do_advance_ctu() 10 3.242 3.254 3.262 91.32% Castro::construct_ctu_hydro_source() 10 2.24 2.356 2.436 68.21% Gravity::make_radial_gravity() 21 0.3392 0.3456 0.3586 10.04% Gravity::get_new_grav_vector() 11 0.2287 0.2298 0.2309 6.46% Castro::construct_old_gravity() 10 0.1964 0.2027 0.2133 5.97% Gravity::get_old_grav_vector() 10 0.1957 0.2018 0.2127 5.96% Castro::construct_new_gravity() 10 0.2045 0.2052 0.2057 5.76% FillPatchIterator::Initialize 41 0.1623 0.1811 0.1973 5.52% Amr::init() 1 0.1941 0.1942 0.1943 5.44% Castro::initialize_do_advance() 10 0.159 0.1723 0.1846 5.17% Amr::initialInit() 1 0.1784 0.1787 0.179 5.01% FillPatchSingleLevel 41 0.1138 0.1363 0.1603 4.49% Amr::InitializeInit() 1 0.06335 0.1041 0.1507 4.22% Amr::defBaseLevel() 1 0.06335 0.1041 0.1507 4.22% Castro::expand_state() 10 0.1085 0.1241 0.1368 3.83% Castro::initData() 1 0.04584 0.0855 0.131 3.67% Castro::estTimeStep() 21 0.04019 0.08109 0.1293 3.62% FabArray::ParallelCopy() 41 0.07852 0.1001 0.128 3.58% Castro::clean_state() 62 0.1154 0.1172 0.1188 3.33% Amr::FinalizeInit() 1 0.02771 0.07463 0.1156 3.24% FabArray::ParallelCopy_finish() 41 0.03641 0.05919 0.09209 2.58% Castro::computeInitialDt() 2 0.001952 0.04859 0.08934 2.50% FabArray::setVal() 143 0.06214 0.07219 0.08586 2.40% Castro::initialize_advance() 10 0.06446 0.0736 0.08445 2.36% Castro::do_new_sources() 10 0.05931 0.06809 0.08072 2.26% amrex::Copy() 193 0.06044 0.07172 0.07921 2.22% Castro::computeTemp() 63 0.06838 0.06969 0.07179 2.01% Castro::reset_internal_energy(MultiFab) 63 0.04942 0.04997 0.05148 1.44% Castro::reset_internal_energy(Fab) 1008 0.0491 0.04966 0.05118 1.43% Castro::do_old_sources() 10 0.04007 0.04495 0.04621 1.29% Castro::normalize_species() 62 0.04176 0.04234 0.04303 1.20% FabArray::ParallelCopy_nowait() 41 0.03582 0.04086 0.04205 1.18% StateDataPhysBCFunct::() 41 0.03222 0.03609 0.03929 1.10% StateData::FillBoundary(geom) 41 0.0321 0.03598 0.0392 1.10% Castro::construct_new_source() 50 0.02894 0.03217 0.03725 1.04% Castro::construct_new_gravity_source() 10 0.02278 0.026 0.0309 0.87% Gravity::interpolate_monopole_grav() 21 0.0277 0.0289 0.03046 0.85% Amr::writePlotFile() 2 0.02555 0.02577 0.02605 0.73% Castro::post_init() 1 0.02528 0.02553 0.02574 0.72% Castro::post_timestep() 10 0.01577 0.01613 0.01697 0.48% VisMF::Write(FabArray) 2 0.01286 0.01379 0.01635 0.46% Castro::apply_source_to_state() 20 0.01242 0.01452 0.01621 0.45% FabArray::Saxpy() 20 0.01237 0.01447 0.01615 0.45% Castro::check_for_nan() 20 0.01092 0.01211 0.01288 0.36% MultiFab::contains_nan() 20 0.01089 0.01209 0.01285 0.36% Castro::Castro() 1 0.01128 0.01201 0.01278 0.36% FabArray::setDomainBndry() 41 0.008536 0.01119 0.01254 0.35% Castro::construct_old_source() 50 0.007474 0.01019 0.01084 0.30% Castro::construct_old_gravity_source() 10 0.00743 0.01013 0.01078 0.30% Castro::computeNewDt() 9 0.008532 0.008542 0.008549 0.24% Castro::initMFs() 1 0.007427 0.007933 0.008482 0.24% AmrLevel::AmrLevel(dm) 1 0.006015 0.006411 0.006856 0.19% StateData::define() 4 0.005985 0.006382 0.006822 0.19% Castro::enforce_min_density() 62 0.005713 0.005987 0.006364 0.18% Castro::swap_state_time_levels() 10 0.003367 0.004436 0.004817 0.13% Castro::finalize_advance() 10 0.002928 0.003738 0.004558 0.13% Castro::finalize_do_advance() 10 0.0005828 0.001745 0.002179 0.06% Castro::buildMetrics() 1 0.001856 0.001983 0.002124 0.06% Castro::post_regrid() 1 0.001365 0.001561 0.001657 0.05% Amr::InitAmr() 1 0.0002936 0.000333 0.0004482 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.137e-05 0.0001224 0.0001542 0.00% DistributionMapping::LeastUsedCPUs() 1 6.826e-06 0.0001165 0.0001462 0.00% Castro::enforce_consistent_e() 1 8.307e-05 9.179e-05 0.0001092 0.00% FabArrayBase::getCPC() 41 6.586e-05 8.3e-05 9.516e-05 0.00% Amr::writeSmallPlotFile() 1 2.515e-05 4.924e-05 6.815e-05 0.00% FabArrayBase::CPC::define() 2 2.004e-05 2.378e-05 2.81e-05 0.00% Castro::enforce_speed_limit() 62 2.34e-05 2.597e-05 2.804e-05 0.00% Gravity::swapTimeLevels() 10 1.013e-05 1.302e-05 1.706e-05 0.00% Gravity::set_mass_offset() 10 9.056e-06 1.133e-05 1.335e-05 0.00% Castro::create_source_corrector() 10 7.72e-06 9.496e-06 1.171e-05 0.00% Amr::initSubcycle() 1 8.831e-06 9.758e-06 1.045e-05 0.00% Castro::FluxRegCrseInit 10 7.033e-06 8.704e-06 9.425e-06 0.00% Castro::retry_advance_ctu() 10 4.59e-06 5.323e-06 5.815e-06 0.00% Castro::FluxRegFineAdd() 10 1.862e-06 2.356e-06 2.802e-06 0.00% DistributionMapping::Distribute() 1 7.8e-07 9.925e-07 1.172e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 30 B 34 B 40 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.04-28-g9718b9c135ed) finalized