MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.07-35-g0eb494d34427) initialized Starting run at 05:28:38 UTC on 2023-07-24. Successfully read inputs file ... Castro git describe: 23.07-18-g440d64b97 AMReX git describe: 23.07-35-g0eb494d34 Microphysics git describe: 23.07-47-geb5189fa reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.016911764 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.363780557 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.344849721 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.341477379 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.337512524 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.36110584 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.351071003 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.313962117 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.3147629 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.314521724 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.31416252 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010233457 seconds Ending run at 05:28:42 UTC on 2023-07-24. Run time = 3.55740087 Run time without initialization = 3.375416667 Average number of zones advanced per microsecond: 0.777 Average number of zones advanced per microsecond per rank: 0.097 TinyProfiler total time across processes [min...avg...max]: 3.556 ... 3.557 ... 3.557 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2823 2.3773 2.4156 67.90% Gravity::make_radial_gravity() 21 0.315 0.3237 0.3442 9.67% check_for_negative_density() 10 0.01509 0.05563 0.1539 4.33% Castro::estTimeStep() 21 0.02071 0.07015 0.1131 3.18% Castro::initData() 1 0.04032 0.07739 0.1128 3.17% amrex::Copy() 193 0.06438 0.07932 0.09084 2.55% FabArray::ParallelCopy_finish() 41 0.03572 0.06297 0.09037 2.54% FabArray::setVal() 143 0.06297 0.07507 0.09008 2.53% Castro::reset_internal_energy(Fab) 1008 0.0485 0.04979 0.05181 1.46% FabArray::ParallelCopy_nowait() 41 0.03522 0.04218 0.04439 1.25% Castro::normalize_species() 62 0.04106 0.04228 0.04424 1.24% StateData::FillBoundary(geom) 41 0.03431 0.03742 0.04027 1.13% FillPatchIterator::Initialize 41 0.03006 0.03561 0.0398 1.12% Gravity::interpolate_monopole_grav() 21 0.02791 0.02887 0.03117 0.88% Castro::construct_new_gravity_source() 10 0.0221 0.02565 0.03088 0.87% Castro::initialize_do_advance() 10 0.01253 0.01861 0.02277 0.64% Castro::computeTemp() 63 0.01943 0.01971 0.02003 0.56% VisMF::Write(FabArray) 2 0.01369 0.01426 0.01729 0.49% Castro::initialize_advance() 10 0.009577 0.01175 0.01535 0.43% FabArray::Saxpy() 20 0.01054 0.0133 0.01465 0.41% FabArray::setDomainBndry() 41 0.008776 0.01182 0.01282 0.36% Amr::writePlotFile() 2 0.007756 0.01099 0.0118 0.33% MultiFab::contains_nan() 20 0.009654 0.01068 0.01173 0.33% Castro::construct_old_gravity_source() 10 0.007138 0.009719 0.01029 0.29% Castro::initMFs() 1 0.00708 0.007365 0.009243 0.26% main() 1 0.005945 0.006623 0.007234 0.20% StateData::define() 4 0.005944 0.006074 0.006773 0.19% Castro::construct_new_source() 50 0.005496 0.006197 0.006389 0.18% Castro::enforce_min_density() 62 0.00573 0.005988 0.00626 0.18% Castro::swap_state_time_levels() 10 0.002815 0.004589 0.00487 0.14% Gravity::get_new_grav_vector() 11 0.002764 0.003728 0.004135 0.12% Amr::coarseTimeStep() 10 0.001471 0.002546 0.003513 0.10% Gravity::get_old_grav_vector() 10 0.001372 0.002065 0.002429 0.07% Castro::finalize_do_advance() 10 0.0008392 0.001625 0.002011 0.06% Castro::buildMetrics() 1 0.001663 0.001712 0.001948 0.05% AmrLevel::FillPatch() 41 0.001086 0.001413 0.001523 0.04% Amr::InitAmr() 1 0.000267 0.0003004 0.0004183 0.01% Amr::timeStep() 10 0.0001689 0.0002308 0.0004031 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002887 0.0002989 0.0003066 0.01% Castro::do_advance_ctu() 10 0.0001425 0.0001864 0.0002211 0.01% Castro::clean_state() 62 0.0001298 0.0001415 0.0001546 0.00% FillPatchIterator::FillFromLevel0() 41 0.0001026 0.0001172 0.0001434 0.00% DistributionMapping::LeastUsedCPUs() 1 6.013e-06 0.0001165 0.0001366 0.00% Castro::finalize_advance() 10 8.319e-05 9.85e-05 0.0001261 0.00% StateDataPhysBCFunct::() 41 8.136e-05 0.0001011 0.0001203 0.00% Castro::Castro() 1 6.249e-05 7.793e-05 0.0001039 0.00% Castro::do_old_sources() 10 7.216e-05 9.117e-05 0.0001034 0.00% Castro::enforce_consistent_e() 1 7.559e-05 8.571e-05 0.0001004 0.00% Castro::construct_old_source() 50 5.369e-05 7.451e-05 8.635e-05 0.00% FabArray::ParallelCopy() 41 6.183e-05 7.08e-05 8.542e-05 0.00% Amr::FinalizeInit() 1 4.173e-06 1.486e-05 7.701e-05 0.00% Castro::do_new_sources() 10 5.06e-05 6.298e-05 7.275e-05 0.00% FillPatchSingleLevel 41 5.814e-05 6.456e-05 7.09e-05 0.00% Castro::subcycle_advance_ctu() 10 4.475e-05 5.146e-05 6.198e-05 0.00% Castro::advance() 10 4.105e-05 4.934e-05 6.116e-05 0.00% Amr::defBaseLevel() 1 2.635e-05 3.844e-05 5.919e-05 0.00% FabArrayBase::getCPC() 41 4.476e-05 4.933e-05 5.728e-05 0.00% Amr::writeSmallPlotFile() 1 2.705e-05 4.495e-05 5.477e-05 0.00% Castro::apply_source_to_state() 20 3.801e-05 4.33e-05 5.359e-05 0.00% Castro::construct_old_gravity() 10 4.142e-05 4.656e-05 5.193e-05 0.00% Castro::construct_new_gravity() 10 3.507e-05 4.022e-05 5.045e-05 0.00% FabArrayBase::CPC::define() 2 2.014e-05 2.834e-05 3.599e-05 0.00% Castro::expand_state() 10 1.993e-05 2.48e-05 3.249e-05 0.00% Castro::enforce_speed_limit() 62 2.71e-05 2.953e-05 3.243e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.401e-05 2.485e-05 3.119e-05 0.00% Castro::check_for_nan() 20 2.201e-05 2.328e-05 2.465e-05 0.00% Gravity::swapTimeLevels() 10 1.145e-05 1.459e-05 1.696e-05 0.00% Castro::post_timestep() 10 1.334e-05 1.45e-05 1.568e-05 0.00% Castro::computeNewDt() 9 9.061e-06 1.112e-05 1.321e-05 0.00% Gravity::set_mass_offset() 10 9.709e-06 1.101e-05 1.257e-05 0.00% Amr::initSubcycle() 1 8.609e-06 9.249e-06 9.759e-06 0.00% Castro::create_source_corrector() 10 6.875e-06 8.495e-06 9.713e-06 0.00% Castro::retry_advance_ctu() 10 6.788e-06 8.061e-06 9.15e-06 0.00% Castro::FluxRegCrseInit 10 5.768e-06 6.91e-06 7.788e-06 0.00% Amr::initialInit() 1 1.108e-06 2.453e-06 7.62e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.654e-06 5.313e-06 6.933e-06 0.00% Castro::computeInitialDt() 2 3.915e-06 4.697e-06 5.875e-06 0.00% Castro::post_init() 1 2.847e-06 3.96e-06 4.865e-06 0.00% Amr::InitializeInit() 1 1.804e-06 2.486e-06 4.639e-06 0.00% Castro::post_regrid() 1 2.177e-06 3.405e-06 4.427e-06 0.00% Castro::FluxRegFineAdd() 10 1.859e-06 2.325e-06 2.96e-06 0.00% Amr::init() 1 2.027e-06 2.399e-06 2.938e-06 0.00% DistributionMapping::Distribute() 1 8.72e-07 9.993e-07 1.17e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.556 3.557 3.557 100.00% Amr::coarseTimeStep() 10 3.358 3.358 3.358 94.39% Amr::timeStep() 10 3.345 3.346 3.347 94.08% Castro::advance() 10 3.329 3.33 3.331 93.62% Castro::subcycle_advance_ctu() 10 3.238 3.249 3.256 91.54% Castro::do_advance_ctu() 10 3.238 3.249 3.256 91.53% Castro::construct_ctu_hydro_source() 10 2.451 2.454 2.457 69.06% Gravity::make_radial_gravity() 21 0.3327 0.3406 0.3578 10.06% AmrLevel::FillPatch() 41 0.201 0.2219 0.2416 6.79% Gravity::get_new_grav_vector() 11 0.2291 0.2307 0.2314 6.50% Castro::construct_old_gravity() 10 0.1926 0.1996 0.2141 6.02% Gravity::get_old_grav_vector() 10 0.192 0.1988 0.2136 6.00% FillPatchIterator::Initialize 41 0.1703 0.1904 0.2081 5.85% Castro::construct_new_gravity() 10 0.2038 0.2051 0.2057 5.78% Castro::initialize_do_advance() 10 0.1703 0.1832 0.1968 5.53% Amr::init() 1 0.1814 0.1815 0.1816 5.10% Amr::initialInit() 1 0.1634 0.1638 0.1643 4.62% FillPatchIterator::FillFromLevel0() 41 0.1185 0.143 0.1603 4.51% FillPatchSingleLevel 41 0.1184 0.1429 0.1602 4.50% check_for_negative_density() 10 0.01509 0.05563 0.1539 4.33% Castro::expand_state() 10 0.1126 0.1273 0.1416 3.98% Amr::InitializeInit() 1 0.06207 0.0995 0.1347 3.79% Amr::defBaseLevel() 1 0.06207 0.0995 0.1347 3.79% FabArray::ParallelCopy() 41 0.07958 0.1053 0.1257 3.53% Castro::clean_state() 62 0.1147 0.1173 0.1212 3.41% Castro::initData() 1 0.04431 0.0814 0.1169 3.29% Castro::estTimeStep() 21 0.02071 0.07015 0.1131 3.18% Amr::FinalizeInit() 1 0.02951 0.06426 0.1023 2.87% Castro::do_old_sources() 10 0.09343 0.09633 0.1009 2.84% amrex::Copy() 193 0.06438 0.07932 0.09084 2.55% FabArray::ParallelCopy_finish() 41 0.03572 0.06297 0.09037 2.54% FabArray::setVal() 143 0.06297 0.07507 0.09008 2.53% Castro::initialize_advance() 10 0.06976 0.07718 0.0881 2.48% Castro::do_new_sources() 10 0.05915 0.06831 0.08192 2.30% Castro::computeInitialDt() 2 0.002183 0.03734 0.07465 2.10% Castro::computeTemp() 63 0.06837 0.0698 0.07209 2.03% Castro::reset_internal_energy(MultiFab) 63 0.04881 0.05008 0.05212 1.46% Castro::reset_internal_energy(Fab) 1008 0.0485 0.04979 0.05181 1.46% FabArray::ParallelCopy_nowait() 41 0.03531 0.04225 0.04445 1.25% Castro::normalize_species() 62 0.04106 0.04228 0.04424 1.24% StateDataPhysBCFunct::() 41 0.03441 0.03752 0.04038 1.14% StateData::FillBoundary(geom) 41 0.03431 0.03742 0.04027 1.13% Castro::construct_new_source() 50 0.02824 0.03185 0.03727 1.05% Castro::finalize_do_advance() 10 0.01167 0.02605 0.03571 1.00% Gravity::interpolate_monopole_grav() 21 0.02791 0.02887 0.03117 0.88% Castro::construct_new_gravity_source() 10 0.0221 0.02565 0.03088 0.87% Amr::writePlotFile() 2 0.02742 0.02809 0.02848 0.80% Castro::post_init() 1 0.02612 0.02654 0.0271 0.76% VisMF::Write(FabArray) 2 0.01369 0.01426 0.01729 0.49% Castro::post_timestep() 10 0.0156 0.01591 0.01625 0.46% Castro::apply_source_to_state() 20 0.01058 0.01334 0.0147 0.41% FabArray::Saxpy() 20 0.01054 0.0133 0.01465 0.41% FabArray::setDomainBndry() 41 0.008776 0.01182 0.01282 0.36% Castro::Castro() 1 0.01163 0.01184 0.01275 0.36% Castro::check_for_nan() 20 0.009676 0.01071 0.01175 0.33% MultiFab::contains_nan() 20 0.009654 0.01068 0.01173 0.33% Castro::construct_old_source() 50 0.007192 0.009794 0.01036 0.29% Castro::construct_old_gravity_source() 10 0.007138 0.009719 0.01029 0.29% Castro::initMFs() 1 0.00708 0.007365 0.009243 0.26% Castro::computeNewDt() 9 0.008394 0.008399 0.008414 0.24% AmrLevel::AmrLevel(dm) 1 0.005958 0.006099 0.006802 0.19% StateData::define() 4 0.005944 0.006074 0.006773 0.19% Castro::enforce_min_density() 62 0.00573 0.005988 0.00626 0.18% Castro::swap_state_time_levels() 10 0.002815 0.004589 0.00487 0.14% Castro::finalize_advance() 10 0.002915 0.003779 0.004718 0.13% Castro::buildMetrics() 1 0.001792 0.001853 0.002112 0.06% Castro::post_regrid() 1 0.001506 0.0016 0.001655 0.05% Amr::InitAmr() 1 0.0002764 0.0003096 0.0004271 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.054e-05 0.0001229 0.0001443 0.00% DistributionMapping::LeastUsedCPUs() 1 6.013e-06 0.0001165 0.0001366 0.00% Castro::enforce_consistent_e() 1 7.559e-05 8.571e-05 0.0001004 0.00% FabArrayBase::getCPC() 41 6.491e-05 7.768e-05 9.324e-05 0.00% Amr::writeSmallPlotFile() 1 2.705e-05 4.495e-05 5.477e-05 0.00% FabArrayBase::CPC::define() 2 2.014e-05 2.834e-05 3.599e-05 0.00% Castro::enforce_speed_limit() 62 2.71e-05 2.953e-05 3.243e-05 0.00% Gravity::swapTimeLevels() 10 1.145e-05 1.459e-05 1.696e-05 0.00% Gravity::set_mass_offset() 10 9.709e-06 1.101e-05 1.257e-05 0.00% Amr::initSubcycle() 1 8.609e-06 9.249e-06 9.759e-06 0.00% Castro::create_source_corrector() 10 6.875e-06 8.495e-06 9.713e-06 0.00% Castro::retry_advance_ctu() 10 6.788e-06 8.061e-06 9.15e-06 0.00% Castro::FluxRegCrseInit 10 5.768e-06 6.91e-06 7.788e-06 0.00% Castro::FluxRegFineAdd() 10 1.859e-06 2.325e-06 2.96e-06 0.00% DistributionMapping::Distribute() 1 8.72e-07 9.993e-07 1.17e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 30 B 34 B 38 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.07-35-g0eb494d34427) finalized