Initializing AMReX (24.01-31-gab99ea69089f)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.01-31-gab99ea69089f) initialized Starting run at 06:32:46 UTC on 2024-01-30. Successfully read inputs file ... Castro git describe: 24.01-24-g6d8abef7c AMReX git describe: 24.01-31-gab99ea690 Microphysics git describe: 24.01-19-g6d5a4e1a reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.490422151 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.339696123 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.321270721 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.319729285 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.329060873 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.339522287 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.33760841 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.313148732 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.308052703 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.3085858 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.30848799 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.007517293 seconds Ending run at 06:32:50 UTC on 2024-01-30. Run time = 3.895915019 Run time without initialization = 3.238026212 Average number of zones advanced per microsecond: 0.810 Average number of zones advanced per microsecond per rank: 0.101 TinyProfiler total time across processes [min...avg...max]: 3.895 ... 3.895 ... 3.896 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.3073 2.3281 2.3440 60.16% Amr::writePlotFile() 2 0.4343 0.4557 0.487 12.50% Gravity::make_radial_gravity() 21 0.2893 0.2942 0.3004 7.71% Castro::initData() 1 0.04738 0.08666 0.12 3.08% Castro::estTimeStep() 21 0.03674 0.0717 0.1124 2.88% check_for_negative_density() 10 0.03987 0.05638 0.07874 2.02% FabArray::setVal() 143 0.06188 0.06858 0.07658 1.97% amrex::Copy() 193 0.06466 0.06831 0.07572 1.94% FabArray::ParallelCopy_finish() 41 0.04956 0.05797 0.06512 1.67% VisMF::Write(FabArray) 2 0.008488 0.03982 0.06117 1.57% Castro::reset_internal_energy(Fab) 1008 0.04539 0.04725 0.04922 1.26% Castro::normalize_species() 62 0.04088 0.04187 0.04402 1.13% FabArray::ParallelCopy_nowait() 41 0.03626 0.038 0.03957 1.02% StateData::FillBoundary(geom) 41 0.03003 0.03115 0.03264 0.84% FillPatchIterator::Initialize 41 0.02791 0.03005 0.03249 0.83% Gravity::interpolate_monopole_grav() 21 0.02784 0.0291 0.0297 0.76% Castro::construct_new_gravity_source() 10 0.02011 0.02136 0.02498 0.64% Castro::computeTemp() 63 0.019 0.01951 0.02017 0.52% Castro::initialize_do_advance() 10 0.01245 0.01466 0.01663 0.43% Castro::initialize_advance() 10 0.009187 0.01178 0.01428 0.37% FabArray::Saxpy() 20 0.0104 0.01118 0.01175 0.30% FabArray::setDomainBndry() 41 0.006822 0.008281 0.0111 0.28% MultiFab::contains_nan() 20 0.00916 0.009956 0.01085 0.28% Castro::construct_old_gravity_source() 10 0.006828 0.008364 0.009417 0.24% Castro::initMFs() 1 0.006227 0.006667 0.007846 0.20% Castro::enforce_min_density() 62 0.005635 0.005884 0.006176 0.16% Castro::construct_new_source() 50 0.005338 0.005758 0.005948 0.15% StateData::define() 4 0.005181 0.005416 0.005903 0.15% main() 1 0.003317 0.004024 0.004609 0.12% Castro::swap_state_time_levels() 10 0.003375 0.003962 0.004301 0.11% Gravity::get_new_grav_vector() 11 0.002972 0.003247 0.003512 0.09% Amr::coarseTimeStep() 10 0.000955 0.002692 0.00343 0.09% Gravity::get_old_grav_vector() 10 0.001601 0.001802 0.001991 0.05% Castro::buildMetrics() 1 0.001497 0.001552 0.001689 0.04% AmrLevel::FillPatch() 41 0.0007066 0.0008273 0.0009472 0.02% Castro::finalize_do_advance() 10 0.0007455 0.0008134 0.0008905 0.02% Amr::InitAmr() 1 0.0003547 0.0003829 0.0004943 0.01% Amr::timeStep() 10 0.0001623 0.000234 0.0004178 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002767 0.0002901 0.0003141 0.01% Castro::clean_state() 62 0.0001353 0.0001576 0.0002275 0.01% Castro::do_advance_ctu() 10 0.0001333 0.0001551 0.0001754 0.00% FillPatchIterator::FillFromLevel0() 41 9.237e-05 0.0001122 0.0001497 0.00% StateDataPhysBCFunct::() 41 8.925e-05 0.0001144 0.000148 0.00% DistributionMapping::LeastUsedCPUs() 1 8.096e-06 0.000113 0.0001417 0.00% Castro::finalize_advance() 10 8.201e-05 9.282e-05 0.0001129 0.00% Castro::do_old_sources() 10 8.307e-05 9.117e-05 0.0001039 0.00% Amr::FinalizeInit() 1 3.677e-06 1.63e-05 9.807e-05 0.00% Castro::enforce_consistent_e() 1 7.896e-05 8.654e-05 9.606e-05 0.00% FabArray::ParallelCopy() 41 7.266e-05 8.132e-05 9.504e-05 0.00% Castro::Castro() 1 5.808e-05 7.67e-05 9.04e-05 0.00% FillPatchSingleLevel 41 6.51e-05 7.255e-05 8.246e-05 0.00% Castro::construct_old_source() 50 6.139e-05 6.987e-05 8.225e-05 0.00% Castro::do_new_sources() 10 5.16e-05 5.986e-05 7.314e-05 0.00% Amr::writeSmallPlotFile() 1 3.298e-05 5.153e-05 7.134e-05 0.00% Castro::advance() 10 4.26e-05 4.955e-05 6.4e-05 0.00% Castro::subcycle_advance_ctu() 10 4.228e-05 5.19e-05 6.238e-05 0.00% FabArrayBase::getCPC() 41 4.078e-05 4.675e-05 5.756e-05 0.00% Castro::computeNewDt() 9 7.719e-06 1.966e-05 5.495e-05 0.00% Castro::construct_new_gravity() 10 3.137e-05 4.128e-05 5.396e-05 0.00% Castro::apply_source_to_state() 20 3.732e-05 4.728e-05 5.262e-05 0.00% Castro::construct_old_gravity() 10 3.253e-05 3.689e-05 4.106e-05 0.00% Castro::enforce_speed_limit() 62 2.497e-05 2.817e-05 3.095e-05 0.00% Castro::expand_state() 10 2.012e-05 2.283e-05 2.672e-05 0.00% FabArrayBase::CPC::define() 2 2.283e-05 2.397e-05 2.638e-05 0.00% Amr::defBaseLevel() 1 1.639e-05 2.044e-05 2.594e-05 0.00% Castro::check_for_nan() 20 2.018e-05 2.323e-05 2.58e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.646e-05 1.983e-05 2.316e-05 0.00% Castro::post_init() 1 1.44e-05 1.699e-05 2.018e-05 0.00% Gravity::set_mass_offset() 10 9.267e-06 1.273e-05 1.726e-05 0.00% Castro::post_timestep() 10 1.189e-05 1.376e-05 1.61e-05 0.00% Amr::initSubcycle() 1 9.377e-06 1.011e-05 1.119e-05 0.00% Gravity::swapTimeLevels() 10 7.671e-06 9.074e-06 1.104e-05 0.00% Castro::create_source_corrector() 10 7.511e-06 8.052e-06 8.864e-06 0.00% Castro::FluxRegCrseInit 10 5.972e-06 7.352e-06 8.077e-06 0.00% Castro::retry_advance_ctu() 10 6.394e-06 7.153e-06 7.946e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.529e-06 4.62e-06 5.514e-06 0.00% Amr::InitializeInit() 1 1.737e-06 2.269e-06 4.63e-06 0.00% Castro::computeInitialDt() 2 3.349e-06 4.005e-06 4.501e-06 0.00% Castro::post_regrid() 1 1.766e-06 3.442e-06 4.451e-06 0.00% Castro::FluxRegFineAdd() 10 2.092e-06 2.683e-06 3.569e-06 0.00% Amr::init() 1 1.994e-06 2.449e-06 3.447e-06 0.00% Amr::initialInit() 1 1.222e-06 1.783e-06 2.262e-06 0.00% DistributionMapping::Distribute() 1 8.79e-07 1.025e-06 1.366e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.895 3.895 3.896 100.00% Amr::coarseTimeStep() 10 3.226 3.226 3.226 82.80% Amr::timeStep() 10 3.208 3.209 3.211 82.42% Castro::advance() 10 3.192 3.193 3.195 82.01% Castro::subcycle_advance_ctu() 10 3.102 3.114 3.122 80.13% Castro::do_advance_ctu() 10 3.102 3.114 3.122 80.13% Castro::construct_ctu_hydro_source() 10 2.403 2.405 2.409 61.83% Amr::init() 1 0.6572 0.6573 0.6574 16.87% Amr::writePlotFile() 2 0.498 0.4982 0.4983 12.79% Gravity::make_radial_gravity() 21 0.3044 0.3095 0.3155 8.10% AmrLevel::FillPatch() 41 0.1794 0.1932 0.2075 5.33% Gravity::get_new_grav_vector() 11 0.202 0.2055 0.2069 5.31% Castro::construct_old_gravity() 10 0.1784 0.1843 0.1895 4.87% Gravity::get_old_grav_vector() 10 0.1778 0.1836 0.1886 4.84% Castro::construct_new_gravity() 10 0.1789 0.1822 0.1832 4.70% FillPatchIterator::Initialize 41 0.1533 0.1659 0.18 4.62% Castro::initialize_do_advance() 10 0.1476 0.1617 0.1747 4.48% Amr::initialInit() 1 0.1666 0.1668 0.1669 4.28% Amr::InitializeInit() 1 0.06732 0.1069 0.1401 3.60% Amr::defBaseLevel() 1 0.06732 0.1069 0.1401 3.60% FillPatchIterator::FillFromLevel0() 41 0.1179 0.1276 0.137 3.52% FillPatchSingleLevel 41 0.1178 0.1275 0.1369 3.51% Castro::initData() 1 0.05136 0.09062 0.1241 3.18% Castro::expand_state() 10 0.1002 0.1115 0.1232 3.16% Castro::clean_state() 62 0.1105 0.1141 0.1191 3.06% Castro::estTimeStep() 21 0.03674 0.0717 0.1124 2.88% FabArray::ParallelCopy() 41 0.08646 0.09612 0.1041 2.67% Amr::FinalizeInit() 1 0.02662 0.0599 0.0996 2.56% Castro::do_old_sources() 10 0.08494 0.08778 0.08929 2.29% Castro::initialize_advance() 10 0.06828 0.07544 0.08723 2.24% check_for_negative_density() 10 0.03987 0.05638 0.07874 2.02% FabArray::setVal() 143 0.06188 0.06858 0.07658 1.97% amrex::Copy() 193 0.06466 0.06831 0.07572 1.94% Castro::computeInitialDt() 2 0.002291 0.03554 0.07512 1.93% Castro::computeTemp() 63 0.06468 0.06705 0.06963 1.79% FabArray::ParallelCopy_finish() 41 0.04956 0.05797 0.06512 1.67% Castro::do_new_sources() 10 0.05374 0.05672 0.06463 1.66% VisMF::Write(FabArray) 2 0.008488 0.03982 0.06117 1.57% Castro::reset_internal_energy(MultiFab) 63 0.04567 0.04754 0.04953 1.27% Castro::reset_internal_energy(Fab) 1008 0.04539 0.04725 0.04922 1.26% Castro::normalize_species() 62 0.04088 0.04187 0.04402 1.13% FabArray::ParallelCopy_nowait() 41 0.03633 0.03808 0.03963 1.02% StateDataPhysBCFunct::() 41 0.03017 0.03126 0.03274 0.84% StateData::FillBoundary(geom) 41 0.03003 0.03115 0.03264 0.84% Castro::construct_new_source() 50 0.02582 0.02712 0.03085 0.79% Gravity::interpolate_monopole_grav() 21 0.02784 0.0291 0.0297 0.76% Castro::finalize_do_advance() 10 0.01577 0.02425 0.02767 0.71% Castro::construct_new_gravity_source() 10 0.02011 0.02136 0.02498 0.64% Castro::post_init() 1 0.02384 0.02407 0.02427 0.62% Castro::post_timestep() 10 0.01519 0.01568 0.01615 0.41% Castro::computeNewDt() 9 0.01144 0.01275 0.01399 0.36% Castro::apply_source_to_state() 20 0.01045 0.01123 0.0118 0.30% FabArray::Saxpy() 20 0.0104 0.01118 0.01175 0.30% Castro::Castro() 1 0.01027 0.01068 0.01152 0.30% FabArray::setDomainBndry() 41 0.006822 0.008281 0.0111 0.28% Castro::check_for_nan() 20 0.009183 0.009979 0.01088 0.28% MultiFab::contains_nan() 20 0.00916 0.009956 0.01085 0.28% Castro::construct_old_source() 50 0.00689 0.008434 0.009499 0.24% Castro::construct_old_gravity_source() 10 0.006828 0.008364 0.009417 0.24% Castro::initMFs() 1 0.006227 0.006667 0.007846 0.20% Castro::enforce_min_density() 62 0.005635 0.005884 0.006176 0.16% AmrLevel::AmrLevel(dm) 1 0.0052 0.005436 0.00592 0.15% StateData::define() 4 0.005181 0.005416 0.005903 0.15% Castro::finalize_advance() 10 0.003082 0.003409 0.00457 0.12% Castro::swap_state_time_levels() 10 0.003375 0.003962 0.004301 0.11% Castro::buildMetrics() 1 0.001618 0.001687 0.001852 0.05% Castro::post_regrid() 1 0.00147 0.001542 0.001645 0.04% Amr::InitAmr() 1 0.0003644 0.000393 0.0005041 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.273e-05 0.0001186 0.0001481 0.00% DistributionMapping::LeastUsedCPUs() 1 8.096e-06 0.000113 0.0001417 0.00% Castro::enforce_consistent_e() 1 7.896e-05 8.654e-05 9.606e-05 0.00% FabArrayBase::getCPC() 41 6.524e-05 7.072e-05 8.394e-05 0.00% Amr::writeSmallPlotFile() 1 3.298e-05 5.153e-05 7.134e-05 0.00% Castro::enforce_speed_limit() 62 2.497e-05 2.817e-05 3.095e-05 0.00% FabArrayBase::CPC::define() 2 2.283e-05 2.397e-05 2.638e-05 0.00% Gravity::set_mass_offset() 10 9.267e-06 1.273e-05 1.726e-05 0.00% Amr::initSubcycle() 1 9.377e-06 1.011e-05 1.119e-05 0.00% Gravity::swapTimeLevels() 10 7.671e-06 9.074e-06 1.104e-05 0.00% Castro::create_source_corrector() 10 7.511e-06 8.052e-06 8.864e-06 0.00% Castro::FluxRegCrseInit 10 5.972e-06 7.352e-06 8.077e-06 0.00% Castro::retry_advance_ctu() 10 6.394e-06 7.153e-06 7.946e-06 0.00% Castro::FluxRegFineAdd() 10 2.092e-06 2.683e-06 3.569e-06 0.00% DistributionMapping::Distribute() 1 8.79e-07 1.025e-06 1.366e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 26 B 30 B 33 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.01-31-gab99ea69089f) finalized