MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.08-18-g3d29fd7d0e81) initialized Starting run at 05:39:30 UTC on 2022-08-25. Successfully read inputs file ... Castro git describe: 22.08-11-ga978fcf88 AMReX git describe: 22.08-18-g3d29fd7d0 Microphysics git describe: 22.08-4-gb9a0f9aa reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.016127306 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.370652313 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.349050109 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.345987155 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.347270352 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.35362594 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.349533202 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.343516321 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.342785954 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.342322982 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.343771077 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010777716 seconds Ending run at 05:39:34 UTC on 2022-08-25. Run time = 3.722002505 Run time without initialization = 3.507174483 Average number of zones advanced per microsecond: 0.747 Average number of zones advanced per microsecond per rank: 0.093 TinyProfiler total time across processes [min...avg...max]: 3.721 ... 3.722 ... 3.722 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.1128 2.4051 2.5513 68.55% Castro::do_advance_ctu() 10 0.03915 0.1869 0.483 12.98% Gravity::make_radial_gravity() 21 0.3493 0.3628 0.3868 10.39% Castro::initData() 1 0.04739 0.09559 0.1408 3.78% Castro::estTimeStep() 21 0.02652 0.0758 0.1231 3.31% FabArray::ParallelCopy_finish() 41 0.03742 0.05868 0.1217 3.27% FabArray::setVal() 143 0.05676 0.06603 0.06967 1.87% Castro::reset_internal_energy(Fab) 1008 0.0471 0.05 0.05127 1.38% FabArray::ParallelCopy_nowait() 41 0.0276 0.04472 0.05067 1.36% StateData::FillBoundary(geom) 41 0.03665 0.04255 0.04691 1.26% Castro::normalize_species() 62 0.0401 0.04184 0.04349 1.17% FillPatchIterator::Initialize 41 0.0243 0.03609 0.04061 1.09% Gravity::interpolate_monopole_grav() 21 0.02649 0.02752 0.02852 0.77% Castro::construct_new_gravity_source() 10 0.01986 0.02272 0.02341 0.63% Castro::expand_state() 10 0.009894 0.01775 0.02169 0.58% Castro::computeTemp() 63 0.01755 0.01917 0.01997 0.54% Castro::initialize_do_advance() 10 0.01028 0.01751 0.01949 0.52% VisMF::Write(FabArray) 2 0.01323 0.01407 0.01685 0.45% MultiFab::Saxpy() 20 0.008603 0.01428 0.01645 0.44% Amr::writePlotFile() 2 0.01028 0.01307 0.01395 0.37% Gravity::get_new_grav_vector() 11 0.007439 0.01146 0.01287 0.35% MultiFab::contains_nan() 20 0.009792 0.01153 0.01261 0.34% FabArray::setDomainBndry() 41 0.004794 0.01034 0.01232 0.33% Castro::construct_old_gravity_source() 10 0.004988 0.01012 0.01179 0.32% Castro::initialize_advance() 10 0.003281 0.008809 0.01075 0.29% Gravity::get_old_grav_vector() 10 0.005539 0.009217 0.01054 0.28% Castro::initMFs() 1 0.006658 0.00859 0.01025 0.28% StateData::define() 4 0.00549 0.007083 0.008136 0.22% Castro::enforce_min_density() 62 0.006003 0.006696 0.007307 0.20% Castro::construct_new_source() 50 0.00476 0.006526 0.007248 0.19% main() 1 0.006469 0.00693 0.007188 0.19% Castro::swap_state_time_levels() 10 0.003343 0.004532 0.005204 0.14% Amr::coarseTimeStep() 10 0.000834 0.001683 0.003196 0.09% Castro::buildMetrics() 1 0.001585 0.002051 0.00234 0.06% Castro::finalize_do_advance() 10 0.0006522 0.001438 0.001714 0.05% Amr::InitAmr() 1 0.0002972 0.0004072 0.0004892 0.01% Amr::timeStep() 10 0.000173 0.0002325 0.0004698 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002932 0.000307 0.0003178 0.01% DistributionMapping::LeastUsedCPUs() 1 7.449e-06 0.0001144 0.000254 0.01% Castro::clean_state() 62 0.0001348 0.0001679 0.0001988 0.01% StateDataPhysBCFunct::() 41 0.0001011 0.00012 0.0001372 0.00% Castro::Castro() 1 4.895e-05 6.964e-05 0.0001119 0.00% Castro::enforce_consistent_e() 1 8.567e-05 9.341e-05 0.0001063 0.00% FabArray::ParallelCopy() 41 7.361e-05 8.446e-05 0.0001014 0.00% Castro::do_new_sources() 10 4.649e-05 6.818e-05 9.695e-05 0.00% Amr::FinalizeInit() 1 3.254e-06 1.592e-05 9.258e-05 0.00% Castro::do_old_sources() 10 4.028e-05 6.673e-05 9.032e-05 0.00% Castro::construct_old_source() 50 3.791e-05 7.471e-05 8.936e-05 0.00% FabArrayBase::getCPC() 41 5.171e-05 6.106e-05 7.403e-05 0.00% Castro::advance() 10 3.43e-05 5.016e-05 7.316e-05 0.00% FillPatchSingleLevel 41 6.834e-05 7.059e-05 7.261e-05 0.00% Castro::apply_source_to_state() 20 4.122e-05 5.201e-05 7.195e-05 0.00% Castro::subcycle_advance_ctu() 10 3.524e-05 4.905e-05 6.857e-05 0.00% Amr::writeSmallPlotFile() 1 2.426e-05 5.081e-05 6.514e-05 0.00% Castro::construct_old_gravity() 10 3.654e-05 5.181e-05 6.094e-05 0.00% Castro::finalize_advance() 10 4.929e-05 5.219e-05 5.47e-05 0.00% Castro::construct_new_gravity() 10 4.27e-05 4.78e-05 5.291e-05 0.00% Amr::defBaseLevel() 1 3.666e-05 4.348e-05 5.276e-05 0.00% Castro::enforce_speed_limit() 62 2.601e-05 2.969e-05 3.52e-05 0.00% FabArrayBase::CPC::define() 2 2.312e-05 2.689e-05 2.989e-05 0.00% Castro::post_timestep() 10 1.351e-05 1.719e-05 2.751e-05 0.00% Castro::check_for_nan() 20 2.112e-05 2.367e-05 2.652e-05 0.00% AmrLevel::AmrLevel(dm) 1 7.136e-06 1.247e-05 1.835e-05 0.00% Amr::initSubcycle() 1 8.823e-06 1.206e-05 1.669e-05 0.00% Gravity::swapTimeLevels() 10 5.709e-06 1.294e-05 1.665e-05 0.00% Castro::create_source_corrector() 10 6.484e-06 1.089e-05 1.45e-05 0.00% Gravity::set_mass_offset() 10 6.139e-06 9.149e-06 1.134e-05 0.00% Castro::computeNewDt() 9 8.477e-06 9.771e-06 1.069e-05 0.00% Castro::FluxRegCrseInit 10 4.87e-06 7.864e-06 1.054e-05 0.00% Castro::computeInitialDt() 2 2.573e-06 5.111e-06 8.289e-06 0.00% Amr::InitializeInit() 1 2.191e-06 3.908e-06 8.159e-06 0.00% Castro::retry_advance_ctu() 10 4.339e-06 6.083e-06 7.018e-06 0.00% Castro::post_regrid() 1 1.805e-06 3.086e-06 6.732e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.862e-06 4.546e-06 5.077e-06 0.00% Castro::post_init() 1 2.825e-06 3.94e-06 4.662e-06 0.00% Amr::init() 1 1.8e-06 2.279e-06 3.14e-06 0.00% Castro::FluxRegFineAdd() 10 1.901e-06 2.321e-06 2.78e-06 0.00% Amr::initialInit() 1 1.398e-06 1.744e-06 2.278e-06 0.00% DistributionMapping::Distribute() 1 1.055e-06 1.262e-06 1.685e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.721 3.722 3.722 100.00% Amr::coarseTimeStep() 10 3.489 3.489 3.489 93.75% Amr::timeStep() 10 3.478 3.479 3.48 93.50% Castro::advance() 10 3.463 3.463 3.464 93.06% Castro::subcycle_advance_ctu() 10 3.392 3.395 3.404 91.47% Castro::do_advance_ctu() 10 3.392 3.395 3.404 91.47% Castro::construct_ctu_hydro_source() 10 2.113 2.405 2.551 68.55% Gravity::make_radial_gravity() 21 0.3493 0.3628 0.3868 10.39% Gravity::get_new_grav_vector() 11 0.2337 0.2361 0.2374 6.38% Castro::construct_old_gravity() 10 0.2054 0.217 0.2353 6.32% Gravity::get_old_grav_vector() 10 0.2045 0.2162 0.2347 6.31% FillPatchIterator::Initialize 41 0.181 0.1927 0.2154 5.79% Amr::init() 1 0.2141 0.2143 0.2144 5.76% Castro::construct_new_gravity() 10 0.2065 0.2083 0.2093 5.62% Amr::initialInit() 1 0.1977 0.198 0.1982 5.33% FillPatchSingleLevel 41 0.1298 0.1463 0.1863 5.00% Castro::initialize_do_advance() 10 0.1661 0.1746 0.1814 4.87% Amr::InitializeInit() 1 0.06939 0.119 0.1669 4.49% Amr::defBaseLevel() 1 0.06939 0.119 0.1669 4.49% FabArray::ParallelCopy() 41 0.0872 0.1036 0.1494 4.01% Castro::initData() 1 0.0517 0.09944 0.1444 3.88% Castro::expand_state() 10 0.1184 0.1264 0.1317 3.54% Amr::FinalizeInit() 1 0.03092 0.07894 0.1287 3.46% Castro::estTimeStep() 21 0.02652 0.0758 0.1231 3.31% FabArray::ParallelCopy_finish() 41 0.03742 0.05868 0.1217 3.27% Castro::clean_state() 62 0.1109 0.1172 0.1212 3.26% Castro::computeInitialDt() 2 0.001692 0.04971 0.09946 2.67% Castro::initialize_advance() 10 0.05802 0.06853 0.07167 1.93% Castro::computeTemp() 63 0.06497 0.06947 0.07146 1.92% FabArray::setVal() 143 0.05676 0.06603 0.06967 1.87% Castro::do_new_sources() 10 0.05359 0.06284 0.0648 1.74% Castro::reset_internal_energy(MultiFab) 63 0.04742 0.0503 0.05157 1.39% Castro::reset_internal_energy(Fab) 1008 0.0471 0.05 0.05127 1.38% FabArray::ParallelCopy_nowait() 41 0.02771 0.0448 0.05076 1.36% Castro::do_old_sources() 10 0.0333 0.04547 0.04895 1.32% StateDataPhysBCFunct::() 41 0.03675 0.04267 0.04705 1.26% StateData::FillBoundary(geom) 41 0.03665 0.04255 0.04691 1.26% Castro::normalize_species() 62 0.0401 0.04184 0.04349 1.17% Castro::construct_new_source() 50 0.02462 0.02924 0.03057 0.82% Castro::post_init() 1 0.02799 0.02853 0.02874 0.77% Gravity::interpolate_monopole_grav() 21 0.02649 0.02752 0.02852 0.77% Amr::writePlotFile() 2 0.02695 0.02714 0.02733 0.73% Castro::construct_new_gravity_source() 10 0.01986 0.02272 0.02341 0.63% VisMF::Write(FabArray) 2 0.01323 0.01407 0.01685 0.45% Castro::apply_source_to_state() 20 0.008644 0.01434 0.0165 0.44% Castro::post_timestep() 10 0.01436 0.01583 0.01648 0.44% MultiFab::Saxpy() 20 0.008603 0.01428 0.01645 0.44% Castro::Castro() 1 0.00953 0.01231 0.01435 0.39% Castro::check_for_nan() 20 0.009815 0.01156 0.01263 0.34% MultiFab::contains_nan() 20 0.009792 0.01153 0.01261 0.34% FabArray::setDomainBndry() 41 0.004794 0.01034 0.01232 0.33% Castro::construct_old_source() 50 0.005026 0.01019 0.01188 0.32% Castro::construct_old_gravity_source() 10 0.004988 0.01012 0.01179 0.32% Castro::initMFs() 1 0.006658 0.00859 0.01025 0.28% AmrLevel::AmrLevel(dm) 1 0.005499 0.007096 0.008154 0.22% StateData::define() 4 0.00549 0.007083 0.008136 0.22% Castro::enforce_min_density() 62 0.006003 0.006696 0.007307 0.20% Castro::computeNewDt() 9 0.007147 0.007159 0.007166 0.19% Castro::swap_state_time_levels() 10 0.003343 0.004532 0.005204 0.14% Castro::buildMetrics() 1 0.001694 0.00222 0.002554 0.07% Castro::post_regrid() 1 0.001505 0.001714 0.002056 0.06% Castro::finalize_do_advance() 10 0.0006522 0.001438 0.001714 0.05% Amr::InitAmr() 1 0.000307 0.0004192 0.0005059 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.318e-05 0.0001202 0.0002608 0.01% DistributionMapping::LeastUsedCPUs() 1 7.449e-06 0.0001144 0.000254 0.01% Castro::enforce_consistent_e() 1 8.567e-05 9.341e-05 0.0001063 0.00% FabArrayBase::getCPC() 41 7.848e-05 8.794e-05 0.0001039 0.00% Castro::finalize_advance() 10 5.72e-05 6.238e-05 6.677e-05 0.00% Amr::writeSmallPlotFile() 1 2.426e-05 5.081e-05 6.514e-05 0.00% Castro::enforce_speed_limit() 62 2.601e-05 2.969e-05 3.52e-05 0.00% FabArrayBase::CPC::define() 2 2.312e-05 2.689e-05 2.989e-05 0.00% Amr::initSubcycle() 1 8.823e-06 1.206e-05 1.669e-05 0.00% Gravity::swapTimeLevels() 10 5.709e-06 1.294e-05 1.665e-05 0.00% Castro::create_source_corrector() 10 6.484e-06 1.089e-05 1.45e-05 0.00% Gravity::set_mass_offset() 10 6.139e-06 9.149e-06 1.134e-05 0.00% Castro::FluxRegCrseInit 10 4.87e-06 7.864e-06 1.054e-05 0.00% Castro::retry_advance_ctu() 10 4.339e-06 6.083e-06 7.018e-06 0.00% Castro::FluxRegFineAdd() 10 1.901e-06 2.321e-06 2.78e-06 0.00% DistributionMapping::Distribute() 1 1.055e-06 1.262e-06 1.685e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] AMReX (22.08-18-g3d29fd7d0e81) finalized