MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.08-3-g2de66d76894b) initialized Starting run at 05:35:14 UTC on 2023-08-02. Successfully read inputs file ... Castro git describe: 23.08 AMReX git describe: 23.08-3-g2de66d768 Microphysics git describe: 23.08 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.016441562 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.367424016 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.35496318 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.334771406 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.336055204 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.361313469 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.347943569 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.314837662 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.314321068 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.314636302 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.314326395 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010282374 seconds Ending run at 05:35:17 UTC on 2023-08-02. Run time = 3.564815327 Run time without initialization = 3.3785737 Average number of zones advanced per microsecond: 0.776 Average number of zones advanced per microsecond per rank: 0.097 TinyProfiler total time across processes [min...avg...max]: 3.563 ... 3.564 ... 3.565 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.3288 2.3696 2.4304 68.18% Gravity::make_radial_gravity() 21 0.3196 0.3337 0.3458 9.70% check_for_negative_density() 10 0.01159 0.07771 0.1217 3.41% Castro::initData() 1 0.0406 0.07813 0.1148 3.22% Castro::estTimeStep() 21 0.02295 0.07002 0.1086 3.05% FabArray::setVal() 143 0.06301 0.0749 0.09111 2.56% amrex::Copy() 193 0.06395 0.07521 0.08441 2.37% FabArray::ParallelCopy_finish() 41 0.03618 0.05541 0.08371 2.35% Castro::reset_internal_energy(Fab) 1008 0.0488 0.05087 0.05405 1.52% Castro::normalize_species() 62 0.0415 0.04221 0.04386 1.23% FabArray::ParallelCopy_nowait() 41 0.03617 0.04103 0.0431 1.21% StateData::FillBoundary(geom) 41 0.03389 0.0372 0.04199 1.18% FillPatchIterator::Initialize 41 0.02952 0.03317 0.03556 1.00% Castro::construct_new_gravity_source() 10 0.02221 0.02528 0.03005 0.84% Gravity::interpolate_monopole_grav() 21 0.02782 0.02841 0.02913 0.82% Castro::initialize_do_advance() 10 0.01266 0.01827 0.02246 0.63% Castro::computeTemp() 63 0.01912 0.02004 0.02115 0.59% VisMF::Write(FabArray) 2 0.01389 0.01459 0.01742 0.49% Castro::initialize_advance() 10 0.008846 0.01178 0.0157 0.44% FabArray::Saxpy() 20 0.01117 0.01272 0.01341 0.38% MultiFab::contains_nan() 20 0.01063 0.01164 0.01261 0.35% FabArray::setDomainBndry() 41 0.009006 0.01106 0.0126 0.35% Amr::writePlotFile() 2 0.006697 0.009786 0.01068 0.30% Castro::construct_old_gravity_source() 10 0.007042 0.009482 0.01018 0.29% Castro::initMFs() 1 0.007247 0.007544 0.009229 0.26% main() 1 0.005479 0.006367 0.006989 0.20% Castro::enforce_min_density() 62 0.005814 0.00614 0.006697 0.19% StateData::define() 4 0.005898 0.006098 0.006683 0.19% Castro::construct_new_source() 50 0.005779 0.006245 0.006541 0.18% Gravity::get_new_grav_vector() 11 0.003023 0.00385 0.005859 0.16% Castro::swap_state_time_levels() 10 0.003372 0.00459 0.005402 0.15% Amr::coarseTimeStep() 10 0.001007 0.002417 0.003414 0.10% Gravity::get_old_grav_vector() 10 0.001577 0.001863 0.002273 0.06% Castro::buildMetrics() 1 0.001649 0.001687 0.001912 0.05% Castro::finalize_do_advance() 10 0.0007108 0.001522 0.001858 0.05% AmrLevel::FillPatch() 41 0.0009524 0.001022 0.001091 0.03% Amr::InitAmr() 1 0.0002779 0.0003118 0.0004221 0.01% Amr::timeStep() 10 0.0001648 0.0002315 0.0003964 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002744 0.000284 0.0002971 0.01% Castro::clean_state() 62 0.0001381 0.0001713 0.0002294 0.01% Castro::do_advance_ctu() 10 0.0001303 0.0001696 0.0001988 0.01% DistributionMapping::LeastUsedCPUs() 1 1.249e-05 0.000116 0.0001531 0.00% Castro::finalize_advance() 10 7.87e-05 9.851e-05 0.0001228 0.00% FillPatchIterator::FillFromLevel0() 41 9.209e-05 0.0001047 0.0001141 0.00% StateDataPhysBCFunct::() 41 7.228e-05 9.265e-05 0.0001114 0.00% FabArray::ParallelCopy() 41 6.506e-05 7.97e-05 0.0001099 0.00% Castro::do_old_sources() 10 6.481e-05 9.101e-05 0.0001066 0.00% Castro::enforce_consistent_e() 1 8.14e-05 8.79e-05 0.0001013 0.00% Castro::construct_old_source() 50 4.941e-05 6.617e-05 9.093e-05 0.00% Castro::Castro() 1 5.977e-05 7.294e-05 8.952e-05 0.00% FillPatchSingleLevel 41 6.466e-05 7.637e-05 8.117e-05 0.00% FabArrayBase::getCPC() 41 4.372e-05 5.292e-05 8.106e-05 0.00% Castro::do_new_sources() 10 5.398e-05 6.432e-05 7.778e-05 0.00% Amr::FinalizeInit() 1 4.394e-06 1.364e-05 7.472e-05 0.00% Castro::construct_old_gravity() 10 4.069e-05 4.988e-05 6.931e-05 0.00% Amr::writeSmallPlotFile() 1 2.599e-05 4.637e-05 6.664e-05 0.00% Castro::subcycle_advance_ctu() 10 4.068e-05 4.976e-05 6.284e-05 0.00% Castro::apply_source_to_state() 20 2.986e-05 4.303e-05 5.241e-05 0.00% Castro::advance() 10 3.648e-05 4.431e-05 4.947e-05 0.00% Castro::construct_new_gravity() 10 3.438e-05 3.948e-05 4.581e-05 0.00% Amr::defBaseLevel() 1 2.896e-05 3.264e-05 4.409e-05 0.00% Castro::enforce_speed_limit() 62 2.404e-05 2.972e-05 3.478e-05 0.00% FabArrayBase::CPC::define() 2 2.226e-05 2.545e-05 3.092e-05 0.00% Castro::expand_state() 10 2.05e-05 2.28e-05 2.689e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.434e-05 1.781e-05 2.247e-05 0.00% Castro::check_for_nan() 20 1.9e-05 2.041e-05 2.127e-05 0.00% Gravity::swapTimeLevels() 10 1.113e-05 1.39e-05 2.059e-05 0.00% Castro::post_timestep() 10 1.215e-05 1.429e-05 1.591e-05 0.00% Castro::computeNewDt() 9 9.722e-06 1.13e-05 1.313e-05 0.00% Gravity::set_mass_offset() 10 8.889e-06 1.072e-05 1.288e-05 0.00% Amr::initSubcycle() 1 8.485e-06 9.097e-06 1.034e-05 0.00% Castro::create_source_corrector() 10 7.525e-06 8.796e-06 1.009e-05 0.00% Amr::initialInit() 1 1.455e-06 2.613e-06 9.105e-06 0.00% Castro::FluxRegCrseInit 10 6.414e-06 7.533e-06 8.491e-06 0.00% Castro::retry_advance_ctu() 10 6.309e-06 7.25e-06 8.038e-06 0.00% Amr::init() 1 2.219e-06 3.036e-06 7.827e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.162e-06 5.873e-06 7.673e-06 0.00% Castro::computeInitialDt() 2 4.101e-06 4.678e-06 5.445e-06 0.00% Castro::post_init() 1 3.088e-06 3.859e-06 5.234e-06 0.00% Amr::InitializeInit() 1 2.053e-06 2.527e-06 4.577e-06 0.00% Castro::post_regrid() 1 1.905e-06 3.073e-06 4.009e-06 0.00% Castro::FluxRegFineAdd() 10 2.087e-06 2.282e-06 2.394e-06 0.00% DistributionMapping::Distribute() 1 1.043e-06 1.256e-06 1.753e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.563 3.564 3.565 100.00% Amr::coarseTimeStep() 10 3.361 3.361 3.361 94.29% Amr::timeStep() 10 3.348 3.349 3.351 93.99% Castro::advance() 10 3.332 3.333 3.334 93.52% Castro::subcycle_advance_ctu() 10 3.241 3.252 3.259 91.41% Castro::do_advance_ctu() 10 3.241 3.252 3.259 91.41% Castro::construct_ctu_hydro_source() 10 2.467 2.47 2.477 69.48% Gravity::make_radial_gravity() 21 0.3345 0.3493 0.3595 10.08% Gravity::get_new_grav_vector() 11 0.2286 0.2342 0.2367 6.64% AmrLevel::FillPatch() 41 0.177 0.2073 0.222 6.23% Castro::construct_new_gravity() 10 0.2025 0.2064 0.2082 5.84% Castro::construct_old_gravity() 10 0.1891 0.1976 0.207 5.81% Gravity::get_old_grav_vector() 10 0.1884 0.197 0.2063 5.79% FillPatchIterator::Initialize 41 0.1512 0.1783 0.1956 5.49% Castro::initialize_do_advance() 10 0.1604 0.1782 0.1893 5.31% Amr::init() 1 0.1857 0.1858 0.1858 5.21% Amr::initialInit() 1 0.1688 0.169 0.1692 4.75% FillPatchIterator::FillFromLevel0() 41 0.1116 0.1341 0.1571 4.41% FillPatchSingleLevel 41 0.1116 0.134 0.1569 4.40% Amr::InitializeInit() 1 0.06257 0.1004 0.1372 3.85% Amr::defBaseLevel() 1 0.06257 0.1004 0.1372 3.85% Castro::expand_state() 10 0.1009 0.1222 0.134 3.76% Castro::clean_state() 62 0.1154 0.1188 0.1252 3.51% check_for_negative_density() 10 0.01159 0.07771 0.1217 3.41% FabArray::ParallelCopy() 41 0.07717 0.0966 0.1201 3.37% Castro::initData() 1 0.04484 0.08222 0.1185 3.32% Castro::estTimeStep() 21 0.02295 0.07002 0.1086 3.05% Amr::FinalizeInit() 1 0.03191 0.06859 0.1065 2.99% Castro::do_old_sources() 10 0.08643 0.09252 0.09568 2.68% FabArray::setVal() 143 0.06301 0.0749 0.09111 2.56% Castro::initialize_advance() 10 0.07068 0.07715 0.08853 2.48% amrex::Copy() 193 0.06395 0.07521 0.08441 2.37% FabArray::ParallelCopy_finish() 41 0.03618 0.05541 0.08371 2.35% Castro::do_new_sources() 10 0.05906 0.06703 0.07881 2.21% Castro::computeInitialDt() 2 0.002159 0.03907 0.07682 2.15% Castro::computeTemp() 63 0.06828 0.0712 0.07547 2.12% Castro::reset_internal_energy(MultiFab) 63 0.04908 0.05116 0.05432 1.52% Castro::reset_internal_energy(Fab) 1008 0.0488 0.05087 0.05405 1.52% Castro::normalize_species() 62 0.0415 0.04221 0.04386 1.23% FabArray::ParallelCopy_nowait() 41 0.03628 0.04111 0.04317 1.21% StateDataPhysBCFunct::() 41 0.03396 0.03729 0.04208 1.18% StateData::FillBoundary(geom) 41 0.03389 0.0372 0.04199 1.18% Castro::construct_new_source() 50 0.02836 0.03153 0.0366 1.03% Castro::finalize_do_advance() 10 0.01202 0.02393 0.03221 0.90% Castro::construct_new_gravity_source() 10 0.02221 0.02528 0.03005 0.84% Castro::post_init() 1 0.02886 0.02908 0.02937 0.82% Gravity::interpolate_monopole_grav() 21 0.02782 0.02841 0.02913 0.82% Amr::writePlotFile() 2 0.02691 0.02713 0.0274 0.77% VisMF::Write(FabArray) 2 0.01389 0.01459 0.01742 0.49% Castro::post_timestep() 10 0.0156 0.01596 0.01639 0.46% Castro::apply_source_to_state() 20 0.01122 0.01276 0.01345 0.38% FabArray::Saxpy() 20 0.01117 0.01272 0.01341 0.38% Castro::Castro() 1 0.01171 0.01194 0.01287 0.36% Castro::check_for_nan() 20 0.01065 0.01166 0.01263 0.35% MultiFab::contains_nan() 20 0.01063 0.01164 0.01261 0.35% FabArray::setDomainBndry() 41 0.009006 0.01106 0.0126 0.35% Castro::construct_old_source() 50 0.007092 0.009548 0.01027 0.29% Castro::construct_old_gravity_source() 10 0.007042 0.009482 0.01018 0.29% Castro::initMFs() 1 0.007247 0.007544 0.009229 0.26% Castro::computeNewDt() 9 0.008546 0.008565 0.008573 0.24% AmrLevel::AmrLevel(dm) 1 0.005912 0.006116 0.006698 0.19% Castro::enforce_min_density() 62 0.005814 0.00614 0.006697 0.19% StateData::define() 4 0.005898 0.006098 0.006683 0.19% Castro::swap_state_time_levels() 10 0.003372 0.00459 0.005402 0.15% Castro::finalize_advance() 10 0.002992 0.003765 0.004739 0.13% Castro::buildMetrics() 1 0.001775 0.001822 0.00207 0.06% Castro::post_regrid() 1 0.001532 0.001633 0.001893 0.05% Amr::InitAmr() 1 0.000287 0.0003209 0.0004307 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.823e-05 0.0001231 0.0001611 0.00% DistributionMapping::LeastUsedCPUs() 1 1.249e-05 0.000116 0.0001531 0.00% FabArrayBase::getCPC() 41 6.729e-05 7.837e-05 0.0001091 0.00% Castro::enforce_consistent_e() 1 8.14e-05 8.79e-05 0.0001013 0.00% Amr::writeSmallPlotFile() 1 2.599e-05 4.637e-05 6.664e-05 0.00% Castro::enforce_speed_limit() 62 2.404e-05 2.972e-05 3.478e-05 0.00% FabArrayBase::CPC::define() 2 2.226e-05 2.545e-05 3.092e-05 0.00% Gravity::swapTimeLevels() 10 1.113e-05 1.39e-05 2.059e-05 0.00% Gravity::set_mass_offset() 10 8.889e-06 1.072e-05 1.288e-05 0.00% Amr::initSubcycle() 1 8.485e-06 9.097e-06 1.034e-05 0.00% Castro::create_source_corrector() 10 7.525e-06 8.796e-06 1.009e-05 0.00% Castro::FluxRegCrseInit 10 6.414e-06 7.533e-06 8.491e-06 0.00% Castro::retry_advance_ctu() 10 6.309e-06 7.25e-06 8.038e-06 0.00% Castro::FluxRegFineAdd() 10 2.087e-06 2.282e-06 2.394e-06 0.00% DistributionMapping::Distribute() 1 1.043e-06 1.256e-06 1.753e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 28 B 36 B 48 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.08-3-g2de66d76894b) finalized