Initializing AMReX (24.01-27-g30738c689207)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.01-27-g30738c689207) initialized Starting run at 06:34:11 UTC on 2024-01-25. Successfully read inputs file ... Castro git describe: 24.01-17-g29c5f4d16 AMReX git describe: 24.01-27-g30738c689 Microphysics git describe: 24.01-9-ga4d7ab4d reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.013372375 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.36040328 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.375736361 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.357455367 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.335483418 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.356478512 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.3382692 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.310443474 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.31081749 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.31002175 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.312831799 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.007612518 seconds Ending run at 06:34:15 UTC on 2024-01-25. Run time = 3.564944638 Run time without initialization = 3.381824734 Average number of zones advanced per microsecond: 0.775 Average number of zones advanced per microsecond per rank: 0.097 TinyProfiler total time across processes [min...avg...max]: 3.564 ... 3.565 ... 3.565 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2579 2.3737 2.4310 68.19% Gravity::make_radial_gravity() 21 0.291 0.2968 0.3095 8.68% check_for_negative_density() 10 0.04687 0.1048 0.225 6.31% Castro::initData() 1 0.04786 0.08526 0.1206 3.38% Castro::estTimeStep() 21 0.02327 0.06643 0.1117 3.13% amrex::Copy() 193 0.07515 0.08412 0.09346 2.62% FabArray::setVal() 143 0.06291 0.07619 0.08786 2.46% FabArray::ParallelCopy_finish() 41 0.03543 0.05356 0.06709 1.88% Castro::reset_internal_energy(Fab) 1008 0.04414 0.04731 0.04869 1.37% FabArray::ParallelCopy_nowait() 41 0.04003 0.04371 0.04533 1.27% Castro::normalize_species() 62 0.04125 0.04204 0.04253 1.19% FillPatchIterator::Initialize 41 0.02739 0.03542 0.03725 1.04% StateData::FillBoundary(geom) 41 0.02842 0.03207 0.0357 1.00% Gravity::interpolate_monopole_grav() 21 0.02712 0.02874 0.02965 0.83% Castro::construct_new_gravity_source() 10 0.0224 0.02585 0.02944 0.83% Castro::initialize_do_advance() 10 0.0136 0.01918 0.02244 0.63% Castro::computeTemp() 63 0.01806 0.01983 0.02209 0.62% Castro::initialize_advance() 10 0.009477 0.01198 0.01461 0.41% FabArray::Saxpy() 20 0.01263 0.01345 0.01431 0.40% FabArray::setDomainBndry() 41 0.007192 0.01138 0.01335 0.37% MultiFab::contains_nan() 20 0.01079 0.01163 0.01253 0.35% VisMF::Write(FabArray) 2 0.008942 0.009466 0.01195 0.34% Castro::construct_old_gravity_source() 10 0.008892 0.01033 0.0111 0.31% Amr::writePlotFile() 2 0.006298 0.008888 0.009558 0.27% StateData::define() 4 0.005309 0.00601 0.008432 0.24% Castro::initMFs() 1 0.006473 0.00688 0.008201 0.23% Castro::enforce_min_density() 62 0.007259 0.007496 0.007727 0.22% Castro::construct_new_source() 50 0.006103 0.006325 0.006599 0.19% Gravity::get_new_grav_vector() 11 0.002907 0.004542 0.005806 0.16% main() 1 0.004007 0.004989 0.005441 0.15% Castro::swap_state_time_levels() 10 0.003318 0.004433 0.004632 0.13% Amr::coarseTimeStep() 10 0.001665 0.002434 0.002857 0.08% Gravity::get_old_grav_vector() 10 0.001698 0.002227 0.002584 0.07% Castro::buildMetrics() 1 0.001499 0.001551 0.00176 0.05% Castro::finalize_do_advance() 10 0.001057 0.001369 0.001676 0.05% AmrLevel::FillPatch() 41 0.0008665 0.001022 0.001193 0.03% Amr::InitAmr() 1 0.0003535 0.0004579 0.0008226 0.02% DistributionMapping::LeastUsedCPUs() 1 9.441e-06 0.000396 0.0005052 0.01% Amr::timeStep() 10 0.0001468 0.0002262 0.0004958 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002737 0.0002948 0.0003538 0.01% Castro::clean_state() 62 0.0001386 0.0001605 0.0002115 0.01% Castro::do_advance_ctu() 10 0.0001098 0.000144 0.0001651 0.00% StateDataPhysBCFunct::() 41 8.763e-05 0.000107 0.0001435 0.00% FillPatchIterator::FillFromLevel0() 41 8.904e-05 0.0001136 0.0001332 0.00% Castro::do_old_sources() 10 6.584e-05 9.442e-05 0.0001206 0.00% Castro::construct_old_source() 50 6.36e-05 7.971e-05 0.0001063 0.00% Castro::finalize_advance() 10 7.169e-05 8.843e-05 0.0001041 0.00% Castro::enforce_consistent_e() 1 7.652e-05 8.998e-05 0.0001024 0.00% FabArray::ParallelCopy() 41 6.818e-05 8.802e-05 0.0001015 0.00% Amr::FinalizeInit() 1 4.361e-06 1.598e-05 8.786e-05 0.00% Castro::Castro() 1 4.757e-05 6.793e-05 8.719e-05 0.00% FillPatchSingleLevel 41 5.398e-05 7.154e-05 8.062e-05 0.00% Castro::do_new_sources() 10 5.841e-05 6.807e-05 7.795e-05 0.00% FabArrayBase::getCPC() 41 3.524e-05 5.414e-05 7.236e-05 0.00% Castro::advance() 10 3.892e-05 4.798e-05 6.89e-05 0.00% Castro::construct_new_gravity() 10 3.039e-05 4.736e-05 6.374e-05 0.00% Amr::writeSmallPlotFile() 1 3.434e-05 4.341e-05 5.854e-05 0.00% Castro::subcycle_advance_ctu() 10 3.839e-05 4.994e-05 5.696e-05 0.00% Castro::apply_source_to_state() 20 4.042e-05 5.033e-05 5.689e-05 0.00% Castro::construct_old_gravity() 10 3.233e-05 3.838e-05 4.772e-05 0.00% Amr::defBaseLevel() 1 1.782e-05 2.669e-05 3.535e-05 0.00% Castro::post_init() 1 1.42e-05 1.867e-05 3.402e-05 0.00% Castro::enforce_speed_limit() 62 2.311e-05 2.754e-05 3.237e-05 0.00% Castro::expand_state() 10 2.082e-05 2.583e-05 3.101e-05 0.00% FabArrayBase::CPC::define() 2 2.174e-05 2.431e-05 2.992e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.549e-05 2.054e-05 2.986e-05 0.00% Castro::check_for_nan() 20 2.175e-05 2.372e-05 2.631e-05 0.00% Castro::post_timestep() 10 1.251e-05 1.578e-05 2.283e-05 0.00% Castro::post_regrid() 1 1.883e-06 5.379e-06 2.038e-05 0.00% Amr::initSubcycle() 1 9.833e-06 1.233e-05 1.898e-05 0.00% Gravity::set_mass_offset() 10 9.426e-06 1.198e-05 1.429e-05 0.00% Gravity::swapTimeLevels() 10 8.889e-06 1.077e-05 1.39e-05 0.00% Castro::computeNewDt() 9 7.346e-06 8.69e-06 1.122e-05 0.00% Castro::create_source_corrector() 10 7.377e-06 8.236e-06 9.979e-06 0.00% Amr::initialInit() 1 1.487e-06 2.654e-06 9.312e-06 0.00% Castro::FluxRegCrseInit 10 6.85e-06 7.572e-06 9.02e-06 0.00% Castro::retry_advance_ctu() 10 6.691e-06 7.395e-06 8.088e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.635e-06 4.645e-06 6.588e-06 0.00% Amr::InitializeInit() 1 1.668e-06 2.677e-06 5.721e-06 0.00% Castro::computeInitialDt() 2 3.003e-06 3.697e-06 4.204e-06 0.00% Amr::init() 1 2.015e-06 2.303e-06 2.768e-06 0.00% Castro::FluxRegFineAdd() 10 1.972e-06 2.161e-06 2.352e-06 0.00% DistributionMapping::Distribute() 1 8.5e-07 1.049e-06 1.391e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.564 3.565 3.565 100.00% Amr::coarseTimeStep() 10 3.369 3.369 3.369 94.50% Amr::timeStep() 10 3.356 3.356 3.357 94.16% Castro::advance() 10 3.339 3.34 3.341 93.72% Castro::subcycle_advance_ctu() 10 3.251 3.259 3.268 91.67% Castro::do_advance_ctu() 10 3.251 3.259 3.268 91.66% Castro::construct_ctu_hydro_source() 10 2.499 2.501 2.508 70.35% Gravity::make_radial_gravity() 21 0.3096 0.3146 0.3238 9.08% AmrLevel::FillPatch() 41 0.1928 0.2105 0.2268 6.36% check_for_negative_density() 10 0.04687 0.1048 0.225 6.31% Gravity::get_new_grav_vector() 11 0.2121 0.2158 0.2192 6.15% Castro::construct_new_gravity() 10 0.1899 0.1929 0.1956 5.49% Castro::construct_old_gravity() 10 0.1775 0.1841 0.1928 5.41% FillPatchIterator::Initialize 41 0.1579 0.1766 0.1921 5.39% Gravity::get_old_grav_vector() 10 0.1769 0.1835 0.1921 5.39% Castro::initialize_do_advance() 10 0.1615 0.1778 0.1912 5.36% Amr::init() 1 0.1821 0.1825 0.1826 5.12% Amr::initialInit() 1 0.1686 0.1688 0.1691 4.74% FillPatchIterator::FillFromLevel0() 41 0.1105 0.1298 0.1429 4.01% FillPatchSingleLevel 41 0.1104 0.1297 0.1428 4.00% Amr::InitializeInit() 1 0.06838 0.1063 0.1419 3.98% Amr::defBaseLevel() 1 0.06837 0.1063 0.1419 3.98% Castro::expand_state() 10 0.1069 0.1213 0.1354 3.80% Castro::initData() 1 0.0515 0.08915 0.1246 3.49% Castro::clean_state() 62 0.1146 0.1162 0.1181 3.31% Castro::estTimeStep() 21 0.02327 0.06643 0.1117 3.13% FabArray::ParallelCopy() 41 0.0795 0.09744 0.1114 3.12% Amr::FinalizeInit() 1 0.02672 0.06253 0.1007 2.82% Castro::do_old_sources() 10 0.09339 0.09757 0.1002 2.81% amrex::Copy() 193 0.07515 0.08412 0.09346 2.62% FabArray::setVal() 143 0.06291 0.07619 0.08786 2.46% Castro::initialize_advance() 10 0.06829 0.0771 0.08527 2.39% Castro::computeInitialDt() 2 0.002178 0.03802 0.07604 2.13% Castro::do_new_sources() 10 0.0605 0.06811 0.07602 2.13% Castro::computeTemp() 63 0.06599 0.06744 0.06872 1.93% FabArray::ParallelCopy_finish() 41 0.03543 0.05356 0.06709 1.88% Castro::reset_internal_energy(MultiFab) 63 0.04441 0.04761 0.049 1.37% Castro::reset_internal_energy(Fab) 1008 0.04414 0.04731 0.04869 1.37% FabArray::ParallelCopy_nowait() 41 0.04012 0.04379 0.04539 1.27% Castro::normalize_species() 62 0.04125 0.04204 0.04253 1.19% StateDataPhysBCFunct::() 41 0.02857 0.03217 0.0358 1.00% Castro::construct_new_source() 50 0.02874 0.03218 0.03578 1.00% StateData::FillBoundary(geom) 41 0.02842 0.03207 0.0357 1.00% Gravity::interpolate_monopole_grav() 21 0.02712 0.02874 0.02965 0.83% Castro::construct_new_gravity_source() 10 0.0224 0.02585 0.02944 0.83% Castro::finalize_do_advance() 10 0.01183 0.02059 0.02847 0.80% Castro::post_init() 1 0.02381 0.02404 0.02425 0.68% Amr::writePlotFile() 2 0.02122 0.02137 0.02159 0.61% Castro::post_timestep() 10 0.01471 0.01572 0.01641 0.46% Castro::apply_source_to_state() 20 0.01268 0.0135 0.01436 0.40% FabArray::Saxpy() 20 0.01263 0.01345 0.01431 0.40% FabArray::setDomainBndry() 41 0.007192 0.01138 0.01335 0.37% Castro::check_for_nan() 20 0.01081 0.01166 0.01256 0.35% MultiFab::contains_nan() 20 0.01079 0.01163 0.01253 0.35% VisMF::Write(FabArray) 2 0.008942 0.009466 0.01195 0.34% Castro::construct_old_source() 50 0.008956 0.01041 0.01121 0.31% Castro::Castro() 1 0.01039 0.01068 0.01114 0.31% Castro::construct_old_gravity_source() 10 0.008892 0.01033 0.0111 0.31% Castro::computeNewDt() 9 0.009189 0.009207 0.009215 0.26% AmrLevel::AmrLevel(dm) 1 0.005331 0.00603 0.008461 0.24% StateData::define() 4 0.005309 0.00601 0.008432 0.24% Castro::initMFs() 1 0.006473 0.00688 0.008201 0.23% Castro::enforce_min_density() 62 0.007259 0.007496 0.007727 0.22% Castro::swap_state_time_levels() 10 0.003318 0.004433 0.004632 0.13% Castro::finalize_advance() 10 0.00295 0.003724 0.004597 0.13% Castro::buildMetrics() 1 0.001616 0.001675 0.001896 0.05% Castro::post_regrid() 1 0.001518 0.001613 0.001673 0.05% Amr::InitAmr() 1 0.0003643 0.0004702 0.0008416 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.453e-05 0.0004017 0.0005125 0.01% DistributionMapping::LeastUsedCPUs() 1 9.441e-06 0.000396 0.0005052 0.01% Castro::enforce_consistent_e() 1 7.652e-05 8.998e-05 0.0001024 0.00% FabArrayBase::getCPC() 41 5.799e-05 7.845e-05 9.561e-05 0.00% Amr::writeSmallPlotFile() 1 3.434e-05 4.341e-05 5.854e-05 0.00% Castro::enforce_speed_limit() 62 2.311e-05 2.754e-05 3.237e-05 0.00% FabArrayBase::CPC::define() 2 2.174e-05 2.431e-05 2.992e-05 0.00% Amr::initSubcycle() 1 9.833e-06 1.233e-05 1.898e-05 0.00% Gravity::set_mass_offset() 10 9.426e-06 1.198e-05 1.429e-05 0.00% Gravity::swapTimeLevels() 10 8.889e-06 1.077e-05 1.39e-05 0.00% Castro::create_source_corrector() 10 7.377e-06 8.236e-06 9.979e-06 0.00% Castro::FluxRegCrseInit 10 6.85e-06 7.572e-06 9.02e-06 0.00% Castro::retry_advance_ctu() 10 6.691e-06 7.395e-06 8.088e-06 0.00% Castro::FluxRegFineAdd() 10 1.972e-06 2.161e-06 2.352e-06 0.00% DistributionMapping::Distribute() 1 8.5e-07 1.049e-06 1.391e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 27 B 33 B 47 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.01-27-g30738c689207) finalized