Initializing AMReX (24.02-34-g3525b4a3f27e)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.02-34-g3525b4a3f27e) initialized Starting run at 06:33:15 UTC on 2024-03-06. Successfully read inputs file ... Castro git describe: 24.02-27-g465a83f5a AMReX git describe: 24.02-34-g3525b4a3f Microphysics git describe: 24.03-1-gce331bc8 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.01285011 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.35168319 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.35148523 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.32763457 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.327261744 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.34959065 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.340459274 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.309139541 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.3100487 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.311326758 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.310592327 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.007408962 seconds Ending run at 06:33:19 UTC on 2024-03-06. Run time = 3.535953541 Run time without initialization = 3.302300899 Average number of zones advanced per microsecond: 0.794 Average number of zones advanced per microsecond per rank: 0.099 TinyProfiler total time across processes [min...avg...max]: 3.535 ... 3.536 ... 3.536 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.3088 2.3606 2.3917 67.64% Gravity::make_radial_gravity() 21 0.2878 0.2956 0.3121 8.83% Castro::estTimeStep() 21 0.04151 0.1096 0.1695 4.79% Castro::initData() 1 0.0472 0.09573 0.1628 4.60% check_for_negative_density() 10 0.02836 0.05916 0.1127 3.19% FabArray::ParallelCopy_finish() 41 0.03503 0.05936 0.08856 2.50% amrex::Copy() 193 0.06307 0.07635 0.08791 2.49% FabArray::setVal() 143 0.06265 0.07119 0.08511 2.41% Castro::reset_internal_energy(Fab) 1008 0.04657 0.04775 0.04851 1.37% Castro::normalize_species() 62 0.04125 0.04214 0.04323 1.22% FabArray::ParallelCopy_nowait() 41 0.0355 0.04063 0.04267 1.21% FillPatchIterator::Initialize 41 0.02792 0.03211 0.03696 1.05% StateData::FillBoundary(geom) 41 0.03018 0.03233 0.03382 0.96% Gravity::interpolate_monopole_grav() 21 0.02785 0.02973 0.03278 0.93% Castro::construct_new_gravity_source() 10 0.02105 0.02517 0.02964 0.84% Castro::initialize_do_advance() 10 0.01231 0.01731 0.02085 0.59% Castro::computeTemp() 63 0.01902 0.01952 0.01996 0.56% FabArray::Saxpy() 20 0.01093 0.0131 0.01467 0.41% Castro::initialize_advance() 10 0.004095 0.01023 0.01395 0.39% MultiFab::contains_nan() 20 0.01035 0.01138 0.01228 0.35% FabArray::setDomainBndry() 41 0.006799 0.009387 0.01174 0.33% VisMF::Write(FabArray) 2 0.00881 0.009313 0.01159 0.33% Castro::initMFs() 1 0.006262 0.007641 0.01071 0.30% Castro::construct_old_gravity_source() 10 0.006993 0.009436 0.01006 0.28% Amr::writePlotFile() 2 0.006116 0.008635 0.009184 0.26% StateData::define() 4 0.005306 0.006466 0.00913 0.26% Castro::construct_new_source() 50 0.00569 0.006258 0.006588 0.19% Castro::enforce_min_density() 62 0.005755 0.006016 0.006446 0.18% main() 1 0.003821 0.004417 0.004965 0.14% Castro::swap_state_time_levels() 10 0.003189 0.004231 0.00443 0.13% Gravity::get_new_grav_vector() 11 0.003048 0.003471 0.003873 0.11% Amr::coarseTimeStep() 10 0.001263 0.00235 0.003483 0.10% Castro::buildMetrics() 1 0.001477 0.001816 0.002597 0.07% Gravity::get_old_grav_vector() 10 0.001562 0.001931 0.00237 0.07% Castro::finalize_do_advance() 10 0.0005826 0.001227 0.001579 0.04% AmrLevel::FillPatch() 41 0.0007487 0.0008777 0.001013 0.03% Amr::InitAmr() 1 0.0003456 0.0004849 0.0007693 0.02% DistributionMapping::LeastUsedCPUs() 1 7.444e-06 0.0003188 0.000457 0.01% Amr::timeStep() 10 0.0001451 0.0002105 0.0003448 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002748 0.0002997 0.0003441 0.01% Castro::do_advance_ctu() 10 0.0001135 0.0001421 0.0001781 0.01% StateDataPhysBCFunct::() 41 9.191e-05 0.0001079 0.0001726 0.00% Castro::clean_state() 62 0.0001322 0.0001445 0.0001584 0.00% Castro::enforce_consistent_e() 1 8.02e-05 9.307e-05 0.0001188 0.00% FillPatchIterator::FillFromLevel0() 41 9.205e-05 0.0001042 0.0001154 0.00% Castro::do_old_sources() 10 7.038e-05 9.144e-05 0.000104 0.00% Castro::finalize_advance() 10 7.893e-05 8.791e-05 0.0001001 0.00% FabArray::ParallelCopy() 41 7.437e-05 8.099e-05 8.647e-05 0.00% Castro::construct_old_source() 50 5.639e-05 7.113e-05 7.889e-05 0.00% Castro::do_new_sources() 10 4.869e-05 6.482e-05 7.854e-05 0.00% Castro::Castro() 1 5.352e-05 6.494e-05 7.473e-05 0.00% Amr::writeSmallPlotFile() 1 3.048e-05 4.889e-05 7.443e-05 0.00% Amr::FinalizeInit() 1 3.936e-06 1.298e-05 7.092e-05 0.00% FillPatchSingleLevel 41 5.894e-05 6.312e-05 6.83e-05 0.00% FabArrayBase::getCPC() 41 4.335e-05 5.158e-05 6.322e-05 0.00% Castro::apply_source_to_state() 20 3.553e-05 4.889e-05 5.554e-05 0.00% Castro::construct_new_gravity() 10 2.84e-05 3.837e-05 5.299e-05 0.00% Castro::advance() 10 3.648e-05 4.449e-05 5.104e-05 0.00% Castro::subcycle_advance_ctu() 10 3.947e-05 4.652e-05 5.02e-05 0.00% Castro::construct_old_gravity() 10 2.918e-05 3.502e-05 4.139e-05 0.00% Castro::enforce_speed_limit() 62 2.668e-05 3.016e-05 3.834e-05 0.00% Castro::expand_state() 10 1.871e-05 2.529e-05 3.555e-05 0.00% FabArrayBase::CPC::define() 2 2.165e-05 2.637e-05 3.295e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.49e-05 2.042e-05 2.823e-05 0.00% Amr::defBaseLevel() 1 1.642e-05 2.277e-05 2.767e-05 0.00% Castro::check_for_nan() 20 2.171e-05 2.335e-05 2.602e-05 0.00% Castro::post_timestep() 10 1.167e-05 1.712e-05 2.502e-05 0.00% Gravity::set_mass_offset() 10 9.18e-06 1.362e-05 2.146e-05 0.00% Castro::post_init() 1 1.386e-05 1.578e-05 1.957e-05 0.00% Amr::initSubcycle() 1 9.663e-06 1.258e-05 1.947e-05 0.00% Gravity::swapTimeLevels() 10 6.717e-06 1.035e-05 1.853e-05 0.00% Castro::computeNewDt() 9 8.161e-06 9.343e-06 1.116e-05 0.00% Castro::create_source_corrector() 10 6.713e-06 8.188e-06 1.031e-05 0.00% Castro::retry_advance_ctu() 10 6.364e-06 7.555e-06 9.015e-06 0.00% Castro::FluxRegCrseInit 10 5.572e-06 7.316e-06 8.918e-06 0.00% Amr::init() 1 1.638e-06 2.751e-06 7.151e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.099e-06 5.227e-06 6.5e-06 0.00% Amr::InitializeInit() 1 1.846e-06 2.615e-06 5.073e-06 0.00% Castro::post_regrid() 1 1.768e-06 3.048e-06 4.905e-06 0.00% Castro::computeInitialDt() 2 3.097e-06 3.746e-06 4.521e-06 0.00% Castro::FluxRegFineAdd() 10 2.092e-06 2.22e-06 2.332e-06 0.00% Amr::initialInit() 1 1.289e-06 1.739e-06 2.245e-06 0.00% DistributionMapping::Distribute() 1 9.81e-07 1.215e-06 1.592e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.535 3.535 3.536 100.00% Amr::coarseTimeStep() 10 3.29 3.29 3.29 93.04% Amr::timeStep() 10 3.276 3.277 3.279 92.72% Castro::advance() 10 3.261 3.262 3.263 92.27% Castro::subcycle_advance_ctu() 10 3.175 3.185 3.193 90.30% Castro::do_advance_ctu() 10 3.175 3.185 3.193 90.30% Castro::construct_ctu_hydro_source() 10 2.437 2.441 2.443 69.09% Gravity::make_radial_gravity() 21 0.304 0.3115 0.3251 9.19% Amr::init() 1 0.2327 0.233 0.2331 6.59% Amr::initialInit() 1 0.2195 0.2199 0.2201 6.23% AmrLevel::FillPatch() 41 0.187 0.205 0.2182 6.17% Gravity::get_new_grav_vector() 11 0.2143 0.2154 0.2162 6.11% Castro::construct_old_gravity() 10 0.1794 0.1842 0.1965 5.56% Gravity::get_old_grav_vector() 10 0.1783 0.1834 0.1959 5.54% Castro::construct_new_gravity() 10 0.1902 0.1909 0.1919 5.43% Amr::InitializeInit() 1 0.06662 0.1178 0.1914 5.41% Amr::defBaseLevel() 1 0.06662 0.1178 0.1914 5.41% FillPatchIterator::Initialize 41 0.1554 0.1743 0.1896 5.36% Castro::initialize_do_advance() 10 0.157 0.1695 0.1783 5.04% Castro::estTimeStep() 21 0.04151 0.1096 0.1695 4.79% Castro::initData() 1 0.0511 0.09958 0.1671 4.73% FillPatchIterator::FillFromLevel0() 41 0.1088 0.1328 0.1549 4.38% FillPatchSingleLevel 41 0.1087 0.1326 0.1548 4.38% Amr::FinalizeInit() 1 0.02812 0.1021 0.1535 4.34% Castro::computeInitialDt() 2 0.002474 0.07636 0.1277 3.61% Castro::expand_state() 10 0.09984 0.1155 0.1252 3.54% FabArray::ParallelCopy() 41 0.07591 0.1001 0.1242 3.51% Castro::clean_state() 62 0.1129 0.1149 0.1165 3.29% check_for_negative_density() 10 0.02836 0.05916 0.1127 3.19% Castro::do_old_sources() 10 0.08683 0.09155 0.09481 2.68% FabArray::ParallelCopy_finish() 41 0.03503 0.05936 0.08856 2.50% amrex::Copy() 193 0.06307 0.07635 0.08791 2.49% FabArray::setVal() 143 0.06265 0.07119 0.08511 2.41% Castro::initialize_advance() 10 0.06414 0.07313 0.08337 2.36% Castro::do_new_sources() 10 0.05786 0.06654 0.07843 2.22% Castro::computeTemp() 63 0.06639 0.06757 0.06828 1.93% Castro::reset_internal_energy(MultiFab) 63 0.04685 0.04805 0.04881 1.38% Castro::reset_internal_energy(Fab) 1008 0.04657 0.04775 0.04851 1.37% Castro::normalize_species() 62 0.04125 0.04214 0.04323 1.22% FabArray::ParallelCopy_nowait() 41 0.03559 0.0407 0.04274 1.21% Castro::construct_new_source() 50 0.02724 0.03143 0.03622 1.02% StateDataPhysBCFunct::() 41 0.03028 0.03244 0.03399 0.96% Castro::finalize_do_advance() 10 0.01306 0.02544 0.03395 0.96% StateData::FillBoundary(geom) 41 0.03018 0.03233 0.03382 0.96% Gravity::interpolate_monopole_grav() 21 0.02785 0.02973 0.03278 0.93% Castro::construct_new_gravity_source() 10 0.02105 0.02517 0.02964 0.84% Castro::post_init() 1 0.02512 0.02534 0.02547 0.72% Amr::writePlotFile() 2 0.02049 0.0206 0.02085 0.59% Castro::post_timestep() 10 0.01536 0.01563 0.01593 0.45% Castro::Castro() 1 0.009705 0.01138 0.0151 0.43% Castro::apply_source_to_state() 20 0.01098 0.01315 0.0147 0.42% FabArray::Saxpy() 20 0.01093 0.0131 0.01467 0.41% Castro::check_for_nan() 20 0.01037 0.0114 0.0123 0.35% MultiFab::contains_nan() 20 0.01035 0.01138 0.01228 0.35% FabArray::setDomainBndry() 41 0.006799 0.009387 0.01174 0.33% VisMF::Write(FabArray) 2 0.00881 0.009313 0.01159 0.33% Castro::initMFs() 1 0.006262 0.007641 0.01071 0.30% Castro::construct_old_source() 50 0.00705 0.009507 0.01014 0.29% Castro::construct_old_gravity_source() 10 0.006993 0.009436 0.01006 0.28% AmrLevel::AmrLevel(dm) 1 0.005327 0.006487 0.009156 0.26% StateData::define() 4 0.005306 0.006466 0.00913 0.26% Castro::computeNewDt() 9 0.009002 0.009007 0.009014 0.25% Castro::enforce_min_density() 62 0.005755 0.006016 0.006446 0.18% Castro::finalize_advance() 10 0.002919 0.003687 0.004445 0.13% Castro::swap_state_time_levels() 10 0.003189 0.004231 0.00443 0.13% Castro::buildMetrics() 1 0.001588 0.00197 0.002823 0.08% Castro::post_regrid() 1 0.00147 0.001593 0.001758 0.05% Amr::InitAmr() 1 0.0003557 0.0004974 0.0007888 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.393e-05 0.0003252 0.0004648 0.01% DistributionMapping::LeastUsedCPUs() 1 7.444e-06 0.0003188 0.000457 0.01% Castro::enforce_consistent_e() 1 8.02e-05 9.307e-05 0.0001188 0.00% FabArrayBase::getCPC() 41 6.719e-05 7.795e-05 8.928e-05 0.00% Amr::writeSmallPlotFile() 1 3.048e-05 4.889e-05 7.443e-05 0.00% Castro::enforce_speed_limit() 62 2.668e-05 3.016e-05 3.834e-05 0.00% FabArrayBase::CPC::define() 2 2.165e-05 2.637e-05 3.295e-05 0.00% Gravity::set_mass_offset() 10 9.18e-06 1.362e-05 2.146e-05 0.00% Amr::initSubcycle() 1 9.663e-06 1.258e-05 1.947e-05 0.00% Gravity::swapTimeLevels() 10 6.717e-06 1.035e-05 1.853e-05 0.00% Castro::create_source_corrector() 10 6.713e-06 8.188e-06 1.031e-05 0.00% Castro::retry_advance_ctu() 10 6.364e-06 7.555e-06 9.015e-06 0.00% Castro::FluxRegCrseInit 10 5.572e-06 7.316e-06 8.918e-06 0.00% Castro::FluxRegFineAdd() 10 2.092e-06 2.22e-06 2.332e-06 0.00% DistributionMapping::Distribute() 1 9.81e-07 1.215e-06 1.592e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 30 B 36 B 48 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.02-34-g3525b4a3f27e) finalized