Initializing AMReX (v2024-19-gc2b6e6b89c92)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (v2024-19-gc2b6e6b89c92) initialized Starting run at 05:32:16 UTC on 2024-03-19. Successfully read inputs file ... Castro git describe: 24.03-14-g710213e7d AMReX git describe: v2024-19-gc2b6e6b89 Microphysics git describe: 24.03-14-gd2554385 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.015620908 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.368528996 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.358141355 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.333947779 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.368784338 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.335246907 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.318660637 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.316335554 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.315598545 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.358282887 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.322880828 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.00877065 seconds Ending run at 05:32:20 UTC on 2024-03-19. Run time = 3.613926715 Run time without initialization = 3.41047383 Average number of zones advanced per microsecond: 0.769 Average number of zones advanced per microsecond per rank: 0.096 TinyProfiler total time across processes [min...avg...max]: 3.613 ... 3.613 ... 3.614 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2976 2.3954 2.4939 69.01% Gravity::make_radial_gravity() 21 0.3022 0.3091 0.3176 8.79% check_for_negative_density() 10 0.02028 0.1223 0.224 6.20% Castro::initData() 1 0.0573 0.0927 0.1335 3.69% Castro::estTimeStep() 21 0.03883 0.07523 0.1067 2.95% amrex::Copy() 193 0.0719 0.07849 0.08412 2.33% FabArray::setVal() 143 0.06382 0.07146 0.07962 2.20% FabArray::ParallelCopy_finish() 41 0.04354 0.05263 0.06033 1.67% Castro::reset_internal_energy(Fab) 1008 0.04652 0.04766 0.04898 1.36% Castro::normalize_species() 62 0.04093 0.04216 0.04425 1.22% FabArray::ParallelCopy_nowait() 41 0.03926 0.04104 0.04257 1.18% FillPatchIterator::Initialize 41 0.02849 0.03339 0.03498 0.97% StateData::FillBoundary(geom) 41 0.02904 0.03146 0.0344 0.95% Gravity::interpolate_monopole_grav() 21 0.0283 0.02929 0.02984 0.83% Castro::construct_new_gravity_source() 10 0.02285 0.02461 0.02874 0.80% Castro::initialize_do_advance() 10 0.01369 0.01774 0.02 0.55% Castro::computeTemp() 63 0.01893 0.01954 0.01998 0.55% FabArray::Saxpy() 20 0.01172 0.01279 0.01372 0.38% Castro::initialize_advance() 10 0.009726 0.01142 0.01326 0.37% FabArray::setDomainBndry() 41 0.007662 0.01067 0.01315 0.36% VisMF::Write(FabArray) 2 0.009174 0.009844 0.01282 0.35% Amr::writePlotFile() 2 0.008652 0.01167 0.01269 0.35% MultiFab::contains_nan() 20 0.009935 0.01086 0.01167 0.32% Castro::construct_old_gravity_source() 10 0.008234 0.009505 0.01014 0.28% Castro::initMFs() 1 0.007153 0.007777 0.008191 0.23% Castro::enforce_min_density() 62 0.007149 0.007373 0.007804 0.22% StateData::define() 4 0.00605 0.006651 0.007148 0.20% Castro::construct_new_source() 50 0.006152 0.006242 0.006343 0.18% Gravity::get_new_grav_vector() 11 0.00341 0.004368 0.005561 0.15% Castro::swap_state_time_levels() 10 0.002992 0.004249 0.004715 0.13% main() 1 0.003279 0.00382 0.004449 0.12% Amr::coarseTimeStep() 10 0.001267 0.002865 0.003625 0.10% Gravity::get_old_grav_vector() 10 0.001648 0.002062 0.002525 0.07% Castro::buildMetrics() 1 0.00165 0.001825 0.002075 0.06% Castro::finalize_do_advance() 10 0.001025 0.001227 0.001803 0.05% AmrLevel::FillPatch() 41 0.0007824 0.00095 0.001255 0.03% Amr::InitAmr() 1 0.0003704 0.0004253 0.0005959 0.02% Amr::timeStep() 10 0.0001694 0.0002171 0.0004319 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002813 0.0003016 0.000408 0.01% DistributionMapping::LeastUsedCPUs() 1 3.222e-05 0.0001899 0.0002514 0.01% Castro::clean_state() 62 0.000159 0.0001666 0.0001826 0.01% Castro::do_advance_ctu() 10 0.0001382 0.0001543 0.0001735 0.00% FillPatchIterator::FillFromLevel0() 41 0.0001077 0.0001221 0.0001391 0.00% StateDataPhysBCFunct::() 41 9.819e-05 0.0001116 0.0001344 0.00% Castro::finalize_advance() 10 0.0001003 0.0001052 0.0001117 0.00% Castro::enforce_consistent_e() 1 8.263e-05 8.988e-05 0.0001107 0.00% Castro::Castro() 1 8.554e-05 9.79e-05 0.0001063 0.00% Castro::construct_old_source() 50 7.362e-05 8.124e-05 0.0001014 0.00% Castro::do_old_sources() 10 8.986e-05 9.588e-05 0.0001014 0.00% FabArray::ParallelCopy() 41 7.644e-05 8.297e-05 8.945e-05 0.00% FillPatchSingleLevel 41 7.28e-05 8.098e-05 8.597e-05 0.00% Amr::FinalizeInit() 1 3.68e-06 1.435e-05 7.55e-05 0.00% FabArrayBase::getCPC() 41 6.025e-05 6.867e-05 7.367e-05 0.00% Castro::do_new_sources() 10 5.76e-05 6.482e-05 6.823e-05 0.00% Castro::advance() 10 4.104e-05 4.859e-05 5.962e-05 0.00% Amr::writeSmallPlotFile() 1 3.111e-05 4.916e-05 5.64e-05 0.00% Castro::apply_source_to_state() 20 4.405e-05 4.991e-05 5.624e-05 0.00% Castro::subcycle_advance_ctu() 10 3.978e-05 4.682e-05 5.607e-05 0.00% Castro::construct_new_gravity() 10 3.266e-05 4.072e-05 4.983e-05 0.00% Amr::defBaseLevel() 1 3.993e-05 4.295e-05 4.902e-05 0.00% Castro::construct_old_gravity() 10 3.303e-05 3.931e-05 4.36e-05 0.00% FabArrayBase::CPC::define() 2 2.902e-05 3.301e-05 3.977e-05 0.00% Castro::check_for_nan() 20 2.144e-05 2.514e-05 3.251e-05 0.00% Castro::enforce_speed_limit() 62 2.265e-05 2.652e-05 3.181e-05 0.00% Amr::initSubcycle() 1 1.057e-05 1.345e-05 2.955e-05 0.00% Castro::expand_state() 10 2.155e-05 2.605e-05 2.876e-05 0.00% Castro::post_init() 1 1.541e-05 1.754e-05 2.114e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.596e-05 1.83e-05 2.112e-05 0.00% Castro::post_timestep() 10 1.303e-05 1.527e-05 1.918e-05 0.00% Gravity::set_mass_offset() 10 9.814e-06 1.356e-05 1.736e-05 0.00% Castro::computeNewDt() 9 8.123e-06 1.095e-05 1.613e-05 0.00% Gravity::swapTimeLevels() 10 1e-05 1.132e-05 1.231e-05 0.00% Castro::create_source_corrector() 10 7.444e-06 8.571e-06 1.013e-05 0.00% Castro::retry_advance_ctu() 10 7.216e-06 8.259e-06 9.04e-06 0.00% Castro::FluxRegCrseInit 10 6.905e-06 7.4e-06 8.002e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.364e-06 5.419e-06 7.872e-06 0.00% Amr::InitializeInit() 1 2.06e-06 2.968e-06 5.459e-06 0.00% Castro::computeInitialDt() 2 3.227e-06 3.575e-06 3.905e-06 0.00% Castro::post_regrid() 1 2.319e-06 3.195e-06 3.888e-06 0.00% Castro::FluxRegFineAdd() 10 2.053e-06 2.431e-06 3.314e-06 0.00% Amr::init() 1 1.689e-06 2.409e-06 2.828e-06 0.00% Amr::initialInit() 1 1.451e-06 1.91e-06 2.331e-06 0.00% DistributionMapping::Distribute() 1 1.21e-06 1.309e-06 1.532e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.613 3.613 3.614 100.00% Amr::coarseTimeStep() 10 3.397 3.397 3.397 94.00% Amr::timeStep() 10 3.383 3.384 3.385 93.67% Castro::advance() 10 3.367 3.368 3.369 93.22% Castro::subcycle_advance_ctu() 10 3.286 3.292 3.296 91.21% Castro::do_advance_ctu() 10 3.286 3.292 3.296 91.21% Castro::construct_ctu_hydro_source() 10 2.537 2.539 2.546 70.44% Gravity::make_radial_gravity() 21 0.3184 0.3252 0.3314 9.17% check_for_negative_density() 10 0.02028 0.1223 0.224 6.20% Gravity::get_new_grav_vector() 11 0.2184 0.2215 0.2232 6.17% AmrLevel::FillPatch() 41 0.1869 0.2015 0.2141 5.93% Amr::init() 1 0.2027 0.2029 0.2029 5.62% Castro::construct_old_gravity() 10 0.1854 0.1896 0.1967 5.44% Castro::construct_new_gravity() 10 0.1927 0.1956 0.1964 5.43% Gravity::get_old_grav_vector() 10 0.1848 0.1889 0.196 5.42% Amr::initialInit() 1 0.1868 0.1872 0.1876 5.19% FillPatchIterator::Initialize 41 0.1582 0.1697 0.1795 4.97% Castro::initialize_do_advance() 10 0.155 0.1688 0.1769 4.89% Amr::InitializeInit() 1 0.08145 0.1157 0.1572 4.35% Amr::defBaseLevel() 1 0.08145 0.1157 0.1572 4.35% Castro::initData() 1 0.0612 0.09677 0.1375 3.80% FillPatchIterator::FillFromLevel0() 41 0.118 0.1256 0.134 3.71% FillPatchSingleLevel 41 0.1178 0.1255 0.1339 3.70% Castro::expand_state() 10 0.1023 0.1144 0.1235 3.42% Castro::clean_state() 62 0.1143 0.1163 0.1188 3.29% Castro::estTimeStep() 21 0.03883 0.07523 0.1067 2.95% Amr::FinalizeInit() 1 0.0296 0.07152 0.106 2.93% FabArray::ParallelCopy() 41 0.08437 0.09385 0.1012 2.80% Castro::do_old_sources() 10 0.08966 0.09282 0.09659 2.67% amrex::Copy() 193 0.0719 0.07849 0.08412 2.33% FabArray::setVal() 143 0.06382 0.07146 0.07962 2.20% Castro::initialize_advance() 10 0.06784 0.07258 0.0787 2.18% Castro::computeInitialDt() 2 0.002449 0.04406 0.07831 2.17% Castro::do_new_sources() 10 0.06164 0.06653 0.07547 2.09% Castro::computeTemp() 63 0.06579 0.06749 0.06925 1.92% FabArray::ParallelCopy_finish() 41 0.04354 0.05263 0.06033 1.67% Castro::reset_internal_energy(MultiFab) 63 0.0468 0.04796 0.04927 1.36% Castro::reset_internal_energy(Fab) 1008 0.04652 0.04766 0.04898 1.36% Castro::normalize_species() 62 0.04093 0.04216 0.04425 1.22% FabArray::ParallelCopy_nowait() 41 0.03937 0.04114 0.04268 1.18% Castro::construct_new_source() 50 0.02901 0.03086 0.03489 0.97% StateDataPhysBCFunct::() 41 0.02914 0.03158 0.03452 0.96% StateData::FillBoundary(geom) 41 0.02904 0.03146 0.0344 0.95% Gravity::interpolate_monopole_grav() 21 0.0283 0.02929 0.02984 0.83% Castro::construct_new_gravity_source() 10 0.02285 0.02461 0.02874 0.80% Castro::finalize_do_advance() 10 0.01407 0.02308 0.02845 0.79% Castro::post_init() 1 0.02671 0.02708 0.02753 0.76% Amr::writePlotFile() 2 0.02412 0.02452 0.02495 0.69% Castro::post_timestep() 10 0.01568 0.01589 0.01633 0.45% Castro::apply_source_to_state() 20 0.01177 0.01284 0.01378 0.38% FabArray::Saxpy() 20 0.01172 0.01279 0.01372 0.38% FabArray::setDomainBndry() 41 0.007662 0.01067 0.01315 0.36% Castro::Castro() 1 0.01052 0.012 0.01283 0.35% VisMF::Write(FabArray) 2 0.009174 0.009844 0.01282 0.35% Castro::check_for_nan() 20 0.009959 0.01088 0.01169 0.32% MultiFab::contains_nan() 20 0.009935 0.01086 0.01167 0.32% Castro::construct_old_source() 50 0.008308 0.009586 0.01022 0.28% Castro::construct_old_gravity_source() 10 0.008234 0.009505 0.01014 0.28% Castro::computeNewDt() 9 0.009322 0.009336 0.009352 0.26% Castro::initMFs() 1 0.007153 0.007777 0.008191 0.23% Castro::enforce_min_density() 62 0.007149 0.007373 0.007804 0.22% AmrLevel::AmrLevel(dm) 1 0.006067 0.006669 0.007169 0.20% StateData::define() 4 0.00605 0.006651 0.007148 0.20% Castro::swap_state_time_levels() 10 0.002992 0.004249 0.004715 0.13% Castro::finalize_advance() 10 0.003016 0.003462 0.004142 0.11% Castro::buildMetrics() 1 0.001795 0.001981 0.002256 0.06% Castro::post_regrid() 1 0.00152 0.001645 0.001827 0.05% Amr::InitAmr() 1 0.0003814 0.0004387 0.0006072 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 3.803e-05 0.0001966 0.0002602 0.01% DistributionMapping::LeastUsedCPUs() 1 3.222e-05 0.0001899 0.0002514 0.01% FabArrayBase::getCPC() 41 9.049e-05 0.0001017 0.0001134 0.00% Castro::enforce_consistent_e() 1 8.263e-05 8.988e-05 0.0001107 0.00% Amr::writeSmallPlotFile() 1 3.111e-05 4.916e-05 5.64e-05 0.00% FabArrayBase::CPC::define() 2 2.902e-05 3.301e-05 3.977e-05 0.00% Castro::enforce_speed_limit() 62 2.265e-05 2.652e-05 3.181e-05 0.00% Amr::initSubcycle() 1 1.057e-05 1.345e-05 2.955e-05 0.00% Gravity::set_mass_offset() 10 9.814e-06 1.356e-05 1.736e-05 0.00% Gravity::swapTimeLevels() 10 1e-05 1.132e-05 1.231e-05 0.00% Castro::create_source_corrector() 10 7.444e-06 8.571e-06 1.013e-05 0.00% Castro::retry_advance_ctu() 10 7.216e-06 8.259e-06 9.04e-06 0.00% Castro::FluxRegCrseInit 10 6.905e-06 7.4e-06 8.002e-06 0.00% Castro::FluxRegFineAdd() 10 2.053e-06 2.431e-06 3.314e-06 0.00% DistributionMapping::Distribute() 1 1.21e-06 1.309e-06 1.532e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 35 B 41 B 52 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-19-gc2b6e6b89c92) finalized