Initializing AMReX (v2024-33-g9e71c2cb9714)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (v2024-33-g9e71c2cb9714) initialized Starting run at 12:40:23 UTC on 2024-03-25. Successfully read inputs file ... Castro git describe: 24.03-30-g437ebcb19 AMReX git describe: v2024-33-g9e71c2cb9 Microphysics git describe: 24.03-21-g81de2adb reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.01511803 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.364876052 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.359519332 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.377568626 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.404419005 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.389683139 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.400421342 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.382168291 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.381993334 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.380965494 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.385864073 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010865549 seconds Ending run at 12:40:27 UTC on 2024-03-25. Run time = 4.049914088 Run time without initialization = 3.846279748 Average number of zones advanced per microsecond: 0.682 Average number of zones advanced per microsecond per rank: 0.085 TinyProfiler total time across processes [min...avg...max]: 4.048 ... 4.049 ... 4.05 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.5219 2.6496 2.8688 70.83% check_for_negative_density() 10 0.02127 0.2449 0.3713 9.17% Gravity::make_radial_gravity() 21 0.3 0.3166 0.3395 8.38% Castro::initData() 1 0.05688 0.09444 0.1351 3.33% Castro::estTimeStep() 21 0.02388 0.07032 0.1106 2.73% amrex::Copy() 193 0.07072 0.08818 0.09692 2.39% FabArray::setVal() 143 0.08378 0.08819 0.09394 2.32% FabArray::ParallelCopy_finish() 41 0.04099 0.05217 0.08107 2.00% Castro::reset_internal_energy(Fab) 1008 0.04545 0.04882 0.05191 1.28% FabArray::ParallelCopy_nowait() 41 0.04064 0.0453 0.04756 1.17% Castro::normalize_species() 62 0.04108 0.04212 0.04341 1.07% FillPatchIterator::Initialize 41 0.02586 0.03791 0.04256 1.05% StateData::FillBoundary(geom) 41 0.02855 0.0334 0.03948 0.97% Gravity::interpolate_monopole_grav() 21 0.0279 0.02915 0.03015 0.74% Castro::construct_new_gravity_source() 10 0.02466 0.02593 0.02757 0.68% Castro::computeTemp() 63 0.01793 0.01979 0.0221 0.55% Castro::initialize_do_advance() 10 0.01334 0.01982 0.022 0.54% Castro::initialize_advance() 10 0.01394 0.01501 0.0163 0.40% FabArray::Saxpy() 20 0.01339 0.01482 0.01605 0.40% VisMF::Write(FabArray) 2 0.009473 0.01102 0.01531 0.38% FabArray::setDomainBndry() 41 0.005915 0.01171 0.0153 0.38% MultiFab::contains_nan() 20 0.0115 0.01293 0.01504 0.37% Amr::writePlotFile() 2 0.007979 0.01189 0.01338 0.33% Castro::construct_old_gravity_source() 10 0.00882 0.01111 0.01257 0.31% Castro::initMFs() 1 0.006428 0.007494 0.007827 0.19% Castro::enforce_min_density() 62 0.007082 0.00753 0.007779 0.19% main() 1 0.005078 0.006229 0.007222 0.18% Castro::construct_new_source() 50 0.006536 0.006857 0.007093 0.18% StateData::define() 4 0.005266 0.006152 0.006564 0.16% Gravity::get_new_grav_vector() 11 0.003115 0.003859 0.004727 0.12% Castro::swap_state_time_levels() 10 0.003 0.004169 0.004363 0.11% Amr::coarseTimeStep() 10 0.0013 0.00198 0.002934 0.07% Gravity::get_old_grav_vector() 10 0.001396 0.002235 0.002708 0.07% Castro::buildMetrics() 1 0.001515 0.001698 0.001762 0.04% AmrLevel::FillPatch() 41 0.0009824 0.001173 0.001687 0.04% Castro::finalize_do_advance() 10 0.001114 0.001194 0.001583 0.04% Amr::InitAmr() 1 0.0003709 0.0004262 0.0005939 0.01% Amr::timeStep() 10 0.0001877 0.0002303 0.0003922 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002952 0.0003126 0.0003329 0.01% DistributionMapping::LeastUsedCPUs() 1 2.825e-05 0.0001929 0.0002403 0.01% Castro::clean_state() 62 0.0001586 0.0001792 0.0002002 0.00% FillPatchIterator::FillFromLevel0() 41 0.0001216 0.0001433 0.0001922 0.00% Castro::do_advance_ctu() 10 0.0001596 0.0001746 0.000186 0.00% Castro::finalize_advance() 10 0.0001044 0.0001275 0.0001448 0.00% Castro::do_old_sources() 10 9.273e-05 0.0001181 0.0001392 0.00% StateDataPhysBCFunct::() 41 0.0001093 0.0001225 0.0001341 0.00% FabArray::ParallelCopy() 41 7.992e-05 9.255e-05 0.0001195 0.00% Castro::construct_old_source() 50 7.681e-05 9.201e-05 0.0001139 0.00% Castro::Castro() 1 7.537e-05 9.239e-05 0.0001103 0.00% Amr::FinalizeInit() 1 4.252e-06 2.351e-05 0.0001058 0.00% Castro::enforce_consistent_e() 1 8.358e-05 9.156e-05 0.0001057 0.00% FillPatchSingleLevel 41 7.98e-05 8.584e-05 9.611e-05 0.00% FabArrayBase::getCPC() 41 5.705e-05 6.952e-05 8.524e-05 0.00% Castro::do_new_sources() 10 6.164e-05 7.34e-05 8.479e-05 0.00% Castro::apply_source_to_state() 20 4.634e-05 5.715e-05 6.912e-05 0.00% Castro::subcycle_advance_ctu() 10 4.877e-05 5.705e-05 6.513e-05 0.00% Castro::advance() 10 4.073e-05 5.297e-05 6.313e-05 0.00% Amr::writeSmallPlotFile() 1 3.07e-05 4.705e-05 5.756e-05 0.00% Amr::defBaseLevel() 1 3.732e-05 4.558e-05 5.417e-05 0.00% Castro::construct_new_gravity() 10 3.083e-05 3.941e-05 5.074e-05 0.00% Castro::construct_old_gravity() 10 3.529e-05 4.004e-05 4.659e-05 0.00% FabArrayBase::CPC::define() 2 2.865e-05 3.091e-05 3.414e-05 0.00% Castro::expand_state() 10 1.881e-05 2.705e-05 3.409e-05 0.00% Castro::enforce_speed_limit() 62 2.571e-05 2.799e-05 3.043e-05 0.00% Castro::check_for_nan() 20 2.214e-05 2.534e-05 2.982e-05 0.00% Castro::post_init() 1 9.832e-06 1.569e-05 2.754e-05 0.00% Gravity::set_mass_offset() 10 1.667e-05 1.982e-05 2.291e-05 0.00% Castro::post_timestep() 10 1.345e-05 1.497e-05 1.914e-05 0.00% Gravity::swapTimeLevels() 10 9.076e-06 1.325e-05 1.807e-05 0.00% AmrLevel::AmrLevel(dm) 1 9.794e-06 1.209e-05 1.484e-05 0.00% Castro::create_source_corrector() 10 8.333e-06 9.663e-06 1.408e-05 0.00% Castro::computeNewDt() 9 8.186e-06 9.638e-06 1.199e-05 0.00% Amr::initSubcycle() 1 1.051e-05 1.136e-05 1.182e-05 0.00% Castro::computeInitialDt() 2 3.543e-06 4.634e-06 1.03e-05 0.00% Castro::FluxRegCrseInit 10 7.207e-06 8.758e-06 9.8e-06 0.00% Castro::retry_advance_ctu() 10 6.785e-06 7.973e-06 9.618e-06 0.00% Amr::initialInit() 1 1.521e-06 2.947e-06 8.548e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.322e-06 4.965e-06 6.423e-06 0.00% Amr::InitializeInit() 1 2.79e-06 3.62e-06 6.352e-06 0.00% Castro::post_regrid() 1 1.971e-06 3.424e-06 5.222e-06 0.00% Amr::init() 1 1.702e-06 2.456e-06 3.297e-06 0.00% Castro::FluxRegFineAdd() 10 2.276e-06 2.799e-06 3.214e-06 0.00% DistributionMapping::Distribute() 1 1.077e-06 1.231e-06 1.44e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 4.048 4.049 4.05 100.00% Amr::coarseTimeStep() 10 3.828 3.828 3.828 94.53% Amr::timeStep() 10 3.815 3.816 3.817 94.24% Castro::advance() 10 3.8 3.8 3.8 93.84% Castro::subcycle_advance_ctu() 10 3.701 3.705 3.708 91.56% Castro::do_advance_ctu() 10 3.701 3.705 3.708 91.56% Castro::construct_ctu_hydro_source() 10 2.914 2.917 2.923 72.17% check_for_negative_density() 10 0.02127 0.2449 0.3713 9.17% Gravity::make_radial_gravity() 21 0.3169 0.3339 0.3537 8.73% Gravity::get_new_grav_vector() 11 0.2242 0.2262 0.2286 5.64% AmrLevel::FillPatch() 41 0.2056 0.2176 0.2268 5.60% Castro::construct_old_gravity() 10 0.1841 0.1958 0.2125 5.25% Gravity::get_old_grav_vector() 10 0.1835 0.1952 0.2119 5.23% Amr::init() 1 0.2029 0.2031 0.2031 5.02% Castro::construct_new_gravity() 10 0.1988 0.2004 0.2023 4.99% Castro::initialize_do_advance() 10 0.164 0.1806 0.1906 4.71% Amr::initialInit() 1 0.1874 0.1876 0.1876 4.63% FillPatchIterator::Initialize 41 0.1761 0.181 0.1854 4.58% Amr::InitializeInit() 1 0.07989 0.1163 0.1578 3.90% Amr::defBaseLevel() 1 0.07989 0.1163 0.1578 3.90% FillPatchIterator::FillFromLevel0() 41 0.1233 0.1314 0.1509 3.73% FillPatchSingleLevel 41 0.1232 0.1313 0.1507 3.72% Castro::initData() 1 0.06102 0.09841 0.1391 3.43% Castro::expand_state() 10 0.1114 0.1219 0.1287 3.18% Castro::clean_state() 62 0.1125 0.1178 0.1243 3.07% FabArray::ParallelCopy() 41 0.08805 0.09766 0.1219 3.01% Castro::estTimeStep() 21 0.02388 0.07032 0.1106 2.73% Castro::do_old_sources() 10 0.1017 0.1048 0.1079 2.66% Amr::FinalizeInit() 1 0.02976 0.0713 0.1077 2.66% amrex::Copy() 193 0.07072 0.08818 0.09692 2.39% Castro::initialize_advance() 10 0.08746 0.09055 0.09459 2.34% FabArray::setVal() 143 0.08378 0.08819 0.09394 2.32% FabArray::ParallelCopy_finish() 41 0.04099 0.05217 0.08107 2.00% Castro::computeInitialDt() 2 0.002322 0.04382 0.08019 1.98% Castro::computeTemp() 63 0.06376 0.06892 0.07434 1.84% Castro::do_new_sources() 10 0.06611 0.07 0.07391 1.82% Castro::reset_internal_energy(MultiFab) 63 0.04574 0.04913 0.05224 1.29% Castro::reset_internal_energy(Fab) 1008 0.04545 0.04882 0.05191 1.28% FabArray::ParallelCopy_nowait() 41 0.04075 0.0454 0.04766 1.18% Castro::normalize_species() 62 0.04108 0.04212 0.04341 1.07% StateDataPhysBCFunct::() 41 0.02868 0.03353 0.0396 0.98% StateData::FillBoundary(geom) 41 0.02855 0.0334 0.03948 0.97% Castro::construct_new_source() 50 0.03153 0.03279 0.03419 0.84% Gravity::interpolate_monopole_grav() 21 0.0279 0.02915 0.03015 0.74% Castro::construct_new_gravity_source() 10 0.02466 0.02593 0.02757 0.68% Castro::post_init() 1 0.02671 0.02693 0.02711 0.67% Amr::writePlotFile() 2 0.02627 0.02644 0.02665 0.66% Castro::finalize_do_advance() 10 0.01351 0.01851 0.02318 0.57% Castro::post_timestep() 10 0.01506 0.01572 0.01634 0.40% Castro::apply_source_to_state() 20 0.01344 0.01487 0.01611 0.40% FabArray::Saxpy() 20 0.01339 0.01482 0.01605 0.40% VisMF::Write(FabArray) 2 0.009473 0.01102 0.01531 0.38% FabArray::setDomainBndry() 41 0.005915 0.01171 0.0153 0.38% Castro::check_for_nan() 20 0.01153 0.01296 0.01506 0.37% MultiFab::contains_nan() 20 0.0115 0.01293 0.01504 0.37% Castro::construct_old_source() 50 0.008898 0.0112 0.01268 0.31% Castro::construct_old_gravity_source() 10 0.00882 0.01111 0.01257 0.31% Castro::Castro() 1 0.009491 0.01144 0.0121 0.30% Castro::computeNewDt() 9 0.009187 0.009203 0.00922 0.23% Castro::initMFs() 1 0.006428 0.007494 0.007827 0.19% Castro::enforce_min_density() 62 0.007082 0.00753 0.007779 0.19% AmrLevel::AmrLevel(dm) 1 0.005276 0.006164 0.006574 0.16% StateData::define() 4 0.005266 0.006152 0.006564 0.16% Castro::finalize_advance() 10 0.004046 0.004263 0.004518 0.11% Castro::swap_state_time_levels() 10 0.003 0.004169 0.004363 0.11% Castro::post_regrid() 1 0.001564 0.001672 0.001985 0.05% Castro::buildMetrics() 1 0.001637 0.001833 0.001911 0.05% Amr::InitAmr() 1 0.0003814 0.0004375 0.0006054 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 3.387e-05 0.0001991 0.0002479 0.01% DistributionMapping::LeastUsedCPUs() 1 2.825e-05 0.0001929 0.0002403 0.01% FabArrayBase::getCPC() 41 8.891e-05 0.0001004 0.0001187 0.00% Castro::enforce_consistent_e() 1 8.358e-05 9.156e-05 0.0001057 0.00% Amr::writeSmallPlotFile() 1 3.07e-05 4.705e-05 5.756e-05 0.00% FabArrayBase::CPC::define() 2 2.865e-05 3.091e-05 3.414e-05 0.00% Castro::enforce_speed_limit() 62 2.571e-05 2.799e-05 3.043e-05 0.00% Gravity::set_mass_offset() 10 1.667e-05 1.982e-05 2.291e-05 0.00% Gravity::swapTimeLevels() 10 9.076e-06 1.325e-05 1.807e-05 0.00% Castro::create_source_corrector() 10 8.333e-06 9.663e-06 1.408e-05 0.00% Amr::initSubcycle() 1 1.051e-05 1.136e-05 1.182e-05 0.00% Castro::FluxRegCrseInit 10 7.207e-06 8.758e-06 9.8e-06 0.00% Castro::retry_advance_ctu() 10 6.785e-06 7.973e-06 9.618e-06 0.00% Castro::FluxRegFineAdd() 10 2.276e-06 2.799e-06 3.214e-06 0.00% DistributionMapping::Distribute() 1 1.077e-06 1.231e-06 1.44e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 35 B 38 B 42 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-33-g9e71c2cb9714) finalized