Initializing AMReX (24.04-9-g2a3955a5f5aa)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.04-9-g2a3955a5f5aa) initialized Starting run at 05:21:31 UTC on 2024-04-10. Successfully read inputs file ... Castro git describe: 24.04-11-g2407e8176 AMReX git describe: 24.04-9-g2a3955a5f Microphysics git describe: 24.04-5-g43dc7a53 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.015084412 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.365465167 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.331903323 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.348828313 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.362817357 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.328764526 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.307207987 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.306997165 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.307301644 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.311086654 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.307713038 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.007484094 seconds Ending run at 05:21:34 UTC on 2024-04-10. Run time = 3.498001751 Run time without initialization = 3.29018217 Average number of zones advanced per microsecond: 0.797 Average number of zones advanced per microsecond per rank: 0.100 TinyProfiler total time across processes [min...avg...max]: 3.498 ... 3.498 ... 3.498 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2631 2.3450 2.3857 68.20% Gravity::make_radial_gravity() 21 0.2957 0.3027 0.3188 9.11% check_for_negative_density() 10 0.0321 0.07631 0.1627 4.65% Castro::initData() 1 0.05732 0.09545 0.1427 4.08% Castro::estTimeStep() 21 0.02654 0.07984 0.1221 3.49% FabArray::ParallelCopy_finish() 41 0.0398 0.05153 0.08612 2.46% amrex::Copy() 193 0.05981 0.07552 0.08414 2.41% FabArray::setVal() 143 0.06148 0.0693 0.08082 2.31% Castro::reset_internal_energy(Fab) 1008 0.04504 0.04696 0.04915 1.40% Castro::normalize_species() 62 0.04133 0.04222 0.04298 1.23% FabArray::ParallelCopy_nowait() 41 0.03326 0.03867 0.04083 1.17% FillPatchIterator::Initialize 41 0.02749 0.03171 0.03373 0.96% StateData::FillBoundary(geom) 41 0.02728 0.03087 0.03341 0.96% Gravity::interpolate_monopole_grav() 21 0.02779 0.02956 0.0308 0.88% Castro::construct_new_gravity_source() 10 0.02208 0.02441 0.02713 0.78% Castro::computeTemp() 63 0.01781 0.01926 0.02018 0.58% Castro::initialize_do_advance() 10 0.01271 0.01703 0.01951 0.56% VisMF::Write(FabArray) 2 0.009002 0.009677 0.01289 0.37% FabArray::Saxpy() 20 0.01033 0.0117 0.01262 0.36% Castro::initialize_advance() 10 0.005634 0.009905 0.01249 0.36% FabArray::setDomainBndry() 41 0.00847 0.01078 0.01188 0.34% MultiFab::contains_nan() 20 0.01054 0.01105 0.01184 0.34% Amr::writePlotFile() 2 0.008138 0.01012 0.01067 0.30% Castro::construct_old_gravity_source() 10 0.006637 0.008874 0.009444 0.27% Castro::initMFs() 1 0.007558 0.007793 0.008635 0.25% StateData::define() 4 0.006176 0.00632 0.006464 0.18% Castro::construct_new_source() 50 0.005174 0.005923 0.006305 0.18% Castro::enforce_min_density() 62 0.005684 0.005949 0.006225 0.18% Gravity::get_new_grav_vector() 11 0.003302 0.003973 0.005073 0.15% Castro::swap_state_time_levels() 10 0.001786 0.003991 0.004314 0.12% main() 1 0.003575 0.003816 0.003942 0.11% Amr::coarseTimeStep() 10 0.001861 0.002922 0.003539 0.10% Gravity::get_old_grav_vector() 10 0.001542 0.001933 0.002126 0.06% Castro::buildMetrics() 1 0.001697 0.001791 0.002068 0.06% Castro::finalize_do_advance() 10 0.0004344 0.001051 0.001556 0.04% AmrLevel::FillPatch() 41 0.0007224 0.001018 0.001154 0.03% Amr::InitAmr() 1 0.0004034 0.0004321 0.0005861 0.02% Amr::timeStep() 10 0.0001693 0.0002169 0.0004108 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002766 0.0002836 0.0002921 0.01% Castro::do_advance_ctu() 10 0.0001357 0.0001739 0.0001922 0.01% DistributionMapping::LeastUsedCPUs() 1 2.883e-05 0.0001618 0.0001912 0.01% Castro::clean_state() 62 0.0001433 0.0001652 0.0001893 0.01% Castro::Castro() 1 9.655e-05 0.0001205 0.0001541 0.00% StateDataPhysBCFunct::() 41 9.367e-05 0.0001059 0.0001209 0.00% Castro::finalize_advance() 10 9.643e-05 0.0001092 0.0001183 0.00% FillPatchIterator::FillFromLevel0() 41 0.0001013 0.0001095 0.0001151 0.00% Castro::do_old_sources() 10 7.611e-05 9.201e-05 0.0001081 0.00% Castro::enforce_consistent_e() 1 8.588e-05 9.132e-05 0.0001016 0.00% Amr::FinalizeInit() 1 3.496e-06 1.659e-05 0.0001 0.00% Castro::construct_old_source() 50 5.459e-05 7.847e-05 9.569e-05 0.00% FabArray::ParallelCopy() 41 6.635e-05 8.092e-05 8.854e-05 0.00% Castro::do_new_sources() 10 5.305e-05 6.344e-05 7.728e-05 0.00% FillPatchSingleLevel 41 6.713e-05 7.123e-05 7.486e-05 0.00% Amr::defBaseLevel() 1 4.839e-05 6.198e-05 7.406e-05 0.00% Amr::writeSmallPlotFile() 1 3.29e-05 4.969e-05 6.082e-05 0.00% FabArrayBase::getCPC() 41 5.084e-05 5.6e-05 6.079e-05 0.00% Castro::apply_source_to_state() 20 3.937e-05 4.608e-05 5.806e-05 0.00% Castro::subcycle_advance_ctu() 10 3.434e-05 4.543e-05 5.313e-05 0.00% Castro::advance() 10 3.586e-05 4.256e-05 4.622e-05 0.00% Castro::construct_new_gravity() 10 3.017e-05 3.492e-05 4.441e-05 0.00% Castro::enforce_speed_limit() 62 2.773e-05 3.337e-05 4.334e-05 0.00% Castro::construct_old_gravity() 10 3.338e-05 3.611e-05 4.166e-05 0.00% FabArrayBase::CPC::define() 2 2.663e-05 2.908e-05 3.239e-05 0.00% Castro::expand_state() 10 2.063e-05 2.288e-05 2.597e-05 0.00% Gravity::set_mass_offset() 10 1.224e-05 1.689e-05 2.303e-05 0.00% Castro::post_init() 1 9.607e-06 1.278e-05 2.192e-05 0.00% Castro::check_for_nan() 20 1.811e-05 1.972e-05 2.09e-05 0.00% Castro::post_timestep() 10 1.357e-05 1.556e-05 1.803e-05 0.00% AmrLevel::AmrLevel(dm) 1 9.976e-06 1.303e-05 1.63e-05 0.00% Gravity::swapTimeLevels() 10 6.691e-06 1.125e-05 1.373e-05 0.00% Amr::initSubcycle() 1 1.198e-05 1.245e-05 1.303e-05 0.00% Castro::computeNewDt() 9 8.155e-06 9.681e-06 1.209e-05 0.00% Castro::FluxRegCrseInit 10 6.79e-06 8.31e-06 1.018e-05 0.00% Castro::retry_advance_ctu() 10 7.43e-06 8.156e-06 9.167e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.062e-06 5.394e-06 8.439e-06 0.00% Castro::create_source_corrector() 10 6.45e-06 7.223e-06 8.142e-06 0.00% Castro::post_regrid() 1 2.299e-06 3.879e-06 7.014e-06 0.00% Amr::InitializeInit() 1 2.833e-06 3.942e-06 6.53e-06 0.00% Castro::computeInitialDt() 2 3.514e-06 4.297e-06 5.624e-06 0.00% Castro::FluxRegFineAdd() 10 2.385e-06 2.724e-06 3.139e-06 0.00% Amr::initialInit() 1 1.459e-06 2.028e-06 2.869e-06 0.00% Amr::init() 1 1.914e-06 2.291e-06 2.791e-06 0.00% DistributionMapping::Distribute() 1 1.126e-06 1.349e-06 2.337e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.498 3.498 3.498 100.00% Amr::coarseTimeStep() 10 3.279 3.279 3.279 93.73% Amr::timeStep() 10 3.264 3.265 3.266 93.37% Castro::advance() 10 3.249 3.249 3.25 92.91% Castro::subcycle_advance_ctu() 10 3.168 3.177 3.188 91.12% Castro::do_advance_ctu() 10 3.168 3.177 3.188 91.12% Castro::construct_ctu_hydro_source() 10 2.439 2.443 2.447 69.95% Gravity::make_radial_gravity() 21 0.3119 0.3184 0.3318 9.49% Gravity::get_new_grav_vector() 11 0.2122 0.2145 0.2161 6.18% AmrLevel::FillPatch() 41 0.1802 0.1955 0.2073 5.93% Amr::init() 1 0.2071 0.2072 0.2072 5.92% Castro::construct_old_gravity() 10 0.1824 0.1866 0.1966 5.62% Gravity::get_old_grav_vector() 10 0.1818 0.186 0.196 5.60% Castro::construct_new_gravity() 10 0.1904 0.1918 0.1932 5.52% Amr::initialInit() 1 0.1918 0.1924 0.1931 5.52% FillPatchIterator::Initialize 41 0.1494 0.164 0.183 5.23% Castro::initialize_do_advance() 10 0.1531 0.165 0.171 4.89% Amr::InitializeInit() 1 0.08104 0.1188 0.1658 4.74% Amr::defBaseLevel() 1 0.08103 0.1188 0.1658 4.74% check_for_negative_density() 10 0.0321 0.07631 0.1627 4.65% FillPatchIterator::FillFromLevel0() 41 0.1086 0.1215 0.1471 4.20% FillPatchSingleLevel 41 0.1085 0.1214 0.147 4.20% Castro::initData() 1 0.06195 0.09959 0.1468 4.20% Castro::estTimeStep() 21 0.02654 0.07984 0.1221 3.49% FabArray::ParallelCopy() 41 0.07845 0.09036 0.1195 3.42% Castro::expand_state() 10 0.09887 0.1119 0.1181 3.38% Castro::clean_state() 62 0.1109 0.1139 0.1174 3.36% Amr::FinalizeInit() 1 0.02653 0.07358 0.1113 3.18% Castro::do_old_sources() 10 0.08748 0.08937 0.09141 2.61% Castro::computeInitialDt() 2 0.00223 0.04919 0.08697 2.49% FabArray::ParallelCopy_finish() 41 0.0398 0.05153 0.08612 2.46% amrex::Copy() 193 0.05981 0.07552 0.08414 2.41% FabArray::setVal() 143 0.06148 0.0693 0.08082 2.31% Castro::initialize_advance() 10 0.05759 0.06907 0.07796 2.23% Castro::do_new_sources() 10 0.05879 0.06426 0.07079 2.02% Castro::computeTemp() 63 0.06399 0.0665 0.06961 1.99% Castro::reset_internal_energy(MultiFab) 63 0.04533 0.04724 0.04943 1.41% Castro::reset_internal_energy(Fab) 1008 0.04504 0.04696 0.04915 1.40% Castro::normalize_species() 62 0.04133 0.04222 0.04298 1.23% FabArray::ParallelCopy_nowait() 41 0.03334 0.03875 0.04091 1.17% StateDataPhysBCFunct::() 41 0.02737 0.03097 0.03353 0.96% StateData::FillBoundary(geom) 41 0.02728 0.03087 0.03341 0.96% Castro::construct_new_source() 50 0.02726 0.03033 0.03293 0.94% Gravity::interpolate_monopole_grav() 21 0.02779 0.02956 0.0308 0.88% Castro::finalize_do_advance() 10 0.01562 0.02183 0.02768 0.79% Castro::construct_new_gravity_source() 10 0.02208 0.02441 0.02713 0.78% Castro::post_init() 1 0.02338 0.02391 0.02455 0.70% Amr::writePlotFile() 2 0.02172 0.02238 0.02284 0.65% Castro::post_timestep() 10 0.01474 0.01548 0.01628 0.47% Castro::Castro() 1 0.01201 0.01264 0.01339 0.38% VisMF::Write(FabArray) 2 0.009002 0.009677 0.01289 0.37% Castro::apply_source_to_state() 20 0.01037 0.01174 0.01267 0.36% FabArray::Saxpy() 20 0.01033 0.0117 0.01262 0.36% FabArray::setDomainBndry() 41 0.00847 0.01078 0.01188 0.34% Castro::check_for_nan() 20 0.01056 0.01107 0.01186 0.34% MultiFab::contains_nan() 20 0.01054 0.01105 0.01184 0.34% Castro::computeNewDt() 9 0.009865 0.009885 0.009904 0.28% Castro::construct_old_source() 50 0.006691 0.008952 0.009529 0.27% Castro::construct_old_gravity_source() 10 0.006637 0.008874 0.009444 0.27% Castro::initMFs() 1 0.007558 0.007793 0.008635 0.25% AmrLevel::AmrLevel(dm) 1 0.00619 0.006333 0.006474 0.19% StateData::define() 4 0.006176 0.00632 0.006464 0.18% Castro::enforce_min_density() 62 0.005684 0.005949 0.006225 0.18% Castro::swap_state_time_levels() 10 0.001786 0.003991 0.004314 0.12% Castro::finalize_advance() 10 0.002953 0.003339 0.004108 0.12% Castro::buildMetrics() 1 0.00184 0.001939 0.002225 0.06% Castro::post_regrid() 1 0.001549 0.001576 0.001613 0.05% Amr::InitAmr() 1 0.0004161 0.0004446 0.0005983 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 3.411e-05 0.0001686 0.0001967 0.01% DistributionMapping::LeastUsedCPUs() 1 2.883e-05 0.0001618 0.0001912 0.01% Castro::enforce_consistent_e() 1 8.588e-05 9.132e-05 0.0001016 0.00% FabArrayBase::getCPC() 41 7.946e-05 8.507e-05 9.135e-05 0.00% Amr::writeSmallPlotFile() 1 3.29e-05 4.969e-05 6.082e-05 0.00% Castro::enforce_speed_limit() 62 2.773e-05 3.337e-05 4.334e-05 0.00% FabArrayBase::CPC::define() 2 2.663e-05 2.908e-05 3.239e-05 0.00% Gravity::set_mass_offset() 10 1.224e-05 1.689e-05 2.303e-05 0.00% Gravity::swapTimeLevels() 10 6.691e-06 1.125e-05 1.373e-05 0.00% Amr::initSubcycle() 1 1.198e-05 1.245e-05 1.303e-05 0.00% Castro::FluxRegCrseInit 10 6.79e-06 8.31e-06 1.018e-05 0.00% Castro::retry_advance_ctu() 10 7.43e-06 8.156e-06 9.167e-06 0.00% Castro::create_source_corrector() 10 6.45e-06 7.223e-06 8.142e-06 0.00% Castro::FluxRegFineAdd() 10 2.385e-06 2.724e-06 3.139e-06 0.00% DistributionMapping::Distribute() 1 1.126e-06 1.349e-06 2.337e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 37 B 43 B 48 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-9-g2a3955a5f5aa) finalized