Initializing AMReX (23.11-17-g9e35dc19489d)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.11-17-g9e35dc19489d) initialized Starting run at 06:25:43 UTC on 2023-11-21. Successfully read inputs file ... Castro git describe: 23.11-6-gb720d68fa AMReX git describe: 23.11-17-g9e35dc194 Microphysics git describe: 23.11-9-ge9e31f40 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.019372766 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.451851334 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.423259721 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.393679026 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.39729427 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.413198883 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.393985129 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.392995328 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.394902653 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.393878153 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.419096575 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.015893011 seconds Ending run at 06:25:47 UTC on 2023-11-21. Run time = 4.339046485 Run time without initialization = 4.098012512 Average number of zones advanced per microsecond: 0.640 Average number of zones advanced per microsecond per rank: 0.080 TinyProfiler total time across processes [min...avg...max]: 4.338 ... 4.339 ... 4.339 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.5033 2.8006 2.9965 69.06% check_for_negative_density() 10 0.007894 0.2093 0.5125 11.81% Gravity::make_radial_gravity() 21 0.2873 0.3056 0.3239 7.47% amrex::Copy() 193 0.09646 0.1194 0.1362 3.14% Castro::initData() 1 0.04967 0.08478 0.1196 2.76% FabArray::setVal() 143 0.08888 0.1029 0.1115 2.57% FabArray::ParallelCopy_finish() 41 0.05522 0.07177 0.11 2.54% Castro::estTimeStep() 21 0.02175 0.06354 0.09158 2.11% FabArray::ParallelCopy_nowait() 41 0.05528 0.06229 0.06912 1.59% FillPatchIterator::Initialize 41 0.04805 0.05541 0.06269 1.44% Castro::reset_internal_energy(Fab) 1008 0.05061 0.05231 0.05417 1.25% StateData::FillBoundary(geom) 41 0.03412 0.04029 0.04892 1.13% Castro::normalize_species() 62 0.04201 0.04297 0.04495 1.04% Amr::InitAmr() 1 0.0002685 0.005352 0.04088 0.94% DistributionMapping::LeastUsedCPUs() 1 1.023e-05 0.03554 0.04062 0.94% Castro::construct_new_gravity_source() 10 0.0279 0.03068 0.03455 0.80% Gravity::interpolate_monopole_grav() 21 0.02825 0.02906 0.02966 0.68% Castro::initialize_do_advance() 10 0.02291 0.02594 0.0284 0.65% FabArray::setDomainBndry() 41 0.01501 0.0208 0.02326 0.54% Castro::computeTemp() 63 0.01984 0.02156 0.02275 0.52% FabArray::Saxpy() 20 0.01794 0.01923 0.02037 0.47% Amr::writePlotFile() 2 0.01204 0.01562 0.0186 0.43% VisMF::Write(FabArray) 2 0.01311 0.01517 0.01833 0.42% Castro::initialize_advance() 10 0.01423 0.01613 0.01793 0.41% MultiFab::contains_nan() 20 0.01227 0.01449 0.01593 0.37% Castro::construct_old_gravity_source() 10 0.01412 0.01516 0.01572 0.36% Castro::initMFs() 1 0.008744 0.008944 0.009285 0.21% Castro::construct_new_source() 50 0.006862 0.008164 0.009168 0.21% StateData::define() 4 0.007231 0.007329 0.00781 0.18% Castro::enforce_min_density() 62 0.007108 0.007327 0.007611 0.18% main() 1 0.005538 0.006626 0.007117 0.16% Castro::swap_state_time_levels() 10 0.003946 0.005919 0.006739 0.16% Gravity::get_new_grav_vector() 11 0.004118 0.00545 0.006552 0.15% Amr::coarseTimeStep() 10 0.001226 0.002263 0.003539 0.08% Gravity::get_old_grav_vector() 10 0.002667 0.00298 0.00336 0.08% Castro::buildMetrics() 1 0.001982 0.002028 0.002092 0.05% Castro::finalize_do_advance() 10 0.0009028 0.001433 0.001815 0.04% AmrLevel::FillPatch() 41 0.001016 0.001267 0.001456 0.03% Amr::timeStep() 10 0.0001656 0.0002534 0.0004562 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0003239 0.0003386 0.0003578 0.01% Castro::do_advance_ctu() 10 0.0001649 0.0002019 0.0002349 0.01% Castro::clean_state() 62 0.000186 0.0002064 0.0002269 0.01% StateDataPhysBCFunct::() 41 0.0001236 0.0001518 0.0001925 0.00% FillPatchIterator::FillFromLevel0() 41 0.0001404 0.0001645 0.0001915 0.00% Castro::Castro() 1 0.0001087 0.0001365 0.0001644 0.00% Castro::finalize_advance() 10 0.0001095 0.0001318 0.0001621 0.00% Castro::do_old_sources() 10 9.406e-05 0.0001296 0.0001604 0.00% FabArray::ParallelCopy() 41 9.796e-05 0.0001167 0.0001387 0.00% Castro::construct_old_source() 50 8.176e-05 0.0001012 0.0001324 0.00% Castro::enforce_consistent_e() 1 8.537e-05 0.0001023 0.0001174 0.00% FillPatchSingleLevel 41 8.065e-05 9.554e-05 0.0001154 0.00% Amr::FinalizeInit() 1 4.24e-06 1.929e-05 0.0001078 0.00% Castro::do_new_sources() 10 7.16e-05 8.679e-05 0.0001023 0.00% Castro::subcycle_advance_ctu() 10 5.682e-05 7.285e-05 0.000102 0.00% FabArrayBase::getCPC() 41 6.952e-05 8.137e-05 9.486e-05 0.00% Castro::advance() 10 5.126e-05 6.108e-05 8.488e-05 0.00% Castro::apply_source_to_state() 20 6.239e-05 7.219e-05 8.425e-05 0.00% Castro::construct_new_gravity() 10 3.491e-05 4.519e-05 6.208e-05 0.00% Castro::expand_state() 10 3.479e-05 4.298e-05 5.623e-05 0.00% Amr::writeSmallPlotFile() 1 3.568e-05 4.855e-05 5.621e-05 0.00% Castro::construct_old_gravity() 10 3.477e-05 4.674e-05 5.458e-05 0.00% FabArrayBase::CPC::define() 2 2.285e-05 3.285e-05 4.545e-05 0.00% Castro::enforce_speed_limit() 62 2.793e-05 3.644e-05 4.144e-05 0.00% Amr::defBaseLevel() 1 2.332e-05 3.239e-05 4.053e-05 0.00% Castro::check_for_nan() 20 2.396e-05 2.976e-05 3.495e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.608e-05 2.23e-05 3.171e-05 0.00% Castro::post_timestep() 10 1.423e-05 1.816e-05 2.365e-05 0.00% Gravity::swapTimeLevels() 10 9.569e-06 1.494e-05 2.267e-05 0.00% Castro::post_init() 1 1.501e-05 1.739e-05 2.091e-05 0.00% Gravity::set_mass_offset() 10 8.93e-06 1.451e-05 1.993e-05 0.00% Castro::create_source_corrector() 10 1.006e-05 1.397e-05 1.979e-05 0.00% Castro::FluxRegCrseInit 10 6.505e-06 9.367e-06 1.269e-05 0.00% Amr::initSubcycle() 1 1.02e-05 1.078e-05 1.166e-05 0.00% Castro::computeNewDt() 9 7.795e-06 9.107e-06 1.061e-05 0.00% Castro::retry_advance_ctu() 10 5.961e-06 8.008e-06 9.723e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.768e-06 5.901e-06 6.814e-06 0.00% Castro::post_regrid() 1 2.005e-06 3.382e-06 5.875e-06 0.00% Amr::InitializeInit() 1 2.072e-06 2.601e-06 5.553e-06 0.00% Castro::computeInitialDt() 2 4.019e-06 4.682e-06 5.263e-06 0.00% Castro::FluxRegFineAdd() 10 2.029e-06 2.889e-06 3.884e-06 0.00% Amr::initialInit() 1 1.657e-06 2.053e-06 3.206e-06 0.00% Amr::init() 1 2.251e-06 2.839e-06 3.112e-06 0.00% DistributionMapping::Distribute() 1 9.48e-07 1.024e-06 1.094e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 4.338 4.339 4.339 100.00% Amr::coarseTimeStep() 10 4.075 4.075 4.075 93.91% Amr::timeStep() 10 4.061 4.062 4.063 93.64% Castro::advance() 10 4.045 4.046 4.047 93.27% Castro::subcycle_advance_ctu() 10 3.937 3.942 3.952 91.09% Castro::do_advance_ctu() 10 3.937 3.942 3.952 91.08% Castro::construct_ctu_hydro_source() 10 3.025 3.032 3.037 70.00% check_for_negative_density() 10 0.007894 0.2093 0.5125 11.81% Gravity::make_radial_gravity() 21 0.3138 0.3321 0.3482 8.02% AmrLevel::FillPatch() 41 0.2853 0.3003 0.3143 7.24% FillPatchIterator::Initialize 41 0.2426 0.2512 0.2632 6.06% Castro::initialize_do_advance() 10 0.2271 0.2413 0.2519 5.80% Amr::init() 1 0.2 0.2355 0.2406 5.55% Gravity::get_new_grav_vector() 11 0.2296 0.2318 0.234 5.39% Castro::construct_old_gravity() 10 0.1929 0.2082 0.2216 5.11% Amr::initialInit() 1 0.1804 0.2162 0.2214 5.10% Gravity::get_old_grav_vector() 10 0.1918 0.2072 0.2208 5.09% Castro::construct_new_gravity() 10 0.2023 0.2038 0.2052 4.73% FillPatchIterator::FillFromLevel0() 41 0.1637 0.175 0.2001 4.61% FillPatchSingleLevel 41 0.1635 0.1748 0.1999 4.61% Amr::InitializeInit() 1 0.07911 0.1497 0.1893 4.36% Amr::defBaseLevel() 1 0.0791 0.1497 0.1893 4.36% Castro::expand_state() 10 0.1551 0.1705 0.184 4.24% FabArray::ParallelCopy() 41 0.1205 0.1343 0.1655 3.82% Castro::do_old_sources() 10 0.1353 0.1388 0.1416 3.26% amrex::Copy() 193 0.09646 0.1194 0.1362 3.14% Castro::clean_state() 62 0.1207 0.1238 0.1261 2.91% Castro::initData() 1 0.05448 0.09004 0.125 2.88% FabArray::setVal() 143 0.08888 0.1029 0.1115 2.57% FabArray::ParallelCopy_finish() 41 0.05522 0.07177 0.11 2.54% Castro::initialize_advance() 10 0.08868 0.0994 0.1047 2.41% Amr::FinalizeInit() 1 0.03209 0.06643 0.1013 2.33% Castro::estTimeStep() 21 0.02175 0.06354 0.09158 2.11% Castro::do_new_sources() 10 0.06931 0.07739 0.08456 1.95% Castro::computeTemp() 63 0.07126 0.07421 0.07692 1.77% Castro::computeInitialDt() 2 0.00225 0.03674 0.07183 1.66% FabArray::ParallelCopy_nowait() 41 0.05539 0.06241 0.06924 1.60% Castro::reset_internal_energy(MultiFab) 63 0.05095 0.05265 0.05449 1.26% Castro::reset_internal_energy(Fab) 1008 0.05061 0.05231 0.05417 1.25% StateDataPhysBCFunct::() 41 0.03425 0.04045 0.04907 1.13% StateData::FillBoundary(geom) 41 0.03412 0.04029 0.04892 1.13% Castro::normalize_species() 62 0.04201 0.04297 0.04495 1.04% Castro::construct_new_source() 50 0.03488 0.03884 0.04372 1.01% Amr::InitAmr() 1 0.0002789 0.005362 0.04089 0.94% DistributionMapping::SFCProcessorMapDoIt() 1 1.505e-05 0.03555 0.04063 0.94% DistributionMapping::LeastUsedCPUs() 1 1.023e-05 0.03554 0.04062 0.94% Amr::writePlotFile() 2 0.03523 0.03538 0.03559 0.82% Castro::construct_new_gravity_source() 10 0.0279 0.03068 0.03455 0.80% Gravity::interpolate_monopole_grav() 21 0.02825 0.02906 0.02966 0.68% Castro::post_init() 1 0.02887 0.02921 0.02957 0.68% Castro::finalize_do_advance() 10 0.01143 0.01898 0.02866 0.66% FabArray::setDomainBndry() 41 0.01501 0.0208 0.02326 0.54% Castro::apply_source_to_state() 20 0.01801 0.0193 0.02044 0.47% FabArray::Saxpy() 20 0.01794 0.01923 0.02037 0.47% VisMF::Write(FabArray) 2 0.01311 0.01517 0.01833 0.42% Castro::Castro() 1 0.0164 0.01676 0.01725 0.40% Castro::post_timestep() 10 0.01549 0.01586 0.01641 0.38% Castro::check_for_nan() 20 0.0123 0.01452 0.01597 0.37% MultiFab::contains_nan() 20 0.01227 0.01449 0.01593 0.37% Castro::construct_old_source() 50 0.01422 0.01526 0.01581 0.36% Castro::construct_old_gravity_source() 10 0.01412 0.01516 0.01572 0.36% Castro::initMFs() 1 0.008744 0.008944 0.009285 0.21% Castro::computeNewDt() 9 0.009252 0.009263 0.009274 0.21% AmrLevel::AmrLevel(dm) 1 0.00725 0.007351 0.007839 0.18% StateData::define() 4 0.007231 0.007329 0.00781 0.18% Castro::enforce_min_density() 62 0.007108 0.007327 0.007611 0.18% Castro::swap_state_time_levels() 10 0.003946 0.005919 0.006739 0.16% Castro::finalize_advance() 10 0.004016 0.004547 0.005036 0.12% Castro::buildMetrics() 1 0.002127 0.002196 0.002256 0.05% Castro::post_regrid() 1 0.001497 0.00169 0.002069 0.05% FabArrayBase::getCPC() 41 9.371e-05 0.0001142 0.0001403 0.00% Castro::enforce_consistent_e() 1 8.537e-05 0.0001023 0.0001174 0.00% Amr::writeSmallPlotFile() 1 3.568e-05 4.855e-05 5.621e-05 0.00% FabArrayBase::CPC::define() 2 2.285e-05 3.285e-05 4.545e-05 0.00% Castro::enforce_speed_limit() 62 2.793e-05 3.644e-05 4.144e-05 0.00% Gravity::swapTimeLevels() 10 9.569e-06 1.494e-05 2.267e-05 0.00% Gravity::set_mass_offset() 10 8.93e-06 1.451e-05 1.993e-05 0.00% Castro::create_source_corrector() 10 1.006e-05 1.397e-05 1.979e-05 0.00% Castro::FluxRegCrseInit 10 6.505e-06 9.367e-06 1.269e-05 0.00% Amr::initSubcycle() 1 1.02e-05 1.078e-05 1.166e-05 0.00% Castro::retry_advance_ctu() 10 5.961e-06 8.008e-06 9.723e-06 0.00% Castro::FluxRegFineAdd() 10 2.029e-06 2.889e-06 3.884e-06 0.00% DistributionMapping::Distribute() 1 9.48e-07 1.024e-06 1.094e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 27 B 34 B 68 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.11-17-g9e35dc19489d) finalized