Initializing AMReX (24.03-8-gae3af4339425)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.03-8-gae3af4339425) initialized Starting run at 05:33:28 UTC on 2024-03-13. Successfully read inputs file ... Castro git describe: 24.03-4-ge94d82665 AMReX git describe: 24.03-8-gae3af4339 Microphysics git describe: 24.03-7-g124b71be reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.015645468 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.378869135 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.344300875 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.332066123 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.372441656 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.336452459 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.31436767 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.327627208 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.314009137 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.314483393 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.315855492 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.009448895 seconds Ending run at 05:33:32 UTC on 2024-03-13. Run time = 3.601936363 Run time without initialization = 3.365451331 Average number of zones advanced per microsecond: 0.779 Average number of zones advanced per microsecond per rank: 0.097 TinyProfiler total time across processes [min...avg...max]: 3.601 ... 3.601 ... 3.602 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.3351 2.3897 2.4671 68.49% Gravity::make_radial_gravity() 21 0.2991 0.3074 0.317 8.80% Castro::initData() 1 0.05287 0.1045 0.1642 4.56% check_for_negative_density() 10 0.02251 0.1037 0.1603 4.45% Castro::estTimeStep() 21 0.02714 0.09787 0.1579 4.38% amrex::Copy() 193 0.06175 0.07416 0.08134 2.26% FabArray::ParallelCopy_finish() 41 0.03986 0.05209 0.07839 2.18% FabArray::setVal() 143 0.05961 0.06522 0.07542 2.09% Castro::reset_internal_energy(Fab) 1008 0.04499 0.04777 0.05026 1.40% Castro::normalize_species() 62 0.0417 0.04273 0.04394 1.22% FabArray::ParallelCopy_nowait() 41 0.03385 0.03893 0.04036 1.12% StateData::FillBoundary(geom) 41 0.02929 0.031 0.03476 0.97% FillPatchIterator::Initialize 41 0.02758 0.03163 0.03442 0.96% Gravity::interpolate_monopole_grav() 21 0.0279 0.02952 0.03053 0.85% Castro::construct_new_gravity_source() 10 0.02158 0.02371 0.02561 0.71% Castro::computeTemp() 63 0.01856 0.01943 0.02018 0.56% Castro::initialize_do_advance() 10 0.01311 0.01679 0.01925 0.53% Amr::writePlotFile() 2 0.0102 0.01352 0.0161 0.45% FabArray::Saxpy() 20 0.01034 0.01155 0.01275 0.35% VisMF::Write(FabArray) 2 0.008185 0.009297 0.01245 0.35% Castro::initialize_advance() 10 0.005513 0.009902 0.01222 0.34% FabArray::setDomainBndry() 41 0.007734 0.009934 0.01208 0.34% MultiFab::contains_nan() 20 0.01006 0.011 0.01202 0.33% Castro::initMFs() 1 0.006504 0.007921 0.01023 0.28% Castro::construct_old_gravity_source() 10 0.006591 0.008825 0.009511 0.26% StateData::define() 4 0.005343 0.006566 0.008289 0.23% Castro::enforce_min_density() 62 0.007234 0.007476 0.008113 0.23% Castro::construct_new_source() 50 0.005485 0.005815 0.006024 0.17% Gravity::get_new_grav_vector() 11 0.003231 0.003919 0.005529 0.15% main() 1 0.003276 0.004089 0.004698 0.13% Castro::swap_state_time_levels() 10 0.002709 0.003866 0.004572 0.13% Amr::coarseTimeStep() 10 0.001765 0.002554 0.003006 0.08% Castro::buildMetrics() 1 0.001471 0.001851 0.002505 0.07% Gravity::get_old_grav_vector() 10 0.001609 0.001932 0.002222 0.06% Castro::finalize_do_advance() 10 0.000372 0.0009531 0.001344 0.04% AmrLevel::FillPatch() 41 0.0006466 0.0009115 0.001005 0.03% Amr::InitAmr() 1 0.0004148 0.0005607 0.0009341 0.03% DistributionMapping::LeastUsedCPUs() 1 2.931e-05 0.0004669 0.0006238 0.02% Amr::timeStep() 10 0.0001615 0.0002177 0.0004672 0.01% Castro::reset_internal_energy(MultiFab) 63 0.000286 0.0003014 0.0003152 0.01% Castro::clean_state() 62 0.0001437 0.0001677 0.0002027 0.01% Castro::do_advance_ctu() 10 0.0001299 0.0001495 0.0001787 0.00% Castro::enforce_consistent_e() 1 7.572e-05 9.316e-05 0.0001364 0.00% FillPatchIterator::FillFromLevel0() 41 0.000103 0.0001187 0.0001336 0.00% StateDataPhysBCFunct::() 41 9.27e-05 0.0001073 0.0001175 0.00% Castro::finalize_advance() 10 8.902e-05 0.0001049 0.0001126 0.00% Castro::do_old_sources() 10 7.378e-05 9.302e-05 0.0001058 0.00% Amr::FinalizeInit() 1 3.636e-06 1.814e-05 0.000102 0.00% Castro::Castro() 1 7.069e-05 8.79e-05 9.772e-05 0.00% FillPatchSingleLevel 41 7.16e-05 8.05e-05 9.446e-05 0.00% FabArray::ParallelCopy() 41 7.211e-05 8.213e-05 8.879e-05 0.00% Castro::construct_old_source() 50 5.123e-05 7.16e-05 8.429e-05 0.00% FabArrayBase::getCPC() 41 6.109e-05 6.633e-05 7.29e-05 0.00% Castro::do_new_sources() 10 5.428e-05 6.31e-05 7.262e-05 0.00% Amr::writeSmallPlotFile() 1 4.34e-05 5.183e-05 6.277e-05 0.00% Castro::apply_source_to_state() 20 3.433e-05 4.421e-05 5.692e-05 0.00% Castro::subcycle_advance_ctu() 10 4.108e-05 4.637e-05 5.611e-05 0.00% Castro::construct_new_gravity() 10 3.524e-05 4.123e-05 4.879e-05 0.00% Amr::defBaseLevel() 1 3.671e-05 4.464e-05 4.833e-05 0.00% Castro::advance() 10 4.145e-05 4.522e-05 4.81e-05 0.00% Castro::construct_old_gravity() 10 3.224e-05 3.789e-05 4.427e-05 0.00% Amr::initSubcycle() 1 9.747e-06 1.683e-05 4.385e-05 0.00% Castro::enforce_speed_limit() 62 2.501e-05 2.915e-05 3.56e-05 0.00% Castro::post_init() 1 1.356e-05 1.786e-05 3.3e-05 0.00% FabArrayBase::CPC::define() 2 2.495e-05 2.861e-05 3.101e-05 0.00% Castro::check_for_nan() 20 2.015e-05 2.265e-05 2.859e-05 0.00% Castro::expand_state() 10 2.127e-05 2.35e-05 2.516e-05 0.00% Castro::post_timestep() 10 1.222e-05 1.563e-05 2.318e-05 0.00% AmrLevel::AmrLevel(dm) 1 9.309e-06 1.369e-05 2.286e-05 0.00% Gravity::set_mass_offset() 10 1.122e-05 1.275e-05 1.46e-05 0.00% Gravity::swapTimeLevels() 10 8.304e-06 1.082e-05 1.239e-05 0.00% Castro::computeNewDt() 9 8.189e-06 9.583e-06 1.163e-05 0.00% Castro::create_source_corrector() 10 6.669e-06 8.207e-06 1.049e-05 0.00% Castro::retry_advance_ctu() 10 6.758e-06 7.997e-06 9.253e-06 0.00% Castro::FluxRegCrseInit 10 6.254e-06 7.528e-06 8.633e-06 0.00% Amr::initialInit() 1 1.641e-06 2.7e-06 7.455e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.623e-06 5.917e-06 7.332e-06 0.00% Castro::post_regrid() 1 2.73e-06 3.919e-06 7.262e-06 0.00% Amr::InitializeInit() 1 2.041e-06 2.836e-06 5.197e-06 0.00% Castro::computeInitialDt() 2 3.263e-06 3.781e-06 4.542e-06 0.00% Castro::FluxRegFineAdd() 10 1.994e-06 2.498e-06 3.094e-06 0.00% Amr::init() 1 1.599e-06 2.397e-06 2.787e-06 0.00% DistributionMapping::Distribute() 1 9.76e-07 1.419e-06 2.293e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.601 3.601 3.602 100.00% Amr::coarseTimeStep() 10 3.351 3.351 3.351 93.04% Amr::timeStep() 10 3.337 3.338 3.339 92.69% Castro::advance() 10 3.321 3.322 3.323 92.24% Castro::subcycle_advance_ctu() 10 3.242 3.25 3.257 90.41% Castro::do_advance_ctu() 10 3.242 3.25 3.257 90.41% Castro::construct_ctu_hydro_source() 10 2.512 2.516 2.52 69.96% Gravity::make_radial_gravity() 21 0.3146 0.3226 0.3297 9.15% Amr::init() 1 0.2353 0.2357 0.2359 6.55% Gravity::get_new_grav_vector() 11 0.2158 0.2189 0.223 6.19% Amr::initialInit() 1 0.2191 0.2199 0.2203 6.11% AmrLevel::FillPatch() 41 0.1747 0.1947 0.2036 5.65% Castro::construct_new_gravity() 10 0.1912 0.1937 0.1968 5.46% Castro::construct_old_gravity() 10 0.1817 0.186 0.1943 5.40% Gravity::get_old_grav_vector() 10 0.1811 0.1854 0.1937 5.38% Amr::InitializeInit() 1 0.07143 0.1272 0.1906 5.29% Amr::defBaseLevel() 1 0.07142 0.1272 0.1906 5.29% FillPatchIterator::Initialize 41 0.1458 0.1641 0.1786 4.96% Castro::initialize_do_advance() 10 0.1542 0.165 0.1716 4.77% Castro::initData() 1 0.05624 0.1084 0.1683 4.67% check_for_negative_density() 10 0.02251 0.1037 0.1603 4.45% Castro::estTimeStep() 21 0.02714 0.09787 0.1579 4.38% Amr::FinalizeInit() 1 0.02935 0.09267 0.1485 4.12% FillPatchIterator::FillFromLevel0() 41 0.1081 0.1225 0.142 3.94% FillPatchSingleLevel 41 0.108 0.1224 0.1419 3.94% Castro::computeInitialDt() 2 0.002645 0.06607 0.1219 3.39% Castro::clean_state() 62 0.1127 0.1169 0.1219 3.39% Castro::expand_state() 10 0.09765 0.1117 0.1198 3.33% FabArray::ParallelCopy() 41 0.07849 0.09119 0.1124 3.12% Castro::do_old_sources() 10 0.08604 0.08878 0.09067 2.52% amrex::Copy() 193 0.06175 0.07416 0.08134 2.26% FabArray::ParallelCopy_finish() 41 0.03986 0.05209 0.07839 2.18% Castro::initialize_advance() 10 0.06089 0.06792 0.07673 2.13% FabArray::setVal() 143 0.05961 0.06522 0.07542 2.09% Castro::computeTemp() 63 0.06384 0.06751 0.07074 1.96% Castro::do_new_sources() 10 0.05825 0.06304 0.07033 1.95% Castro::reset_internal_energy(MultiFab) 63 0.04528 0.04807 0.05056 1.40% Castro::reset_internal_energy(Fab) 1008 0.04499 0.04777 0.05026 1.40% Castro::normalize_species() 62 0.0417 0.04273 0.04394 1.22% FabArray::ParallelCopy_nowait() 41 0.03394 0.03902 0.04045 1.12% StateDataPhysBCFunct::() 41 0.0294 0.03111 0.03487 0.97% StateData::FillBoundary(geom) 41 0.02929 0.031 0.03476 0.97% Castro::construct_new_source() 50 0.02707 0.02952 0.03164 0.88% Gravity::interpolate_monopole_grav() 21 0.0279 0.02952 0.03053 0.85% Castro::finalize_do_advance() 10 0.01534 0.02312 0.02937 0.82% Castro::post_init() 1 0.02569 0.02624 0.02702 0.75% Amr::writePlotFile() 2 0.02459 0.02537 0.02605 0.72% Castro::construct_new_gravity_source() 10 0.02158 0.02371 0.02561 0.71% Castro::post_timestep() 10 0.0159 0.01612 0.01669 0.46% Castro::Castro() 1 0.009251 0.01174 0.01437 0.40% Castro::apply_source_to_state() 20 0.01038 0.01159 0.0128 0.36% FabArray::Saxpy() 20 0.01034 0.01155 0.01275 0.35% VisMF::Write(FabArray) 2 0.008185 0.009297 0.01245 0.35% FabArray::setDomainBndry() 41 0.007734 0.009934 0.01208 0.34% Castro::check_for_nan() 20 0.01008 0.01102 0.01204 0.33% MultiFab::contains_nan() 20 0.01006 0.011 0.01202 0.33% Castro::initMFs() 1 0.006504 0.007921 0.01023 0.28% Castro::computeNewDt() 9 0.009627 0.009647 0.009659 0.27% Castro::construct_old_source() 50 0.006642 0.008897 0.009595 0.27% Castro::construct_old_gravity_source() 10 0.006591 0.008825 0.009511 0.26% AmrLevel::AmrLevel(dm) 1 0.005354 0.00658 0.008308 0.23% StateData::define() 4 0.005343 0.006566 0.008289 0.23% Castro::enforce_min_density() 62 0.007234 0.007476 0.008113 0.23% Castro::swap_state_time_levels() 10 0.002709 0.003866 0.004572 0.13% Castro::finalize_advance() 10 0.002996 0.003397 0.004033 0.11% Castro::buildMetrics() 1 0.00159 0.002006 0.002729 0.08% Castro::post_regrid() 1 0.001491 0.001621 0.001847 0.05% Amr::InitAmr() 1 0.0004262 0.0005775 0.0009779 0.03% DistributionMapping::SFCProcessorMapDoIt() 1 3.88e-05 0.0004742 0.0006323 0.02% DistributionMapping::LeastUsedCPUs() 1 2.931e-05 0.0004669 0.0006238 0.02% Castro::enforce_consistent_e() 1 7.572e-05 9.316e-05 0.0001364 0.00% FabArrayBase::getCPC() 41 9.135e-05 9.494e-05 0.0001002 0.00% Amr::writeSmallPlotFile() 1 4.34e-05 5.183e-05 6.277e-05 0.00% Amr::initSubcycle() 1 9.747e-06 1.683e-05 4.385e-05 0.00% Castro::enforce_speed_limit() 62 2.501e-05 2.915e-05 3.56e-05 0.00% FabArrayBase::CPC::define() 2 2.495e-05 2.861e-05 3.101e-05 0.00% Gravity::set_mass_offset() 10 1.122e-05 1.275e-05 1.46e-05 0.00% Gravity::swapTimeLevels() 10 8.304e-06 1.082e-05 1.239e-05 0.00% Castro::create_source_corrector() 10 6.669e-06 8.207e-06 1.049e-05 0.00% Castro::retry_advance_ctu() 10 6.758e-06 7.997e-06 9.253e-06 0.00% Castro::FluxRegCrseInit 10 6.254e-06 7.528e-06 8.633e-06 0.00% Castro::FluxRegFineAdd() 10 1.994e-06 2.498e-06 3.094e-06 0.00% DistributionMapping::Distribute() 1 9.76e-07 1.419e-06 2.293e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 36 B 39 B 49 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.03-8-gae3af4339425) finalized