Initializing AMReX (24.02-30-g2ecafcff4013)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.02-30-g2ecafcff4013) initialized Starting run at 06:33:02 UTC on 2024-02-29. Successfully read inputs file ... Castro git describe: 24.02-26-g582f93d7e AMReX git describe: 24.02-30-g2ecafcff4 Microphysics git describe: 24.02-31-ge587300c reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.012794337 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.353275401 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.345543643 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.334955912 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.334218602 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.33546778 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.372560813 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.317200809 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.312385627 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.312705779 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.313251852 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.073723538 seconds Ending run at 06:33:06 UTC on 2024-02-29. Run time = 3.601999673 Run time without initialization = 3.410364068 Average number of zones advanced per microsecond: 0.769 Average number of zones advanced per microsecond per rank: 0.096 TinyProfiler total time across processes [min...avg...max]: 3.601 ... 3.602 ... 3.602 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2961 2.3677 2.4276 67.39% Gravity::make_radial_gravity() 21 0.2912 0.311 0.3324 9.23% check_for_negative_density() 10 0.01708 0.08207 0.1596 4.43% Castro::initData() 1 0.04734 0.08683 0.1306 3.62% Castro::estTimeStep() 21 0.0316 0.07224 0.1155 3.21% amrex::Copy() 193 0.06327 0.08174 0.09743 2.70% FabArray::ParallelCopy_finish() 41 0.04556 0.05631 0.08639 2.40% FabArray::setVal() 143 0.06648 0.07164 0.07846 2.18% Amr::writePlotFile() 2 0.07261 0.07467 0.07591 2.11% Castro::reset_internal_energy(Fab) 1008 0.04445 0.04758 0.04892 1.36% FabArray::ParallelCopy_nowait() 41 0.03426 0.04132 0.04305 1.20% Castro::normalize_species() 62 0.04106 0.04201 0.04271 1.19% StateData::FillBoundary(geom) 41 0.02901 0.03287 0.03681 1.02% FillPatchIterator::Initialize 41 0.02625 0.03318 0.03567 0.99% Gravity::interpolate_monopole_grav() 21 0.02761 0.02907 0.03029 0.84% Castro::construct_new_gravity_source() 10 0.02118 0.02351 0.02502 0.69% Castro::computeTemp() 63 0.01788 0.01974 0.02051 0.57% Castro::initialize_do_advance() 10 0.01102 0.01686 0.01882 0.52% Castro::initialize_advance() 10 0.008613 0.01199 0.01519 0.42% MultiFab::contains_nan() 20 0.009893 0.01204 0.01511 0.42% FabArray::Saxpy() 20 0.01066 0.01277 0.01414 0.39% VisMF::Write(FabArray) 2 0.008614 0.009116 0.01136 0.32% FabArray::setDomainBndry() 41 0.006525 0.009385 0.0104 0.29% Castro::construct_old_gravity_source() 10 0.006499 0.009365 0.01018 0.28% Castro::initMFs() 1 0.006366 0.006818 0.008086 0.22% Castro::construct_new_source() 50 0.005721 0.00636 0.006732 0.19% Castro::enforce_min_density() 62 0.005625 0.005995 0.006323 0.18% StateData::define() 4 0.005285 0.005497 0.006033 0.17% Castro::swap_state_time_levels() 10 0.003163 0.004155 0.00477 0.13% main() 1 0.003597 0.004132 0.004463 0.12% Gravity::get_new_grav_vector() 11 0.002735 0.00344 0.003932 0.11% Amr::coarseTimeStep() 10 0.001479 0.002064 0.003025 0.08% Gravity::get_old_grav_vector() 10 0.00144 0.002002 0.002384 0.07% Castro::buildMetrics() 1 0.001503 0.001565 0.001734 0.05% Castro::finalize_do_advance() 10 0.0005723 0.0009994 0.001267 0.04% AmrLevel::FillPatch() 41 0.0007418 0.0008818 0.0009996 0.03% Amr::InitAmr() 1 0.0003496 0.0003872 0.0005454 0.02% Amr::timeStep() 10 0.0001563 0.0001998 0.0003343 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002641 0.0002849 0.0003069 0.01% DistributionMapping::LeastUsedCPUs() 1 7.613e-06 0.0001674 0.0002051 0.01% StateDataPhysBCFunct::() 41 8.221e-05 0.0001358 0.0001963 0.01% Castro::do_advance_ctu() 10 0.0001174 0.0001412 0.0001672 0.00% Castro::clean_state() 62 0.0001302 0.0001447 0.0001515 0.00% Castro::enforce_consistent_e() 1 8.089e-05 9.818e-05 0.0001491 0.00% Castro::finalize_advance() 10 7.728e-05 9.714e-05 0.0001241 0.00% FillPatchIterator::FillFromLevel0() 41 9.663e-05 0.0001076 0.0001226 0.00% Castro::do_old_sources() 10 6.902e-05 8.518e-05 9.787e-05 0.00% Amr::FinalizeInit() 1 3.737e-06 1.581e-05 9.318e-05 0.00% Castro::do_new_sources() 10 4.713e-05 6.326e-05 8.733e-05 0.00% Castro::construct_old_source() 50 4.941e-05 7.116e-05 8.533e-05 0.00% FillPatchSingleLevel 41 5.88e-05 6.871e-05 8.254e-05 0.00% FabArray::ParallelCopy() 41 6.319e-05 7.161e-05 8.25e-05 0.00% Castro::Castro() 1 5.513e-05 6.803e-05 7.937e-05 0.00% Amr::writeSmallPlotFile() 1 3.104e-05 5.413e-05 6.506e-05 0.00% FabArrayBase::getCPC() 41 3.788e-05 4.602e-05 5.556e-05 0.00% Castro::subcycle_advance_ctu() 10 4.221e-05 4.652e-05 5.259e-05 0.00% Castro::advance() 10 3.656e-05 4.539e-05 5.164e-05 0.00% Castro::construct_old_gravity() 10 2.934e-05 3.839e-05 4.993e-05 0.00% Castro::apply_source_to_state() 20 3.659e-05 4.328e-05 4.92e-05 0.00% Castro::construct_new_gravity() 10 3.162e-05 3.487e-05 4.459e-05 0.00% Castro::expand_state() 10 2.026e-05 2.646e-05 3.469e-05 0.00% FabArrayBase::CPC::define() 2 2.066e-05 2.553e-05 3.308e-05 0.00% Amr::defBaseLevel() 1 1.748e-05 2.446e-05 3.066e-05 0.00% Castro::enforce_speed_limit() 62 2.355e-05 2.804e-05 3.025e-05 0.00% Amr::initSubcycle() 1 9.07e-06 1.186e-05 2.727e-05 0.00% Castro::check_for_nan() 20 2.106e-05 2.302e-05 2.437e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.176e-05 1.514e-05 1.743e-05 0.00% Castro::post_init() 1 1.43e-05 1.548e-05 1.662e-05 0.00% Castro::post_timestep() 10 1.181e-05 1.433e-05 1.654e-05 0.00% Gravity::swapTimeLevels() 10 7.424e-06 9.379e-06 1.385e-05 0.00% Gravity::set_mass_offset() 10 7.963e-06 1.002e-05 1.17e-05 0.00% Castro::create_source_corrector() 10 6.956e-06 8.718e-06 1.113e-05 0.00% Castro::computeNewDt() 9 7.384e-06 8.682e-06 1.103e-05 0.00% Castro::computeInitialDt() 2 2.968e-06 7.35e-06 9.922e-06 0.00% Castro::retry_advance_ctu() 10 6.945e-06 7.839e-06 8.718e-06 0.00% Castro::FluxRegCrseInit 10 5.181e-06 7.233e-06 8.512e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.191e-06 6.106e-06 7.068e-06 0.00% Amr::InitializeInit() 1 1.762e-06 2.862e-06 5.926e-06 0.00% Castro::post_regrid() 1 2.116e-06 3.503e-06 4.559e-06 0.00% Castro::FluxRegFineAdd() 10 1.975e-06 2.432e-06 3.432e-06 0.00% Amr::init() 1 1.897e-06 2.348e-06 2.893e-06 0.00% Amr::initialInit() 1 1.397e-06 1.858e-06 2.694e-06 0.00% DistributionMapping::Distribute() 1 8.54e-07 1.137e-06 1.652e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.601 3.602 3.602 100.00% Amr::coarseTimeStep() 10 3.332 3.332 3.332 92.51% Amr::timeStep() 10 3.319 3.32 3.321 92.19% Castro::advance() 10 3.304 3.304 3.305 91.74% Castro::subcycle_advance_ctu() 10 3.224 3.227 3.229 89.65% Castro::do_advance_ctu() 10 3.224 3.227 3.229 89.65% Castro::construct_ctu_hydro_source() 10 2.466 2.471 2.476 68.75% Gravity::make_radial_gravity() 21 0.3072 0.3275 0.3462 9.61% Castro::construct_old_gravity() 10 0.1842 0.2004 0.2158 5.99% Gravity::get_old_grav_vector() 10 0.1832 0.1997 0.2153 5.98% Gravity::get_new_grav_vector() 11 0.2095 0.2114 0.2132 5.92% AmrLevel::FillPatch() 41 0.1921 0.2071 0.2132 5.92% Amr::init() 1 0.1909 0.1911 0.1911 5.31% Castro::construct_new_gravity() 10 0.1879 0.1889 0.1899 5.27% Castro::initialize_do_advance() 10 0.1565 0.1726 0.1871 5.19% FillPatchIterator::Initialize 41 0.1586 0.1735 0.1828 5.08% Amr::initialInit() 1 0.178 0.1783 0.1786 4.96% check_for_negative_density() 10 0.01708 0.08207 0.1596 4.43% Amr::InitializeInit() 1 0.06745 0.1075 0.152 4.22% Amr::defBaseLevel() 1 0.06745 0.1075 0.152 4.22% FillPatchIterator::FillFromLevel0() 41 0.1236 0.131 0.1501 4.17% FillPatchSingleLevel 41 0.1235 0.1308 0.15 4.16% Castro::initData() 1 0.05133 0.09089 0.1341 3.72% Castro::expand_state() 10 0.1105 0.1179 0.1292 3.59% FabArray::ParallelCopy() 41 0.08826 0.09777 0.1208 3.35% Castro::clean_state() 62 0.1094 0.1149 0.1179 3.27% Castro::estTimeStep() 21 0.0316 0.07224 0.1155 3.21% Amr::FinalizeInit() 1 0.02607 0.07088 0.1111 3.08% Castro::do_old_sources() 10 0.09318 0.09749 0.1009 2.80% amrex::Copy() 193 0.06327 0.08174 0.09743 2.70% Castro::computeInitialDt() 2 0.002229 0.04683 0.08689 2.41% Amr::writePlotFile() 2 0.08636 0.08656 0.08678 2.41% FabArray::ParallelCopy_finish() 41 0.04556 0.05631 0.08639 2.40% FabArray::setVal() 143 0.06648 0.07164 0.07846 2.18% Castro::initialize_advance() 10 0.07168 0.07405 0.07713 2.14% Castro::computeTemp() 63 0.06262 0.0676 0.06951 1.93% Castro::do_new_sources() 10 0.05967 0.06294 0.06777 1.88% Castro::reset_internal_energy(MultiFab) 63 0.04473 0.04786 0.0492 1.37% Castro::reset_internal_energy(Fab) 1008 0.04445 0.04758 0.04892 1.36% FabArray::ParallelCopy_nowait() 41 0.03433 0.04139 0.04312 1.20% Castro::normalize_species() 62 0.04106 0.04201 0.04271 1.19% StateDataPhysBCFunct::() 41 0.02912 0.03301 0.03696 1.03% StateData::FillBoundary(geom) 41 0.02901 0.03287 0.03681 1.02% Castro::construct_new_source() 50 0.0269 0.02987 0.03171 0.88% Gravity::interpolate_monopole_grav() 21 0.02761 0.02907 0.03029 0.84% Castro::construct_new_gravity_source() 10 0.02118 0.02351 0.02502 0.69% Castro::post_init() 1 0.02317 0.02349 0.02375 0.66% Castro::finalize_do_advance() 10 0.01117 0.01744 0.02125 0.59% Castro::post_timestep() 10 0.01484 0.01562 0.01608 0.45% Castro::check_for_nan() 20 0.009917 0.01207 0.01514 0.42% MultiFab::contains_nan() 20 0.009893 0.01204 0.01511 0.42% Castro::apply_source_to_state() 20 0.0107 0.01282 0.01419 0.39% FabArray::Saxpy() 20 0.01066 0.01277 0.01414 0.39% Castro::Castro() 1 0.01054 0.01085 0.01169 0.32% VisMF::Write(FabArray) 2 0.008614 0.009116 0.01136 0.32% FabArray::setDomainBndry() 41 0.006525 0.009385 0.0104 0.29% Castro::construct_old_source() 50 0.006548 0.009436 0.01027 0.29% Castro::construct_old_gravity_source() 10 0.006499 0.009365 0.01018 0.28% Castro::computeNewDt() 9 0.008967 0.008982 0.008987 0.25% Castro::initMFs() 1 0.006366 0.006818 0.008086 0.22% Castro::enforce_min_density() 62 0.005625 0.005995 0.006323 0.18% AmrLevel::AmrLevel(dm) 1 0.005302 0.005512 0.006048 0.17% StateData::define() 4 0.005285 0.005497 0.006033 0.17% Castro::swap_state_time_levels() 10 0.003163 0.004155 0.00477 0.13% Castro::finalize_advance() 10 0.003156 0.003358 0.003586 0.10% Castro::post_regrid() 1 0.001542 0.001697 0.002217 0.06% Castro::buildMetrics() 1 0.001626 0.001705 0.0019 0.05% Amr::InitAmr() 1 0.0003596 0.0003991 0.0005562 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.281e-05 0.0001746 0.0002133 0.01% DistributionMapping::LeastUsedCPUs() 1 7.613e-06 0.0001674 0.0002051 0.01% Castro::enforce_consistent_e() 1 8.089e-05 9.818e-05 0.0001491 0.00% FabArrayBase::getCPC() 41 6.195e-05 7.155e-05 8.61e-05 0.00% Amr::writeSmallPlotFile() 1 3.104e-05 5.413e-05 6.506e-05 0.00% FabArrayBase::CPC::define() 2 2.066e-05 2.553e-05 3.308e-05 0.00% Castro::enforce_speed_limit() 62 2.355e-05 2.804e-05 3.025e-05 0.00% Amr::initSubcycle() 1 9.07e-06 1.186e-05 2.727e-05 0.00% Gravity::swapTimeLevels() 10 7.424e-06 9.379e-06 1.385e-05 0.00% Gravity::set_mass_offset() 10 7.963e-06 1.002e-05 1.17e-05 0.00% Castro::create_source_corrector() 10 6.956e-06 8.718e-06 1.113e-05 0.00% Castro::retry_advance_ctu() 10 6.945e-06 7.839e-06 8.718e-06 0.00% Castro::FluxRegCrseInit 10 5.181e-06 7.233e-06 8.512e-06 0.00% Castro::FluxRegFineAdd() 10 1.975e-06 2.432e-06 3.432e-06 0.00% DistributionMapping::Distribute() 1 8.54e-07 1.137e-06 1.652e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 27 B 33 B 43 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.02-30-g2ecafcff4013) finalized