MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.08-31-g435281069858) initialized Starting run at 05:20:58 UTC on 2023-08-18. Successfully read inputs file ... Castro git describe: 23.08-6-g41b0e2684 AMReX git describe: 23.08-31-g435281069 Microphysics git describe: 23.08-11-g9ecfd8d2 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.014443023 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.378252164 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.358467793 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.32895623 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.329911122 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.35697152 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.339170873 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.313616342 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.310098553 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.312308813 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.314540652 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010177562 seconds Ending run at 05:21:02 UTC on 2023-08-18. Run time = 3.578406374 Run time without initialization = 3.357244996 Average number of zones advanced per microsecond: 0.781 Average number of zones advanced per microsecond per rank: 0.098 TinyProfiler total time across processes [min...avg...max]: 3.577 ... 3.578 ... 3.578 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2814 2.3537 2.4098 67.34% Gravity::make_radial_gravity() 21 0.3232 0.3306 0.3465 9.68% check_for_negative_density() 10 0.02846 0.08702 0.1635 4.57% Castro::initData() 1 0.03864 0.08537 0.146 4.08% Castro::estTimeStep() 21 0.03621 0.1008 0.1409 3.94% FabArray::ParallelCopy_finish() 41 0.03684 0.0536 0.09173 2.56% amrex::Copy() 193 0.06216 0.07763 0.08492 2.37% FabArray::setVal() 143 0.05971 0.07038 0.08241 2.30% Castro::reset_internal_energy(Fab) 1008 0.04752 0.04915 0.05043 1.41% Castro::normalize_species() 62 0.04078 0.04208 0.04421 1.24% FabArray::ParallelCopy_nowait() 41 0.03461 0.04014 0.0422 1.18% StateData::FillBoundary(geom) 41 0.03522 0.03758 0.04039 1.13% FillPatchIterator::Initialize 41 0.02698 0.03151 0.03379 0.94% Gravity::interpolate_monopole_grav() 21 0.02825 0.02878 0.02939 0.82% Castro::construct_new_gravity_source() 10 0.02245 0.02488 0.02883 0.81% Castro::initialize_do_advance() 10 0.01159 0.01724 0.01995 0.56% Castro::computeTemp() 63 0.01852 0.01941 0.01989 0.56% VisMF::Write(FabArray) 2 0.01221 0.01332 0.01611 0.45% FabArray::Saxpy() 20 0.01119 0.01321 0.01412 0.39% Castro::initialize_advance() 10 0.004149 0.0106 0.01368 0.38% FabArray::setDomainBndry() 41 0.008895 0.01148 0.01314 0.37% MultiFab::contains_nan() 20 0.009962 0.01074 0.01147 0.32% Amr::writePlotFile() 2 0.006004 0.008817 0.01107 0.31% Castro::construct_old_gravity_source() 10 0.007136 0.009961 0.01083 0.30% Castro::initMFs() 1 0.006035 0.007189 0.009629 0.27% StateData::define() 4 0.005048 0.006266 0.008774 0.25% Castro::enforce_min_density() 62 0.007293 0.007676 0.008158 0.23% Castro::construct_new_source() 50 0.005762 0.006415 0.006724 0.19% Gravity::get_new_grav_vector() 11 0.002917 0.003744 0.005728 0.16% Castro::swap_state_time_levels() 10 0.003119 0.004034 0.004371 0.12% main() 1 0.003056 0.003773 0.004164 0.12% Amr::coarseTimeStep() 10 0.001558 0.00245 0.003065 0.09% Gravity::get_old_grav_vector() 10 0.001661 0.002056 0.002549 0.07% Castro::buildMetrics() 1 0.001467 0.001817 0.002524 0.07% Castro::finalize_do_advance() 10 0.0004083 0.0009592 0.001166 0.03% AmrLevel::FillPatch() 41 0.0006711 0.0007231 0.0007625 0.02% Amr::InitAmr() 1 0.000276 0.0003828 0.000576 0.02% Amr::timeStep() 10 0.0001577 0.0002397 0.0004031 0.01% DistributionMapping::LeastUsedCPUs() 1 7.509e-06 0.0002369 0.0003517 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002893 0.0003092 0.0003504 0.01% Castro::clean_state() 62 0.0001452 0.0001736 0.0002176 0.01% Castro::do_advance_ctu() 10 0.0001421 0.0001594 0.0001744 0.00% Castro::finalize_advance() 10 8.792e-05 0.0001084 0.000129 0.00% FillPatchIterator::FillFromLevel0() 41 9.632e-05 0.000103 0.0001142 0.00% Castro::do_old_sources() 10 8.555e-05 9.645e-05 0.000111 0.00% StateDataPhysBCFunct::() 41 8.015e-05 9.302e-05 0.0001056 0.00% Castro::enforce_consistent_e() 1 8.117e-05 8.732e-05 0.0001024 0.00% Castro::construct_old_source() 50 5.244e-05 7.19e-05 9.608e-05 0.00% Amr::FinalizeInit() 1 4.469e-06 1.639e-05 8.82e-05 0.00% FabArray::ParallelCopy() 41 6.622e-05 7.078e-05 8.097e-05 0.00% FillPatchSingleLevel 41 6.559e-05 7.273e-05 7.871e-05 0.00% Castro::Castro() 1 5.554e-05 6.606e-05 7.57e-05 0.00% FabArrayBase::getCPC() 41 4.628e-05 5.737e-05 7.337e-05 0.00% Castro::do_new_sources() 10 5.838e-05 6.495e-05 7.104e-05 0.00% Amr::writeSmallPlotFile() 1 2.958e-05 5.243e-05 6.404e-05 0.00% Castro::apply_source_to_state() 20 4.251e-05 4.747e-05 6.052e-05 0.00% Castro::subcycle_advance_ctu() 10 4.505e-05 5.057e-05 5.561e-05 0.00% Castro::construct_old_gravity() 10 3.973e-05 4.589e-05 5.345e-05 0.00% Castro::advance() 10 3.867e-05 4.479e-05 5.041e-05 0.00% Castro::construct_new_gravity() 10 3.584e-05 4.114e-05 4.966e-05 0.00% Amr::defBaseLevel() 1 2.581e-05 3.352e-05 4.781e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.177e-05 2.258e-05 3.866e-05 0.00% Castro::enforce_speed_limit() 62 2.909e-05 3.304e-05 3.732e-05 0.00% FabArrayBase::CPC::define() 2 2.153e-05 2.478e-05 2.805e-05 0.00% Castro::expand_state() 10 1.92e-05 2.313e-05 2.592e-05 0.00% Castro::check_for_nan() 20 2.048e-05 2.195e-05 2.344e-05 0.00% Amr::initSubcycle() 1 9.303e-06 1.246e-05 1.953e-05 0.00% Gravity::swapTimeLevels() 10 1.147e-05 1.433e-05 1.77e-05 0.00% Castro::post_timestep() 10 1.366e-05 1.473e-05 1.661e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.841e-06 6.229e-06 1.582e-05 0.00% Gravity::set_mass_offset() 10 9.536e-06 1.109e-05 1.376e-05 0.00% Castro::computeNewDt() 9 9.914e-06 1.172e-05 1.306e-05 0.00% Castro::create_source_corrector() 10 6.836e-06 8.186e-06 9.234e-06 0.00% Castro::retry_advance_ctu() 10 6.476e-06 7.853e-06 9.112e-06 0.00% Castro::FluxRegCrseInit 10 6.143e-06 7.428e-06 8.911e-06 0.00% Castro::computeInitialDt() 2 4.253e-06 4.894e-06 5.767e-06 0.00% Castro::post_regrid() 1 2.234e-06 4.452e-06 5.565e-06 0.00% Amr::InitializeInit() 1 1.988e-06 2.71e-06 5.061e-06 0.00% Castro::post_init() 1 3.119e-06 3.982e-06 4.699e-06 0.00% Castro::FluxRegFineAdd() 10 1.943e-06 2.529e-06 2.987e-06 0.00% Amr::init() 1 1.728e-06 2.244e-06 2.696e-06 0.00% Amr::initialInit() 1 1.491e-06 1.771e-06 2.195e-06 0.00% DistributionMapping::Distribute() 1 9.58e-07 1.246e-06 1.592e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.577 3.578 3.578 100.00% Amr::coarseTimeStep() 10 3.343 3.343 3.343 93.42% Amr::timeStep() 10 3.329 3.33 3.331 93.08% Castro::advance() 10 3.313 3.314 3.315 92.64% Castro::subcycle_advance_ctu() 10 3.229 3.238 3.253 90.90% Castro::do_advance_ctu() 10 3.229 3.238 3.253 90.89% Castro::construct_ctu_hydro_source() 10 2.46 2.462 2.466 68.92% Gravity::make_radial_gravity() 21 0.3392 0.3471 0.3595 10.05% Gravity::get_new_grav_vector() 11 0.227 0.2313 0.2338 6.53% AmrLevel::FillPatch() 41 0.1803 0.2054 0.2226 6.22% Amr::init() 1 0.2204 0.2206 0.2207 6.17% Castro::construct_old_gravity() 10 0.1906 0.1991 0.2087 5.83% Gravity::get_old_grav_vector() 10 0.1898 0.1985 0.2081 5.82% Castro::construct_new_gravity() 10 0.2015 0.205 0.2066 5.77% Amr::initialInit() 1 0.2056 0.2061 0.2065 5.77% FillPatchIterator::Initialize 41 0.1525 0.1747 0.1989 5.56% Castro::initialize_do_advance() 10 0.1568 0.1726 0.1825 5.10% Amr::InitializeInit() 1 0.05897 0.1073 0.1758 4.91% Amr::defBaseLevel() 1 0.05897 0.1073 0.1758 4.91% check_for_negative_density() 10 0.02846 0.08702 0.1635 4.57% FillPatchIterator::FillFromLevel0() 41 0.1141 0.1318 0.1631 4.56% FillPatchSingleLevel 41 0.114 0.1316 0.1629 4.55% Castro::initData() 1 0.04234 0.08965 0.1529 4.27% Amr::FinalizeInit() 1 0.02976 0.09886 0.1472 4.11% Castro::estTimeStep() 21 0.03621 0.1008 0.1409 3.94% Castro::expand_state() 10 0.09925 0.1184 0.1301 3.64% FabArray::ParallelCopy() 41 0.07774 0.0939 0.1265 3.54% Castro::clean_state() 62 0.1141 0.1178 0.1216 3.40% Castro::computeInitialDt() 2 0.002202 0.07098 0.1194 3.34% Castro::do_old_sources() 10 0.0905 0.09483 0.09782 2.73% FabArray::ParallelCopy_finish() 41 0.03684 0.0536 0.09173 2.56% amrex::Copy() 193 0.06216 0.07763 0.08492 2.37% FabArray::setVal() 143 0.05971 0.07038 0.08241 2.30% Castro::initialize_advance() 10 0.05697 0.07229 0.08151 2.28% Castro::do_new_sources() 10 0.06065 0.06644 0.07539 2.11% Castro::computeTemp() 63 0.06639 0.06887 0.07059 1.97% Castro::reset_internal_energy(MultiFab) 63 0.04781 0.04946 0.05075 1.42% Castro::reset_internal_energy(Fab) 1008 0.04752 0.04915 0.05043 1.41% Castro::normalize_species() 62 0.04078 0.04208 0.04421 1.24% FabArray::ParallelCopy_nowait() 41 0.0347 0.04022 0.04228 1.18% StateDataPhysBCFunct::() 41 0.03531 0.03768 0.04048 1.13% StateData::FillBoundary(geom) 41 0.03522 0.03758 0.04039 1.13% Castro::construct_new_source() 50 0.02887 0.03129 0.03556 0.99% Gravity::interpolate_monopole_grav() 21 0.02825 0.02878 0.02939 0.82% Castro::construct_new_gravity_source() 10 0.02245 0.02488 0.02883 0.81% Castro::post_init() 1 0.02714 0.02733 0.02772 0.77% Castro::finalize_do_advance() 10 0.01226 0.02153 0.02735 0.76% Amr::writePlotFile() 2 0.02448 0.02474 0.02507 0.70% Castro::post_timestep() 10 0.01557 0.01585 0.0162 0.45% VisMF::Write(FabArray) 2 0.01221 0.01332 0.01611 0.45% Castro::apply_source_to_state() 20 0.01124 0.01326 0.01416 0.40% FabArray::Saxpy() 20 0.01119 0.01321 0.01412 0.39% Castro::Castro() 1 0.009437 0.01104 0.01404 0.39% FabArray::setDomainBndry() 41 0.008895 0.01148 0.01314 0.37% Castro::check_for_nan() 20 0.009983 0.01076 0.01149 0.32% MultiFab::contains_nan() 20 0.009962 0.01074 0.01147 0.32% Castro::construct_old_source() 50 0.007189 0.01003 0.01091 0.30% Castro::construct_old_gravity_source() 10 0.007136 0.009961 0.01083 0.30% Castro::initMFs() 1 0.006035 0.007189 0.009629 0.27% Castro::computeNewDt() 9 0.009267 0.009277 0.009287 0.26% AmrLevel::AmrLevel(dm) 1 0.005068 0.006289 0.00881 0.25% StateData::define() 4 0.005048 0.006266 0.008774 0.25% Castro::enforce_min_density() 62 0.007293 0.007676 0.008158 0.23% Castro::finalize_advance() 10 0.003219 0.003758 0.004496 0.13% Castro::swap_state_time_levels() 10 0.003119 0.004034 0.004371 0.12% Castro::buildMetrics() 1 0.001574 0.001965 0.002751 0.08% Castro::post_regrid() 1 0.00149 0.001716 0.002078 0.06% Amr::InitAmr() 1 0.000286 0.0003952 0.0005946 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 2.478e-05 0.0002444 0.0003596 0.01% DistributionMapping::LeastUsedCPUs() 1 7.509e-06 0.0002369 0.0003517 0.01% Castro::enforce_consistent_e() 1 8.117e-05 8.732e-05 0.0001024 0.00% FabArrayBase::getCPC() 41 6.943e-05 8.215e-05 9.692e-05 0.00% Amr::writeSmallPlotFile() 1 2.958e-05 5.243e-05 6.404e-05 0.00% Castro::enforce_speed_limit() 62 2.909e-05 3.304e-05 3.732e-05 0.00% FabArrayBase::CPC::define() 2 2.153e-05 2.478e-05 2.805e-05 0.00% Amr::initSubcycle() 1 9.303e-06 1.246e-05 1.953e-05 0.00% Gravity::swapTimeLevels() 10 1.147e-05 1.433e-05 1.77e-05 0.00% Gravity::set_mass_offset() 10 9.536e-06 1.109e-05 1.376e-05 0.00% Castro::create_source_corrector() 10 6.836e-06 8.186e-06 9.234e-06 0.00% Castro::retry_advance_ctu() 10 6.476e-06 7.853e-06 9.112e-06 0.00% Castro::FluxRegCrseInit 10 6.143e-06 7.428e-06 8.911e-06 0.00% Castro::FluxRegFineAdd() 10 1.943e-06 2.529e-06 2.987e-06 0.00% DistributionMapping::Distribute() 1 9.58e-07 1.246e-06 1.592e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 31 B 42 B 73 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.08-31-g435281069858) finalized