MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.07-9-g40b3d2176b17) initialized Starting run at 05:37:57 UTC on 2022-07-15. Successfully read inputs file ... Castro git describe: 22.07-5-g8855157b6 AMReX git describe: 22.07-9-g40b3d2176 Microphysics git describe: 22.07-12-gda28cc0d reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.015715036 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.349832652 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.338257287 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.338751801 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.337281756 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.338195335 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.341299016 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.335518824 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.335345293 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.334188032 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.334714262 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.009708122 seconds Ending run at 05:38:01 UTC on 2022-07-15. Run time = 3.579898861 Run time without initialization = 3.399481741 Average number of zones advanced per microsecond: 0.771 Average number of zones advanced per microsecond per rank: 0.096 TinyProfiler total time across processes [min...avg...max]: 3.578 ... 3.579 ... 3.58 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.0504 2.3717 2.4801 69.28% Castro::do_advance_ctu() 10 0.02937 0.1398 0.4634 12.94% Gravity::make_radial_gravity() 21 0.3327 0.349 0.3782 10.56% FabArray::ParallelCopy_finish() 41 0.03286 0.05503 0.1277 3.57% Castro::estTimeStep() 21 0.02026 0.06377 0.1191 3.33% Castro::initData() 1 0.03832 0.07843 0.1173 3.28% FabArray::setVal() 143 0.05009 0.06754 0.07254 2.03% Castro::reset_internal_energy(Fab) 1008 0.04431 0.04977 0.05257 1.47% FabArray::ParallelCopy_nowait() 41 0.02541 0.04357 0.04909 1.37% StateData::FillBoundary(geom) 41 0.03512 0.04129 0.04572 1.28% Castro::normalize_species() 62 0.03759 0.04097 0.04261 1.19% FillPatchIterator::Initialize 41 0.02072 0.03283 0.0369 1.03% Gravity::interpolate_monopole_grav() 21 0.02539 0.02739 0.02796 0.78% Castro::construct_new_gravity_source() 10 0.01657 0.02214 0.02383 0.67% Castro::expand_state() 10 0.009544 0.019 0.02212 0.62% Castro::computeTemp() 63 0.01691 0.019 0.0201 0.56% Castro::initialize_do_advance() 10 0.008558 0.01666 0.01916 0.54% MultiFab::Saxpy() 20 0.008385 0.01424 0.01617 0.45% VisMF::Write(FabArray) 2 0.01175 0.01251 0.01494 0.42% Amr::writePlotFile() 2 0.01072 0.01224 0.01324 0.37% Gravity::get_new_grav_vector() 11 0.008142 0.01135 0.01275 0.36% MultiFab::contains_nan() 20 0.00937 0.01111 0.01262 0.35% FabArray::setDomainBndry() 41 0.004835 0.01028 0.01214 0.34% Castro::construct_old_gravity_source() 10 0.004771 0.009998 0.01151 0.32% Gravity::get_old_grav_vector() 10 0.005362 0.009654 0.01096 0.31% Castro::initialize_advance() 10 0.006618 0.01025 0.01093 0.31% Castro::enforce_min_density() 62 0.00568 0.006638 0.007114 0.20% Castro::construct_new_source() 50 0.004695 0.006454 0.007067 0.20% Castro::initMFs() 1 0.005618 0.006001 0.006787 0.19% main() 1 0.003227 0.004862 0.005628 0.16% StateData::define() 4 0.004632 0.004901 0.005181 0.14% Amr::coarseTimeStep() 10 0.0008294 0.00208 0.004685 0.13% Castro::swap_state_time_levels() 10 0.00262 0.003672 0.003984 0.11% Castro::finalize_do_advance() 10 0.0004626 0.001244 0.001542 0.04% Castro::buildMetrics() 1 0.001335 0.001424 0.001521 0.04% Amr::timeStep() 10 0.0001741 0.0002308 0.000543 0.02% Amr::InitAmr() 1 0.0002569 0.0002999 0.0004721 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002843 0.0003089 0.0003189 0.01% DistributionMapping::LeastUsedCPUs() 1 1.013e-05 0.0001985 0.0002329 0.01% Castro::clean_state() 62 0.0001236 0.0001504 0.000175 0.00% StateDataPhysBCFunct::() 41 0.0001105 0.0001344 0.0001675 0.00% FabArray::ParallelCopy() 41 6.728e-05 8.636e-05 0.0001171 0.00% Castro::enforce_consistent_e() 1 8.039e-05 8.679e-05 9.027e-05 0.00% Castro::do_old_sources() 10 3.096e-05 6.639e-05 8.845e-05 0.00% Castro::construct_old_source() 50 2.502e-05 6.7e-05 8.604e-05 0.00% Castro::Castro() 1 5.357e-05 6.86e-05 8.479e-05 0.00% Castro::do_new_sources() 10 3.996e-05 6.551e-05 7.895e-05 0.00% Amr::FinalizeInit() 1 3.333e-06 1.24e-05 6.889e-05 0.00% FillPatchSingleLevel 41 5.248e-05 6.288e-05 6.731e-05 0.00% Castro::construct_old_gravity() 10 3.253e-05 5.225e-05 6.649e-05 0.00% Amr::writeSmallPlotFile() 1 2.998e-05 4.478e-05 6.58e-05 0.00% FabArrayBase::getCPC() 41 5.461e-05 5.83e-05 6.228e-05 0.00% Castro::finalize_advance() 10 4.784e-05 5.25e-05 5.98e-05 0.00% Castro::construct_new_gravity() 10 3.277e-05 4.626e-05 5.815e-05 0.00% Castro::subcycle_advance_ctu() 10 3.074e-05 4.557e-05 5.557e-05 0.00% Castro::apply_source_to_state() 20 3.562e-05 4.78e-05 5.403e-05 0.00% Castro::advance() 10 2.786e-05 4.105e-05 4.955e-05 0.00% Castro::enforce_speed_limit() 62 2.55e-05 3.079e-05 3.354e-05 0.00% FabArrayBase::CPC::define() 2 2.265e-05 2.517e-05 2.981e-05 0.00% Amr::defBaseLevel() 1 1.766e-05 2.325e-05 2.932e-05 0.00% Castro::check_for_nan() 20 1.68e-05 2.163e-05 2.537e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.232e-05 1.492e-05 1.857e-05 0.00% Castro::post_timestep() 10 1.113e-05 1.307e-05 1.596e-05 0.00% Gravity::swapTimeLevels() 10 4.97e-06 1.181e-05 1.576e-05 0.00% Gravity::set_mass_offset() 10 6.366e-06 1.085e-05 1.551e-05 0.00% Castro::create_source_corrector() 10 6.24e-06 1.066e-05 1.434e-05 0.00% Castro::FluxRegCrseInit 10 6.415e-06 9.418e-06 1.156e-05 0.00% Castro::computeNewDt() 9 7.195e-06 8.767e-06 1.067e-05 0.00% Castro::post_init() 1 2.606e-06 4.546e-06 1.044e-05 0.00% Amr::initSubcycle() 1 7.965e-06 9.098e-06 9.868e-06 0.00% Castro::retry_advance_ctu() 10 5.239e-06 7.326e-06 8.541e-06 0.00% Amr::InitializeInit() 1 1.891e-06 3.807e-06 8.376e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.981e-06 4.879e-06 7.777e-06 0.00% Amr::initialInit() 1 1.24e-06 2.38e-06 7.383e-06 0.00% Amr::init() 1 1.398e-06 2.577e-06 6.836e-06 0.00% Castro::computeInitialDt() 2 3.214e-06 4.139e-06 5.713e-06 0.00% Castro::post_regrid() 1 1.509e-06 2.937e-06 4.109e-06 0.00% Castro::FluxRegFineAdd() 10 1.69e-06 2.78e-06 3.745e-06 0.00% DistributionMapping::Distribute() 1 8.79e-07 1.054e-06 1.324e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.578 3.579 3.58 100.00% Amr::coarseTimeStep() 10 3.384 3.384 3.384 94.53% Amr::timeStep() 10 3.371 3.374 3.375 94.27% Castro::advance() 10 3.356 3.357 3.358 93.79% Castro::subcycle_advance_ctu() 10 3.283 3.288 3.305 92.32% Castro::do_advance_ctu() 10 3.283 3.288 3.305 92.32% Castro::construct_ctu_hydro_source() 10 2.05 2.372 2.48 69.28% Gravity::make_radial_gravity() 21 0.3327 0.349 0.3782 10.56% Castro::construct_old_gravity() 10 0.1981 0.2119 0.2336 6.53% Gravity::get_old_grav_vector() 10 0.1972 0.211 0.2331 6.51% Gravity::get_new_grav_vector() 11 0.2266 0.2279 0.2294 6.41% FillPatchIterator::Initialize 41 0.1718 0.1834 0.2154 6.02% Castro::construct_new_gravity() 10 0.2023 0.2032 0.2042 5.71% FillPatchSingleLevel 41 0.1238 0.1403 0.1898 5.30% Amr::init() 1 0.1798 0.18 0.18 5.03% Castro::initialize_do_advance() 10 0.1617 0.1653 0.1715 4.79% Amr::initialInit() 1 0.1639 0.165 0.1656 4.63% FabArray::ParallelCopy() 41 0.08008 0.09877 0.1533 4.28% Amr::InitializeInit() 1 0.05692 0.09753 0.1372 3.83% Amr::defBaseLevel() 1 0.05692 0.09753 0.1372 3.83% Castro::expand_state() 10 0.1124 0.1186 0.1277 3.57% FabArray::ParallelCopy_finish() 41 0.03286 0.05503 0.1277 3.57% Castro::initData() 1 0.04259 0.08241 0.121 3.38% Castro::clean_state() 62 0.1046 0.1159 0.1204 3.36% Castro::estTimeStep() 21 0.02026 0.06377 0.1191 3.33% Amr::FinalizeInit() 1 0.02758 0.06748 0.1087 3.04% Castro::computeInitialDt() 2 0.001849 0.04153 0.08218 2.30% Castro::initialize_advance() 10 0.05128 0.06922 0.07446 2.08% Castro::computeTemp() 63 0.06208 0.06907 0.07282 2.03% FabArray::setVal() 143 0.05009 0.06754 0.07254 2.03% Castro::do_new_sources() 10 0.04882 0.06173 0.06526 1.82% Castro::reset_internal_energy(MultiFab) 63 0.04461 0.05008 0.05288 1.48% Castro::reset_internal_energy(Fab) 1008 0.04431 0.04977 0.05257 1.47% FabArray::ParallelCopy_nowait() 41 0.02549 0.04366 0.04917 1.37% Castro::do_old_sources() 10 0.03177 0.04528 0.04866 1.36% StateDataPhysBCFunct::() 41 0.03523 0.04143 0.04585 1.28% StateData::FillBoundary(geom) 41 0.03512 0.04129 0.04572 1.28% Castro::normalize_species() 62 0.03759 0.04097 0.04261 1.19% Castro::construct_new_source() 50 0.02127 0.0286 0.03076 0.86% Gravity::interpolate_monopole_grav() 21 0.02539 0.02739 0.02796 0.78% Castro::post_init() 1 0.02439 0.02541 0.02593 0.72% Amr::writePlotFile() 2 0.02423 0.02476 0.02566 0.72% Castro::construct_new_gravity_source() 10 0.01657 0.02214 0.02383 0.67% Castro::post_timestep() 10 0.01434 0.01611 0.01693 0.47% Castro::apply_source_to_state() 20 0.008422 0.01428 0.01622 0.45% MultiFab::Saxpy() 20 0.008385 0.01424 0.01617 0.45% VisMF::Write(FabArray) 2 0.01175 0.01251 0.01494 0.42% Castro::check_for_nan() 20 0.009388 0.01114 0.01265 0.35% MultiFab::contains_nan() 20 0.00937 0.01111 0.01262 0.35% FabArray::setDomainBndry() 41 0.004835 0.01028 0.01214 0.34% Castro::construct_old_source() 50 0.004796 0.01007 0.01159 0.32% Castro::construct_old_gravity_source() 10 0.004771 0.009998 0.01151 0.32% Castro::Castro() 1 0.009384 0.009978 0.01085 0.30% Castro::computeNewDt() 9 0.007444 0.007453 0.007457 0.21% Castro::enforce_min_density() 62 0.00568 0.006638 0.007114 0.20% Castro::initMFs() 1 0.005618 0.006001 0.006787 0.19% AmrLevel::AmrLevel(dm) 1 0.004651 0.004916 0.005196 0.15% StateData::define() 4 0.004632 0.004901 0.005181 0.14% Castro::swap_state_time_levels() 10 0.00262 0.003672 0.003984 0.11% Castro::buildMetrics() 1 0.001452 0.001558 0.001676 0.05% Castro::post_regrid() 1 0.001555 0.001606 0.001664 0.05% Castro::finalize_do_advance() 10 0.0004626 0.001244 0.001542 0.04% Amr::InitAmr() 1 0.0002659 0.000309 0.0004819 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.524e-05 0.0002044 0.0002404 0.01% DistributionMapping::LeastUsedCPUs() 1 1.013e-05 0.0001985 0.0002329 0.01% Castro::enforce_consistent_e() 1 8.039e-05 8.679e-05 9.027e-05 0.00% FabArrayBase::getCPC() 41 7.866e-05 8.347e-05 8.715e-05 0.00% Castro::finalize_advance() 10 5.663e-05 6.47e-05 7.449e-05 0.00% Amr::writeSmallPlotFile() 1 2.998e-05 4.478e-05 6.58e-05 0.00% Castro::enforce_speed_limit() 62 2.55e-05 3.079e-05 3.354e-05 0.00% FabArrayBase::CPC::define() 2 2.265e-05 2.517e-05 2.981e-05 0.00% Gravity::swapTimeLevels() 10 4.97e-06 1.181e-05 1.576e-05 0.00% Gravity::set_mass_offset() 10 6.366e-06 1.085e-05 1.551e-05 0.00% Castro::create_source_corrector() 10 6.24e-06 1.066e-05 1.434e-05 0.00% Castro::FluxRegCrseInit 10 6.415e-06 9.418e-06 1.156e-05 0.00% Amr::initSubcycle() 1 7.965e-06 9.098e-06 9.868e-06 0.00% Castro::retry_advance_ctu() 10 5.239e-06 7.326e-06 8.541e-06 0.00% Castro::FluxRegFineAdd() 10 1.69e-06 2.78e-06 3.745e-06 0.00% DistributionMapping::Distribute() 1 8.79e-07 1.054e-06 1.324e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] AMReX (22.07-9-g40b3d2176b17) finalized