MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.06-48-gb2b9150ada12) initialized Starting run at 05:38:46 UTC on 2022-06-29. Successfully read inputs file ... Castro git describe: 22.06-12-g556652b03 AMReX git describe: 22.06-48-gb2b9150ad Microphysics git describe: 22.06-7-ga6a75714 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.013999516 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.350434088 [STEP 1] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.337900843 [STEP 2] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.33681646 [STEP 3] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.33702243 [STEP 4] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.338437096 [STEP 5] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.345431745 [STEP 6] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.332921483 [STEP 7] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.332738038 [STEP 8] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.332450425 [STEP 9] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.333444065 [STEP 10] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.009675112 seconds Ending run at 05:38:49 UTC on 2022-06-29. Run time = 3.584275487 Run time without initialization = 3.394250386 Average number of zones advanced per microsecond: 0.772 Average number of zones advanced per microsecond per rank: 0.097 TinyProfiler total time across processes [min...avg...max]: 3.581 ... 3.583 ... 3.584 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.0980 2.3706 2.4635 68.73% Castro::do_advance_ctu() 10 0.03507 0.1288 0.4045 11.28% Gravity::make_radial_gravity() 21 0.3399 0.3526 0.3768 10.51% Castro::initData() 1 0.03837 0.07886 0.1254 3.50% FabArray::ParallelCopy_finish() 41 0.03862 0.05596 0.1148 3.20% Castro::estTimeStep() 21 0.02184 0.07228 0.1097 3.06% FabArray::setVal() 143 0.06017 0.06931 0.07254 2.02% Castro::reset_internal_energy(Fab) 1008 0.04723 0.04989 0.05241 1.46% FabArray::ParallelCopy_nowait() 41 0.02623 0.04339 0.04889 1.36% StateData::FillBoundary(geom) 41 0.03651 0.04277 0.04671 1.30% Castro::normalize_species() 62 0.04032 0.04193 0.04395 1.23% FillPatchIterator::Initialize 41 0.02015 0.03224 0.03718 1.04% Gravity::interpolate_monopole_grav() 21 0.02695 0.02764 0.02834 0.79% Castro::construct_new_gravity_source() 10 0.01707 0.02222 0.02373 0.66% Castro::expand_state() 10 0.009592 0.01876 0.02211 0.62% Castro::computeTemp() 63 0.01684 0.019 0.01978 0.55% Castro::initialize_do_advance() 10 0.008911 0.01681 0.01941 0.54% MultiFab::Saxpy() 20 0.008519 0.01429 0.01621 0.45% VisMF::Write(FabArray) 2 0.01138 0.01196 0.01447 0.40% Amr::writePlotFile() 2 0.009417 0.01202 0.01285 0.36% Gravity::get_new_grav_vector() 11 0.008502 0.01143 0.01264 0.35% FabArray::setDomainBndry() 41 0.004965 0.01035 0.01259 0.35% MultiFab::contains_nan() 20 0.009921 0.01133 0.01236 0.34% Castro::initialize_advance() 10 0.006582 0.01037 0.0118 0.33% Castro::construct_old_gravity_source() 10 0.00481 0.01002 0.01167 0.33% Gravity::get_old_grav_vector() 10 0.005606 0.009642 0.0111 0.31% Castro::construct_new_source() 50 0.004912 0.006559 0.007132 0.20% Castro::initMFs() 1 0.005472 0.005934 0.006676 0.19% Castro::enforce_min_density() 62 0.005208 0.005965 0.006501 0.18% main() 1 0.003287 0.005342 0.00629 0.18% StateData::define() 4 0.004543 0.004742 0.005081 0.14% Castro::swap_state_time_levels() 10 0.002883 0.003664 0.003905 0.11% Amr::coarseTimeStep() 10 0.0008781 0.001746 0.003186 0.09% Castro::buildMetrics() 1 0.001293 0.001367 0.001477 0.04% Castro::finalize_do_advance() 10 0.0005423 0.001202 0.0014 0.04% Amr::timeStep() 10 0.0001713 0.0002384 0.0005322 0.01% Amr::InitAmr() 1 0.0002576 0.0002894 0.0003831 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002955 0.0003097 0.000325 0.01% Castro::clean_state() 62 0.0001273 0.0001612 0.000174 0.00% StateDataPhysBCFunct::() 41 9.569e-05 0.0001254 0.0001477 0.00% DistributionMapping::LeastUsedCPUs() 1 7.98e-06 0.0001077 0.0001307 0.00% Castro::enforce_consistent_e() 1 7.921e-05 8.843e-05 0.0001089 0.00% FabArray::ParallelCopy() 41 6.382e-05 8.506e-05 0.0001013 0.00% Castro::subcycle_advance_ctu() 10 4.033e-05 5.638e-05 9.255e-05 0.00% Castro::construct_old_source() 50 3.242e-05 7.208e-05 8.95e-05 0.00% Castro::Castro() 1 5.214e-05 7.065e-05 8.772e-05 0.00% Castro::do_old_sources() 10 3.835e-05 6.772e-05 8.343e-05 0.00% Castro::do_new_sources() 10 4.196e-05 6.798e-05 8.185e-05 0.00% FillPatchSingleLevel 41 5.953e-05 7.1e-05 8.091e-05 0.00% Castro::advance() 10 3.467e-05 5.212e-05 7.314e-05 0.00% Amr::FinalizeInit() 1 3.886e-06 1.375e-05 7.206e-05 0.00% Amr::writeSmallPlotFile() 1 3.062e-05 5.338e-05 7.087e-05 0.00% Castro::construct_old_gravity() 10 3.676e-05 5.462e-05 6.757e-05 0.00% Castro::apply_source_to_state() 20 3.907e-05 5.217e-05 6.016e-05 0.00% Castro::finalize_advance() 10 4.645e-05 5.171e-05 5.745e-05 0.00% FabArrayBase::getCPC() 41 4.778e-05 5.014e-05 5.347e-05 0.00% Castro::construct_new_gravity() 10 3.466e-05 4.52e-05 5.195e-05 0.00% Amr::defBaseLevel() 1 2.665e-05 3.331e-05 4.052e-05 0.00% Castro::enforce_speed_limit() 62 2.839e-05 3.207e-05 3.439e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.44e-05 2.031e-05 3.393e-05 0.00% FabArrayBase::CPC::define() 2 2.425e-05 2.616e-05 2.891e-05 0.00% Castro::check_for_nan() 20 1.875e-05 2.188e-05 2.459e-05 0.00% Castro::post_timestep() 10 1.158e-05 1.394e-05 1.638e-05 0.00% Gravity::swapTimeLevels() 10 5.794e-06 1.175e-05 1.618e-05 0.00% Amr::initSubcycle() 1 8.571e-06 1.014e-05 1.471e-05 0.00% Castro::create_source_corrector() 10 7.193e-06 1.054e-05 1.439e-05 0.00% Castro::post_init() 1 8.543e-06 9.886e-06 1.345e-05 0.00% Castro::FluxRegCrseInit 10 8.033e-06 9.991e-06 1.284e-05 0.00% Gravity::set_mass_offset() 10 6.381e-06 9.112e-06 1.166e-05 0.00% Castro::computeNewDt() 9 7.653e-06 9.083e-06 1.028e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.626e-06 4.354e-06 7.182e-06 0.00% Castro::retry_advance_ctu() 10 4.275e-06 5.714e-06 6.562e-06 0.00% Amr::InitializeInit() 1 2.071e-06 2.751e-06 5.429e-06 0.00% Castro::computeInitialDt() 2 3.38e-06 3.949e-06 4.742e-06 0.00% Castro::post_regrid() 1 1.952e-06 2.508e-06 3.755e-06 0.00% Castro::FluxRegFineAdd() 10 2.195e-06 2.571e-06 3.07e-06 0.00% Amr::init() 1 1.651e-06 2.11e-06 2.672e-06 0.00% Amr::initialInit() 1 1.245e-06 1.643e-06 2.139e-06 0.00% DistributionMapping::Distribute() 1 8.93e-07 1.012e-06 1.248e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.581 3.583 3.584 100.00% Amr::coarseTimeStep() 10 3.378 3.378 3.378 94.25% Amr::timeStep() 10 3.366 3.368 3.368 93.98% Castro::advance() 10 3.351 3.351 3.352 93.51% Castro::subcycle_advance_ctu() 10 3.277 3.28 3.287 91.70% Castro::do_advance_ctu() 10 3.277 3.28 3.287 91.70% Castro::construct_ctu_hydro_source() 10 2.098 2.371 2.463 68.73% Gravity::make_radial_gravity() 21 0.3399 0.3526 0.3768 10.51% Gravity::get_new_grav_vector() 11 0.231 0.2324 0.2335 6.51% Castro::construct_old_gravity() 10 0.1998 0.2111 0.2292 6.39% Gravity::get_old_grav_vector() 10 0.199 0.2103 0.2286 6.38% Castro::construct_new_gravity() 10 0.2036 0.2049 0.2059 5.74% FillPatchIterator::Initialize 41 0.1762 0.1851 0.205 5.72% Amr::init() 1 0.1895 0.1896 0.1896 5.29% FillPatchSingleLevel 41 0.1289 0.1425 0.1798 5.02% Amr::initialInit() 1 0.1751 0.1754 0.1755 4.90% Castro::initialize_do_advance() 10 0.1561 0.1679 0.1748 4.88% Amr::InitializeInit() 1 0.05658 0.0975 0.1448 4.04% Amr::defBaseLevel() 1 0.05657 0.0975 0.1448 4.04% FabArray::ParallelCopy() 41 0.0851 0.09951 0.1412 3.94% Castro::initData() 1 0.04256 0.08284 0.1291 3.60% Castro::expand_state() 10 0.1126 0.1208 0.1259 3.51% Castro::clean_state() 62 0.1094 0.1164 0.1198 3.34% Amr::FinalizeInit() 1 0.03055 0.07789 0.1188 3.32% FabArray::ParallelCopy_finish() 41 0.03862 0.05596 0.1148 3.20% Castro::estTimeStep() 21 0.02184 0.07228 0.1097 3.06% Castro::computeInitialDt() 2 0.001738 0.04906 0.09001 2.51% Castro::initialize_advance() 10 0.06453 0.07124 0.0741 2.07% FabArray::setVal() 143 0.06017 0.06931 0.07254 2.02% Castro::computeTemp() 63 0.06437 0.0692 0.07239 2.02% Castro::do_new_sources() 10 0.05059 0.06206 0.06547 1.83% Castro::reset_internal_energy(MultiFab) 63 0.04753 0.0502 0.05274 1.47% Castro::reset_internal_energy(Fab) 1008 0.04723 0.04989 0.05241 1.46% Castro::do_old_sources() 10 0.03231 0.04543 0.04897 1.37% FabArray::ParallelCopy_nowait() 41 0.02631 0.04346 0.04896 1.37% StateDataPhysBCFunct::() 41 0.03661 0.04289 0.04684 1.31% StateData::FillBoundary(geom) 41 0.03651 0.04277 0.04671 1.30% Castro::normalize_species() 62 0.04032 0.04193 0.04395 1.23% Castro::construct_new_source() 50 0.02198 0.02878 0.03073 0.86% Castro::post_init() 1 0.02799 0.02819 0.02838 0.79% Gravity::interpolate_monopole_grav() 21 0.02695 0.02764 0.02834 0.79% Amr::writePlotFile() 2 0.02384 0.02398 0.02423 0.68% Castro::construct_new_gravity_source() 10 0.01707 0.02222 0.02373 0.66% Castro::post_timestep() 10 0.01479 0.01604 0.01672 0.47% Castro::apply_source_to_state() 20 0.008564 0.01434 0.01626 0.45% MultiFab::Saxpy() 20 0.008519 0.01429 0.01621 0.45% VisMF::Write(FabArray) 2 0.01138 0.01196 0.01447 0.40% FabArray::setDomainBndry() 41 0.004965 0.01035 0.01259 0.35% Castro::check_for_nan() 20 0.00994 0.01136 0.01238 0.35% MultiFab::contains_nan() 20 0.009921 0.01133 0.01236 0.34% Castro::construct_old_source() 50 0.004842 0.01009 0.01176 0.33% Castro::construct_old_gravity_source() 10 0.00481 0.01002 0.01167 0.33% Castro::Castro() 1 0.009206 0.00975 0.01055 0.29% Castro::computeNewDt() 9 0.00747 0.007937 0.008006 0.22% Castro::initMFs() 1 0.005472 0.005934 0.006676 0.19% Castro::enforce_min_density() 62 0.005208 0.005965 0.006501 0.18% AmrLevel::AmrLevel(dm) 1 0.004562 0.004762 0.005099 0.14% StateData::define() 4 0.004543 0.004742 0.005081 0.14% Castro::swap_state_time_levels() 10 0.002883 0.003664 0.003905 0.11% Castro::post_regrid() 1 0.001529 0.001582 0.001654 0.05% Castro::buildMetrics() 1 0.001421 0.001498 0.001622 0.05% Castro::finalize_do_advance() 10 0.0005423 0.001202 0.0014 0.04% Amr::InitAmr() 1 0.0002669 0.0002995 0.0003917 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.25e-05 0.0001131 0.0001391 0.00% DistributionMapping::LeastUsedCPUs() 1 7.98e-06 0.0001077 0.0001307 0.00% Castro::enforce_consistent_e() 1 7.921e-05 8.843e-05 0.0001089 0.00% FabArrayBase::getCPC() 41 7.22e-05 7.629e-05 8.137e-05 0.00% Castro::finalize_advance() 10 5.668e-05 6.427e-05 7.171e-05 0.00% Amr::writeSmallPlotFile() 1 3.062e-05 5.338e-05 7.087e-05 0.00% Castro::enforce_speed_limit() 62 2.839e-05 3.207e-05 3.439e-05 0.00% FabArrayBase::CPC::define() 2 2.425e-05 2.616e-05 2.891e-05 0.00% Gravity::swapTimeLevels() 10 5.794e-06 1.175e-05 1.618e-05 0.00% Amr::initSubcycle() 1 8.571e-06 1.014e-05 1.471e-05 0.00% Castro::create_source_corrector() 10 7.193e-06 1.054e-05 1.439e-05 0.00% Castro::FluxRegCrseInit 10 8.033e-06 9.991e-06 1.284e-05 0.00% Gravity::set_mass_offset() 10 6.381e-06 9.112e-06 1.166e-05 0.00% Castro::retry_advance_ctu() 10 4.275e-06 5.714e-06 6.562e-06 0.00% Castro::FluxRegFineAdd() 10 2.195e-06 2.571e-06 3.07e-06 0.00% DistributionMapping::Distribute() 1 8.93e-07 1.012e-06 1.248e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] AMReX (22.06-48-gb2b9150ada12) finalized