MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.09-24-gb84d7c069cef) initialized Starting run at 05:39:36 UTC on 2022-09-27. Successfully read inputs file ... Castro git describe: 22.09-1-g65b273ad0 AMReX git describe: 22.09-24-gb84d7c069 Microphysics git describe: 22.09-13-gb685b7d3 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.015221353 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.358646789 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.342318229 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.341492582 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.340703344 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.354269163 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.351723672 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.336606956 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.338608261 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.338460574 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.338877945 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.025902452 seconds Ending run at 05:39:40 UTC on 2022-09-27. Run time = 3.657863023 Run time without initialization = 3.475323602 Average number of zones advanced per microsecond: 0.754 Average number of zones advanced per microsecond per rank: 0.094 TinyProfiler total time across processes [min...avg...max]: 3.655 ... 3.657 ... 3.658 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.1340 2.4128 2.5116 68.66% Castro::do_advance_ctu() 10 0.03514 0.134 0.4154 11.36% Gravity::make_radial_gravity() 21 0.3376 0.3509 0.3767 10.30% FabArray::ParallelCopy_finish() 41 0.0452 0.06249 0.1231 3.37% Castro::initData() 1 0.03979 0.07889 0.1164 3.18% Castro::estTimeStep() 21 0.02899 0.06943 0.1073 2.93% FabArray::setVal() 143 0.06199 0.06996 0.07206 1.97% Castro::reset_internal_energy(Fab) 1008 0.04591 0.04929 0.05242 1.43% FabArray::ParallelCopy_nowait() 41 0.02751 0.04453 0.04996 1.37% StateData::FillBoundary(geom) 41 0.03659 0.04193 0.04629 1.27% Castro::normalize_species() 62 0.03972 0.04134 0.04258 1.16% FillPatchIterator::Initialize 41 0.02361 0.03585 0.03994 1.09% Amr::writePlotFile() 2 0.02523 0.02805 0.02868 0.78% Gravity::interpolate_monopole_grav() 21 0.02674 0.0276 0.02799 0.77% Castro::construct_new_gravity_source() 10 0.02027 0.023 0.02564 0.70% Castro::expand_state() 10 0.009695 0.0187 0.02172 0.59% Castro::computeTemp() 63 0.01685 0.01854 0.02005 0.55% Castro::initialize_do_advance() 10 0.009462 0.01735 0.01939 0.53% VisMF::Write(FabArray) 2 0.01293 0.01348 0.01611 0.44% MultiFab::Saxpy() 20 0.008564 0.01435 0.0161 0.44% Gravity::get_new_grav_vector() 11 0.00766 0.01155 0.01288 0.35% FabArray::setDomainBndry() 41 0.004929 0.01038 0.01253 0.34% MultiFab::contains_nan() 20 0.009572 0.01094 0.01202 0.33% Castro::construct_old_gravity_source() 10 0.004889 0.009986 0.01167 0.32% Gravity::get_old_grav_vector() 10 0.005479 0.009517 0.01094 0.30% Castro::initialize_advance() 10 0.006609 0.00993 0.01074 0.29% main() 1 0.004486 0.006579 0.007082 0.19% Castro::construct_new_source() 50 0.004844 0.006471 0.007015 0.19% Castro::initMFs() 1 0.006645 0.006682 0.006804 0.19% Castro::enforce_min_density() 62 0.005222 0.00602 0.006473 0.18% StateData::define() 4 0.005406 0.00544 0.00554 0.15% Castro::swap_state_time_levels() 10 0.003272 0.004267 0.004606 0.13% Amr::coarseTimeStep() 10 0.0009231 0.001786 0.003595 0.10% Castro::finalize_do_advance() 10 0.0006476 0.00145 0.001755 0.05% Castro::buildMetrics() 1 0.001525 0.001545 0.00158 0.04% Amr::InitAmr() 1 0.0002664 0.0002984 0.0003949 0.01% Amr::timeStep() 10 0.0001667 0.0002119 0.0003778 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002989 0.0003118 0.0003389 0.01% Castro::clean_state() 62 0.0001448 0.0001649 0.0001854 0.01% DistributionMapping::LeastUsedCPUs() 1 1.34e-05 0.000113 0.0001399 0.00% StateDataPhysBCFunct::() 41 0.0001029 0.0001218 0.0001396 0.00% Castro::enforce_consistent_e() 1 7.599e-05 9.006e-05 0.0001023 0.00% Castro::Castro() 1 6.554e-05 8.029e-05 0.0001014 0.00% FabArray::ParallelCopy() 41 6.769e-05 8.387e-05 9.66e-05 0.00% Castro::construct_old_source() 50 3.765e-05 7.117e-05 9.575e-05 0.00% Castro::do_old_sources() 10 3.897e-05 6.833e-05 8.487e-05 0.00% Castro::do_new_sources() 10 4.353e-05 6.895e-05 8.481e-05 0.00% Amr::writeSmallPlotFile() 1 2.441e-05 6.444e-05 7.345e-05 0.00% Castro::subcycle_advance_ctu() 10 4.453e-05 6.039e-05 7.263e-05 0.00% FillPatchSingleLevel 41 6.059e-05 6.608e-05 7.018e-05 0.00% Castro::construct_old_gravity() 10 3.286e-05 5.161e-05 6.627e-05 0.00% Castro::advance() 10 3.404e-05 4.759e-05 6.437e-05 0.00% Amr::FinalizeInit() 1 3.831e-06 1.209e-05 6.174e-05 0.00% Castro::finalize_advance() 10 5.149e-05 5.664e-05 6.131e-05 0.00% Castro::apply_source_to_state() 20 4.384e-05 5.037e-05 5.733e-05 0.00% FabArrayBase::getCPC() 41 4.601e-05 5.008e-05 5.275e-05 0.00% Castro::construct_new_gravity() 10 3.581e-05 4.448e-05 5.124e-05 0.00% Castro::enforce_speed_limit() 62 2.385e-05 2.863e-05 3.213e-05 0.00% Amr::defBaseLevel() 1 2.437e-05 2.764e-05 3.108e-05 0.00% FabArrayBase::CPC::define() 2 2.241e-05 2.576e-05 3.029e-05 0.00% Castro::check_for_nan() 20 2.143e-05 2.458e-05 2.85e-05 0.00% Castro::post_timestep() 10 2.289e-05 2.458e-05 2.739e-05 0.00% Amr::initSubcycle() 1 8.005e-06 9.551e-06 1.783e-05 0.00% Gravity::swapTimeLevels() 10 5.811e-06 1.199e-05 1.667e-05 0.00% AmrLevel::AmrLevel(dm) 1 7.745e-06 9.376e-06 1.296e-05 0.00% Castro::post_init() 1 2.897e-06 5.739e-06 1.267e-05 0.00% Castro::create_source_corrector() 10 6.668e-06 1.1e-05 1.234e-05 0.00% Gravity::set_mass_offset() 10 7.403e-06 9.986e-06 1.145e-05 0.00% Castro::computeNewDt() 9 7.87e-06 9.642e-06 1.133e-05 0.00% Castro::FluxRegCrseInit 10 6.481e-06 9.458e-06 1.119e-05 0.00% Amr::InitializeInit() 1 1.886e-06 3.999e-06 9.993e-06 0.00% Castro::retry_advance_ctu() 10 4.045e-06 6.011e-06 7.723e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.574e-06 4.859e-06 6.951e-06 0.00% Castro::computeInitialDt() 2 3.175e-06 4.016e-06 4.656e-06 0.00% Castro::post_regrid() 1 1.725e-06 3.021e-06 4.126e-06 0.00% Castro::FluxRegFineAdd() 10 1.743e-06 2.263e-06 2.913e-06 0.00% Amr::init() 1 1.62e-06 2.019e-06 2.789e-06 0.00% Amr::initialInit() 1 1.191e-06 1.479e-06 2.03e-06 0.00% DistributionMapping::Distribute() 1 9.68e-07 1.157e-06 1.918e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.655 3.657 3.658 100.00% Amr::coarseTimeStep() 10 3.442 3.442 3.442 94.11% Amr::timeStep() 10 3.431 3.432 3.433 93.86% Castro::advance() 10 3.416 3.416 3.417 93.40% Castro::subcycle_advance_ctu() 10 3.343 3.345 3.353 91.66% Castro::do_advance_ctu() 10 3.343 3.345 3.353 91.66% Castro::construct_ctu_hydro_source() 10 2.134 2.413 2.512 68.66% Gravity::make_radial_gravity() 21 0.3376 0.3509 0.3767 10.30% Gravity::get_new_grav_vector() 11 0.2282 0.23 0.2319 6.34% Castro::construct_old_gravity() 10 0.2006 0.2111 0.231 6.32% Gravity::get_old_grav_vector() 10 0.1997 0.2102 0.2305 6.30% FillPatchIterator::Initialize 41 0.1876 0.1955 0.217 5.93% Castro::construct_new_gravity() 10 0.203 0.2044 0.2059 5.63% FillPatchSingleLevel 41 0.1363 0.1493 0.1885 5.15% Castro::initialize_do_advance() 10 0.1652 0.1781 0.1847 5.05% Amr::init() 1 0.182 0.1821 0.1821 4.98% Amr::initialInit() 1 0.1662 0.1666 0.1667 4.56% FabArray::ParallelCopy() 41 0.0936 0.1072 0.1508 4.12% Amr::InitializeInit() 1 0.06086 0.1001 0.1378 3.77% Amr::defBaseLevel() 1 0.06086 0.1 0.1377 3.77% Castro::expand_state() 10 0.1208 0.1309 0.1349 3.69% FabArray::ParallelCopy_finish() 41 0.0452 0.06249 0.1231 3.37% Castro::initData() 1 0.04387 0.08301 0.1206 3.30% Castro::clean_state() 62 0.1073 0.1147 0.1191 3.26% Castro::estTimeStep() 21 0.02899 0.06943 0.1073 2.93% Amr::FinalizeInit() 1 0.02894 0.06652 0.1058 2.89% Castro::computeInitialDt() 2 0.001734 0.03941 0.07862 2.15% Castro::initialize_advance() 10 0.06256 0.0707 0.07319 2.00% Castro::computeTemp() 63 0.06306 0.06814 0.0728 1.99% FabArray::setVal() 143 0.06199 0.06996 0.07206 1.97% Castro::do_new_sources() 10 0.0536 0.06305 0.06766 1.85% Castro::reset_internal_energy(MultiFab) 63 0.04621 0.0496 0.05276 1.44% Castro::reset_internal_energy(Fab) 1008 0.04591 0.04929 0.05242 1.43% FabArray::ParallelCopy_nowait() 41 0.02759 0.0446 0.05004 1.37% Castro::do_old_sources() 10 0.03221 0.0448 0.04868 1.33% StateDataPhysBCFunct::() 41 0.0367 0.04205 0.04643 1.27% StateData::FillBoundary(geom) 41 0.03659 0.04193 0.04629 1.27% Castro::normalize_species() 62 0.03972 0.04134 0.04258 1.16% Amr::writePlotFile() 2 0.04134 0.04152 0.04185 1.14% Castro::construct_new_source() 50 0.02512 0.02947 0.03082 0.84% Gravity::interpolate_monopole_grav() 21 0.02674 0.0276 0.02799 0.77% Castro::post_init() 1 0.02611 0.02646 0.02661 0.73% Castro::construct_new_gravity_source() 10 0.02027 0.023 0.02564 0.70% Castro::post_timestep() 10 0.01486 0.01584 0.01655 0.45% Castro::apply_source_to_state() 20 0.008612 0.0144 0.01616 0.44% VisMF::Write(FabArray) 2 0.01293 0.01348 0.01611 0.44% MultiFab::Saxpy() 20 0.008564 0.01435 0.0161 0.44% FabArray::setDomainBndry() 41 0.004929 0.01038 0.01253 0.34% Castro::check_for_nan() 20 0.009595 0.01096 0.01205 0.33% MultiFab::contains_nan() 20 0.009572 0.01094 0.01202 0.33% Castro::construct_old_source() 50 0.004927 0.01006 0.01177 0.32% Castro::construct_old_gravity_source() 10 0.004889 0.009986 0.01167 0.32% Castro::Castro() 1 0.01135 0.01145 0.01167 0.32% Castro::computeNewDt() 9 0.007301 0.007315 0.007322 0.20% Castro::initMFs() 1 0.006645 0.006682 0.006804 0.19% Castro::enforce_min_density() 62 0.005222 0.00602 0.006473 0.18% AmrLevel::AmrLevel(dm) 1 0.005415 0.00545 0.00555 0.15% StateData::define() 4 0.005406 0.00544 0.00554 0.15% Castro::swap_state_time_levels() 10 0.003272 0.004267 0.004606 0.13% Castro::finalize_do_advance() 10 0.0006476 0.00145 0.001755 0.05% Castro::buildMetrics() 1 0.001648 0.001674 0.001708 0.05% Castro::post_regrid() 1 0.001513 0.001574 0.001627 0.04% Amr::InitAmr() 1 0.0002749 0.0003079 0.0004029 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.798e-05 0.0001191 0.0001465 0.00% DistributionMapping::LeastUsedCPUs() 1 1.34e-05 0.000113 0.0001399 0.00% Castro::enforce_consistent_e() 1 7.599e-05 9.006e-05 0.0001023 0.00% FabArrayBase::getCPC() 41 7.152e-05 7.583e-05 8.011e-05 0.00% Amr::writeSmallPlotFile() 1 2.441e-05 6.444e-05 7.345e-05 0.00% Castro::finalize_advance() 10 6.028e-05 6.836e-05 7.315e-05 0.00% Castro::enforce_speed_limit() 62 2.385e-05 2.863e-05 3.213e-05 0.00% FabArrayBase::CPC::define() 2 2.241e-05 2.576e-05 3.029e-05 0.00% Amr::initSubcycle() 1 8.005e-06 9.551e-06 1.783e-05 0.00% Gravity::swapTimeLevels() 10 5.811e-06 1.199e-05 1.667e-05 0.00% Castro::create_source_corrector() 10 6.668e-06 1.1e-05 1.234e-05 0.00% Gravity::set_mass_offset() 10 7.403e-06 9.986e-06 1.145e-05 0.00% Castro::FluxRegCrseInit 10 6.481e-06 9.458e-06 1.119e-05 0.00% Castro::retry_advance_ctu() 10 4.045e-06 6.011e-06 7.723e-06 0.00% Castro::FluxRegFineAdd() 10 1.743e-06 2.263e-06 2.913e-06 0.00% DistributionMapping::Distribute() 1 9.68e-07 1.157e-06 1.918e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] AMReX (22.09-24-gb84d7c069cef) finalized