MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.05-16-g9473062293af) initialized Starting run at 05:37:50 UTC on 2022-05-13. Successfully read inputs file ... Castro git describe: 22.05-16-gcd83f56f0 AMReX git describe: 22.05-16-g947306229 Microphysics git describe: 22.05 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.013559839 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.343427333 [STEP 1] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.335273926 [STEP 2] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.334053706 [STEP 3] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.334331264 [STEP 4] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.342014048 [STEP 5] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.340421601 [STEP 6] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.332592232 [STEP 7] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.329357917 [STEP 8] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.331857665 [STEP 9] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.332049613 [STEP 10] FAB kilobyte spread across MPI nodes: [58394 ... 58394] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.009651739 seconds Ending run at 05:37:53 UTC on 2022-05-13. Run time = 3.590313271 Run time without initialization = 3.369989261 Average number of zones advanced per microsecond: 0.778 Average number of zones advanced per microsecond per rank: 0.097 TinyProfiler total time across processes [min...avg...max]: 3.588 ... 3.59 ... 3.59 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.0401 2.3275 2.4421 68.02% Castro::do_advance_ctu() 10 0.03056 0.1448 0.4345 12.10% Gravity::make_radial_gravity() 21 0.3341 0.351 0.3776 10.52% Castro::initData() 1 0.03771 0.08573 0.1525 4.25% Castro::estTimeStep() 21 0.03054 0.1017 0.1495 4.17% FabArray::ParallelCopy_finish() 41 0.04043 0.06132 0.1287 3.59% FabArray::setVal() 143 0.05411 0.06752 0.07135 1.99% Castro::reset_internal_energy(Fab) 1008 0.04556 0.04964 0.05218 1.45% FabArray::ParallelCopy_nowait() 41 0.02534 0.04305 0.04914 1.37% StateData::FillBoundary(geom) 41 0.03459 0.04136 0.04567 1.27% Castro::normalize_species() 62 0.03914 0.04146 0.04257 1.19% FillPatchIterator::Initialize 41 0.01943 0.03184 0.03635 1.01% Gravity::interpolate_monopole_grav() 21 0.02546 0.02723 0.02785 0.78% Castro::construct_new_gravity_source() 10 0.01764 0.02324 0.02549 0.71% Castro::expand_state() 10 0.009559 0.01791 0.02121 0.59% Castro::computeTemp() 63 0.01722 0.01869 0.01974 0.55% Castro::initialize_do_advance() 10 0.008903 0.01634 0.01833 0.51% MultiFab::Saxpy() 20 0.008703 0.01438 0.01619 0.45% FabArray::setDomainBndry() 41 0.004914 0.01189 0.01487 0.41% VisMF::Write(FabArray) 2 0.01129 0.01208 0.01427 0.40% Gravity::get_new_grav_vector() 11 0.00877 0.01134 0.01259 0.35% MultiFab::contains_nan() 20 0.009395 0.01103 0.01251 0.35% Amr::writePlotFile() 2 0.009146 0.01139 0.01224 0.34% Castro::construct_old_gravity_source() 10 0.004924 0.01007 0.01176 0.33% Gravity::get_old_grav_vector() 10 0.005577 0.009397 0.01078 0.30% Castro::initialize_advance() 10 0.003215 0.008619 0.009519 0.27% Castro::initMFs() 1 0.00543 0.006336 0.008977 0.25% Castro::enforce_min_density() 62 0.005897 0.00678 0.007298 0.20% StateData::define() 4 0.004471 0.005183 0.007261 0.20% Castro::construct_new_source() 50 0.004669 0.006369 0.007004 0.20% main() 1 0.00336 0.005052 0.005539 0.15% Castro::swap_state_time_levels() 10 0.002832 0.003596 0.003839 0.11% Amr::coarseTimeStep() 10 0.000382 0.0008869 0.002182 0.06% Castro::buildMetrics() 1 0.001283 0.001493 0.002088 0.06% Castro::finalize_do_advance() 10 0.0006787 0.001146 0.001413 0.04% Amr::InitAmr() 1 0.0002861 0.0003633 0.0005259 0.01% Amr::timeStep() 10 0.0001685 0.0002291 0.000524 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002821 0.0003264 0.0003875 0.01% DistributionMapping::LeastUsedCPUs() 1 8.929e-06 0.0002099 0.0002978 0.01% StateDataPhysBCFunct::() 41 0.0001172 0.0001501 0.000179 0.00% Castro::clean_state() 62 0.0001305 0.0001567 0.0001721 0.00% Castro::enforce_consistent_e() 1 7.762e-05 9.58e-05 0.0001298 0.00% Castro::construct_old_source() 50 3.095e-05 7.429e-05 9.336e-05 0.00% Castro::do_new_sources() 10 3.947e-05 6.454e-05 8.142e-05 0.00% Amr::FinalizeInit() 1 4.055e-06 1.355e-05 7.549e-05 0.00% FillPatchSingleLevel 41 5.454e-05 6.622e-05 7.542e-05 0.00% FabArray::ParallelCopy() 41 4.504e-05 6.44e-05 7.489e-05 0.00% Castro::do_old_sources() 10 3.644e-05 6.181e-05 7.411e-05 0.00% Castro::Castro() 1 4.779e-05 5.52e-05 7.088e-05 0.00% Amr::writeSmallPlotFile() 1 5.347e-05 5.739e-05 6.702e-05 0.00% Castro::construct_old_gravity() 10 2.881e-05 5.075e-05 6.272e-05 0.00% Castro::subcycle_advance_ctu() 10 3.666e-05 5.268e-05 6.018e-05 0.00% FabArrayBase::getCPC() 41 4.929e-05 5.231e-05 5.926e-05 0.00% Castro::apply_source_to_state() 20 3.237e-05 4.566e-05 5.861e-05 0.00% Castro::finalize_advance() 10 4.748e-05 5.284e-05 5.684e-05 0.00% Castro::advance() 10 2.552e-05 4.01e-05 5.101e-05 0.00% Castro::construct_new_gravity() 10 3.193e-05 4.378e-05 4.97e-05 0.00% Amr::defBaseLevel() 1 2.876e-05 3.922e-05 4.742e-05 0.00% Castro::enforce_speed_limit() 62 2.127e-05 2.653e-05 2.979e-05 0.00% FabArrayBase::CPC::define() 2 2.281e-05 2.516e-05 2.892e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.289e-05 1.894e-05 2.86e-05 0.00% Castro::check_for_nan() 20 2.316e-05 2.487e-05 2.741e-05 0.00% Castro::FluxRegCrseInit 10 7.333e-06 1.541e-05 2.136e-05 0.00% Castro::post_timestep() 10 1.492e-05 1.88e-05 2.077e-05 0.00% Gravity::swapTimeLevels() 10 7.037e-06 1.279e-05 1.77e-05 0.00% Amr::initSubcycle() 1 8.128e-06 1.049e-05 1.611e-05 0.00% Gravity::set_mass_offset() 10 7.521e-06 1.172e-05 1.603e-05 0.00% Castro::create_source_corrector() 10 6.606e-06 1.123e-05 1.429e-05 0.00% Castro::post_init() 1 8.796e-06 9.95e-06 1.214e-05 0.00% Castro::computeNewDt() 9 7.113e-06 9.462e-06 1.133e-05 0.00% Amr::init() 1 1.987e-06 3.068e-06 8.413e-06 0.00% Amr::InitializeInit() 1 2.147e-06 3.177e-06 6.933e-06 0.00% Castro::retry_advance_ctu() 10 3.632e-06 5.728e-06 6.801e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.531e-06 5.055e-06 6.644e-06 0.00% Castro::computeInitialDt() 2 3.866e-06 4.339e-06 5.006e-06 0.00% Castro::post_regrid() 1 2.306e-06 3.201e-06 4.892e-06 0.00% Castro::FluxRegFineAdd() 10 1.758e-06 2.251e-06 2.689e-06 0.00% Amr::initialInit() 1 1.152e-06 1.672e-06 2.324e-06 0.00% DistributionMapping::Distribute() 1 8.79e-07 1.093e-06 1.532e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.588 3.59 3.59 100.00% Amr::coarseTimeStep() 10 3.355 3.355 3.355 93.44% Amr::timeStep() 10 3.343 3.345 3.346 93.19% Castro::advance() 10 3.328 3.329 3.329 92.72% Castro::subcycle_advance_ctu() 10 3.258 3.261 3.274 91.18% Castro::do_advance_ctu() 10 3.258 3.261 3.274 91.18% Castro::construct_ctu_hydro_source() 10 2.04 2.327 2.442 68.02% Gravity::make_radial_gravity() 21 0.3341 0.351 0.3776 10.52% Gravity::get_new_grav_vector() 11 0.2286 0.2299 0.2311 6.44% Castro::construct_old_gravity() 10 0.1956 0.2103 0.2303 6.41% Gravity::get_old_grav_vector() 10 0.1946 0.2095 0.2297 6.40% Amr::init() 1 0.2196 0.2198 0.2199 6.13% FillPatchIterator::Initialize 41 0.181 0.1898 0.2146 5.98% Amr::initialInit() 1 0.2057 0.2061 0.2063 5.75% Castro::construct_new_gravity() 10 0.2033 0.2043 0.2053 5.72% FillPatchSingleLevel 41 0.1302 0.1461 0.1902 5.30% Castro::initialize_do_advance() 10 0.1583 0.1713 0.1797 5.00% Amr::InitializeInit() 1 0.05576 0.1054 0.1772 4.94% Amr::defBaseLevel() 1 0.05576 0.1054 0.1772 4.94% Castro::initData() 1 0.04157 0.08976 0.157 4.37% FabArray::ParallelCopy() 41 0.08853 0.1045 0.1542 4.29% Amr::FinalizeInit() 1 0.02869 0.1007 0.1505 4.19% Castro::estTimeStep() 21 0.03054 0.1017 0.1495 4.17% Castro::expand_state() 10 0.1159 0.1245 0.1305 3.63% FabArray::ParallelCopy_finish() 41 0.04043 0.06132 0.1287 3.59% Castro::computeInitialDt() 2 0.001725 0.07369 0.1235 3.44% Castro::clean_state() 62 0.1078 0.1161 0.1206 3.36% Castro::computeTemp() 63 0.06327 0.06866 0.07231 2.01% FabArray::setVal() 143 0.05411 0.06752 0.07135 1.99% Castro::initialize_advance() 10 0.0546 0.06767 0.07108 1.98% Castro::do_new_sources() 10 0.05093 0.06326 0.06643 1.85% Castro::reset_internal_energy(MultiFab) 63 0.04584 0.04997 0.05256 1.46% Castro::reset_internal_energy(Fab) 1008 0.04556 0.04964 0.05218 1.45% FabArray::ParallelCopy_nowait() 41 0.02542 0.04312 0.04922 1.37% Castro::do_old_sources() 10 0.03247 0.04504 0.04887 1.36% StateDataPhysBCFunct::() 41 0.03473 0.04151 0.04583 1.28% StateData::FillBoundary(geom) 41 0.03459 0.04136 0.04567 1.27% Castro::normalize_species() 62 0.03914 0.04146 0.04257 1.19% Castro::construct_new_source() 50 0.02231 0.02961 0.03235 0.90% Gravity::interpolate_monopole_grav() 21 0.02546 0.02723 0.02785 0.78% Castro::post_init() 1 0.02603 0.02625 0.02643 0.74% Castro::construct_new_gravity_source() 10 0.01764 0.02324 0.02549 0.71% Amr::writePlotFile() 2 0.02334 0.02347 0.02367 0.66% Castro::post_timestep() 10 0.0144 0.01596 0.01667 0.46% Castro::apply_source_to_state() 20 0.008735 0.01443 0.01624 0.45% MultiFab::Saxpy() 20 0.008703 0.01438 0.01619 0.45% FabArray::setDomainBndry() 41 0.004914 0.01189 0.01487 0.41% VisMF::Write(FabArray) 2 0.01129 0.01208 0.01427 0.40% Castro::Castro() 1 0.00931 0.01023 0.01287 0.36% Castro::check_for_nan() 20 0.009422 0.01106 0.01253 0.35% MultiFab::contains_nan() 20 0.009395 0.01103 0.01251 0.35% Castro::construct_old_source() 50 0.004955 0.01014 0.01185 0.33% Castro::construct_old_gravity_source() 10 0.004924 0.01007 0.01176 0.33% Castro::computeNewDt() 9 0.007162 0.007928 0.009909 0.28% Castro::initMFs() 1 0.00543 0.006336 0.008977 0.25% Castro::enforce_min_density() 62 0.005897 0.00678 0.007298 0.20% AmrLevel::AmrLevel(dm) 1 0.004488 0.005202 0.00728 0.20% StateData::define() 4 0.004471 0.005183 0.007261 0.20% Castro::swap_state_time_levels() 10 0.002832 0.003596 0.003839 0.11% Castro::buildMetrics() 1 0.001408 0.001639 0.00231 0.06% Castro::post_regrid() 1 0.001513 0.001602 0.00184 0.05% Castro::finalize_do_advance() 10 0.0006787 0.001146 0.001413 0.04% Amr::InitAmr() 1 0.0002942 0.0003738 0.0005421 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.537e-05 0.0002161 0.0003055 0.01% DistributionMapping::LeastUsedCPUs() 1 8.929e-06 0.0002099 0.0002978 0.01% Castro::enforce_consistent_e() 1 7.762e-05 9.58e-05 0.0001298 0.00% FabArrayBase::getCPC() 41 7.417e-05 7.747e-05 8.483e-05 0.00% Castro::finalize_advance() 10 5.676e-05 7.051e-05 7.62e-05 0.00% Amr::writeSmallPlotFile() 1 5.347e-05 5.739e-05 6.702e-05 0.00% Castro::enforce_speed_limit() 62 2.127e-05 2.653e-05 2.979e-05 0.00% FabArrayBase::CPC::define() 2 2.281e-05 2.516e-05 2.892e-05 0.00% Castro::FluxRegCrseInit 10 7.333e-06 1.541e-05 2.136e-05 0.00% Gravity::swapTimeLevels() 10 7.037e-06 1.279e-05 1.77e-05 0.00% Amr::initSubcycle() 1 8.128e-06 1.049e-05 1.611e-05 0.00% Gravity::set_mass_offset() 10 7.521e-06 1.172e-05 1.603e-05 0.00% Castro::create_source_corrector() 10 6.606e-06 1.123e-05 1.429e-05 0.00% Castro::retry_advance_ctu() 10 3.632e-06 5.728e-06 6.801e-06 0.00% Castro::FluxRegFineAdd() 10 1.758e-06 2.251e-06 2.689e-06 0.00% DistributionMapping::Distribute() 1 8.79e-07 1.093e-06 1.532e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] AMReX (22.05-16-g9473062293af) finalized