MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.02-31-ge52fb91f805b) initialized Starting run at 17:07:45 UTC on 2023-02-11. Successfully read inputs file ... Castro git describe: 23.01-32-ga29e2eca5 AMReX git describe: 23.02-31-ge52fb91f8 Microphysics git describe: 23.02-9-gfebab1f7 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.016573563 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.377368221 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.369234291 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.358790051 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.34238091 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.367900967 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.330902557 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.316119863 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.316433352 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.319158352 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.317488358 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010783492 seconds Ending run at 17:07:48 UTC on 2023-02-11. Run time = 3.623909249 Run time without initialization = 3.433766799 Average number of zones advanced per microsecond: 0.763 Average number of zones advanced per microsecond per rank: 0.095 TinyProfiler total time across processes [min...avg...max]: 3.623 ... 3.624 ... 3.624 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2805 2.4005 2.4501 67.61% Gravity::make_radial_gravity() 21 0.324 0.3346 0.3487 9.62% Castro::do_advance_ctu() 10 0.04473 0.09607 0.2194 6.05% Castro::initData() 1 0.03974 0.08083 0.1184 3.27% Castro::estTimeStep() 21 0.02475 0.06655 0.1034 2.85% amrex::Copy() 193 0.07227 0.07877 0.08587 2.37% FabArray::setVal() 143 0.06496 0.07181 0.07849 2.17% FabArray::ParallelCopy_finish() 41 0.03604 0.045 0.05401 1.49% Castro::reset_internal_energy(Fab) 1008 0.04987 0.05095 0.053 1.46% FabArray::ParallelCopy_nowait() 41 0.04177 0.04565 0.04698 1.30% Castro::normalize_species() 62 0.04196 0.04242 0.04293 1.18% StateData::FillBoundary(geom) 41 0.03296 0.03708 0.04059 1.12% FillPatchIterator::Initialize 41 0.03037 0.03726 0.03901 1.08% Gravity::interpolate_monopole_grav() 21 0.02843 0.0292 0.02989 0.82% Castro::construct_new_gravity_source() 10 0.02407 0.0268 0.02941 0.81% Castro::computeTemp() 63 0.01995 0.02038 0.02096 0.58% Castro::initialize_do_advance() 10 0.01821 0.0189 0.01946 0.54% VisMF::Write(FabArray) 2 0.0136 0.01435 0.01734 0.48% FabArray::Saxpy() 20 0.01422 0.01492 0.01561 0.43% Castro::initialize_advance() 10 0.009376 0.01172 0.01416 0.39% MultiFab::contains_nan() 20 0.01148 0.01228 0.01357 0.37% FabArray::setDomainBndry() 41 0.008966 0.01216 0.01306 0.36% Amr::writePlotFile() 2 0.007578 0.01065 0.01166 0.32% Castro::construct_old_gravity_source() 10 0.01008 0.01105 0.01165 0.32% Castro::initMFs() 1 0.006929 0.007376 0.007964 0.22% Castro::construct_new_source() 50 0.006328 0.00651 0.006782 0.19% Castro::enforce_min_density() 62 0.00591 0.006265 0.006569 0.18% main() 1 0.005531 0.00615 0.006459 0.18% StateData::define() 4 0.005687 0.006079 0.006379 0.18% Castro::swap_state_time_levels() 10 0.003801 0.004776 0.004929 0.14% Gravity::get_new_grav_vector() 11 0.003407 0.003981 0.004277 0.12% Gravity::get_old_grav_vector() 10 0.001857 0.002772 0.003246 0.09% Amr::coarseTimeStep() 10 0.001026 0.002121 0.002726 0.08% Castro::finalize_do_advance() 10 0.001719 0.002127 0.00249 0.07% Castro::buildMetrics() 1 0.001624 0.001741 0.00184 0.05% Castro::expand_state() 10 0.001106 0.001247 0.001408 0.04% Amr::timeStep() 10 0.0001994 0.0002611 0.0004737 0.01% Amr::InitAmr() 1 0.0002807 0.0003208 0.0004729 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002733 0.000293 0.0003287 0.01% DistributionMapping::LeastUsedCPUs() 1 6.636e-06 0.0001681 0.0002093 0.01% Castro::clean_state() 62 0.0001587 0.0001695 0.0001816 0.01% StateDataPhysBCFunct::() 41 9.62e-05 0.0001072 0.0001349 0.00% Amr::writeSmallPlotFile() 1 6.416e-05 8.114e-05 0.0001106 0.00% Castro::finalize_advance() 10 8.53e-05 9.268e-05 0.0001022 0.00% Castro::enforce_consistent_e() 1 8.2e-05 9.215e-05 0.0001004 0.00% Castro::Castro() 1 6.384e-05 7.887e-05 0.0001003 0.00% FillPatchSingleLevel 41 6.974e-05 8.054e-05 9.857e-05 0.00% FabArray::ParallelCopy() 41 7.41e-05 8.157e-05 9.564e-05 0.00% Castro::subcycle_advance_ctu() 10 4.376e-05 5.343e-05 9.237e-05 0.00% Castro::construct_old_source() 50 7.037e-05 7.817e-05 9.083e-05 0.00% Castro::do_old_sources() 10 6.338e-05 6.807e-05 7.31e-05 0.00% Amr::FinalizeInit() 1 3.562e-06 1.354e-05 7.173e-05 0.00% Castro::do_new_sources() 10 6.326e-05 6.692e-05 7.14e-05 0.00% FabArrayBase::getCPC() 41 5.21e-05 5.852e-05 7.045e-05 0.00% Castro::construct_old_gravity() 10 4.283e-05 5.108e-05 6.694e-05 0.00% Castro::apply_source_to_state() 20 4.147e-05 5.198e-05 6.641e-05 0.00% Castro::construct_new_gravity() 10 3.229e-05 4.255e-05 5.185e-05 0.00% Amr::defBaseLevel() 1 2.885e-05 3.656e-05 4.897e-05 0.00% Castro::advance() 10 3.766e-05 4.216e-05 4.462e-05 0.00% Castro::post_timestep() 10 1.782e-05 2.601e-05 3.423e-05 0.00% FabArrayBase::CPC::define() 2 2.309e-05 2.618e-05 3.331e-05 0.00% Castro::enforce_speed_limit() 62 2.46e-05 2.768e-05 3.21e-05 0.00% Castro::check_for_nan() 20 1.996e-05 2.349e-05 2.756e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.321e-05 1.696e-05 2.393e-05 0.00% Amr::initSubcycle() 1 9.295e-06 1.061e-05 1.45e-05 0.00% Castro::create_source_corrector() 10 7.937e-06 1.047e-05 1.422e-05 0.00% Gravity::swapTimeLevels() 10 1.125e-05 1.243e-05 1.362e-05 0.00% Gravity::set_mass_offset() 10 9.672e-06 1.068e-05 1.143e-05 0.00% Castro::computeNewDt() 9 7.953e-06 9.162e-06 1.084e-05 0.00% Castro::FluxRegCrseInit 10 6.736e-06 8.087e-06 9.864e-06 0.00% Castro::retry_advance_ctu() 10 4.94e-06 5.484e-06 6.096e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.78e-06 4.534e-06 5.718e-06 0.00% Amr::InitializeInit() 1 2.017e-06 2.877e-06 4.89e-06 0.00% Castro::computeInitialDt() 2 3.154e-06 3.672e-06 4.507e-06 0.00% Castro::post_regrid() 1 1.907e-06 2.99e-06 4.098e-06 0.00% Castro::post_init() 1 2.537e-06 3.517e-06 4.089e-06 0.00% Castro::FluxRegFineAdd() 10 1.947e-06 2.322e-06 2.759e-06 0.00% Amr::init() 1 1.748e-06 1.965e-06 2.257e-06 0.00% Amr::initialInit() 1 1.186e-06 1.453e-06 1.874e-06 0.00% DistributionMapping::Distribute() 1 9.94e-07 1.221e-06 1.868e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.623 3.624 3.624 100.00% Amr::coarseTimeStep() 10 3.417 3.417 3.417 94.28% Amr::timeStep() 10 3.404 3.405 3.406 93.98% Castro::advance() 10 3.388 3.388 3.389 93.51% Castro::subcycle_advance_ctu() 10 3.305 3.31 3.314 91.45% Castro::do_advance_ctu() 10 3.305 3.31 3.314 91.45% Castro::construct_ctu_hydro_source() 10 2.281 2.401 2.45 67.61% Gravity::make_radial_gravity() 21 0.3407 0.3528 0.3644 10.06% Gravity::get_new_grav_vector() 11 0.2279 0.2296 0.2316 6.39% Castro::construct_old_gravity() 10 0.2017 0.2105 0.2208 6.09% Gravity::get_old_grav_vector() 10 0.2008 0.2097 0.2201 6.07% Castro::construct_new_gravity() 10 0.2006 0.2018 0.203 5.60% Amr::init() 1 0.1895 0.1897 0.1897 5.23% FillPatchIterator::Initialize 41 0.1685 0.1775 0.1888 5.21% Castro::initialize_do_advance() 10 0.1606 0.1722 0.182 5.02% Amr::initialInit() 1 0.1723 0.1726 0.1728 4.77% Amr::InitializeInit() 1 0.0607 0.1027 0.141 3.89% Amr::defBaseLevel() 1 0.06069 0.1027 0.141 3.89% FillPatchSingleLevel 41 0.1185 0.1281 0.1373 3.79% Castro::expand_state() 10 0.1107 0.1222 0.1323 3.65% Castro::clean_state() 62 0.118 0.1195 0.1225 3.38% Castro::initData() 1 0.0441 0.08495 0.1222 3.37% Amr::FinalizeInit() 1 0.0313 0.06988 0.1117 3.08% Castro::estTimeStep() 21 0.02475 0.06655 0.1034 2.85% FabArray::ParallelCopy() 41 0.08276 0.09082 0.09794 2.70% amrex::Copy() 193 0.07227 0.07877 0.08587 2.37% Castro::computeInitialDt() 2 0.002175 0.04044 0.08249 2.28% Castro::initialize_advance() 10 0.07104 0.07505 0.0802 2.21% FabArray::setVal() 143 0.06496 0.07181 0.07849 2.17% Castro::computeTemp() 63 0.07023 0.07161 0.07425 2.05% Castro::do_new_sources() 10 0.06285 0.06828 0.07409 2.04% FabArray::ParallelCopy_finish() 41 0.03604 0.045 0.05401 1.49% Castro::reset_internal_energy(MultiFab) 63 0.05014 0.05124 0.05329 1.47% Castro::reset_internal_energy(Fab) 1008 0.04987 0.05095 0.053 1.46% Castro::do_old_sources() 10 0.04628 0.04723 0.04781 1.32% FabArray::ParallelCopy_nowait() 41 0.04186 0.04574 0.04706 1.30% Castro::normalize_species() 62 0.04196 0.04242 0.04293 1.18% StateDataPhysBCFunct::() 41 0.03309 0.03719 0.0407 1.12% StateData::FillBoundary(geom) 41 0.03296 0.03708 0.04059 1.12% Castro::construct_new_source() 50 0.03058 0.03331 0.03613 1.00% Gravity::interpolate_monopole_grav() 21 0.02843 0.0292 0.02989 0.82% Castro::construct_new_gravity_source() 10 0.02407 0.0268 0.02941 0.81% Castro::post_init() 1 0.02868 0.02891 0.02915 0.80% Amr::writePlotFile() 2 0.02757 0.0279 0.02821 0.78% VisMF::Write(FabArray) 2 0.0136 0.01435 0.01734 0.48% Castro::post_timestep() 10 0.01568 0.0161 0.0167 0.46% Castro::apply_source_to_state() 20 0.01428 0.01497 0.01566 0.43% FabArray::Saxpy() 20 0.01422 0.01492 0.01561 0.43% Castro::check_for_nan() 20 0.0115 0.01231 0.01359 0.38% MultiFab::contains_nan() 20 0.01148 0.01228 0.01357 0.37% FabArray::setDomainBndry() 41 0.008966 0.01216 0.01306 0.36% Castro::Castro() 1 0.01065 0.01149 0.01229 0.34% Castro::construct_old_source() 50 0.01015 0.01112 0.01173 0.32% Castro::construct_old_gravity_source() 10 0.01008 0.01105 0.01165 0.32% Castro::computeNewDt() 9 0.008689 0.008698 0.008709 0.24% Castro::initMFs() 1 0.006929 0.007376 0.007964 0.22% Castro::enforce_min_density() 62 0.00591 0.006265 0.006569 0.18% AmrLevel::AmrLevel(dm) 1 0.005704 0.006096 0.006393 0.18% StateData::define() 4 0.005687 0.006079 0.006379 0.18% Castro::swap_state_time_levels() 10 0.003801 0.004776 0.004929 0.14% Castro::finalize_advance() 10 0.002932 0.003322 0.003746 0.10% Castro::finalize_do_advance() 10 0.001719 0.002127 0.00249 0.07% Castro::buildMetrics() 1 0.001744 0.001875 0.00199 0.05% Castro::post_regrid() 1 0.001614 0.001695 0.001979 0.05% Amr::InitAmr() 1 0.0002901 0.0003314 0.0004835 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.182e-05 0.0001739 0.0002156 0.01% DistributionMapping::LeastUsedCPUs() 1 6.636e-06 0.0001681 0.0002093 0.01% Amr::writeSmallPlotFile() 1 6.416e-05 8.114e-05 0.0001106 0.00% Castro::enforce_consistent_e() 1 8.2e-05 9.215e-05 0.0001004 0.00% FabArrayBase::getCPC() 41 7.617e-05 8.47e-05 9.354e-05 0.00% FabArrayBase::CPC::define() 2 2.309e-05 2.618e-05 3.331e-05 0.00% Castro::enforce_speed_limit() 62 2.46e-05 2.768e-05 3.21e-05 0.00% Amr::initSubcycle() 1 9.295e-06 1.061e-05 1.45e-05 0.00% Castro::create_source_corrector() 10 7.937e-06 1.047e-05 1.422e-05 0.00% Gravity::swapTimeLevels() 10 1.125e-05 1.243e-05 1.362e-05 0.00% Gravity::set_mass_offset() 10 9.672e-06 1.068e-05 1.143e-05 0.00% Castro::FluxRegCrseInit 10 6.736e-06 8.087e-06 9.864e-06 0.00% Castro::retry_advance_ctu() 10 4.94e-06 5.484e-06 6.096e-06 0.00% Castro::FluxRegFineAdd() 10 1.947e-06 2.322e-06 2.759e-06 0.00% DistributionMapping::Distribute() 1 9.94e-07 1.221e-06 1.868e-06 0.00% ------------------------------------------------------------------------------------------- Cpu (amrex_mempool) Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 27 B 30 B 36 B 8192 KiB 8192 KiB 8192 KiB amrex_mempool_init() 8 8 15 KiB 16 KiB 17 KiB 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] AMReX (23.02-31-ge52fb91f805b) finalized