MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.11-32-gbd0cef1f097e) initialized Starting run at 22:43:41 UTC on 2022-11-22. Successfully read inputs file ... Castro git describe: 22.11-14-ge11d35bb8 AMReX git describe: 22.11-32-gbd0cef1f0 Microphysics git describe: 22.11-41-g63248ba9 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.016387163 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.362676363 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.344906996 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.343000993 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.348773017 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.356448774 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.354444767 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.340230164 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.344141311 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.340149878 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.338747282 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010428899 seconds Ending run at 22:43:44 UTC on 2022-11-22. Run time = 3.677146104 Run time without initialization = 3.492122437 Average number of zones advanced per microsecond: 0.751 Average number of zones advanced per microsecond per rank: 0.094 TinyProfiler total time across processes [min...avg...max]: 3.674 ... 3.677 ... 3.677 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.1459 2.4141 2.5277 68.74% Castro::do_advance_ctu() 10 0.01313 0.1316 0.4082 11.10% Gravity::make_radial_gravity() 21 0.3248 0.3387 0.3709 10.09% FabArray::ParallelCopy_finish() 41 0.04358 0.06175 0.1191 3.24% Castro::initData() 1 0.03949 0.08013 0.115 3.13% Castro::estTimeStep() 21 0.0324 0.0691 0.1092 2.97% amrex::Copy() 193 0.04925 0.07821 0.0898 2.44% FabArray::setVal() 143 0.06107 0.06876 0.07174 1.95% Castro::reset_internal_energy(Fab) 1008 0.04891 0.05062 0.05203 1.41% FabArray::ParallelCopy_nowait() 41 0.02805 0.04461 0.05071 1.38% StateData::FillBoundary(geom) 41 0.03549 0.0424 0.04858 1.32% Castro::normalize_species() 62 0.04117 0.0418 0.04295 1.17% FillPatchIterator::Initialize 41 0.02422 0.03571 0.04005 1.09% Gravity::interpolate_monopole_grav() 21 0.02698 0.0277 0.02822 0.77% Castro::construct_new_gravity_source() 10 0.02066 0.02303 0.02412 0.66% Castro::computeTemp() 63 0.01773 0.01948 0.02068 0.56% Castro::initialize_do_advance() 10 0.01018 0.01759 0.01936 0.53% VisMF::Write(FabArray) 2 0.013 0.014 0.01826 0.50% FabArray::Saxpy() 20 0.008703 0.01411 0.01652 0.45% FabArray::setDomainBndry() 41 0.004915 0.01037 0.01248 0.34% MultiFab::contains_nan() 20 0.009676 0.01125 0.01221 0.33% Castro::construct_old_gravity_source() 10 0.00487 0.009863 0.01174 0.32% Castro::initialize_advance() 10 0.006644 0.009906 0.01124 0.31% Amr::writePlotFile() 2 0.006329 0.009878 0.01115 0.30% Castro::initMFs() 1 0.006687 0.007143 0.008421 0.23% main() 1 0.004523 0.006845 0.007509 0.20% Castro::construct_new_source() 50 0.004867 0.006475 0.007124 0.19% Castro::enforce_min_density() 62 0.005261 0.006121 0.006949 0.19% StateData::define() 4 0.005516 0.005739 0.006338 0.17% Castro::swap_state_time_levels() 10 0.003281 0.004396 0.00465 0.13% Gravity::get_new_grav_vector() 11 0.00253 0.003893 0.004487 0.12% Gravity::get_old_grav_vector() 10 0.001405 0.002551 0.00311 0.08% Amr::coarseTimeStep() 10 0.001906 0.002203 0.002749 0.07% Castro::buildMetrics() 1 0.001562 0.001644 0.001835 0.05% Castro::finalize_do_advance() 10 0.0006533 0.001442 0.001712 0.05% Castro::expand_state() 10 0.0007154 0.0009486 0.001098 0.03% Amr::timeStep() 10 0.0001742 0.0002473 0.0004469 0.01% Amr::InitAmr() 1 0.0002809 0.000307 0.0004195 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002802 0.0003 0.0003325 0.01% Castro::clean_state() 62 0.0001437 0.0001716 0.000192 0.01% DistributionMapping::LeastUsedCPUs() 1 8.3e-06 0.0001412 0.000168 0.00% StateDataPhysBCFunct::() 41 8.018e-05 0.0001158 0.0001399 0.00% Castro::finalize_advance() 10 6.571e-05 9.608e-05 0.0001212 0.00% FabArray::ParallelCopy() 41 6.081e-05 8.403e-05 0.0001132 0.00% Castro::enforce_consistent_e() 1 7.497e-05 8.749e-05 0.0001032 0.00% Castro::Castro() 1 5.534e-05 6.977e-05 8.973e-05 0.00% Castro::construct_old_source() 50 2.793e-05 6.754e-05 8.9e-05 0.00% Castro::do_old_sources() 10 3.286e-05 6.434e-05 8.364e-05 0.00% FillPatchSingleLevel 41 5.341e-05 6.968e-05 8.114e-05 0.00% Castro::do_new_sources() 10 3.712e-05 6.595e-05 8.018e-05 0.00% Amr::FinalizeInit() 1 4.258e-06 1.42e-05 7.553e-05 0.00% Amr::writeSmallPlotFile() 1 2.378e-05 5.498e-05 7.376e-05 0.00% Castro::subcycle_advance_ctu() 10 3.999e-05 5.752e-05 7.235e-05 0.00% FabArrayBase::getCPC() 41 4.021e-05 5.386e-05 6.774e-05 0.00% Castro::apply_source_to_state() 20 2.768e-05 4.695e-05 6.385e-05 0.00% Castro::advance() 10 3.146e-05 4.735e-05 6.057e-05 0.00% Castro::construct_old_gravity() 10 2.965e-05 4.374e-05 5.498e-05 0.00% Castro::construct_new_gravity() 10 3.266e-05 4.279e-05 5.068e-05 0.00% AmrLevel::AmrLevel(dm) 1 2.201e-05 2.743e-05 3.65e-05 0.00% Castro::enforce_speed_limit() 62 2.29e-05 3.013e-05 3.569e-05 0.00% Castro::post_timestep() 10 1.34e-05 2.31e-05 3.272e-05 0.00% Amr::defBaseLevel() 1 1.744e-05 2.181e-05 2.787e-05 0.00% FabArrayBase::CPC::define() 2 2.128e-05 2.403e-05 2.733e-05 0.00% Castro::check_for_nan() 20 1.933e-05 2.32e-05 2.705e-05 0.00% Amr::init() 1 1.709e-06 4.196e-06 1.893e-05 0.00% Gravity::swapTimeLevels() 10 6.541e-06 1.319e-05 1.604e-05 0.00% Gravity::set_mass_offset() 10 7.123e-06 1.084e-05 1.366e-05 0.00% Castro::create_source_corrector() 10 5.998e-06 1.066e-05 1.35e-05 0.00% Castro::post_init() 1 3.074e-06 6.416e-06 1.161e-05 0.00% Castro::computeNewDt() 9 8.499e-06 9.564e-06 1.097e-05 0.00% Castro::FluxRegCrseInit 10 5.133e-06 8.409e-06 1.068e-05 0.00% Amr::initSubcycle() 1 7.933e-06 8.839e-06 9.422e-06 0.00% Amr::InitializeInit() 1 2.053e-06 3.535e-06 8.599e-06 0.00% Castro::retry_advance_ctu() 10 3.54e-06 5.485e-06 7.541e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.711e-06 5.331e-06 7.337e-06 0.00% Castro::post_regrid() 1 2.04e-06 3.414e-06 7.173e-06 0.00% Castro::computeInitialDt() 2 3.06e-06 3.783e-06 4.471e-06 0.00% Castro::FluxRegFineAdd() 10 1.919e-06 2.303e-06 2.881e-06 0.00% Amr::initialInit() 1 1.064e-06 1.435e-06 1.638e-06 0.00% DistributionMapping::Distribute() 1 9.76e-07 1.25e-06 1.514e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.674 3.677 3.677 100.00% Amr::coarseTimeStep() 10 3.474 3.474 3.474 94.48% Amr::timeStep() 10 3.461 3.462 3.462 94.15% Castro::advance() 10 3.445 3.446 3.446 93.71% Castro::subcycle_advance_ctu() 10 3.368 3.371 3.377 91.83% Castro::do_advance_ctu() 10 3.368 3.371 3.377 91.83% Castro::construct_ctu_hydro_source() 10 2.146 2.414 2.528 68.74% Gravity::make_radial_gravity() 21 0.345 0.3578 0.3821 10.39% Gravity::get_new_grav_vector() 11 0.2305 0.2365 0.2383 6.48% Castro::construct_old_gravity() 10 0.2013 0.212 0.2302 6.26% Gravity::get_old_grav_vector() 10 0.2005 0.2113 0.2297 6.25% FillPatchIterator::Initialize 41 0.1851 0.1952 0.2145 5.83% Castro::construct_new_gravity() 10 0.2031 0.2076 0.2094 5.70% Castro::initialize_do_advance() 10 0.1648 0.1785 0.1858 5.05% FillPatchSingleLevel 41 0.1347 0.1491 0.1854 5.04% Amr::init() 1 0.1845 0.1846 0.1846 5.02% Amr::initialInit() 1 0.1679 0.1681 0.1683 4.58% FabArray::ParallelCopy() 41 0.09154 0.1065 0.1473 4.01% Castro::expand_state() 10 0.1195 0.1304 0.1363 3.71% Amr::InitializeInit() 1 0.06028 0.1012 0.1358 3.69% Amr::defBaseLevel() 1 0.06028 0.1012 0.1358 3.69% Castro::clean_state() 62 0.1137 0.1176 0.1215 3.30% Castro::initData() 1 0.04358 0.08405 0.1191 3.24% FabArray::ParallelCopy_finish() 41 0.04358 0.06175 0.1191 3.24% Castro::estTimeStep() 21 0.0324 0.0691 0.1092 2.97% Amr::FinalizeInit() 1 0.03227 0.06697 0.1076 2.93% amrex::Copy() 193 0.04925 0.07821 0.0898 2.44% Castro::computeInitialDt() 2 0.002263 0.0369 0.07781 2.12% Castro::initialize_advance() 10 0.06433 0.07126 0.07392 2.01% Castro::computeTemp() 63 0.06691 0.0704 0.07304 1.99% FabArray::setVal() 143 0.06107 0.06876 0.07174 1.95% Castro::do_new_sources() 10 0.0548 0.06299 0.06434 1.75% Castro::reset_internal_energy(MultiFab) 63 0.04919 0.05092 0.05236 1.42% Castro::reset_internal_energy(Fab) 1008 0.04891 0.05062 0.05203 1.41% FabArray::ParallelCopy_nowait() 41 0.02813 0.04468 0.05078 1.38% StateDataPhysBCFunct::() 41 0.03557 0.04251 0.04869 1.32% StateData::FillBoundary(geom) 41 0.03549 0.0424 0.04858 1.32% Castro::do_old_sources() 10 0.03342 0.04493 0.04854 1.32% Castro::normalize_species() 62 0.04117 0.0418 0.04295 1.17% Castro::construct_new_source() 50 0.02553 0.0295 0.03079 0.84% Castro::post_init() 1 0.02945 0.02976 0.03 0.82% Gravity::interpolate_monopole_grav() 21 0.02698 0.0277 0.02822 0.77% Amr::writePlotFile() 2 0.02676 0.02695 0.02721 0.74% Castro::construct_new_gravity_source() 10 0.02066 0.02303 0.02412 0.66% VisMF::Write(FabArray) 2 0.013 0.014 0.01826 0.50% Castro::apply_source_to_state() 20 0.008734 0.01416 0.01657 0.45% FabArray::Saxpy() 20 0.008703 0.01411 0.01652 0.45% Castro::post_timestep() 10 0.01549 0.01608 0.01627 0.44% FabArray::setDomainBndry() 41 0.004915 0.01037 0.01248 0.34% Castro::check_for_nan() 20 0.009695 0.01127 0.01224 0.33% MultiFab::contains_nan() 20 0.009676 0.01125 0.01221 0.33% Castro::Castro() 1 0.01081 0.01117 0.01199 0.33% Castro::construct_old_source() 50 0.004898 0.00993 0.01181 0.32% Castro::construct_old_gravity_source() 10 0.00487 0.009863 0.01174 0.32% Castro::computeNewDt() 9 0.00879 0.008795 0.008799 0.24% Castro::initMFs() 1 0.006687 0.007143 0.008421 0.23% Castro::enforce_min_density() 62 0.005261 0.006121 0.006949 0.19% AmrLevel::AmrLevel(dm) 1 0.005538 0.005766 0.006375 0.17% StateData::define() 4 0.005516 0.005739 0.006338 0.17% Castro::swap_state_time_levels() 10 0.003281 0.004396 0.00465 0.13% Castro::finalize_advance() 10 0.003468 0.003594 0.003734 0.10% Castro::buildMetrics() 1 0.001679 0.001773 0.00199 0.05% Castro::finalize_do_advance() 10 0.0006533 0.001442 0.001712 0.05% Castro::post_regrid() 1 0.001525 0.001593 0.001659 0.05% Amr::InitAmr() 1 0.00029 0.0003158 0.0004274 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.661e-05 0.0001478 0.0001756 0.00% DistributionMapping::LeastUsedCPUs() 1 8.3e-06 0.0001412 0.000168 0.00% Castro::enforce_consistent_e() 1 7.497e-05 8.749e-05 0.0001032 0.00% FabArrayBase::getCPC() 41 6.399e-05 7.789e-05 9.507e-05 0.00% Amr::writeSmallPlotFile() 1 2.378e-05 5.498e-05 7.376e-05 0.00% Castro::enforce_speed_limit() 62 2.29e-05 3.013e-05 3.569e-05 0.00% FabArrayBase::CPC::define() 2 2.128e-05 2.403e-05 2.733e-05 0.00% Gravity::swapTimeLevels() 10 6.541e-06 1.319e-05 1.604e-05 0.00% Gravity::set_mass_offset() 10 7.123e-06 1.084e-05 1.366e-05 0.00% Castro::create_source_corrector() 10 5.998e-06 1.066e-05 1.35e-05 0.00% Castro::FluxRegCrseInit 10 5.133e-06 8.409e-06 1.068e-05 0.00% Amr::initSubcycle() 1 7.933e-06 8.839e-06 9.422e-06 0.00% Castro::retry_advance_ctu() 10 3.54e-06 5.485e-06 7.541e-06 0.00% Castro::FluxRegFineAdd() 10 1.919e-06 2.303e-06 2.881e-06 0.00% DistributionMapping::Distribute() 1 9.76e-07 1.25e-06 1.514e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] AMReX (22.11-32-gbd0cef1f097e) finalized