MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.09-18-g3e5cc7780280) initialized Starting run at 05:39:29 UTC on 2022-09-21. Successfully read inputs file ... Castro git describe: 22.09 AMReX git describe: 22.09-18-g3e5cc7780 Microphysics git describe: 22.08-13-g1adf1bdb reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.016562624 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.360677686 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.346731798 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.345148996 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.344479839 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.354480315 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.355578265 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.341615099 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.34213477 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.341823226 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.342651964 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010168775 seconds Ending run at 05:39:32 UTC on 2022-09-21. Run time = 3.682001715 Run time without initialization = 3.493414807 Average number of zones advanced per microsecond: 0.750 Average number of zones advanced per microsecond per rank: 0.094 TinyProfiler total time across processes [min...avg...max]: 3.682 ... 3.682 ... 3.682 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.0572 2.4212 2.5460 69.14% Castro::do_advance_ctu() 10 0.03382 0.1577 0.5263 14.29% Gravity::make_radial_gravity() 21 0.3432 0.3574 0.3846 10.45% FabArray::ParallelCopy_finish() 41 0.04249 0.0626 0.1234 3.35% Castro::initData() 1 0.0396 0.08169 0.1192 3.24% Castro::estTimeStep() 21 0.02927 0.06681 0.1091 2.96% FabArray::setVal() 143 0.05895 0.06822 0.07057 1.92% Castro::reset_internal_energy(Fab) 1008 0.04699 0.04984 0.05177 1.41% FabArray::ParallelCopy_nowait() 41 0.0274 0.0446 0.05005 1.36% StateData::FillBoundary(geom) 41 0.03364 0.04208 0.04625 1.26% Castro::normalize_species() 62 0.0404 0.04152 0.04245 1.15% FillPatchIterator::Initialize 41 0.02408 0.0359 0.04047 1.10% Gravity::interpolate_monopole_grav() 21 0.02559 0.02742 0.0284 0.77% Castro::construct_new_gravity_source() 10 0.01984 0.02288 0.02372 0.64% Castro::expand_state() 10 0.01004 0.01875 0.02225 0.60% Castro::computeTemp() 63 0.01736 0.01907 0.02024 0.55% Castro::initialize_do_advance() 10 0.01015 0.01745 0.01936 0.53% VisMF::Write(FabArray) 2 0.01291 0.01388 0.0181 0.49% MultiFab::Saxpy() 20 0.008916 0.01439 0.01619 0.44% Amr::writePlotFile() 2 0.008857 0.01279 0.01402 0.38% Gravity::get_new_grav_vector() 11 0.0074 0.01134 0.01279 0.35% FabArray::setDomainBndry() 41 0.004745 0.01035 0.01263 0.34% MultiFab::contains_nan() 20 0.009664 0.0109 0.01201 0.33% Castro::construct_old_gravity_source() 10 0.00504 0.0101 0.01182 0.32% Gravity::get_old_grav_vector() 10 0.005562 0.009402 0.01085 0.29% Castro::initialize_advance() 10 0.003279 0.008843 0.0106 0.29% Castro::initMFs() 1 0.006874 0.007317 0.008498 0.23% Castro::enforce_min_density() 62 0.006106 0.006692 0.007164 0.19% main() 1 0.006701 0.006923 0.007138 0.19% Castro::construct_new_source() 50 0.004701 0.006506 0.007137 0.19% StateData::define() 4 0.005631 0.005857 0.006425 0.17% Castro::swap_state_time_levels() 10 0.003286 0.004433 0.00513 0.14% Amr::coarseTimeStep() 10 0.0009151 0.001575 0.001977 0.05% Castro::buildMetrics() 1 0.001593 0.001662 0.00183 0.05% Castro::finalize_do_advance() 10 0.000666 0.001411 0.001625 0.04% Amr::InitAmr() 1 0.0002717 0.0003009 0.0004041 0.01% Amr::timeStep() 10 0.0001616 0.0002292 0.0003749 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002814 0.0003028 0.0003262 0.01% Castro::clean_state() 62 0.0001509 0.0001664 0.0001937 0.01% StateDataPhysBCFunct::() 41 9.962e-05 0.0001172 0.0001379 0.00% DistributionMapping::LeastUsedCPUs() 1 6.991e-06 0.0001069 0.0001313 0.00% Castro::enforce_consistent_e() 1 7.849e-05 8.989e-05 0.0001153 0.00% Castro::Castro() 1 5.337e-05 7.295e-05 9.725e-05 0.00% Castro::construct_old_source() 50 3.375e-05 7.341e-05 9.477e-05 0.00% FabArray::ParallelCopy() 41 6.238e-05 8.121e-05 8.985e-05 0.00% Amr::FinalizeInit() 1 3.695e-06 1.49e-05 8.799e-05 0.00% Castro::do_new_sources() 10 4.148e-05 7.143e-05 8.71e-05 0.00% Castro::do_old_sources() 10 4.199e-05 7.052e-05 8.593e-05 0.00% FillPatchSingleLevel 41 5.455e-05 6.819e-05 8.002e-05 0.00% Castro::construct_old_gravity() 10 3.415e-05 5.485e-05 7.456e-05 0.00% Castro::subcycle_advance_ctu() 10 3.83e-05 5.409e-05 7.323e-05 0.00% Amr::writeSmallPlotFile() 1 2.286e-05 5.174e-05 6.86e-05 0.00% FabArrayBase::getCPC() 41 5.022e-05 5.613e-05 6.143e-05 0.00% Castro::advance() 10 2.852e-05 4.415e-05 5.924e-05 0.00% Castro::finalize_advance() 10 5.273e-05 5.413e-05 5.68e-05 0.00% Castro::apply_source_to_state() 20 3.27e-05 4.856e-05 5.678e-05 0.00% Castro::construct_new_gravity() 10 3.561e-05 4.759e-05 5.625e-05 0.00% Amr::defBaseLevel() 1 3.3e-05 3.841e-05 4.387e-05 0.00% Castro::enforce_speed_limit() 62 2.233e-05 2.839e-05 3.611e-05 0.00% Castro::post_timestep() 10 1.422e-05 2.166e-05 3.231e-05 0.00% FabArrayBase::CPC::define() 2 2.321e-05 2.65e-05 3.135e-05 0.00% Castro::check_for_nan() 20 2.12e-05 2.44e-05 2.703e-05 0.00% Amr::InitializeInit() 1 2.059e-06 8.105e-06 1.813e-05 0.00% AmrLevel::AmrLevel(dm) 1 7.651e-06 1.29e-05 1.716e-05 0.00% Gravity::swapTimeLevels() 10 7.318e-06 1.304e-05 1.582e-05 0.00% Castro::create_source_corrector() 10 7.309e-06 1.03e-05 1.408e-05 0.00% Castro::FluxRegCrseInit 10 6.766e-06 8.775e-06 1.148e-05 0.00% Gravity::set_mass_offset() 10 7.21e-06 9.588e-06 1.119e-05 0.00% Castro::computeNewDt() 9 7.781e-06 8.898e-06 9.967e-06 0.00% Amr::initSubcycle() 1 7.935e-06 8.733e-06 9.724e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.585e-06 5.012e-06 9.34e-06 0.00% Castro::retry_advance_ctu() 10 3.986e-06 5.439e-06 6.682e-06 0.00% Castro::computeInitialDt() 2 3.025e-06 3.909e-06 5.655e-06 0.00% Castro::post_init() 1 3.091e-06 3.502e-06 4.41e-06 0.00% Castro::post_regrid() 1 2.244e-06 2.86e-06 3.865e-06 0.00% Castro::FluxRegFineAdd() 10 1.88e-06 2.254e-06 2.606e-06 0.00% Amr::init() 1 2.039e-06 2.174e-06 2.51e-06 0.00% Amr::initialInit() 1 1.259e-06 1.555e-06 1.949e-06 0.00% DistributionMapping::Distribute() 1 8.49e-07 1.008e-06 1.133e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.682 3.682 3.682 100.00% Amr::coarseTimeStep() 10 3.476 3.476 3.476 94.41% Amr::timeStep() 10 3.466 3.467 3.467 94.16% Castro::advance() 10 3.45 3.45 3.45 93.71% Castro::subcycle_advance_ctu() 10 3.379 3.381 3.39 92.08% Castro::do_advance_ctu() 10 3.378 3.381 3.39 92.08% Castro::construct_ctu_hydro_source() 10 2.057 2.421 2.546 69.14% Gravity::make_radial_gravity() 21 0.3432 0.3574 0.3846 10.45% Castro::construct_old_gravity() 10 0.2028 0.2152 0.2362 6.41% Gravity::get_old_grav_vector() 10 0.2018 0.2144 0.2356 6.40% Gravity::get_new_grav_vector() 11 0.2275 0.2322 0.2338 6.35% FillPatchIterator::Initialize 41 0.1871 0.1959 0.2159 5.86% Castro::construct_new_gravity() 10 0.2008 0.2045 0.2059 5.59% Amr::init() 1 0.188 0.1882 0.1882 5.11% FillPatchSingleLevel 41 0.1355 0.1496 0.1871 5.08% Castro::initialize_do_advance() 10 0.1627 0.1788 0.1867 5.07% Amr::initialInit() 1 0.1713 0.1717 0.1722 4.68% FabArray::ParallelCopy() 41 0.09242 0.1074 0.151 4.10% Amr::InitializeInit() 1 0.06073 0.1033 0.1409 3.83% Amr::defBaseLevel() 1 0.06072 0.1033 0.1409 3.83% Castro::expand_state() 10 0.1191 0.1311 0.1368 3.71% Castro::initData() 1 0.04368 0.08583 0.1241 3.37% FabArray::ParallelCopy_finish() 41 0.04249 0.0626 0.1234 3.35% Castro::clean_state() 62 0.111 0.1166 0.1207 3.28% Amr::FinalizeInit() 1 0.0308 0.06846 0.1109 3.01% Castro::estTimeStep() 21 0.02927 0.06681 0.1091 2.96% Castro::computeInitialDt() 2 0.001857 0.03947 0.08204 2.23% Castro::computeTemp() 63 0.06464 0.06921 0.07199 1.96% Castro::initialize_advance() 10 0.05896 0.06933 0.07179 1.95% FabArray::setVal() 143 0.05895 0.06822 0.07057 1.92% Castro::do_new_sources() 10 0.05297 0.06309 0.06493 1.76% Castro::reset_internal_energy(MultiFab) 63 0.04728 0.05014 0.0521 1.41% Castro::reset_internal_energy(Fab) 1008 0.04699 0.04984 0.05177 1.41% FabArray::ParallelCopy_nowait() 41 0.02748 0.04468 0.05014 1.36% Castro::do_old_sources() 10 0.0331 0.04512 0.04912 1.33% StateDataPhysBCFunct::() 41 0.03374 0.0422 0.04636 1.26% StateData::FillBoundary(geom) 41 0.03364 0.04208 0.04625 1.26% Castro::normalize_species() 62 0.0404 0.04152 0.04245 1.15% Castro::construct_new_source() 50 0.02454 0.02938 0.03059 0.83% Castro::post_init() 1 0.02799 0.02837 0.02866 0.78% Gravity::interpolate_monopole_grav() 21 0.02559 0.02742 0.0284 0.77% Amr::writePlotFile() 2 0.02618 0.02667 0.02696 0.73% Castro::construct_new_gravity_source() 10 0.01984 0.02288 0.02372 0.64% VisMF::Write(FabArray) 2 0.01291 0.01388 0.0181 0.49% Castro::post_timestep() 10 0.01575 0.01603 0.01647 0.45% Castro::apply_source_to_state() 20 0.008949 0.01444 0.01624 0.44% MultiFab::Saxpy() 20 0.008916 0.01439 0.01619 0.44% FabArray::setDomainBndry() 41 0.004745 0.01035 0.01263 0.34% Castro::Castro() 1 0.01099 0.01142 0.01222 0.33% Castro::check_for_nan() 20 0.009686 0.01093 0.01204 0.33% MultiFab::contains_nan() 20 0.009664 0.0109 0.01201 0.33% Castro::construct_old_source() 50 0.005074 0.01017 0.01191 0.32% Castro::construct_old_gravity_source() 10 0.00504 0.0101 0.01182 0.32% Castro::initMFs() 1 0.006874 0.007317 0.008498 0.23% Castro::enforce_min_density() 62 0.006106 0.006692 0.007164 0.19% Castro::computeNewDt() 9 0.007018 0.007033 0.00705 0.19% AmrLevel::AmrLevel(dm) 1 0.00564 0.00587 0.006441 0.17% StateData::define() 4 0.005631 0.005857 0.006425 0.17% Castro::swap_state_time_levels() 10 0.003286 0.004433 0.00513 0.14% Castro::buildMetrics() 1 0.001708 0.001793 0.001991 0.05% Castro::post_regrid() 1 0.001538 0.001643 0.001924 0.05% Castro::finalize_do_advance() 10 0.000666 0.001411 0.001625 0.04% Amr::InitAmr() 1 0.0002811 0.0003096 0.000412 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.143e-05 0.0001129 0.0001386 0.00% DistributionMapping::LeastUsedCPUs() 1 6.991e-06 0.0001069 0.0001313 0.00% Castro::enforce_consistent_e() 1 7.849e-05 8.989e-05 0.0001153 0.00% FabArrayBase::getCPC() 41 7.343e-05 8.263e-05 9.011e-05 0.00% Castro::finalize_advance() 10 6.138e-05 6.516e-05 7.063e-05 0.00% Amr::writeSmallPlotFile() 1 2.286e-05 5.174e-05 6.86e-05 0.00% Castro::enforce_speed_limit() 62 2.233e-05 2.839e-05 3.611e-05 0.00% FabArrayBase::CPC::define() 2 2.321e-05 2.65e-05 3.135e-05 0.00% Gravity::swapTimeLevels() 10 7.318e-06 1.304e-05 1.582e-05 0.00% Castro::create_source_corrector() 10 7.309e-06 1.03e-05 1.408e-05 0.00% Castro::FluxRegCrseInit 10 6.766e-06 8.775e-06 1.148e-05 0.00% Gravity::set_mass_offset() 10 7.21e-06 9.588e-06 1.119e-05 0.00% Amr::initSubcycle() 1 7.935e-06 8.733e-06 9.724e-06 0.00% Castro::retry_advance_ctu() 10 3.986e-06 5.439e-06 6.682e-06 0.00% Castro::FluxRegFineAdd() 10 1.88e-06 2.254e-06 2.606e-06 0.00% DistributionMapping::Distribute() 1 8.49e-07 1.008e-06 1.133e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] AMReX (22.09-18-g3e5cc7780280) finalized