MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.02-10-ga7322024263f) initialized Starting run at 06:46:42 UTC on 2023-02-07. Successfully read inputs file ... Castro git describe: 23.01-28-gbabec27eb AMReX git describe: 23.02-10-ga73220242 Microphysics git describe: 23.02-4-g379d922f reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.016310392 seconds [Level 0 step 1] ADVANCE with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.368001254 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.398347463 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.342113014 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.33622441 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.363035005 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.335873566 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.314544794 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.313989355 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.316714642 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.317799366 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010085778 seconds Ending run at 06:46:45 UTC on 2023-02-07. Run time = 3.609076128 Run time without initialization = 3.423589616 Average number of zones advanced per microsecond: 0.766 Average number of zones advanced per microsecond per rank: 0.096 TinyProfiler total time across processes [min...avg...max]: 3.609 ... 3.609 ... 3.609 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.3255 2.3782 2.4391 67.58% Gravity::make_radial_gravity() 21 0.3168 0.3335 0.3431 9.51% Castro::do_advance_ctu() 10 0.05984 0.123 0.1788 4.95% Castro::estTimeStep() 21 0.03677 0.07526 0.1203 3.33% Castro::initData() 1 0.04037 0.07719 0.1135 3.14% amrex::Copy() 193 0.06236 0.07242 0.08294 2.30% FabArray::setVal() 143 0.06408 0.07033 0.07985 2.21% FabArray::ParallelCopy_finish() 41 0.0353 0.04743 0.06711 1.86% Castro::reset_internal_energy(Fab) 1008 0.04852 0.05043 0.05284 1.46% Castro::normalize_species() 62 0.04116 0.04258 0.04695 1.30% FabArray::ParallelCopy_nowait() 41 0.03798 0.04204 0.04501 1.25% StateData::FillBoundary(geom) 41 0.03474 0.03794 0.04358 1.21% FillPatchIterator::Initialize 41 0.0292 0.03459 0.03663 1.02% Castro::construct_new_gravity_source() 10 0.02338 0.02679 0.0329 0.91% Gravity::interpolate_monopole_grav() 21 0.02797 0.02847 0.02932 0.81% Castro::computeTemp() 63 0.01938 0.02016 0.02111 0.58% Castro::initialize_do_advance() 10 0.01302 0.01746 0.01877 0.52% VisMF::Write(FabArray) 2 0.01353 0.0144 0.01707 0.47% FabArray::Saxpy() 20 0.01221 0.0137 0.01443 0.40% Castro::initialize_advance() 10 0.008956 0.01115 0.01406 0.39% FabArray::setDomainBndry() 41 0.008209 0.01081 0.0121 0.34% MultiFab::contains_nan() 20 0.009926 0.01087 0.01174 0.33% Castro::construct_old_gravity_source() 10 0.007803 0.01041 0.01098 0.30% Amr::writePlotFile() 2 0.006707 0.009277 0.01013 0.28% Castro::initMFs() 1 0.006978 0.006992 0.007014 0.19% Castro::construct_new_source() 50 0.005899 0.006084 0.006613 0.18% Castro::enforce_min_density() 62 0.005903 0.006041 0.006226 0.17% main() 1 0.005503 0.005825 0.00613 0.17% StateData::define() 4 0.005687 0.005711 0.005729 0.16% Castro::swap_state_time_levels() 10 0.003324 0.004492 0.004761 0.13% Gravity::get_new_grav_vector() 11 0.003099 0.003738 0.004086 0.11% Amr::coarseTimeStep() 10 0.001421 0.002839 0.00348 0.10% Gravity::get_old_grav_vector() 10 0.001808 0.002389 0.002781 0.08% Castro::finalize_do_advance() 10 0.0005222 0.001484 0.001852 0.05% Castro::buildMetrics() 1 0.001654 0.001671 0.001683 0.05% Castro::expand_state() 10 0.0006658 0.0007921 0.001052 0.03% Amr::timeStep() 10 0.0001701 0.0002359 0.0005116 0.01% Amr::InitAmr() 1 0.0002732 0.0002961 0.0004259 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002836 0.0003081 0.0003487 0.01% DistributionMapping::LeastUsedCPUs() 1 7.295e-06 0.0001432 0.0001638 0.00% Castro::clean_state() 62 0.0001363 0.0001462 0.000157 0.00% Castro::finalize_advance() 10 8.338e-05 9.667e-05 0.0001106 0.00% StateDataPhysBCFunct::() 41 9.38e-05 9.978e-05 0.0001056 0.00% Castro::enforce_consistent_e() 1 8.255e-05 8.887e-05 9.546e-05 0.00% Castro::Castro() 1 6.537e-05 7.719e-05 8.957e-05 0.00% Castro::construct_old_source() 50 4.974e-05 6.939e-05 8.089e-05 0.00% Amr::FinalizeInit() 1 4.026e-06 1.418e-05 8.062e-05 0.00% FabArrayBase::getCPC() 41 4.269e-05 5.347e-05 8e-05 0.00% FabArray::ParallelCopy() 41 6.526e-05 7.372e-05 7.962e-05 0.00% Castro::do_old_sources() 10 4.708e-05 6.191e-05 7.609e-05 0.00% Amr::writeSmallPlotFile() 1 3.242e-05 5.276e-05 7.552e-05 0.00% Castro::advance() 10 3.361e-05 4.404e-05 7.404e-05 0.00% FillPatchSingleLevel 41 5.857e-05 6.414e-05 6.999e-05 0.00% Castro::subcycle_advance_ctu() 10 3.946e-05 4.561e-05 6.271e-05 0.00% Castro::do_new_sources() 10 5.299e-05 5.756e-05 6.165e-05 0.00% Castro::apply_source_to_state() 20 3.407e-05 4.219e-05 5.611e-05 0.00% Castro::construct_old_gravity() 10 3.541e-05 3.926e-05 4.824e-05 0.00% Castro::construct_new_gravity() 10 3.405e-05 3.808e-05 4.694e-05 0.00% Amr::defBaseLevel() 1 1.685e-05 2.325e-05 3.351e-05 0.00% Castro::enforce_speed_limit() 62 2.513e-05 2.755e-05 3.209e-05 0.00% FabArrayBase::CPC::define() 2 2.209e-05 2.553e-05 2.97e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.63e-05 2.374e-05 2.85e-05 0.00% Castro::check_for_nan() 20 2.019e-05 2.239e-05 2.521e-05 0.00% Castro::post_timestep() 10 1.483e-05 1.725e-05 2.096e-05 0.00% Castro::create_source_corrector() 10 7.379e-06 9.633e-06 1.21e-05 0.00% Gravity::swapTimeLevels() 10 7.577e-06 1.033e-05 1.202e-05 0.00% Gravity::set_mass_offset() 10 9.393e-06 1.031e-05 1.143e-05 0.00% Castro::computeNewDt() 9 8.212e-06 9.076e-06 1.025e-05 0.00% Castro::FluxRegCrseInit 10 8.169e-06 8.777e-06 9.758e-06 0.00% Amr::initSubcycle() 1 8.683e-06 8.992e-06 9.606e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.691e-06 5.371e-06 6.823e-06 0.00% Castro::retry_advance_ctu() 10 4.851e-06 5.781e-06 6.667e-06 0.00% Amr::InitializeInit() 1 1.947e-06 2.611e-06 5.398e-06 0.00% Castro::computeInitialDt() 2 3.545e-06 4.201e-06 4.815e-06 0.00% Castro::post_regrid() 1 1.877e-06 3.594e-06 4.77e-06 0.00% Castro::post_init() 1 2.525e-06 3.682e-06 4.431e-06 0.00% Amr::init() 1 1.768e-06 2.153e-06 2.749e-06 0.00% Castro::FluxRegFineAdd() 10 2.155e-06 2.404e-06 2.707e-06 0.00% Amr::initialInit() 1 1.006e-06 1.232e-06 1.547e-06 0.00% DistributionMapping::Distribute() 1 8.35e-07 1.03e-06 1.319e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.609 3.609 3.609 100.00% Amr::coarseTimeStep() 10 3.407 3.407 3.407 94.41% Amr::timeStep() 10 3.394 3.394 3.396 94.08% Castro::advance() 10 3.377 3.378 3.379 93.61% Castro::subcycle_advance_ctu() 10 3.294 3.301 3.307 91.63% Castro::do_advance_ctu() 10 3.294 3.301 3.307 91.63% Castro::construct_ctu_hydro_source() 10 2.325 2.378 2.439 67.58% Gravity::make_radial_gravity() 21 0.3337 0.3505 0.3614 10.01% Gravity::get_new_grav_vector() 11 0.2294 0.2307 0.2316 6.42% Castro::construct_old_gravity() 10 0.1899 0.204 0.2141 5.93% Gravity::get_old_grav_vector() 10 0.1892 0.2033 0.2134 5.91% Castro::construct_new_gravity() 10 0.2014 0.2022 0.2031 5.63% Amr::init() 1 0.1849 0.1851 0.1851 5.13% FillPatchIterator::Initialize 41 0.1667 0.1731 0.1824 5.05% Castro::initialize_do_advance() 10 0.1596 0.1656 0.1718 4.76% Amr::initialInit() 1 0.1685 0.1687 0.169 4.68% FillPatchSingleLevel 41 0.1197 0.1277 0.1436 3.98% Amr::InitializeInit() 1 0.06225 0.0994 0.1368 3.79% Amr::defBaseLevel() 1 0.06225 0.0994 0.1368 3.79% Castro::clean_state() 62 0.1154 0.1186 0.1241 3.44% Castro::expand_state() 10 0.1118 0.1174 0.1234 3.42% Castro::estTimeStep() 21 0.03677 0.07526 0.1203 3.33% Castro::initData() 1 0.04457 0.0816 0.119 3.30% Amr::FinalizeInit() 1 0.03199 0.06934 0.1064 2.95% FabArray::ParallelCopy() 41 0.08045 0.08962 0.1053 2.92% amrex::Copy() 193 0.06236 0.07242 0.08294 2.30% Castro::initialize_advance() 10 0.06719 0.07305 0.08085 2.24% FabArray::setVal() 143 0.06408 0.07033 0.07985 2.21% Castro::do_new_sources() 10 0.05931 0.0664 0.07775 2.15% Castro::computeInitialDt() 2 0.0022 0.03954 0.07656 2.12% Castro::computeTemp() 63 0.06874 0.07089 0.07426 2.06% FabArray::ParallelCopy_finish() 41 0.0353 0.04743 0.06711 1.86% Castro::reset_internal_energy(MultiFab) 63 0.04881 0.05073 0.05315 1.47% Castro::reset_internal_energy(Fab) 1008 0.04852 0.05043 0.05284 1.46% Castro::do_old_sources() 10 0.04107 0.04587 0.04967 1.38% Castro::normalize_species() 62 0.04116 0.04258 0.04695 1.30% FabArray::ParallelCopy_nowait() 41 0.03809 0.04211 0.04508 1.25% StateDataPhysBCFunct::() 41 0.03484 0.03804 0.04368 1.21% StateData::FillBoundary(geom) 41 0.03474 0.03794 0.04358 1.21% Castro::construct_new_source() 50 0.02937 0.03287 0.03951 1.09% Castro::construct_new_gravity_source() 10 0.02338 0.02679 0.0329 0.91% Castro::post_init() 1 0.02915 0.02941 0.02962 0.82% Gravity::interpolate_monopole_grav() 21 0.02797 0.02847 0.02932 0.81% Amr::writePlotFile() 2 0.02624 0.02647 0.0267 0.74% VisMF::Write(FabArray) 2 0.01353 0.0144 0.01707 0.47% Castro::post_timestep() 10 0.01547 0.01623 0.01685 0.47% Castro::apply_source_to_state() 20 0.01225 0.01374 0.01447 0.40% FabArray::Saxpy() 20 0.01221 0.0137 0.01443 0.40% FabArray::setDomainBndry() 41 0.008209 0.01081 0.0121 0.34% Castro::Castro() 1 0.01187 0.01189 0.01195 0.33% Castro::check_for_nan() 20 0.009952 0.01089 0.01176 0.33% MultiFab::contains_nan() 20 0.009926 0.01087 0.01174 0.33% Castro::construct_old_source() 50 0.007853 0.01048 0.01106 0.31% Castro::construct_old_gravity_source() 10 0.007803 0.01041 0.01098 0.30% Castro::computeNewDt() 9 0.009116 0.00912 0.009129 0.25% Castro::initMFs() 1 0.006978 0.006992 0.007014 0.19% Castro::enforce_min_density() 62 0.005903 0.006041 0.006226 0.17% AmrLevel::AmrLevel(dm) 1 0.005712 0.005735 0.005757 0.16% StateData::define() 4 0.005687 0.005711 0.005729 0.16% Castro::swap_state_time_levels() 10 0.003324 0.004492 0.004761 0.13% Castro::finalize_advance() 10 0.002964 0.003438 0.003995 0.11% Castro::finalize_do_advance() 10 0.0005222 0.001484 0.001852 0.05% Castro::buildMetrics() 1 0.001784 0.001806 0.001816 0.05% Castro::post_regrid() 1 0.001545 0.001615 0.00173 0.05% Amr::InitAmr() 1 0.0002825 0.0003051 0.0004347 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.496e-05 0.0001496 0.0001714 0.00% DistributionMapping::LeastUsedCPUs() 1 7.295e-06 0.0001432 0.0001638 0.00% FabArrayBase::getCPC() 41 6.599e-05 7.9e-05 0.0001062 0.00% Castro::enforce_consistent_e() 1 8.255e-05 8.887e-05 9.546e-05 0.00% Amr::writeSmallPlotFile() 1 3.242e-05 5.276e-05 7.552e-05 0.00% Castro::enforce_speed_limit() 62 2.513e-05 2.755e-05 3.209e-05 0.00% FabArrayBase::CPC::define() 2 2.209e-05 2.553e-05 2.97e-05 0.00% Castro::create_source_corrector() 10 7.379e-06 9.633e-06 1.21e-05 0.00% Gravity::swapTimeLevels() 10 7.577e-06 1.033e-05 1.202e-05 0.00% Gravity::set_mass_offset() 10 9.393e-06 1.031e-05 1.143e-05 0.00% Castro::FluxRegCrseInit 10 8.169e-06 8.777e-06 9.758e-06 0.00% Amr::initSubcycle() 1 8.683e-06 8.992e-06 9.606e-06 0.00% Castro::retry_advance_ctu() 10 4.851e-06 5.781e-06 6.667e-06 0.00% Castro::FluxRegFineAdd() 10 2.155e-06 2.404e-06 2.707e-06 0.00% DistributionMapping::Distribute() 1 8.35e-07 1.03e-06 1.319e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] AMReX (23.02-10-ga7322024263f) finalized