Initializing AMReX (23.11-5-gd36463103dae)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.11-5-gd36463103dae) initialized Starting run at 06:37:42 UTC on 2023-11-07. Successfully read inputs file ... Castro git describe: 23.11-3-g640a8312a AMReX git describe: 23.11-5-gd36463103 Microphysics git describe: 23.11 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.014245834 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.369759597 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.351927789 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.332597965 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.334126927 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.333321006 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.369191227 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.31211713 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.306055613 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.307650379 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.307728209 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010196244 seconds Ending run at 06:37:46 UTC on 2023-11-07. Run time = 3.522158102 Run time without initialization = 3.340768782 Average number of zones advanced per microsecond: 0.785 Average number of zones advanced per microsecond per rank: 0.098 TinyProfiler total time across processes [min...avg...max]: 3.521 ... 3.522 ... 3.522 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.3095 2.3543 2.4036 68.24% Gravity::make_radial_gravity() 21 0.2876 0.3085 0.3242 9.20% check_for_negative_density() 10 0.02325 0.07644 0.1258 3.57% Castro::initData() 1 0.04747 0.0853 0.1197 3.40% Castro::estTimeStep() 21 0.02304 0.06093 0.102 2.89% amrex::Copy() 193 0.07368 0.08428 0.09907 2.81% FabArray::setVal() 143 0.06892 0.07651 0.0836 2.37% FabArray::ParallelCopy_finish() 41 0.04443 0.05123 0.06105 1.73% Castro::reset_internal_energy(Fab) 1008 0.04667 0.04791 0.04902 1.39% FabArray::ParallelCopy_nowait() 41 0.04036 0.0431 0.04407 1.25% Castro::normalize_species() 62 0.04081 0.04162 0.04237 1.20% StateData::FillBoundary(geom) 41 0.03068 0.03376 0.03835 1.09% FillPatchIterator::Initialize 41 0.0283 0.03443 0.03774 1.07% Gravity::interpolate_monopole_grav() 21 0.02773 0.02899 0.02993 0.85% Castro::construct_new_gravity_source() 10 0.02358 0.02514 0.02675 0.76% Castro::computeTemp() 63 0.01968 0.01999 0.02077 0.59% Castro::initialize_do_advance() 10 0.01605 0.01803 0.01929 0.55% Castro::initialize_advance() 10 0.0106 0.0132 0.01585 0.45% MultiFab::contains_nan() 20 0.01046 0.01307 0.01569 0.45% VisMF::Write(FabArray) 2 0.01241 0.01291 0.01524 0.43% FabArray::Saxpy() 20 0.01193 0.01356 0.01459 0.41% FabArray::setDomainBndry() 41 0.008155 0.01105 0.01371 0.39% Castro::construct_old_gravity_source() 10 0.00946 0.01002 0.01063 0.30% Amr::writePlotFile() 2 0.00644 0.008684 0.009257 0.26% Castro::enforce_min_density() 62 0.007275 0.007531 0.007754 0.22% Castro::construct_new_source() 50 0.006305 0.006578 0.006931 0.20% Castro::initMFs() 1 0.006185 0.006218 0.0063 0.18% main() 1 0.003805 0.004871 0.005312 0.15% StateData::define() 4 0.005202 0.005243 0.005286 0.15% Castro::swap_state_time_levels() 10 0.003336 0.004445 0.004644 0.13% Gravity::get_new_grav_vector() 11 0.002929 0.003639 0.004008 0.11% Amr::coarseTimeStep() 10 0.00111 0.001748 0.00232 0.07% Gravity::get_old_grav_vector() 10 0.001497 0.002011 0.00229 0.07% Castro::finalize_do_advance() 10 0.001068 0.001257 0.001506 0.04% Castro::buildMetrics() 1 0.001464 0.001471 0.00148 0.04% AmrLevel::FillPatch() 41 0.0007345 0.0009695 0.001424 0.04% Amr::timeStep() 10 0.0001679 0.0002412 0.0004382 0.01% Amr::InitAmr() 1 0.0002659 0.000289 0.0003961 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002713 0.0002853 0.0003006 0.01% StateDataPhysBCFunct::() 41 9.581e-05 0.0001242 0.0001762 0.01% Castro::clean_state() 62 0.0001449 0.0001529 0.0001688 0.00% Castro::do_advance_ctu() 10 0.0001316 0.0001461 0.0001633 0.00% DistributionMapping::LeastUsedCPUs() 1 6.559e-06 0.0001207 0.0001439 0.00% FillPatchIterator::FillFromLevel0() 41 0.0001044 0.0001208 0.0001411 0.00% Castro::enforce_consistent_e() 1 8.116e-05 9.628e-05 0.0001239 0.00% Amr::FinalizeInit() 1 4.751e-06 1.903e-05 0.0001129 0.00% Castro::Castro() 1 7.145e-05 8.747e-05 0.000108 0.00% Castro::construct_old_source() 50 6.21e-05 7.58e-05 0.0001037 0.00% Castro::finalize_advance() 10 7.564e-05 8.787e-05 0.0001013 0.00% Castro::do_old_sources() 10 7.193e-05 9.178e-05 0.0001007 0.00% FabArray::ParallelCopy() 41 7.225e-05 8.761e-05 0.0001006 0.00% FillPatchSingleLevel 41 6.454e-05 7.331e-05 7.755e-05 0.00% FabArrayBase::getCPC() 41 4.042e-05 5.191e-05 7.179e-05 0.00% Castro::do_new_sources() 10 5.094e-05 6.419e-05 7.069e-05 0.00% Castro::construct_old_gravity() 10 3.087e-05 4.136e-05 6.189e-05 0.00% Castro::advance() 10 3.808e-05 4.917e-05 6.124e-05 0.00% Amr::writeSmallPlotFile() 1 3.144e-05 4.701e-05 6.01e-05 0.00% Castro::subcycle_advance_ctu() 10 4.216e-05 5.47e-05 5.988e-05 0.00% Castro::apply_source_to_state() 20 3.556e-05 4.52e-05 4.956e-05 0.00% Amr::defBaseLevel() 1 2.631e-05 3.55e-05 4.851e-05 0.00% Castro::construct_new_gravity() 10 3.29e-05 3.838e-05 4.34e-05 0.00% Castro::expand_state() 10 1.937e-05 2.663e-05 3.377e-05 0.00% Castro::enforce_speed_limit() 62 2.501e-05 2.796e-05 3.219e-05 0.00% FabArrayBase::CPC::define() 2 2.339e-05 2.734e-05 3.071e-05 0.00% Castro::check_for_nan() 20 2.243e-05 2.489e-05 2.709e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.33e-05 1.778e-05 2.137e-05 0.00% Gravity::swapTimeLevels() 10 9.125e-06 1.167e-05 2.033e-05 0.00% Amr::initSubcycle() 1 9.764e-06 1.141e-05 1.95e-05 0.00% Castro::post_init() 1 1.416e-05 1.611e-05 1.944e-05 0.00% Castro::post_timestep() 10 1.26e-05 1.454e-05 1.67e-05 0.00% Castro::FluxRegCrseInit 10 6.181e-06 1.013e-05 1.459e-05 0.00% Gravity::set_mass_offset() 10 9.669e-06 1.24e-05 1.438e-05 0.00% Castro::create_source_corrector() 10 7.065e-06 8.354e-06 1.062e-05 0.00% Castro::computeNewDt() 9 7.608e-06 8.172e-06 8.666e-06 0.00% Castro::FluxRegFineAdd() 10 2.058e-06 3.361e-06 8.557e-06 0.00% Amr::initialInit() 1 1.429e-06 2.671e-06 7.937e-06 0.00% Castro::retry_advance_ctu() 10 6.512e-06 7.059e-06 7.732e-06 0.00% Amr::init() 1 1.912e-06 3.413e-06 6.868e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.586e-06 4.879e-06 6.634e-06 0.00% Amr::InitializeInit() 1 1.777e-06 3.094e-06 5.915e-06 0.00% Castro::computeInitialDt() 2 3.518e-06 4.368e-06 5.431e-06 0.00% Castro::post_regrid() 1 1.946e-06 3.193e-06 4.141e-06 0.00% DistributionMapping::Distribute() 1 7.95e-07 1.115e-06 1.968e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.521 3.522 3.522 100.00% Amr::coarseTimeStep() 10 3.325 3.325 3.325 94.41% Amr::timeStep() 10 3.313 3.313 3.314 94.09% Castro::advance() 10 3.297 3.297 3.298 93.62% Castro::subcycle_advance_ctu() 10 3.213 3.216 3.219 91.38% Castro::do_advance_ctu() 10 3.212 3.216 3.219 91.38% Castro::construct_ctu_hydro_source() 10 2.447 2.452 2.457 69.76% Gravity::make_radial_gravity() 21 0.303 0.3248 0.3413 9.69% AmrLevel::FillPatch() 41 0.1932 0.2091 0.2199 6.24% Castro::construct_old_gravity() 10 0.181 0.1995 0.2133 6.06% Gravity::get_new_grav_vector() 11 0.2095 0.2114 0.2128 6.04% Gravity::get_old_grav_vector() 10 0.18 0.1986 0.2127 6.04% Castro::initialize_do_advance() 10 0.1643 0.1767 0.1932 5.48% Castro::construct_new_gravity() 10 0.1873 0.1885 0.1898 5.39% FillPatchIterator::Initialize 41 0.159 0.1741 0.1859 5.28% Amr::init() 1 0.1808 0.1809 0.181 5.14% Amr::initialInit() 1 0.1664 0.1666 0.1668 4.74% Amr::InitializeInit() 1 0.06793 0.1059 0.1402 3.98% Amr::defBaseLevel() 1 0.06793 0.1059 0.1401 3.98% FillPatchIterator::FillFromLevel0() 41 0.1208 0.1286 0.137 3.89% FillPatchSingleLevel 41 0.1207 0.1285 0.1368 3.89% Castro::expand_state() 10 0.1071 0.1188 0.1326 3.76% check_for_negative_density() 10 0.02325 0.07644 0.1258 3.57% Castro::initData() 1 0.0516 0.08951 0.1239 3.52% Castro::clean_state() 62 0.1149 0.1166 0.1183 3.36% FabArray::ParallelCopy() 41 0.08868 0.0945 0.1045 2.97% Castro::do_old_sources() 10 0.09554 0.1002 0.1044 2.96% Castro::estTimeStep() 21 0.02304 0.06093 0.102 2.89% amrex::Copy() 193 0.07368 0.08428 0.09907 2.81% Amr::FinalizeInit() 1 0.02664 0.06075 0.09889 2.81% FabArray::setVal() 143 0.06892 0.07651 0.0836 2.37% Castro::initialize_advance() 10 0.07513 0.07773 0.08118 2.30% Castro::computeInitialDt() 2 0.00215 0.03639 0.07437 2.11% Castro::computeTemp() 63 0.067 0.06818 0.06981 1.98% Castro::do_new_sources() 10 0.06196 0.06585 0.06981 1.98% FabArray::ParallelCopy_finish() 41 0.04443 0.05123 0.06105 1.73% Castro::reset_internal_energy(MultiFab) 63 0.04697 0.0482 0.0493 1.40% Castro::reset_internal_energy(Fab) 1008 0.04667 0.04791 0.04902 1.39% FabArray::ParallelCopy_nowait() 41 0.04044 0.04317 0.04415 1.25% Castro::normalize_species() 62 0.04081 0.04162 0.04237 1.20% StateDataPhysBCFunct::() 41 0.0308 0.03389 0.03847 1.09% StateData::FillBoundary(geom) 41 0.03068 0.03376 0.03835 1.09% Castro::construct_new_source() 50 0.03015 0.03172 0.03344 0.95% Gravity::interpolate_monopole_grav() 21 0.02773 0.02899 0.02993 0.85% Castro::construct_new_gravity_source() 10 0.02358 0.02514 0.02675 0.76% Amr::writePlotFile() 2 0.02443 0.0246 0.02474 0.70% Castro::post_init() 1 0.02359 0.02388 0.02412 0.68% Castro::finalize_do_advance() 10 0.01159 0.01672 0.02155 0.61% Castro::post_timestep() 10 0.01556 0.01581 0.01605 0.46% Castro::check_for_nan() 20 0.01048 0.0131 0.01572 0.45% MultiFab::contains_nan() 20 0.01046 0.01307 0.01569 0.45% VisMF::Write(FabArray) 2 0.01241 0.01291 0.01524 0.43% Castro::apply_source_to_state() 20 0.01197 0.01361 0.01464 0.42% FabArray::Saxpy() 20 0.01193 0.01356 0.01459 0.41% FabArray::setDomainBndry() 41 0.008155 0.01105 0.01371 0.39% Castro::Castro() 1 0.01088 0.01095 0.01107 0.31% Castro::construct_old_source() 50 0.009523 0.0101 0.01072 0.30% Castro::construct_old_gravity_source() 10 0.00946 0.01002 0.01063 0.30% Castro::computeNewDt() 9 0.009083 0.009094 0.009101 0.26% Castro::enforce_min_density() 62 0.007275 0.007531 0.007754 0.22% Castro::initMFs() 1 0.006185 0.006218 0.0063 0.18% AmrLevel::AmrLevel(dm) 1 0.005216 0.00526 0.005303 0.15% StateData::define() 4 0.005202 0.005243 0.005286 0.15% Castro::swap_state_time_levels() 10 0.003336 0.004445 0.004644 0.13% Castro::finalize_advance() 10 0.003091 0.003356 0.00364 0.10% Castro::post_regrid() 1 0.001493 0.001593 0.001665 0.05% Castro::buildMetrics() 1 0.001591 0.001602 0.001616 0.05% Amr::InitAmr() 1 0.0002758 0.0003004 0.0004061 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.107e-05 0.0001267 0.0001516 0.00% DistributionMapping::LeastUsedCPUs() 1 6.559e-06 0.0001207 0.0001439 0.00% Castro::enforce_consistent_e() 1 8.116e-05 9.628e-05 0.0001239 0.00% FabArrayBase::getCPC() 41 6.381e-05 7.926e-05 9.805e-05 0.00% Amr::writeSmallPlotFile() 1 3.144e-05 4.701e-05 6.01e-05 0.00% Castro::enforce_speed_limit() 62 2.501e-05 2.796e-05 3.219e-05 0.00% FabArrayBase::CPC::define() 2 2.339e-05 2.734e-05 3.071e-05 0.00% Gravity::swapTimeLevels() 10 9.125e-06 1.167e-05 2.033e-05 0.00% Amr::initSubcycle() 1 9.764e-06 1.141e-05 1.95e-05 0.00% Castro::FluxRegCrseInit 10 6.181e-06 1.013e-05 1.459e-05 0.00% Gravity::set_mass_offset() 10 9.669e-06 1.24e-05 1.438e-05 0.00% Castro::create_source_corrector() 10 7.065e-06 8.354e-06 1.062e-05 0.00% Castro::FluxRegFineAdd() 10 2.058e-06 3.361e-06 8.557e-06 0.00% Castro::retry_advance_ctu() 10 6.512e-06 7.059e-06 7.732e-06 0.00% DistributionMapping::Distribute() 1 7.95e-07 1.115e-06 1.968e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 28 B 32 B 36 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.11-5-gd36463103dae) finalized