Initializing AMReX (23.12-17-g554b1ca3b00c)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.12-17-g554b1ca3b00c) initialized Starting run at 06:37:41 UTC on 2023-12-15. Successfully read inputs file ... Castro git describe: 23.12-6-g9cf0cb6b3 AMReX git describe: 23.12-17-g554b1ca3b Microphysics git describe: 23.12-1-gbdf6a18e reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.013263308 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.364123985 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.362529592 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.327979281 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.326783151 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.352626068 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.360159429 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.307062572 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.306491971 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.306096616 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.307286859 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.007561044 seconds Ending run at 06:37:44 UTC on 2023-12-15. Run time = 3.553803814 Run time without initialization = 3.334456978 Average number of zones advanced per microsecond: 0.786 Average number of zones advanced per microsecond per rank: 0.098 TinyProfiler total time across processes [min...avg...max]: 3.553 ... 3.554 ... 3.554 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2611 2.3523 2.4012 67.57% Gravity::make_radial_gravity() 21 0.2822 0.2884 0.2981 8.39% check_for_negative_density() 10 0.02899 0.08335 0.1766 4.97% Castro::estTimeStep() 21 0.02918 0.1018 0.1564 4.40% Castro::initData() 1 0.04748 0.09068 0.1509 4.25% amrex::Copy() 193 0.07611 0.0821 0.09283 2.61% FabArray::setVal() 143 0.06401 0.07686 0.08956 2.52% FabArray::ParallelCopy_finish() 41 0.03516 0.06034 0.07199 2.03% Castro::reset_internal_energy(Fab) 1008 0.04467 0.04686 0.0479 1.35% FabArray::ParallelCopy_nowait() 41 0.03963 0.04228 0.04317 1.21% Castro::normalize_species() 62 0.04121 0.04201 0.04279 1.20% FillPatchIterator::Initialize 41 0.02795 0.03432 0.03807 1.07% StateData::FillBoundary(geom) 41 0.02922 0.0326 0.0357 1.00% Gravity::interpolate_monopole_grav() 21 0.02704 0.029 0.03152 0.89% Castro::construct_new_gravity_source() 10 0.02311 0.02647 0.03048 0.86% Castro::initialize_do_advance() 10 0.0119 0.01817 0.02172 0.61% Castro::computeTemp() 63 0.01821 0.01934 0.02005 0.56% FabArray::Saxpy() 20 0.01295 0.01394 0.01553 0.44% Castro::initialize_advance() 10 0.009587 0.01231 0.0154 0.43% FabArray::setDomainBndry() 41 0.006832 0.01006 0.01204 0.34% VisMF::Write(FabArray) 2 0.008916 0.009389 0.0118 0.33% MultiFab::contains_nan() 20 0.009921 0.01077 0.0118 0.33% Castro::construct_old_gravity_source() 10 0.008359 0.01016 0.01114 0.31% Castro::initMFs() 1 0.00629 0.007372 0.01039 0.29% Amr::writePlotFile() 2 0.006262 0.008938 0.009492 0.27% StateData::define() 4 0.0052 0.005925 0.007922 0.22% Castro::enforce_min_density() 62 0.007109 0.007356 0.007549 0.21% Castro::construct_new_source() 50 0.006125 0.006332 0.006506 0.18% main() 1 0.004025 0.004477 0.004903 0.14% Castro::swap_state_time_levels() 10 0.003302 0.004356 0.004517 0.13% Gravity::get_new_grav_vector() 11 0.00301 0.003643 0.003986 0.11% Amr::coarseTimeStep() 10 0.001789 0.002299 0.003085 0.09% Gravity::get_old_grav_vector() 10 0.001607 0.002076 0.002428 0.07% Castro::buildMetrics() 1 0.001461 0.001693 0.00227 0.06% Castro::finalize_do_advance() 10 0.001059 0.001356 0.00154 0.04% AmrLevel::FillPatch() 41 0.00086 0.001097 0.001413 0.04% Amr::InitAmr() 1 0.0002617 0.0003431 0.0006513 0.02% Amr::timeStep() 10 0.0001398 0.0002116 0.0004545 0.01% DistributionMapping::LeastUsedCPUs() 1 8.557e-06 0.0003513 0.0004411 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002788 0.0002914 0.0003367 0.01% Castro::do_advance_ctu() 10 0.0001247 0.0001655 0.0002081 0.01% StateDataPhysBCFunct::() 41 9.092e-05 0.0001251 0.0001821 0.01% FillPatchIterator::FillFromLevel0() 41 9.376e-05 0.0001275 0.0001758 0.00% Castro::clean_state() 62 0.0001331 0.0001559 0.0001743 0.00% Castro::enforce_consistent_e() 1 7.607e-05 9.392e-05 0.0001165 0.00% Castro::do_old_sources() 10 7.203e-05 9.054e-05 0.0001095 0.00% Castro::finalize_advance() 10 7.978e-05 8.814e-05 0.0001086 0.00% FabArray::ParallelCopy() 41 6.693e-05 8.791e-05 0.0001051 0.00% Castro::construct_old_source() 50 6.601e-05 7.817e-05 9.32e-05 0.00% FillPatchSingleLevel 41 5.647e-05 7.238e-05 9.182e-05 0.00% Amr::FinalizeInit() 1 4.225e-06 1.55e-05 8.627e-05 0.00% Castro::Castro() 1 5.786e-05 7.067e-05 8.491e-05 0.00% Amr::writeSmallPlotFile() 1 3.234e-05 5.151e-05 8.117e-05 0.00% FabArrayBase::getCPC() 41 4.115e-05 5.474e-05 7.691e-05 0.00% Castro::do_new_sources() 10 5.347e-05 6.628e-05 7.371e-05 0.00% Castro::apply_source_to_state() 20 3.796e-05 5.192e-05 6.53e-05 0.00% Castro::subcycle_advance_ctu() 10 4.506e-05 5.217e-05 6.346e-05 0.00% Castro::advance() 10 3.838e-05 4.508e-05 5.159e-05 0.00% Castro::construct_old_gravity() 10 3.134e-05 3.601e-05 4.716e-05 0.00% Castro::enforce_speed_limit() 62 2.685e-05 3.061e-05 4.638e-05 0.00% Castro::construct_new_gravity() 10 2.872e-05 3.641e-05 4.272e-05 0.00% Amr::defBaseLevel() 1 2.848e-05 3.407e-05 4.163e-05 0.00% Castro::expand_state() 10 1.895e-05 2.531e-05 3.182e-05 0.00% FabArrayBase::CPC::define() 2 2.273e-05 2.645e-05 3.095e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.37e-05 1.951e-05 3.079e-05 0.00% Castro::check_for_nan() 20 2.193e-05 2.412e-05 2.545e-05 0.00% Castro::post_init() 1 1.606e-05 1.76e-05 1.939e-05 0.00% Amr::initSubcycle() 1 9.733e-06 1.212e-05 1.878e-05 0.00% Castro::post_timestep() 10 1.316e-05 1.423e-05 1.511e-05 0.00% Gravity::set_mass_offset() 10 8.436e-06 1.138e-05 1.429e-05 0.00% Gravity::swapTimeLevels() 10 7.362e-06 1.026e-05 1.321e-05 0.00% Castro::FluxRegCrseInit 10 6.771e-06 8.066e-06 1.063e-05 0.00% Castro::computeNewDt() 9 6.707e-06 8.247e-06 1.04e-05 0.00% Castro::create_source_corrector() 10 7.306e-06 8.572e-06 9.298e-06 0.00% Amr::initialInit() 1 1.331e-06 2.433e-06 8.5e-06 0.00% Amr::InitializeInit() 1 1.67e-06 3.792e-06 8.039e-06 0.00% Castro::retry_advance_ctu() 10 6.513e-06 7.239e-06 7.649e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.795e-06 5.106e-06 7.293e-06 0.00% Castro::computeInitialDt() 2 2.743e-06 4.043e-06 5.151e-06 0.00% Castro::post_regrid() 1 2.188e-06 2.922e-06 3.726e-06 0.00% Castro::FluxRegFineAdd() 10 2.026e-06 2.202e-06 2.647e-06 0.00% Amr::init() 1 1.808e-06 2.228e-06 2.624e-06 0.00% DistributionMapping::Distribute() 1 9.44e-07 1.289e-06 1.536e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.553 3.553 3.554 100.00% Amr::coarseTimeStep() 10 3.322 3.322 3.322 93.48% Amr::timeStep() 10 3.309 3.31 3.31 93.14% Castro::advance() 10 3.293 3.294 3.295 92.70% Castro::subcycle_advance_ctu() 10 3.203 3.212 3.221 90.62% Castro::do_advance_ctu() 10 3.203 3.212 3.22 90.62% Castro::construct_ctu_hydro_source() 10 2.451 2.456 2.46 69.22% Gravity::make_radial_gravity() 21 0.3006 0.3063 0.3154 8.87% AmrLevel::FillPatch() 41 0.19 0.213 0.2316 6.52% Amr::init() 1 0.2185 0.2189 0.219 6.16% Gravity::get_new_grav_vector() 11 0.2109 0.2135 0.2186 6.15% Amr::initialInit() 1 0.2047 0.2052 0.2054 5.78% FillPatchIterator::Initialize 41 0.1604 0.1801 0.1971 5.55% Castro::construct_new_gravity() 10 0.1882 0.1901 0.1954 5.50% Castro::construct_old_gravity() 10 0.1775 0.1828 0.1895 5.33% Gravity::get_old_grav_vector() 10 0.1769 0.182 0.1883 5.30% Castro::initialize_do_advance() 10 0.1605 0.1745 0.1869 5.26% Amr::InitializeInit() 1 0.06741 0.1124 0.1778 5.00% Amr::defBaseLevel() 1 0.06741 0.1124 0.1778 5.00% check_for_negative_density() 10 0.02899 0.08335 0.1766 4.97% Castro::estTimeStep() 21 0.02918 0.1018 0.1564 4.40% Castro::initData() 1 0.05131 0.09467 0.1551 4.37% FillPatchIterator::FillFromLevel0() 41 0.1127 0.1357 0.1504 4.23% FillPatchSingleLevel 41 0.1126 0.1356 0.1503 4.23% Amr::FinalizeInit() 1 0.02694 0.09278 0.1378 3.88% Castro::expand_state() 10 0.1044 0.1197 0.133 3.74% Castro::clean_state() 62 0.1117 0.1151 0.1168 3.29% FabArray::ParallelCopy() 41 0.07811 0.1028 0.1151 3.24% Castro::computeInitialDt() 2 0.00235 0.06792 0.113 3.18% Castro::do_old_sources() 10 0.09199 0.09562 0.09901 2.79% amrex::Copy() 193 0.07611 0.0821 0.09283 2.61% FabArray::setVal() 143 0.06401 0.07686 0.08956 2.52% Castro::initialize_advance() 10 0.06948 0.07832 0.08658 2.44% Castro::do_new_sources() 10 0.06015 0.06965 0.0793 2.23% FabArray::ParallelCopy_finish() 41 0.03516 0.06034 0.07199 2.03% Castro::computeTemp() 63 0.06316 0.06649 0.06822 1.92% Castro::reset_internal_energy(MultiFab) 63 0.04495 0.04715 0.04818 1.36% Castro::reset_internal_energy(Fab) 1008 0.04467 0.04686 0.0479 1.35% FabArray::ParallelCopy_nowait() 41 0.03973 0.04237 0.04326 1.22% Castro::normalize_species() 62 0.04121 0.04201 0.04279 1.20% Castro::finalize_do_advance() 10 0.01225 0.02618 0.03726 1.05% Castro::construct_new_source() 50 0.02933 0.0328 0.03696 1.04% StateDataPhysBCFunct::() 41 0.02932 0.03273 0.03579 1.01% StateData::FillBoundary(geom) 41 0.02922 0.0326 0.0357 1.00% Gravity::interpolate_monopole_grav() 21 0.02704 0.029 0.03152 0.89% Castro::construct_new_gravity_source() 10 0.02311 0.02647 0.03048 0.86% Castro::post_init() 1 0.02388 0.02433 0.02447 0.69% Amr::writePlotFile() 2 0.02108 0.02133 0.0216 0.61% Castro::post_timestep() 10 0.01525 0.01574 0.01619 0.46% Castro::apply_source_to_state() 20 0.013 0.014 0.0156 0.44% FabArray::Saxpy() 20 0.01295 0.01394 0.01553 0.44% Castro::Castro() 1 0.01022 0.01141 0.0145 0.41% FabArray::setDomainBndry() 41 0.006832 0.01006 0.01204 0.34% Castro::check_for_nan() 20 0.009946 0.0108 0.01182 0.33% VisMF::Write(FabArray) 2 0.008916 0.009389 0.0118 0.33% MultiFab::contains_nan() 20 0.009921 0.01077 0.0118 0.33% Castro::construct_old_source() 50 0.008431 0.01024 0.01123 0.32% Castro::construct_old_gravity_source() 10 0.008359 0.01016 0.01114 0.31% Castro::initMFs() 1 0.00629 0.007372 0.01039 0.29% Castro::computeNewDt() 9 0.009007 0.00902 0.009032 0.25% AmrLevel::AmrLevel(dm) 1 0.005216 0.005945 0.007947 0.22% StateData::define() 4 0.0052 0.005925 0.007922 0.22% Castro::enforce_min_density() 62 0.007109 0.007356 0.007549 0.21% Castro::swap_state_time_levels() 10 0.003302 0.004356 0.004517 0.13% Castro::finalize_advance() 10 0.002913 0.003715 0.004423 0.12% Castro::buildMetrics() 1 0.001583 0.001836 0.002484 0.07% Castro::post_regrid() 1 0.001563 0.001645 0.001837 0.05% Amr::InitAmr() 1 0.0002721 0.0003552 0.0006701 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.414e-05 0.0003577 0.0004483 0.01% DistributionMapping::LeastUsedCPUs() 1 8.557e-06 0.0003513 0.0004411 0.01% Castro::enforce_consistent_e() 1 7.607e-05 9.392e-05 0.0001165 0.00% FabArrayBase::getCPC() 41 6.388e-05 8.119e-05 0.0001032 0.00% Amr::writeSmallPlotFile() 1 3.234e-05 5.151e-05 8.117e-05 0.00% Castro::enforce_speed_limit() 62 2.685e-05 3.061e-05 4.638e-05 0.00% FabArrayBase::CPC::define() 2 2.273e-05 2.645e-05 3.095e-05 0.00% Amr::initSubcycle() 1 9.733e-06 1.212e-05 1.878e-05 0.00% Gravity::set_mass_offset() 10 8.436e-06 1.138e-05 1.429e-05 0.00% Gravity::swapTimeLevels() 10 7.362e-06 1.026e-05 1.321e-05 0.00% Castro::FluxRegCrseInit 10 6.771e-06 8.066e-06 1.063e-05 0.00% Castro::create_source_corrector() 10 7.306e-06 8.572e-06 9.298e-06 0.00% Castro::retry_advance_ctu() 10 6.513e-06 7.239e-06 7.649e-06 0.00% Castro::FluxRegFineAdd() 10 2.026e-06 2.202e-06 2.647e-06 0.00% DistributionMapping::Distribute() 1 9.44e-07 1.289e-06 1.536e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 27 B 33 B 49 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.12-17-g554b1ca3b00c) finalized