Initializing AMReX (23.11-5-gd36463103dae)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.11-5-gd36463103dae) initialized Starting run at 06:22:11 UTC on 2023-11-13. Successfully read inputs file ... Castro git describe: 23.11-5-gedad6c8f7 AMReX git describe: 23.11-5-gd36463103 Microphysics git describe: 23.11-5-g3fe63e82 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.015003176 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.356985898 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.338445048 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.33349693 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.330701345 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.350422268 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.338823287 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.311598599 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.310169166 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.310297108 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.312104222 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.009995436 seconds Ending run at 06:22:15 UTC on 2023-11-13. Run time = 3.551038841 Run time without initialization = 3.308349298 Average number of zones advanced per microsecond: 0.792 Average number of zones advanced per microsecond per rank: 0.099 TinyProfiler total time across processes [min...avg...max]: 3.55 ... 3.551 ... 3.551 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2897 2.3565 2.4004 67.60% Gravity::make_radial_gravity() 21 0.2907 0.3032 0.3179 8.95% Castro::initData() 1 0.06355 0.1068 0.1662 4.68% Castro::estTimeStep() 21 0.02641 0.09801 0.1465 4.13% check_for_negative_density() 10 0.02535 0.07279 0.1454 4.09% FabArray::ParallelCopy_finish() 41 0.03768 0.05636 0.09239 2.60% amrex::Copy() 193 0.05938 0.07439 0.08095 2.28% FabArray::setVal() 143 0.04727 0.06461 0.07275 2.05% Castro::reset_internal_energy(Fab) 1008 0.04607 0.04821 0.05035 1.42% Castro::normalize_species() 62 0.04133 0.04274 0.04447 1.25% FabArray::ParallelCopy_nowait() 41 0.0335 0.03985 0.04159 1.17% FillPatchIterator::Initialize 41 0.02785 0.0333 0.0376 1.06% StateData::FillBoundary(geom) 41 0.03032 0.03284 0.03612 1.02% Gravity::interpolate_monopole_grav() 21 0.02871 0.03001 0.03187 0.90% Castro::construct_new_gravity_source() 10 0.02159 0.02413 0.02648 0.75% Castro::initialize_do_advance() 10 0.01342 0.01792 0.02177 0.61% Castro::computeTemp() 63 0.01873 0.02014 0.02081 0.59% VisMF::Write(FabArray) 2 0.01259 0.01329 0.01598 0.45% Castro::initialize_advance() 10 0.004114 0.01016 0.01418 0.40% FabArray::Saxpy() 20 0.009852 0.01189 0.01318 0.37% FabArray::setDomainBndry() 41 0.006756 0.01027 0.01305 0.37% MultiFab::contains_nan() 20 0.01028 0.01137 0.01266 0.36% Amr::writePlotFile() 2 0.006835 0.009784 0.01076 0.30% Castro::construct_old_gravity_source() 10 0.005209 0.009133 0.01024 0.29% Castro::initMFs() 1 0.007315 0.008521 0.0102 0.29% StateData::define() 4 0.00614 0.007506 0.009665 0.27% Castro::enforce_min_density() 62 0.007171 0.00745 0.007777 0.22% Castro::construct_new_source() 50 0.005604 0.006012 0.006199 0.17% Castro::swap_state_time_levels() 10 0.003498 0.004309 0.004931 0.14% main() 1 0.004048 0.004402 0.004695 0.13% Gravity::get_new_grav_vector() 11 0.002965 0.003662 0.004514 0.13% Amr::coarseTimeStep() 10 0.0009939 0.00226 0.003389 0.10% Castro::buildMetrics() 1 0.001919 0.002239 0.002615 0.07% Gravity::get_old_grav_vector() 10 0.001572 0.001941 0.002509 0.07% Castro::finalize_do_advance() 10 0.0004399 0.001063 0.001402 0.04% AmrLevel::FillPatch() 41 0.0007586 0.0008848 0.001135 0.03% Amr::InitAmr() 1 0.0002813 0.0003625 0.0004818 0.01% Amr::timeStep() 10 0.0001811 0.0002301 0.0004445 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002676 0.0002851 0.0003049 0.01% DistributionMapping::LeastUsedCPUs() 1 7.465e-06 0.0001487 0.0002261 0.01% Castro::do_advance_ctu() 10 0.0001211 0.0001459 0.0001719 0.00% Castro::clean_state() 62 0.0001411 0.0001516 0.0001642 0.00% FillPatchIterator::FillFromLevel0() 41 0.0001132 0.0001232 0.000142 0.00% Castro::Castro() 1 5.757e-05 7.402e-05 0.0001296 0.00% Castro::enforce_consistent_e() 1 8.244e-05 0.0001009 0.0001294 0.00% StateDataPhysBCFunct::() 41 9.206e-05 0.0001091 0.0001221 0.00% FabArray::ParallelCopy() 41 7.176e-05 8.08e-05 9.902e-05 0.00% Castro::do_old_sources() 10 8.08e-05 8.636e-05 9.64e-05 0.00% Castro::finalize_advance() 10 7.412e-05 8.54e-05 9.47e-05 0.00% Castro::construct_old_source() 50 5.187e-05 6.898e-05 9.095e-05 0.00% FillPatchSingleLevel 41 6.861e-05 7.01e-05 7.264e-05 0.00% Amr::FinalizeInit() 1 3.998e-06 1.365e-05 7.057e-05 0.00% Amr::writeSmallPlotFile() 1 2.987e-05 4.339e-05 6.794e-05 0.00% Castro::do_new_sources() 10 5.317e-05 6.104e-05 6.701e-05 0.00% Castro::advance() 10 3.786e-05 4.561e-05 6.653e-05 0.00% Castro::apply_source_to_state() 20 4.055e-05 4.903e-05 5.683e-05 0.00% FabArrayBase::getCPC() 41 4.59e-05 5.006e-05 5.587e-05 0.00% Castro::construct_old_gravity() 10 3.375e-05 4.059e-05 5.077e-05 0.00% Castro::subcycle_advance_ctu() 10 4.066e-05 4.613e-05 4.941e-05 0.00% Castro::construct_new_gravity() 10 3.536e-05 3.719e-05 4.17e-05 0.00% Amr::defBaseLevel() 1 2.706e-05 3.193e-05 3.708e-05 0.00% FabArrayBase::CPC::define() 2 2.351e-05 2.699e-05 3.395e-05 0.00% Castro::expand_state() 10 2.203e-05 2.558e-05 2.983e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.475e-05 1.963e-05 2.911e-05 0.00% Castro::enforce_speed_limit() 62 2.555e-05 2.757e-05 2.89e-05 0.00% Castro::check_for_nan() 20 2.388e-05 2.562e-05 2.749e-05 0.00% Castro::post_init() 1 1.403e-05 1.759e-05 2.65e-05 0.00% Castro::post_timestep() 10 1.288e-05 1.62e-05 2.415e-05 0.00% Amr::initSubcycle() 1 9.718e-06 1.258e-05 1.666e-05 0.00% Gravity::set_mass_offset() 10 9.411e-06 1.192e-05 1.431e-05 0.00% Gravity::swapTimeLevels() 10 8.199e-06 1.005e-05 1.262e-05 0.00% Castro::computeNewDt() 9 7.754e-06 8.886e-06 1.157e-05 0.00% Castro::create_source_corrector() 10 7.073e-06 9.256e-06 1.113e-05 0.00% Castro::FluxRegCrseInit 10 6.172e-06 7.21e-06 9.466e-06 0.00% Castro::retry_advance_ctu() 10 6.549e-06 7.388e-06 8.352e-06 0.00% Castro::post_regrid() 1 2.679e-06 3.836e-06 7.14e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.35e-06 5.385e-06 6.728e-06 0.00% Castro::computeInitialDt() 2 3.667e-06 4.555e-06 5.628e-06 0.00% Amr::InitializeInit() 1 1.803e-06 2.476e-06 5.107e-06 0.00% Castro::FluxRegFineAdd() 10 2.002e-06 2.364e-06 2.962e-06 0.00% Amr::init() 1 1.767e-06 2.103e-06 2.806e-06 0.00% Amr::initialInit() 1 1.576e-06 1.865e-06 2.445e-06 0.00% DistributionMapping::Distribute() 1 8.68e-07 1.129e-06 1.354e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.55 3.551 3.551 100.00% Amr::coarseTimeStep() 10 3.294 3.294 3.294 92.75% Amr::timeStep() 10 3.28 3.281 3.282 92.43% Castro::advance() 10 3.264 3.265 3.265 91.95% Castro::subcycle_advance_ctu() 10 3.185 3.195 3.206 90.29% Castro::do_advance_ctu() 10 3.185 3.194 3.206 90.29% Castro::construct_ctu_hydro_source() 10 2.447 2.45 2.456 69.16% Gravity::make_radial_gravity() 21 0.3068 0.3191 0.3305 9.31% Amr::init() 1 0.242 0.2422 0.2423 6.82% Amr::initialInit() 1 0.2262 0.2267 0.2271 6.39% Gravity::get_new_grav_vector() 11 0.2153 0.2166 0.2188 6.16% AmrLevel::FillPatch() 41 0.1839 0.203 0.215 6.05% Castro::construct_old_gravity() 10 0.1789 0.1876 0.1969 5.54% Gravity::get_old_grav_vector() 10 0.1778 0.1868 0.1963 5.53% Amr::InitializeInit() 1 0.08733 0.1317 0.1961 5.52% Amr::defBaseLevel() 1 0.08733 0.1317 0.1961 5.52% FillPatchIterator::Initialize 41 0.1551 0.1731 0.1925 5.42% Castro::construct_new_gravity() 10 0.1899 0.1909 0.1921 5.41% Castro::initialize_do_advance() 10 0.1639 0.1732 0.1831 5.16% Castro::initData() 1 0.0678 0.1112 0.1714 4.83% FillPatchIterator::FillFromLevel0() 41 0.1129 0.1295 0.1566 4.41% FillPatchSingleLevel 41 0.1128 0.1294 0.1565 4.41% Castro::estTimeStep() 21 0.02641 0.09801 0.1465 4.13% check_for_negative_density() 10 0.02535 0.07279 0.1454 4.09% Amr::FinalizeInit() 1 0.03042 0.09499 0.1396 3.93% Castro::expand_state() 10 0.1068 0.1171 0.1289 3.63% FabArray::ParallelCopy() 41 0.07909 0.09636 0.126 3.55% Castro::clean_state() 62 0.1129 0.1179 0.1222 3.44% Castro::computeInitialDt() 2 0.00294 0.06752 0.1118 3.15% Castro::do_old_sources() 10 0.08437 0.09011 0.09371 2.64% FabArray::ParallelCopy_finish() 41 0.03768 0.05636 0.09239 2.60% amrex::Copy() 193 0.05938 0.07439 0.08095 2.28% Castro::initialize_advance() 10 0.05442 0.06675 0.07623 2.15% FabArray::setVal() 143 0.04727 0.06461 0.07275 2.05% Castro::computeTemp() 63 0.06507 0.06863 0.07147 2.01% Castro::do_new_sources() 10 0.05374 0.06493 0.07106 2.00% Castro::reset_internal_energy(MultiFab) 63 0.04634 0.0485 0.05065 1.43% Castro::reset_internal_energy(Fab) 1008 0.04607 0.04821 0.05035 1.42% Castro::normalize_species() 62 0.04133 0.04274 0.04447 1.25% FabArray::ParallelCopy_nowait() 41 0.03357 0.03993 0.04166 1.17% StateDataPhysBCFunct::() 41 0.03042 0.03295 0.03625 1.02% StateData::FillBoundary(geom) 41 0.03032 0.03284 0.03612 1.02% Castro::finalize_do_advance() 10 0.01519 0.02225 0.03382 0.95% Castro::construct_new_source() 50 0.0272 0.03014 0.03254 0.92% Gravity::interpolate_monopole_grav() 21 0.02871 0.03001 0.03187 0.90% Castro::post_init() 1 0.02556 0.02673 0.02723 0.77% Castro::construct_new_gravity_source() 10 0.02159 0.02413 0.02648 0.75% Amr::writePlotFile() 2 0.02519 0.02555 0.0259 0.73% Castro::post_timestep() 10 0.01555 0.01587 0.01676 0.47% VisMF::Write(FabArray) 2 0.01259 0.01329 0.01598 0.45% Castro::Castro() 1 0.01099 0.0128 0.01501 0.42% Castro::apply_source_to_state() 20 0.009897 0.01194 0.01324 0.37% FabArray::Saxpy() 20 0.009852 0.01189 0.01318 0.37% FabArray::setDomainBndry() 41 0.006756 0.01027 0.01305 0.37% Castro::check_for_nan() 20 0.01031 0.0114 0.01269 0.36% MultiFab::contains_nan() 20 0.01028 0.01137 0.01266 0.36% Castro::construct_old_source() 50 0.005261 0.009202 0.01031 0.29% Castro::construct_old_gravity_source() 10 0.005209 0.009133 0.01024 0.29% Castro::initMFs() 1 0.007315 0.008521 0.0102 0.29% AmrLevel::AmrLevel(dm) 1 0.006156 0.007526 0.009694 0.27% StateData::define() 4 0.00614 0.007506 0.009665 0.27% Castro::computeNewDt() 9 0.009312 0.009321 0.00933 0.26% Castro::enforce_min_density() 62 0.007171 0.00745 0.007777 0.22% Castro::swap_state_time_levels() 10 0.003498 0.004309 0.004931 0.14% Castro::finalize_advance() 10 0.002997 0.003444 0.003892 0.11% Castro::buildMetrics() 1 0.002041 0.002407 0.00284 0.08% Castro::post_regrid() 1 0.001539 0.002005 0.002825 0.08% Amr::InitAmr() 1 0.0002925 0.0003751 0.0004984 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.312e-05 0.0001552 0.0002337 0.01% DistributionMapping::LeastUsedCPUs() 1 7.465e-06 0.0001487 0.0002261 0.01% Castro::enforce_consistent_e() 1 8.244e-05 0.0001009 0.0001294 0.00% FabArrayBase::getCPC() 41 7.011e-05 7.705e-05 8.788e-05 0.00% Amr::writeSmallPlotFile() 1 2.987e-05 4.339e-05 6.794e-05 0.00% FabArrayBase::CPC::define() 2 2.351e-05 2.699e-05 3.395e-05 0.00% Castro::enforce_speed_limit() 62 2.555e-05 2.757e-05 2.89e-05 0.00% Amr::initSubcycle() 1 9.718e-06 1.258e-05 1.666e-05 0.00% Gravity::set_mass_offset() 10 9.411e-06 1.192e-05 1.431e-05 0.00% Gravity::swapTimeLevels() 10 8.199e-06 1.005e-05 1.262e-05 0.00% Castro::create_source_corrector() 10 7.073e-06 9.256e-06 1.113e-05 0.00% Castro::FluxRegCrseInit 10 6.172e-06 7.21e-06 9.466e-06 0.00% Castro::retry_advance_ctu() 10 6.549e-06 7.388e-06 8.352e-06 0.00% Castro::FluxRegFineAdd() 10 2.002e-06 2.364e-06 2.962e-06 0.00% DistributionMapping::Distribute() 1 8.68e-07 1.129e-06 1.354e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 27 B 34 B 38 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.11-5-gd36463103dae) finalized