Initializing AMReX (24.02-12-g68244ec91d11)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (24.02-12-g68244ec91d11) initialized Starting run at 06:42:09 UTC on 2024-02-12. Successfully read inputs file ... Castro git describe: 24.02-16-g08d58b44f AMReX git describe: 24.02-12-g68244ec91 Microphysics git describe: 24.02-11-g348ca2f5 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.013099591 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.360531599 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.354494568 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.33328377 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.332556591 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.351569846 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.35453174 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.311102692 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.310597088 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.311140429 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.311491095 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.007414251 seconds Ending run at 06:42:12 UTC on 2024-02-12. Run time = 3.546332852 Run time without initialization = 3.344339915 Average number of zones advanced per microsecond: 0.784 Average number of zones advanced per microsecond per rank: 0.098 TinyProfiler total time across processes [min...avg...max]: 3.545 ... 3.546 ... 3.546 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.3198 2.3651 2.4081 67.90% Gravity::make_radial_gravity() 21 0.287 0.2931 0.3092 8.72% Castro::initData() 1 0.04964 0.09408 0.1346 3.80% Castro::estTimeStep() 21 0.02474 0.08261 0.1308 3.69% check_for_negative_density() 10 0.02755 0.07292 0.1195 3.37% amrex::Copy() 193 0.06786 0.07976 0.08985 2.53% FabArray::ParallelCopy_finish() 41 0.03579 0.06184 0.08693 2.45% FabArray::setVal() 143 0.06401 0.07399 0.08612 2.43% Castro::reset_internal_energy(Fab) 1008 0.04715 0.04839 0.04999 1.41% Castro::normalize_species() 62 0.04146 0.04243 0.04411 1.24% FabArray::ParallelCopy_nowait() 41 0.03433 0.04139 0.04399 1.24% FillPatchIterator::Initialize 41 0.02734 0.03466 0.04045 1.14% StateData::FillBoundary(geom) 41 0.03051 0.03266 0.0356 1.00% Castro::construct_new_gravity_source() 10 0.02242 0.02627 0.03495 0.99% Gravity::interpolate_monopole_grav() 21 0.0287 0.02965 0.03081 0.87% Castro::initialize_do_advance() 10 0.01148 0.01837 0.02427 0.68% Castro::computeTemp() 63 0.01966 0.01999 0.02088 0.59% Castro::initialize_advance() 10 0.009928 0.01233 0.01504 0.42% FabArray::Saxpy() 20 0.0106 0.01289 0.0139 0.39% MultiFab::contains_nan() 20 0.01087 0.01172 0.01258 0.35% FabArray::setDomainBndry() 41 0.006527 0.009687 0.01225 0.35% VisMF::Write(FabArray) 2 0.008749 0.009236 0.0115 0.32% Castro::construct_old_gravity_source() 10 0.006671 0.009489 0.01038 0.29% Castro::initMFs() 1 0.006417 0.008366 0.009818 0.28% Amr::writePlotFile() 2 0.006166 0.008466 0.009133 0.26% StateData::define() 4 0.005245 0.006842 0.008067 0.23% Castro::construct_new_source() 50 0.005855 0.006676 0.008043 0.23% Amr::coarseTimeStep() 10 0.0009643 0.005609 0.007211 0.20% Castro::enforce_min_density() 62 0.005614 0.00607 0.006538 0.18% main() 1 0.003847 0.004395 0.004974 0.14% Castro::swap_state_time_levels() 10 0.003181 0.004162 0.004414 0.12% Gravity::get_new_grav_vector() 11 0.002826 0.003584 0.003979 0.11% Gravity::get_old_grav_vector() 10 0.001612 0.002043 0.002561 0.07% Castro::buildMetrics() 1 0.001512 0.001979 0.002437 0.07% Castro::finalize_do_advance() 10 0.0005087 0.001227 0.00158 0.04% AmrLevel::FillPatch() 41 0.0007242 0.0008663 0.0009854 0.03% Amr::InitAmr() 1 0.0003607 0.0005337 0.0006669 0.02% Amr::timeStep() 10 0.0001737 0.0002217 0.0003826 0.01% DistributionMapping::LeastUsedCPUs() 1 7.254e-06 0.000152 0.0003439 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002823 0.0002969 0.0003204 0.01% Castro::clean_state() 62 0.0001384 0.0001491 0.0001599 0.00% Castro::do_advance_ctu() 10 0.0001199 0.0001454 0.0001581 0.00% Castro::finalize_advance() 10 8.557e-05 0.000103 0.0001384 0.00% StateDataPhysBCFunct::() 41 9.204e-05 0.000104 0.0001228 0.00% FillPatchIterator::FillFromLevel0() 41 0.0001005 0.0001086 0.0001215 0.00% Castro::enforce_consistent_e() 1 8.108e-05 9.026e-05 0.0001035 0.00% Castro::do_old_sources() 10 7.388e-05 8.939e-05 0.0001011 0.00% FillPatchSingleLevel 41 6.222e-05 7.756e-05 9.338e-05 0.00% Castro::do_new_sources() 10 4.865e-05 6.901e-05 9.232e-05 0.00% Castro::Castro() 1 5.821e-05 7.092e-05 9.154e-05 0.00% Castro::construct_old_source() 50 5.61e-05 6.93e-05 8.619e-05 0.00% FabArray::ParallelCopy() 41 6.707e-05 7.711e-05 8.499e-05 0.00% FabArrayBase::getCPC() 41 4.316e-05 5.393e-05 7.741e-05 0.00% Amr::writeSmallPlotFile() 1 3.002e-05 5.786e-05 7.718e-05 0.00% Castro::advance() 10 3.778e-05 4.954e-05 7.577e-05 0.00% Amr::FinalizeInit() 1 3.579e-06 1.314e-05 7.372e-05 0.00% Castro::subcycle_advance_ctu() 10 4.223e-05 4.918e-05 6.46e-05 0.00% Castro::apply_source_to_state() 20 3.41e-05 4.619e-05 5.293e-05 0.00% Castro::retry_advance_ctu() 10 6.863e-06 2.279e-05 5.025e-05 0.00% Castro::construct_old_gravity() 10 3.352e-05 3.943e-05 4.479e-05 0.00% Castro::construct_new_gravity() 10 3.083e-05 3.556e-05 4.391e-05 0.00% Castro::enforce_speed_limit() 62 2.729e-05 3.022e-05 3.346e-05 0.00% Castro::post_init() 1 1.401e-05 1.84e-05 3.236e-05 0.00% Castro::expand_state() 10 2.194e-05 2.485e-05 2.849e-05 0.00% FabArrayBase::CPC::define() 2 2.194e-05 2.549e-05 2.816e-05 0.00% Castro::check_for_nan() 20 2.149e-05 2.451e-05 2.725e-05 0.00% Amr::initSubcycle() 1 9.835e-06 1.493e-05 2.635e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.432e-05 2.08e-05 2.597e-05 0.00% Gravity::set_mass_offset() 10 9.139e-06 1.663e-05 2.501e-05 0.00% Amr::defBaseLevel() 1 1.766e-05 2.101e-05 2.357e-05 0.00% Castro::post_timestep() 10 1.359e-05 1.548e-05 2.1e-05 0.00% Castro::FluxRegCrseInit 10 6.563e-06 1.065e-05 2.079e-05 0.00% Gravity::swapTimeLevels() 10 8.935e-06 1.032e-05 1.176e-05 0.00% Castro::create_source_corrector() 10 8.1e-06 8.859e-06 9.82e-06 0.00% Castro::computeNewDt() 9 7.142e-06 8.405e-06 9.669e-06 0.00% Amr::initialInit() 1 1.551e-06 2.731e-06 8.738e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.063e-06 4.94e-06 6.566e-06 0.00% Amr::InitializeInit() 1 2.063e-06 3.155e-06 6.309e-06 0.00% Castro::post_regrid() 1 1.769e-06 3.137e-06 5.696e-06 0.00% Castro::computeInitialDt() 2 3.208e-06 3.932e-06 5.257e-06 0.00% Amr::init() 1 1.925e-06 2.439e-06 3.081e-06 0.00% Castro::FluxRegFineAdd() 10 2.039e-06 2.344e-06 2.616e-06 0.00% DistributionMapping::Distribute() 1 9.84e-07 1.187e-06 1.375e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.545 3.546 3.546 100.00% Amr::coarseTimeStep() 10 3.332 3.332 3.332 93.96% Amr::timeStep() 10 3.314 3.316 3.321 93.64% Castro::advance() 10 3.299 3.3 3.301 93.09% Castro::subcycle_advance_ctu() 10 3.209 3.217 3.225 90.93% Castro::do_advance_ctu() 10 3.208 3.217 3.225 90.93% Castro::construct_ctu_hydro_source() 10 2.456 2.459 2.462 69.43% Gravity::make_radial_gravity() 21 0.3033 0.3097 0.3228 9.10% AmrLevel::FillPatch() 41 0.1929 0.2119 0.2271 6.40% Gravity::get_new_grav_vector() 11 0.2066 0.2077 0.209 5.89% Amr::init() 1 0.2012 0.2013 0.2015 5.68% Castro::construct_old_gravity() 10 0.1803 0.187 0.1985 5.60% Gravity::get_old_grav_vector() 10 0.1796 0.1862 0.1979 5.58% FillPatchIterator::Initialize 41 0.1603 0.1807 0.1941 5.47% Castro::initialize_do_advance() 10 0.1609 0.1783 0.1912 5.39% Amr::initialInit() 1 0.1877 0.188 0.1882 5.31% Castro::construct_new_gravity() 10 0.1838 0.1844 0.1853 5.23% Amr::InitializeInit() 1 0.06855 0.1171 0.1611 4.54% Amr::defBaseLevel() 1 0.06854 0.1171 0.161 4.54% FillPatchIterator::FillFromLevel0() 41 0.1102 0.1363 0.1532 4.32% FillPatchSingleLevel 41 0.1101 0.1362 0.1531 4.32% Castro::initData() 1 0.05325 0.09785 0.1385 3.90% Castro::expand_state() 10 0.1074 0.1223 0.1364 3.85% Castro::estTimeStep() 21 0.02474 0.08261 0.1308 3.69% FabArray::ParallelCopy() 41 0.07745 0.1034 0.1214 3.42% Castro::clean_state() 62 0.1147 0.1164 0.1197 3.38% Amr::FinalizeInit() 1 0.02683 0.07089 0.1195 3.37% check_for_negative_density() 10 0.02755 0.07292 0.1195 3.37% Castro::do_old_sources() 10 0.09465 0.09705 0.1002 2.82% Castro::computeInitialDt() 2 0.002174 0.04623 0.09487 2.68% amrex::Copy() 193 0.06786 0.07976 0.08985 2.53% Castro::initialize_advance() 10 0.07117 0.07844 0.08722 2.46% FabArray::ParallelCopy_finish() 41 0.03579 0.06184 0.08693 2.45% FabArray::setVal() 143 0.06401 0.07399 0.08612 2.43% Castro::do_new_sources() 10 0.05998 0.06659 0.08144 2.30% Castro::computeTemp() 63 0.06731 0.06868 0.07119 2.01% Castro::reset_internal_energy(MultiFab) 63 0.04744 0.04869 0.05031 1.42% Castro::reset_internal_energy(Fab) 1008 0.04715 0.04839 0.04999 1.41% Castro::normalize_species() 62 0.04146 0.04243 0.04411 1.24% FabArray::ParallelCopy_nowait() 41 0.03443 0.04147 0.04406 1.24% Castro::construct_new_source() 50 0.02878 0.03294 0.0428 1.21% Castro::finalize_do_advance() 10 0.01255 0.02845 0.03595 1.01% StateDataPhysBCFunct::() 41 0.03061 0.03276 0.0357 1.01% StateData::FillBoundary(geom) 41 0.03051 0.03266 0.0356 1.00% Castro::construct_new_gravity_source() 10 0.02242 0.02627 0.03495 0.99% Gravity::interpolate_monopole_grav() 21 0.0287 0.02965 0.03081 0.87% Castro::post_init() 1 0.02409 0.02421 0.0244 0.69% Amr::writePlotFile() 2 0.02058 0.02074 0.02091 0.59% Castro::post_timestep() 10 0.01558 0.01611 0.01906 0.54% Castro::Castro() 1 0.009311 0.01225 0.01447 0.41% Castro::apply_source_to_state() 20 0.01064 0.01293 0.01394 0.39% FabArray::Saxpy() 20 0.0106 0.01289 0.0139 0.39% Castro::check_for_nan() 20 0.0109 0.01175 0.01261 0.36% MultiFab::contains_nan() 20 0.01087 0.01172 0.01258 0.35% FabArray::setDomainBndry() 41 0.006527 0.009687 0.01225 0.35% VisMF::Write(FabArray) 2 0.008749 0.009236 0.0115 0.32% Castro::construct_old_source() 50 0.006729 0.009558 0.01045 0.29% Castro::construct_old_gravity_source() 10 0.006671 0.009489 0.01038 0.29% Castro::initMFs() 1 0.006417 0.008366 0.009818 0.28% Castro::computeNewDt() 9 0.009158 0.009166 0.009173 0.26% AmrLevel::AmrLevel(dm) 1 0.005262 0.006863 0.008091 0.23% StateData::define() 4 0.005245 0.006842 0.008067 0.23% Castro::enforce_min_density() 62 0.005614 0.00607 0.006538 0.18% Castro::finalize_advance() 10 0.003006 0.004091 0.00545 0.15% Castro::swap_state_time_levels() 10 0.003181 0.004162 0.004414 0.12% Castro::buildMetrics() 1 0.001628 0.002158 0.002673 0.08% Castro::post_regrid() 1 0.001506 0.001595 0.001638 0.05% Amr::InitAmr() 1 0.0003709 0.0005486 0.0006843 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.298e-05 0.0001581 0.0003514 0.01% DistributionMapping::LeastUsedCPUs() 1 7.254e-06 0.000152 0.0003439 0.01% FabArrayBase::getCPC() 41 6.603e-05 7.942e-05 0.0001037 0.00% Castro::enforce_consistent_e() 1 8.108e-05 9.026e-05 0.0001035 0.00% Amr::writeSmallPlotFile() 1 3.002e-05 5.786e-05 7.718e-05 0.00% Castro::retry_advance_ctu() 10 6.863e-06 2.279e-05 5.025e-05 0.00% Castro::enforce_speed_limit() 62 2.729e-05 3.022e-05 3.346e-05 0.00% FabArrayBase::CPC::define() 2 2.194e-05 2.549e-05 2.816e-05 0.00% Amr::initSubcycle() 1 9.835e-06 1.493e-05 2.635e-05 0.00% Gravity::set_mass_offset() 10 9.139e-06 1.663e-05 2.501e-05 0.00% Castro::FluxRegCrseInit 10 6.563e-06 1.065e-05 2.079e-05 0.00% Gravity::swapTimeLevels() 10 8.935e-06 1.032e-05 1.176e-05 0.00% Castro::create_source_corrector() 10 8.1e-06 8.859e-06 9.82e-06 0.00% Castro::FluxRegFineAdd() 10 2.039e-06 2.344e-06 2.616e-06 0.00% DistributionMapping::Distribute() 1 9.84e-07 1.187e-06 1.375e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 33 B 36 B 41 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.02-12-g68244ec91d11) finalized