MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.10-4-ge470d3350ed3) initialized Starting run at 05:22:28 UTC on 2023-10-03. Successfully read inputs file ... Castro git describe: 23.10-4-g104a57d85 AMReX git describe: 23.10-4-ge470d3350 Microphysics git describe: 23.10-1-g4803fc8b reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.015193316 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.35413873 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.349137881 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.335380639 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.333990829 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.334193993 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.372764316 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.319526433 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.312541877 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.313280418 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.313022421 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.009812757 seconds Ending run at 05:22:31 UTC on 2023-10-03. Run time = 3.531749886 Run time without initialization = 3.352302729 Average number of zones advanced per microsecond: 0.782 Average number of zones advanced per microsecond per rank: 0.098 TinyProfiler total time across processes [min...avg...max]: 3.532 ... 3.532 ... 3.532 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2669 2.3485 2.4036 68.05% Gravity::make_radial_gravity() 21 0.312 0.3333 0.358 10.14% check_for_negative_density() 10 0.02003 0.07884 0.1629 4.61% Castro::initData() 1 0.03908 0.07874 0.1149 3.25% Castro::estTimeStep() 21 0.02394 0.06463 0.1077 3.05% amrex::Copy() 193 0.06426 0.08174 0.09838 2.79% FabArray::ParallelCopy_finish() 41 0.03491 0.05313 0.08556 2.42% FabArray::setVal() 143 0.06666 0.07352 0.08301 2.35% Castro::reset_internal_energy(Fab) 1008 0.04721 0.04927 0.0553 1.57% FabArray::ParallelCopy_nowait() 41 0.03248 0.04085 0.04317 1.22% Castro::normalize_species() 62 0.04113 0.04177 0.04251 1.20% StateData::FillBoundary(geom) 41 0.03443 0.03731 0.04064 1.15% FillPatchIterator::Initialize 41 0.02735 0.03339 0.03585 1.02% Gravity::interpolate_monopole_grav() 21 0.02796 0.02828 0.02869 0.81% Castro::construct_new_gravity_source() 10 0.02149 0.02378 0.02573 0.73% Castro::computeTemp() 63 0.01855 0.01988 0.02307 0.65% Castro::initialize_do_advance() 10 0.0118 0.01726 0.01856 0.53% Castro::initialize_advance() 10 0.01052 0.01323 0.01623 0.46% VisMF::Write(FabArray) 2 0.01248 0.01302 0.01574 0.45% MultiFab::contains_nan() 20 0.009581 0.01117 0.01538 0.44% FabArray::Saxpy() 20 0.01037 0.01263 0.01418 0.40% FabArray::setDomainBndry() 41 0.008864 0.01184 0.01347 0.38% Amr::writePlotFile() 2 0.007057 0.009887 0.01051 0.30% Castro::construct_old_gravity_source() 10 0.006529 0.009468 0.0103 0.29% Castro::initMFs() 1 0.006328 0.006619 0.008428 0.24% Castro::construct_new_source() 50 0.005608 0.006322 0.006712 0.19% Castro::enforce_min_density() 62 0.00574 0.006121 0.006462 0.18% StateData::define() 4 0.005233 0.005346 0.005854 0.17% Castro::swap_state_time_levels() 10 0.002387 0.004137 0.004444 0.13% Gravity::get_old_grav_vector() 10 0.001406 0.00263 0.00436 0.12% Gravity::get_new_grav_vector() 11 0.002653 0.003626 0.004082 0.12% main() 1 0.003645 0.003809 0.003928 0.11% Amr::coarseTimeStep() 10 0.0009794 0.001499 0.002078 0.06% Castro::buildMetrics() 1 0.001481 0.001514 0.001683 0.05% Castro::finalize_do_advance() 10 0.0004151 0.001011 0.001322 0.04% AmrLevel::FillPatch() 41 0.0007553 0.0008853 0.001038 0.03% Amr::InitAmr() 1 0.0002497 0.0002753 0.000389 0.01% Amr::timeStep() 10 0.0001663 0.0002226 0.0003835 0.01% Castro::reset_internal_energy(MultiFab) 63 0.000287 0.0003016 0.0003431 0.01% Castro::do_advance_ctu() 10 0.0001402 0.0001648 0.0001879 0.01% Castro::clean_state() 62 0.0001374 0.0001508 0.0001629 0.00% Amr::FinalizeInit() 1 4.123e-06 2.374e-05 0.0001428 0.00% FillPatchIterator::FillFromLevel0() 41 9.57e-05 0.0001177 0.0001387 0.00% DistributionMapping::LeastUsedCPUs() 1 8.523e-06 0.0001089 0.0001306 0.00% Castro::construct_old_gravity() 10 4.203e-05 5.547e-05 0.0001269 0.00% Castro::finalize_advance() 10 8.663e-05 0.000105 0.0001255 0.00% StateDataPhysBCFunct::() 41 9.153e-05 0.000105 0.0001251 0.00% Castro::do_old_sources() 10 6.868e-05 9.131e-05 0.00011 0.00% Castro::enforce_consistent_e() 1 8.038e-05 8.808e-05 0.0001061 0.00% Castro::construct_old_source() 50 5.243e-05 7.142e-05 0.0001033 0.00% Castro::Castro() 1 5.77e-05 7.444e-05 8.884e-05 0.00% Castro::do_new_sources() 10 4.865e-05 6.455e-05 8.104e-05 0.00% FabArray::ParallelCopy() 41 6.611e-05 6.984e-05 7.515e-05 0.00% FillPatchSingleLevel 41 6.325e-05 6.734e-05 7.194e-05 0.00% Castro::subcycle_advance_ctu() 10 3.809e-05 5.024e-05 6.965e-05 0.00% FabArrayBase::getCPC() 41 3.901e-05 5.035e-05 6.758e-05 0.00% Amr::writeSmallPlotFile() 1 2.97e-05 4.884e-05 6.327e-05 0.00% Amr::init() 1 1.932e-06 9.731e-06 6.169e-05 0.00% Castro::apply_source_to_state() 20 3.812e-05 4.703e-05 5.578e-05 0.00% Castro::advance() 10 3.915e-05 4.518e-05 5.341e-05 0.00% Amr::defBaseLevel() 1 2.311e-05 3.552e-05 4.271e-05 0.00% Castro::construct_new_gravity() 10 3.184e-05 3.662e-05 4.211e-05 0.00% Castro::check_for_nan() 20 2.135e-05 2.542e-05 4.032e-05 0.00% Castro::enforce_speed_limit() 62 2.488e-05 3.043e-05 3.46e-05 0.00% AmrLevel::AmrLevel(dm) 1 2.136e-05 2.651e-05 3.234e-05 0.00% Castro::expand_state() 10 1.967e-05 2.398e-05 3.212e-05 0.00% FabArrayBase::CPC::define() 2 2.282e-05 2.54e-05 2.775e-05 0.00% Gravity::swapTimeLevels() 10 1.358e-05 1.702e-05 2.694e-05 0.00% Castro::post_timestep() 10 1.267e-05 1.488e-05 1.813e-05 0.00% Gravity::set_mass_offset() 10 8.944e-06 1.172e-05 1.664e-05 0.00% Castro::computeNewDt() 9 8.646e-06 1.041e-05 1.203e-05 0.00% Castro::create_source_corrector() 10 6.867e-06 8.186e-06 1.094e-05 0.00% Amr::initSubcycle() 1 8.772e-06 9.441e-06 1.069e-05 0.00% Castro::retry_advance_ctu() 10 6.535e-06 7.585e-06 9.189e-06 0.00% Castro::FluxRegCrseInit 10 5.671e-06 7.015e-06 8.52e-06 0.00% Amr::initialInit() 1 1.243e-06 2.373e-06 7.409e-06 0.00% Castro::post_regrid() 1 1.621e-06 4.851e-06 7.29e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.616e-06 4.633e-06 7.051e-06 0.00% Castro::computeInitialDt() 2 3.577e-06 4.472e-06 5.456e-06 0.00% Amr::InitializeInit() 1 1.813e-06 2.345e-06 4.821e-06 0.00% Castro::post_init() 1 2.635e-06 3.823e-06 4.549e-06 0.00% Castro::FluxRegFineAdd() 10 2.014e-06 2.316e-06 2.912e-06 0.00% DistributionMapping::Distribute() 1 9.48e-07 1.027e-06 1.168e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.531 3.532 3.532 100.00% Amr::coarseTimeStep() 10 3.339 3.339 3.339 94.53% Amr::timeStep() 10 3.326 3.327 3.327 94.20% Castro::advance() 10 3.31 3.311 3.311 93.75% Castro::subcycle_advance_ctu() 10 3.226 3.23 3.233 91.55% Castro::do_advance_ctu() 10 3.226 3.23 3.233 91.55% Castro::construct_ctu_hydro_source() 10 2.444 2.448 2.453 69.46% Gravity::make_radial_gravity() 21 0.3282 0.3503 0.3718 10.53% Castro::construct_old_gravity() 10 0.1976 0.2149 0.2325 6.58% Gravity::get_old_grav_vector() 10 0.1964 0.2138 0.232 6.57% Gravity::get_new_grav_vector() 11 0.2195 0.2211 0.2219 6.28% AmrLevel::FillPatch() 41 0.1904 0.2085 0.221 6.26% Castro::construct_new_gravity() 10 0.1962 0.1971 0.1979 5.60% FillPatchIterator::Initialize 41 0.161 0.177 0.1892 5.36% Castro::initialize_do_advance() 10 0.1537 0.1698 0.1832 5.19% Amr::init() 1 0.1789 0.179 0.179 5.07% Amr::initialInit() 1 0.1629 0.1631 0.1634 4.63% check_for_negative_density() 10 0.02003 0.07884 0.1629 4.61% FillPatchIterator::FillFromLevel0() 41 0.1183 0.1317 0.1529 4.33% FillPatchSingleLevel 41 0.1181 0.1316 0.1528 4.33% Amr::InitializeInit() 1 0.05942 0.09925 0.1355 3.84% Amr::defBaseLevel() 1 0.05942 0.09925 0.1355 3.84% Castro::clean_state() 62 0.1132 0.1166 0.1263 3.58% Castro::expand_state() 10 0.1069 0.1138 0.1194 3.38% Castro::initData() 1 0.04322 0.0828 0.1193 3.38% FabArray::ParallelCopy() 41 0.07732 0.09413 0.1182 3.35% Castro::estTimeStep() 21 0.02394 0.06463 0.1077 3.05% Castro::do_old_sources() 10 0.09419 0.1023 0.1067 3.02% Amr::FinalizeInit() 1 0.02778 0.06388 0.1035 2.93% amrex::Copy() 193 0.06426 0.08174 0.09838 2.79% FabArray::ParallelCopy_finish() 41 0.03491 0.05313 0.08556 2.42% FabArray::setVal() 143 0.06666 0.07352 0.08301 2.35% Castro::initialize_advance() 10 0.07431 0.07682 0.08138 2.30% Castro::computeTemp() 63 0.06615 0.06945 0.07869 2.23% Castro::computeInitialDt() 2 0.002356 0.03861 0.07846 2.22% Castro::do_new_sources() 10 0.0592 0.06308 0.06843 1.94% Castro::reset_internal_energy(MultiFab) 63 0.04749 0.04957 0.05562 1.57% Castro::reset_internal_energy(Fab) 1008 0.04721 0.04927 0.0553 1.57% FabArray::ParallelCopy_nowait() 41 0.03258 0.04093 0.04324 1.22% Castro::normalize_species() 62 0.04113 0.04177 0.04251 1.20% StateDataPhysBCFunct::() 41 0.03455 0.03742 0.04074 1.15% StateData::FillBoundary(geom) 41 0.03443 0.03731 0.04064 1.15% Castro::construct_new_source() 50 0.0271 0.03011 0.03239 0.92% Gravity::interpolate_monopole_grav() 21 0.02796 0.02828 0.02869 0.81% Amr::writePlotFile() 2 0.0253 0.02574 0.02603 0.74% Castro::construct_new_gravity_source() 10 0.02149 0.02378 0.02573 0.73% Castro::post_init() 1 0.02466 0.02498 0.02522 0.71% Castro::finalize_do_advance() 10 0.0116 0.01778 0.02263 0.64% Castro::post_timestep() 10 0.01533 0.01567 0.01601 0.45% VisMF::Write(FabArray) 2 0.01248 0.01302 0.01574 0.45% Castro::check_for_nan() 20 0.009621 0.01119 0.0154 0.44% MultiFab::contains_nan() 20 0.009581 0.01117 0.01538 0.44% Castro::apply_source_to_state() 20 0.01042 0.01267 0.01423 0.40% FabArray::Saxpy() 20 0.01037 0.01263 0.01418 0.40% FabArray::setDomainBndry() 41 0.008864 0.01184 0.01347 0.38% Castro::Castro() 1 0.01074 0.01092 0.01192 0.34% Castro::construct_old_source() 50 0.006581 0.009539 0.01038 0.29% Castro::construct_old_gravity_source() 10 0.006529 0.009468 0.0103 0.29% Castro::computeNewDt() 9 0.009263 0.009272 0.009281 0.26% Castro::initMFs() 1 0.006328 0.006619 0.008428 0.24% Castro::enforce_min_density() 62 0.00574 0.006121 0.006462 0.18% AmrLevel::AmrLevel(dm) 1 0.005265 0.005373 0.005878 0.17% StateData::define() 4 0.005233 0.005346 0.005854 0.17% Castro::swap_state_time_levels() 10 0.002387 0.004137 0.004444 0.13% Castro::finalize_advance() 10 0.003103 0.003327 0.003519 0.10% Castro::buildMetrics() 1 0.001613 0.001648 0.001831 0.05% Castro::post_regrid() 1 0.001525 0.001603 0.001661 0.05% Amr::InitAmr() 1 0.0002589 0.0002848 0.0003982 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.344e-05 0.0001146 0.0001389 0.00% DistributionMapping::LeastUsedCPUs() 1 8.523e-06 0.0001089 0.0001306 0.00% Castro::enforce_consistent_e() 1 8.038e-05 8.808e-05 0.0001061 0.00% FabArrayBase::getCPC() 41 6.677e-05 7.575e-05 9.409e-05 0.00% Amr::writeSmallPlotFile() 1 2.97e-05 4.884e-05 6.327e-05 0.00% Castro::enforce_speed_limit() 62 2.488e-05 3.043e-05 3.46e-05 0.00% FabArrayBase::CPC::define() 2 2.282e-05 2.54e-05 2.775e-05 0.00% Gravity::swapTimeLevels() 10 1.358e-05 1.702e-05 2.694e-05 0.00% Gravity::set_mass_offset() 10 8.944e-06 1.172e-05 1.664e-05 0.00% Castro::create_source_corrector() 10 6.867e-06 8.186e-06 1.094e-05 0.00% Amr::initSubcycle() 1 8.772e-06 9.441e-06 1.069e-05 0.00% Castro::retry_advance_ctu() 10 6.535e-06 7.585e-06 9.189e-06 0.00% Castro::FluxRegCrseInit 10 5.671e-06 7.015e-06 8.52e-06 0.00% Castro::FluxRegFineAdd() 10 2.014e-06 2.316e-06 2.912e-06 0.00% DistributionMapping::Distribute() 1 9.48e-07 1.027e-06 1.168e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 29 B 32 B 39 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-4-ge470d3350ed3) finalized