Initializing AMReX (23.11-17-g9e35dc19489d)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.11-17-g9e35dc19489d) initialized Starting run at 06:21:57 UTC on 2023-11-23. Successfully read inputs file ... Castro git describe: 23.11-7-gbc5fe8d25 AMReX git describe: 23.11-17-g9e35dc194 Microphysics git describe: 23.11-11-g5ab809ab reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.01747058 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.38809421 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.38307527 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.400165688 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.399149096 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.426972153 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.400637137 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.398835194 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.397872063 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.399395184 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.427711394 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.015561369 seconds Ending run at 06:22:01 UTC on 2023-11-23. Run time = 4.232092548 Run time without initialization = 4.046242435 Average number of zones advanced per microsecond: 0.648 Average number of zones advanced per microsecond per rank: 0.081 TinyProfiler total time across processes [min...avg...max]: 4.231 ... 4.232 ... 4.232 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.5002 2.7292 2.9487 69.67% check_for_negative_density() 10 0.03638 0.256 0.4892 11.56% Gravity::make_radial_gravity() 21 0.3052 0.3225 0.3391 8.01% Castro::initData() 1 0.04737 0.08457 0.1201 2.84% amrex::Copy() 193 0.09565 0.1082 0.1188 2.81% Castro::estTimeStep() 21 0.02319 0.06742 0.114 2.69% FabArray::setVal() 143 0.08529 0.0936 0.1014 2.40% FabArray::ParallelCopy_finish() 41 0.04972 0.0593 0.07627 1.80% FabArray::ParallelCopy_nowait() 41 0.05639 0.0579 0.05884 1.39% FillPatchIterator::Initialize 41 0.04566 0.05103 0.05699 1.35% Castro::reset_internal_energy(Fab) 1008 0.04663 0.05101 0.05437 1.28% StateData::FillBoundary(geom) 41 0.03306 0.03852 0.04381 1.04% Castro::normalize_species() 62 0.04191 0.04292 0.0438 1.04% Castro::construct_new_gravity_source() 10 0.02623 0.02999 0.03339 0.79% Gravity::interpolate_monopole_grav() 21 0.02705 0.02925 0.03064 0.72% Castro::initialize_do_advance() 10 0.02219 0.02454 0.02674 0.63% Castro::computeTemp() 63 0.01847 0.02094 0.02286 0.54% VisMF::Write(FabArray) 2 0.01197 0.01423 0.02153 0.51% FabArray::setDomainBndry() 41 0.01392 0.01722 0.02062 0.49% FabArray::Saxpy() 20 0.0161 0.01777 0.019 0.45% Amr::writePlotFile() 2 0.008423 0.01547 0.01828 0.43% MultiFab::contains_nan() 20 0.01203 0.01416 0.0164 0.39% Castro::initialize_advance() 10 0.01347 0.01483 0.01621 0.38% Castro::construct_old_gravity_source() 10 0.01409 0.0147 0.01518 0.36% Castro::construct_new_source() 50 0.007129 0.007739 0.00839 0.20% main() 1 0.006943 0.007628 0.008003 0.19% Castro::enforce_min_density() 62 0.006555 0.007107 0.007508 0.18% Castro::initMFs() 1 0.006355 0.006399 0.006448 0.15% Gravity::get_new_grav_vector() 11 0.003213 0.00475 0.005878 0.14% Castro::swap_state_time_levels() 10 0.003241 0.004463 0.005399 0.13% StateData::define() 4 0.005186 0.005213 0.005245 0.12% Amr::coarseTimeStep() 10 0.001833 0.002853 0.004468 0.11% Gravity::get_old_grav_vector() 10 0.002604 0.002997 0.003579 0.08% Castro::finalize_do_advance() 10 0.001132 0.001456 0.001743 0.04% Castro::buildMetrics() 1 0.001457 0.001475 0.001484 0.04% AmrLevel::FillPatch() 41 0.0009576 0.001123 0.001197 0.03% Amr::timeStep() 10 0.0002045 0.0002603 0.0005631 0.01% Amr::InitAmr() 1 0.0002678 0.0003214 0.0004788 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0003086 0.0003308 0.0003433 0.01% DistributionMapping::LeastUsedCPUs() 1 6.973e-06 0.0001992 0.0002509 0.01% Castro::clean_state() 62 0.0001694 0.0001953 0.0002174 0.01% Castro::do_advance_ctu() 10 0.0001775 0.0001937 0.0002155 0.01% FillPatchIterator::FillFromLevel0() 41 0.0001517 0.0001654 0.0001903 0.00% StateDataPhysBCFunct::() 41 0.0001118 0.0001332 0.0001512 0.00% Castro::do_old_sources() 10 0.0001187 0.0001332 0.0001456 0.00% Castro::construct_old_source() 50 9.003e-05 0.0001116 0.000145 0.00% Castro::finalize_advance() 10 0.000103 0.0001181 0.0001436 0.00% Castro::Castro() 1 7.877e-05 9.675e-05 0.0001266 0.00% FabArray::ParallelCopy() 41 8.783e-05 0.0001052 0.0001199 0.00% Castro::enforce_consistent_e() 1 7.248e-05 8.87e-05 0.0001053 0.00% FillPatchSingleLevel 41 7.945e-05 9.085e-05 0.0001034 0.00% Castro::do_new_sources() 10 7.615e-05 8.458e-05 8.977e-05 0.00% FabArrayBase::getCPC() 41 5.035e-05 7.352e-05 8.878e-05 0.00% Amr::FinalizeInit() 1 3.969e-06 1.445e-05 8.304e-05 0.00% Castro::apply_source_to_state() 20 6.738e-05 7.391e-05 8.008e-05 0.00% Castro::subcycle_advance_ctu() 10 5.702e-05 6.753e-05 7.998e-05 0.00% Castro::construct_new_gravity() 10 3.162e-05 4.586e-05 6.905e-05 0.00% Castro::construct_old_gravity() 10 4.009e-05 4.922e-05 5.994e-05 0.00% Castro::expand_state() 10 3.337e-05 4.297e-05 5.782e-05 0.00% Castro::advance() 10 4.538e-05 5.025e-05 5.559e-05 0.00% Amr::writeSmallPlotFile() 1 3.074e-05 4.333e-05 5.523e-05 0.00% FabArrayBase::CPC::define() 2 2.195e-05 2.856e-05 3.891e-05 0.00% Amr::defBaseLevel() 1 2.364e-05 3.189e-05 3.862e-05 0.00% Castro::enforce_speed_limit() 62 3.238e-05 3.498e-05 3.742e-05 0.00% Castro::check_for_nan() 20 2.72e-05 2.993e-05 3.168e-05 0.00% Amr::initSubcycle() 1 1.008e-05 1.269e-05 2.961e-05 0.00% Castro::post_timestep() 10 1.379e-05 1.738e-05 2.092e-05 0.00% Gravity::swapTimeLevels() 10 1.117e-05 1.454e-05 2.057e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.299e-05 1.679e-05 2.018e-05 0.00% Castro::post_init() 1 1.478e-05 1.635e-05 1.965e-05 0.00% Castro::create_source_corrector() 10 9.399e-06 1.262e-05 1.81e-05 0.00% Gravity::set_mass_offset() 10 7.526e-06 1.256e-05 1.691e-05 0.00% Castro::FluxRegCrseInit 10 5.831e-06 8.661e-06 1.108e-05 0.00% Castro::computeNewDt() 9 8.009e-06 8.848e-06 9.567e-06 0.00% Castro::retry_advance_ctu() 10 6.419e-06 7.373e-06 8.41e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.442e-06 5.708e-06 7.248e-06 0.00% Amr::InitializeInit() 1 1.804e-06 2.819e-06 5.73e-06 0.00% Castro::computeInitialDt() 2 3.186e-06 3.66e-06 4.383e-06 0.00% Amr::init() 1 1.699e-06 2.387e-06 3.792e-06 0.00% Castro::post_regrid() 1 1.833e-06 2.6e-06 3.304e-06 0.00% Amr::initialInit() 1 1.482e-06 1.911e-06 3.008e-06 0.00% Castro::FluxRegFineAdd() 10 2.046e-06 2.354e-06 2.674e-06 0.00% DistributionMapping::Distribute() 1 8.07e-07 9.994e-07 1.32e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 4.231 4.232 4.232 100.00% Amr::coarseTimeStep() 10 4.023 4.023 4.023 95.05% Amr::timeStep() 10 4.008 4.009 4.01 94.76% Castro::advance() 10 3.992 3.993 3.994 94.37% Castro::subcycle_advance_ctu() 10 3.892 3.897 3.901 92.18% Castro::do_advance_ctu() 10 3.892 3.897 3.901 92.18% Castro::construct_ctu_hydro_source() 10 3.001 3.007 3.012 71.16% check_for_negative_density() 10 0.03638 0.256 0.4892 11.56% Gravity::make_radial_gravity() 21 0.326 0.3461 0.3657 8.64% AmrLevel::FillPatch() 41 0.2556 0.2693 0.2836 6.70% FillPatchIterator::Initialize 41 0.2162 0.2246 0.2369 5.60% Castro::initialize_do_advance() 10 0.2104 0.2212 0.2354 5.56% Gravity::get_new_grav_vector() 11 0.2308 0.2322 0.2345 5.54% Castro::construct_old_gravity() 10 0.1974 0.213 0.2268 5.36% Gravity::get_old_grav_vector() 10 0.1964 0.2122 0.2261 5.34% Castro::construct_new_gravity() 10 0.2086 0.2095 0.2109 4.98% Amr::init() 1 0.1852 0.1854 0.1854 4.38% FillPatchIterator::FillFromLevel0() 41 0.145 0.1563 0.1706 4.03% FillPatchSingleLevel 41 0.1448 0.1562 0.1704 4.03% Amr::initialInit() 1 0.1673 0.1676 0.1677 3.96% Castro::expand_state() 10 0.142 0.1529 0.1671 3.95% Amr::InitializeInit() 1 0.06783 0.1053 0.1411 3.33% Amr::defBaseLevel() 1 0.06783 0.1053 0.1411 3.33% FabArray::ParallelCopy() 41 0.1086 0.1174 0.1347 3.18% Castro::do_old_sources() 10 0.1249 0.1283 0.1303 3.08% Castro::clean_state() 62 0.1142 0.1216 0.1261 2.98% Castro::initData() 1 0.05124 0.08869 0.1243 2.94% amrex::Copy() 193 0.09565 0.1082 0.1188 2.81% Castro::estTimeStep() 21 0.02319 0.06742 0.114 2.69% FabArray::setVal() 143 0.08529 0.0936 0.1014 2.40% Amr::FinalizeInit() 1 0.02665 0.0623 0.09989 2.36% Castro::initialize_advance() 10 0.08704 0.09208 0.09618 2.27% Castro::do_new_sources() 10 0.0674 0.07569 0.0831 1.96% Castro::computeTemp() 63 0.06541 0.07228 0.07646 1.81% FabArray::ParallelCopy_finish() 41 0.04972 0.0593 0.07627 1.80% Castro::computeInitialDt() 2 0.002344 0.03806 0.07559 1.79% FabArray::ParallelCopy_nowait() 41 0.05647 0.058 0.05894 1.39% Castro::reset_internal_energy(MultiFab) 63 0.04694 0.05134 0.05471 1.29% Castro::reset_internal_energy(Fab) 1008 0.04663 0.05101 0.05437 1.28% StateDataPhysBCFunct::() 41 0.03318 0.03865 0.04396 1.04% StateData::FillBoundary(geom) 41 0.03306 0.03852 0.04381 1.04% Castro::normalize_species() 62 0.04191 0.04292 0.0438 1.04% Castro::construct_new_source() 50 0.03335 0.03773 0.04131 0.98% Amr::writePlotFile() 2 0.03325 0.03341 0.03358 0.79% Castro::construct_new_gravity_source() 10 0.02623 0.02999 0.03339 0.79% Gravity::interpolate_monopole_grav() 21 0.02705 0.02925 0.03064 0.72% Castro::finalize_do_advance() 10 0.01275 0.02151 0.03029 0.72% Castro::post_init() 1 0.02385 0.024 0.02416 0.57% VisMF::Write(FabArray) 2 0.01197 0.01423 0.02153 0.51% FabArray::setDomainBndry() 41 0.01392 0.01722 0.02062 0.49% Castro::apply_source_to_state() 20 0.01617 0.01785 0.01907 0.45% FabArray::Saxpy() 20 0.0161 0.01777 0.019 0.45% Castro::check_for_nan() 20 0.01206 0.01419 0.01643 0.39% Castro::post_timestep() 10 0.0151 0.01584 0.0164 0.39% MultiFab::contains_nan() 20 0.01203 0.01416 0.0164 0.39% Castro::construct_old_source() 50 0.01418 0.01481 0.01531 0.36% Castro::construct_old_gravity_source() 10 0.01409 0.0147 0.01518 0.36% Castro::Castro() 1 0.01105 0.01114 0.01123 0.27% Castro::computeNewDt() 9 0.009299 0.009312 0.009324 0.22% Castro::enforce_min_density() 62 0.006555 0.007107 0.007508 0.18% Castro::initMFs() 1 0.006355 0.006399 0.006448 0.15% Castro::swap_state_time_levels() 10 0.003241 0.004463 0.005399 0.13% AmrLevel::AmrLevel(dm) 1 0.005199 0.00523 0.005259 0.12% StateData::define() 4 0.005186 0.005213 0.005245 0.12% Castro::finalize_advance() 10 0.003904 0.004426 0.005036 0.12% Castro::buildMetrics() 1 0.001607 0.001623 0.001634 0.04% Castro::post_regrid() 1 0.001489 0.001553 0.001623 0.04% Amr::InitAmr() 1 0.0002783 0.0003341 0.0005084 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.299e-05 0.0002059 0.000259 0.01% DistributionMapping::LeastUsedCPUs() 1 6.973e-06 0.0001992 0.0002509 0.01% FabArrayBase::getCPC() 41 7.514e-05 0.0001021 0.0001168 0.00% Castro::enforce_consistent_e() 1 7.248e-05 8.87e-05 0.0001053 0.00% Amr::writeSmallPlotFile() 1 3.074e-05 4.333e-05 5.523e-05 0.00% FabArrayBase::CPC::define() 2 2.195e-05 2.856e-05 3.891e-05 0.00% Castro::enforce_speed_limit() 62 3.238e-05 3.498e-05 3.742e-05 0.00% Amr::initSubcycle() 1 1.008e-05 1.269e-05 2.961e-05 0.00% Gravity::swapTimeLevels() 10 1.117e-05 1.454e-05 2.057e-05 0.00% Castro::create_source_corrector() 10 9.399e-06 1.262e-05 1.81e-05 0.00% Gravity::set_mass_offset() 10 7.526e-06 1.256e-05 1.691e-05 0.00% Castro::FluxRegCrseInit 10 5.831e-06 8.661e-06 1.108e-05 0.00% Castro::retry_advance_ctu() 10 6.419e-06 7.373e-06 8.41e-06 0.00% Castro::FluxRegFineAdd() 10 2.046e-06 2.354e-06 2.674e-06 0.00% DistributionMapping::Distribute() 1 8.07e-07 9.994e-07 1.32e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 24 B 26 B 30 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.11-17-g9e35dc19489d) finalized