Initializing AMReX (23.12-24-g75571e2dcbf2)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.12-24-g75571e2dcbf2) initialized Starting run at 06:37:09 UTC on 2023-12-21. Successfully read inputs file ... Castro git describe: 23.12-13-gfe78cf0df AMReX git describe: 23.12-24-g75571e2dc Microphysics git describe: 23.12-13-ga38a1eea reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.012813645 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.362501279 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.353888575 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.331884311 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.334298616 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.363309034 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.340020541 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.313806258 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.313792543 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.313121186 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.310531396 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.007473182 seconds Ending run at 06:37:13 UTC on 2023-12-21. Run time = 3.600504562 Run time without initialization = 3.350790243 Average number of zones advanced per microsecond: 0.782 Average number of zones advanced per microsecond per rank: 0.098 TinyProfiler total time across processes [min...avg...max]: 3.599 ... 3.6 ... 3.601 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2962 2.3491 2.4295 67.48% Gravity::make_radial_gravity() 21 0.2869 0.3005 0.3185 8.85% check_for_negative_density() 10 0.03573 0.1213 0.1785 4.96% Castro::initData() 1 0.0473 0.08538 0.1273 3.53% Castro::estTimeStep() 21 0.03533 0.07678 0.1212 3.37% FabArray::ParallelCopy_finish() 41 0.03671 0.05573 0.08989 2.50% amrex::Copy() 193 0.06257 0.07736 0.08693 2.41% FabArray::setVal() 143 0.0616 0.06993 0.08302 2.31% Amr::InitAmr() 1 0.0002524 0.00783 0.06052 1.68% DistributionMapping::LeastUsedCPUs() 1 7.79e-06 0.05269 0.06027 1.67% Castro::reset_internal_energy(Fab) 1008 0.04635 0.04793 0.05093 1.41% Castro::normalize_species() 62 0.04144 0.04204 0.04352 1.21% FabArray::ParallelCopy_nowait() 41 0.03568 0.04105 0.04266 1.18% StateData::FillBoundary(geom) 41 0.0283 0.03192 0.03611 1.00% FillPatchIterator::Initialize 41 0.02761 0.03257 0.03453 0.96% Gravity::interpolate_monopole_grav() 21 0.02759 0.0292 0.0301 0.84% Castro::construct_new_gravity_source() 10 0.02244 0.02494 0.02854 0.79% Castro::computeTemp() 63 0.01923 0.01976 0.02064 0.57% Castro::initialize_do_advance() 10 0.01213 0.01765 0.02061 0.57% Castro::initialize_advance() 10 0.004158 0.01004 0.01383 0.38% FabArray::Saxpy() 20 0.0109 0.01228 0.01361 0.38% FabArray::setDomainBndry() 41 0.006755 0.009748 0.01253 0.35% MultiFab::contains_nan() 20 0.009743 0.01056 0.01218 0.34% VisMF::Write(FabArray) 2 0.008652 0.009301 0.01161 0.32% Castro::construct_old_gravity_source() 10 0.007186 0.009304 0.01017 0.28% Amr::writePlotFile() 2 0.006147 0.008265 0.008715 0.24% Castro::enforce_min_density() 62 0.005753 0.006053 0.006393 0.18% Castro::construct_new_source() 50 0.005612 0.006026 0.006287 0.17% Castro::initMFs() 1 0.00621 0.006228 0.006244 0.17% Gravity::get_new_grav_vector() 11 0.002985 0.004032 0.005941 0.16% main() 1 0.00353 0.004914 0.005399 0.15% StateData::define() 4 0.00518 0.005205 0.005222 0.15% Castro::swap_state_time_levels() 10 0.003145 0.004131 0.004374 0.12% Amr::coarseTimeStep() 10 0.002251 0.002616 0.00319 0.09% Gravity::get_old_grav_vector() 10 0.001525 0.002019 0.002484 0.07% Castro::buildMetrics() 1 0.001452 0.001467 0.001481 0.04% Castro::finalize_do_advance() 10 0.0005045 0.001092 0.001449 0.04% AmrLevel::FillPatch() 41 0.0007722 0.0009149 0.001083 0.03% Amr::timeStep() 10 0.0001461 0.0002195 0.0004285 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002836 0.0003001 0.000328 0.01% Castro::clean_state() 62 0.0001448 0.000167 0.0002038 0.01% Castro::do_advance_ctu() 10 0.0001352 0.0001594 0.000193 0.01% FillPatchIterator::FillFromLevel0() 41 0.0001007 0.0001207 0.0001436 0.00% Castro::do_old_sources() 10 8.12e-05 9.387e-05 0.0001333 0.00% StateDataPhysBCFunct::() 41 8.313e-05 0.0001036 0.0001207 0.00% Castro::finalize_advance() 10 8.389e-05 9.517e-05 0.0001115 0.00% Castro::enforce_consistent_e() 1 7.443e-05 8.88e-05 0.0001111 0.00% Castro::construct_old_source() 50 5.235e-05 6.926e-05 9.529e-05 0.00% FabArray::ParallelCopy() 41 6.923e-05 8.094e-05 9.174e-05 0.00% Castro::Castro() 1 5.935e-05 6.721e-05 8.396e-05 0.00% Amr::writeSmallPlotFile() 1 3.049e-05 6.186e-05 7.964e-05 0.00% FillPatchSingleLevel 41 5.964e-05 6.856e-05 7.682e-05 0.00% Castro::do_new_sources() 10 5.603e-05 6.491e-05 7.583e-05 0.00% FabArrayBase::getCPC() 41 4.5e-05 5.715e-05 7.565e-05 0.00% Amr::FinalizeInit() 1 3.695e-06 1.169e-05 6.317e-05 0.00% Castro::apply_source_to_state() 20 4.018e-05 4.608e-05 6.035e-05 0.00% Castro::subcycle_advance_ctu() 10 3.759e-05 4.867e-05 5.635e-05 0.00% Castro::advance() 10 3.818e-05 4.36e-05 4.707e-05 0.00% Castro::construct_old_gravity() 10 3.149e-05 3.657e-05 4.678e-05 0.00% Castro::construct_new_gravity() 10 2.829e-05 3.459e-05 4.314e-05 0.00% Amr::defBaseLevel() 1 2.507e-05 3.036e-05 3.6e-05 0.00% Castro::enforce_speed_limit() 62 2.61e-05 2.958e-05 3.446e-05 0.00% Castro::expand_state() 10 2.071e-05 2.646e-05 3.4e-05 0.00% Castro::check_for_nan() 20 2.222e-05 2.455e-05 2.936e-05 0.00% FabArrayBase::CPC::define() 2 2.198e-05 2.481e-05 2.756e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.338e-05 1.821e-05 2.729e-05 0.00% Castro::post_timestep() 10 1.344e-05 1.67e-05 2.388e-05 0.00% Castro::post_init() 1 1.296e-05 1.523e-05 1.759e-05 0.00% Castro::computeNewDt() 9 7.983e-06 9.86e-06 1.336e-05 0.00% Gravity::set_mass_offset() 10 8.98e-06 1.097e-05 1.29e-05 0.00% Gravity::swapTimeLevels() 10 6.624e-06 9.83e-06 1.16e-05 0.00% Amr::initSubcycle() 1 9.519e-06 9.929e-06 1.041e-05 0.00% Castro::create_source_corrector() 10 6.639e-06 8.148e-06 9.735e-06 0.00% Castro::retry_advance_ctu() 10 6.49e-06 7.505e-06 8.364e-06 0.00% Castro::FluxRegCrseInit 10 6.943e-06 7.671e-06 8.255e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.624e-06 4.351e-06 5.784e-06 0.00% Castro::computeInitialDt() 2 3.095e-06 3.869e-06 4.698e-06 0.00% Amr::InitializeInit() 1 1.809e-06 2.313e-06 4.66e-06 0.00% Castro::post_regrid() 1 2.132e-06 2.853e-06 3.875e-06 0.00% Castro::FluxRegFineAdd() 10 1.925e-06 2.461e-06 3.001e-06 0.00% Amr::init() 1 1.902e-06 2.187e-06 2.576e-06 0.00% Amr::initialInit() 1 1.213e-06 1.511e-06 2.182e-06 0.00% DistributionMapping::Distribute() 1 8.58e-07 9.248e-07 9.8e-07 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.599 3.6 3.601 100.00% Amr::coarseTimeStep() 10 3.338 3.338 3.338 92.71% Amr::timeStep() 10 3.324 3.325 3.325 92.36% Castro::advance() 10 3.309 3.309 3.31 91.92% Castro::subcycle_advance_ctu() 10 3.224 3.236 3.247 90.18% Castro::do_advance_ctu() 10 3.224 3.236 3.247 90.18% Castro::construct_ctu_hydro_source() 10 2.488 2.492 2.5 69.42% Gravity::make_radial_gravity() 21 0.3023 0.3167 0.3316 9.21% Amr::init() 1 0.189 0.2417 0.2493 6.92% Amr::initialInit() 1 0.1761 0.2291 0.2368 6.58% Gravity::get_new_grav_vector() 11 0.2069 0.2125 0.2146 5.96% AmrLevel::FillPatch() 41 0.1796 0.2027 0.2122 5.89% Amr::InitializeInit() 1 0.06894 0.1585 0.2086 5.79% Amr::defBaseLevel() 1 0.06893 0.1585 0.2086 5.79% Castro::construct_old_gravity() 10 0.1794 0.1873 0.1991 5.53% Gravity::get_old_grav_vector() 10 0.1787 0.1867 0.1986 5.51% Castro::construct_new_gravity() 10 0.1836 0.1883 0.1897 5.27% FillPatchIterator::Initialize 41 0.1518 0.1715 0.1887 5.24% check_for_negative_density() 10 0.03573 0.1213 0.1785 4.96% Castro::initialize_do_advance() 10 0.1608 0.1717 0.1768 4.91% FillPatchIterator::FillFromLevel0() 41 0.1131 0.1291 0.1544 4.29% FillPatchSingleLevel 41 0.113 0.129 0.1542 4.28% Castro::initData() 1 0.05123 0.08961 0.1321 3.67% FabArray::ParallelCopy() 41 0.07893 0.09694 0.1258 3.49% Castro::expand_state() 10 0.1045 0.1172 0.1235 3.43% Castro::estTimeStep() 21 0.03533 0.07678 0.1212 3.37% Castro::clean_state() 62 0.1129 0.1153 0.1196 3.32% Amr::FinalizeInit() 1 0.02805 0.07054 0.1089 3.03% Castro::do_old_sources() 10 0.08708 0.09265 0.0959 2.66% FabArray::ParallelCopy_finish() 41 0.03671 0.05573 0.08989 2.50% amrex::Copy() 193 0.06257 0.07736 0.08693 2.41% Castro::computeInitialDt() 2 0.002477 0.04501 0.08339 2.32% FabArray::setVal() 143 0.0616 0.06993 0.08302 2.31% Castro::initialize_advance() 10 0.05795 0.06995 0.08118 2.25% Castro::do_new_sources() 10 0.05849 0.06466 0.07409 2.06% Castro::computeTemp() 63 0.06599 0.06799 0.07182 1.99% Amr::InitAmr() 1 0.0002619 0.00784 0.06053 1.68% DistributionMapping::SFCProcessorMapDoIt() 1 1.233e-05 0.0527 0.06028 1.67% DistributionMapping::LeastUsedCPUs() 1 7.79e-06 0.05269 0.06027 1.67% Castro::reset_internal_energy(MultiFab) 63 0.04663 0.04823 0.05123 1.42% Castro::reset_internal_energy(Fab) 1008 0.04635 0.04793 0.05093 1.41% Castro::normalize_species() 62 0.04144 0.04204 0.04352 1.21% FabArray::ParallelCopy_nowait() 41 0.03578 0.04113 0.04274 1.19% StateDataPhysBCFunct::() 41 0.02842 0.03202 0.03621 1.01% StateData::FillBoundary(geom) 41 0.0283 0.03192 0.03611 1.00% Castro::construct_new_source() 50 0.0285 0.03096 0.03463 0.96% Castro::finalize_do_advance() 10 0.01321 0.02372 0.03162 0.88% Gravity::interpolate_monopole_grav() 21 0.02759 0.0292 0.0301 0.84% Castro::construct_new_gravity_source() 10 0.02244 0.02494 0.02854 0.79% Castro::post_init() 1 0.02489 0.0252 0.0254 0.71% Amr::writePlotFile() 2 0.02006 0.02021 0.0205 0.57% Castro::post_timestep() 10 0.0151 0.0157 0.01642 0.46% Castro::apply_source_to_state() 20 0.01095 0.01233 0.01367 0.38% FabArray::Saxpy() 20 0.0109 0.01228 0.01361 0.38% FabArray::setDomainBndry() 41 0.006755 0.009748 0.01253 0.35% Castro::check_for_nan() 20 0.009767 0.01058 0.01221 0.34% MultiFab::contains_nan() 20 0.009743 0.01056 0.01218 0.34% VisMF::Write(FabArray) 2 0.008652 0.009301 0.01161 0.32% Castro::Castro() 1 0.01093 0.01095 0.01098 0.30% Castro::construct_old_source() 50 0.007238 0.009373 0.01027 0.29% Castro::construct_old_gravity_source() 10 0.007186 0.009304 0.01017 0.28% Castro::computeNewDt() 9 0.00915 0.009161 0.009171 0.25% Castro::enforce_min_density() 62 0.005753 0.006053 0.006393 0.18% Castro::initMFs() 1 0.00621 0.006228 0.006244 0.17% AmrLevel::AmrLevel(dm) 1 0.005196 0.005223 0.005249 0.15% StateData::define() 4 0.00518 0.005205 0.005222 0.15% Castro::swap_state_time_levels() 10 0.003145 0.004131 0.004374 0.12% Castro::finalize_advance() 10 0.002962 0.003489 0.004321 0.12% Castro::post_regrid() 1 0.001499 0.001569 0.001747 0.05% Castro::buildMetrics() 1 0.001601 0.001611 0.001623 0.05% Castro::enforce_consistent_e() 1 7.443e-05 8.88e-05 0.0001111 0.00% FabArrayBase::getCPC() 41 6.723e-05 8.196e-05 0.0001021 0.00% Amr::writeSmallPlotFile() 1 3.049e-05 6.186e-05 7.964e-05 0.00% Castro::enforce_speed_limit() 62 2.61e-05 2.958e-05 3.446e-05 0.00% FabArrayBase::CPC::define() 2 2.198e-05 2.481e-05 2.756e-05 0.00% Gravity::set_mass_offset() 10 8.98e-06 1.097e-05 1.29e-05 0.00% Gravity::swapTimeLevels() 10 6.624e-06 9.83e-06 1.16e-05 0.00% Amr::initSubcycle() 1 9.519e-06 9.929e-06 1.041e-05 0.00% Castro::create_source_corrector() 10 6.639e-06 8.148e-06 9.735e-06 0.00% Castro::retry_advance_ctu() 10 6.49e-06 7.505e-06 8.364e-06 0.00% Castro::FluxRegCrseInit 10 6.943e-06 7.671e-06 8.255e-06 0.00% Castro::FluxRegFineAdd() 10 1.925e-06 2.461e-06 3.001e-06 0.00% DistributionMapping::Distribute() 1 8.58e-07 9.248e-07 9.8e-07 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 27 B 31 B 41 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.12-24-g75571e2dcbf2) finalized