MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.07-44-g49dd703558c5) initialized Starting run at 05:20:43 UTC on 2023-07-27. Successfully read inputs file ... Castro git describe: 23.07-20-g4174f17eb AMReX git describe: 23.07-44-g49dd70355 Microphysics git describe: 23.07-48-g588beb9c reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.016921051 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.365698634 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.346214696 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.338387815 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.337840553 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.361310813 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.35207841 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.315396425 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.316401118 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.317452385 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.316640454 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.010412854 seconds Ending run at 05:20:46 UTC on 2023-07-27. Run time = 3.568911501 Run time without initialization = 3.384610599 Average number of zones advanced per microsecond: 0.775 Average number of zones advanced per microsecond per rank: 0.097 TinyProfiler total time across processes [min...avg...max]: 3.568 ... 3.569 ... 3.569 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2466 2.3601 2.4145 67.65% Gravity::make_radial_gravity() 21 0.3255 0.3364 0.3541 9.92% check_for_negative_density() 10 0.01414 0.07404 0.194 5.44% Castro::estTimeStep() 21 0.02514 0.06945 0.1205 3.38% Castro::initData() 1 0.03839 0.07941 0.1134 3.18% amrex::Copy() 193 0.06343 0.0777 0.08855 2.48% FabArray::ParallelCopy_finish() 41 0.03661 0.06263 0.08808 2.47% FabArray::setVal() 143 0.06172 0.07387 0.08798 2.47% Castro::reset_internal_energy(Fab) 1008 0.04791 0.04988 0.05164 1.45% Castro::normalize_species() 62 0.04096 0.04247 0.04397 1.23% FabArray::ParallelCopy_nowait() 41 0.03554 0.04182 0.04383 1.23% StateData::FillBoundary(geom) 41 0.03406 0.03786 0.04162 1.17% FillPatchIterator::Initialize 41 0.02937 0.0354 0.04052 1.14% Gravity::interpolate_monopole_grav() 21 0.02772 0.029 0.03132 0.88% Castro::construct_new_gravity_source() 10 0.02205 0.02586 0.03089 0.87% Castro::initialize_do_advance() 10 0.01266 0.01895 0.02332 0.65% Castro::computeTemp() 63 0.01932 0.01997 0.02086 0.58% VisMF::Write(FabArray) 2 0.01392 0.01458 0.01784 0.50% Castro::initialize_advance() 10 0.009 0.01164 0.01525 0.43% FabArray::Saxpy() 20 0.01072 0.01313 0.01424 0.40% FabArray::setDomainBndry() 41 0.009057 0.01151 0.01321 0.37% MultiFab::contains_nan() 20 0.009656 0.01064 0.01213 0.34% Amr::writePlotFile() 2 0.007386 0.01066 0.01163 0.33% Castro::construct_old_gravity_source() 10 0.007141 0.009526 0.0101 0.28% Castro::initMFs() 1 0.007134 0.007706 0.008653 0.24% StateData::define() 4 0.005804 0.006135 0.006655 0.19% Castro::construct_new_source() 50 0.005728 0.006186 0.006468 0.18% Castro::enforce_min_density() 62 0.005717 0.006 0.006377 0.18% main() 1 0.005293 0.005856 0.006029 0.17% Castro::swap_state_time_levels() 10 0.002806 0.004774 0.005625 0.16% Gravity::get_new_grav_vector() 11 0.002957 0.003747 0.004267 0.12% Amr::coarseTimeStep() 10 0.00127 0.002747 0.004036 0.11% Gravity::get_old_grav_vector() 10 0.001495 0.002018 0.002417 0.07% Castro::finalize_do_advance() 10 0.0005577 0.001657 0.002136 0.06% Castro::buildMetrics() 1 0.001638 0.001743 0.001916 0.05% AmrLevel::FillPatch() 41 0.0009091 0.001063 0.001245 0.03% Amr::InitAmr() 1 0.0002708 0.0003022 0.0004106 0.01% Amr::timeStep() 10 0.0001702 0.0002307 0.0004083 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002853 0.0003044 0.0003283 0.01% Castro::do_advance_ctu() 10 0.0001422 0.0001821 0.0002291 0.01% Castro::clean_state() 62 0.0001316 0.0001452 0.0001662 0.00% StateDataPhysBCFunct::() 41 8.008e-05 0.0001008 0.0001517 0.00% DistributionMapping::LeastUsedCPUs() 1 6.642e-06 0.0001195 0.0001441 0.00% Castro::finalize_advance() 10 8.088e-05 0.0001002 0.000122 0.00% FillPatchIterator::FillFromLevel0() 41 9.96e-05 0.0001113 0.0001179 0.00% Castro::do_old_sources() 10 7.093e-05 8.93e-05 0.0001064 0.00% Castro::enforce_consistent_e() 1 7.942e-05 8.808e-05 9.615e-05 0.00% Amr::writeSmallPlotFile() 1 2.657e-05 5.285e-05 8.347e-05 0.00% Castro::Castro() 1 5.783e-05 6.942e-05 8.336e-05 0.00% Castro::construct_old_source() 50 5.189e-05 6.775e-05 7.829e-05 0.00% Amr::FinalizeInit() 1 3.957e-06 1.388e-05 7.676e-05 0.00% FabArray::ParallelCopy() 41 6.334e-05 6.926e-05 7.359e-05 0.00% FillPatchSingleLevel 41 6.21e-05 6.746e-05 7.305e-05 0.00% Castro::do_new_sources() 10 5.275e-05 6.003e-05 6.984e-05 0.00% Castro::subcycle_advance_ctu() 10 4.099e-05 5.047e-05 6.428e-05 0.00% Castro::advance() 10 3.517e-05 4.492e-05 5.948e-05 0.00% FabArrayBase::getCPC() 41 4.481e-05 4.955e-05 5.784e-05 0.00% Castro::construct_old_gravity() 10 3.929e-05 4.542e-05 5.469e-05 0.00% Amr::defBaseLevel() 1 2.475e-05 3.66e-05 5.204e-05 0.00% Castro::apply_source_to_state() 20 3.351e-05 4.224e-05 4.98e-05 0.00% Castro::construct_new_gravity() 10 3.558e-05 4.021e-05 4.596e-05 0.00% Castro::enforce_speed_limit() 62 2.75e-05 3.031e-05 3.634e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.267e-05 2.06e-05 2.937e-05 0.00% FabArrayBase::CPC::define() 2 2.032e-05 2.412e-05 2.843e-05 0.00% Castro::check_for_nan() 20 2.226e-05 2.396e-05 2.715e-05 0.00% Castro::expand_state() 10 2.09e-05 2.313e-05 2.633e-05 0.00% Gravity::swapTimeLevels() 10 1.032e-05 1.43e-05 1.874e-05 0.00% Castro::post_timestep() 10 1.333e-05 1.43e-05 1.532e-05 0.00% Gravity::set_mass_offset() 10 8.943e-06 1.111e-05 1.53e-05 0.00% Castro::computeNewDt() 9 8.723e-06 1.211e-05 1.466e-05 0.00% Castro::create_source_corrector() 10 7.075e-06 8.481e-06 1.022e-05 0.00% Amr::initSubcycle() 1 8.501e-06 9.419e-06 9.962e-06 0.00% Amr::initialInit() 1 1.473e-06 3.437e-06 9.624e-06 0.00% Castro::retry_advance_ctu() 10 6.942e-06 7.779e-06 9.175e-06 0.00% Castro::FluxRegCrseInit 10 5.709e-06 7.486e-06 8.35e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.758e-06 5.297e-06 7.436e-06 0.00% Castro::post_init() 1 3.144e-06 3.87e-06 5.639e-06 0.00% Castro::computeInitialDt() 2 3.603e-06 4.502e-06 5.593e-06 0.00% Amr::InitializeInit() 1 2.073e-06 2.724e-06 5.413e-06 0.00% Castro::post_regrid() 1 1.925e-06 3.229e-06 5.165e-06 0.00% Amr::init() 1 2.168e-06 2.573e-06 2.981e-06 0.00% Castro::FluxRegFineAdd() 10 1.783e-06 2.17e-06 2.635e-06 0.00% DistributionMapping::Distribute() 1 9.46e-07 1.097e-06 1.263e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.568 3.569 3.569 100.00% Amr::coarseTimeStep() 10 3.368 3.368 3.368 94.38% Amr::timeStep() 10 3.354 3.356 3.357 94.06% Castro::advance() 10 3.338 3.339 3.34 93.60% Castro::subcycle_advance_ctu() 10 3.247 3.258 3.266 91.52% Castro::do_advance_ctu() 10 3.247 3.258 3.266 91.51% Castro::construct_ctu_hydro_source() 10 2.45 2.455 2.461 68.96% Gravity::make_radial_gravity() 21 0.3424 0.353 0.3678 10.31% Gravity::get_new_grav_vector() 11 0.2371 0.2387 0.2398 6.72% AmrLevel::FillPatch() 41 0.1953 0.2197 0.2392 6.70% Castro::construct_old_gravity() 10 0.1967 0.2041 0.2161 6.05% Gravity::get_old_grav_vector() 10 0.1956 0.2033 0.2155 6.04% Castro::construct_new_gravity() 10 0.2094 0.2106 0.2117 5.93% FillPatchIterator::Initialize 41 0.1682 0.1896 0.2068 5.79% Castro::initialize_do_advance() 10 0.1671 0.1817 0.1944 5.45% check_for_negative_density() 10 0.01414 0.07404 0.194 5.44% Amr::init() 1 0.1837 0.1838 0.1839 5.15% Amr::initialInit() 1 0.166 0.1664 0.1667 4.67% FillPatchIterator::FillFromLevel0() 41 0.1214 0.1427 0.1586 4.44% FillPatchSingleLevel 41 0.1213 0.1426 0.1584 4.44% Castro::expand_state() 10 0.1087 0.1256 0.1406 3.94% Amr::InitializeInit() 1 0.05962 0.1014 0.1348 3.78% Amr::defBaseLevel() 1 0.05962 0.1014 0.1348 3.78% FabArray::ParallelCopy() 41 0.07986 0.1046 0.1238 3.47% Castro::clean_state() 62 0.1135 0.1178 0.1221 3.42% Castro::estTimeStep() 21 0.02514 0.06945 0.1205 3.38% Castro::initData() 1 0.0425 0.08341 0.1175 3.29% Amr::FinalizeInit() 1 0.03167 0.06502 0.1067 2.99% Castro::do_old_sources() 10 0.09032 0.09534 0.09901 2.77% Castro::initialize_advance() 10 0.06963 0.07722 0.08878 2.49% amrex::Copy() 193 0.06343 0.0777 0.08855 2.48% FabArray::ParallelCopy_finish() 41 0.03661 0.06263 0.08808 2.47% FabArray::setVal() 143 0.06172 0.07387 0.08798 2.47% Castro::do_new_sources() 10 0.05903 0.06825 0.08198 2.30% Castro::computeInitialDt() 2 0.002182 0.03556 0.07732 2.17% Castro::computeTemp() 63 0.06765 0.07015 0.07276 2.04% Castro::reset_internal_energy(MultiFab) 63 0.04819 0.05019 0.05196 1.46% Castro::reset_internal_energy(Fab) 1008 0.04791 0.04988 0.05164 1.45% Castro::normalize_species() 62 0.04096 0.04247 0.04397 1.23% FabArray::ParallelCopy_nowait() 41 0.03562 0.0419 0.04389 1.23% StateDataPhysBCFunct::() 41 0.03417 0.03796 0.04172 1.17% StateData::FillBoundary(geom) 41 0.03406 0.03786 0.04162 1.17% Castro::construct_new_source() 50 0.02815 0.03204 0.0373 1.05% Castro::finalize_do_advance() 10 0.01171 0.02687 0.03703 1.04% Gravity::interpolate_monopole_grav() 21 0.02772 0.029 0.03132 0.88% Castro::construct_new_gravity_source() 10 0.02205 0.02586 0.03089 0.87% Castro::post_init() 1 0.02867 0.02901 0.02935 0.82% Amr::writePlotFile() 2 0.02757 0.02797 0.02835 0.79% VisMF::Write(FabArray) 2 0.01392 0.01458 0.01784 0.50% Castro::post_timestep() 10 0.01541 0.01609 0.01699 0.48% Castro::apply_source_to_state() 20 0.01076 0.01317 0.01428 0.40% FabArray::Saxpy() 20 0.01072 0.01313 0.01424 0.40% FabArray::setDomainBndry() 41 0.009057 0.01151 0.01321 0.37% Castro::Castro() 1 0.01109 0.01163 0.01248 0.35% Castro::check_for_nan() 20 0.009679 0.01067 0.01215 0.34% MultiFab::contains_nan() 20 0.009656 0.01064 0.01213 0.34% Castro::construct_old_source() 50 0.007193 0.009593 0.01018 0.29% Castro::construct_old_gravity_source() 10 0.007141 0.009526 0.0101 0.28% Castro::computeNewDt() 9 0.008668 0.008687 0.008696 0.24% Castro::initMFs() 1 0.007134 0.007706 0.008653 0.24% AmrLevel::AmrLevel(dm) 1 0.005816 0.006155 0.006678 0.19% StateData::define() 4 0.005804 0.006135 0.006655 0.19% Castro::enforce_min_density() 62 0.005717 0.006 0.006377 0.18% Castro::swap_state_time_levels() 10 0.002806 0.004774 0.005625 0.16% Castro::finalize_advance() 10 0.002918 0.003768 0.00466 0.13% Castro::buildMetrics() 1 0.001757 0.001876 0.002071 0.06% Castro::post_regrid() 1 0.001586 0.001668 0.001971 0.06% Amr::InitAmr() 1 0.0002801 0.0003116 0.0004191 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.135e-05 0.0001259 0.000152 0.00% DistributionMapping::LeastUsedCPUs() 1 6.642e-06 0.0001195 0.0001441 0.00% Castro::enforce_consistent_e() 1 7.942e-05 8.808e-05 9.615e-05 0.00% Amr::writeSmallPlotFile() 1 2.657e-05 5.285e-05 8.347e-05 0.00% FabArrayBase::getCPC() 41 6.649e-05 7.368e-05 8.103e-05 0.00% Castro::enforce_speed_limit() 62 2.75e-05 3.031e-05 3.634e-05 0.00% FabArrayBase::CPC::define() 2 2.032e-05 2.412e-05 2.843e-05 0.00% Gravity::swapTimeLevels() 10 1.032e-05 1.43e-05 1.874e-05 0.00% Gravity::set_mass_offset() 10 8.943e-06 1.111e-05 1.53e-05 0.00% Castro::create_source_corrector() 10 7.075e-06 8.481e-06 1.022e-05 0.00% Amr::initSubcycle() 1 8.501e-06 9.419e-06 9.962e-06 0.00% Castro::retry_advance_ctu() 10 6.942e-06 7.779e-06 9.175e-06 0.00% Castro::FluxRegCrseInit 10 5.709e-06 7.486e-06 8.35e-06 0.00% Castro::FluxRegFineAdd() 10 1.783e-06 2.17e-06 2.635e-06 0.00% DistributionMapping::Distribute() 1 9.46e-07 1.097e-06 1.263e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 32 B 39 B 52 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.07-44-g49dd703558c5) finalized