Initializing AMReX (23.12-24-g75571e2dcbf2)... MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.12-24-g75571e2dcbf2) initialized Starting run at 06:27:45 UTC on 2023-12-25. Successfully read inputs file ... Castro git describe: 23.12-17-g30952554d AMReX git describe: 23.12-24-g75571e2dc Microphysics git describe: 23.12-13-ga38a1eea reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = dustcollapse-3d-monopole_plt00000 Write plotfile time = 0.013445649 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 4.541742215e-05 [Level 0 step 1] Advanced 262144 cells [STEP 1] Coarse TimeStep time: 0.362872153 [STEP 1] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 1 TIME = 4.541742215e-05 DT = 4.541742215e-05 [Level 0 step 2] ADVANCE at time 4.541742215e-05 with dt = 4.768829326e-05 [Level 0 step 2] Advanced 262144 cells [STEP 2] Coarse TimeStep time: 0.353571154 [STEP 2] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 2 TIME = 9.31057154e-05 DT = 4.768829326e-05 [Level 0 step 3] ADVANCE at time 9.31057154e-05 with dt = 5.007270792e-05 [Level 0 step 3] Advanced 262144 cells [STEP 3] Coarse TimeStep time: 0.344602538 [STEP 3] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 3 TIME = 0.0001431784233 DT = 5.007270792e-05 [Level 0 step 4] ADVANCE at time 0.0001431784233 with dt = 5.257634331e-05 [Level 0 step 4] Advanced 262144 cells [STEP 4] Coarse TimeStep time: 0.333317435 [STEP 4] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 4 TIME = 0.0001957547666 DT = 5.257634331e-05 [Level 0 step 5] ADVANCE at time 0.0001957547666 with dt = 5.520516048e-05 [Level 0 step 5] Advanced 262144 cells [STEP 5] Coarse TimeStep time: 0.332571999 [STEP 5] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 5 TIME = 0.0002509599271 DT = 5.520516048e-05 [Level 0 step 6] ADVANCE at time 0.0002509599271 with dt = 5.79654185e-05 [Level 0 step 6] Advanced 262144 cells [STEP 6] Coarse TimeStep time: 0.371506158 [STEP 6] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 6 TIME = 0.0003089253456 DT = 5.79654185e-05 [Level 0 step 7] ADVANCE at time 0.0003089253456 with dt = 6.086368943e-05 [Level 0 step 7] Advanced 262144 cells [STEP 7] Coarse TimeStep time: 0.313238842 [STEP 7] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 7 TIME = 0.000369789035 DT = 6.086368943e-05 [Level 0 step 8] ADVANCE at time 0.000369789035 with dt = 6.39068739e-05 [Level 0 step 8] Advanced 262144 cells [STEP 8] Coarse TimeStep time: 0.307126701 [STEP 8] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 8 TIME = 0.000433695909 DT = 6.39068739e-05 [Level 0 step 9] ADVANCE at time 0.000433695909 with dt = 6.71022176e-05 [Level 0 step 9] Advanced 262144 cells [STEP 9] Coarse TimeStep time: 0.308229448 [STEP 9] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 9 TIME = 0.0005007981265 DT = 6.71022176e-05 [Level 0 step 10] ADVANCE at time 0.0005007981265 with dt = 7.045732848e-05 [Level 0 step 10] Advanced 262144 cells [STEP 10] Coarse TimeStep time: 0.307030968 [STEP 10] FAB kilobyte spread across MPI nodes: [57998 ... 57998] STEP = 10 TIME = 0.000571255455 DT = 7.045732848e-05 PLOTFILE: file = dustcollapse-3d-monopole_plt00010 Write plotfile time = 0.007554165 seconds Ending run at 06:27:48 UTC on 2023-12-25. Run time = 3.530549814 Run time without initialization = 3.347310661 Average number of zones advanced per microsecond: 0.783 Average number of zones advanced per microsecond per rank: 0.098 TinyProfiler total time across processes [min...avg...max]: 3.53 ... 3.53 ... 3.531 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.2987 2.3648 2.3960 67.86% Gravity::make_radial_gravity() 21 0.2851 0.2981 0.3079 8.72% check_for_negative_density() 10 0.03745 0.0699 0.1388 3.93% Castro::initData() 1 0.04865 0.08689 0.1217 3.45% amrex::Copy() 193 0.07924 0.08481 0.09733 2.76% Castro::estTimeStep() 21 0.0234 0.06189 0.09721 2.75% FabArray::setVal() 143 0.06709 0.07779 0.09643 2.73% FabArray::ParallelCopy_finish() 41 0.03798 0.06405 0.08101 2.29% Castro::reset_internal_energy(Fab) 1008 0.04486 0.04721 0.04882 1.38% FabArray::ParallelCopy_nowait() 41 0.0432 0.04469 0.04668 1.32% Castro::normalize_species() 62 0.041 0.04185 0.04322 1.22% FillPatchIterator::Initialize 41 0.02854 0.03556 0.04095 1.16% StateData::FillBoundary(geom) 41 0.02861 0.03227 0.03554 1.01% Gravity::interpolate_monopole_grav() 21 0.02821 0.0293 0.02988 0.85% Castro::construct_new_gravity_source() 10 0.02348 0.02522 0.02728 0.77% Castro::initialize_do_advance() 10 0.0177 0.02048 0.02503 0.71% Castro::computeTemp() 63 0.01848 0.01972 0.0214 0.61% Castro::initialize_advance() 10 0.01048 0.01313 0.01581 0.45% FabArray::Saxpy() 20 0.01296 0.01362 0.01453 0.41% FabArray::setDomainBndry() 41 0.007969 0.01075 0.01289 0.37% MultiFab::contains_nan() 20 0.01006 0.01116 0.01209 0.34% VisMF::Write(FabArray) 2 0.009011 0.009528 0.01207 0.34% Castro::construct_old_gravity_source() 10 0.01002 0.01036 0.01088 0.31% Amr::writePlotFile() 2 0.006183 0.008899 0.009427 0.27% Castro::initMFs() 1 0.006371 0.006828 0.007999 0.23% Castro::construct_new_source() 50 0.006319 0.006564 0.006864 0.19% Castro::enforce_min_density() 62 0.005806 0.006152 0.00669 0.19% StateData::define() 4 0.005234 0.005439 0.005965 0.17% main() 1 0.003811 0.004373 0.004926 0.14% Castro::swap_state_time_levels() 10 0.003305 0.004387 0.004589 0.13% Gravity::get_new_grav_vector() 11 0.002899 0.003492 0.00397 0.11% Amr::coarseTimeStep() 10 0.001198 0.002073 0.003067 0.09% Gravity::get_old_grav_vector() 10 0.001527 0.002088 0.002349 0.07% Castro::buildMetrics() 1 0.001476 0.001552 0.001746 0.05% Castro::finalize_do_advance() 10 0.001107 0.001337 0.001589 0.05% AmrLevel::FillPatch() 41 0.0007603 0.001098 0.001301 0.04% Amr::InitAmr() 1 0.0002584 0.0002893 0.0004028 0.01% Amr::timeStep() 10 0.0001572 0.0002137 0.0003492 0.01% Castro::reset_internal_energy(MultiFab) 63 0.0002746 0.0002862 0.0003259 0.01% Castro::do_advance_ctu() 10 0.0001259 0.0001584 0.0001978 0.01% Castro::clean_state() 62 0.0001437 0.000157 0.0001811 0.01% StateDataPhysBCFunct::() 41 8.203e-05 0.0001105 0.0001562 0.00% FillPatchIterator::FillFromLevel0() 41 0.0001041 0.000129 0.0001487 0.00% DistributionMapping::LeastUsedCPUs() 1 7.597e-06 0.0001186 0.0001458 0.00% Castro::finalize_advance() 10 7.883e-05 9.273e-05 0.0001111 0.00% Castro::Castro() 1 5.597e-05 7.359e-05 0.0001065 0.00% Castro::do_old_sources() 10 7.761e-05 9.275e-05 0.0001046 0.00% FabArray::ParallelCopy() 41 6.551e-05 8.514e-05 0.0001014 0.00% Castro::enforce_consistent_e() 1 7.346e-05 8.492e-05 9.694e-05 0.00% Castro::do_new_sources() 10 5.299e-05 7.317e-05 9.422e-05 0.00% Castro::construct_old_source() 50 6.443e-05 7.625e-05 9.166e-05 0.00% Castro::advance() 10 4.001e-05 5.613e-05 8.903e-05 0.00% Castro::subcycle_advance_ctu() 10 4.54e-05 6.363e-05 8.788e-05 0.00% Amr::FinalizeInit() 1 4.104e-06 1.522e-05 8.663e-05 0.00% FillPatchSingleLevel 41 5.436e-05 7.049e-05 8.595e-05 0.00% FabArrayBase::getCPC() 41 3.948e-05 5.457e-05 7.581e-05 0.00% Amr::writeSmallPlotFile() 1 3.049e-05 5.774e-05 7.147e-05 0.00% Castro::construct_old_gravity() 10 3.077e-05 4.004e-05 5.858e-05 0.00% Castro::apply_source_to_state() 20 3.889e-05 4.735e-05 5.485e-05 0.00% Castro::construct_new_gravity() 10 2.98e-05 3.626e-05 4.838e-05 0.00% Amr::defBaseLevel() 1 2.484e-05 3.051e-05 3.645e-05 0.00% Castro::expand_state() 10 2.248e-05 2.642e-05 3.593e-05 0.00% Castro::enforce_speed_limit() 62 2.399e-05 2.868e-05 3.165e-05 0.00% FabArrayBase::CPC::define() 2 2.134e-05 2.591e-05 3.145e-05 0.00% Castro::check_for_nan() 20 2.329e-05 2.488e-05 2.769e-05 0.00% Castro::post_timestep() 10 1.272e-05 1.696e-05 2.585e-05 0.00% Castro::post_init() 1 1.603e-05 1.724e-05 2.158e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.23e-05 1.517e-05 1.832e-05 0.00% Gravity::swapTimeLevels() 10 9.832e-06 1.198e-05 1.445e-05 0.00% Gravity::set_mass_offset() 10 9.022e-06 1.123e-05 1.407e-05 0.00% Castro::FluxRegCrseInit 10 6.322e-06 8.419e-06 1.168e-05 0.00% Castro::computeNewDt() 9 7.674e-06 8.853e-06 1.13e-05 0.00% Amr::initSubcycle() 1 9.593e-06 1.025e-05 1.117e-05 0.00% Castro::create_source_corrector() 10 7.639e-06 9.537e-06 1.072e-05 0.00% Castro::retry_advance_ctu() 10 7.061e-06 7.789e-06 8.608e-06 0.00% Amr::init() 1 1.901e-06 3.064e-06 8.233e-06 0.00% Amr::initialInit() 1 1.281e-06 2.517e-06 7.723e-06 0.00% Amr::InitializeInit() 1 1.709e-06 2.99e-06 5.962e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 3.643e-06 4.22e-06 5.57e-06 0.00% Castro::post_regrid() 1 1.561e-06 3.321e-06 4.957e-06 0.00% Castro::computeInitialDt() 2 2.9e-06 3.721e-06 4.263e-06 0.00% Castro::FluxRegFineAdd() 10 2.053e-06 2.271e-06 2.449e-06 0.00% DistributionMapping::Distribute() 1 9.15e-07 9.997e-07 1.144e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.53 3.53 3.531 100.00% Amr::coarseTimeStep() 10 3.335 3.335 3.335 94.46% Amr::timeStep() 10 3.321 3.322 3.323 94.12% Castro::advance() 10 3.306 3.306 3.307 93.66% Castro::subcycle_advance_ctu() 10 3.209 3.223 3.23 91.48% Castro::do_advance_ctu() 10 3.209 3.223 3.23 91.48% Castro::construct_ctu_hydro_source() 10 2.452 2.455 2.459 69.64% Gravity::make_radial_gravity() 21 0.3018 0.3152 0.3245 9.19% AmrLevel::FillPatch() 41 0.1949 0.2223 0.2443 6.92% Gravity::get_new_grav_vector() 11 0.2096 0.2111 0.2129 6.03% FillPatchIterator::Initialize 41 0.1635 0.1878 0.2105 5.96% Castro::initialize_do_advance() 10 0.1731 0.1901 0.2011 5.70% Castro::construct_old_gravity() 10 0.1797 0.19 0.1973 5.59% Gravity::get_old_grav_vector() 10 0.1786 0.1892 0.1966 5.57% Castro::construct_new_gravity() 10 0.1867 0.1878 0.1892 5.36% Amr::init() 1 0.1827 0.1828 0.1828 5.18% Amr::initialInit() 1 0.1687 0.169 0.1691 4.79% FillPatchIterator::FillFromLevel0() 41 0.1205 0.1415 0.162 4.59% FillPatchSingleLevel 41 0.1204 0.1414 0.1619 4.58% Castro::expand_state() 10 0.1132 0.1323 0.1463 4.14% Amr::InitializeInit() 1 0.06834 0.1072 0.1421 4.02% Amr::defBaseLevel() 1 0.06833 0.1072 0.1421 4.02% check_for_negative_density() 10 0.03745 0.0699 0.1388 3.93% FabArray::ParallelCopy() 41 0.08483 0.1089 0.1261 3.57% Castro::initData() 1 0.05256 0.09075 0.1256 3.56% Castro::clean_state() 62 0.1107 0.1145 0.1173 3.32% Castro::do_old_sources() 10 0.09606 0.1004 0.1039 2.94% Amr::FinalizeInit() 1 0.02698 0.06181 0.1007 2.85% amrex::Copy() 193 0.07924 0.08481 0.09733 2.76% Castro::estTimeStep() 21 0.0234 0.06189 0.09721 2.75% FabArray::setVal() 143 0.06709 0.07779 0.09643 2.73% Castro::initialize_advance() 10 0.07307 0.07966 0.09416 2.67% FabArray::ParallelCopy_finish() 41 0.03798 0.06405 0.08101 2.29% Castro::computeInitialDt() 2 0.002157 0.03702 0.07574 2.15% Castro::do_new_sources() 10 0.06144 0.06569 0.06966 1.97% Castro::computeTemp() 63 0.06375 0.06722 0.06949 1.97% Castro::reset_internal_energy(MultiFab) 63 0.04513 0.0475 0.04915 1.39% Castro::reset_internal_energy(Fab) 1008 0.04486 0.04721 0.04882 1.38% FabArray::ParallelCopy_nowait() 41 0.04329 0.04477 0.04675 1.32% Castro::normalize_species() 62 0.041 0.04185 0.04322 1.22% StateDataPhysBCFunct::() 41 0.02872 0.03238 0.03565 1.01% StateData::FillBoundary(geom) 41 0.02861 0.03227 0.03554 1.01% Castro::construct_new_source() 50 0.02982 0.03179 0.03395 0.96% Gravity::interpolate_monopole_grav() 21 0.02821 0.0293 0.02988 0.85% Castro::construct_new_gravity_source() 10 0.02348 0.02522 0.02728 0.77% Castro::post_init() 1 0.02415 0.02436 0.02449 0.69% Amr::writePlotFile() 2 0.02125 0.02145 0.02169 0.61% Castro::finalize_do_advance() 10 0.0123 0.01679 0.02142 0.61% Castro::post_timestep() 10 0.015 0.01568 0.01652 0.47% Castro::apply_source_to_state() 20 0.01299 0.01367 0.01458 0.41% FabArray::Saxpy() 20 0.01296 0.01362 0.01453 0.41% FabArray::setDomainBndry() 41 0.007969 0.01075 0.01289 0.37% Castro::check_for_nan() 20 0.01008 0.01118 0.01212 0.34% MultiFab::contains_nan() 20 0.01006 0.01116 0.01209 0.34% VisMF::Write(FabArray) 2 0.009011 0.009528 0.01207 0.34% Castro::Castro() 1 0.01039 0.01081 0.01165 0.33% Castro::construct_old_source() 50 0.01009 0.01043 0.01097 0.31% Castro::construct_old_gravity_source() 10 0.01002 0.01036 0.01088 0.31% Castro::computeNewDt() 9 0.009425 0.009433 0.009438 0.27% Castro::initMFs() 1 0.006371 0.006828 0.007999 0.23% Castro::enforce_min_density() 62 0.005806 0.006152 0.00669 0.19% AmrLevel::AmrLevel(dm) 1 0.005249 0.005454 0.00598 0.17% StateData::define() 4 0.005234 0.005439 0.005965 0.17% Castro::swap_state_time_levels() 10 0.003305 0.004387 0.004589 0.13% Castro::finalize_advance() 10 0.003102 0.003341 0.00361 0.10% Castro::buildMetrics() 1 0.001596 0.001682 0.001896 0.05% Castro::post_regrid() 1 0.001479 0.001549 0.001646 0.05% Amr::InitAmr() 1 0.0002682 0.0002996 0.0004126 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.235e-05 0.0001238 0.0001518 0.00% DistributionMapping::LeastUsedCPUs() 1 7.597e-06 0.0001186 0.0001458 0.00% FabArrayBase::getCPC() 41 6.082e-05 8.048e-05 9.931e-05 0.00% Castro::enforce_consistent_e() 1 7.346e-05 8.492e-05 9.694e-05 0.00% Amr::writeSmallPlotFile() 1 3.049e-05 5.774e-05 7.147e-05 0.00% Castro::enforce_speed_limit() 62 2.399e-05 2.868e-05 3.165e-05 0.00% FabArrayBase::CPC::define() 2 2.134e-05 2.591e-05 3.145e-05 0.00% Gravity::swapTimeLevels() 10 9.832e-06 1.198e-05 1.445e-05 0.00% Gravity::set_mass_offset() 10 9.022e-06 1.123e-05 1.407e-05 0.00% Castro::FluxRegCrseInit 10 6.322e-06 8.419e-06 1.168e-05 0.00% Amr::initSubcycle() 1 9.593e-06 1.025e-05 1.117e-05 0.00% Castro::create_source_corrector() 10 7.639e-06 9.537e-06 1.072e-05 0.00% Castro::retry_advance_ctu() 10 7.061e-06 7.789e-06 8.608e-06 0.00% Castro::FluxRegFineAdd() 10 2.053e-06 2.271e-06 2.449e-06 0.00% DistributionMapping::Distribute() 1 9.15e-07 9.997e-07 1.144e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 4) :: [2, 2, 2, 2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 28 B 31 B 36 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.12-24-g75571e2dcbf2) finalized