Initializing CUDA... CUDA initialized with 1 GPU AMReX (22.02-7-g9558c8a1684c) initialized Starting run at 09:13:48 UTC on 2022-02-09. Successfully read inputs file ... Castro git describe: 22.02-4-g0d942c92d AMReX git describe: 22.02-7-g9558c8a16 Microphysics git describe: 22.02 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003505882 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.003542796 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Gravity::fill_multipole_BCs() time = 0.012110563 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.208783933 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 ...estimated hydro-limited timestep at level 1: 0.02713036318 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02713036318 [Level 0 step 1] ADVANCE with dt = 0.002713036318  Beginning subcycle 1 starting at time 0 with dt = 0.002713036318 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008081074 Gravity::solve_for_phi() time = 0.049047803 Castro::do_old_sources() time = 0.00506722 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.30844263 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007928235 Gravity::solve_for_phi() time = 0.045186862 Castro::do_new_sources() time = 0.010199673 ...estimated hydro-limited timestep at level 0: 0.05551272919 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272919  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.681717879 [Level 0 step 1] Advanced 884736 cells [Level 1 step 1] ADVANCE with dt = 0.002713036318  Beginning subcycle 1 starting at time 0 with dt = 0.002713036318 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003787893 Castro::do_old_sources() time = 0.002376041 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.033823053 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029390454 Castro::do_new_sources() time = 0.003696023 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.881056308 [Level 1 step 1] Advanced 393216 cells Castro::do_new_sources() time = 0.004213586 Castro::do_new_sources() time = 0.006308177 Castro::reflux() at level 0 : time = 0.02649198 Updating the rotational period from 30.54368673 s to 30.52206572 s. [STEP 1] Coarse TimeStep time: 0.688989817 [STEP 1] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 1 TIME = 0.002713036318 DT = 0.002713036318 ...estimated hydro-limited timestep at level 0: 0.05551272816 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272816 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05551272816 ... but limiting to: 0.00298433995 = 1.1 * 0.002713036318 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02775634251 ... but limiting to: 0.00298433995 = 1.1 * 0.002713036318 Now regridding at level lbase = 0 grid_places() time: 0.00295811 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.014154405 STEP = 1 TIME = 0.002713036318 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05551272816 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272816 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251 [Level 0 step 2] ADVANCE with dt = 0.00298433995  Beginning subcycle 1 starting at time 0.002713036318 with dt = 0.00298433995 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008073558 Gravity::solve_for_phi() time = 0.050209479 Castro::do_old_sources() time = 0.00433739 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10799284 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008160852 Gravity::solve_for_phi() time = 0.045914161 Castro::do_new_sources() time = 0.006483527 ...estimated hydro-limited timestep at level 0: 0.05665145362 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.498832281 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE with dt = 0.00298433995  Beginning subcycle 1 starting at time 0.002713036318 with dt = 0.00298433995 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003547014 Castro::do_old_sources() time = 0.002339075 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.030609685 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029170237 Castro::do_new_sources() time = 0.00394565 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.760452045 [Level 1 step 2] Advanced 393216 cells Castro::do_new_sources() time = 0.003395713 Castro::do_new_sources() time = 0.005938951 Castro::reflux() at level 0 : time = 0.024640958 Updating the rotational period from 30.52206572 s to 30.52210616 s. [STEP 2] Coarse TimeStep time: 0.465114843 [STEP 2] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 2 TIME = 0.005697376269 DT = 0.00298433995 ...estimated hydro-limited timestep at level 0: 0.05665145259 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145259 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05665145259 ... but limiting to: 0.003282773945 = 1.1 * 0.00298433995 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02832568214 ... but limiting to: 0.003282773945 = 1.1 * 0.00298433995 Now regridding at level lbase = 0 grid_places() time: 0.001925257 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.011022861 STEP = 2 TIME = 0.005697376269 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05665145259 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145259 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214 [Level 0 step 3] ADVANCE with dt = 0.003282773945  Beginning subcycle 1 starting at time 0.005697376269 with dt = 0.003282773945 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008008394 Gravity::solve_for_phi() time = 0.050371094 Castro::do_old_sources() time = 0.004421799 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.134058139 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008075071 Gravity::solve_for_phi() time = 0.046512427 Castro::do_new_sources() time = 0.006562996 ...estimated hydro-limited timestep at level 0: 0.05769010785 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010785  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.131166888 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE with dt = 0.003282773945  Beginning subcycle 1 starting at time 0.005697376269 with dt = 0.003282773945 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003522302 Castro::do_old_sources() time = 0.00231829 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.036123047 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029374954 Castro::do_new_sources() time = 0.003120793 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.508212805 [Level 1 step 3] Advanced 393216 cells Castro::do_new_sources() time = 0.003834818 Castro::do_new_sources() time = 0.006062177 Castro::reflux() at level 0 : time = 0.025666264 Updating the rotational period from 30.52210616 s to 30.52203124 s. [STEP 3] Coarse TimeStep time: 0.496020191 [STEP 3] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 3 TIME = 0.008980150214 DT = 0.003282773945 ...estimated hydro-limited timestep at level 0: 0.05769010675 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010675 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05769010675 ... but limiting to: 0.00361105134 = 1.1 * 0.003282773945 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02884498561 ... but limiting to: 0.00361105134 = 1.1 * 0.003282773945 Now regridding at level lbase = 0 grid_places() time: 0.004177039 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.01087427 STEP = 3 TIME = 0.008980150214 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05769010675 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010675 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561 [Level 0 step 4] ADVANCE with dt = 0.00361105134  Beginning subcycle 1 starting at time 0.008980150214 with dt = 0.00361105134 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008048353 Gravity::solve_for_phi() time = 0.050489692 Castro::do_old_sources() time = 0.004229845 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109893623 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007961858 Gravity::solve_for_phi() time = 0.046661576 Castro::do_new_sources() time = 0.006618995 ...estimated hydro-limited timestep at level 0: 0.05863574591 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574591  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.462139157 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE with dt = 0.00361105134  Beginning subcycle 1 starting at time 0.008980150214 with dt = 0.00361105134 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003610269 Castro::do_old_sources() time = 0.002309821 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.035012655 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029262427 Castro::do_new_sources() time = 0.003576551 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.540838043 [Level 1 step 4] Advanced 393216 cells Castro::do_new_sources() time = 0.003856154 Castro::do_new_sources() time = 0.005945229 Castro::reflux() at level 0 : time = 0.025112543 Updating the rotational period from 30.52203124 s to 30.52194705 s. [STEP 4] Coarse TimeStep time: 0.480846786 [STEP 4] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 4 TIME = 0.01259120155 DT = 0.00361105134 ...estimated hydro-limited timestep at level 0: 0.05863574483 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574483 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05863574483 ... but limiting to: 0.003972156474 = 1.1 * 0.00361105134 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02931778012 ... but limiting to: 0.003972156474 = 1.1 * 0.00361105134 Now regridding at level lbase = 0 grid_places() time: 0.004429471 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.016030391 STEP = 4 TIME = 0.01259120155 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05863574483 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574483 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012 [Level 0 step 5] ADVANCE with dt = 0.003972156474  Beginning subcycle 1 starting at time 0.01259120155 with dt = 0.003972156474 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008087862 Gravity::solve_for_phi() time = 0.050770383 Castro::do_old_sources() time = 0.004308432 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.135807481 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008056899 Gravity::solve_for_phi() time = 0.046787389 Castro::do_new_sources() time = 0.006572002 ...estimated hydro-limited timestep at level 0: 0.0594445305 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0594445305  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.178935539 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE with dt = 0.003972156474  Beginning subcycle 1 starting at time 0.01259120155 with dt = 0.003972156474 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003580273 Castro::do_old_sources() time = 0.002273258 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.0511343 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029632411 Castro::do_new_sources() time = 0.004848566 ...estimated hydro-limited timestep at level 1: 0.02974830524 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02974830524  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.67149337 [Level 1 step 5] Advanced 393216 cells Castro::do_new_sources() time = 0.005420209 Castro::do_new_sources() time = 0.009088572 Castro::reflux() at level 0 : time = 0.037919757 Updating the rotational period from 30.52194705 s to 30.52185024 s. [STEP 5] Coarse TimeStep time: 0.540531741 [STEP 5] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 5 TIME = 0.01656335803 DT = 0.003972156474 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.206767412 seconds Ending run at 09:13:53 UTC on 2022-02-09. Run time = 4.837191724 Run time without initialization = 2.87902875 Average number of zones advanced per microsecond: 2.219 Average number of zones advanced per microsecond per rank: 2.219 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9489481728 TinyProfiler total time across processes [min...avg...max]: 4.837 ... 4.837 ... 4.837 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.3746 1.3746 1.3746 28.42% Castro::construct_ctu_hydro_source() 10 0.9829 0.9829 0.9829 20.32% VisMF::Write(FabArray) 4 0.4087 0.4087 0.4087 8.45% MLCellLinOp::applyBC() 6611 0.1736 0.1736 0.1736 3.59% MLPoisson::Fsmooth() 4616 0.1613 0.1613 0.1613 3.34% FabArray::setVal() 2104 0.1601 0.1601 0.1601 3.31% Amr::defBaseLevel() 1 0.1533 0.1533 0.1533 3.17% Gravity::fill_multipole_BCs() 15 0.1439 0.1439 0.1439 2.98% FabArray::ParallelCopy_nowait() 2596 0.1026 0.1026 0.1026 2.12% Castro::computeTemp() 122 0.09113 0.09113 0.09113 1.88% FillBoundary_nowait() 6022 0.08207 0.08207 0.08207 1.70% Castro::derive() 607 0.07443 0.07443 0.07443 1.54% Castro::normalize_species() 119 0.0693 0.0693 0.0693 1.43% MLCellLinOp::reflux() 34 0.04075 0.04075 0.04075 0.84% Castro::reset_internal_energy() 122 0.03925 0.03925 0.03925 0.81% MultiFab::Dot() 2078 0.03921 0.03921 0.03921 0.81% MLCGSolver::bicgstab 117 0.03804 0.03804 0.03804 0.79% MLCellLinOp::defineAuxData() 25 0.03775 0.03775 0.03775 0.78% StateDataPhysBCFunct::() 798 0.03173 0.03173 0.03173 0.66% Castro::expand_state() 10 0.02841 0.02841 0.02841 0.59% FluxRegister::Reflux() 30 0.02757 0.02757 0.02757 0.57% Castro::construct_new_source() 140 0.02699 0.02699 0.02699 0.56% MultiFab::Saxpy() 90 0.02682 0.02682 0.02682 0.55% StateData::FillBoundary(geom) 546 0.02475 0.02475 0.02475 0.51% Castro::estTimeStep() 29 0.0239 0.0239 0.0239 0.49% MultiFab::LinComb() 2972 0.02352 0.02352 0.02352 0.49% MLPoisson::Fapply() 1931 0.02319 0.02319 0.02319 0.48% FabArray::setDomainBndry() 798 0.02293 0.02293 0.02293 0.47% BndryData::define() 35 0.02284 0.02284 0.02284 0.47% MultiFab::Multiply() 408 0.02098 0.02098 0.02098 0.43% Castro::enforce_min_density() 119 0.01996 0.01996 0.01996 0.41% Castro::reflux() 5 0.01977 0.01977 0.01977 0.41% amrex::average_down 644 0.01904 0.01904 0.01904 0.39% MultiFab::Xpay() 892 0.01788 0.01788 0.01788 0.37% MLMG::addInterpCorrection() 555 0.01532 0.01532 0.01532 0.32% Castro::construct_new_gravity_source() 20 0.01266 0.01266 0.01266 0.26% AmrMesh::MakeNewGrids() 6 0.01207 0.01207 0.01207 0.25% Castro::construct_old_gravity_source() 20 0.01086 0.01086 0.01086 0.22% Castro::volWgtSum() 156 0.01086 0.01086 0.01086 0.22% MLPoisson::FFlux() 1326 0.01033 0.01033 0.01033 0.21% Castro::finalize_advance() 10 0.01002 0.01002 0.01002 0.21% Castro::do_advance_ctu() 10 0.009472 0.009472 0.009472 0.20% FabArray::setVal(val, thecmd, scomp, ncomp) 1095 0.00896 0.00896 0.00896 0.19% MLCellLinOp::setLevelBC() 30 0.008114 0.008114 0.008114 0.17% FabArrayBase::CPC::define() 1033 0.007881 0.007881 0.007881 0.16% MLCellLinOp::compGrad() 30 0.007865 0.007865 0.007865 0.16% MLMG::oneIter() 117 0.007157 0.007157 0.007157 0.15% Castro::volInBoundary() 42 0.007099 0.007099 0.007099 0.15% Amr::writePlotFile() 2 0.007018 0.007018 0.007018 0.15% FillPatchIterator::Initialize 765 0.0068 0.0068 0.0068 0.14% Gravity::actual_solve_with_mlmg() 25 0.006395 0.006395 0.006395 0.13% Castro::initData() 3 0.005921 0.005921 0.005921 0.12% MLCellLinOp::updateSolBC() 27 0.005661 0.005661 0.005661 0.12% MLCellLinOp::defineBC() 25 0.004771 0.004771 0.004771 0.10% MLCellLinOp::updateCorBC() 22 0.004667 0.004667 0.004667 0.10% MLMG::ResNormInf() 154 0.004514 0.004514 0.004514 0.09% FillPatchInterp(Fab) 33 0.004431 0.004431 0.004431 0.09% Castro::problem_post_timestep() 11 0.004166 0.004166 0.004166 0.09% Amr::regrid() 5 0.00416 0.00416 0.00416 0.09% Castro::construct_old_source() 70 0.004135 0.004135 0.004135 0.09% Gravity::get_new_grav_vector() 12 0.004068 0.004068 0.004068 0.08% MLCellLinOp::prepareForSolve() 25 0.003781 0.003781 0.003781 0.08% CellConservativeLinear::interp() 198 0.003669 0.003669 0.003669 0.08% FabArray::mult() 72 0.003584 0.003584 0.003584 0.07% Castro::fill_hybrid_hydro_source() 50 0.00357 0.00357 0.00357 0.07% Gravity::get_old_grav_vector() 10 0.0033 0.0033 0.0033 0.07% MLMG::prepareForSolve() 25 0.003162 0.003162 0.003162 0.07% Castro::wd_update() 6 0.002888 0.002888 0.002888 0.06% FabArrayBase::getCPC() 2980 0.002534 0.002534 0.002534 0.05% Castro::construct_old_gravity() 10 0.002523 0.002523 0.002523 0.05% Castro::init(old) 4 0.002497 0.002497 0.002497 0.05% Castro::locWgtSum() 36 0.00246 0.00246 0.00246 0.05% Castro::FluxRegFineAdd() 10 0.002009 0.002009 0.002009 0.04% MLCellLinOp::smooth() 2308 0.001889 0.001889 0.001889 0.04% Castro::construct_new_gravity() 10 0.00185 0.00185 0.00185 0.04% MultiFab::max() 56 0.001755 0.001755 0.001755 0.04% Gravity::solve_for_phi() 20 0.001552 0.001552 0.001552 0.03% FabArray::FillBoundary() 6022 0.001536 0.001536 0.001536 0.03% FabArrayBase::getFB() 6022 0.00134 0.00134 0.00134 0.03% MultiFab::Subtract() 25 0.001231 0.001231 0.001231 0.03% Gravity::create_comp_minus_level_grad_phi() 5 0.001227 0.001227 0.001227 0.03% MultiFab::Copy() 30 0.001177 0.001177 0.001177 0.02% FabArrayBase::FB::FB() 98 0.001152 0.001152 0.001152 0.02% MLMG::interpCorrection_1 22 0.001142 0.001142 0.001142 0.02% Castro::build_fine_mask() 166 0.001134 0.001134 0.001134 0.02% TagBoxArray::mapPRD 6 0.001108 0.001108 0.001108 0.02% Gravity::update_max_rhs() 10 0.001106 0.001106 0.001106 0.02% FabArray::ParallelCopy() 2596 0.001027 0.001027 0.001027 0.02% MLCellLinOp::apply() 1931 0.001016 0.001016 0.001016 0.02% Castro::volProductSum() 12 0.0009541 0.0009541 0.0009541 0.02% Gravity::average_fine_ec_onto_crse_ec() 5 0.0009521 0.0009521 0.0009521 0.02% Amr::bldFineLevels() 1 0.0009481 0.0009481 0.0009481 0.02% FillPatchTwoLevels 387 0.0009249 0.0009249 0.0009249 0.02% CGSolver::sxay() 2962 0.0008943 0.0008943 0.0008943 0.02% OwnerMask() 6 0.000892 0.000892 0.000892 0.02% MultiFab::norm0(mask) 17 0.0007758 0.0007758 0.0007758 0.02% TagBoxArray::collate() 6 0.000773 0.000773 0.000773 0.02% main() 1 0.0007353 0.0007353 0.0007353 0.02% MLMG::MLRhsNormInf() 25 0.0006885 0.0006885 0.0006885 0.01% MLCGSolver::ParallelAllReduce 2754 0.0006555 0.0006555 0.0006555 0.01% Castro::clean_state() 119 0.0006155 0.0006155 0.0006155 0.01% MLMG::mgVcycle() 161 0.0006096 0.0006096 0.0006096 0.01% Gravity::actual_multilevel_solve() 5 0.000525 0.000525 0.000525 0.01% Castro::apply_problem_tags() 6 0.0004975 0.0004975 0.0004975 0.01% MLMG::computeResWithCrseSolFineCor() 22 0.000472 0.000472 0.000472 0.01% MLMG::computeResWithCrseCorFineCor() 22 0.0004714 0.0004714 0.0004714 0.01% Castro::apply_tagging_restrictions() 6 0.0004579 0.0004579 0.0004579 0.01% MultiFab::min() 10 0.0004521 0.0004521 0.0004521 0.01% MLCellLinOp::correctionResidual() 716 0.000418 0.000418 0.000418 0.01% Castro::subcycle_advance_ctu() 10 0.0004058 0.0004058 0.0004058 0.01% MLLinOp::defineGrids() 25 0.0003777 0.0003777 0.0003777 0.01% StateData::define() 35 0.0003521 0.0003521 0.0003521 0.01% FillPatchSingleLevel 798 0.0003521 0.0003521 0.0003521 0.01% Castro::construct_new_rotation_source() 20 0.0003278 0.0003278 0.0003278 0.01% Gravity::multilevel_solve_for_new_phi() 5 0.00031 0.00031 0.00031 0.01% Castro::swap_state_time_levels() 10 0.0002625 0.0002625 0.0002625 0.01% Castro::initialize_advance() 10 0.0002396 0.0002396 0.0002396 0.00% MLMG:computeResOfCorrection() 555 0.0002287 0.0002287 0.0002287 0.00% Castro::enforce_consistent_e() 3 0.0002139 0.0002139 0.0002139 0.00% Castro::linear_to_hybrid_momentum() 3 0.000211 0.000211 0.000211 0.00% Gravity::solve_phi_with_mlmg() 25 0.0002078 0.0002078 0.0002078 0.00% Castro::construct_old_rotation_source() 10 0.0001931 0.0001931 0.0001931 0.00% Gravity::GetCrsePhi() 10 0.0001862 0.0001862 0.0001862 0.00% MLMG::actualBottomSolve() 117 0.0001833 0.0001833 0.0001833 0.00% AMRErrorTag::operator() 6 0.0001794 0.0001794 0.0001794 0.00% Castro::initialize_do_advance() 10 0.0001645 0.0001645 0.0001645 0.00% Castro::create_source_corrector() 10 0.0001539 0.0001539 0.0001539 0.00% MLMG::mgVcycle_down::0 117 0.0001451 0.0001451 0.0001451 0.00% MLMG::solve() 25 0.000127 0.000127 0.000127 0.00% MLMG::mgVcycle_down::1 117 0.0001238 0.0001238 0.0001238 0.00% MLMG::mgVcycle_down::2 117 0.0001198 0.0001198 0.0001198 0.00% MLCellLinOp::solutionResidual() 176 0.0001196 0.0001196 0.0001196 0.00% MLMG::mgVcycle_down::3 117 0.0001171 0.0001171 0.0001171 0.00% Castro::do_new_sources() 20 0.0001136 0.0001136 0.0001136 0.00% Castro::post_regrid() 12 0.0001121 0.0001121 0.0001121 0.00% Amr::grid_places() 6 0.0001058 0.0001058 0.0001058 0.00% Castro::advance() 10 0.0001057 0.0001057 0.0001057 0.00% Amr::coarseTimeStep() 5 0.0001014 0.0001014 0.0001014 0.00% MLMG::mgVcycle_bottom 161 9.323e-05 9.323e-05 9.323e-05 0.00% MLMG::mgVcycle_up::0 117 8.615e-05 8.615e-05 8.615e-05 0.00% MLMG::mgVcycle_down::4 87 8.483e-05 8.483e-05 8.483e-05 0.00% MLMG::buildFineMask() 25 7.971e-05 7.971e-05 7.971e-05 0.00% AmrLevel::AmrLevel(dm) 7 7.643e-05 7.643e-05 7.643e-05 0.00% MLMG::mgVcycle_up::3 117 7.57e-05 7.57e-05 7.57e-05 0.00% MLMG::mgVcycle_up::1 117 7.393e-05 7.393e-05 7.393e-05 0.00% MLMG::mgVcycle_up::2 117 7.013e-05 7.013e-05 7.013e-05 0.00% MLMG::mgVcycle_up::4 87 6.968e-05 6.968e-05 6.968e-05 0.00% Amr::timeStep() 10 6.901e-05 6.901e-05 6.901e-05 0.00% Castro::finalize_do_advance() 10 6.551e-05 6.551e-05 6.551e-05 0.00% Castro::do_old_sources() 10 6.292e-05 6.292e-05 6.292e-05 0.00% makeSFC 115 5.9e-05 5.9e-05 5.9e-05 0.00% MLMG::computeResidual() 117 5.619e-05 5.619e-05 5.619e-05 0.00% Castro::enforce_speed_limit() 119 5.447e-05 5.447e-05 5.447e-05 0.00% MLPoisson::define() 25 4.67e-05 4.67e-05 4.67e-05 0.00% Castro::errorEst() 6 4.535e-05 4.535e-05 4.535e-05 0.00% DistributionMapping::Distribute() 117 3.997e-05 3.997e-05 3.997e-05 0.00% MLLinOp::define() 25 3.671e-05 3.671e-05 3.671e-05 0.00% Castro::post_init() 2 3.625e-05 3.625e-05 3.625e-05 0.00% Amr::writeSmallPlotFile() 1 3.504e-05 3.504e-05 3.504e-05 0.00% Castro::computeNewDt() 8 3.072e-05 3.072e-05 3.072e-05 0.00% MLLinOp::makeAgglomeratedDMap 25 2.919e-05 2.919e-05 2.919e-05 0.00% FabArrayBase::TheFPinfo() 33 2.751e-05 2.751e-05 2.751e-05 0.00% FPinfo::FPinfo() 3 2.479e-05 2.479e-05 2.479e-05 0.00% FabArray::RecvLayoutMask() 5 2.356e-05 2.356e-05 2.356e-05 0.00% MLPoisson::prepareForSolve() 25 2.331e-05 2.331e-05 2.331e-05 0.00% Castro::computeInitialDt() 2 2.222e-05 2.222e-05 2.222e-05 0.00% MLMG::computeMLResidual() 32 2.207e-05 2.207e-05 2.207e-05 0.00% Castro::apply_source_to_state() 40 1.954e-05 1.954e-05 1.954e-05 0.00% MLMG::miniCycle() 44 1.913e-05 1.913e-05 1.913e-05 0.00% ClusterList::intersect() 6 1.85e-05 1.85e-05 1.85e-05 0.00% Amr::FinalizeInit() 1 1.76e-05 1.76e-05 1.76e-05 0.00% MLMG::MLResNormInf() 32 1.591e-05 1.591e-05 1.591e-05 0.00% Castro::construct_new_hybrid_source() 20 1.546e-05 1.546e-05 1.546e-05 0.00% MLMG::getGradSolution() 25 1.419e-05 1.419e-05 1.419e-05 0.00% Amr::initSubcycle() 1 1.332e-05 1.332e-05 1.332e-05 0.00% Castro::react_state() 20 1.33e-05 1.33e-05 1.33e-05 0.00% Castro::avgDown(state_indx) 30 1.276e-05 1.276e-05 1.276e-05 0.00% amrex::average_down_w_geom 30 1.171e-05 1.171e-05 1.171e-05 0.00% Castro::post_timestep() 10 1.167e-05 1.167e-05 1.167e-05 0.00% AmrMesh-cluster 6 1.146e-05 1.146e-05 1.146e-05 0.00% Gravity::swapTimeLevels() 10 1.105e-05 1.105e-05 1.105e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 7.347e-06 7.347e-06 7.347e-06 0.00% Amr::InitializeInit() 1 6.718e-06 6.718e-06 6.718e-06 0.00% Castro::construct_old_hybrid_source() 10 6.035e-06 6.035e-06 6.035e-06 0.00% Castro::avgDown() 6 5.318e-06 5.318e-06 5.318e-06 0.00% Castro::retry_advance_ctu() 10 5.072e-06 5.072e-06 5.072e-06 0.00% MLLinOp::makeSubCommunicator() 25 4.883e-06 4.883e-06 4.883e-06 0.00% BoxList::complementIn 12 4.848e-06 4.848e-06 4.848e-06 0.00% BoxList::parallelComplementIn() 12 4.535e-06 4.535e-06 4.535e-06 0.00% Gravity::set_mass_offset() 6 2.785e-06 2.785e-06 2.785e-06 0.00% Amr::init() 1 1.828e-06 1.828e-06 1.828e-06 0.00% ClusterList::chop() 6 1.756e-06 1.756e-06 1.756e-06 0.00% Amr::initialInit() 1 1.12e-06 1.12e-06 1.12e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 4.837 4.837 4.837 100.00% Amr::coarseTimeStep() 5 2.672 2.672 2.672 55.23% Amr::timeStep() 10 2.662 2.662 2.662 55.03% Castro::advance() 10 2.06 2.06 2.06 42.59% Castro::subcycle_advance_ctu() 10 1.974 1.974 1.974 40.80% Castro::do_advance_ctu() 10 1.973 1.973 1.973 40.79% Amr::InitAmr() 1 1.375 1.375 1.375 28.42% Gravity::solve_phi_with_mlmg() 25 0.9854 0.9854 0.9854 20.37% Castro::construct_ctu_hydro_source() 10 0.9829 0.9829 0.9829 20.32% Gravity::actual_solve_with_mlmg() 25 0.8376 0.8376 0.8376 17.32% MLMG::solve() 25 0.7334 0.7334 0.7334 15.16% MLMG::oneIter() 117 0.6534 0.6534 0.6534 13.51% Gravity::solve_for_phi() 20 0.6471 0.6471 0.6471 13.38% MLMG::mgVcycle() 161 0.5901 0.5901 0.5901 12.20% Amr::init() 1 0.5835 0.5835 0.5835 12.06% Amr::writePlotFile() 2 0.4157 0.4157 0.4157 8.59% VisMF::Write(FabArray) 4 0.4087 0.4087 0.4087 8.45% Castro::construct_new_gravity() 10 0.4048 0.4048 0.4048 8.37% Amr::initialInit() 1 0.3746 0.3746 0.3746 7.74% MLCellLinOp::smooth() 2308 0.3492 0.3492 0.3492 7.22% Gravity::multilevel_solve_for_new_phi() 5 0.3438 0.3438 0.3438 7.11% Gravity::actual_multilevel_solve() 5 0.3435 0.3435 0.3435 7.10% Amr::regrid() 5 0.3122 0.3122 0.3122 6.45% Castro::post_timestep() 10 0.3047 0.3047 0.3047 6.30% Castro::construct_old_gravity() 10 0.2991 0.2991 0.2991 6.18% Castro::post_regrid() 12 0.2676 0.2676 0.2676 5.53% MLCellLinOp::applyBC() 6611 0.2587 0.2587 0.2587 5.35% Castro::clean_state() 119 0.2173 0.2173 0.2173 4.49% Amr::InitializeInit() 1 0.1888 0.1888 0.1888 3.90% Amr::defBaseLevel() 1 0.1888 0.1888 0.1888 3.90% Amr::FinalizeInit() 1 0.1857 0.1857 0.1857 3.84% Castro::problem_post_timestep() 11 0.1846 0.1846 0.1846 3.82% FillPatchIterator::Initialize 765 0.1672 0.1672 0.1672 3.46% MLPoisson::Fsmooth() 4616 0.1613 0.1613 0.1613 3.34% MLMG::mgVcycle_bottom 161 0.1608 0.1608 0.1608 3.32% FabArray::setVal() 2104 0.1601 0.1601 0.1601 3.31% Gravity::fill_multipole_BCs() 15 0.1449 0.1449 0.1449 2.99% Castro::post_init() 2 0.1423 0.1423 0.1423 2.94% MLMG::actualBottomSolve() 117 0.1416 0.1416 0.1416 2.93% MLCGSolver::bicgstab 117 0.1405 0.1405 0.1405 2.90% Castro::reflux() 5 0.1399 0.1399 0.1399 2.89% Castro::computeTemp() 122 0.1304 0.1304 0.1304 2.70% Castro::derive() 607 0.129 0.129 0.129 2.67% FillPatchSingleLevel 798 0.1249 0.1249 0.1249 2.58% MLMG::mgVcycle_down::0 117 0.1141 0.1141 0.1141 2.36% FabArray::ParallelCopy() 2596 0.1112 0.1112 0.1112 2.30% FabArray::ParallelCopy_nowait() 2596 0.1102 0.1102 0.1102 2.28% Castro::do_new_sources() 20 0.1098 0.1098 0.1098 2.27% Castro::initialize_do_advance() 10 0.103 0.103 0.103 2.13% MLMG::mgVcycle_up::0 117 0.09906 0.09906 0.09906 2.05% MLCellLinOp::apply() 1931 0.09225 0.09225 0.09225 1.91% FabArray::FillBoundary() 6022 0.0861 0.0861 0.0861 1.78% FillBoundary_nowait() 6022 0.08457 0.08457 0.08457 1.75% Castro::expand_state() 10 0.07831 0.07831 0.07831 1.62% MLPoisson::define() 25 0.07801 0.07801 0.07801 1.61% Castro::initialize_advance() 10 0.07285 0.07285 0.07285 1.51% Castro::normalize_species() 119 0.0693 0.0693 0.0693 1.43% Castro::wd_update() 6 0.0687 0.0687 0.0687 1.42% Castro::construct_new_source() 140 0.05893 0.05893 0.05893 1.22% MLCellLinOp::correctionResidual() 716 0.0573 0.0573 0.0573 1.18% StateDataPhysBCFunct::() 798 0.05648 0.05648 0.05648 1.17% MLCellLinOp::reflux() 34 0.05625 0.05625 0.05625 1.16% Castro::volWgtSum() 156 0.053 0.053 0.053 1.10% Castro::volInBoundary() 42 0.05199 0.05199 0.05199 1.07% MLMG::mgVcycle_down::1 117 0.04785 0.04785 0.04785 0.99% MLCellLinOp::defineAuxData() 25 0.04495 0.04495 0.04495 0.93% MLMG::computeResWithCrseSolFineCor() 22 0.04216 0.04216 0.04216 0.87% MLMG:computeResOfCorrection() 555 0.04053 0.04053 0.04053 0.84% Amr::bldFineLevels() 1 0.04009 0.04009 0.04009 0.83% MLMG::mgVcycle_up::1 117 0.03987 0.03987 0.03987 0.82% Castro::reset_internal_energy() 122 0.03925 0.03925 0.03925 0.81% MultiFab::Dot() 2078 0.03921 0.03921 0.03921 0.81% MLCellLinOp::solutionResidual() 176 0.03818 0.03818 0.03818 0.79% FluxRegister::Reflux() 30 0.03738 0.03738 0.03738 0.77% FillPatchTwoLevels 387 0.03674 0.03674 0.03674 0.76% Castro::do_old_sources() 10 0.03403 0.03403 0.03403 0.70% MLCellLinOp::defineBC() 25 0.03246 0.03246 0.03246 0.67% amrex::average_down 644 0.03201 0.03201 0.03201 0.66% MLMG::computeMLResidual() 32 0.03124 0.03124 0.03124 0.65% Gravity::get_new_grav_vector() 12 0.02917 0.02917 0.02917 0.60% BndryData::define() 35 0.02755 0.02755 0.02755 0.57% MLMG::mgVcycle_down::2 117 0.02751 0.02751 0.02751 0.57% MultiFab::Saxpy() 90 0.02682 0.02682 0.02682 0.55% MLMG::mgVcycle_down::3 117 0.02642 0.02642 0.02642 0.55% MLMG::addInterpCorrection() 555 0.0257 0.0257 0.0257 0.53% MLMG::computeResidual() 117 0.02542 0.02542 0.02542 0.53% Gravity::get_old_grav_vector() 10 0.02526 0.02526 0.02526 0.52% StateData::FillBoundary(geom) 546 0.02475 0.02475 0.02475 0.51% Castro::estTimeStep() 29 0.0239 0.0239 0.0239 0.49% CGSolver::sxay() 2962 0.02372 0.02372 0.02372 0.49% MultiFab::LinComb() 2972 0.02352 0.02352 0.02352 0.49% MLPoisson::Fapply() 1931 0.02319 0.02319 0.02319 0.48% FabArray::setDomainBndry() 798 0.02293 0.02293 0.02293 0.47% MLCGSolver::ParallelAllReduce 2754 0.02247 0.02247 0.02247 0.46% MultiFab::Multiply() 408 0.02098 0.02098 0.02098 0.43% MLMG::mgVcycle_up::3 117 0.02065 0.02065 0.02065 0.43% Amr::grid_places() 6 0.02061 0.02061 0.02061 0.43% AmrMesh::MakeNewGrids() 6 0.0205 0.0205 0.0205 0.42% MLMG::mgVcycle_up::2 117 0.02043 0.02043 0.02043 0.42% Castro::enforce_min_density() 119 0.01996 0.01996 0.01996 0.41% MLMG::miniCycle() 44 0.01919 0.01919 0.01919 0.40% MLMG::mgVcycle_down::4 87 0.01818 0.01818 0.01818 0.38% MultiFab::Xpay() 892 0.01788 0.01788 0.01788 0.37% MLMG::prepareForSolve() 25 0.01724 0.01724 0.01724 0.36% Castro::initData() 3 0.01486 0.01486 0.01486 0.31% MLMG::mgVcycle_up::4 87 0.01462 0.01462 0.01462 0.30% Castro::construct_old_source() 70 0.01446 0.01446 0.01446 0.30% Castro::finalize_advance() 10 0.01382 0.01382 0.01382 0.29% Castro::construct_new_gravity_source() 20 0.01266 0.01266 0.01266 0.26% Castro::computeNewDt() 8 0.01238 0.01238 0.01238 0.26% Castro::apply_source_to_state() 40 0.01142 0.01142 0.01142 0.24% Castro::construct_old_gravity_source() 20 0.01086 0.01086 0.01086 0.22% MLMG::getGradSolution() 25 0.01044 0.01044 0.01044 0.22% MLCellLinOp::compGrad() 30 0.01043 0.01043 0.01043 0.22% FabArrayBase::getCPC() 2980 0.01041 0.01041 0.01041 0.22% MLPoisson::FFlux() 1326 0.01033 0.01033 0.01033 0.21% MLMG::computeResWithCrseCorFineCor() 22 0.01032 0.01032 0.01032 0.21% Castro::init(old) 4 0.00956 0.00956 0.00956 0.20% MLCellLinOp::setLevelBC() 30 0.009407 0.009407 0.009407 0.19% MLCellLinOp::updateSolBC() 27 0.009129 0.009129 0.009129 0.19% FabArray::setVal(val, thecmd, scomp, ncomp) 1095 0.00896 0.00896 0.00896 0.19% FillPatchInterp(Fab) 33 0.0081 0.0081 0.0081 0.17% FabArrayBase::CPC::define() 1033 0.007881 0.007881 0.007881 0.16% MLCellLinOp::updateCorBC() 22 0.007334 0.007334 0.007334 0.15% Castro::locWgtSum() 36 0.006924 0.006924 0.006924 0.14% MLMG::ResNormInf() 154 0.005089 0.005089 0.005089 0.11% Castro::errorEst() 6 0.00419 0.00419 0.00419 0.09% Gravity::swapTimeLevels() 10 0.004051 0.004051 0.004051 0.08% Castro::volProductSum() 12 0.003968 0.003968 0.003968 0.08% Castro::computeInitialDt() 2 0.003893 0.003893 0.003893 0.08% MLPoisson::prepareForSolve() 25 0.003805 0.003805 0.003805 0.08% MLCellLinOp::prepareForSolve() 25 0.003781 0.003781 0.003781 0.08% CellConservativeLinear::interp() 198 0.003669 0.003669 0.003669 0.08% Castro::avgDown() 6 0.003647 0.003647 0.003647 0.08% Castro::avgDown(state_indx) 30 0.003641 0.003641 0.003641 0.08% amrex::average_down_w_geom 30 0.003628 0.003628 0.003628 0.08% FabArray::mult() 72 0.003584 0.003584 0.003584 0.07% Castro::fill_hybrid_hydro_source() 50 0.00357 0.00357 0.00357 0.07% TagBoxArray::mapPRD 6 0.002743 0.002743 0.002743 0.06% Castro::construct_new_hybrid_source() 20 0.002702 0.002702 0.002702 0.06% FabArrayBase::getFB() 6022 0.002493 0.002493 0.002493 0.05% Gravity::average_fine_ec_onto_crse_ec() 5 0.002392 0.002392 0.002392 0.05% Gravity::update_max_rhs() 10 0.002312 0.002312 0.002312 0.05% MLMG::interpCorrection_1 22 0.002296 0.002296 0.002296 0.05% Gravity::create_comp_minus_level_grad_phi() 5 0.002205 0.002205 0.002205 0.05% Castro::FluxRegFineAdd() 10 0.002009 0.002009 0.002009 0.04% Gravity::GetCrsePhi() 10 0.001865 0.001865 0.001865 0.04% MultiFab::max() 56 0.001755 0.001755 0.001755 0.04% MLMG::MLResNormInf() 32 0.00138 0.00138 0.00138 0.03% MultiFab::Subtract() 25 0.001231 0.001231 0.001231 0.03% MultiFab::Copy() 30 0.001177 0.001177 0.001177 0.02% FabArrayBase::FB::FB() 98 0.001152 0.001152 0.001152 0.02% Castro::build_fine_mask() 166 0.001134 0.001134 0.001134 0.02% OwnerMask() 6 0.000892 0.000892 0.000892 0.02% Castro::construct_old_hybrid_source() 10 0.0008904 0.0008904 0.0008904 0.02% MLMG::MLRhsNormInf() 25 0.0008897 0.0008897 0.0008897 0.02% MultiFab::norm0(mask) 17 0.0007758 0.0007758 0.0007758 0.02% TagBoxArray::collate() 6 0.000773 0.000773 0.000773 0.02% MLLinOp::define() 25 0.0005443 0.0005443 0.0005443 0.01% MLLinOp::defineGrids() 25 0.0005076 0.0005076 0.0005076 0.01% Castro::apply_problem_tags() 6 0.0004975 0.0004975 0.0004975 0.01% Castro::apply_tagging_restrictions() 6 0.0004579 0.0004579 0.0004579 0.01% MultiFab::min() 10 0.0004521 0.0004521 0.0004521 0.01% AmrLevel::AmrLevel(dm) 7 0.0004285 0.0004285 0.0004285 0.01% Castro::react_state() 20 0.0004235 0.0004235 0.0004235 0.01% StateData::define() 35 0.0003521 0.0003521 0.0003521 0.01% MLMG::buildFineMask() 25 0.0003512 0.0003512 0.0003512 0.01% Castro::construct_new_rotation_source() 20 0.0003278 0.0003278 0.0003278 0.01% Castro::swap_state_time_levels() 10 0.0002625 0.0002625 0.0002625 0.01% Castro::enforce_consistent_e() 3 0.0002139 0.0002139 0.0002139 0.00% Castro::linear_to_hybrid_momentum() 3 0.000211 0.000211 0.000211 0.00% Castro::construct_old_rotation_source() 10 0.0001931 0.0001931 0.0001931 0.00% AMRErrorTag::operator() 6 0.0001794 0.0001794 0.0001794 0.00% Castro::create_source_corrector() 10 0.0001539 0.0001539 0.0001539 0.00% MLLinOp::makeAgglomeratedDMap 25 0.000125 0.000125 0.000125 0.00% makeSFC 115 9.58e-05 9.58e-05 9.58e-05 0.00% Castro::finalize_do_advance() 10 6.551e-05 6.551e-05 6.551e-05 0.00% Castro::enforce_speed_limit() 119 5.447e-05 5.447e-05 5.447e-05 0.00% FabArrayBase::TheFPinfo() 33 5.23e-05 5.23e-05 5.23e-05 0.00% DistributionMapping::Distribute() 117 3.997e-05 3.997e-05 3.997e-05 0.00% Amr::writeSmallPlotFile() 1 3.504e-05 3.504e-05 3.504e-05 0.00% AmrMesh-cluster 6 3.172e-05 3.172e-05 3.172e-05 0.00% FPinfo::FPinfo() 3 2.479e-05 2.479e-05 2.479e-05 0.00% FabArray::RecvLayoutMask() 5 2.356e-05 2.356e-05 2.356e-05 0.00% ClusterList::intersect() 6 1.85e-05 1.85e-05 1.85e-05 0.00% Amr::initSubcycle() 1 1.332e-05 1.332e-05 1.332e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.052e-05 1.052e-05 1.052e-05 0.00% BoxList::parallelComplementIn() 12 9.383e-06 9.383e-06 9.383e-06 0.00% Castro::retry_advance_ctu() 10 5.072e-06 5.072e-06 5.072e-06 0.00% MLLinOp::makeSubCommunicator() 25 4.883e-06 4.883e-06 4.883e-06 0.00% BoxList::complementIn 12 4.848e-06 4.848e-06 4.848e-06 0.00% Gravity::set_mass_offset() 6 2.785e-06 2.785e-06 2.785e-06 0.00% ClusterList::chop() 6 1.756e-06 1.756e-06 1.756e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0e0, 0.0e0, 0.0e0] [TOP]::mg.v(nvals = 1) :: [2] Total GPU global memory (MB): 12066 Free GPU global memory (MB): 4849 [The Arena] space allocated (MB): 9049 [The Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (22.02-7-g9558c8a1684c) finalized