Initializing CUDA... CUDA initialized with 1 GPU AMReX (22.04-20-gfc55c67f72d2) initialized Starting run at 12:45:50 UTC on 2022-04-15. Successfully read inputs file ... Castro git describe: 22.04-3-g23b38164b AMReX git describe: 22.04-20-gfc55c67f7 Microphysics git describe: 22.04-1-gef526ccd reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003608883 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.002627146 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Gravity::fill_multipole_BCs() time = 0.012101464 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.22516667 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 ...estimated hydro-limited timestep at level 1: 0.02713036318 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02713036318 [Level 0 step 1] ADVANCE with dt = 0.002713036318  Beginning subcycle 1 starting at time 0 with dt = 0.002713036318 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008003776 Gravity::solve_for_phi() time = 0.05033212 Castro::do_old_sources() time = 0.004824189 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.314415441 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007846551 Gravity::solve_for_phi() time = 0.046055297 Castro::do_new_sources() time = 0.009364949 ...estimated hydro-limited timestep at level 0: 0.05551272919 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272919  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.668980989 [Level 0 step 1] Advanced 884736 cells [Level 1 step 1] ADVANCE with dt = 0.002713036318  Beginning subcycle 1 starting at time 0 with dt = 0.002713036318 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.004045268 Castro::do_old_sources() time = 0.002232731 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.043529068 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.030033077 Castro::do_new_sources() time = 0.003013753 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.57347203 [Level 1 step 1] Advanced 393216 cells Castro::do_new_sources() time = 0.002969495 Castro::do_new_sources() time = 0.00583918 Castro::reflux() at level 0 : time = 0.024792052 Updating the rotational period from 30.54368673 s to 30.52206572 s. [STEP 1] Coarse TimeStep time: 0.699664111 [STEP 1] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 1 TIME = 0.002713036318 DT = 0.002713036318 ...estimated hydro-limited timestep at level 0: 0.05551272816 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272816 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05551272816 ... but limiting to: 0.00298433995 = 1.1 * 0.002713036318 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02775634251 ... but limiting to: 0.00298433995 = 1.1 * 0.002713036318 Now regridding at level lbase = 0 grid_places() time: 0.002104537 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.010867852 STEP = 1 TIME = 0.002713036318 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05551272816 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272816 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251 [Level 0 step 2] ADVANCE with dt = 0.00298433995  Beginning subcycle 1 starting at time 0.002713036318 with dt = 0.00298433995 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007912165 Gravity::solve_for_phi() time = 0.051082422 Castro::do_old_sources() time = 0.004806226 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.113362016 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.00801177 Gravity::solve_for_phi() time = 0.047073245 Castro::do_new_sources() time = 0.005748808 ...estimated hydro-limited timestep at level 0: 0.05665145362 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.413747619 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE with dt = 0.00298433995  Beginning subcycle 1 starting at time 0.002713036318 with dt = 0.00298433995 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003825573 Castro::do_old_sources() time = 0.002100707 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.030814222 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.030076194 Castro::do_new_sources() time = 0.003674504 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.698452123 [Level 1 step 2] Advanced 393216 cells Castro::do_new_sources() time = 0.003152412 Castro::do_new_sources() time = 0.005745514 Castro::reflux() at level 0 : time = 0.024534898 Updating the rotational period from 30.52206572 s to 30.52210616 s. [STEP 2] Coarse TimeStep time: 0.470827577 [STEP 2] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 2 TIME = 0.005697376269 DT = 0.00298433995 ...estimated hydro-limited timestep at level 0: 0.05665145259 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145259 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05665145259 ... but limiting to: 0.003282773945 = 1.1 * 0.00298433995 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02832568214 ... but limiting to: 0.003282773945 = 1.1 * 0.00298433995 Now regridding at level lbase = 0 grid_places() time: 0.004401315 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.010816784 STEP = 2 TIME = 0.005697376269 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05665145259 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145259 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214 [Level 0 step 3] ADVANCE with dt = 0.003282773945  Beginning subcycle 1 starting at time 0.005697376269 with dt = 0.003282773945 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007841869 Gravity::solve_for_phi() time = 0.051679349 Castro::do_old_sources() time = 0.004196239 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.127054431 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008136936 Gravity::solve_for_phi() time = 0.048189431 Castro::do_new_sources() time = 0.005954651 ...estimated hydro-limited timestep at level 0: 0.05769010785 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010785  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.188195719 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE with dt = 0.003282773945  Beginning subcycle 1 starting at time 0.005697376269 with dt = 0.003282773945 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00384427 Castro::do_old_sources() time = 0.002090836 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.039633481 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.030018632 Castro::do_new_sources() time = 0.003032831 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.252198396 [Level 1 step 3] Advanced 393216 cells Castro::do_new_sources() time = 0.003079219 Castro::do_new_sources() time = 0.006268359 Castro::reflux() at level 0 : time = 0.025137817 Updating the rotational period from 30.52210616 s to 30.52203124 s. [STEP 3] Coarse TimeStep time: 0.500166754 [STEP 3] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 3 TIME = 0.008980150214 DT = 0.003282773945 ...estimated hydro-limited timestep at level 0: 0.05769010675 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010675 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05769010675 ... but limiting to: 0.00361105134 = 1.1 * 0.003282773945 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02884498561 ... but limiting to: 0.00361105134 = 1.1 * 0.003282773945 Now regridding at level lbase = 0 grid_places() time: 0.005252529 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.010810496 STEP = 3 TIME = 0.008980150214 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05769010675 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010675 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561 [Level 0 step 4] ADVANCE with dt = 0.00361105134  Beginning subcycle 1 starting at time 0.008980150214 with dt = 0.00361105134 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.00794247 Gravity::solve_for_phi() time = 0.052095042 Castro::do_old_sources() time = 0.00403158 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.104515188 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007891183 Gravity::solve_for_phi() time = 0.04803448 Castro::do_new_sources() time = 0.00584767 ...estimated hydro-limited timestep at level 0: 0.05863574591 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574591  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.564354224 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE with dt = 0.00361105134  Beginning subcycle 1 starting at time 0.008980150214 with dt = 0.00361105134 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003855933 Castro::do_old_sources() time = 0.002091953 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.047824009 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.030117783 Castro::do_new_sources() time = 0.005202639 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.726305295 [Level 1 step 4] Advanced 393216 cells Castro::do_new_sources() time = 0.004557809 Castro::do_new_sources() time = 0.009911669 Castro::reflux() at level 0 : time = 0.038416904 Updating the rotational period from 30.52203124 s to 30.52194705 s. [STEP 4] Coarse TimeStep time: 0.514979274 [STEP 4] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 4 TIME = 0.01259120155 DT = 0.00361105134 ...estimated hydro-limited timestep at level 0: 0.05863574483 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574483 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05863574483 ... but limiting to: 0.003972156474 = 1.1 * 0.00361105134 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02931778012 ... but limiting to: 0.003972156474 = 1.1 * 0.00361105134 Now regridding at level lbase = 0 grid_places() time: 0.002005469 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.010861545 STEP = 4 TIME = 0.01259120155 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05863574483 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574483 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012 [Level 0 step 5] ADVANCE with dt = 0.003972156474  Beginning subcycle 1 starting at time 0.01259120155 with dt = 0.003972156474 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007822732 Gravity::solve_for_phi() time = 0.051823264 Castro::do_old_sources() time = 0.004295168 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.136886237 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007824931 Gravity::solve_for_phi() time = 0.047867207 Castro::do_new_sources() time = 0.006055525 ...estimated hydro-limited timestep at level 0: 0.0594445305 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0594445305  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.153532817 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE with dt = 0.003972156474  Beginning subcycle 1 starting at time 0.01259120155 with dt = 0.003972156474 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003857028 Castro::do_old_sources() time = 0.002183266 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.03094079 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.030595209 Castro::do_new_sources() time = 0.004130663 ...estimated hydro-limited timestep at level 1: 0.02974830524 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02974830524  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.590447099 [Level 1 step 5] Advanced 393216 cells Castro::do_new_sources() time = 0.00303651 Castro::do_new_sources() time = 0.005928394 Castro::reflux() at level 0 : time = 0.024770235 Updating the rotational period from 30.52194705 s to 30.52185024 s. [STEP 5] Coarse TimeStep time: 0.501912857 [STEP 5] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 5 TIME = 0.01656335803 DT = 0.003972156474 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.227027381 seconds Ending run at 12:45:54 UTC on 2022-04-15. Run time = 4.712881392 Run time without initialization = 2.915578582 Average number of zones advanced per microsecond: 2.192 Average number of zones advanced per microsecond per rank: 2.192 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9489481728 TinyProfiler total time across processes [min...avg...max]: 4.713 ... 4.713 ... 4.713 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.1812 1.1812 1.1812 25.06% Castro::construct_ctu_hydro_source() 10 0.9891 0.9891 0.9891 20.99% VisMF::Write(FabArray) 4 0.4444 0.4444 0.4444 9.43% MLCellLinOp::applyBC() 6611 0.1774 0.1774 0.1774 3.76% Amr::defBaseLevel() 1 0.1696 0.1696 0.1696 3.60% MLPoisson::Fsmooth() 4616 0.1608 0.1608 0.1608 3.41% FabArray::setVal() 2104 0.1453 0.1453 0.1453 3.08% Gravity::fill_multipole_BCs() 15 0.134 0.134 0.134 2.84% FabArray::ParallelCopy_nowait() 2596 0.1044 0.1044 0.1044 2.22% Castro::computeTemp() 122 0.09299 0.09299 0.09299 1.97% FillBoundary_nowait() 6022 0.08802 0.08802 0.08802 1.87% Castro::derive() 607 0.07184 0.07184 0.07184 1.52% Castro::normalize_species() 119 0.06732 0.06732 0.06732 1.43% MLCellLinOp::reflux() 34 0.05178 0.05178 0.05178 1.10% MLCellLinOp::defineAuxData() 25 0.04117 0.04117 0.04117 0.87% MultiFab::Dot() 2078 0.04002 0.04002 0.04002 0.85% Castro::reset_internal_energy() 122 0.03945 0.03945 0.03945 0.84% MLCGSolver::bicgstab 117 0.03887 0.03887 0.03887 0.82% Castro::expand_state() 10 0.02829 0.02829 0.02829 0.60% StateData::FillBoundary(geom) 546 0.02822 0.02822 0.02822 0.60% FluxRegister::Reflux() 30 0.02762 0.02762 0.02762 0.59% MultiFab::Saxpy() 90 0.02684 0.02684 0.02684 0.57% BndryData::define() 35 0.02492 0.02492 0.02492 0.53% MultiFab::LinComb() 2972 0.02407 0.02407 0.02407 0.51% MLPoisson::Fapply() 1931 0.02351 0.02351 0.02351 0.50% Castro::construct_new_source() 140 0.02351 0.02351 0.02351 0.50% FabArray::setDomainBndry() 798 0.02299 0.02299 0.02299 0.49% StateDataPhysBCFunct::() 798 0.02128 0.02128 0.02128 0.45% Castro::estTimeStep() 29 0.02112 0.02112 0.02112 0.45% MultiFab::Multiply() 408 0.02108 0.02108 0.02108 0.45% Castro::reflux() 5 0.02054 0.02054 0.02054 0.44% amrex::average_down 644 0.01988 0.01988 0.01988 0.42% Castro::enforce_min_density() 119 0.01934 0.01934 0.01934 0.41% MultiFab::Xpay() 892 0.01791 0.01791 0.01791 0.38% MLMG::addInterpCorrection() 555 0.01579 0.01579 0.01579 0.33% AmrMesh::MakeNewGrids() 6 0.01211 0.01211 0.01211 0.26% Castro::construct_new_gravity_source() 20 0.01171 0.01171 0.01171 0.25% MLPoisson::FFlux() 1326 0.01168 0.01168 0.01168 0.25% Castro::volWgtSum() 156 0.01156 0.01156 0.01156 0.25% Castro::finalize_advance() 10 0.01013 0.01013 0.01013 0.22% Castro::do_advance_ctu() 10 0.009791 0.009791 0.009791 0.21% FabArray::setVal(val, thecmd, scomp, ncomp) 1095 0.009558 0.009558 0.009558 0.20% Castro::construct_old_gravity_source() 20 0.008741 0.008741 0.008741 0.19% MLCellLinOp::setLevelBC() 30 0.008592 0.008592 0.008592 0.18% FabArrayBase::CPC::define() 1033 0.008494 0.008494 0.008494 0.18% Gravity::actual_solve_with_mlmg() 25 0.008011 0.008011 0.008011 0.17% Amr::writePlotFile() 2 0.007997 0.007997 0.007997 0.17% MLCellLinOp::compGrad() 30 0.007926 0.007926 0.007926 0.17% Castro::volInBoundary() 42 0.007482 0.007482 0.007482 0.16% FillPatchIterator::Initialize 765 0.007399 0.007399 0.007399 0.16% MLMG::oneIter() 117 0.007209 0.007209 0.007209 0.15% Castro::initData() 3 0.005899 0.005899 0.005899 0.13% MLCellLinOp::updateSolBC() 27 0.00574 0.00574 0.00574 0.12% MLCellLinOp::defineBC() 25 0.005152 0.005152 0.005152 0.11% Castro::problem_post_timestep() 11 0.005021 0.005021 0.005021 0.11% MLCellLinOp::updateCorBC() 22 0.004767 0.004767 0.004767 0.10% Amr::regrid() 5 0.004712 0.004712 0.004712 0.10% MLMG::ResNormInf() 154 0.004538 0.004538 0.004538 0.10% Gravity::get_new_grav_vector() 12 0.004484 0.004484 0.004484 0.10% MultiFab::contains_nan() 20 0.004216 0.004216 0.004216 0.09% FillPatchInterp(Fab) 33 0.004154 0.004154 0.004154 0.09% Castro::construct_old_source() 70 0.004104 0.004104 0.004104 0.09% MLCellLinOp::prepareForSolve() 25 0.004101 0.004101 0.004101 0.09% CellConservativeLinear::interp() 198 0.003982 0.003982 0.003982 0.08% FabArray::mult() 72 0.00364 0.00364 0.00364 0.08% MLMG::prepareForSolve() 25 0.003583 0.003583 0.003583 0.08% Gravity::get_old_grav_vector() 10 0.00357 0.00357 0.00357 0.08% Castro::fill_hybrid_hydro_source() 50 0.003399 0.003399 0.003399 0.07% Castro::wd_update() 6 0.003304 0.003304 0.003304 0.07% Castro::construct_old_gravity() 10 0.002785 0.002785 0.002785 0.06% FabArrayBase::getCPC() 2980 0.002746 0.002746 0.002746 0.06% Castro::locWgtSum() 36 0.002679 0.002679 0.002679 0.06% Castro::init(old) 4 0.002524 0.002524 0.002524 0.05% Gravity::solve_for_phi() 20 0.002444 0.002444 0.002444 0.05% MLCellLinOp::smooth() 2308 0.002091 0.002091 0.002091 0.04% Castro::FluxRegFineAdd() 10 0.00201 0.00201 0.00201 0.04% Castro::construct_new_gravity() 10 0.001974 0.001974 0.001974 0.04% MultiFab::max() 56 0.001799 0.001799 0.001799 0.04% FabArray::FillBoundary() 6022 0.001616 0.001616 0.001616 0.03% Castro::clean_state() 119 0.001415 0.001415 0.001415 0.03% Gravity::create_comp_minus_level_grad_phi() 5 0.00136 0.00136 0.00136 0.03% FabArrayBase::getFB() 6022 0.001334 0.001334 0.001334 0.03% MultiFab::Subtract() 25 0.001258 0.001258 0.001258 0.03% FabArrayBase::FB::FB() 98 0.001222 0.001222 0.001222 0.03% MultiFab::Copy() 30 0.001202 0.001202 0.001202 0.03% Castro::build_fine_mask() 166 0.001196 0.001196 0.001196 0.03% TagBoxArray::mapPRD 6 0.001187 0.001187 0.001187 0.03% MLMG::interpCorrection_1 22 0.00118 0.00118 0.00118 0.03% Gravity::update_max_rhs() 10 0.001152 0.001152 0.001152 0.02% FabArray::ParallelCopy() 2596 0.001025 0.001025 0.001025 0.02% FillPatchTwoLevels 387 0.001023 0.001023 0.001023 0.02% MLCellLinOp::apply() 1931 0.001007 0.001007 0.001007 0.02% Castro::volProductSum() 12 0.001003 0.001003 0.001003 0.02% Gravity::average_fine_ec_onto_crse_ec() 5 0.0009802 0.0009802 0.0009802 0.02% CGSolver::sxay() 2962 0.0009434 0.0009434 0.0009434 0.02% main() 1 0.0009296 0.0009296 0.0009296 0.02% OwnerMask() 6 0.0009291 0.0009291 0.0009291 0.02% TagBoxArray::collate() 6 0.0008147 0.0008147 0.0008147 0.02% MultiFab::norm0(mask) 17 0.0007967 0.0007967 0.0007967 0.02% MLMG::mgVcycle() 161 0.0007624 0.0007624 0.0007624 0.02% Castro::subcycle_advance_ctu() 10 0.0007593 0.0007593 0.0007593 0.02% Amr::bldFineLevels() 1 0.0007471 0.0007471 0.0007471 0.02% MLMG::MLRhsNormInf() 25 0.0006916 0.0006916 0.0006916 0.01% MLCGSolver::ParallelAllReduce 2754 0.0006734 0.0006734 0.0006734 0.01% MultiFab::min() 10 0.0005919 0.0005919 0.0005919 0.01% MLLinOp::defineGrids() 25 0.0005514 0.0005514 0.0005514 0.01% Gravity::actual_multilevel_solve() 5 0.0005333 0.0005333 0.0005333 0.01% Castro::apply_problem_tags() 6 0.0005262 0.0005262 0.0005262 0.01% MLMG::computeResWithCrseSolFineCor() 22 0.0004958 0.0004958 0.0004958 0.01% MLMG::computeResWithCrseCorFineCor() 22 0.0004843 0.0004843 0.0004843 0.01% Castro::apply_tagging_restrictions() 6 0.0004802 0.0004802 0.0004802 0.01% Castro::construct_new_rotation_source() 20 0.0004546 0.0004546 0.0004546 0.01% MLCellLinOp::correctionResidual() 716 0.0004357 0.0004357 0.0004357 0.01% Castro::initialize_advance() 10 0.0004258 0.0004258 0.0004258 0.01% FillPatchSingleLevel 798 0.0004027 0.0004027 0.0004027 0.01% Gravity::multilevel_solve_for_new_phi() 5 0.0003748 0.0003748 0.0003748 0.01% Castro::linear_to_hybrid_momentum() 3 0.0003665 0.0003665 0.0003665 0.01% StateData::define() 35 0.000339 0.000339 0.000339 0.01% Gravity::GetCrsePhi() 10 0.0003159 0.0003159 0.0003159 0.01% Castro::advance() 10 0.0003134 0.0003134 0.0003134 0.01% Castro::swap_state_time_levels() 10 0.0002993 0.0002993 0.0002993 0.01% Castro::initialize_do_advance() 10 0.0002884 0.0002884 0.0002884 0.01% MLMG:computeResOfCorrection() 555 0.0002575 0.0002575 0.0002575 0.01% Castro::construct_old_rotation_source() 10 0.000226 0.000226 0.000226 0.00% MLMG::actualBottomSolve() 117 0.0002255 0.0002255 0.0002255 0.00% Castro::post_regrid() 12 0.0002222 0.0002222 0.0002222 0.00% Castro::enforce_consistent_e() 3 0.0002063 0.0002063 0.0002063 0.00% MLMG::solve() 25 0.0002036 0.0002036 0.0002036 0.00% Castro::create_source_corrector() 10 0.0001977 0.0001977 0.0001977 0.00% AMRErrorTag::operator() 6 0.0001832 0.0001832 0.0001832 0.00% MLMG::mgVcycle_down::0 117 0.0001729 0.0001729 0.0001729 0.00% Castro::do_new_sources() 20 0.0001704 0.0001704 0.0001704 0.00% Amr::coarseTimeStep() 5 0.0001648 0.0001648 0.0001648 0.00% Castro::computeNewDt() 8 0.0001584 0.0001584 0.0001584 0.00% Gravity::solve_phi_with_mlmg() 25 0.0001526 0.0001526 0.0001526 0.00% MLMG::mgVcycle_down::1 117 0.0001498 0.0001498 0.0001498 0.00% MLMG::mgVcycle_down::3 117 0.0001442 0.0001442 0.0001442 0.00% MLMG::mgVcycle_down::2 117 0.0001407 0.0001407 0.0001407 0.00% MLCellLinOp::solutionResidual() 176 0.0001377 0.0001377 0.0001377 0.00% Amr::grid_places() 6 0.0001295 0.0001295 0.0001295 0.00% Castro::finalize_do_advance() 10 0.0001201 0.0001201 0.0001201 0.00% MLMG::mgVcycle_bottom 161 0.0001198 0.0001198 0.0001198 0.00% Castro::react_state() 20 0.0001059 0.0001059 0.0001059 0.00% Amr::timeStep() 10 0.0001031 0.0001031 0.0001031 0.00% MLMG::buildFineMask() 25 9.645e-05 9.645e-05 9.645e-05 0.00% MLMG::mgVcycle_down::4 87 9.628e-05 9.628e-05 9.628e-05 0.00% Castro::do_old_sources() 10 9.447e-05 9.447e-05 9.447e-05 0.00% MLMG::mgVcycle_up::0 117 9.183e-05 9.183e-05 9.183e-05 0.00% MLMG::mgVcycle_up::3 117 8.898e-05 8.898e-05 8.898e-05 0.00% MLMG::mgVcycle_up::1 117 8.552e-05 8.552e-05 8.552e-05 0.00% makeSFC 115 8.412e-05 8.412e-05 8.412e-05 0.00% MLMG::mgVcycle_up::4 87 7.961e-05 7.961e-05 7.961e-05 0.00% MLMG::mgVcycle_up::2 117 7.959e-05 7.959e-05 7.959e-05 0.00% AmrLevel::AmrLevel(dm) 7 7.712e-05 7.712e-05 7.712e-05 0.00% Castro::enforce_speed_limit() 119 7.47e-05 7.47e-05 7.47e-05 0.00% MLMG::computeResidual() 117 7.439e-05 7.439e-05 7.439e-05 0.00% MLPoisson::define() 25 7.169e-05 7.169e-05 7.169e-05 0.00% MLLinOp::define() 25 6.015e-05 6.015e-05 6.015e-05 0.00% DistributionMapping::Distribute() 117 5.485e-05 5.485e-05 5.485e-05 0.00% Castro::errorEst() 6 4.898e-05 4.898e-05 4.898e-05 0.00% Amr::FinalizeInit() 1 4.586e-05 4.586e-05 4.586e-05 0.00% FabArrayBase::TheFPinfo() 33 4.426e-05 4.426e-05 4.426e-05 0.00% MLLinOp::makeAgglomeratedDMap 25 4.313e-05 4.313e-05 4.313e-05 0.00% FPinfo::FPinfo() 3 4.083e-05 4.083e-05 4.083e-05 0.00% Amr::writeSmallPlotFile() 1 4.065e-05 4.065e-05 4.065e-05 0.00% Castro::post_init() 2 3.687e-05 3.687e-05 3.687e-05 0.00% MLMG::computeMLResidual() 32 3.252e-05 3.252e-05 3.252e-05 0.00% FabArray::RecvLayoutMask() 5 2.842e-05 2.842e-05 2.842e-05 0.00% MLPoisson::prepareForSolve() 25 2.776e-05 2.776e-05 2.776e-05 0.00% Castro::apply_source_to_state() 40 2.543e-05 2.543e-05 2.543e-05 0.00% Castro::avgDown(state_indx) 30 2.442e-05 2.442e-05 2.442e-05 0.00% ClusterList::intersect() 6 2.205e-05 2.205e-05 2.205e-05 0.00% MLMG::miniCycle() 44 2.2e-05 2.2e-05 2.2e-05 0.00% MLMG::MLResNormInf() 32 2.093e-05 2.093e-05 2.093e-05 0.00% Castro::construct_new_hybrid_source() 20 1.949e-05 1.949e-05 1.949e-05 0.00% amrex::average_down_w_geom 30 1.911e-05 1.911e-05 1.911e-05 0.00% MLMG::getGradSolution() 25 1.804e-05 1.804e-05 1.804e-05 0.00% Castro::post_timestep() 10 1.804e-05 1.804e-05 1.804e-05 0.00% Castro::check_for_nan() 20 1.71e-05 1.71e-05 1.71e-05 0.00% Gravity::swapTimeLevels() 10 1.468e-05 1.468e-05 1.468e-05 0.00% Amr::initSubcycle() 1 1.274e-05 1.274e-05 1.274e-05 0.00% AmrMesh-cluster 6 1.138e-05 1.138e-05 1.138e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 9.496e-06 9.496e-06 9.496e-06 0.00% Castro::construct_old_hybrid_source() 10 8.129e-06 8.129e-06 8.129e-06 0.00% Castro::retry_advance_ctu() 10 7.592e-06 7.592e-06 7.592e-06 0.00% Castro::avgDown() 6 7.268e-06 7.268e-06 7.268e-06 0.00% BoxList::parallelComplementIn() 12 5.878e-06 5.878e-06 5.878e-06 0.00% BoxList::complementIn 12 5.861e-06 5.861e-06 5.861e-06 0.00% Gravity::set_mass_offset() 6 5.107e-06 5.107e-06 5.107e-06 0.00% MLLinOp::makeSubCommunicator() 25 5.013e-06 5.013e-06 5.013e-06 0.00% Amr::InitializeInit() 1 4.128e-06 4.128e-06 4.128e-06 0.00% Castro::computeInitialDt() 2 3.537e-06 3.537e-06 3.537e-06 0.00% Amr::init() 1 2.36e-06 2.36e-06 2.36e-06 0.00% ClusterList::chop() 6 1.972e-06 1.972e-06 1.972e-06 0.00% Amr::initialInit() 1 1.537e-06 1.537e-06 1.537e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 4.713 4.713 4.713 100.00% Amr::coarseTimeStep() 5 2.688 2.688 2.688 57.03% Amr::timeStep() 10 2.679 2.679 2.679 56.84% Castro::advance() 10 2.073 2.073 2.073 43.99% Castro::subcycle_advance_ctu() 10 1.99 1.99 1.99 42.21% Castro::do_advance_ctu() 10 1.989 1.989 1.989 42.20% Amr::InitAmr() 1 1.181 1.181 1.181 25.06% Gravity::solve_phi_with_mlmg() 25 1.014 1.014 1.014 21.51% Castro::construct_ctu_hydro_source() 10 0.9891 0.9891 0.9891 20.99% Gravity::actual_solve_with_mlmg() 25 0.8756 0.8756 0.8756 18.58% MLMG::solve() 25 0.762 0.762 0.762 16.17% MLMG::oneIter() 117 0.6791 0.6791 0.6791 14.41% Gravity::solve_for_phi() 20 0.6654 0.6654 0.6654 14.12% Amr::init() 1 0.6159 0.6159 0.6159 13.07% MLMG::mgVcycle() 161 0.6027 0.6027 0.6027 12.79% Amr::writePlotFile() 2 0.4524 0.4524 0.4524 9.60% VisMF::Write(FabArray) 4 0.4444 0.4444 0.4444 9.43% Castro::construct_new_gravity() 10 0.4148 0.4148 0.4148 8.80% Amr::initialInit() 1 0.3906 0.3906 0.3906 8.29% MLCellLinOp::smooth() 2308 0.3558 0.3558 0.3558 7.55% Gravity::multilevel_solve_for_new_phi() 5 0.355 0.355 0.355 7.53% Gravity::actual_multilevel_solve() 5 0.3546 0.3546 0.3546 7.52% Amr::regrid() 5 0.3118 0.3118 0.3118 6.62% Castro::post_timestep() 10 0.3077 0.3077 0.3077 6.53% Castro::construct_old_gravity() 10 0.3076 0.3076 0.3076 6.53% Castro::post_regrid() 12 0.2685 0.2685 0.2685 5.70% MLCellLinOp::applyBC() 6611 0.2683 0.2683 0.2683 5.69% Castro::clean_state() 119 0.2163 0.2163 0.2163 4.59% Amr::InitializeInit() 1 0.2062 0.2062 0.2062 4.38% Amr::defBaseLevel() 1 0.2062 0.2062 0.2062 4.38% Castro::problem_post_timestep() 11 0.1848 0.1848 0.1848 3.92% Amr::FinalizeInit() 1 0.1844 0.1844 0.1844 3.91% MLMG::mgVcycle_bottom 161 0.1638 0.1638 0.1638 3.48% FillPatchIterator::Initialize 765 0.1619 0.1619 0.1619 3.44% MLPoisson::Fsmooth() 4616 0.1608 0.1608 0.1608 3.41% Castro::post_init() 2 0.1506 0.1506 0.1506 3.20% FabArray::setVal() 2104 0.1453 0.1453 0.1453 3.08% MLMG::actualBottomSolve() 117 0.1442 0.1442 0.1442 3.06% MLCGSolver::bicgstab 117 0.1431 0.1431 0.1431 3.04% Castro::reflux() 5 0.1377 0.1377 0.1377 2.92% Gravity::fill_multipole_BCs() 15 0.135 0.135 0.135 2.86% Castro::computeTemp() 122 0.1324 0.1324 0.1324 2.81% Castro::derive() 607 0.1273 0.1273 0.1273 2.70% FillPatchSingleLevel 798 0.1187 0.1187 0.1187 2.52% MLMG::mgVcycle_down::0 117 0.1163 0.1163 0.1163 2.47% FabArray::ParallelCopy() 2596 0.1136 0.1136 0.1136 2.41% FabArray::ParallelCopy_nowait() 2596 0.1126 0.1126 0.1126 2.39% Castro::do_new_sources() 20 0.1026 0.1026 0.1026 2.18% MLMG::mgVcycle_up::0 117 0.1005 0.1005 0.1005 2.13% Castro::initialize_do_advance() 10 0.09625 0.09625 0.09625 2.04% MLCellLinOp::apply() 1931 0.09512 0.09512 0.09512 2.02% FabArray::FillBoundary() 6022 0.09219 0.09219 0.09219 1.96% FillBoundary_nowait() 6022 0.09057 0.09057 0.09057 1.92% MLPoisson::define() 25 0.08505 0.08505 0.08505 1.80% Castro::expand_state() 10 0.07224 0.07224 0.07224 1.53% Castro::wd_update() 6 0.06937 0.06937 0.06937 1.47% Castro::initialize_advance() 10 0.06919 0.06919 0.06919 1.47% MLCellLinOp::reflux() 34 0.06891 0.06891 0.06891 1.46% Castro::normalize_species() 119 0.06732 0.06732 0.06732 1.43% MLCellLinOp::correctionResidual() 716 0.05889 0.05889 0.05889 1.25% MLMG::computeResWithCrseSolFineCor() 22 0.05479 0.05479 0.05479 1.16% Castro::construct_new_source() 140 0.05464 0.05464 0.05464 1.16% Castro::volWgtSum() 156 0.05285 0.05285 0.05285 1.12% Castro::volInBoundary() 42 0.05282 0.05282 0.05282 1.12% MLMG::mgVcycle_down::1 117 0.04987 0.04987 0.04987 1.06% StateDataPhysBCFunct::() 798 0.0495 0.0495 0.0495 1.05% MLCellLinOp::defineAuxData() 25 0.04896 0.04896 0.04896 1.04% MLMG:computeResOfCorrection() 555 0.04169 0.04169 0.04169 0.88% MLMG::mgVcycle_up::1 117 0.04144 0.04144 0.04144 0.88% MultiFab::Dot() 2078 0.04002 0.04002 0.04002 0.85% MLCellLinOp::solutionResidual() 176 0.03972 0.03972 0.03972 0.84% Castro::reset_internal_energy() 122 0.03945 0.03945 0.03945 0.84% FillPatchTwoLevels 387 0.03771 0.03771 0.03771 0.80% FluxRegister::Reflux() 30 0.03745 0.03745 0.03745 0.79% MLCellLinOp::defineBC() 25 0.03522 0.03522 0.03522 0.75% amrex::average_down 644 0.03338 0.03338 0.03338 0.71% Castro::do_old_sources() 10 0.03293 0.03293 0.03293 0.70% MLMG::computeMLResidual() 32 0.03209 0.03209 0.03209 0.68% Amr::bldFineLevels() 1 0.03057 0.03057 0.03057 0.65% BndryData::define() 35 0.02992 0.02992 0.02992 0.63% Gravity::get_new_grav_vector() 12 0.02856 0.02856 0.02856 0.61% StateData::FillBoundary(geom) 546 0.02822 0.02822 0.02822 0.60% MLMG::mgVcycle_down::2 117 0.02796 0.02796 0.02796 0.59% MultiFab::Saxpy() 90 0.02684 0.02684 0.02684 0.57% MLMG::mgVcycle_down::3 117 0.02681 0.02681 0.02681 0.57% MLMG::addInterpCorrection() 555 0.02645 0.02645 0.02645 0.56% MLMG::computeResidual() 117 0.02629 0.02629 0.02629 0.56% Gravity::get_old_grav_vector() 10 0.02565 0.02565 0.02565 0.54% CGSolver::sxay() 2962 0.0243 0.0243 0.0243 0.52% MultiFab::LinComb() 2972 0.02407 0.02407 0.02407 0.51% MLPoisson::Fapply() 1931 0.02351 0.02351 0.02351 0.50% FabArray::setDomainBndry() 798 0.02299 0.02299 0.02299 0.49% MLCGSolver::ParallelAllReduce 2754 0.02294 0.02294 0.02294 0.49% Castro::estTimeStep() 29 0.02112 0.02112 0.02112 0.45% Castro::initData() 3 0.02112 0.02112 0.02112 0.45% MultiFab::Multiply() 408 0.02108 0.02108 0.02108 0.45% MLMG::mgVcycle_up::3 117 0.02097 0.02097 0.02097 0.45% MLMG::mgVcycle_up::2 117 0.02066 0.02066 0.02066 0.44% Amr::grid_places() 6 0.02009 0.02009 0.02009 0.43% AmrMesh::MakeNewGrids() 6 0.01996 0.01996 0.01996 0.42% MLMG::miniCycle() 44 0.01959 0.01959 0.01959 0.42% Castro::enforce_min_density() 119 0.01934 0.01934 0.01934 0.41% MLMG::mgVcycle_down::4 87 0.01866 0.01866 0.01866 0.40% MLMG::prepareForSolve() 25 0.01828 0.01828 0.01828 0.39% MultiFab::Xpay() 892 0.01791 0.01791 0.01791 0.38% MLMG::mgVcycle_up::4 87 0.01488 0.01488 0.01488 0.32% Castro::finalize_advance() 10 0.01402 0.01402 0.01402 0.30% Castro::construct_old_source() 70 0.01367 0.01367 0.01367 0.29% Castro::construct_new_gravity_source() 20 0.01171 0.01171 0.01171 0.25% MLPoisson::FFlux() 1326 0.01168 0.01168 0.01168 0.25% Castro::apply_source_to_state() 40 0.01146 0.01146 0.01146 0.24% FabArrayBase::getCPC() 2980 0.01124 0.01124 0.01124 0.24% Castro::computeNewDt() 8 0.01071 0.01071 0.01071 0.23% MLMG::computeResWithCrseCorFineCor() 22 0.01067 0.01067 0.01067 0.23% MLMG::getGradSolution() 25 0.01063 0.01063 0.01063 0.23% MLCellLinOp::compGrad() 30 0.01061 0.01061 0.01061 0.23% MLCellLinOp::setLevelBC() 30 0.009929 0.009929 0.009929 0.21% Castro::init(old) 4 0.009805 0.009805 0.009805 0.21% FabArray::setVal(val, thecmd, scomp, ncomp) 1095 0.009558 0.009558 0.009558 0.20% MLCellLinOp::updateSolBC() 27 0.009362 0.009362 0.009362 0.20% Castro::construct_old_gravity_source() 20 0.008741 0.008741 0.008741 0.19% FabArrayBase::CPC::define() 1033 0.008494 0.008494 0.008494 0.18% FillPatchInterp(Fab) 33 0.008136 0.008136 0.008136 0.17% MLCellLinOp::updateCorBC() 22 0.007573 0.007573 0.007573 0.16% Castro::locWgtSum() 36 0.007277 0.007277 0.007277 0.15% MLMG::ResNormInf() 154 0.005132 0.005132 0.005132 0.11% Castro::check_for_nan() 20 0.004233 0.004233 0.004233 0.09% MultiFab::contains_nan() 20 0.004216 0.004216 0.004216 0.09% MLPoisson::prepareForSolve() 25 0.004129 0.004129 0.004129 0.09% MLCellLinOp::prepareForSolve() 25 0.004101 0.004101 0.004101 0.09% Castro::volProductSum() 12 0.004075 0.004075 0.004075 0.09% Gravity::swapTimeLevels() 10 0.004006 0.004006 0.004006 0.08% CellConservativeLinear::interp() 198 0.003982 0.003982 0.003982 0.08% Castro::avgDown() 6 0.003934 0.003934 0.003934 0.08% Castro::avgDown(state_indx) 30 0.003927 0.003927 0.003927 0.08% amrex::average_down_w_geom 30 0.003902 0.003902 0.003902 0.08% FabArray::mult() 72 0.00364 0.00364 0.00364 0.08% Castro::errorEst() 6 0.003633 0.003633 0.003633 0.08% Castro::computeInitialDt() 2 0.003567 0.003567 0.003567 0.08% Castro::fill_hybrid_hydro_source() 50 0.003399 0.003399 0.003399 0.07% TagBoxArray::mapPRD 6 0.002903 0.002903 0.002903 0.06% Castro::construct_new_hybrid_source() 20 0.002697 0.002697 0.002697 0.06% FabArrayBase::getFB() 6022 0.002557 0.002557 0.002557 0.05% Gravity::average_fine_ec_onto_crse_ec() 5 0.002421 0.002421 0.002421 0.05% Gravity::update_max_rhs() 10 0.002395 0.002395 0.002395 0.05% MLMG::interpCorrection_1 22 0.002388 0.002388 0.002388 0.05% Gravity::create_comp_minus_level_grad_phi() 5 0.002359 0.002359 0.002359 0.05% Gravity::GetCrsePhi() 10 0.002252 0.002252 0.002252 0.05% Castro::FluxRegFineAdd() 10 0.00201 0.00201 0.00201 0.04% MultiFab::max() 56 0.001799 0.001799 0.001799 0.04% MLMG::MLResNormInf() 32 0.001443 0.001443 0.001443 0.03% MultiFab::Subtract() 25 0.001258 0.001258 0.001258 0.03% FabArrayBase::FB::FB() 98 0.001222 0.001222 0.001222 0.03% MultiFab::Copy() 30 0.001202 0.001202 0.001202 0.03% Castro::build_fine_mask() 166 0.001196 0.001196 0.001196 0.03% OwnerMask() 6 0.0009291 0.0009291 0.0009291 0.02% MLMG::MLRhsNormInf() 25 0.0008944 0.0008944 0.0008944 0.02% TagBoxArray::collate() 6 0.0008147 0.0008147 0.0008147 0.02% MultiFab::norm0(mask) 17 0.0007967 0.0007967 0.0007967 0.02% MLLinOp::define() 25 0.0007951 0.0007951 0.0007951 0.02% MLLinOp::defineGrids() 25 0.0007349 0.0007349 0.0007349 0.02% Castro::construct_old_hybrid_source() 10 0.0007303 0.0007303 0.0007303 0.02% MultiFab::min() 10 0.0005919 0.0005919 0.0005919 0.01% Castro::apply_problem_tags() 6 0.0005262 0.0005262 0.0005262 0.01% Castro::react_state() 20 0.0004942 0.0004942 0.0004942 0.01% Castro::apply_tagging_restrictions() 6 0.0004802 0.0004802 0.0004802 0.01% Castro::construct_new_rotation_source() 20 0.0004546 0.0004546 0.0004546 0.01% AmrLevel::AmrLevel(dm) 7 0.0004161 0.0004161 0.0004161 0.01% MLMG::buildFineMask() 25 0.0003738 0.0003738 0.0003738 0.01% Castro::linear_to_hybrid_momentum() 3 0.0003665 0.0003665 0.0003665 0.01% StateData::define() 35 0.000339 0.000339 0.000339 0.01% Castro::swap_state_time_levels() 10 0.0002993 0.0002993 0.0002993 0.01% Castro::construct_old_rotation_source() 10 0.000226 0.000226 0.000226 0.00% Castro::enforce_consistent_e() 3 0.0002063 0.0002063 0.0002063 0.00% Castro::create_source_corrector() 10 0.0001977 0.0001977 0.0001977 0.00% AMRErrorTag::operator() 6 0.0001832 0.0001832 0.0001832 0.00% MLLinOp::makeAgglomeratedDMap 25 0.0001785 0.0001785 0.0001785 0.00% makeSFC 115 0.0001354 0.0001354 0.0001354 0.00% Castro::finalize_do_advance() 10 0.0001201 0.0001201 0.0001201 0.00% FabArrayBase::TheFPinfo() 33 8.51e-05 8.51e-05 8.51e-05 0.00% Castro::enforce_speed_limit() 119 7.47e-05 7.47e-05 7.47e-05 0.00% DistributionMapping::Distribute() 117 5.485e-05 5.485e-05 5.485e-05 0.00% FPinfo::FPinfo() 3 4.083e-05 4.083e-05 4.083e-05 0.00% Amr::writeSmallPlotFile() 1 4.065e-05 4.065e-05 4.065e-05 0.00% AmrMesh-cluster 6 3.54e-05 3.54e-05 3.54e-05 0.00% FabArray::RecvLayoutMask() 5 2.842e-05 2.842e-05 2.842e-05 0.00% ClusterList::intersect() 6 2.205e-05 2.205e-05 2.205e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.307e-05 1.307e-05 1.307e-05 0.00% Amr::initSubcycle() 1 1.274e-05 1.274e-05 1.274e-05 0.00% BoxList::parallelComplementIn() 12 1.174e-05 1.174e-05 1.174e-05 0.00% Castro::retry_advance_ctu() 10 7.592e-06 7.592e-06 7.592e-06 0.00% BoxList::complementIn 12 5.861e-06 5.861e-06 5.861e-06 0.00% Gravity::set_mass_offset() 6 5.107e-06 5.107e-06 5.107e-06 0.00% MLLinOp::makeSubCommunicator() 25 5.013e-06 5.013e-06 5.013e-06 0.00% ClusterList::chop() 6 1.972e-06 1.972e-06 1.972e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0e0, 0.0e0, 0.0e0] [TOP]::mg.v(nvals = 1) :: [2] Total GPU global memory (MB): 12066 Free GPU global memory (MB): 4849 [The Arena] space allocated (MB): 9049 [The Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (22.04-20-gfc55c67f72d2) finalized