Initializing AMReX (24.04-3-gd78e241d1ad4)... Initializing CUDA... CUDA initialized with 1 device. AMReX (24.04-3-gd78e241d1ad4) initialized Starting run at 19:16:49 UTC on 2024-04-02. Successfully read inputs file ... Castro git describe: 24.04-1-g670698e55 AMReX git describe: 24.04-3-gd78e241d1 Microphysics git describe: 24.04 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.00382724 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001906393 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009055517 Gravity::multilevel_solve_for_new_phi() time = 0.053361661 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.149807102 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003409932 on level 0 Castro::do_old_sources() time = 0.009258054 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.136516557 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.00738988 Gravity::multilevel_solve_for_new_phi() time = 0.042413212 Castro::construct_new_gravity() time = 0.046107131 on level 0 Castro::do_new_sources() time = 0.008157114 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.920806859 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.235230171 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002292746 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007589004 Gravity::multilevel_solve_for_new_phi() time = 0.060377336 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003459475 on level 0 Castro::do_old_sources() time = 0.006561867 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.179978165 on level 0 Castro::construct_old_gravity() time = 0.000351 on level 1 Castro::do_old_sources() time = 0.002162186 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.008275657 on level 1 Castro::reflux() at level 0 : time = 0.018563348 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007255736 Gravity::multilevel_solve_for_new_phi() time = 0.041280891 Castro::construct_new_gravity() time = 0.044908078 on level 0 Castro::do_new_sources() time = 0.007098272 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000400319 on level 1 Castro::do_new_sources() time = 0.002414595 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.161854908 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.386136109 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.002129713 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007258518 Gravity::multilevel_solve_for_new_phi() time = 0.015234283 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003496971 on level 0 Castro::do_old_sources() time = 0.006785518 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.166159102 on level 0 Castro::construct_old_gravity() time = 0.00034939 on level 1 Castro::do_old_sources() time = 0.002134451 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.006746543 on level 1 Castro::reflux() at level 0 : time = 0.019032024 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007221543 Gravity::multilevel_solve_for_new_phi() time = 0.028987497 Castro::construct_new_gravity() time = 0.032559068 on level 0 Castro::do_new_sources() time = 0.006797618 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000367601 on level 1 Castro::do_new_sources() time = 0.002056176 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.478307072 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.317224794 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.00214395 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007253812 Gravity::multilevel_solve_for_new_phi() time = 0.015247866 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003441014 on level 0 Castro::do_old_sources() time = 0.00658258 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.165753464 on level 0 Castro::construct_old_gravity() time = 0.000358477 on level 1 Castro::do_old_sources() time = 0.001647601 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.006654842 on level 1 Castro::reflux() at level 0 : time = 0.017475198 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007270008 Gravity::multilevel_solve_for_new_phi() time = 0.02900698 Castro::construct_new_gravity() time = 0.032682399 on level 0 Castro::do_new_sources() time = 0.007156847 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000437357 on level 1 Castro::do_new_sources() time = 0.001987806 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.519555725 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.310563262 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002103714 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007261846 Gravity::multilevel_solve_for_new_phi() time = 0.015336964 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003445105 on level 0 Castro::do_old_sources() time = 0.006817802 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.179495996 on level 0 Castro::construct_old_gravity() time = 0.000361453 on level 1 Castro::do_old_sources() time = 0.001586744 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.006779219 on level 1 Castro::reflux() at level 0 : time = 0.017696981 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007274949 Gravity::multilevel_solve_for_new_phi() time = 0.029081722 Castro::construct_new_gravity() time = 0.032665895 on level 0 Castro::do_new_sources() time = 0.006785437 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000431695 on level 1 Castro::do_new_sources() time = 0.00215045 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.3517883 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.322865321 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.158579346 seconds Ending run at 19:16:52 UTC on 2024-04-02. Run time = 3.167065024 Run time without initialization = 1.731466408 Average number of zones advanced per microsecond: 2.858 Average number of zones advanced per microsecond per rank: 2.858 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.167 ... 3.167 ... 3.167 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0462 1.0462 1.0462 33.03% Castro::construct_ctu_hydro_source() 9 0.8233 0.8233 0.8233 25.99% VisMF::Write(FabArray) 3 0.3016 0.3016 0.3016 9.52% Castro::initMFs() 5 0.1512 0.1512 0.1512 4.78% Gravity::fill_multipole_BCs() 10 0.07284 0.07284 0.07284 2.30% Castro::normalize_species() 87 0.06861 0.06861 0.06861 2.17% Castro::computeTemp() 88 0.06306 0.06306 0.06306 1.99% MLCellLinOp::applyBC() 1917 0.0484 0.0484 0.0484 1.53% FillBoundary_nowait() 1728 0.04285 0.04285 0.04285 1.35% FabArray::setVal() 920 0.03826 0.03826 0.03826 1.21% StateData::FillBoundary(geom) 650 0.03573 0.03573 0.03573 1.13% Castro::volInBoundary() 42 0.03111 0.03111 0.03111 0.98% FabArray::ParallelCopy_nowait() 954 0.03056 0.03056 0.03056 0.96% amrex::Copy() 441 0.02668 0.02668 0.02668 0.84% Castro::reset_internal_energy(MultiFab) 88 0.02314 0.02314 0.02314 0.73% FluxRegister::Reflux() 24 0.02246 0.02246 0.02246 0.71% MLCellLinOp::defineAuxData() 10 0.0216 0.0216 0.0216 0.68% amrex::Add() 136 0.01732 0.01732 0.01732 0.55% Castro::estTimeStep() 26 0.01703 0.01703 0.01703 0.54% FabArray::Saxpy() 604 0.01596 0.01596 0.01596 0.50% StateDataPhysBCFunct::() 95 0.01567 0.01567 0.01567 0.49% Castro::construct_new_source() 63 0.01419 0.01419 0.01419 0.45% BndryData::define() 26 0.01332 0.01332 0.01332 0.42% MLPoisson::Fsmooth() 1376 0.01262 0.01262 0.01262 0.40% Castro::reflux() 4 0.01093 0.01093 0.01093 0.35% Castro::problem_post_timestep() 10 0.01043 0.01043 0.01043 0.33% Castro::enforce_min_density() 87 0.01017 0.01017 0.01017 0.32% amrex::Dot() 466 0.00925 0.00925 0.00925 0.29% FabArray::norminf() 439 0.008823 0.008823 0.008823 0.28% MLCellLinOp::reflux() 30 0.008657 0.008657 0.008657 0.27% Castro::construct_old_gravity_source() 18 0.008463 0.008463 0.008463 0.27% Castro::FluxRegCrseInit 9 0.007947 0.007947 0.007947 0.25% MLPoisson::Fapply() 493 0.006883 0.006883 0.006883 0.22% Castro::initData() 1 0.00674 0.00674 0.00674 0.21% FabArray::Xpay() 353 0.006468 0.006468 0.006468 0.20% amrex::average_down 233 0.006198 0.006198 0.006198 0.20% AmrMesh::MakeNewGrids() 6 0.006167 0.006167 0.006167 0.19% Castro::construct_new_gravity_source() 9 0.005392 0.005392 0.005392 0.17% Castro::construct_old_source() 63 0.004721 0.004721 0.004721 0.15% Castro::wd_update() 6 0.004658 0.004658 0.004658 0.15% Castro::reset_internal_energy(Fab) 1476 0.004511 0.004511 0.004511 0.14% Amr::writePlotFile() 2 0.004496 0.004496 0.004496 0.14% MLMG::addInterpCorrection() 155 0.004452 0.004452 0.004452 0.14% FabArrayBase::CPC::define() 534 0.003764 0.003764 0.003764 0.12% Gravity::actual_solve_with_mlmg() 10 0.003729 0.003729 0.003729 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003703 0.003703 0.003703 0.12% FillPatchInterp(MF) 30 0.003687 0.003687 0.003687 0.12% FabArray::setDomainBndry() 92 0.003361 0.003361 0.003361 0.11% MultiFab::contains_nan() 18 0.003253 0.003253 0.003253 0.10% MLCellLinOp::compGrad() 18 0.002926 0.002926 0.002926 0.09% MLCellLinOp::defineBC() 10 0.002749 0.002749 0.002749 0.09% Castro::enforce_speed_limit() 87 0.002722 0.002722 0.002722 0.09% FabArray::mult() 55 0.002585 0.002585 0.002585 0.08% MLCellLinOp::setLevelBC() 18 0.002509 0.002509 0.002509 0.08% check_for_negative_density() 9 0.002346 0.002346 0.002346 0.07% Castro::apply_tagging_restrictions() 6 0.002083 0.002083 0.002083 0.07% MLCellLinOp::prepareForSolve() 10 0.002036 0.002036 0.002036 0.06% MLMG::prepareForSolve() 10 0.001863 0.001863 0.001863 0.06% Castro::fill_hybrid_hydro_source() 27 0.001672 0.001672 0.001672 0.05% Castro::post_timestep() 9 0.00165 0.00165 0.00165 0.05% MLPoisson::FFlux() 150 0.001538 0.001538 0.001538 0.05% MLCellLinOp::updateSolBC() 25 0.001396 0.001396 0.001396 0.04% TagBoxArray::mapPRD 6 0.001378 0.001378 0.001378 0.04% Gravity::get_new_grav_vector() 10 0.001303 0.001303 0.001303 0.04% FabArray::norminf(mask) 21 0.001227 0.001227 0.001227 0.04% FabArrayBase::getCPC() 1522 0.001141 0.001141 0.001141 0.04% MLCellLinOp::updateCorBC() 17 0.001045 0.001045 0.001045 0.03% Castro::build_fine_mask() 44 0.001009 0.001009 0.001009 0.03% OwnerMask() 6 0.001006 0.001006 0.001006 0.03% Gravity::get_old_grav_vector() 9 0.0009957 0.0009957 0.0009957 0.03% Castro::finalize_do_advance() 9 0.0009264 0.0009264 0.0009264 0.03% average_down_faces 48 0.0008913 0.0008913 0.0008913 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0008325 0.0008325 0.0008325 0.03% TagBoxArray::collate() 6 0.0008296 0.0008296 0.0008296 0.03% FillPatchTwoLevels 31 0.0007462 0.0007462 0.0007462 0.02% MLCGSolver::bicgstab 31 0.0007211 0.0007211 0.0007211 0.02% main() 1 0.0007181 0.0007181 0.0007181 0.02% Castro::FluxRegFineAdd() 9 0.0006723 0.0006723 0.0006723 0.02% AmrLevel::FillPatch() 62 0.0006202 0.0006202 0.0006202 0.02% MultiFab::max() 18 0.0006069 0.0006069 0.0006069 0.02% FillPatchIterator::Initialize 62 0.000555 0.000555 0.000555 0.02% Castro::apply_problem_tags() 6 0.0005196 0.0005196 0.0005196 0.02% MultiFab::Multiply() 8 0.0005095 0.0005095 0.0005095 0.02% MLCellLinOp::smooth() 688 0.0004985 0.0004985 0.0004985 0.02% Castro::linear_to_hybrid_momentum() 1 0.0004393 0.0004393 0.0004393 0.01% FabArrayBase::FB::FB() 37 0.0004343 0.0004343 0.0004343 0.01% Castro::Castro() 5 0.0004192 0.0004192 0.0004192 0.01% MLMG::interpCorrection_1 17 0.0004106 0.0004106 0.0004106 0.01% FabArray::FillBoundary() 1728 0.0003739 0.0003739 0.0003739 0.01% Amr::regrid() 5 0.0003606 0.0003606 0.0003606 0.01% FabArray::ParallelCopy() 954 0.0003211 0.0003211 0.0003211 0.01% Castro::clean_state() 87 0.0003152 0.0003152 0.0003152 0.01% Castro::initialize_do_advance() 9 0.000315 0.000315 0.000315 0.01% Gravity::update_max_rhs() 10 0.0002827 0.0002827 0.0002827 0.01% FabArrayBase::getFB() 1728 0.0002767 0.0002767 0.0002767 0.01% Amr::coarseTimeStep() 5 0.0002469 0.0002469 0.0002469 0.01% Castro::subcycle_advance_ctu() 5 0.0002455 0.0002455 0.0002455 0.01% Gravity::actual_multilevel_solve() 10 0.0002437 0.0002437 0.0002437 0.01% AMRErrorTag::operator() 6 0.0002304 0.0002304 0.0002304 0.01% MLCellLinOp::apply() 493 0.0002268 0.0002268 0.0002268 0.01% MLLinOp::defineGrids() 10 0.000218 0.000218 0.000218 0.01% Castro::do_old_sources() 9 0.0002151 0.0002151 0.0002151 0.01% Castro::construct_old_rotation_source() 9 0.0002148 0.0002148 0.0002148 0.01% Castro::construct_new_rotation_source() 9 0.0001985 0.0001985 0.0001985 0.01% Castro::initialize_advance() 9 0.0001741 0.0001741 0.0001741 0.01% StateData::define() 25 0.0001569 0.0001569 0.0001569 0.00% Castro::enforce_consistent_e() 1 0.0001474 0.0001474 0.0001474 0.00% Castro::construct_new_gravity() 9 0.0001443 0.0001443 0.0001443 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.000133 0.000133 0.000133 0.00% MLCGSolver::ParallelAllReduce 745 0.0001293 0.0001293 0.0001293 0.00% Castro::swap_state_time_levels() 9 0.0001248 0.0001248 0.0001248 0.00% Castro::do_new_sources() 9 0.0001227 0.0001227 0.0001227 0.00% Amr::grid_places() 6 0.0001174 0.0001174 0.0001174 0.00% MLMG::mgVcycle() 65 0.0001029 0.0001029 0.0001029 0.00% Castro::buildMetrics() 5 0.0001023 0.0001023 0.0001023 0.00% MLCellLinOp::correctionResidual() 189 9.65e-05 9.65e-05 9.65e-05 0.00% Castro::construct_old_gravity() 9 9.589e-05 9.589e-05 9.589e-05 0.00% Castro::do_advance_ctu() 5 9.532e-05 9.532e-05 9.532e-05 0.00% Castro::post_regrid() 10 9e-05 9e-05 9e-05 0.00% Castro::finalize_advance() 9 8.932e-05 8.932e-05 8.932e-05 0.00% AmrLevel::derive() 6 7.664e-05 7.664e-05 7.664e-05 0.00% Amr::timeStep() 9 7.425e-05 7.425e-05 7.425e-05 0.00% MLMG::oneIter() 31 5.858e-05 5.858e-05 5.858e-05 0.00% FillPatchSingleLevel 92 5.788e-05 5.788e-05 5.788e-05 0.00% Castro::create_source_corrector() 9 5.545e-05 5.545e-05 5.545e-05 0.00% Castro::advance() 5 5.302e-05 5.302e-05 5.302e-05 0.00% Castro::errorEst() 6 5.07e-05 5.07e-05 5.07e-05 0.00% FabArray::RecvLayoutMask() 8 4.904e-05 4.904e-05 4.904e-05 0.00% MLMG:computeResOfCorrection() 155 4.838e-05 4.838e-05 4.838e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.756e-05 4.756e-05 4.756e-05 0.00% MLMG::solve() 10 4.75e-05 4.75e-05 4.75e-05 0.00% Castro::computeNewDt() 8 4.663e-05 4.663e-05 4.663e-05 0.00% MLCellLinOp::solutionResidual() 71 4.308e-05 4.308e-05 4.308e-05 0.00% MLMG::mgVcycle_down::0 31 4.15e-05 4.15e-05 4.15e-05 0.00% MLMG::actualBottomSolve() 31 3.986e-05 3.986e-05 3.986e-05 0.00% MLMG::mgVcycle_bottom 65 3.889e-05 3.889e-05 3.889e-05 0.00% Amr::writeSmallPlotFile() 1 3.84e-05 3.84e-05 3.84e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.706e-05 3.706e-05 3.706e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.57e-05 3.57e-05 3.57e-05 0.00% Amr::defBaseLevel() 1 3.514e-05 3.514e-05 3.514e-05 0.00% Gravity::solve_phi_with_mlmg() 10 3.388e-05 3.388e-05 3.388e-05 0.00% MLMG::mgVcycle_down::1 31 3.237e-05 3.237e-05 3.237e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.149e-05 3.149e-05 3.149e-05 0.00% MLPoisson::define() 10 3.056e-05 3.056e-05 3.056e-05 0.00% MLMG::mgVcycle_down::3 31 3.039e-05 3.039e-05 3.039e-05 0.00% MLMG::mgVcycle_down::2 31 2.903e-05 2.903e-05 2.903e-05 0.00% makeSFC 50 2.803e-05 2.803e-05 2.803e-05 0.00% Castro::react_state() 18 2.668e-05 2.668e-05 2.668e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.667e-05 2.667e-05 2.667e-05 0.00% MLMG::mgVcycle_down::4 31 2.646e-05 2.646e-05 2.646e-05 0.00% MLMG::ResNormInf() 54 2.517e-05 2.517e-05 2.517e-05 0.00% MLMG::mgVcycle_up::4 31 2.159e-05 2.159e-05 2.159e-05 0.00% DistributionMapping::Distribute() 52 2.102e-05 2.102e-05 2.102e-05 0.00% MLMG::mgVcycle_up::3 31 1.974e-05 1.974e-05 1.974e-05 0.00% MLMG::mgVcycle_up::1 31 1.924e-05 1.924e-05 1.924e-05 0.00% FabArrayBase::TheFPinfo() 25 1.888e-05 1.888e-05 1.888e-05 0.00% FPinfo::FPinfo() 3 1.883e-05 1.883e-05 1.883e-05 0.00% MLMG::mgVcycle_up::0 31 1.876e-05 1.876e-05 1.876e-05 0.00% MLMG::mgVcycle_up::2 31 1.797e-05 1.797e-05 1.797e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.616e-05 1.616e-05 1.616e-05 0.00% Amr::initSubcycle() 1 1.549e-05 1.549e-05 1.549e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.5e-05 1.5e-05 1.5e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.444e-05 1.444e-05 1.444e-05 0.00% MLMG::computeResidual() 31 1.413e-05 1.413e-05 1.413e-05 0.00% MLMG::miniCycle() 34 1.392e-05 1.392e-05 1.392e-05 0.00% MLMG::computeMLResidual() 15 1.36e-05 1.36e-05 1.36e-05 0.00% Amr::FinalizeInit() 1 1.348e-05 1.348e-05 1.348e-05 0.00% MLLinOp::define() 10 1.344e-05 1.344e-05 1.344e-05 0.00% ClusterList::intersect() 4 1.265e-05 1.265e-05 1.265e-05 0.00% Castro::post_init() 1 1.046e-05 1.046e-05 1.046e-05 0.00% Castro::check_for_nan() 18 9.827e-06 9.827e-06 9.827e-06 0.00% MLMG::getGradSolution() 10 9.041e-06 9.041e-06 9.041e-06 0.00% Castro::apply_source_to_state() 18 8.834e-06 8.834e-06 8.834e-06 0.00% Castro::construct_new_hybrid_source() 9 8.399e-06 8.399e-06 8.399e-06 0.00% Castro::expand_state() 13 8.248e-06 8.248e-06 8.248e-06 0.00% Castro::avgDown(state_indx) 20 8.079e-06 8.079e-06 8.079e-06 0.00% Amr::InitializeInit() 1 7.732e-06 7.732e-06 7.732e-06 0.00% Gravity::swapTimeLevels() 9 7.61e-06 7.61e-06 7.61e-06 0.00% amrex::average_down_w_geom 20 7.479e-06 7.479e-06 7.479e-06 0.00% MLMG::MLResNormInf() 15 7.371e-06 7.371e-06 7.371e-06 0.00% AmrMesh-cluster 4 6.89e-06 6.89e-06 6.89e-06 0.00% Castro::construct_old_hybrid_source() 9 6.657e-06 6.657e-06 6.657e-06 0.00% MLPoisson::prepareForSolve() 10 6.629e-06 6.629e-06 6.629e-06 0.00% Castro::init(old) 3 5.341e-06 5.341e-06 5.341e-06 0.00% MLMG::MLRhsNormInf() 10 5.278e-06 5.278e-06 5.278e-06 0.00% BoxList::parallelComplementIn() 12 4.618e-06 4.618e-06 4.618e-06 0.00% BoxList::complementIn 12 4.519e-06 4.519e-06 4.519e-06 0.00% Castro::avgDown() 4 4.357e-06 4.357e-06 4.357e-06 0.00% Gravity::set_mass_offset() 6 4.33e-06 4.33e-06 4.33e-06 0.00% Castro::computeInitialDt() 2 3.763e-06 3.763e-06 3.763e-06 0.00% Castro::derive() 6 3.652e-06 3.652e-06 3.652e-06 0.00% Castro::retry_advance_ctu() 5 2.734e-06 2.734e-06 2.734e-06 0.00% Amr::bldFineLevels() 1 2.469e-06 2.469e-06 2.469e-06 0.00% Castro::init() 1 2.388e-06 2.388e-06 2.388e-06 0.00% ClusterList::chop() 4 1.865e-06 1.865e-06 1.865e-06 0.00% Amr::init() 1 1.85e-06 1.85e-06 1.85e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.672e-06 1.672e-06 1.672e-06 0.00% Amr::initialInit() 1 1.193e-06 1.193e-06 1.193e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.167 3.167 3.167 100.00% Amr::coarseTimeStep() 5 1.572 1.572 1.572 49.64% Amr::timeStep() 9 1.567 1.567 1.567 49.47% Castro::advance() 5 1.353 1.353 1.353 42.72% Castro::subcycle_advance_ctu() 5 1.331 1.331 1.331 42.02% Castro::do_advance_ctu() 5 1.33 1.33 1.33 42.01% Amr::InitAmr() 1 1.046 1.046 1.046 33.03% Castro::construct_ctu_hydro_source() 9 0.8564 0.8564 0.8564 27.04% Amr::init() 1 0.3892 0.3892 0.3892 12.29% Gravity::multilevel_solve_for_new_phi() 10 0.3305 0.3305 0.3305 10.44% Gravity::actual_multilevel_solve() 10 0.3297 0.3297 0.3297 10.41% Gravity::solve_phi_with_mlmg() 10 0.3265 0.3265 0.3265 10.31% Amr::writePlotFile() 2 0.3085 0.3085 0.3085 9.74% VisMF::Write(FabArray) 3 0.3016 0.3016 0.3016 9.52% Gravity::actual_solve_with_mlmg() 10 0.251 0.251 0.251 7.93% Amr::initialInit() 1 0.2393 0.2393 0.2393 7.56% MLMG::solve() 10 0.1968 0.1968 0.1968 6.21% Castro::construct_new_gravity() 9 0.1906 0.1906 0.1906 6.02% Castro::clean_state() 87 0.1711 0.1711 0.1711 5.40% MLMG::oneIter() 31 0.1668 0.1668 0.1668 5.27% Amr::InitializeInit() 1 0.1656 0.1656 0.1656 5.23% Amr::defBaseLevel() 1 0.1656 0.1656 0.1656 5.23% Castro::Castro() 5 0.1554 0.1554 0.1554 4.91% Castro::initMFs() 5 0.1512 0.1512 0.1512 4.78% Amr::regrid() 5 0.1479 0.1479 0.1479 4.67% MLMG::mgVcycle() 65 0.1435 0.1435 0.1435 4.53% Castro::post_regrid() 10 0.1334 0.1334 0.1334 4.21% AmrLevel::FillPatch() 62 0.0935 0.0935 0.0935 2.95% MLCellLinOp::applyBC() 1917 0.09234 0.09234 0.09234 2.92% Castro::computeTemp() 88 0.09071 0.09071 0.09071 2.86% MLCellLinOp::smooth() 688 0.08204 0.08204 0.08204 2.59% FillPatchIterator::Initialize 62 0.07905 0.07905 0.07905 2.50% Gravity::fill_multipole_BCs() 10 0.07495 0.07495 0.07495 2.37% Amr::FinalizeInit() 1 0.07372 0.07372 0.07372 2.33% Castro::reflux() 4 0.0728 0.0728 0.0728 2.30% FillPatchSingleLevel 92 0.07049 0.07049 0.07049 2.23% Castro::normalize_species() 87 0.06861 0.06861 0.06861 2.17% FillPatchIterator::FillFromLevel0() 31 0.06791 0.06791 0.06791 2.14% Castro::post_timestep() 9 0.06584 0.06584 0.06584 2.08% Castro::post_init() 1 0.0622 0.0622 0.0622 1.96% Castro::initialize_do_advance() 9 0.0533 0.0533 0.0533 1.68% Castro::problem_post_timestep() 10 0.05178 0.05178 0.05178 1.64% StateDataPhysBCFunct::() 95 0.05141 0.05141 0.05141 1.62% Castro::do_new_sources() 9 0.04467 0.04467 0.04467 1.41% FabArray::FillBoundary() 1728 0.04393 0.04393 0.04393 1.39% MLPoisson::define() 10 0.04363 0.04363 0.04363 1.38% Castro::do_old_sources() 9 0.04362 0.04362 0.04362 1.38% FillBoundary_nowait() 1728 0.04356 0.04356 0.04356 1.38% Castro::expand_state() 13 0.04291 0.04291 0.04291 1.35% MLMG::mgVcycle_bottom 65 0.03847 0.03847 0.03847 1.21% FabArray::setVal() 920 0.03826 0.03826 0.03826 1.21% Castro::wd_update() 6 0.03578 0.03578 0.03578 1.13% StateData::FillBoundary(geom) 650 0.03573 0.03573 0.03573 1.13% FabArray::ParallelCopy() 954 0.03489 0.03489 0.03489 1.10% FabArray::ParallelCopy_nowait() 954 0.03457 0.03457 0.03457 1.09% MLMG::actualBottomSolve() 31 0.03138 0.03138 0.03138 0.99% Castro::volInBoundary() 42 0.03112 0.03112 0.03112 0.98% MLCGSolver::bicgstab 31 0.03108 0.03108 0.03108 0.98% FluxRegister::Reflux() 24 0.02977 0.02977 0.02977 0.94% MLMG::mgVcycle_down::0 31 0.02929 0.02929 0.02929 0.92% MLCellLinOp::apply() 493 0.02796 0.02796 0.02796 0.88% Castro::reset_internal_energy(MultiFab) 88 0.02765 0.02765 0.02765 0.87% Castro::construct_new_source() 63 0.02684 0.02684 0.02684 0.85% amrex::Copy() 441 0.02668 0.02668 0.02668 0.84% MLCellLinOp::defineAuxData() 10 0.02498 0.02498 0.02498 0.79% Gravity::get_new_grav_vector() 10 0.02369 0.02369 0.02369 0.75% Castro::initialize_advance() 9 0.02209 0.02209 0.02209 0.70% MLMG::mgVcycle_up::0 31 0.02177 0.02177 0.02177 0.69% Castro::construct_old_gravity() 9 0.01876 0.01876 0.01876 0.59% Gravity::get_old_grav_vector() 9 0.01867 0.01867 0.01867 0.59% MLCellLinOp::correctionResidual() 189 0.01837 0.01837 0.01837 0.58% MLCellLinOp::defineBC() 10 0.01833 0.01833 0.01833 0.58% amrex::Add() 136 0.01732 0.01732 0.01732 0.55% Castro::estTimeStep() 26 0.01703 0.01703 0.01703 0.54% FabArray::Saxpy() 604 0.01596 0.01596 0.01596 0.50% BndryData::define() 26 0.01544 0.01544 0.01544 0.49% MLCellLinOp::reflux() 30 0.01495 0.01495 0.01495 0.47% MLCellLinOp::solutionResidual() 71 0.0146 0.0146 0.0146 0.46% Amr::grid_places() 6 0.01448 0.01448 0.01448 0.46% AmrMesh::MakeNewGrids() 6 0.01436 0.01436 0.01436 0.45% MLMG:computeResOfCorrection() 155 0.01403 0.01403 0.01403 0.44% MLMG::computeResWithCrseSolFineCor() 17 0.01316 0.01316 0.01316 0.42% Castro::construct_old_source() 63 0.01305 0.01305 0.01305 0.41% MLPoisson::Fsmooth() 1376 0.01262 0.01262 0.01262 0.40% MLMG::computeMLResidual() 15 0.01239 0.01239 0.01239 0.39% Castro::initData() 1 0.01185 0.01185 0.01185 0.37% MLMG::mgVcycle_down::1 31 0.01166 0.01166 0.01166 0.37% Castro::enforce_min_density() 87 0.01017 0.01017 0.01017 0.32% amrex::average_down 233 0.009935 0.009935 0.009935 0.31% amrex::Dot() 466 0.00925 0.00925 0.00925 0.29% Castro::FluxRegCrseInit 9 0.009009 0.009009 0.009009 0.28% MLMG::prepareForSolve() 10 0.008941 0.008941 0.008941 0.28% FabArray::norminf() 439 0.008823 0.008823 0.008823 0.28% Castro::construct_old_gravity_source() 18 0.008463 0.008463 0.008463 0.27% MLMG::mgVcycle_up::1 31 0.00844 0.00844 0.00844 0.27% Amr::bldFineLevels() 1 0.007963 0.007963 0.007963 0.25% Castro::computeNewDt() 8 0.00789 0.00789 0.00789 0.25% FillPatchIterator::FillFromTwoLevels() 31 0.007402 0.007402 0.007402 0.23% Castro::finalize_do_advance() 9 0.007373 0.007373 0.007373 0.23% FillPatchTwoLevels 31 0.007371 0.007371 0.007371 0.23% MLMG::miniCycle() 34 0.007109 0.007109 0.007109 0.22% MLPoisson::Fapply() 493 0.006883 0.006883 0.006883 0.22% MLMG::addInterpCorrection() 155 0.006881 0.006881 0.006881 0.22% MLMG::mgVcycle_down::2 31 0.006833 0.006833 0.006833 0.22% FabArray::Xpay() 353 0.006468 0.006468 0.006468 0.20% MLMG::mgVcycle_down::3 31 0.006217 0.006217 0.006217 0.20% MLMG::mgVcycle_down::4 31 0.006094 0.006094 0.006094 0.19% MLMG::computeResidual() 31 0.005905 0.005905 0.005905 0.19% Castro::construct_new_gravity_source() 9 0.005392 0.005392 0.005392 0.17% MLCGSolver::ParallelAllReduce 745 0.005223 0.005223 0.005223 0.16% MLMG::mgVcycle_up::3 31 0.004973 0.004973 0.004973 0.16% MLMG::mgVcycle_up::4 31 0.004937 0.004937 0.004937 0.16% FabArrayBase::getCPC() 1522 0.004905 0.004905 0.004905 0.15% MLMG::mgVcycle_up::2 31 0.004758 0.004758 0.004758 0.15% Castro::reset_internal_energy(Fab) 1476 0.004511 0.004511 0.004511 0.14% MLMG::getGradSolution() 10 0.004372 0.004372 0.004372 0.14% MLCellLinOp::compGrad() 18 0.004363 0.004363 0.004363 0.14% Castro::apply_source_to_state() 18 0.004224 0.004224 0.004224 0.13% Castro::errorEst() 6 0.003817 0.003817 0.003817 0.12% FabArrayBase::CPC::define() 534 0.003764 0.003764 0.003764 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003703 0.003703 0.003703 0.12% FillPatchInterp(MF) 30 0.003687 0.003687 0.003687 0.12% MLMG::computeResWithCrseCorFineCor() 17 0.003609 0.003609 0.003609 0.11% MLCellLinOp::updateSolBC() 25 0.003392 0.003392 0.003392 0.11% FabArray::setDomainBndry() 92 0.003361 0.003361 0.003361 0.11% Castro::check_for_nan() 18 0.003262 0.003262 0.003262 0.10% MultiFab::contains_nan() 18 0.003253 0.003253 0.003253 0.10% TagBoxArray::mapPRD 6 0.003227 0.003227 0.003227 0.10% Castro::init(old) 3 0.003025 0.003025 0.003025 0.10% Castro::computeInitialDt() 2 0.002743 0.002743 0.002743 0.09% Castro::enforce_speed_limit() 87 0.002722 0.002722 0.002722 0.09% FabArray::mult() 55 0.002585 0.002585 0.002585 0.08% Castro::buildMetrics() 5 0.002559 0.002559 0.002559 0.08% MLCellLinOp::setLevelBC() 18 0.002509 0.002509 0.002509 0.08% MLCellLinOp::updateCorBC() 17 0.002379 0.002379 0.002379 0.08% check_for_negative_density() 9 0.002346 0.002346 0.002346 0.07% MLMG::ResNormInf() 54 0.002103 0.002103 0.002103 0.07% Castro::apply_tagging_restrictions() 6 0.002083 0.002083 0.002083 0.07% Gravity::update_max_rhs() 10 0.002054 0.002054 0.002054 0.06% MLPoisson::prepareForSolve() 10 0.002043 0.002043 0.002043 0.06% MLCellLinOp::prepareForSolve() 10 0.002036 0.002036 0.002036 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.002004 0.002004 0.002004 0.06% Castro::fill_hybrid_hydro_source() 27 0.001672 0.001672 0.001672 0.05% MLPoisson::FFlux() 150 0.001538 0.001538 0.001538 0.05% average_down_faces 48 0.00133 0.00133 0.00133 0.04% FabArray::norminf(mask) 21 0.001227 0.001227 0.001227 0.04% Castro::avgDown() 4 0.00122 0.00122 0.00122 0.04% Castro::avgDown(state_indx) 20 0.001215 0.001215 0.001215 0.04% amrex::average_down_w_geom 20 0.001207 0.001207 0.001207 0.04% MLMG::MLResNormInf() 15 0.001149 0.001149 0.001149 0.04% Castro::construct_new_hybrid_source() 9 0.001055 0.001055 0.001055 0.03% Castro::build_fine_mask() 44 0.001009 0.001009 0.001009 0.03% OwnerMask() 6 0.001006 0.001006 0.001006 0.03% MLMG::interpCorrection_1 17 0.000981 0.000981 0.000981 0.03% Castro::derive() 6 0.0009332 0.0009332 0.0009332 0.03% AmrLevel::derive() 6 0.0009295 0.0009295 0.0009295 0.03% Castro::init() 1 0.0009061 0.0009061 0.0009061 0.03% AmrLevel::FillCoarsePatch() 5 0.0009038 0.0009038 0.0009038 0.03% TagBoxArray::collate() 6 0.0008296 0.0008296 0.0008296 0.03% FabArrayBase::getFB() 1728 0.000711 0.000711 0.000711 0.02% Gravity::swapTimeLevels() 9 0.0006892 0.0006892 0.0006892 0.02% Castro::FluxRegFineAdd() 9 0.0006723 0.0006723 0.0006723 0.02% Castro::construct_old_hybrid_source() 9 0.0006315 0.0006315 0.0006315 0.02% MLMG::MLRhsNormInf() 10 0.0006119 0.0006119 0.0006119 0.02% MultiFab::max() 18 0.0006069 0.0006069 0.0006069 0.02% Castro::apply_problem_tags() 6 0.0005196 0.0005196 0.0005196 0.02% MultiFab::Multiply() 8 0.0005095 0.0005095 0.0005095 0.02% Castro::linear_to_hybrid_momentum() 1 0.0004393 0.0004393 0.0004393 0.01% FabArrayBase::FB::FB() 37 0.0004343 0.0004343 0.0004343 0.01% Castro::react_state() 18 0.0003777 0.0003777 0.0003777 0.01% MLLinOp::define() 10 0.0002953 0.0002953 0.0002953 0.01% MLLinOp::defineGrids() 10 0.0002818 0.0002818 0.0002818 0.01% AMRErrorTag::operator() 6 0.0002304 0.0002304 0.0002304 0.01% Castro::construct_old_rotation_source() 9 0.0002148 0.0002148 0.0002148 0.01% Castro::construct_new_rotation_source() 9 0.0001985 0.0001985 0.0001985 0.01% AmrLevel::AmrLevel(dm) 5 0.0001926 0.0001926 0.0001926 0.01% StateData::define() 25 0.0001569 0.0001569 0.0001569 0.00% Castro::enforce_consistent_e() 1 0.0001474 0.0001474 0.0001474 0.00% Castro::swap_state_time_levels() 9 0.0001248 0.0001248 0.0001248 0.00% Castro::finalize_advance() 9 8.932e-05 8.932e-05 8.932e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 6.216e-05 6.216e-05 6.216e-05 0.00% Castro::create_source_corrector() 9 5.545e-05 5.545e-05 5.545e-05 0.00% FabArray::RecvLayoutMask() 8 4.904e-05 4.904e-05 4.904e-05 0.00% makeSFC 50 4.716e-05 4.716e-05 4.716e-05 0.00% Amr::writeSmallPlotFile() 1 3.84e-05 3.84e-05 3.84e-05 0.00% FabArrayBase::TheFPinfo() 25 3.772e-05 3.772e-05 3.772e-05 0.00% AmrMesh-cluster 4 2.141e-05 2.141e-05 2.141e-05 0.00% DistributionMapping::Distribute() 52 2.102e-05 2.102e-05 2.102e-05 0.00% FPinfo::FPinfo() 3 1.883e-05 1.883e-05 1.883e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.804e-05 1.804e-05 1.804e-05 0.00% Amr::initSubcycle() 1 1.549e-05 1.549e-05 1.549e-05 0.00% ClusterList::intersect() 4 1.265e-05 1.265e-05 1.265e-05 0.00% BoxList::parallelComplementIn() 12 9.137e-06 9.137e-06 9.137e-06 0.00% BoxList::complementIn 12 4.519e-06 4.519e-06 4.519e-06 0.00% Gravity::set_mass_offset() 6 4.33e-06 4.33e-06 4.33e-06 0.00% Castro::retry_advance_ctu() 5 2.734e-06 2.734e-06 2.734e-06 0.00% ClusterList::chop() 4 1.865e-06 1.865e-06 1.865e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.672e-06 1.672e-06 1.672e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1735 KiB 9037 MiB Castro::reflux() 436 436 12 MiB 666 MiB Castro::initMFs() 258 258 352 MiB 576 MiB Castro::swap_state_time_levels() 175 175 183 MiB 340 MiB StateData::define() 175 175 223 MiB 340 MiB Castro::initialize_do_advance() 143 143 127 MiB 325 MiB FillPatchIterator::Initialize 899 899 4084 KiB 303 MiB Amr::writePlotFile() 56 56 17 MiB 189 MiB Castro::problem_post_timestep() 162 162 793 KiB 167 MiB Castro::FluxRegCrseInit 660 660 445 KiB 167 MiB FluxRegister::Reflux() 648 648 1526 KiB 160 MiB Castro::initialize_advance() 143 143 51 MiB 121 MiB Castro::construct_new_source() 143 143 256 KiB 67 MiB Castro::construct_old_source() 143 143 137 KiB 67 MiB Castro::buildMetrics() 140 140 37 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 28 MiB 60 MiB Castro::Castro() 210 210 4103 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2673 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 195 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 245 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 875 KiB 16 MiB FillPatchTwoLevels 300 300 7565 B 11 MiB FillPatchInterp(MF) 330 330 4645 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 133 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4437 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 756 KiB 7424 KiB Castro::build_fine_mask() 224 224 1205 KiB 6912 KiB AmrLevel::derive() 162 162 2543 B 6912 KiB BndryData::define() 3624 3624 279 KiB 4243 KiB MLCellLinOp::reflux() 450 450 4887 B 2376 KiB Castro::wd_update() 6 6 25 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 401 B 2095 KiB amrex::average_down 1483 1483 2377 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 4773 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 787 B 867 KiB MLCellLinOp::defineBC() 276 276 3770 B 689 KiB Castro::estTimeStep() 26 26 2555 B 480 KiB VisMF::Write(FabArray) 1568 1568 2310 B 320 KiB Castro::normalize_species() 87 87 6974 B 320 KiB Castro::volInBoundary() 70 70 3187 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 126 B 204 KiB FabArray::norminf(mask) 29 29 185 B 163 KiB amrex::Dot() 559 559 433 B 160 KiB FabArray::norminf() 470 470 431 B 160 KiB MultiFab::max() 18 18 30 B 160 KiB check_for_negative_density() 9 9 119 B 160 KiB Castro::initData() 1 1 47 B 160 KiB FabArray::setVal() 419 419 56 KiB 120 KiB MLMG::interpCorrection_1 34 34 27 B 91 KiB average_down_faces 99 99 652 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 276 B 57 KiB MLPoisson::Fsmooth() 228 228 3059 B 55 KiB FillBoundary_nowait() 751 751 443 B 53 KiB TagBoxArray::mapPRD 324 324 41 B 45 KiB OwnerMask() 168 168 11 B 38 KiB MLCellLinOp::applyBC() 3834 3834 143 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9744 B 25 KiB MultiFab::contains_nan() 18 18 20 B 20 KiB StateData::FillBoundary(geom) 2538 2538 44 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 601 B 3456 B MLCGSolver::bicgstab 155 155 26 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 165 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 11 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 608 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1235 B 278 KiB FabArray::setVal() 419 419 56 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 276 B 57 KiB MLPoisson::Fsmooth() 228 228 3059 B 55 KiB FillBoundary_nowait() 751 751 443 B 53 KiB MLCellLinOp::applyBC() 1917 1917 143 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9744 B 25 KiB Gravity::get_new_grav_vector() 18 18 3399 B 20 KiB Gravity::get_old_grav_vector() 12 12 6678 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 44 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1365 B 6304 B MLMG::prepareForSolve() 18 18 228 B 3712 B FabArray::norminf(mask) 29 29 126 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 601 B 3456 B Castro::FluxRegCrseInit 12 12 8 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 624 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (24.04-3-gd78e241d1ad4) finalized