Initializing AMReX (24.04-6-g771c439170bf)... Initializing CUDA... CUDA initialized with 1 device. AMReX (24.04-6-g771c439170bf) initialized Starting run at 08:20:08 UTC on 2024-04-04. Successfully read inputs file ... Castro git describe: 24.04-2-ga882a0395 AMReX git describe: 24.04-6-g771c43917 Microphysics git describe: 24.04-1-gab9345c2 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003391862 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001846666 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009254005 Gravity::multilevel_solve_for_new_phi() time = 0.052773059 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.143468189 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003279953 on level 0 Castro::do_old_sources() time = 0.008390845 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.134382148 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.007364407 Gravity::multilevel_solve_for_new_phi() time = 0.041844422 Castro::construct_new_gravity() time = 0.045494438 on level 0 Castro::do_new_sources() time = 0.008529799 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.984736006 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.231924887 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002311147 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007885787 Gravity::multilevel_solve_for_new_phi() time = 0.060408558 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003384518 on level 0 Castro::do_old_sources() time = 0.007482538 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.1600324 on level 0 Castro::construct_old_gravity() time = 0.000382092 on level 1 Castro::do_old_sources() time = 0.001957972 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.009095677 on level 1 Castro::reflux() at level 0 : time = 0.017969807 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007237322 Gravity::multilevel_solve_for_new_phi() time = 0.041064389 Castro::construct_new_gravity() time = 0.044563567 on level 0 Castro::do_new_sources() time = 0.006550869 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000381734 on level 1 Castro::do_new_sources() time = 0.00226919 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.405711061 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.362737435 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.002052459 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007211534 Gravity::multilevel_solve_for_new_phi() time = 0.014983423 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003337618 on level 0 Castro::do_old_sources() time = 0.006680968 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.172939731 on level 0 Castro::construct_old_gravity() time = 0.000406768 on level 1 Castro::do_old_sources() time = 0.001469038 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.008424786 on level 1 Castro::reflux() at level 0 : time = 0.017700245 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007225705 Gravity::multilevel_solve_for_new_phi() time = 0.028647835 Castro::construct_new_gravity() time = 0.032167869 on level 0 Castro::do_new_sources() time = 0.006923783 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000370176 on level 1 Castro::do_new_sources() time = 0.002391407 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.411436873 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.318316547 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.001972951 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007178155 Gravity::multilevel_solve_for_new_phi() time = 0.014902799 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003413912 on level 0 Castro::do_old_sources() time = 0.006471135 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.16357862 on level 0 Castro::construct_old_gravity() time = 0.000363374 on level 1 Castro::do_old_sources() time = 0.001724237 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.006722447 on level 1 Castro::reflux() at level 0 : time = 0.01749785 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007253096 Gravity::multilevel_solve_for_new_phi() time = 0.036364395 Castro::construct_new_gravity() time = 0.039812279 on level 0 Castro::do_new_sources() time = 0.006682387 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000412999 on level 1 Castro::do_new_sources() time = 0.002292623 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.475407507 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.311205076 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002137178 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007235894 Gravity::multilevel_solve_for_new_phi() time = 0.015082464 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003310343 on level 0 Castro::do_old_sources() time = 0.006715362 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.153426078 on level 0 Castro::construct_old_gravity() time = 0.000348937 on level 1 Castro::do_old_sources() time = 0.002605404 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.013584026 on level 1 Castro::reflux() at level 0 : time = 0.018566002 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007200728 Gravity::multilevel_solve_for_new_phi() time = 0.029384027 Castro::construct_new_gravity() time = 0.034868154 on level 0 Castro::do_new_sources() time = 0.007011718 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000407444 on level 1 Castro::do_new_sources() time = 0.002407757 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.549310239 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.306044095 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.165582331 seconds Ending run at 08:20:12 UTC on 2024-04-04. Run time = 3.116872055 Run time without initialization = 1.696666502 Average number of zones advanced per microsecond: 2.916 Average number of zones advanced per microsecond per rank: 2.916 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.117 ... 3.117 ... 3.117 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0407 1.0407 1.0407 33.39% Castro::construct_ctu_hydro_source() 9 0.7862 0.7862 0.7862 25.22% VisMF::Write(FabArray) 3 0.3022 0.3022 0.3022 9.70% Castro::initMFs() 5 0.1501 0.1501 0.1501 4.82% Gravity::fill_multipole_BCs() 10 0.07313 0.07313 0.07313 2.35% Castro::normalize_species() 87 0.06299 0.06299 0.06299 2.02% Castro::computeTemp() 88 0.06003 0.06003 0.06003 1.93% MLCellLinOp::applyBC() 1917 0.04773 0.04773 0.04773 1.53% FillBoundary_nowait() 1728 0.04304 0.04304 0.04304 1.38% FabArray::setVal() 920 0.03782 0.03782 0.03782 1.21% StateData::FillBoundary(geom) 650 0.03435 0.03435 0.03435 1.10% FabArray::ParallelCopy_nowait() 954 0.03041 0.03041 0.03041 0.98% Castro::volInBoundary() 42 0.02702 0.02702 0.02702 0.87% amrex::Copy() 441 0.02652 0.02652 0.02652 0.85% FabArray::Saxpy() 604 0.0234 0.0234 0.0234 0.75% Castro::reset_internal_energy(MultiFab) 88 0.02251 0.02251 0.02251 0.72% FluxRegister::Reflux() 24 0.02244 0.02244 0.02244 0.72% MLCellLinOp::defineAuxData() 10 0.02015 0.02015 0.02015 0.65% amrex::Add() 136 0.01727 0.01727 0.01727 0.55% StateDataPhysBCFunct::() 95 0.01654 0.01654 0.01654 0.53% Castro::estTimeStep() 26 0.01597 0.01597 0.01597 0.51% Castro::construct_new_source() 63 0.01585 0.01585 0.01585 0.51% BndryData::define() 26 0.01252 0.01252 0.01252 0.40% MLPoisson::Fsmooth() 1376 0.01232 0.01232 0.01232 0.40% Castro::enforce_min_density() 87 0.01125 0.01125 0.01125 0.36% Castro::reflux() 4 0.01116 0.01116 0.01116 0.36% MLCellLinOp::reflux() 30 0.01058 0.01058 0.01058 0.34% Castro::problem_post_timestep() 10 0.009936 0.009936 0.009936 0.32% amrex::Dot() 466 0.008977 0.008977 0.008977 0.29% FabArray::norminf() 439 0.008534 0.008534 0.008534 0.27% Castro::FluxRegCrseInit 9 0.007959 0.007959 0.007959 0.26% Castro::construct_old_gravity_source() 18 0.007611 0.007611 0.007611 0.24% Castro::initData() 1 0.006894 0.006894 0.006894 0.22% MLPoisson::Fapply() 493 0.006745 0.006745 0.006745 0.22% FabArray::Xpay() 353 0.006352 0.006352 0.006352 0.20% amrex::average_down 233 0.006165 0.006165 0.006165 0.20% AmrMesh::MakeNewGrids() 6 0.005719 0.005719 0.005719 0.18% Castro::construct_new_gravity_source() 9 0.005093 0.005093 0.005093 0.16% Castro::construct_old_source() 63 0.004984 0.004984 0.004984 0.16% Amr::writePlotFile() 2 0.00454 0.00454 0.00454 0.15% MLMG::addInterpCorrection() 155 0.00447 0.00447 0.00447 0.14% Castro::reset_internal_energy(Fab) 1476 0.004251 0.004251 0.004251 0.14% Castro::wd_update() 6 0.004073 0.004073 0.004073 0.13% Gravity::actual_solve_with_mlmg() 10 0.003923 0.003923 0.003923 0.13% FabArrayBase::CPC::define() 534 0.003769 0.003769 0.003769 0.12% FillPatchInterp(MF) 30 0.003671 0.003671 0.003671 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003635 0.003635 0.003635 0.12% check_for_negative_density() 9 0.003324 0.003324 0.003324 0.11% FabArray::setDomainBndry() 92 0.00327 0.00327 0.00327 0.10% MultiFab::contains_nan() 18 0.003261 0.003261 0.003261 0.10% Castro::enforce_speed_limit() 87 0.003249 0.003249 0.003249 0.10% MLCellLinOp::compGrad() 18 0.002903 0.002903 0.002903 0.09% Castro::clean_state() 87 0.002809 0.002809 0.002809 0.09% MLCellLinOp::defineBC() 10 0.002692 0.002692 0.002692 0.09% FabArray::mult() 55 0.002589 0.002589 0.002589 0.08% MLCellLinOp::setLevelBC() 18 0.002412 0.002412 0.002412 0.08% MLCellLinOp::prepareForSolve() 10 0.001979 0.001979 0.001979 0.06% Castro::apply_tagging_restrictions() 6 0.001925 0.001925 0.001925 0.06% MLMG::prepareForSolve() 10 0.00186 0.00186 0.00186 0.06% Castro::fill_hybrid_hydro_source() 27 0.001704 0.001704 0.001704 0.05% MLPoisson::FFlux() 150 0.001477 0.001477 0.001477 0.05% MLCellLinOp::updateSolBC() 25 0.001363 0.001363 0.001363 0.04% TagBoxArray::mapPRD 6 0.001323 0.001323 0.001323 0.04% FabArray::norminf(mask) 21 0.001228 0.001228 0.001228 0.04% FabArrayBase::getCPC() 1522 0.001195 0.001195 0.001195 0.04% Gravity::get_new_grav_vector() 10 0.001182 0.001182 0.001182 0.04% Gravity::get_old_grav_vector() 9 0.001044 0.001044 0.001044 0.03% MLCellLinOp::updateCorBC() 17 0.001003 0.001003 0.001003 0.03% OwnerMask() 6 0.0009971 0.0009971 0.0009971 0.03% Castro::build_fine_mask() 44 0.0009414 0.0009414 0.0009414 0.03% average_down_faces 48 0.0008985 0.0008985 0.0008985 0.03% Castro::post_timestep() 9 0.0008622 0.0008622 0.0008622 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0008003 0.0008003 0.0008003 0.03% TagBoxArray::collate() 6 0.0007821 0.0007821 0.0007821 0.03% FillPatchTwoLevels 31 0.0007578 0.0007578 0.0007578 0.02% MLCGSolver::bicgstab 31 0.000721 0.000721 0.000721 0.02% Castro::advance() 5 0.0007068 0.0007068 0.0007068 0.02% Castro::FluxRegFineAdd() 9 0.000673 0.000673 0.000673 0.02% main() 1 0.0006579 0.0006579 0.0006579 0.02% AmrLevel::FillPatch() 62 0.0006476 0.0006476 0.0006476 0.02% MultiFab::max() 18 0.0006116 0.0006116 0.0006116 0.02% FillPatchIterator::Initialize 62 0.0005785 0.0005785 0.0005785 0.02% Castro::apply_problem_tags() 6 0.0005393 0.0005393 0.0005393 0.02% MultiFab::Multiply() 8 0.0005146 0.0005146 0.0005146 0.02% MLCellLinOp::smooth() 688 0.0005075 0.0005075 0.0005075 0.02% Castro::Castro() 5 0.0004568 0.0004568 0.0004568 0.01% FabArrayBase::FB::FB() 37 0.0004384 0.0004384 0.0004384 0.01% MLMG::interpCorrection_1 17 0.0004045 0.0004045 0.0004045 0.01% FabArray::FillBoundary() 1728 0.0003932 0.0003932 0.0003932 0.01% Amr::regrid() 5 0.0003579 0.0003579 0.0003579 0.01% Castro::linear_to_hybrid_momentum() 1 0.000339 0.000339 0.000339 0.01% FabArray::ParallelCopy() 954 0.0003347 0.0003347 0.0003347 0.01% Castro::initialize_do_advance() 9 0.0003128 0.0003128 0.0003128 0.01% FabArrayBase::getFB() 1728 0.0002971 0.0002971 0.0002971 0.01% Gravity::update_max_rhs() 10 0.0002668 0.0002668 0.0002668 0.01% Amr::coarseTimeStep() 5 0.0002531 0.0002531 0.0002531 0.01% Gravity::actual_multilevel_solve() 10 0.0002417 0.0002417 0.0002417 0.01% MLCellLinOp::apply() 493 0.0002348 0.0002348 0.0002348 0.01% AMRErrorTag::operator() 6 0.0002342 0.0002342 0.0002342 0.01% Castro::subcycle_advance_ctu() 5 0.0002182 0.0002182 0.0002182 0.01% Castro::construct_new_rotation_source() 9 0.0002129 0.0002129 0.0002129 0.01% MLLinOp::defineGrids() 10 0.0001968 0.0001968 0.0001968 0.01% Castro::construct_new_gravity() 9 0.0001847 0.0001847 0.0001847 0.01% Castro::construct_old_rotation_source() 9 0.0001836 0.0001836 0.0001836 0.01% Castro::do_advance_ctu() 5 0.0001834 0.0001834 0.0001834 0.01% Castro::initialize_advance() 9 0.0001767 0.0001767 0.0001767 0.01% Castro::do_old_sources() 9 0.0001711 0.0001711 0.0001711 0.01% StateData::define() 25 0.0001627 0.0001627 0.0001627 0.01% Castro::finalize_do_advance() 9 0.0001483 0.0001483 0.0001483 0.00% Castro::enforce_consistent_e() 1 0.0001468 0.0001468 0.0001468 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001418 0.0001418 0.0001418 0.00% MLCGSolver::ParallelAllReduce 745 0.0001346 0.0001346 0.0001346 0.00% Castro::swap_state_time_levels() 9 0.0001262 0.0001262 0.0001262 0.00% Castro::do_new_sources() 9 0.0001209 0.0001209 0.0001209 0.00% MLMG::mgVcycle() 65 0.0001049 0.0001049 0.0001049 0.00% Amr::grid_places() 6 0.0001033 0.0001033 0.0001033 0.00% Castro::buildMetrics() 5 0.0001026 0.0001026 0.0001026 0.00% Castro::construct_old_gravity() 9 9.879e-05 9.879e-05 9.879e-05 0.00% Castro::finalize_advance() 9 9.571e-05 9.571e-05 9.571e-05 0.00% Castro::post_regrid() 10 9.176e-05 9.176e-05 9.176e-05 0.00% MLCellLinOp::correctionResidual() 189 9.157e-05 9.157e-05 9.157e-05 0.00% AmrLevel::derive() 6 7.967e-05 7.967e-05 7.967e-05 0.00% Amr::timeStep() 9 7.784e-05 7.784e-05 7.784e-05 0.00% FillPatchSingleLevel 92 6.449e-05 6.449e-05 6.449e-05 0.00% MLMG::oneIter() 31 5.662e-05 5.662e-05 5.662e-05 0.00% MLMG:computeResOfCorrection() 155 5.353e-05 5.353e-05 5.353e-05 0.00% Castro::errorEst() 6 5.163e-05 5.163e-05 5.163e-05 0.00% FabArray::RecvLayoutMask() 8 5.001e-05 5.001e-05 5.001e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.86e-05 4.86e-05 4.86e-05 0.00% MLMG::solve() 10 4.859e-05 4.859e-05 4.859e-05 0.00% Castro::computeNewDt() 8 4.198e-05 4.198e-05 4.198e-05 0.00% MLMG::mgVcycle_down::0 31 4.189e-05 4.189e-05 4.189e-05 0.00% MLCellLinOp::solutionResidual() 71 4.064e-05 4.064e-05 4.064e-05 0.00% MLMG::mgVcycle_bottom 65 3.962e-05 3.962e-05 3.962e-05 0.00% Castro::react_state() 18 3.96e-05 3.96e-05 3.96e-05 0.00% MLMG::actualBottomSolve() 31 3.887e-05 3.887e-05 3.887e-05 0.00% Amr::writeSmallPlotFile() 1 3.773e-05 3.773e-05 3.773e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.71e-05 3.71e-05 3.71e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.695e-05 3.695e-05 3.695e-05 0.00% Castro::create_source_corrector() 9 3.666e-05 3.666e-05 3.666e-05 0.00% Amr::defBaseLevel() 1 3.601e-05 3.601e-05 3.601e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.302e-05 3.302e-05 3.302e-05 0.00% MLMG::mgVcycle_down::1 31 3.301e-05 3.301e-05 3.301e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 3.183e-05 3.183e-05 3.183e-05 0.00% MLMG::mgVcycle_down::3 31 3.087e-05 3.087e-05 3.087e-05 0.00% MLMG::mgVcycle_down::2 31 3.079e-05 3.079e-05 3.079e-05 0.00% Gravity::solve_phi_with_mlmg() 10 3.068e-05 3.068e-05 3.068e-05 0.00% makeSFC 50 2.728e-05 2.728e-05 2.728e-05 0.00% MLMG::mgVcycle_down::4 31 2.722e-05 2.722e-05 2.722e-05 0.00% MLPoisson::define() 10 2.636e-05 2.636e-05 2.636e-05 0.00% MLMG::ResNormInf() 54 2.478e-05 2.478e-05 2.478e-05 0.00% MLMG::mgVcycle_up::4 31 2.421e-05 2.421e-05 2.421e-05 0.00% MLMG::mgVcycle_up::3 31 2.125e-05 2.125e-05 2.125e-05 0.00% MLMG::mgVcycle_up::0 31 2.061e-05 2.061e-05 2.061e-05 0.00% FabArrayBase::TheFPinfo() 25 2.044e-05 2.044e-05 2.044e-05 0.00% DistributionMapping::Distribute() 52 2.014e-05 2.014e-05 2.014e-05 0.00% MLMG::mgVcycle_up::1 31 1.961e-05 1.961e-05 1.961e-05 0.00% FPinfo::FPinfo() 3 1.936e-05 1.936e-05 1.936e-05 0.00% MLMG::mgVcycle_up::2 31 1.894e-05 1.894e-05 1.894e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.752e-05 1.752e-05 1.752e-05 0.00% MLMG::computeMLResidual() 15 1.713e-05 1.713e-05 1.713e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.462e-05 1.462e-05 1.462e-05 0.00% MLMG::computeResidual() 31 1.421e-05 1.421e-05 1.421e-05 0.00% MLMG::miniCycle() 34 1.419e-05 1.419e-05 1.419e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.371e-05 1.371e-05 1.371e-05 0.00% Amr::initSubcycle() 1 1.367e-05 1.367e-05 1.367e-05 0.00% Amr::FinalizeInit() 1 1.362e-05 1.362e-05 1.362e-05 0.00% MLLinOp::define() 10 1.299e-05 1.299e-05 1.299e-05 0.00% ClusterList::intersect() 4 1.225e-05 1.225e-05 1.225e-05 0.00% Castro::check_for_nan() 18 1.121e-05 1.121e-05 1.121e-05 0.00% Castro::post_init() 1 1.106e-05 1.106e-05 1.106e-05 0.00% BoxList::parallelComplementIn() 12 1.039e-05 1.039e-05 1.039e-05 0.00% MLMG::getGradSolution() 10 8.927e-06 8.927e-06 8.927e-06 0.00% Castro::expand_state() 13 8.674e-06 8.674e-06 8.674e-06 0.00% Castro::apply_source_to_state() 18 8.273e-06 8.273e-06 8.273e-06 0.00% AmrMesh-cluster 4 8.017e-06 8.017e-06 8.017e-06 0.00% Castro::construct_new_hybrid_source() 9 7.924e-06 7.924e-06 7.924e-06 0.00% Gravity::swapTimeLevels() 9 7.429e-06 7.429e-06 7.429e-06 0.00% MLMG::MLResNormInf() 15 7.366e-06 7.366e-06 7.366e-06 0.00% Castro::avgDown(state_indx) 20 7.118e-06 7.118e-06 7.118e-06 0.00% Amr::InitializeInit() 1 7.02e-06 7.02e-06 7.02e-06 0.00% amrex::average_down_w_geom 20 6.904e-06 6.904e-06 6.904e-06 0.00% MLPoisson::prepareForSolve() 10 6.653e-06 6.653e-06 6.653e-06 0.00% Castro::construct_old_hybrid_source() 9 6.609e-06 6.609e-06 6.609e-06 0.00% MLMG::MLRhsNormInf() 10 5.363e-06 5.363e-06 5.363e-06 0.00% Castro::init(old) 3 4.88e-06 4.88e-06 4.88e-06 0.00% BoxList::complementIn 12 4.568e-06 4.568e-06 4.568e-06 0.00% Castro::avgDown() 4 3.964e-06 3.964e-06 3.964e-06 0.00% Gravity::set_mass_offset() 6 3.857e-06 3.857e-06 3.857e-06 0.00% Castro::derive() 6 3.583e-06 3.583e-06 3.583e-06 0.00% Castro::retry_advance_ctu() 5 3.123e-06 3.123e-06 3.123e-06 0.00% Amr::bldFineLevels() 1 2.687e-06 2.687e-06 2.687e-06 0.00% Castro::computeInitialDt() 2 2.437e-06 2.437e-06 2.437e-06 0.00% Castro::init() 1 2.155e-06 2.155e-06 2.155e-06 0.00% Amr::init() 1 2.151e-06 2.151e-06 2.151e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.906e-06 1.906e-06 1.906e-06 0.00% ClusterList::chop() 4 1.876e-06 1.876e-06 1.876e-06 0.00% Amr::initialInit() 1 1.215e-06 1.215e-06 1.215e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.117 3.117 3.117 100.00% Amr::coarseTimeStep() 5 1.53 1.53 1.53 49.10% Amr::timeStep() 9 1.525 1.525 1.525 48.93% Castro::advance() 5 1.321 1.321 1.321 42.38% Castro::subcycle_advance_ctu() 5 1.298 1.298 1.298 41.63% Castro::do_advance_ctu() 5 1.297 1.297 1.297 41.62% Amr::InitAmr() 1 1.041 1.041 1.041 33.39% Castro::construct_ctu_hydro_source() 9 0.8222 0.8222 0.8222 26.38% Amr::init() 1 0.3794 0.3794 0.3794 12.17% Gravity::multilevel_solve_for_new_phi() 10 0.3356 0.3356 0.3356 10.77% Gravity::actual_multilevel_solve() 10 0.3348 0.3348 0.3348 10.74% Gravity::solve_phi_with_mlmg() 10 0.3316 0.3316 0.3316 10.64% Amr::writePlotFile() 2 0.3092 0.3092 0.3092 9.92% VisMF::Write(FabArray) 3 0.3022 0.3022 0.3022 9.70% Gravity::actual_solve_with_mlmg() 10 0.256 0.256 0.256 8.21% Amr::initialInit() 1 0.2359 0.2359 0.2359 7.57% MLMG::solve() 10 0.204 0.204 0.204 6.54% Castro::construct_new_gravity() 9 0.1986 0.1986 0.1986 6.37% MLMG::oneIter() 31 0.1734 0.1734 0.1734 5.56% Castro::clean_state() 87 0.1657 0.1657 0.1657 5.32% Amr::InitializeInit() 1 0.1642 0.1642 0.1642 5.27% Amr::defBaseLevel() 1 0.1642 0.1642 0.1642 5.27% Castro::Castro() 5 0.1542 0.1542 0.1542 4.95% Castro::initMFs() 5 0.1501 0.1501 0.1501 4.82% MLMG::mgVcycle() 65 0.1494 0.1494 0.1494 4.79% Amr::regrid() 5 0.1452 0.1452 0.1452 4.66% Castro::post_regrid() 10 0.1307 0.1307 0.1307 4.19% AmrLevel::FillPatch() 62 0.09289 0.09289 0.09289 2.98% MLCellLinOp::applyBC() 1917 0.0919 0.0919 0.0919 2.95% Castro::computeTemp() 88 0.0868 0.0868 0.0868 2.78% MLCellLinOp::smooth() 688 0.08128 0.08128 0.08128 2.61% FillPatchIterator::Initialize 62 0.07844 0.07844 0.07844 2.52% Gravity::fill_multipole_BCs() 10 0.07516 0.07516 0.07516 2.41% Castro::reflux() 4 0.07177 0.07177 0.07177 2.30% Amr::FinalizeInit() 1 0.07165 0.07165 0.07165 2.30% FillPatchSingleLevel 92 0.07001 0.07001 0.07001 2.25% FillPatchIterator::FillFromLevel0() 31 0.06738 0.06738 0.06738 2.16% Castro::normalize_species() 87 0.06299 0.06299 0.06299 2.02% Castro::post_init() 1 0.06126 0.06126 0.06126 1.97% Castro::post_timestep() 9 0.05913 0.05913 0.05913 1.90% StateDataPhysBCFunct::() 95 0.05089 0.05089 0.05089 1.63% Castro::initialize_do_advance() 9 0.05044 0.05044 0.05044 1.62% Castro::problem_post_timestep() 10 0.04631 0.04631 0.04631 1.49% Castro::do_new_sources() 9 0.04513 0.04513 0.04513 1.45% MLMG::mgVcycle_bottom 65 0.04509 0.04509 0.04509 1.45% FabArray::FillBoundary() 1728 0.04417 0.04417 0.04417 1.42% FillBoundary_nowait() 1728 0.04378 0.04378 0.04378 1.40% Castro::do_old_sources() 9 0.04358 0.04358 0.04358 1.40% Castro::expand_state() 13 0.04132 0.04132 0.04132 1.33% MLPoisson::define() 10 0.04126 0.04126 0.04126 1.32% MLMG::actualBottomSolve() 31 0.03807 0.03807 0.03807 1.22% FabArray::setVal() 920 0.03782 0.03782 0.03782 1.21% MLCGSolver::bicgstab 31 0.03779 0.03779 0.03779 1.21% FabArray::ParallelCopy() 954 0.03477 0.03477 0.03477 1.12% FabArray::ParallelCopy_nowait() 954 0.03443 0.03443 0.03443 1.10% StateData::FillBoundary(geom) 650 0.03435 0.03435 0.03435 1.10% Castro::wd_update() 6 0.0311 0.0311 0.0311 1.00% FluxRegister::Reflux() 24 0.0297 0.0297 0.0297 0.95% MLMG::mgVcycle_down::0 31 0.02932 0.02932 0.02932 0.94% Castro::construct_new_source() 63 0.0282 0.0282 0.0282 0.90% MLCellLinOp::apply() 493 0.0278 0.0278 0.0278 0.89% Castro::volInBoundary() 42 0.02702 0.02702 0.02702 0.87% Castro::reset_internal_energy(MultiFab) 88 0.02676 0.02676 0.02676 0.86% amrex::Copy() 441 0.02652 0.02652 0.02652 0.85% Gravity::get_new_grav_vector() 10 0.025 0.025 0.025 0.80% MLCellLinOp::defineAuxData() 10 0.02352 0.02352 0.02352 0.75% FabArray::Saxpy() 604 0.0234 0.0234 0.0234 0.75% Castro::initialize_advance() 9 0.02246 0.02246 0.02246 0.72% MLMG::mgVcycle_up::0 31 0.02188 0.02188 0.02188 0.70% Castro::construct_old_gravity() 9 0.01832 0.01832 0.01832 0.59% Gravity::get_old_grav_vector() 9 0.01822 0.01822 0.01822 0.58% MLCellLinOp::correctionResidual() 189 0.01814 0.01814 0.01814 0.58% MLCellLinOp::defineBC() 10 0.01745 0.01745 0.01745 0.56% amrex::Add() 136 0.01727 0.01727 0.01727 0.55% MLCellLinOp::reflux() 30 0.01677 0.01677 0.01677 0.54% Castro::estTimeStep() 26 0.01597 0.01597 0.01597 0.51% BndryData::define() 26 0.01462 0.01462 0.01462 0.47% MLCellLinOp::solutionResidual() 71 0.01451 0.01451 0.01451 0.47% MLMG::computeResWithCrseSolFineCor() 17 0.01415 0.01415 0.01415 0.45% MLMG:computeResOfCorrection() 155 0.01391 0.01391 0.01391 0.45% Amr::grid_places() 6 0.01377 0.01377 0.01377 0.44% AmrMesh::MakeNewGrids() 6 0.01367 0.01367 0.01367 0.44% MLMG::computeMLResidual() 15 0.01325 0.01325 0.01325 0.43% Castro::construct_old_source() 63 0.0128 0.0128 0.0128 0.41% MLPoisson::Fsmooth() 1376 0.01232 0.01232 0.01232 0.40% Castro::initData() 1 0.01172 0.01172 0.01172 0.38% MLMG::mgVcycle_down::1 31 0.01161 0.01161 0.01161 0.37% Castro::enforce_min_density() 87 0.01125 0.01125 0.01125 0.36% amrex::average_down 233 0.009949 0.009949 0.009949 0.32% Castro::FluxRegCrseInit 9 0.009014 0.009014 0.009014 0.29% amrex::Dot() 466 0.008977 0.008977 0.008977 0.29% MLMG::prepareForSolve() 10 0.008749 0.008749 0.008749 0.28% FabArray::norminf() 439 0.008534 0.008534 0.008534 0.27% MLMG::mgVcycle_up::1 31 0.008398 0.008398 0.008398 0.27% Castro::construct_old_gravity_source() 18 0.007611 0.007611 0.007611 0.24% FillPatchIterator::FillFromTwoLevels() 31 0.007378 0.007378 0.007378 0.24% FillPatchTwoLevels 31 0.007345 0.007345 0.007345 0.24% Castro::computeNewDt() 8 0.007226 0.007226 0.007226 0.23% Amr::bldFineLevels() 1 0.007117 0.007117 0.007117 0.23% MLMG::miniCycle() 34 0.007027 0.007027 0.007027 0.23% MLMG::addInterpCorrection() 155 0.006889 0.006889 0.006889 0.22% MLPoisson::Fapply() 493 0.006745 0.006745 0.006745 0.22% MLMG::mgVcycle_down::2 31 0.006715 0.006715 0.006715 0.22% FabArray::Xpay() 353 0.006352 0.006352 0.006352 0.20% Castro::finalize_do_advance() 9 0.006299 0.006299 0.006299 0.20% MLMG::mgVcycle_down::3 31 0.006093 0.006093 0.006093 0.20% MLMG::mgVcycle_down::4 31 0.005953 0.005953 0.005953 0.19% MLMG::computeResidual() 31 0.005795 0.005795 0.005795 0.19% MLCGSolver::ParallelAllReduce 745 0.005095 0.005095 0.005095 0.16% Castro::construct_new_gravity_source() 9 0.005093 0.005093 0.005093 0.16% FabArrayBase::getCPC() 1522 0.004964 0.004964 0.004964 0.16% MLMG::mgVcycle_up::4 31 0.004879 0.004879 0.004879 0.16% MLMG::mgVcycle_up::2 31 0.004667 0.004667 0.004667 0.15% MLMG::mgVcycle_up::3 31 0.004663 0.004663 0.004663 0.15% MLMG::getGradSolution() 10 0.004409 0.004409 0.004409 0.14% MLCellLinOp::compGrad() 18 0.0044 0.0044 0.0044 0.14% Castro::reset_internal_energy(Fab) 1476 0.004251 0.004251 0.004251 0.14% Castro::apply_source_to_state() 18 0.004226 0.004226 0.004226 0.14% FabArrayBase::CPC::define() 534 0.003769 0.003769 0.003769 0.12% Castro::errorEst() 6 0.003677 0.003677 0.003677 0.12% FillPatchInterp(MF) 30 0.003671 0.003671 0.003671 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003635 0.003635 0.003635 0.12% MLMG::computeResWithCrseCorFineCor() 17 0.003501 0.003501 0.003501 0.11% check_for_negative_density() 9 0.003324 0.003324 0.003324 0.11% MLCellLinOp::updateSolBC() 25 0.003296 0.003296 0.003296 0.11% Castro::check_for_nan() 18 0.003272 0.003272 0.003272 0.10% FabArray::setDomainBndry() 92 0.00327 0.00327 0.00327 0.10% MultiFab::contains_nan() 18 0.003261 0.003261 0.003261 0.10% Castro::enforce_speed_limit() 87 0.003249 0.003249 0.003249 0.10% TagBoxArray::mapPRD 6 0.003167 0.003167 0.003167 0.10% Castro::init(old) 3 0.002998 0.002998 0.002998 0.10% Castro::computeInitialDt() 2 0.002634 0.002634 0.002634 0.08% FabArray::mult() 55 0.002589 0.002589 0.002589 0.08% Castro::buildMetrics() 5 0.002468 0.002468 0.002468 0.08% MLCellLinOp::setLevelBC() 18 0.002412 0.002412 0.002412 0.08% MLCellLinOp::updateCorBC() 17 0.0023 0.0023 0.0023 0.07% MLMG::ResNormInf() 54 0.002096 0.002096 0.002096 0.07% Gravity::update_max_rhs() 10 0.002054 0.002054 0.002054 0.07% Gravity::average_fine_ec_onto_crse_ec() 8 0.001988 0.001988 0.001988 0.06% MLPoisson::prepareForSolve() 10 0.001986 0.001986 0.001986 0.06% MLCellLinOp::prepareForSolve() 10 0.001979 0.001979 0.001979 0.06% Castro::apply_tagging_restrictions() 6 0.001925 0.001925 0.001925 0.06% Castro::fill_hybrid_hydro_source() 27 0.001704 0.001704 0.001704 0.05% MLPoisson::FFlux() 150 0.001477 0.001477 0.001477 0.05% average_down_faces 48 0.00131 0.00131 0.00131 0.04% FabArray::norminf(mask) 21 0.001228 0.001228 0.001228 0.04% Castro::avgDown() 4 0.00118 0.00118 0.00118 0.04% Castro::avgDown(state_indx) 20 0.001176 0.001176 0.001176 0.04% amrex::average_down_w_geom 20 0.001169 0.001169 0.001169 0.04% MLMG::MLResNormInf() 15 0.00115 0.00115 0.00115 0.04% Castro::construct_new_hybrid_source() 9 0.001057 0.001057 0.001057 0.03% OwnerMask() 6 0.0009971 0.0009971 0.0009971 0.03% MLMG::interpCorrection_1 17 0.0009657 0.0009657 0.0009657 0.03% Castro::init() 1 0.0009554 0.0009554 0.0009554 0.03% AmrLevel::FillCoarsePatch() 5 0.0009533 0.0009533 0.0009533 0.03% Castro::build_fine_mask() 44 0.0009414 0.0009414 0.0009414 0.03% Castro::derive() 6 0.0009271 0.0009271 0.0009271 0.03% AmrLevel::derive() 6 0.0009235 0.0009235 0.0009235 0.03% TagBoxArray::collate() 6 0.0007821 0.0007821 0.0007821 0.03% FabArrayBase::getFB() 1728 0.0007355 0.0007355 0.0007355 0.02% Gravity::swapTimeLevels() 9 0.000676 0.000676 0.000676 0.02% Castro::FluxRegFineAdd() 9 0.000673 0.000673 0.000673 0.02% Castro::construct_old_hybrid_source() 9 0.0006619 0.0006619 0.0006619 0.02% MultiFab::max() 18 0.0006116 0.0006116 0.0006116 0.02% MLMG::MLRhsNormInf() 10 0.0006027 0.0006027 0.0006027 0.02% Castro::apply_problem_tags() 6 0.0005393 0.0005393 0.0005393 0.02% MultiFab::Multiply() 8 0.0005146 0.0005146 0.0005146 0.02% FabArrayBase::FB::FB() 37 0.0004384 0.0004384 0.0004384 0.01% Castro::react_state() 18 0.0003878 0.0003878 0.0003878 0.01% Castro::linear_to_hybrid_momentum() 1 0.000339 0.000339 0.000339 0.01% MLLinOp::define() 10 0.0002718 0.0002718 0.0002718 0.01% MLLinOp::defineGrids() 10 0.0002589 0.0002589 0.0002589 0.01% AMRErrorTag::operator() 6 0.0002342 0.0002342 0.0002342 0.01% Castro::construct_new_rotation_source() 9 0.0002129 0.0002129 0.0002129 0.01% AmrLevel::AmrLevel(dm) 5 0.0001998 0.0001998 0.0001998 0.01% Castro::construct_old_rotation_source() 9 0.0001836 0.0001836 0.0001836 0.01% StateData::define() 25 0.0001627 0.0001627 0.0001627 0.01% Castro::enforce_consistent_e() 1 0.0001468 0.0001468 0.0001468 0.00% Castro::swap_state_time_levels() 9 0.0001262 0.0001262 0.0001262 0.00% Castro::finalize_advance() 9 9.571e-05 9.571e-05 9.571e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 6.011e-05 6.011e-05 6.011e-05 0.00% FabArray::RecvLayoutMask() 8 5.001e-05 5.001e-05 5.001e-05 0.00% makeSFC 50 4.55e-05 4.55e-05 4.55e-05 0.00% FabArrayBase::TheFPinfo() 25 3.981e-05 3.981e-05 3.981e-05 0.00% Amr::writeSmallPlotFile() 1 3.773e-05 3.773e-05 3.773e-05 0.00% Castro::create_source_corrector() 9 3.666e-05 3.666e-05 3.666e-05 0.00% AmrMesh-cluster 4 2.214e-05 2.214e-05 2.214e-05 0.00% DistributionMapping::Distribute() 52 2.014e-05 2.014e-05 2.014e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.944e-05 1.944e-05 1.944e-05 0.00% FPinfo::FPinfo() 3 1.936e-05 1.936e-05 1.936e-05 0.00% BoxList::parallelComplementIn() 12 1.496e-05 1.496e-05 1.496e-05 0.00% Amr::initSubcycle() 1 1.367e-05 1.367e-05 1.367e-05 0.00% ClusterList::intersect() 4 1.225e-05 1.225e-05 1.225e-05 0.00% BoxList::complementIn 12 4.568e-06 4.568e-06 4.568e-06 0.00% Gravity::set_mass_offset() 6 3.857e-06 3.857e-06 3.857e-06 0.00% Castro::retry_advance_ctu() 5 3.123e-06 3.123e-06 3.123e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.906e-06 1.906e-06 1.906e-06 0.00% ClusterList::chop() 4 1.876e-06 1.876e-06 1.876e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1610 KiB 9037 MiB Castro::reflux() 436 436 12 MiB 666 MiB Castro::initMFs() 258 258 351 MiB 576 MiB Castro::swap_state_time_levels() 175 175 182 MiB 340 MiB StateData::define() 175 175 222 MiB 340 MiB Castro::initialize_do_advance() 143 143 127 MiB 325 MiB FillPatchIterator::Initialize 899 899 4046 KiB 303 MiB Amr::writePlotFile() 56 56 17 MiB 189 MiB Castro::problem_post_timestep() 162 162 759 KiB 167 MiB Castro::FluxRegCrseInit 660 660 452 KiB 167 MiB FluxRegister::Reflux() 648 648 1547 KiB 160 MiB Castro::initialize_advance() 143 143 50 MiB 121 MiB Castro::construct_new_source() 143 143 259 KiB 67 MiB Castro::construct_old_source() 143 143 127 KiB 67 MiB Castro::buildMetrics() 140 140 37 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 28 MiB 60 MiB Castro::Castro() 210 210 4035 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2820 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 193 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 264 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 927 KiB 16 MiB FillPatchTwoLevels 300 300 7662 B 11 MiB FillPatchInterp(MF) 330 330 4768 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 136 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4520 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 781 KiB 7424 KiB Castro::build_fine_mask() 224 224 1232 KiB 6912 KiB AmrLevel::derive() 162 162 2574 B 6912 KiB BndryData::define() 3624 3624 293 KiB 4243 KiB MLCellLinOp::reflux() 450 450 6400 B 2376 KiB Castro::wd_update() 6 6 22 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 435 B 2095 KiB amrex::average_down 1483 1483 2388 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 4610 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 799 B 867 KiB MLCellLinOp::defineBC() 276 276 4037 B 689 KiB Castro::estTimeStep() 26 26 2433 B 480 KiB VisMF::Write(FabArray) 1568 1568 2278 B 320 KiB Castro::normalize_species() 87 87 6573 B 320 KiB Castro::volInBoundary() 70 70 2810 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 127 B 204 KiB FabArray::norminf(mask) 29 29 196 B 163 KiB amrex::Dot() 559 559 427 B 160 KiB FabArray::norminf() 470 470 423 B 160 KiB MultiFab::max() 18 18 30 B 160 KiB check_for_negative_density() 9 9 173 B 160 KiB Castro::initData() 1 1 42 B 160 KiB FabArray::setVal() 419 419 55 KiB 120 KiB MLMG::interpCorrection_1 34 34 27 B 91 KiB average_down_faces 99 99 649 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 281 B 57 KiB MLPoisson::Fsmooth() 228 228 3231 B 55 KiB FillBoundary_nowait() 751 751 449 B 53 KiB TagBoxArray::mapPRD 324 324 41 B 45 KiB OwnerMask() 168 168 11 B 38 KiB MLCellLinOp::applyBC() 3834 3834 143 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9731 B 25 KiB MultiFab::contains_nan() 18 18 21 B 20 KiB StateData::FillBoundary(geom) 2538 2538 45 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 615 B 3456 B MLCGSolver::bicgstab 155 155 32 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 169 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 22 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 594 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1263 B 278 KiB FabArray::setVal() 419 419 55 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 281 B 57 KiB MLPoisson::Fsmooth() 228 228 3231 B 55 KiB FillBoundary_nowait() 751 751 449 B 53 KiB MLCellLinOp::applyBC() 1917 1917 143 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9731 B 25 KiB Gravity::get_new_grav_vector() 18 18 3348 B 20 KiB Gravity::get_old_grav_vector() 12 12 6632 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 45 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1359 B 6304 B MLMG::prepareForSolve() 18 18 240 B 3712 B FabArray::norminf(mask) 29 29 137 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 615 B 3456 B Castro::FluxRegCrseInit 12 12 9 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 621 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 4 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (24.04-6-g771c439170bf) finalized