Initializing AMReX (24.04-15-g7813bb7d6bc6)... Initializing CUDA... CUDA initialized with 1 device. AMReX (24.04-15-g7813bb7d6bc6) initialized Starting run at 08:19:47 UTC on 2024-04-15. Successfully read inputs file ... Castro git describe: 24.04-14-g3d76cd5a0 AMReX git describe: 24.04-15-g7813bb7d6 Microphysics git describe: 24.04-7-gd4312a6c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003821312 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.002026323 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.008933846 Gravity::multilevel_solve_for_new_phi() time = 0.055001239 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.179260567 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.007109629 on level 0 Castro::do_old_sources() time = 0.009548169 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.133054268 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.006703911 Gravity::multilevel_solve_for_new_phi() time = 0.042433285 Castro::construct_new_gravity() time = 0.04946597 on level 0 Castro::do_new_sources() time = 0.007680424 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.860888193 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.238962442 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002425175 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007474956 Gravity::multilevel_solve_for_new_phi() time = 0.063922771 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.006966309 on level 0 Castro::do_old_sources() time = 0.010933537 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.144731632 on level 0 Castro::construct_old_gravity() time = 0.000366414 on level 1 Castro::do_old_sources() time = 0.001975843 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.011982286 on level 1 Castro::reflux() at level 0 : time = 0.018122006 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007186987 Gravity::multilevel_solve_for_new_phi() time = 0.043433805 Castro::construct_new_gravity() time = 0.050339206 on level 0 Castro::do_new_sources() time = 0.006917434 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000391742 on level 1 Castro::do_new_sources() time = 0.002398457 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.260153689 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.384431413 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.002213226 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007178708 Gravity::multilevel_solve_for_new_phi() time = 0.015466486 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.006733855 on level 0 Castro::do_old_sources() time = 0.007020508 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.159079525 on level 0 Castro::construct_old_gravity() time = 0.00035809 on level 1 Castro::do_old_sources() time = 0.002219617 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007532328 on level 1 Castro::reflux() at level 0 : time = 0.017940372 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007241742 Gravity::multilevel_solve_for_new_phi() time = 0.028782598 Castro::construct_new_gravity() time = 0.032316915 on level 0 Castro::do_new_sources() time = 0.00720149 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000400933 on level 1 Castro::do_new_sources() time = 0.002572875 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.518161961 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.30962439 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002082094 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.00723573 Gravity::multilevel_solve_for_new_phi() time = 0.015088951 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003441588 on level 0 Castro::do_old_sources() time = 0.007442578 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.158471282 on level 0 Castro::construct_old_gravity() time = 0.000354738 on level 1 Castro::do_old_sources() time = 0.001698711 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.006766513 on level 1 Castro::reflux() at level 0 : time = 0.017721828 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007232299 Gravity::multilevel_solve_for_new_phi() time = 0.02891833 Castro::construct_new_gravity() time = 0.032372545 on level 0 Castro::do_new_sources() time = 0.007195842 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000380965 on level 1 Castro::do_new_sources() time = 0.002371843 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.614633232 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.303912203 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002045431 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007170922 Gravity::multilevel_solve_for_new_phi() time = 0.01504503 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003345692 on level 0 Castro::do_old_sources() time = 0.006949175 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.136918991 on level 0 Castro::construct_old_gravity() time = 0.000363918 on level 1 Castro::do_old_sources() time = 0.001684548 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.014383877 on level 1 Castro::reflux() at level 0 : time = 0.021488093 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007216604 Gravity::multilevel_solve_for_new_phi() time = 0.029061356 Castro::construct_new_gravity() time = 0.032603627 on level 0 Castro::do_new_sources() time = 0.010161018 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000379373 on level 1 Castro::do_new_sources() time = 0.002454487 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.673242499 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.300015763 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.150735024 seconds Ending run at 08:19:50 UTC on 2024-04-15. Run time = 3.168850247 Run time without initialization = 1.688514574 Average number of zones advanced per microsecond: 2.930 Average number of zones advanced per microsecond per rank: 2.930 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.169 ... 3.169 ... 3.169 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0581 1.0581 1.0581 33.39% Castro::construct_ctu_hydro_source() 9 0.7414 0.7414 0.7414 23.40% VisMF::Write(FabArray) 3 0.3231 0.3231 0.3231 10.20% Castro::initMFs() 5 0.1503 0.1503 0.1503 4.74% Castro::computeTemp() 88 0.07611 0.07611 0.07611 2.40% Gravity::fill_multipole_BCs() 10 0.07162 0.07162 0.07162 2.26% Castro::normalize_species() 87 0.06808 0.06808 0.06808 2.15% StateData::FillBoundary(geom) 650 0.06201 0.06201 0.06201 1.96% MLCellLinOp::applyBC() 1917 0.05025 0.05025 0.05025 1.59% FillBoundary_nowait() 1728 0.04332 0.04332 0.04332 1.37% FabArray::setVal() 920 0.03844 0.03844 0.03844 1.21% FabArray::ParallelCopy_nowait() 954 0.03102 0.03102 0.03102 0.98% Castro::volInBoundary() 42 0.02718 0.02718 0.02718 0.86% amrex::Copy() 441 0.02675 0.02675 0.02675 0.84% FluxRegister::Reflux() 24 0.02243 0.02243 0.02243 0.71% Castro::reset_internal_energy(MultiFab) 88 0.02195 0.02195 0.02195 0.69% MLCellLinOp::defineAuxData() 10 0.02116 0.02116 0.02116 0.67% Castro::enforce_min_density() 87 0.01797 0.01797 0.01797 0.57% amrex::Add() 136 0.01725 0.01725 0.01725 0.54% Castro::estTimeStep() 26 0.01667 0.01667 0.01667 0.53% FabArray::Saxpy() 604 0.01614 0.01614 0.01614 0.51% Castro::construct_new_source() 63 0.01501 0.01501 0.01501 0.47% Castro::reflux() 4 0.01423 0.01423 0.01423 0.45% MLPoisson::Fsmooth() 1376 0.01347 0.01347 0.01347 0.43% BndryData::define() 26 0.01317 0.01317 0.01317 0.42% StateDataPhysBCFunct::() 95 0.01156 0.01156 0.01156 0.36% Castro::problem_post_timestep() 10 0.01077 0.01077 0.01077 0.34% MLCellLinOp::reflux() 30 0.0101 0.0101 0.0101 0.32% amrex::Dot() 466 0.009462 0.009462 0.009462 0.30% FabArray::norminf() 439 0.008988 0.008988 0.008988 0.28% Castro::FluxRegCrseInit 9 0.007976 0.007976 0.007976 0.25% Castro::construct_old_gravity_source() 18 0.007788 0.007788 0.007788 0.25% MLPoisson::Fapply() 493 0.007112 0.007112 0.007112 0.22% AmrMesh::MakeNewGrids() 6 0.006608 0.006608 0.006608 0.21% FabArray::Xpay() 353 0.006605 0.006605 0.006605 0.21% Castro::initData() 1 0.006527 0.006527 0.006527 0.21% amrex::average_down 233 0.00644 0.00644 0.00644 0.20% Castro::reset_internal_energy(Fab) 1476 0.006074 0.006074 0.006074 0.19% Castro::construct_new_gravity_source() 9 0.005149 0.005149 0.005149 0.16% Castro::construct_old_source() 63 0.004694 0.004694 0.004694 0.15% MLMG::addInterpCorrection() 155 0.00469 0.00469 0.00469 0.15% Amr::writePlotFile() 2 0.004595 0.004595 0.004595 0.15% Castro::wd_update() 6 0.004481 0.004481 0.004481 0.14% Castro::enforce_speed_limit() 87 0.004137 0.004137 0.004137 0.13% Gravity::actual_solve_with_mlmg() 10 0.003826 0.003826 0.003826 0.12% FabArrayBase::CPC::define() 534 0.003803 0.003803 0.003803 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003778 0.003778 0.003778 0.12% FillPatchInterp(MF) 30 0.003659 0.003659 0.003659 0.12% FabArray::setDomainBndry() 92 0.00333 0.00333 0.00333 0.11% MultiFab::contains_nan() 18 0.003266 0.003266 0.003266 0.10% MLCellLinOp::compGrad() 18 0.002926 0.002926 0.002926 0.09% MLCellLinOp::defineBC() 10 0.002789 0.002789 0.002789 0.09% FabArray::mult() 55 0.002593 0.002593 0.002593 0.08% MLCellLinOp::setLevelBC() 18 0.002489 0.002489 0.002489 0.08% check_for_negative_density() 9 0.002231 0.002231 0.002231 0.07% Castro::clean_state() 87 0.00207 0.00207 0.00207 0.07% MLCellLinOp::prepareForSolve() 10 0.002054 0.002054 0.002054 0.06% MLMG::prepareForSolve() 10 0.001942 0.001942 0.001942 0.06% Castro::fill_hybrid_hydro_source() 27 0.001901 0.001901 0.001901 0.06% MLPoisson::FFlux() 150 0.001894 0.001894 0.001894 0.06% Castro::apply_tagging_restrictions() 6 0.001847 0.001847 0.001847 0.06% MLCellLinOp::updateSolBC() 25 0.001408 0.001408 0.001408 0.04% TagBoxArray::mapPRD 6 0.001392 0.001392 0.001392 0.04% FabArrayBase::getCPC() 1522 0.001269 0.001269 0.001269 0.04% FabArray::norminf(mask) 21 0.001227 0.001227 0.001227 0.04% Gravity::get_new_grav_vector() 10 0.001148 0.001148 0.001148 0.04% Gravity::get_old_grav_vector() 9 0.001053 0.001053 0.001053 0.03% MLCellLinOp::updateCorBC() 17 0.001034 0.001034 0.001034 0.03% OwnerMask() 6 0.001031 0.001031 0.001031 0.03% Castro::build_fine_mask() 44 0.0009842 0.0009842 0.0009842 0.03% MLCGSolver::bicgstab 31 0.000948 0.000948 0.000948 0.03% average_down_faces 48 0.0009166 0.0009166 0.0009166 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.000879 0.000879 0.000879 0.03% Castro::post_timestep() 9 0.0008638 0.0008638 0.0008638 0.03% Castro::advance() 5 0.000839 0.000839 0.000839 0.03% TagBoxArray::collate() 6 0.000821 0.000821 0.000821 0.03% FillPatchTwoLevels 31 0.0007727 0.0007727 0.0007727 0.02% MLCellLinOp::smooth() 688 0.0007659 0.0007659 0.0007659 0.02% AmrLevel::FillPatch() 62 0.0006837 0.0006837 0.0006837 0.02% main() 1 0.0006734 0.0006734 0.0006734 0.02% Castro::FluxRegFineAdd() 9 0.0006642 0.0006642 0.0006642 0.02% MultiFab::max() 18 0.0006186 0.0006186 0.0006186 0.02% FillPatchIterator::Initialize 62 0.0006106 0.0006106 0.0006106 0.02% MultiFab::Multiply() 8 0.0005058 0.0005058 0.0005058 0.02% Castro::apply_problem_tags() 6 0.0004866 0.0004866 0.0004866 0.02% FabArrayBase::FB::FB() 37 0.0004521 0.0004521 0.0004521 0.01% Castro::Castro() 5 0.0004317 0.0004317 0.0004317 0.01% MLMG::interpCorrection_1 17 0.0004317 0.0004317 0.0004317 0.01% FabArray::FillBoundary() 1728 0.0004166 0.0004166 0.0004166 0.01% Amr::regrid() 5 0.0004003 0.0004003 0.0004003 0.01% FabArray::ParallelCopy() 954 0.0003646 0.0003646 0.0003646 0.01% Castro::linear_to_hybrid_momentum() 1 0.000317 0.000317 0.000317 0.01% Castro::initialize_do_advance() 9 0.0003041 0.0003041 0.0003041 0.01% MLCellLinOp::apply() 493 0.0002993 0.0002993 0.0002993 0.01% FabArrayBase::getFB() 1728 0.0002945 0.0002945 0.0002945 0.01% Castro::subcycle_advance_ctu() 5 0.0002644 0.0002644 0.0002644 0.01% Gravity::actual_multilevel_solve() 10 0.0002563 0.0002563 0.0002563 0.01% Gravity::update_max_rhs() 10 0.0002538 0.0002538 0.0002538 0.01% Castro::do_advance_ctu() 5 0.0002493 0.0002493 0.0002493 0.01% Castro::construct_new_rotation_source() 9 0.0002436 0.0002436 0.0002436 0.01% AMRErrorTag::operator() 6 0.0002309 0.0002309 0.0002309 0.01% Amr::coarseTimeStep() 5 0.0002284 0.0002284 0.0002284 0.01% Castro::construct_old_rotation_source() 9 0.0002253 0.0002253 0.0002253 0.01% MLLinOp::defineGrids() 10 0.0002083 0.0002083 0.0002083 0.01% Castro::finalize_do_advance() 9 0.0001916 0.0001916 0.0001916 0.01% MLCGSolver::ParallelAllReduce 745 0.000157 0.000157 0.000157 0.00% StateData::define() 25 0.0001552 0.0001552 0.0001552 0.00% Castro::initialize_advance() 9 0.00015 0.00015 0.00015 0.00% Castro::do_old_sources() 9 0.0001487 0.0001487 0.0001487 0.00% Castro::construct_new_gravity() 9 0.0001484 0.0001484 0.0001484 0.00% Castro::enforce_consistent_e() 1 0.0001439 0.0001439 0.0001439 0.00% Castro::do_new_sources() 9 0.0001397 0.0001397 0.0001397 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001371 0.0001371 0.0001371 0.00% MLMG::mgVcycle() 65 0.000132 0.000132 0.000132 0.00% Castro::swap_state_time_levels() 9 0.0001314 0.0001314 0.0001314 0.00% MLCellLinOp::correctionResidual() 189 0.0001242 0.0001242 0.0001242 0.00% Castro::buildMetrics() 5 0.0001092 0.0001092 0.0001092 0.00% Castro::construct_old_gravity() 9 0.0001064 0.0001064 0.0001064 0.00% Castro::finalize_advance() 9 9.628e-05 9.628e-05 9.628e-05 0.00% Amr::grid_places() 6 9.57e-05 9.57e-05 9.57e-05 0.00% Castro::post_regrid() 10 8.248e-05 8.248e-05 8.248e-05 0.00% AmrLevel::derive() 6 7.911e-05 7.911e-05 7.911e-05 0.00% Amr::timeStep() 9 7.86e-05 7.86e-05 7.86e-05 0.00% MLMG::oneIter() 31 7.059e-05 7.059e-05 7.059e-05 0.00% FillPatchSingleLevel 92 6.741e-05 6.741e-05 6.741e-05 0.00% Castro::create_source_corrector() 9 5.98e-05 5.98e-05 5.98e-05 0.00% MLMG:computeResOfCorrection() 155 5.634e-05 5.634e-05 5.634e-05 0.00% MLMG::solve() 10 5.615e-05 5.615e-05 5.615e-05 0.00% MLMG::mgVcycle_down::1 31 5.546e-05 5.546e-05 5.546e-05 0.00% MLMG::mgVcycle_down::0 31 5.384e-05 5.384e-05 5.384e-05 0.00% FabArray::RecvLayoutMask() 8 5.215e-05 5.215e-05 5.215e-05 0.00% MLCellLinOp::solutionResidual() 71 5.166e-05 5.166e-05 5.166e-05 0.00% MLMG::mgVcycle_bottom 65 5.131e-05 5.131e-05 5.131e-05 0.00% Castro::errorEst() 6 5.112e-05 5.112e-05 5.112e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.974e-05 4.974e-05 4.974e-05 0.00% MLMG::actualBottomSolve() 31 4.855e-05 4.855e-05 4.855e-05 0.00% MLMG::mgVcycle_down::3 31 4.494e-05 4.494e-05 4.494e-05 0.00% MLMG::mgVcycle_down::2 31 4.346e-05 4.346e-05 4.346e-05 0.00% Amr::defBaseLevel() 1 4.227e-05 4.227e-05 4.227e-05 0.00% MLMG::mgVcycle_down::4 31 4.177e-05 4.177e-05 4.177e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.946e-05 3.946e-05 3.946e-05 0.00% Amr::writeSmallPlotFile() 1 3.918e-05 3.918e-05 3.918e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.779e-05 3.779e-05 3.779e-05 0.00% MLMG::ResNormInf() 54 3.257e-05 3.257e-05 3.257e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.176e-05 3.176e-05 3.176e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 3.136e-05 3.136e-05 3.136e-05 0.00% Castro::react_state() 18 3.042e-05 3.042e-05 3.042e-05 0.00% MLPoisson::define() 10 2.83e-05 2.83e-05 2.83e-05 0.00% MLMG::mgVcycle_up::3 31 2.821e-05 2.821e-05 2.821e-05 0.00% makeSFC 50 2.799e-05 2.799e-05 2.799e-05 0.00% MLMG::mgVcycle_up::4 31 2.764e-05 2.764e-05 2.764e-05 0.00% Gravity::solve_phi_with_mlmg() 10 2.686e-05 2.686e-05 2.686e-05 0.00% MLMG::mgVcycle_up::0 31 2.623e-05 2.623e-05 2.623e-05 0.00% MLMG::mgVcycle_up::1 31 2.618e-05 2.618e-05 2.618e-05 0.00% MLMG::mgVcycle_up::2 31 2.596e-05 2.596e-05 2.596e-05 0.00% Castro::computeNewDt() 8 2.574e-05 2.574e-05 2.574e-05 0.00% FPinfo::FPinfo() 3 2.158e-05 2.158e-05 2.158e-05 0.00% BoxList::complementIn 12 2.097e-05 2.097e-05 2.097e-05 0.00% FabArrayBase::TheFPinfo() 25 2.073e-05 2.073e-05 2.073e-05 0.00% DistributionMapping::Distribute() 52 2.05e-05 2.05e-05 2.05e-05 0.00% MLMG::computeMLResidual() 15 1.964e-05 1.964e-05 1.964e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.682e-05 1.682e-05 1.682e-05 0.00% Amr::initSubcycle() 1 1.591e-05 1.591e-05 1.591e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.538e-05 1.538e-05 1.538e-05 0.00% MLMG::computeResidual() 31 1.527e-05 1.527e-05 1.527e-05 0.00% Amr::FinalizeInit() 1 1.519e-05 1.519e-05 1.519e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.496e-05 1.496e-05 1.496e-05 0.00% MLMG::miniCycle() 34 1.478e-05 1.478e-05 1.478e-05 0.00% MLLinOp::define() 10 1.363e-05 1.363e-05 1.363e-05 0.00% ClusterList::intersect() 4 1.246e-05 1.246e-05 1.246e-05 0.00% Castro::check_for_nan() 18 1.216e-05 1.216e-05 1.216e-05 0.00% Castro::post_init() 1 1.146e-05 1.146e-05 1.146e-05 0.00% MLMG::getGradSolution() 10 1.008e-05 1.008e-05 1.008e-05 0.00% Gravity::swapTimeLevels() 9 9.994e-06 9.994e-06 9.994e-06 0.00% Castro::apply_source_to_state() 18 9.917e-06 9.917e-06 9.917e-06 0.00% Castro::construct_new_hybrid_source() 9 9.684e-06 9.684e-06 9.684e-06 0.00% Castro::expand_state() 13 9.557e-06 9.557e-06 9.557e-06 0.00% MLMG::MLResNormInf() 15 8.527e-06 8.527e-06 8.527e-06 0.00% AmrMesh-cluster 4 7.788e-06 7.788e-06 7.788e-06 0.00% amrex::average_down_w_geom 20 7.701e-06 7.701e-06 7.701e-06 0.00% Amr::InitializeInit() 1 7.449e-06 7.449e-06 7.449e-06 0.00% Castro::avgDown(state_indx) 20 7.359e-06 7.359e-06 7.359e-06 0.00% Castro::construct_old_hybrid_source() 9 7.218e-06 7.218e-06 7.218e-06 0.00% MLPoisson::prepareForSolve() 10 6.914e-06 6.914e-06 6.914e-06 0.00% Castro::init(old) 3 6.009e-06 6.009e-06 6.009e-06 0.00% MLMG::MLRhsNormInf() 10 5.876e-06 5.876e-06 5.876e-06 0.00% BoxList::parallelComplementIn() 12 5.41e-06 5.41e-06 5.41e-06 0.00% Gravity::set_mass_offset() 6 4.998e-06 4.998e-06 4.998e-06 0.00% Castro::avgDown() 4 4.106e-06 4.106e-06 4.106e-06 0.00% Castro::computeInitialDt() 2 3.638e-06 3.638e-06 3.638e-06 0.00% Castro::derive() 6 3.595e-06 3.595e-06 3.595e-06 0.00% Castro::retry_advance_ctu() 5 2.956e-06 2.956e-06 2.956e-06 0.00% Amr::bldFineLevels() 1 2.743e-06 2.743e-06 2.743e-06 0.00% Castro::init() 1 2.721e-06 2.721e-06 2.721e-06 0.00% Amr::init() 1 1.909e-06 1.909e-06 1.909e-06 0.00% ClusterList::chop() 4 1.829e-06 1.829e-06 1.829e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.699e-06 1.699e-06 1.699e-06 0.00% Amr::initialInit() 1 1.251e-06 1.251e-06 1.251e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.169 3.169 3.169 100.00% Amr::coarseTimeStep() 5 1.537 1.537 1.537 48.51% Amr::timeStep() 9 1.532 1.532 1.532 48.35% Castro::advance() 5 1.312 1.312 1.312 41.41% Castro::subcycle_advance_ctu() 5 1.287 1.287 1.287 40.62% Castro::do_advance_ctu() 5 1.287 1.287 1.287 40.61% Amr::InitAmr() 1 1.058 1.058 1.058 33.39% Castro::construct_ctu_hydro_source() 9 0.773 0.773 0.773 24.39% Amr::init() 1 0.4221 0.4221 0.4221 13.32% Gravity::multilevel_solve_for_new_phi() 10 0.3374 0.3374 0.3374 10.65% Gravity::actual_multilevel_solve() 10 0.3365 0.3365 0.3365 10.62% Gravity::solve_phi_with_mlmg() 10 0.3332 0.3332 0.3332 10.52% Amr::writePlotFile() 2 0.3301 0.3301 0.3301 10.42% VisMF::Write(FabArray) 3 0.3231 0.3231 0.3231 10.20% Gravity::actual_solve_with_mlmg() 10 0.259 0.259 0.259 8.17% Amr::initialInit() 1 0.2428 0.2428 0.2428 7.66% MLMG::solve() 10 0.205 0.205 0.205 6.47% Castro::construct_new_gravity() 9 0.1987 0.1987 0.1987 6.27% Castro::clean_state() 87 0.195 0.195 0.195 6.16% MLMG::oneIter() 31 0.1738 0.1738 0.1738 5.48% Amr::InitializeInit() 1 0.164 0.164 0.164 5.17% Amr::defBaseLevel() 1 0.164 0.164 0.164 5.17% Amr::regrid() 5 0.1568 0.1568 0.1568 4.95% Castro::Castro() 5 0.1543 0.1543 0.1543 4.87% Castro::initMFs() 5 0.1503 0.1503 0.1503 4.74% MLMG::mgVcycle() 65 0.1492 0.1492 0.1492 4.71% Castro::post_regrid() 10 0.1417 0.1417 0.1417 4.47% AmrLevel::FillPatch() 62 0.1157 0.1157 0.1157 3.65% Castro::computeTemp() 88 0.1041 0.1041 0.1041 3.29% FillPatchIterator::Initialize 62 0.1011 0.1011 0.1011 3.19% MLCellLinOp::applyBC() 1917 0.09473 0.09473 0.09473 2.99% FillPatchSingleLevel 92 0.09259 0.09259 0.09259 2.92% FillPatchIterator::FillFromLevel0() 31 0.08994 0.08994 0.08994 2.84% MLCellLinOp::smooth() 688 0.08483 0.08483 0.08483 2.68% Amr::FinalizeInit() 1 0.07879 0.07879 0.07879 2.49% Castro::reflux() 4 0.07531 0.07531 0.07531 2.38% Gravity::fill_multipole_BCs() 10 0.0737 0.0737 0.0737 2.33% StateDataPhysBCFunct::() 95 0.07357 0.07357 0.07357 2.32% Castro::normalize_species() 87 0.06808 0.06808 0.06808 2.15% Castro::post_init() 1 0.06734 0.06734 0.06734 2.13% Castro::post_timestep() 9 0.06341 0.06341 0.06341 2.00% StateData::FillBoundary(geom) 650 0.06201 0.06201 0.06201 1.96% Castro::initialize_do_advance() 9 0.05565 0.05565 0.05565 1.76% Castro::do_old_sources() 9 0.04957 0.04957 0.04957 1.56% Castro::do_new_sources() 9 0.04903 0.04903 0.04903 1.55% Castro::problem_post_timestep() 10 0.04767 0.04767 0.04767 1.50% FabArray::FillBoundary() 1728 0.04448 0.04448 0.04448 1.40% FillBoundary_nowait() 1728 0.04407 0.04407 0.04407 1.39% MLPoisson::define() 10 0.04326 0.04326 0.04326 1.37% Castro::expand_state() 13 0.04245 0.04245 0.04245 1.34% MLMG::mgVcycle_bottom 65 0.04011 0.04011 0.04011 1.27% FabArray::setVal() 920 0.03844 0.03844 0.03844 1.21% FabArray::ParallelCopy() 954 0.03547 0.03547 0.03547 1.12% FabArray::ParallelCopy_nowait() 954 0.03511 0.03511 0.03511 1.11% Gravity::get_new_grav_vector() 10 0.03344 0.03344 0.03344 1.06% MLMG::actualBottomSolve() 31 0.03273 0.03273 0.03273 1.03% MLCGSolver::bicgstab 31 0.03241 0.03241 0.03241 1.02% Castro::wd_update() 6 0.03166 0.03166 0.03166 1.00% MLMG::mgVcycle_down::0 31 0.02973 0.02973 0.02973 0.94% FluxRegister::Reflux() 24 0.02973 0.02973 0.02973 0.94% Castro::construct_old_gravity() 9 0.02914 0.02914 0.02914 0.92% Gravity::get_old_grav_vector() 9 0.02903 0.02903 0.02903 0.92% MLCellLinOp::apply() 493 0.02889 0.02889 0.02889 0.91% Castro::reset_internal_energy(MultiFab) 88 0.02803 0.02803 0.02803 0.88% Castro::construct_new_source() 63 0.02747 0.02747 0.02747 0.87% Castro::volInBoundary() 42 0.02718 0.02718 0.02718 0.86% amrex::Copy() 441 0.02675 0.02675 0.02675 0.84% MLCellLinOp::defineAuxData() 10 0.02469 0.02469 0.02469 0.78% Castro::initialize_advance() 9 0.02422 0.02422 0.02422 0.76% MLMG::mgVcycle_up::0 31 0.02215 0.02215 0.02215 0.70% MLCellLinOp::correctionResidual() 189 0.01892 0.01892 0.01892 0.60% MLCellLinOp::defineBC() 10 0.01825 0.01825 0.01825 0.58% Castro::enforce_min_density() 87 0.01797 0.01797 0.01797 0.57% amrex::Add() 136 0.01725 0.01725 0.01725 0.54% MLCellLinOp::reflux() 30 0.01687 0.01687 0.01687 0.53% Castro::estTimeStep() 26 0.01667 0.01667 0.01667 0.53% FabArray::Saxpy() 604 0.01614 0.01614 0.01614 0.51% BndryData::define() 26 0.01532 0.01532 0.01532 0.48% MLCellLinOp::solutionResidual() 71 0.01482 0.01482 0.01482 0.47% Amr::grid_places() 6 0.01468 0.01468 0.01468 0.46% AmrMesh::MakeNewGrids() 6 0.01458 0.01458 0.01458 0.46% MLMG:computeResOfCorrection() 155 0.01445 0.01445 0.01445 0.46% MLMG::computeResWithCrseSolFineCor() 17 0.01432 0.01432 0.01432 0.45% MLPoisson::Fsmooth() 1376 0.01347 0.01347 0.01347 0.43% MLMG::computeMLResidual() 15 0.01325 0.01325 0.01325 0.42% Castro::construct_old_source() 63 0.01295 0.01295 0.01295 0.41% MLMG::mgVcycle_down::1 31 0.01225 0.01225 0.01225 0.39% Castro::initData() 1 0.01134 0.01134 0.01134 0.36% amrex::average_down 233 0.01043 0.01043 0.01043 0.33% amrex::Dot() 466 0.009462 0.009462 0.009462 0.30% MLMG::prepareForSolve() 10 0.009092 0.009092 0.009092 0.29% Castro::FluxRegCrseInit 9 0.009042 0.009042 0.009042 0.29% FabArray::norminf() 439 0.008988 0.008988 0.008988 0.28% MLMG::mgVcycle_up::1 31 0.008959 0.008959 0.008959 0.28% Amr::bldFineLevels() 1 0.008077 0.008077 0.008077 0.25% Castro::construct_old_gravity_source() 18 0.007788 0.007788 0.007788 0.25% FillPatchIterator::FillFromTwoLevels() 31 0.007445 0.007445 0.007445 0.23% FillPatchTwoLevels 31 0.007414 0.007414 0.007414 0.23% MLMG::miniCycle() 34 0.007384 0.007384 0.007384 0.23% MLMG::addInterpCorrection() 155 0.00729 0.00729 0.00729 0.23% MLMG::mgVcycle_down::2 31 0.007264 0.007264 0.007264 0.23% Castro::computeNewDt() 8 0.007177 0.007177 0.007177 0.23% Castro::finalize_do_advance() 9 0.007137 0.007137 0.007137 0.23% MLPoisson::Fapply() 493 0.007112 0.007112 0.007112 0.22% MLMG::mgVcycle_down::3 31 0.00671 0.00671 0.00671 0.21% FabArray::Xpay() 353 0.006605 0.006605 0.006605 0.21% MLMG::mgVcycle_down::4 31 0.00655 0.00655 0.00655 0.21% MLMG::computeResidual() 31 0.006118 0.006118 0.006118 0.19% Castro::reset_internal_energy(Fab) 1476 0.006074 0.006074 0.006074 0.19% MLCGSolver::ParallelAllReduce 745 0.005395 0.005395 0.005395 0.17% MLMG::mgVcycle_up::4 31 0.005244 0.005244 0.005244 0.17% Castro::construct_new_gravity_source() 9 0.005149 0.005149 0.005149 0.16% MLMG::mgVcycle_up::2 31 0.005076 0.005076 0.005076 0.16% FabArrayBase::getCPC() 1522 0.005072 0.005072 0.005072 0.16% MLMG::mgVcycle_up::3 31 0.005062 0.005062 0.005062 0.16% MLMG::getGradSolution() 10 0.004433 0.004433 0.004433 0.14% MLCellLinOp::compGrad() 18 0.004423 0.004423 0.004423 0.14% Castro::apply_source_to_state() 18 0.004227 0.004227 0.004227 0.13% Castro::enforce_speed_limit() 87 0.004137 0.004137 0.004137 0.13% FabArrayBase::CPC::define() 534 0.003803 0.003803 0.003803 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003778 0.003778 0.003778 0.12% MLMG::computeResWithCrseCorFineCor() 17 0.003702 0.003702 0.003702 0.12% FillPatchInterp(MF) 30 0.003659 0.003659 0.003659 0.12% Castro::errorEst() 6 0.003561 0.003561 0.003561 0.11% MLCellLinOp::updateSolBC() 25 0.00348 0.00348 0.00348 0.11% FabArray::setDomainBndry() 92 0.00333 0.00333 0.00333 0.11% Castro::check_for_nan() 18 0.003279 0.003279 0.003279 0.10% MultiFab::contains_nan() 18 0.003266 0.003266 0.003266 0.10% TagBoxArray::mapPRD 6 0.003256 0.003256 0.003256 0.10% Castro::init(old) 3 0.003072 0.003072 0.003072 0.10% FabArray::mult() 55 0.002593 0.002593 0.002593 0.08% Castro::computeInitialDt() 2 0.002581 0.002581 0.002581 0.08% Castro::buildMetrics() 5 0.002494 0.002494 0.002494 0.08% MLCellLinOp::setLevelBC() 18 0.002489 0.002489 0.002489 0.08% MLCellLinOp::updateCorBC() 17 0.002406 0.002406 0.002406 0.08% check_for_negative_density() 9 0.002231 0.002231 0.002231 0.07% MLMG::ResNormInf() 54 0.002114 0.002114 0.002114 0.07% MLPoisson::prepareForSolve() 10 0.002061 0.002061 0.002061 0.07% MLCellLinOp::prepareForSolve() 10 0.002054 0.002054 0.002054 0.06% Gravity::update_max_rhs() 10 0.002045 0.002045 0.002045 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.002042 0.002042 0.002042 0.06% Castro::fill_hybrid_hydro_source() 27 0.001901 0.001901 0.001901 0.06% MLPoisson::FFlux() 150 0.001894 0.001894 0.001894 0.06% Castro::apply_tagging_restrictions() 6 0.001847 0.001847 0.001847 0.06% average_down_faces 48 0.001356 0.001356 0.001356 0.04% FabArray::norminf(mask) 21 0.001227 0.001227 0.001227 0.04% Castro::avgDown() 4 0.001198 0.001198 0.001198 0.04% Castro::avgDown(state_indx) 20 0.001194 0.001194 0.001194 0.04% amrex::average_down_w_geom 20 0.001186 0.001186 0.001186 0.04% MLMG::MLResNormInf() 15 0.001155 0.001155 0.001155 0.04% MLMG::interpCorrection_1 17 0.001085 0.001085 0.001085 0.03% Castro::construct_new_hybrid_source() 9 0.001066 0.001066 0.001066 0.03% OwnerMask() 6 0.001031 0.001031 0.001031 0.03% Castro::build_fine_mask() 44 0.0009842 0.0009842 0.0009842 0.03% Castro::derive() 6 0.000946 0.000946 0.000946 0.03% AmrLevel::derive() 6 0.0009424 0.0009424 0.0009424 0.03% Castro::init() 1 0.0009398 0.0009398 0.0009398 0.03% AmrLevel::FillCoarsePatch() 5 0.000937 0.000937 0.000937 0.03% Castro::construct_old_hybrid_source() 9 0.0008518 0.0008518 0.0008518 0.03% TagBoxArray::collate() 6 0.000821 0.000821 0.000821 0.03% FabArrayBase::getFB() 1728 0.0007466 0.0007466 0.0007466 0.02% Gravity::swapTimeLevels() 9 0.0006919 0.0006919 0.0006919 0.02% Castro::FluxRegFineAdd() 9 0.0006642 0.0006642 0.0006642 0.02% MultiFab::max() 18 0.0006186 0.0006186 0.0006186 0.02% MLMG::MLRhsNormInf() 10 0.0006089 0.0006089 0.0006089 0.02% MultiFab::Multiply() 8 0.0005058 0.0005058 0.0005058 0.02% Castro::apply_problem_tags() 6 0.0004866 0.0004866 0.0004866 0.02% FabArrayBase::FB::FB() 37 0.0004521 0.0004521 0.0004521 0.01% Castro::react_state() 18 0.0004226 0.0004226 0.0004226 0.01% Castro::linear_to_hybrid_momentum() 1 0.000317 0.000317 0.000317 0.01% MLLinOp::define() 10 0.000285 0.000285 0.000285 0.01% MLLinOp::defineGrids() 10 0.0002714 0.0002714 0.0002714 0.01% Castro::construct_new_rotation_source() 9 0.0002436 0.0002436 0.0002436 0.01% AMRErrorTag::operator() 6 0.0002309 0.0002309 0.0002309 0.01% Castro::construct_old_rotation_source() 9 0.0002253 0.0002253 0.0002253 0.01% AmrLevel::AmrLevel(dm) 5 0.000193 0.000193 0.000193 0.01% StateData::define() 25 0.0001552 0.0001552 0.0001552 0.00% Castro::enforce_consistent_e() 1 0.0001439 0.0001439 0.0001439 0.00% Castro::swap_state_time_levels() 9 0.0001314 0.0001314 0.0001314 0.00% Castro::finalize_advance() 9 9.628e-05 9.628e-05 9.628e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 6.141e-05 6.141e-05 6.141e-05 0.00% Castro::create_source_corrector() 9 5.98e-05 5.98e-05 5.98e-05 0.00% FabArray::RecvLayoutMask() 8 5.215e-05 5.215e-05 5.215e-05 0.00% makeSFC 50 4.646e-05 4.646e-05 4.646e-05 0.00% FabArrayBase::TheFPinfo() 25 4.231e-05 4.231e-05 4.231e-05 0.00% Amr::writeSmallPlotFile() 1 3.918e-05 3.918e-05 3.918e-05 0.00% BoxList::parallelComplementIn() 12 2.638e-05 2.638e-05 2.638e-05 0.00% AmrMesh-cluster 4 2.208e-05 2.208e-05 2.208e-05 0.00% FPinfo::FPinfo() 3 2.158e-05 2.158e-05 2.158e-05 0.00% BoxList::complementIn 12 2.097e-05 2.097e-05 2.097e-05 0.00% DistributionMapping::Distribute() 52 2.05e-05 2.05e-05 2.05e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.885e-05 1.885e-05 1.885e-05 0.00% Amr::initSubcycle() 1 1.591e-05 1.591e-05 1.591e-05 0.00% ClusterList::intersect() 4 1.246e-05 1.246e-05 1.246e-05 0.00% Gravity::set_mass_offset() 6 4.998e-06 4.998e-06 4.998e-06 0.00% Castro::retry_advance_ctu() 5 2.956e-06 2.956e-06 2.956e-06 0.00% ClusterList::chop() 4 1.829e-06 1.829e-06 1.829e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.699e-06 1.699e-06 1.699e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1662 KiB 9037 MiB Castro::reflux() 436 436 13 MiB 666 MiB Castro::initMFs() 258 258 350 MiB 576 MiB Castro::swap_state_time_levels() 175 175 178 MiB 340 MiB StateData::define() 175 175 221 MiB 340 MiB Castro::initialize_do_advance() 143 143 123 MiB 325 MiB FillPatchIterator::Initialize 899 899 4366 KiB 303 MiB Amr::writePlotFile() 56 56 18 MiB 189 MiB Castro::problem_post_timestep() 162 162 741 KiB 167 MiB Castro::FluxRegCrseInit 660 660 446 KiB 167 MiB FluxRegister::Reflux() 648 648 1523 KiB 160 MiB Castro::initialize_advance() 143 143 49 MiB 121 MiB Castro::construct_new_source() 143 143 243 KiB 67 MiB Castro::construct_old_source() 143 143 135 KiB 67 MiB Castro::buildMetrics() 140 140 37 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 28 MiB 60 MiB Castro::Castro() 210 210 4340 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2785 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 308 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 353 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 908 KiB 16 MiB FillPatchTwoLevels 300 300 7565 B 11 MiB FillPatchInterp(MF) 330 330 4621 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 131 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4457 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 772 KiB 7424 KiB Castro::build_fine_mask() 224 224 1226 KiB 6912 KiB AmrLevel::derive() 162 162 2570 B 6912 KiB BndryData::define() 3624 3624 290 KiB 4243 KiB MLCellLinOp::reflux() 450 450 6011 B 2376 KiB Castro::wd_update() 6 6 22 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 412 B 2095 KiB amrex::average_down 1483 1483 2387 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 4836 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 804 B 867 KiB MLCellLinOp::defineBC() 276 276 3926 B 689 KiB Castro::estTimeStep() 26 26 2486 B 480 KiB VisMF::Write(FabArray) 1568 1568 2307 B 320 KiB Castro::normalize_species() 87 87 6998 B 320 KiB Castro::volInBoundary() 70 70 2781 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 129 B 204 KiB FabArray::norminf(mask) 29 29 190 B 163 KiB amrex::Dot() 559 559 441 B 160 KiB FabArray::norminf() 470 470 437 B 160 KiB MultiFab::max() 18 18 30 B 160 KiB check_for_negative_density() 9 9 113 B 160 KiB Castro::initData() 1 1 41 B 160 KiB FabArray::setVal() 419 419 55 KiB 120 KiB MLMG::interpCorrection_1 34 34 30 B 91 KiB average_down_faces 99 99 632 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 274 B 57 KiB MLPoisson::Fsmooth() 228 228 3188 B 55 KiB FillBoundary_nowait() 751 751 434 B 53 KiB TagBoxArray::mapPRD 324 324 41 B 45 KiB OwnerMask() 168 168 12 B 38 KiB MLCellLinOp::applyBC() 3834 3834 143 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9541 B 25 KiB MultiFab::contains_nan() 18 18 20 B 20 KiB StateData::FillBoundary(geom) 2538 2538 35 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 612 B 3456 B MLCGSolver::bicgstab 155 155 27 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 167 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 15 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 578 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1231 B 278 KiB FabArray::setVal() 419 419 55 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 274 B 57 KiB MLPoisson::Fsmooth() 228 228 3188 B 55 KiB FillBoundary_nowait() 751 751 434 B 53 KiB MLCellLinOp::applyBC() 1917 1917 143 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9541 B 25 KiB Gravity::get_new_grav_vector() 18 18 3507 B 20 KiB Gravity::get_old_grav_vector() 12 12 6386 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 35 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1358 B 6304 B MLMG::prepareForSolve() 18 18 237 B 3712 B FabArray::norminf(mask) 29 29 132 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 612 B 3456 B Castro::FluxRegCrseInit 12 12 8 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 604 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1781 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (24.04-15-g7813bb7d6bc6) finalized