Initializing AMReX (v2024-48-g47347f785f5c)... Initializing CUDA... CUDA initialized with 1 device. AMReX (v2024-48-g47347f785f5c) initialized Starting run at 09:25:12 UTC on 2024-04-01. Successfully read inputs file ... Castro git describe: 24.03-38-gcd731a3af AMReX git describe: v2024-48-g47347f785 Microphysics git describe: 24.03-23-g3112c13a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003384133 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.002061367 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009257001 Gravity::multilevel_solve_for_new_phi() time = 0.052825992 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.143172809 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003287359 on level 0 Castro::do_old_sources() time = 0.008919894 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.129818303 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.007366815 Gravity::multilevel_solve_for_new_phi() time = 0.041807269 Castro::construct_new_gravity() time = 0.045260326 on level 0 Castro::do_new_sources() time = 0.008073351 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.061164366 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.22729076 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002207632 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007508363 Gravity::multilevel_solve_for_new_phi() time = 0.059462075 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003410606 on level 0 Castro::do_old_sources() time = 0.006488781 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.157055045 on level 0 Castro::construct_old_gravity() time = 0.000372888 on level 1 Castro::do_old_sources() time = 0.001833338 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007892513 on level 1 Castro::reflux() at level 0 : time = 0.018310599 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007227167 Gravity::multilevel_solve_for_new_phi() time = 0.040981609 Castro::construct_new_gravity() time = 0.044585019 on level 0 Castro::do_new_sources() time = 0.006767797 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000408278 on level 1 Castro::do_new_sources() time = 0.002374284 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.445864597 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.358501464 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.002110661 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007264982 Gravity::multilevel_solve_for_new_phi() time = 0.01505699 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003370816 on level 0 Castro::do_old_sources() time = 0.006550074 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.163370044 on level 0 Castro::construct_old_gravity() time = 0.000334481 on level 1 Castro::do_old_sources() time = 0.002044281 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007756274 on level 1 Castro::reflux() at level 0 : time = 0.017746151 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007235503 Gravity::multilevel_solve_for_new_phi() time = 0.028520676 Castro::construct_new_gravity() time = 0.032031576 on level 0 Castro::do_new_sources() time = 0.006635322 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000395123 on level 1 Castro::do_new_sources() time = 0.002405625 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.557346701 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.307827587 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002136577 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007245397 Gravity::multilevel_solve_for_new_phi() time = 0.015003703 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003327892 on level 0 Castro::do_old_sources() time = 0.006486727 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.158053394 on level 0 Castro::construct_old_gravity() time = 0.00032297 on level 1 Castro::do_old_sources() time = 0.001538671 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.008785199 on level 1 Castro::reflux() at level 0 : time = 0.017319079 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007249149 Gravity::multilevel_solve_for_new_phi() time = 0.028605708 Castro::construct_new_gravity() time = 0.032179991 on level 0 Castro::do_new_sources() time = 0.006634556 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000400638 on level 1 Castro::do_new_sources() time = 0.002064582 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.650630954 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.299923359 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002136138 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.014360235 Gravity::multilevel_solve_for_new_phi() time = 0.022232372 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003298038 on level 0 Castro::do_old_sources() time = 0.006757012 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.177256761 on level 0 Castro::construct_old_gravity() time = 0.000365975 on level 1 Castro::do_old_sources() time = 0.001483799 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.006817382 on level 1 Castro::reflux() at level 0 : time = 0.017788931 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007269512 Gravity::multilevel_solve_for_new_phi() time = 0.02904094 Castro::construct_new_gravity() time = 0.032543968 on level 0 Castro::do_new_sources() time = 0.006842526 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000399969 on level 1 Castro::do_new_sources() time = 0.002598095 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.378202755 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.327304568 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.150089074 seconds Ending run at 09:25:16 UTC on 2024-04-01. Run time = 3.137618512 Run time without initialization = 1.67181633 Average number of zones advanced per microsecond: 2.960 Average number of zones advanced per microsecond per rank: 2.960 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.138 ... 3.138 ... 3.138 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0802 1.0802 1.0802 34.43% Castro::construct_ctu_hydro_source() 9 0.7814 0.7814 0.7814 24.90% VisMF::Write(FabArray) 3 0.2864 0.2864 0.2864 9.13% Castro::initMFs() 5 0.1554 0.1554 0.1554 4.95% Gravity::fill_multipole_BCs() 10 0.08009 0.08009 0.08009 2.55% Castro::normalize_species() 87 0.06505 0.06505 0.06505 2.07% Castro::computeTemp() 88 0.06054 0.06054 0.06054 1.93% MLCellLinOp::applyBC() 1917 0.04743 0.04743 0.04743 1.51% FillBoundary_nowait() 1728 0.0429 0.0429 0.0429 1.37% FabArray::setVal() 920 0.03794 0.03794 0.03794 1.21% StateData::FillBoundary(geom) 650 0.03433 0.03433 0.03433 1.09% FabArray::ParallelCopy_nowait() 954 0.02984 0.02984 0.02984 0.95% Castro::volInBoundary() 42 0.02867 0.02867 0.02867 0.91% amrex::Copy() 441 0.02652 0.02652 0.02652 0.85% Castro::reset_internal_energy(MultiFab) 88 0.02316 0.02316 0.02316 0.74% FluxRegister::Reflux() 24 0.02245 0.02245 0.02245 0.72% MLCellLinOp::defineAuxData() 10 0.02035 0.02035 0.02035 0.65% amrex::Add() 136 0.01727 0.01727 0.01727 0.55% Castro::estTimeStep() 26 0.01665 0.01665 0.01665 0.53% FabArray::Saxpy() 604 0.01585 0.01585 0.01585 0.51% StateDataPhysBCFunct::() 95 0.01519 0.01519 0.01519 0.48% Castro::construct_new_source() 63 0.01348 0.01348 0.01348 0.43% BndryData::define() 26 0.01257 0.01257 0.01257 0.40% MLPoisson::Fsmooth() 1376 0.01234 0.01234 0.01234 0.39% Castro::reflux() 4 0.01042 0.01042 0.01042 0.33% Castro::problem_post_timestep() 10 0.01039 0.01039 0.01039 0.33% Castro::enforce_min_density() 87 0.01024 0.01024 0.01024 0.33% MLCellLinOp::reflux() 30 0.01013 0.01013 0.01013 0.32% amrex::Dot() 466 0.008901 0.008901 0.008901 0.28% FabArray::norminf() 439 0.008609 0.008609 0.008609 0.27% Castro::construct_old_gravity_source() 18 0.007984 0.007984 0.007984 0.25% Castro::FluxRegCrseInit 9 0.007944 0.007944 0.007944 0.25% MLPoisson::Fapply() 493 0.006719 0.006719 0.006719 0.21% Castro::initData() 1 0.006485 0.006485 0.006485 0.21% FabArray::Xpay() 353 0.006399 0.006399 0.006399 0.20% amrex::average_down 233 0.006072 0.006072 0.006072 0.19% AmrMesh::MakeNewGrids() 6 0.005965 0.005965 0.005965 0.19% Castro::construct_new_gravity_source() 9 0.005213 0.005213 0.005213 0.17% Castro::wd_update() 6 0.004895 0.004895 0.004895 0.16% Amr::writePlotFile() 2 0.00457 0.00457 0.00457 0.15% MLMG::addInterpCorrection() 155 0.004432 0.004432 0.004432 0.14% Castro::construct_old_source() 63 0.004273 0.004273 0.004273 0.14% Castro::reset_internal_energy(Fab) 1476 0.004238 0.004238 0.004238 0.14% Castro::enforce_speed_limit() 87 0.003953 0.003953 0.003953 0.13% Gravity::actual_solve_with_mlmg() 10 0.003744 0.003744 0.003744 0.12% FabArrayBase::CPC::define() 534 0.003716 0.003716 0.003716 0.12% check_for_negative_density() 9 0.003716 0.003716 0.003716 0.12% FillPatchInterp(MF) 30 0.003593 0.003593 0.003593 0.11% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003549 0.003549 0.003549 0.11% MultiFab::contains_nan() 18 0.003285 0.003285 0.003285 0.10% FabArray::setDomainBndry() 92 0.003265 0.003265 0.003265 0.10% MLCellLinOp::compGrad() 18 0.002918 0.002918 0.002918 0.09% MLCellLinOp::defineBC() 10 0.002674 0.002674 0.002674 0.09% FabArray::mult() 55 0.002589 0.002589 0.002589 0.08% MLCellLinOp::setLevelBC() 18 0.002393 0.002393 0.002393 0.08% Castro::apply_tagging_restrictions() 6 0.002112 0.002112 0.002112 0.07% MLCellLinOp::prepareForSolve() 10 0.00197 0.00197 0.00197 0.06% MLMG::prepareForSolve() 10 0.001882 0.001882 0.001882 0.06% Castro::fill_hybrid_hydro_source() 27 0.001862 0.001862 0.001862 0.06% MLPoisson::FFlux() 150 0.001458 0.001458 0.001458 0.05% MLCellLinOp::updateSolBC() 25 0.001375 0.001375 0.001375 0.04% TagBoxArray::mapPRD 6 0.001324 0.001324 0.001324 0.04% FabArray::norminf(mask) 21 0.001217 0.001217 0.001217 0.04% Gravity::get_new_grav_vector() 10 0.001217 0.001217 0.001217 0.04% FabArrayBase::getCPC() 1522 0.001139 0.001139 0.001139 0.04% OwnerMask() 6 0.0009963 0.0009963 0.0009963 0.03% Gravity::get_old_grav_vector() 9 0.0009872 0.0009872 0.0009872 0.03% MLCellLinOp::updateCorBC() 17 0.0009844 0.0009844 0.0009844 0.03% Castro::build_fine_mask() 44 0.0009428 0.0009428 0.0009428 0.03% average_down_faces 48 0.0008508 0.0008508 0.0008508 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0007727 0.0007727 0.0007727 0.02% TagBoxArray::collate() 6 0.000763 0.000763 0.000763 0.02% FillPatchTwoLevels 31 0.0007604 0.0007604 0.0007604 0.02% MLCGSolver::bicgstab 31 0.0007316 0.0007316 0.0007316 0.02% Castro::FluxRegFineAdd() 9 0.0007056 0.0007056 0.0007056 0.02% Castro::post_timestep() 9 0.0006908 0.0006908 0.0006908 0.02% main() 1 0.00068 0.00068 0.00068 0.02% MultiFab::max() 18 0.0006446 0.0006446 0.0006446 0.02% AmrLevel::FillPatch() 62 0.00062 0.00062 0.00062 0.02% FillPatchIterator::Initialize 62 0.0005651 0.0005651 0.0005651 0.02% MLCellLinOp::smooth() 688 0.0005335 0.0005335 0.0005335 0.02% MultiFab::Multiply() 8 0.0005018 0.0005018 0.0005018 0.02% Castro::apply_problem_tags() 6 0.0004803 0.0004803 0.0004803 0.02% FabArrayBase::FB::FB() 37 0.0004459 0.0004459 0.0004459 0.01% Castro::linear_to_hybrid_momentum() 1 0.000435 0.000435 0.000435 0.01% MLMG::interpCorrection_1 17 0.0004027 0.0004027 0.0004027 0.01% Castro::Castro() 5 0.000401 0.000401 0.000401 0.01% FabArray::FillBoundary() 1728 0.000391 0.000391 0.000391 0.01% Amr::regrid() 5 0.0003746 0.0003746 0.0003746 0.01% FabArray::ParallelCopy() 954 0.0003265 0.0003265 0.0003265 0.01% FabArrayBase::getFB() 1728 0.0003008 0.0003008 0.0003008 0.01% Amr::coarseTimeStep() 5 0.0002708 0.0002708 0.0002708 0.01% Castro::clean_state() 87 0.0002553 0.0002553 0.0002553 0.01% Castro::subcycle_advance_ctu() 5 0.0002509 0.0002509 0.0002509 0.01% Gravity::actual_multilevel_solve() 10 0.0002476 0.0002476 0.0002476 0.01% Castro::do_new_sources() 9 0.000247 0.000247 0.000247 0.01% Gravity::update_max_rhs() 10 0.0002424 0.0002424 0.0002424 0.01% AMRErrorTag::operator() 6 0.0002398 0.0002398 0.0002398 0.01% MLCellLinOp::apply() 493 0.0002202 0.0002202 0.0002202 0.01% Castro::construct_new_rotation_source() 9 0.0002164 0.0002164 0.0002164 0.01% Castro::initialize_do_advance() 9 0.0002141 0.0002141 0.0002141 0.01% Castro::construct_old_rotation_source() 9 0.0002096 0.0002096 0.0002096 0.01% MLLinOp::defineGrids() 10 0.0002061 0.0002061 0.0002061 0.01% StateData::define() 25 0.0001809 0.0001809 0.0001809 0.01% Castro::do_old_sources() 9 0.0001594 0.0001594 0.0001594 0.01% Castro::enforce_consistent_e() 1 0.0001474 0.0001474 0.0001474 0.00% Castro::initialize_advance() 9 0.0001414 0.0001414 0.0001414 0.00% MLCGSolver::ParallelAllReduce 745 0.0001331 0.0001331 0.0001331 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001297 0.0001297 0.0001297 0.00% Castro::swap_state_time_levels() 9 0.000127 0.000127 0.000127 0.00% Castro::construct_new_gravity() 9 0.0001226 0.0001226 0.0001226 0.00% Castro::finalize_do_advance() 9 0.0001193 0.0001193 0.0001193 0.00% Castro::buildMetrics() 5 0.0001074 0.0001074 0.0001074 0.00% Amr::grid_places() 6 0.0001066 0.0001066 0.0001066 0.00% MLCellLinOp::correctionResidual() 189 0.0001035 0.0001035 0.0001035 0.00% Castro::do_advance_ctu() 5 9.963e-05 9.963e-05 9.963e-05 0.00% MLMG::mgVcycle() 65 9.695e-05 9.695e-05 9.695e-05 0.00% Castro::construct_old_gravity() 9 9.336e-05 9.336e-05 9.336e-05 0.00% Castro::finalize_advance() 9 9.174e-05 9.174e-05 9.174e-05 0.00% FillPatchSingleLevel 92 8.352e-05 8.352e-05 8.352e-05 0.00% AmrLevel::derive() 6 8.202e-05 8.202e-05 8.202e-05 0.00% Amr::timeStep() 9 7.553e-05 7.553e-05 7.553e-05 0.00% Castro::post_regrid() 10 6.348e-05 6.348e-05 6.348e-05 0.00% MLMG::oneIter() 31 5.732e-05 5.732e-05 5.732e-05 0.00% MLMG:computeResOfCorrection() 155 5.097e-05 5.097e-05 5.097e-05 0.00% Castro::errorEst() 6 4.969e-05 4.969e-05 4.969e-05 0.00% FabArray::RecvLayoutMask() 8 4.903e-05 4.903e-05 4.903e-05 0.00% MLMG::solve() 10 4.882e-05 4.882e-05 4.882e-05 0.00% MLCellLinOp::solutionResidual() 71 4.601e-05 4.601e-05 4.601e-05 0.00% Amr::defBaseLevel() 1 4.553e-05 4.553e-05 4.553e-05 0.00% FillPatchIterator::FillFromLevel0() 31 4.509e-05 4.509e-05 4.509e-05 0.00% MLMG::mgVcycle_bottom 65 4.166e-05 4.166e-05 4.166e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.135e-05 4.135e-05 4.135e-05 0.00% MLMG::actualBottomSolve() 31 3.994e-05 3.994e-05 3.994e-05 0.00% Castro::react_state() 18 3.966e-05 3.966e-05 3.966e-05 0.00% MLMG::mgVcycle_down::0 31 3.878e-05 3.878e-05 3.878e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.779e-05 3.779e-05 3.779e-05 0.00% Amr::writeSmallPlotFile() 1 3.76e-05 3.76e-05 3.76e-05 0.00% MLMG::mgVcycle_down::1 31 3.365e-05 3.365e-05 3.365e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.346e-05 3.346e-05 3.346e-05 0.00% MLMG::mgVcycle_down::3 31 3.088e-05 3.088e-05 3.088e-05 0.00% MLMG::mgVcycle_down::2 31 3.079e-05 3.079e-05 3.079e-05 0.00% Castro::advance() 5 2.933e-05 2.933e-05 2.933e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.789e-05 2.789e-05 2.789e-05 0.00% MLMG::mgVcycle_down::4 31 2.761e-05 2.761e-05 2.761e-05 0.00% makeSFC 50 2.717e-05 2.717e-05 2.717e-05 0.00% Gravity::solve_phi_with_mlmg() 10 2.611e-05 2.611e-05 2.611e-05 0.00% Castro::create_source_corrector() 9 2.574e-05 2.574e-05 2.574e-05 0.00% MLMG::ResNormInf() 54 2.568e-05 2.568e-05 2.568e-05 0.00% MLMG::mgVcycle_up::4 31 2.542e-05 2.542e-05 2.542e-05 0.00% Castro::computeNewDt() 8 2.54e-05 2.54e-05 2.54e-05 0.00% FabArrayBase::TheFPinfo() 25 2.2e-05 2.2e-05 2.2e-05 0.00% MLMG::mgVcycle_up::0 31 2.167e-05 2.167e-05 2.167e-05 0.00% MLMG::mgVcycle_up::3 31 2.07e-05 2.07e-05 2.07e-05 0.00% DistributionMapping::Distribute() 52 2.033e-05 2.033e-05 2.033e-05 0.00% MLPoisson::define() 10 1.996e-05 1.996e-05 1.996e-05 0.00% MLMG::mgVcycle_up::1 31 1.989e-05 1.989e-05 1.989e-05 0.00% FPinfo::FPinfo() 3 1.919e-05 1.919e-05 1.919e-05 0.00% MLMG::mgVcycle_up::2 31 1.855e-05 1.855e-05 1.855e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.511e-05 1.511e-05 1.511e-05 0.00% MLMG::computeMLResidual() 15 1.469e-05 1.469e-05 1.469e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.402e-05 1.402e-05 1.402e-05 0.00% MLMG::miniCycle() 34 1.39e-05 1.39e-05 1.39e-05 0.00% Amr::FinalizeInit() 1 1.343e-05 1.343e-05 1.343e-05 0.00% Amr::initSubcycle() 1 1.337e-05 1.337e-05 1.337e-05 0.00% MLMG::computeResidual() 31 1.307e-05 1.307e-05 1.307e-05 0.00% ClusterList::intersect() 4 1.279e-05 1.279e-05 1.279e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.195e-05 1.195e-05 1.195e-05 0.00% Castro::check_for_nan() 18 1.161e-05 1.161e-05 1.161e-05 0.00% Castro::apply_source_to_state() 18 9.51e-06 9.51e-06 9.51e-06 0.00% Castro::expand_state() 13 8.878e-06 8.878e-06 8.878e-06 0.00% MLMG::getGradSolution() 10 8.725e-06 8.725e-06 8.725e-06 0.00% MLLinOp::define() 10 7.722e-06 7.722e-06 7.722e-06 0.00% MLMG::MLResNormInf() 15 7.586e-06 7.586e-06 7.586e-06 0.00% MLPoisson::prepareForSolve() 10 7.511e-06 7.511e-06 7.511e-06 0.00% Castro::construct_new_hybrid_source() 9 7.355e-06 7.355e-06 7.355e-06 0.00% Gravity::swapTimeLevels() 9 7.35e-06 7.35e-06 7.35e-06 0.00% Castro::avgDown(state_indx) 20 7.004e-06 7.004e-06 7.004e-06 0.00% amrex::average_down_w_geom 20 6.877e-06 6.877e-06 6.877e-06 0.00% Amr::InitializeInit() 1 6.045e-06 6.045e-06 6.045e-06 0.00% Castro::construct_old_hybrid_source() 9 5.897e-06 5.897e-06 5.897e-06 0.00% AmrMesh-cluster 4 5.85e-06 5.85e-06 5.85e-06 0.00% MLMG::MLRhsNormInf() 10 5.213e-06 5.213e-06 5.213e-06 0.00% Castro::init(old) 3 5.158e-06 5.158e-06 5.158e-06 0.00% BoxList::complementIn 12 4.479e-06 4.479e-06 4.479e-06 0.00% BoxList::parallelComplementIn() 12 4.293e-06 4.293e-06 4.293e-06 0.00% Gravity::set_mass_offset() 6 4.147e-06 4.147e-06 4.147e-06 0.00% Castro::post_init() 1 3.985e-06 3.985e-06 3.985e-06 0.00% Castro::derive() 6 3.673e-06 3.673e-06 3.673e-06 0.00% Castro::avgDown() 4 3.563e-06 3.563e-06 3.563e-06 0.00% Castro::computeInitialDt() 2 3.067e-06 3.067e-06 3.067e-06 0.00% Castro::retry_advance_ctu() 5 2.902e-06 2.902e-06 2.902e-06 0.00% Amr::bldFineLevels() 1 2.612e-06 2.612e-06 2.612e-06 0.00% Castro::init() 1 2.14e-06 2.14e-06 2.14e-06 0.00% Amr::init() 1 1.903e-06 1.903e-06 1.903e-06 0.00% ClusterList::chop() 4 1.706e-06 1.706e-06 1.706e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.6e-06 1.6e-06 1.6e-06 0.00% Amr::initialInit() 1 1.132e-06 1.132e-06 1.132e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.138 3.138 3.138 100.00% Amr::coarseTimeStep() 5 1.521 1.521 1.521 48.48% Amr::timeStep() 9 1.516 1.516 1.516 48.31% Castro::advance() 5 1.302 1.302 1.302 41.51% Castro::subcycle_advance_ctu() 5 1.28 1.28 1.28 40.81% Castro::do_advance_ctu() 5 1.28 1.28 1.28 40.80% Amr::InitAmr() 1 1.08 1.08 1.08 34.43% Castro::construct_ctu_hydro_source() 9 0.8169 0.8169 0.8169 26.03% Amr::init() 1 0.3855 0.3855 0.3855 12.29% Gravity::multilevel_solve_for_new_phi() 10 0.3337 0.3337 0.3337 10.63% Gravity::actual_multilevel_solve() 10 0.3329 0.3329 0.3329 10.61% Gravity::solve_phi_with_mlmg() 10 0.3298 0.3298 0.3298 10.51% Amr::writePlotFile() 2 0.2934 0.2934 0.2934 9.35% VisMF::Write(FabArray) 3 0.2864 0.2864 0.2864 9.13% Gravity::actual_solve_with_mlmg() 10 0.2472 0.2472 0.2472 7.88% Amr::initialInit() 1 0.2422 0.2422 0.2422 7.72% MLMG::solve() 10 0.1953 0.1953 0.1953 6.22% Castro::construct_new_gravity() 9 0.1883 0.1883 0.1883 6.00% Amr::InitializeInit() 1 0.1695 0.1695 0.1695 5.40% Amr::defBaseLevel() 1 0.1694 0.1694 0.1694 5.40% Castro::clean_state() 87 0.1661 0.1661 0.1661 5.29% MLMG::oneIter() 31 0.1647 0.1647 0.1647 5.25% Castro::Castro() 5 0.1595 0.1595 0.1595 5.08% Castro::initMFs() 5 0.1554 0.1554 0.1554 4.95% Amr::regrid() 5 0.1524 0.1524 0.1524 4.86% MLMG::mgVcycle() 65 0.1414 0.1414 0.1414 4.51% Castro::post_regrid() 10 0.1377 0.1377 0.1377 4.39% MLCellLinOp::applyBC() 1917 0.09147 0.09147 0.09147 2.92% AmrLevel::FillPatch() 62 0.0912 0.0912 0.0912 2.91% Castro::computeTemp() 88 0.08794 0.08794 0.08794 2.80% Gravity::fill_multipole_BCs() 10 0.08211 0.08211 0.08211 2.62% MLCellLinOp::smooth() 688 0.08112 0.08112 0.08112 2.59% FillPatchIterator::Initialize 62 0.0768 0.0768 0.0768 2.45% Amr::FinalizeInit() 1 0.07278 0.07278 0.07278 2.32% Castro::reflux() 4 0.0712 0.0712 0.0712 2.27% FillPatchSingleLevel 92 0.06845 0.06845 0.06845 2.18% FillPatchIterator::FillFromLevel0() 31 0.06587 0.06587 0.06587 2.10% Castro::normalize_species() 87 0.06505 0.06505 0.06505 2.07% Castro::post_timestep() 9 0.06173 0.06173 0.06173 1.97% Castro::post_init() 1 0.06144 0.06144 0.06144 1.96% Castro::initialize_do_advance() 9 0.05147 0.05147 0.05147 1.64% StateDataPhysBCFunct::() 95 0.04952 0.04952 0.04952 1.58% Castro::problem_post_timestep() 10 0.04935 0.04935 0.04935 1.57% Castro::do_new_sources() 9 0.04447 0.04447 0.04447 1.42% FabArray::FillBoundary() 1728 0.04404 0.04404 0.04404 1.40% FillBoundary_nowait() 1728 0.04365 0.04365 0.04365 1.39% Castro::do_old_sources() 9 0.04218 0.04218 0.04218 1.34% Castro::expand_state() 13 0.04174 0.04174 0.04174 1.33% MLPoisson::define() 10 0.04135 0.04135 0.04135 1.32% FabArray::setVal() 920 0.03794 0.03794 0.03794 1.21% MLMG::mgVcycle_bottom 65 0.03754 0.03754 0.03754 1.20% StateData::FillBoundary(geom) 650 0.03433 0.03433 0.03433 1.09% FabArray::ParallelCopy() 954 0.03414 0.03414 0.03414 1.09% FabArray::ParallelCopy_nowait() 954 0.03382 0.03382 0.03382 1.08% Castro::wd_update() 6 0.03358 0.03358 0.03358 1.07% MLMG::actualBottomSolve() 31 0.03052 0.03052 0.03052 0.97% MLCGSolver::bicgstab 31 0.03023 0.03023 0.03023 0.96% FluxRegister::Reflux() 24 0.02972 0.02972 0.02972 0.95% MLMG::mgVcycle_down::0 31 0.02915 0.02915 0.02915 0.93% Castro::volInBoundary() 42 0.02868 0.02868 0.02868 0.91% MLCellLinOp::apply() 493 0.02762 0.02762 0.02762 0.88% Castro::reset_internal_energy(MultiFab) 88 0.0274 0.0274 0.0274 0.87% amrex::Copy() 441 0.02652 0.02652 0.02652 0.85% Castro::construct_new_source() 63 0.02613 0.02613 0.02613 0.83% MLCellLinOp::defineAuxData() 10 0.02366 0.02366 0.02366 0.75% Gravity::get_new_grav_vector() 10 0.02307 0.02307 0.02307 0.74% Castro::initialize_advance() 9 0.02179 0.02179 0.02179 0.69% MLMG::mgVcycle_up::0 31 0.02176 0.02176 0.02176 0.69% Castro::construct_old_gravity() 9 0.01818 0.01818 0.01818 0.58% Gravity::get_old_grav_vector() 9 0.01808 0.01808 0.01808 0.58% MLCellLinOp::correctionResidual() 189 0.01807 0.01807 0.01807 0.58% MLCellLinOp::defineBC() 10 0.0174 0.0174 0.0174 0.55% amrex::Add() 136 0.01727 0.01727 0.01727 0.55% Castro::estTimeStep() 26 0.01665 0.01665 0.01665 0.53% MLCellLinOp::reflux() 30 0.01629 0.01629 0.01629 0.52% FabArray::Saxpy() 604 0.01585 0.01585 0.01585 0.51% BndryData::define() 26 0.01459 0.01459 0.01459 0.46% MLCellLinOp::solutionResidual() 71 0.01443 0.01443 0.01443 0.46% Amr::grid_places() 6 0.0141 0.0141 0.0141 0.45% AmrMesh::MakeNewGrids() 6 0.01399 0.01399 0.01399 0.45% MLMG:computeResOfCorrection() 155 0.01389 0.01389 0.01389 0.44% MLMG::computeResWithCrseSolFineCor() 17 0.01347 0.01347 0.01347 0.43% MLMG::computeMLResidual() 15 0.01332 0.01332 0.01332 0.42% Castro::construct_old_source() 63 0.01236 0.01236 0.01236 0.39% MLPoisson::Fsmooth() 1376 0.01234 0.01234 0.01234 0.39% Castro::initData() 1 0.01156 0.01156 0.01156 0.37% MLMG::mgVcycle_down::1 31 0.0115 0.0115 0.0115 0.37% Castro::enforce_min_density() 87 0.01024 0.01024 0.01024 0.33% amrex::average_down 233 0.009698 0.009698 0.009698 0.31% Castro::FluxRegCrseInit 9 0.008981 0.008981 0.008981 0.29% amrex::Dot() 466 0.008901 0.008901 0.008901 0.28% MLMG::prepareForSolve() 10 0.008754 0.008754 0.008754 0.28% FabArray::norminf() 439 0.008609 0.008609 0.008609 0.27% MLMG::mgVcycle_up::1 31 0.008332 0.008332 0.008332 0.27% Castro::construct_old_gravity_source() 18 0.007984 0.007984 0.007984 0.25% Amr::bldFineLevels() 1 0.007765 0.007765 0.007765 0.25% FillPatchIterator::FillFromTwoLevels() 31 0.007274 0.007274 0.007274 0.23% FillPatchTwoLevels 31 0.007236 0.007236 0.007236 0.23% Castro::computeNewDt() 8 0.007169 0.007169 0.007169 0.23% MLMG::miniCycle() 34 0.007034 0.007034 0.007034 0.22% Castro::finalize_do_advance() 9 0.006816 0.006816 0.006816 0.22% MLMG::addInterpCorrection() 155 0.006766 0.006766 0.006766 0.22% MLMG::mgVcycle_down::2 31 0.006738 0.006738 0.006738 0.21% MLPoisson::Fapply() 493 0.006719 0.006719 0.006719 0.21% FabArray::Xpay() 353 0.006399 0.006399 0.006399 0.20% MLMG::mgVcycle_down::3 31 0.006135 0.006135 0.006135 0.20% MLMG::mgVcycle_down::4 31 0.005979 0.005979 0.005979 0.19% MLMG::computeResidual() 31 0.005775 0.005775 0.005775 0.18% Castro::construct_new_gravity_source() 9 0.005213 0.005213 0.005213 0.17% MLCGSolver::ParallelAllReduce 745 0.005061 0.005061 0.005061 0.16% FabArrayBase::getCPC() 1522 0.004855 0.004855 0.004855 0.15% MLMG::mgVcycle_up::4 31 0.004832 0.004832 0.004832 0.15% MLMG::mgVcycle_up::2 31 0.004684 0.004684 0.004684 0.15% MLMG::mgVcycle_up::3 31 0.00464 0.00464 0.00464 0.15% MLMG::getGradSolution() 10 0.004377 0.004377 0.004377 0.14% MLCellLinOp::compGrad() 18 0.004368 0.004368 0.004368 0.14% Castro::reset_internal_energy(Fab) 1476 0.004238 0.004238 0.004238 0.14% Castro::apply_source_to_state() 18 0.004225 0.004225 0.004225 0.13% Castro::enforce_speed_limit() 87 0.003953 0.003953 0.003953 0.13% Castro::errorEst() 6 0.003828 0.003828 0.003828 0.12% FabArrayBase::CPC::define() 534 0.003716 0.003716 0.003716 0.12% check_for_negative_density() 9 0.003716 0.003716 0.003716 0.12% FillPatchInterp(MF) 30 0.003593 0.003593 0.003593 0.11% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003549 0.003549 0.003549 0.11% MLMG::computeResWithCrseCorFineCor() 17 0.003457 0.003457 0.003457 0.11% Castro::check_for_nan() 18 0.003297 0.003297 0.003297 0.11% MultiFab::contains_nan() 18 0.003285 0.003285 0.003285 0.10% MLCellLinOp::updateSolBC() 25 0.003275 0.003275 0.003275 0.10% FabArray::setDomainBndry() 92 0.003265 0.003265 0.003265 0.10% TagBoxArray::mapPRD 6 0.003117 0.003117 0.003117 0.10% Castro::init(old) 3 0.002969 0.002969 0.002969 0.09% Castro::computeInitialDt() 2 0.002815 0.002815 0.002815 0.09% FabArray::mult() 55 0.002589 0.002589 0.002589 0.08% Castro::buildMetrics() 5 0.002568 0.002568 0.002568 0.08% MLCellLinOp::setLevelBC() 18 0.002393 0.002393 0.002393 0.08% MLCellLinOp::updateCorBC() 17 0.002251 0.002251 0.002251 0.07% Castro::apply_tagging_restrictions() 6 0.002112 0.002112 0.002112 0.07% MLMG::ResNormInf() 54 0.002087 0.002087 0.002087 0.07% Gravity::update_max_rhs() 10 0.002053 0.002053 0.002053 0.07% MLPoisson::prepareForSolve() 10 0.001978 0.001978 0.001978 0.06% MLCellLinOp::prepareForSolve() 10 0.00197 0.00197 0.00197 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.001938 0.001938 0.001938 0.06% Castro::fill_hybrid_hydro_source() 27 0.001862 0.001862 0.001862 0.06% MLPoisson::FFlux() 150 0.001458 0.001458 0.001458 0.05% average_down_faces 48 0.001286 0.001286 0.001286 0.04% Castro::construct_new_hybrid_source() 9 0.001221 0.001221 0.001221 0.04% FabArray::norminf(mask) 21 0.001217 0.001217 0.001217 0.04% Castro::avgDown() 4 0.001156 0.001156 0.001156 0.04% Castro::avgDown(state_indx) 20 0.001153 0.001153 0.001153 0.04% amrex::average_down_w_geom 20 0.001146 0.001146 0.001146 0.04% MLMG::MLResNormInf() 15 0.00114 0.00114 0.00114 0.04% OwnerMask() 6 0.0009963 0.0009963 0.0009963 0.03% MLMG::interpCorrection_1 17 0.000955 0.000955 0.000955 0.03% Castro::derive() 6 0.0009457 0.0009457 0.0009457 0.03% Castro::build_fine_mask() 44 0.0009428 0.0009428 0.0009428 0.03% AmrLevel::derive() 6 0.000942 0.000942 0.000942 0.03% Castro::init() 1 0.0009234 0.0009234 0.0009234 0.03% AmrLevel::FillCoarsePatch() 5 0.0009213 0.0009213 0.0009213 0.03% TagBoxArray::collate() 6 0.000763 0.000763 0.000763 0.02% FabArrayBase::getFB() 1728 0.0007467 0.0007467 0.0007467 0.02% Castro::FluxRegFineAdd() 9 0.0007056 0.0007056 0.0007056 0.02% Gravity::swapTimeLevels() 9 0.0006708 0.0006708 0.0006708 0.02% Castro::construct_old_hybrid_source() 9 0.0006548 0.0006548 0.0006548 0.02% MultiFab::max() 18 0.0006446 0.0006446 0.0006446 0.02% MLMG::MLRhsNormInf() 10 0.0006036 0.0006036 0.0006036 0.02% MultiFab::Multiply() 8 0.0005018 0.0005018 0.0005018 0.02% Castro::apply_problem_tags() 6 0.0004803 0.0004803 0.0004803 0.02% FabArrayBase::FB::FB() 37 0.0004459 0.0004459 0.0004459 0.01% Castro::linear_to_hybrid_momentum() 1 0.000435 0.000435 0.000435 0.01% Castro::react_state() 18 0.0003817 0.0003817 0.0003817 0.01% MLLinOp::define() 10 0.0002762 0.0002762 0.0002762 0.01% MLLinOp::defineGrids() 10 0.0002685 0.0002685 0.0002685 0.01% AMRErrorTag::operator() 6 0.0002398 0.0002398 0.0002398 0.01% Castro::construct_new_rotation_source() 9 0.0002164 0.0002164 0.0002164 0.01% AmrLevel::AmrLevel(dm) 5 0.0002144 0.0002144 0.0002144 0.01% Castro::construct_old_rotation_source() 9 0.0002096 0.0002096 0.0002096 0.01% StateData::define() 25 0.0001809 0.0001809 0.0001809 0.01% Castro::enforce_consistent_e() 1 0.0001474 0.0001474 0.0001474 0.00% Castro::swap_state_time_levels() 9 0.000127 0.000127 0.000127 0.00% Castro::finalize_advance() 9 9.174e-05 9.174e-05 9.174e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 6.082e-05 6.082e-05 6.082e-05 0.00% FabArray::RecvLayoutMask() 8 4.903e-05 4.903e-05 4.903e-05 0.00% makeSFC 50 4.571e-05 4.571e-05 4.571e-05 0.00% FabArrayBase::TheFPinfo() 25 4.119e-05 4.119e-05 4.119e-05 0.00% Amr::writeSmallPlotFile() 1 3.76e-05 3.76e-05 3.76e-05 0.00% Castro::create_source_corrector() 9 2.574e-05 2.574e-05 2.574e-05 0.00% AmrMesh-cluster 4 2.035e-05 2.035e-05 2.035e-05 0.00% DistributionMapping::Distribute() 52 2.033e-05 2.033e-05 2.033e-05 0.00% FPinfo::FPinfo() 3 1.919e-05 1.919e-05 1.919e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.375e-05 1.375e-05 1.375e-05 0.00% Amr::initSubcycle() 1 1.337e-05 1.337e-05 1.337e-05 0.00% ClusterList::intersect() 4 1.279e-05 1.279e-05 1.279e-05 0.00% BoxList::parallelComplementIn() 12 8.772e-06 8.772e-06 8.772e-06 0.00% BoxList::complementIn 12 4.479e-06 4.479e-06 4.479e-06 0.00% Gravity::set_mass_offset() 6 4.147e-06 4.147e-06 4.147e-06 0.00% Castro::retry_advance_ctu() 5 2.902e-06 2.902e-06 2.902e-06 0.00% ClusterList::chop() 4 1.706e-06 1.706e-06 1.706e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.6e-06 1.6e-06 1.6e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1688 KiB 9037 MiB Castro::reflux() 436 436 12 MiB 666 MiB Castro::initMFs() 258 258 345 MiB 576 MiB Castro::swap_state_time_levels() 175 175 178 MiB 340 MiB StateData::define() 175 175 218 MiB 340 MiB Castro::initialize_do_advance() 143 143 124 MiB 325 MiB FillPatchIterator::Initialize 899 899 4036 KiB 303 MiB Amr::writePlotFile() 56 56 16 MiB 189 MiB Castro::problem_post_timestep() 162 162 767 KiB 167 MiB Castro::FluxRegCrseInit 660 660 448 KiB 167 MiB FluxRegister::Reflux() 648 648 1538 KiB 160 MiB Castro::initialize_advance() 143 143 49 MiB 121 MiB Castro::construct_new_source() 143 143 238 KiB 67 MiB Castro::construct_old_source() 143 143 129 KiB 67 MiB Castro::buildMetrics() 140 140 37 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 28 MiB 60 MiB Castro::Castro() 210 210 3991 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2680 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 191 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 241 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 874 KiB 16 MiB FillPatchTwoLevels 300 300 7485 B 11 MiB FillPatchInterp(MF) 330 330 4627 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 152 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4534 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 771 KiB 7424 KiB Castro::build_fine_mask() 224 224 1194 KiB 6912 KiB AmrLevel::derive() 162 162 2607 B 6912 KiB BndryData::define() 3624 3624 279 KiB 4243 KiB MLCellLinOp::reflux() 450 450 6038 B 2376 KiB Castro::wd_update() 6 6 23 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 424 B 2095 KiB amrex::average_down 1483 1483 2335 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 4692 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 783 B 867 KiB MLCellLinOp::defineBC() 276 276 3783 B 689 KiB Castro::estTimeStep() 26 26 2531 B 480 KiB VisMF::Write(FabArray) 1568 1568 2270 B 320 KiB Castro::normalize_species() 87 87 6755 B 320 KiB Castro::volInBoundary() 70 70 2958 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 123 B 204 KiB FabArray::norminf(mask) 29 29 185 B 163 KiB amrex::Dot() 559 559 421 B 160 KiB FabArray::norminf() 470 470 424 B 160 KiB MultiFab::max() 18 18 32 B 160 KiB check_for_negative_density() 9 9 192 B 160 KiB Castro::initData() 1 1 47 B 160 KiB FabArray::setVal() 419 419 54 KiB 120 KiB MLMG::interpCorrection_1 34 34 26 B 91 KiB average_down_faces 99 99 632 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 276 B 57 KiB MLPoisson::Fsmooth() 228 228 3055 B 55 KiB FillBoundary_nowait() 751 751 452 B 53 KiB TagBoxArray::mapPRD 324 324 40 B 45 KiB OwnerMask() 168 168 11 B 38 KiB MLCellLinOp::applyBC() 3834 3834 143 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9523 B 25 KiB MultiFab::contains_nan() 18 18 21 B 20 KiB StateData::FillBoundary(geom) 2538 2538 44 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 596 B 3456 B MLCGSolver::bicgstab 155 155 25 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 156 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 11 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 581 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1247 B 278 KiB FabArray::setVal() 419 419 54 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 276 B 57 KiB MLPoisson::Fsmooth() 228 228 3055 B 55 KiB FillBoundary_nowait() 751 751 453 B 53 KiB MLCellLinOp::applyBC() 1917 1917 143 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9523 B 25 KiB Gravity::get_new_grav_vector() 18 18 3245 B 20 KiB Gravity::get_old_grav_vector() 12 12 6529 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 45 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1331 B 6304 B MLMG::prepareForSolve() 18 18 228 B 3712 B FabArray::norminf(mask) 29 29 126 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 596 B 3456 B Castro::FluxRegCrseInit 12 12 8 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 605 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (v2024-48-g47347f785f5c) finalized