Initializing AMReX (24.04-3-gd78e241d1ad4)... Initializing CUDA... CUDA initialized with 1 device. AMReX (24.04-3-gd78e241d1ad4) initialized Starting run at 20:22:03 UTC on 2024-04-02. Successfully read inputs file ... Castro git describe: 24.04-1-g6930369b2 AMReX git describe: 24.04-3-gd78e241d1 Microphysics git describe: 24.04 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003107651 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001720607 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009104951 Gravity::multilevel_solve_for_new_phi() time = 0.052274343 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.144746368 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003390162 on level 0 Castro::do_old_sources() time = 0.00881705 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.130886162 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.006851858 Gravity::multilevel_solve_for_new_phi() time = 0.040174799 Castro::construct_new_gravity() time = 0.043811072 on level 0 Castro::do_new_sources() time = 0.007602816 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.083572385 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.226595868 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002059327 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.00739674 Gravity::multilevel_solve_for_new_phi() time = 0.059198885 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003299092 on level 0 Castro::do_old_sources() time = 0.009831579 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.150743782 on level 0 Castro::construct_old_gravity() time = 0.000376008 on level 1 Castro::do_old_sources() time = 0.001573101 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.011403342 on level 1 Castro::reflux() at level 0 : time = 0.018359638 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007247731 Gravity::multilevel_solve_for_new_phi() time = 0.040611693 Castro::construct_new_gravity() time = 0.044088223 on level 0 Castro::do_new_sources() time = 0.006317238 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000377345 on level 1 Castro::do_new_sources() time = 0.002467404 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.354053817 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.366440764 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.00183207 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007105595 Gravity::multilevel_solve_for_new_phi() time = 0.015060381 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003422408 on level 0 Castro::do_old_sources() time = 0.006275966 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.170645741 on level 0 Castro::construct_old_gravity() time = 0.000370689 on level 1 Castro::do_old_sources() time = 0.002159451 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.00691599 on level 1 Castro::reflux() at level 0 : time = 0.017789251 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007255121 Gravity::multilevel_solve_for_new_phi() time = 0.028690506 Castro::construct_new_gravity() time = 0.032178131 on level 0 Castro::do_new_sources() time = 0.006824302 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.00035918 on level 1 Castro::do_new_sources() time = 0.002336332 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.462224936 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.31474083 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.0020309 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007233346 Gravity::multilevel_solve_for_new_phi() time = 0.015131671 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003447185 on level 0 Castro::do_old_sources() time = 0.006189476 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.090073361 on level 0 Castro::construct_old_gravity() time = 0.000379029 on level 1 Castro::do_old_sources() time = 0.002262225 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007409869 on level 1 Castro::reflux() at level 0 : time = 0.017537012 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007275329 Gravity::multilevel_solve_for_new_phi() time = 0.028793802 Castro::construct_new_gravity() time = 0.032300213 on level 0 Castro::do_new_sources() time = 0.006452168 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000388162 on level 1 Castro::do_new_sources() time = 0.002443624 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 4.908967507 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.235794152 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.010787482 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.006966473 Gravity::multilevel_solve_for_new_phi() time = 0.014902971 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003333481 on level 0 Castro::do_old_sources() time = 0.010421127 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.149244864 on level 0 Castro::construct_old_gravity() time = 0.000344216 on level 1 Castro::do_old_sources() time = 0.001336553 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.011125634 on level 1 Castro::reflux() at level 0 : time = 0.018314259 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.006951572 Gravity::multilevel_solve_for_new_phi() time = 0.028584293 Castro::construct_new_gravity() time = 0.032034473 on level 0 Castro::do_new_sources() time = 0.006829562 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000391152 on level 1 Castro::do_new_sources() time = 0.002316848 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.505265299 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.32533017 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.154506349 seconds Ending run at 20:22:06 UTC on 2024-04-02. Run time = 3.070648418 Run time without initialization = 1.62432089 Average number of zones advanced per microsecond: 3.046 Average number of zones advanced per microsecond per rank: 3.046 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.071 ... 3.071 ... 3.071 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0625 1.0625 1.0625 34.60% Castro::construct_ctu_hydro_source() 9 0.7007 0.7007 0.7007 22.82% VisMF::Write(FabArray) 3 0.2923 0.2923 0.2923 9.52% Castro::initMFs() 5 0.1544 0.1544 0.1544 5.03% Castro::computeTemp() 88 0.07626 0.07626 0.07626 2.48% Castro::normalize_species() 87 0.07244 0.07244 0.07244 2.36% Gravity::fill_multipole_BCs() 10 0.07147 0.07147 0.07147 2.33% MLCellLinOp::applyBC() 1917 0.0471 0.0471 0.0471 1.53% FillBoundary_nowait() 1728 0.04251 0.04251 0.04251 1.38% FabArray::setVal() 920 0.03773 0.03773 0.03773 1.23% StateData::FillBoundary(geom) 650 0.03477 0.03477 0.03477 1.13% FabArray::ParallelCopy_nowait() 954 0.03015 0.03015 0.03015 0.98% Castro::volInBoundary() 42 0.02925 0.02925 0.02925 0.95% amrex::Copy() 441 0.0265 0.0265 0.0265 0.86% Castro::reset_internal_energy(MultiFab) 88 0.02247 0.02247 0.02247 0.73% FluxRegister::Reflux() 24 0.02242 0.02242 0.02242 0.73% MLCellLinOp::defineAuxData() 10 0.02036 0.02036 0.02036 0.66% Castro::enforce_min_density() 87 0.01808 0.01808 0.01808 0.59% amrex::Add() 136 0.01724 0.01724 0.01724 0.56% Castro::estTimeStep() 26 0.01652 0.01652 0.01652 0.54% FabArray::Saxpy() 604 0.01575 0.01575 0.01575 0.51% StateDataPhysBCFunct::() 95 0.01423 0.01423 0.01423 0.46% Castro::construct_new_source() 63 0.01416 0.01416 0.01416 0.46% BndryData::define() 26 0.01261 0.01261 0.01261 0.41% MLPoisson::Fsmooth() 1376 0.01221 0.01221 0.01221 0.40% Castro::reflux() 4 0.01162 0.01162 0.01162 0.38% Castro::problem_post_timestep() 10 0.01003 0.01003 0.01003 0.33% MLCellLinOp::reflux() 30 0.009159 0.009159 0.009159 0.30% amrex::Dot() 466 0.008842 0.008842 0.008842 0.29% FabArray::norminf() 439 0.008418 0.008418 0.008418 0.27% Castro::apply_problem_tags() 6 0.00808 0.00808 0.00808 0.26% Castro::FluxRegCrseInit 9 0.007974 0.007974 0.007974 0.26% Castro::construct_old_gravity_source() 18 0.007275 0.007275 0.007275 0.24% Castro::initData() 1 0.006729 0.006729 0.006729 0.22% MLPoisson::Fapply() 493 0.006712 0.006712 0.006712 0.22% FabArray::Xpay() 353 0.006363 0.006363 0.006363 0.21% amrex::average_down 233 0.006161 0.006161 0.006161 0.20% AmrMesh::MakeNewGrids() 6 0.005213 0.005213 0.005213 0.17% Castro::reset_internal_energy(Fab) 1476 0.004971 0.004971 0.004971 0.16% Amr::writePlotFile() 2 0.004638 0.004638 0.004638 0.15% Castro::construct_new_gravity_source() 9 0.004419 0.004419 0.004419 0.14% MLMG::addInterpCorrection() 155 0.004386 0.004386 0.004386 0.14% Gravity::actual_solve_with_mlmg() 10 0.004004 0.004004 0.004004 0.13% Castro::wd_update() 6 0.003937 0.003937 0.003937 0.13% FabArrayBase::CPC::define() 534 0.003782 0.003782 0.003782 0.12% Castro::construct_old_source() 63 0.003689 0.003689 0.003689 0.12% FillPatchInterp(MF) 30 0.003653 0.003653 0.003653 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003616 0.003616 0.003616 0.12% FabArray::setDomainBndry() 92 0.003339 0.003339 0.003339 0.11% MultiFab::contains_nan() 18 0.003252 0.003252 0.003252 0.11% Castro::enforce_speed_limit() 87 0.003208 0.003208 0.003208 0.10% MLCellLinOp::compGrad() 18 0.002919 0.002919 0.002919 0.10% Castro::apply_tagging_restrictions() 6 0.002727 0.002727 0.002727 0.09% MLCellLinOp::defineBC() 10 0.002706 0.002706 0.002706 0.09% FabArray::mult() 55 0.002582 0.002582 0.002582 0.08% MLCellLinOp::setLevelBC() 18 0.002418 0.002418 0.002418 0.08% check_for_negative_density() 9 0.002002 0.002002 0.002002 0.07% MLCellLinOp::prepareForSolve() 10 0.001995 0.001995 0.001995 0.06% MLMG::prepareForSolve() 10 0.001906 0.001906 0.001906 0.06% Castro::fill_hybrid_hydro_source() 27 0.001654 0.001654 0.001654 0.05% Castro::post_timestep() 9 0.001557 0.001557 0.001557 0.05% MLPoisson::FFlux() 150 0.001478 0.001478 0.001478 0.05% MLCellLinOp::updateSolBC() 25 0.001405 0.001405 0.001405 0.05% TagBoxArray::mapPRD 6 0.001329 0.001329 0.001329 0.04% FabArray::norminf(mask) 21 0.001228 0.001228 0.001228 0.04% Gravity::get_new_grav_vector() 10 0.001204 0.001204 0.001204 0.04% Castro::clean_state() 87 0.001189 0.001189 0.001189 0.04% FabArrayBase::getCPC() 1522 0.001168 0.001168 0.001168 0.04% Gravity::get_old_grav_vector() 9 0.001007 0.001007 0.001007 0.03% OwnerMask() 6 0.001004 0.001004 0.001004 0.03% MLCellLinOp::updateCorBC() 17 0.001003 0.001003 0.001003 0.03% Castro::build_fine_mask() 44 0.0009577 0.0009577 0.0009577 0.03% average_down_faces 48 0.0008827 0.0008827 0.0008827 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0008267 0.0008267 0.0008267 0.03% TagBoxArray::collate() 6 0.0007949 0.0007949 0.0007949 0.03% FillPatchTwoLevels 31 0.0007831 0.0007831 0.0007831 0.03% MLCGSolver::bicgstab 31 0.0007199 0.0007199 0.0007199 0.02% Castro::FluxRegFineAdd() 9 0.0006948 0.0006948 0.0006948 0.02% main() 1 0.0006786 0.0006786 0.0006786 0.02% AmrLevel::FillPatch() 62 0.0006542 0.0006542 0.0006542 0.02% FillPatchIterator::Initialize 62 0.0006124 0.0006124 0.0006124 0.02% MultiFab::max() 18 0.0005973 0.0005973 0.0005973 0.02% MLCellLinOp::smooth() 688 0.0005176 0.0005176 0.0005176 0.02% MultiFab::Multiply() 8 0.0005054 0.0005054 0.0005054 0.02% Castro::Castro() 5 0.0004636 0.0004636 0.0004636 0.02% FabArrayBase::FB::FB() 37 0.0004447 0.0004447 0.0004447 0.01% MLMG::interpCorrection_1 17 0.0004099 0.0004099 0.0004099 0.01% FabArray::FillBoundary() 1728 0.0003795 0.0003795 0.0003795 0.01% Amr::regrid() 5 0.0003504 0.0003504 0.0003504 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003343 0.0003343 0.0003343 0.01% FabArray::ParallelCopy() 954 0.0003303 0.0003303 0.0003303 0.01% Castro::initialize_do_advance() 9 0.0003102 0.0003102 0.0003102 0.01% Amr::coarseTimeStep() 5 0.0002849 0.0002849 0.0002849 0.01% FabArrayBase::getFB() 1728 0.0002826 0.0002826 0.0002826 0.01% Gravity::actual_multilevel_solve() 10 0.000252 0.000252 0.000252 0.01% Gravity::update_max_rhs() 10 0.0002518 0.0002518 0.0002518 0.01% MLLinOp::defineGrids() 10 0.0002272 0.0002272 0.0002272 0.01% AMRErrorTag::operator() 6 0.0002262 0.0002262 0.0002262 0.01% MLCellLinOp::apply() 493 0.0002258 0.0002258 0.0002258 0.01% Castro::subcycle_advance_ctu() 5 0.0002067 0.0002067 0.0002067 0.01% Castro::construct_new_rotation_source() 9 0.0002042 0.0002042 0.0002042 0.01% Castro::construct_old_rotation_source() 9 0.0001891 0.0001891 0.0001891 0.01% StateData::define() 25 0.0001571 0.0001571 0.0001571 0.01% Castro::construct_new_gravity() 9 0.000157 0.000157 0.000157 0.01% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001463 0.0001463 0.0001463 0.00% Castro::enforce_consistent_e() 1 0.0001461 0.0001461 0.0001461 0.00% Castro::construct_old_gravity() 9 0.0001353 0.0001353 0.0001353 0.00% MLCGSolver::ParallelAllReduce 745 0.0001349 0.0001349 0.0001349 0.00% Castro::initialize_advance() 9 0.0001321 0.0001321 0.0001321 0.00% Castro::do_old_sources() 9 0.0001296 0.0001296 0.0001296 0.00% Castro::swap_state_time_levels() 9 0.0001295 0.0001295 0.0001295 0.00% Castro::do_new_sources() 9 0.0001179 0.0001179 0.0001179 0.00% Castro::do_advance_ctu() 5 0.000111 0.000111 0.000111 0.00% MLMG::mgVcycle() 65 0.0001087 0.0001087 0.0001087 0.00% Castro::finalize_advance() 9 0.0001045 0.0001045 0.0001045 0.00% Castro::buildMetrics() 5 0.0001037 0.0001037 0.0001037 0.00% Castro::finalize_do_advance() 9 0.000101 0.000101 0.000101 0.00% MLCellLinOp::correctionResidual() 189 0.0001003 0.0001003 0.0001003 0.00% Amr::grid_places() 6 9.248e-05 9.248e-05 9.248e-05 0.00% Amr::timeStep() 9 8.296e-05 8.296e-05 8.296e-05 0.00% AmrLevel::derive() 6 7.666e-05 7.666e-05 7.666e-05 0.00% Castro::post_regrid() 10 6.469e-05 6.469e-05 6.469e-05 0.00% FillPatchSingleLevel 92 6.104e-05 6.104e-05 6.104e-05 0.00% MLMG::oneIter() 31 5.768e-05 5.768e-05 5.768e-05 0.00% Castro::create_source_corrector() 9 5.742e-05 5.742e-05 5.742e-05 0.00% Castro::advance() 5 5.625e-05 5.625e-05 5.625e-05 0.00% MLMG::solve() 10 5.292e-05 5.292e-05 5.292e-05 0.00% Castro::errorEst() 6 5.08e-05 5.08e-05 5.08e-05 0.00% FabArray::RecvLayoutMask() 8 4.971e-05 4.971e-05 4.971e-05 0.00% MLMG:computeResOfCorrection() 155 4.781e-05 4.781e-05 4.781e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.619e-05 4.619e-05 4.619e-05 0.00% MLCellLinOp::solutionResidual() 71 4.256e-05 4.256e-05 4.256e-05 0.00% MLMG::mgVcycle_down::0 31 4.2e-05 4.2e-05 4.2e-05 0.00% FillPatchIterator::FillFromLevel0() 31 4.131e-05 4.131e-05 4.131e-05 0.00% MLMG::actualBottomSolve() 31 3.974e-05 3.974e-05 3.974e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.9e-05 3.9e-05 3.9e-05 0.00% MLMG::mgVcycle_bottom 65 3.823e-05 3.823e-05 3.823e-05 0.00% Amr::writeSmallPlotFile() 1 3.806e-05 3.806e-05 3.806e-05 0.00% Amr::defBaseLevel() 1 3.449e-05 3.449e-05 3.449e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.419e-05 3.419e-05 3.419e-05 0.00% Gravity::solve_phi_with_mlmg() 10 3.338e-05 3.338e-05 3.338e-05 0.00% MLMG::mgVcycle_down::1 31 3.26e-05 3.26e-05 3.26e-05 0.00% Castro::computeNewDt() 8 3.126e-05 3.126e-05 3.126e-05 0.00% makeSFC 50 3.044e-05 3.044e-05 3.044e-05 0.00% MLPoisson::define() 10 3.013e-05 3.013e-05 3.013e-05 0.00% MLMG::mgVcycle_down::3 31 2.942e-05 2.942e-05 2.942e-05 0.00% MLMG::mgVcycle_down::2 31 2.84e-05 2.84e-05 2.84e-05 0.00% Castro::react_state() 18 2.751e-05 2.751e-05 2.751e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.742e-05 2.742e-05 2.742e-05 0.00% MLMG::ResNormInf() 54 2.69e-05 2.69e-05 2.69e-05 0.00% MLMG::mgVcycle_down::4 31 2.58e-05 2.58e-05 2.58e-05 0.00% MLMG::mgVcycle_up::2 31 2.336e-05 2.336e-05 2.336e-05 0.00% FabArrayBase::TheFPinfo() 25 2.283e-05 2.283e-05 2.283e-05 0.00% DistributionMapping::Distribute() 52 2.208e-05 2.208e-05 2.208e-05 0.00% MLMG::mgVcycle_up::4 31 2.124e-05 2.124e-05 2.124e-05 0.00% FPinfo::FPinfo() 3 1.965e-05 1.965e-05 1.965e-05 0.00% MLMG::mgVcycle_up::3 31 1.912e-05 1.912e-05 1.912e-05 0.00% MLMG::mgVcycle_up::0 31 1.899e-05 1.899e-05 1.899e-05 0.00% MLMG::mgVcycle_up::1 31 1.89e-05 1.89e-05 1.89e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.653e-05 1.653e-05 1.653e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.54e-05 1.54e-05 1.54e-05 0.00% Amr::initSubcycle() 1 1.441e-05 1.441e-05 1.441e-05 0.00% MLMG::computeMLResidual() 15 1.431e-05 1.431e-05 1.431e-05 0.00% MLMG::miniCycle() 34 1.428e-05 1.428e-05 1.428e-05 0.00% MLMG::computeResidual() 31 1.402e-05 1.402e-05 1.402e-05 0.00% Amr::FinalizeInit() 1 1.374e-05 1.374e-05 1.374e-05 0.00% ClusterList::intersect() 4 1.368e-05 1.368e-05 1.368e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.356e-05 1.356e-05 1.356e-05 0.00% MLLinOp::define() 10 1.351e-05 1.351e-05 1.351e-05 0.00% Castro::check_for_nan() 18 1.278e-05 1.278e-05 1.278e-05 0.00% Castro::apply_source_to_state() 18 1.102e-05 1.102e-05 1.102e-05 0.00% Castro::post_init() 1 1.084e-05 1.084e-05 1.084e-05 0.00% Castro::expand_state() 13 9.823e-06 9.823e-06 9.823e-06 0.00% Gravity::swapTimeLevels() 9 9.635e-06 9.635e-06 9.635e-06 0.00% MLMG::getGradSolution() 10 9.576e-06 9.576e-06 9.576e-06 0.00% AmrMesh-cluster 4 8.69e-06 8.69e-06 8.69e-06 0.00% Castro::construct_new_hybrid_source() 9 8.555e-06 8.555e-06 8.555e-06 0.00% MLMG::MLResNormInf() 15 8.195e-06 8.195e-06 8.195e-06 0.00% Castro::construct_old_hybrid_source() 9 7.679e-06 7.679e-06 7.679e-06 0.00% Castro::avgDown(state_indx) 20 7.349e-06 7.349e-06 7.349e-06 0.00% Amr::InitializeInit() 1 7.341e-06 7.341e-06 7.341e-06 0.00% MLPoisson::prepareForSolve() 10 6.926e-06 6.926e-06 6.926e-06 0.00% amrex::average_down_w_geom 20 6.761e-06 6.761e-06 6.761e-06 0.00% MLMG::MLRhsNormInf() 10 5.35e-06 5.35e-06 5.35e-06 0.00% BoxList::complementIn 12 5.244e-06 5.244e-06 5.244e-06 0.00% Gravity::set_mass_offset() 6 5.119e-06 5.119e-06 5.119e-06 0.00% Castro::init(old) 3 5.036e-06 5.036e-06 5.036e-06 0.00% BoxList::parallelComplementIn() 12 4.752e-06 4.752e-06 4.752e-06 0.00% Castro::derive() 6 3.907e-06 3.907e-06 3.907e-06 0.00% Castro::avgDown() 4 3.565e-06 3.565e-06 3.565e-06 0.00% Castro::computeInitialDt() 2 3.558e-06 3.558e-06 3.558e-06 0.00% Castro::retry_advance_ctu() 5 3.061e-06 3.061e-06 3.061e-06 0.00% Amr::bldFineLevels() 1 2.489e-06 2.489e-06 2.489e-06 0.00% Castro::init() 1 2.205e-06 2.205e-06 2.205e-06 0.00% ClusterList::chop() 4 2.052e-06 2.052e-06 2.052e-06 0.00% Amr::init() 1 1.973e-06 1.973e-06 1.973e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.544e-06 1.544e-06 1.544e-06 0.00% Amr::initialInit() 1 1.443e-06 1.443e-06 1.443e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.071 3.071 3.071 100.00% Amr::coarseTimeStep() 5 1.469 1.469 1.469 47.85% Amr::timeStep() 9 1.464 1.464 1.464 47.67% Castro::advance() 5 1.239 1.239 1.239 40.35% Castro::subcycle_advance_ctu() 5 1.212 1.212 1.212 39.48% Castro::do_advance_ctu() 5 1.212 1.212 1.212 39.47% Amr::InitAmr() 1 1.062 1.062 1.062 34.60% Castro::construct_ctu_hydro_source() 9 0.7285 0.7285 0.7285 23.73% Amr::init() 1 0.3837 0.3837 0.3837 12.50% Gravity::multilevel_solve_for_new_phi() 10 0.3236 0.3236 0.3236 10.54% Gravity::actual_multilevel_solve() 10 0.3228 0.3228 0.3228 10.51% Gravity::solve_phi_with_mlmg() 10 0.3195 0.3195 0.3195 10.41% Amr::writePlotFile() 2 0.2994 0.2994 0.2994 9.75% VisMF::Write(FabArray) 3 0.2923 0.2923 0.2923 9.52% Gravity::actual_solve_with_mlmg() 10 0.2455 0.2455 0.2455 8.00% Amr::initialInit() 1 0.2389 0.2389 0.2389 7.78% Castro::clean_state() 87 0.1972 0.1972 0.1972 6.42% MLMG::solve() 10 0.1931 0.1931 0.1931 6.29% Castro::construct_new_gravity() 9 0.186 0.186 0.186 6.06% Amr::InitializeInit() 1 0.1683 0.1683 0.1683 5.48% Amr::defBaseLevel() 1 0.1683 0.1683 0.1683 5.48% MLMG::oneIter() 31 0.1631 0.1631 0.1631 5.31% Amr::regrid() 5 0.1589 0.1589 0.1589 5.17% Castro::Castro() 5 0.1585 0.1585 0.1585 5.16% Castro::initMFs() 5 0.1544 0.1544 0.1544 5.03% MLMG::mgVcycle() 65 0.14 0.14 0.14 4.56% Castro::post_regrid() 10 0.1362 0.1362 0.1362 4.43% Castro::computeTemp() 88 0.1037 0.1037 0.1037 3.38% AmrLevel::FillPatch() 62 0.09113 0.09113 0.09113 2.97% MLCellLinOp::applyBC() 1917 0.09072 0.09072 0.09072 2.95% MLCellLinOp::smooth() 688 0.08024 0.08024 0.08024 2.61% FillPatchIterator::Initialize 62 0.07668 0.07668 0.07668 2.50% Gravity::fill_multipole_BCs() 10 0.07351 0.07351 0.07351 2.39% Castro::normalize_species() 87 0.07244 0.07244 0.07244 2.36% Castro::reflux() 4 0.07204 0.07204 0.07204 2.35% Amr::FinalizeInit() 1 0.07057 0.07057 0.07057 2.30% FillPatchSingleLevel 92 0.06808 0.06808 0.06808 2.22% FillPatchIterator::FillFromLevel0() 31 0.06545 0.06545 0.06545 2.13% Castro::post_timestep() 9 0.06482 0.06482 0.06482 2.11% Castro::post_init() 1 0.06054 0.06054 0.06054 1.97% Castro::initialize_do_advance() 9 0.05983 0.05983 0.05983 1.95% StateDataPhysBCFunct::() 95 0.049 0.049 0.049 1.60% Castro::do_old_sources() 9 0.04895 0.04895 0.04895 1.59% Castro::problem_post_timestep() 10 0.04855 0.04855 0.04855 1.58% Castro::do_new_sources() 9 0.04366 0.04366 0.04366 1.42% FabArray::FillBoundary() 1728 0.04361 0.04361 0.04361 1.42% FillBoundary_nowait() 1728 0.04323 0.04323 0.04323 1.41% MLPoisson::define() 10 0.04158 0.04158 0.04158 1.35% Castro::expand_state() 13 0.04126 0.04126 0.04126 1.34% FabArray::setVal() 920 0.03773 0.03773 0.03773 1.23% MLMG::mgVcycle_bottom 65 0.03697 0.03697 0.03697 1.20% StateData::FillBoundary(geom) 650 0.03477 0.03477 0.03477 1.13% FabArray::ParallelCopy() 954 0.03451 0.03451 0.03451 1.12% FabArray::ParallelCopy_nowait() 954 0.03418 0.03418 0.03418 1.11% Castro::wd_update() 6 0.03319 0.03319 0.03319 1.08% MLMG::actualBottomSolve() 31 0.03005 0.03005 0.03005 0.98% MLCGSolver::bicgstab 31 0.02976 0.02976 0.02976 0.97% FluxRegister::Reflux() 24 0.02969 0.02969 0.02969 0.97% Castro::volInBoundary() 42 0.02925 0.02925 0.02925 0.95% MLMG::mgVcycle_down::0 31 0.02896 0.02896 0.02896 0.94% MLCellLinOp::apply() 493 0.02753 0.02753 0.02753 0.90% Castro::reset_internal_energy(MultiFab) 88 0.02744 0.02744 0.02744 0.89% Castro::initialize_advance() 9 0.02677 0.02677 0.02677 0.87% amrex::Copy() 441 0.0265 0.0265 0.0265 0.86% Castro::construct_new_source() 63 0.02578 0.02578 0.02578 0.84% MLCellLinOp::defineAuxData() 10 0.0237 0.0237 0.0237 0.77% Gravity::get_new_grav_vector() 10 0.02287 0.02287 0.02287 0.74% MLMG::mgVcycle_up::0 31 0.02161 0.02161 0.02161 0.70% Amr::grid_places() 6 0.0216 0.0216 0.0216 0.70% AmrMesh::MakeNewGrids() 6 0.02151 0.02151 0.02151 0.70% Castro::construct_old_gravity() 9 0.01847 0.01847 0.01847 0.60% Gravity::get_old_grav_vector() 9 0.01833 0.01833 0.01833 0.60% Castro::enforce_min_density() 87 0.01808 0.01808 0.01808 0.59% MLCellLinOp::correctionResidual() 189 0.018 0.018 0.018 0.59% MLCellLinOp::defineBC() 10 0.01754 0.01754 0.01754 0.57% amrex::Add() 136 0.01724 0.01724 0.01724 0.56% Castro::estTimeStep() 26 0.01652 0.01652 0.01652 0.54% FabArray::Saxpy() 604 0.01575 0.01575 0.01575 0.51% MLCellLinOp::reflux() 30 0.01532 0.01532 0.01532 0.50% BndryData::define() 26 0.01469 0.01469 0.01469 0.48% MLCellLinOp::solutionResidual() 71 0.01455 0.01455 0.01455 0.47% MLMG:computeResOfCorrection() 155 0.01382 0.01382 0.01382 0.45% MLMG::computeResWithCrseSolFineCor() 17 0.01325 0.01325 0.01325 0.43% MLMG::computeMLResidual() 15 0.01267 0.01267 0.01267 0.41% MLPoisson::Fsmooth() 1376 0.01221 0.01221 0.01221 0.40% Castro::errorEst() 6 0.012 0.012 0.012 0.39% Castro::initData() 1 0.01156 0.01156 0.01156 0.38% MLMG::mgVcycle_down::1 31 0.01151 0.01151 0.01151 0.37% Castro::construct_old_source() 63 0.01108 0.01108 0.01108 0.36% amrex::average_down 233 0.009838 0.009838 0.009838 0.32% Castro::FluxRegCrseInit 9 0.009054 0.009054 0.009054 0.29% amrex::Dot() 466 0.008842 0.008842 0.008842 0.29% MLMG::prepareForSolve() 10 0.008806 0.008806 0.008806 0.29% FabArray::norminf() 439 0.008418 0.008418 0.008418 0.27% MLMG::mgVcycle_up::1 31 0.008255 0.008255 0.008255 0.27% Castro::computeNewDt() 8 0.008149 0.008149 0.008149 0.27% Castro::apply_problem_tags() 6 0.00808 0.00808 0.00808 0.26% FillPatchIterator::FillFromTwoLevels() 31 0.00746 0.00746 0.00746 0.24% FillPatchTwoLevels 31 0.007426 0.007426 0.007426 0.24% Castro::construct_old_gravity_source() 18 0.007275 0.007275 0.007275 0.24% MLMG::miniCycle() 34 0.006939 0.006939 0.006939 0.23% MLMG::addInterpCorrection() 155 0.006755 0.006755 0.006755 0.22% Amr::bldFineLevels() 1 0.006746 0.006746 0.006746 0.22% MLPoisson::Fapply() 493 0.006712 0.006712 0.006712 0.22% MLMG::mgVcycle_down::2 31 0.006637 0.006637 0.006637 0.22% FabArray::Xpay() 353 0.006363 0.006363 0.006363 0.21% MLMG::mgVcycle_down::3 31 0.006046 0.006046 0.006046 0.20% MLMG::mgVcycle_down::4 31 0.005909 0.005909 0.005909 0.19% Castro::finalize_do_advance() 9 0.005873 0.005873 0.005873 0.19% MLMG::computeResidual() 31 0.005809 0.005809 0.005809 0.19% MLCGSolver::ParallelAllReduce 745 0.005021 0.005021 0.005021 0.16% Castro::reset_internal_energy(Fab) 1476 0.004971 0.004971 0.004971 0.16% FabArrayBase::getCPC() 1522 0.00495 0.00495 0.00495 0.16% MLMG::mgVcycle_up::4 31 0.004788 0.004788 0.004788 0.16% MLMG::mgVcycle_up::2 31 0.004624 0.004624 0.004624 0.15% MLMG::mgVcycle_up::3 31 0.004579 0.004579 0.004579 0.15% MLMG::getGradSolution() 10 0.004435 0.004435 0.004435 0.14% MLCellLinOp::compGrad() 18 0.004426 0.004426 0.004426 0.14% Castro::construct_new_gravity_source() 9 0.004419 0.004419 0.004419 0.14% Castro::apply_source_to_state() 18 0.004221 0.004221 0.004221 0.14% FabArrayBase::CPC::define() 534 0.003782 0.003782 0.003782 0.12% FillPatchInterp(MF) 30 0.003653 0.003653 0.003653 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003616 0.003616 0.003616 0.12% MLMG::computeResWithCrseCorFineCor() 17 0.003471 0.003471 0.003471 0.11% FabArray::setDomainBndry() 92 0.003339 0.003339 0.003339 0.11% MLCellLinOp::updateSolBC() 25 0.003323 0.003323 0.003323 0.11% Castro::check_for_nan() 18 0.003265 0.003265 0.003265 0.11% MultiFab::contains_nan() 18 0.003252 0.003252 0.003252 0.11% Castro::enforce_speed_limit() 87 0.003208 0.003208 0.003208 0.10% TagBoxArray::mapPRD 6 0.003184 0.003184 0.003184 0.10% Castro::init(old) 3 0.003064 0.003064 0.003064 0.10% Castro::apply_tagging_restrictions() 6 0.002727 0.002727 0.002727 0.09% Castro::computeInitialDt() 2 0.002638 0.002638 0.002638 0.09% FabArray::mult() 55 0.002582 0.002582 0.002582 0.08% Castro::buildMetrics() 5 0.002463 0.002463 0.002463 0.08% MLCellLinOp::setLevelBC() 18 0.002418 0.002418 0.002418 0.08% MLCellLinOp::updateCorBC() 17 0.002271 0.002271 0.002271 0.07% MLMG::ResNormInf() 54 0.002076 0.002076 0.002076 0.07% Gravity::update_max_rhs() 10 0.002017 0.002017 0.002017 0.07% MLPoisson::prepareForSolve() 10 0.002002 0.002002 0.002002 0.07% check_for_negative_density() 9 0.002002 0.002002 0.002002 0.07% MLCellLinOp::prepareForSolve() 10 0.001995 0.001995 0.001995 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.001986 0.001986 0.001986 0.06% Castro::fill_hybrid_hydro_source() 27 0.001654 0.001654 0.001654 0.05% MLPoisson::FFlux() 150 0.001478 0.001478 0.001478 0.05% average_down_faces 48 0.001312 0.001312 0.001312 0.04% FabArray::norminf(mask) 21 0.001228 0.001228 0.001228 0.04% Castro::avgDown() 4 0.001158 0.001158 0.001158 0.04% Castro::avgDown(state_indx) 20 0.001154 0.001154 0.001154 0.04% amrex::average_down_w_geom 20 0.001147 0.001147 0.001147 0.04% MLMG::MLResNormInf() 15 0.001145 0.001145 0.001145 0.04% Castro::construct_new_hybrid_source() 9 0.001009 0.001009 0.001009 0.03% OwnerMask() 6 0.001004 0.001004 0.001004 0.03% MLMG::interpCorrection_1 17 0.0009628 0.0009628 0.0009628 0.03% Castro::build_fine_mask() 44 0.0009577 0.0009577 0.0009577 0.03% Castro::derive() 6 0.0009176 0.0009176 0.0009176 0.03% AmrLevel::derive() 6 0.0009137 0.0009137 0.0009137 0.03% Castro::init() 1 0.000902 0.000902 0.000902 0.03% AmrLevel::FillCoarsePatch() 5 0.0008998 0.0008998 0.0008998 0.03% TagBoxArray::collate() 6 0.0007949 0.0007949 0.0007949 0.03% FabArrayBase::getFB() 1728 0.0007274 0.0007274 0.0007274 0.02% Castro::FluxRegFineAdd() 9 0.0006948 0.0006948 0.0006948 0.02% Gravity::swapTimeLevels() 9 0.0006797 0.0006797 0.0006797 0.02% Castro::construct_old_hybrid_source() 9 0.0006613 0.0006613 0.0006613 0.02% MLMG::MLRhsNormInf() 10 0.0005988 0.0005988 0.0005988 0.02% MultiFab::max() 18 0.0005973 0.0005973 0.0005973 0.02% MultiFab::Multiply() 8 0.0005054 0.0005054 0.0005054 0.02% FabArrayBase::FB::FB() 37 0.0004447 0.0004447 0.0004447 0.01% Castro::react_state() 18 0.0003695 0.0003695 0.0003695 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003343 0.0003343 0.0003343 0.01% MLLinOp::define() 10 0.000308 0.000308 0.000308 0.01% MLLinOp::defineGrids() 10 0.0002945 0.0002945 0.0002945 0.01% AMRErrorTag::operator() 6 0.0002262 0.0002262 0.0002262 0.01% Castro::construct_new_rotation_source() 9 0.0002042 0.0002042 0.0002042 0.01% AmrLevel::AmrLevel(dm) 5 0.0001961 0.0001961 0.0001961 0.01% Castro::construct_old_rotation_source() 9 0.0001891 0.0001891 0.0001891 0.01% StateData::define() 25 0.0001571 0.0001571 0.0001571 0.01% Castro::enforce_consistent_e() 1 0.0001461 0.0001461 0.0001461 0.00% Castro::swap_state_time_levels() 9 0.0001295 0.0001295 0.0001295 0.00% Castro::finalize_advance() 9 0.0001045 0.0001045 0.0001045 0.00% MLLinOp::makeAgglomeratedDMap 10 6.574e-05 6.574e-05 6.574e-05 0.00% Castro::create_source_corrector() 9 5.742e-05 5.742e-05 5.742e-05 0.00% makeSFC 50 5.034e-05 5.034e-05 5.034e-05 0.00% FabArray::RecvLayoutMask() 8 4.971e-05 4.971e-05 4.971e-05 0.00% FabArrayBase::TheFPinfo() 25 4.248e-05 4.248e-05 4.248e-05 0.00% Amr::writeSmallPlotFile() 1 3.806e-05 3.806e-05 3.806e-05 0.00% AmrMesh-cluster 4 2.442e-05 2.442e-05 2.442e-05 0.00% DistributionMapping::Distribute() 52 2.208e-05 2.208e-05 2.208e-05 0.00% FPinfo::FPinfo() 3 1.965e-05 1.965e-05 1.965e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.872e-05 1.872e-05 1.872e-05 0.00% Amr::initSubcycle() 1 1.441e-05 1.441e-05 1.441e-05 0.00% ClusterList::intersect() 4 1.368e-05 1.368e-05 1.368e-05 0.00% BoxList::parallelComplementIn() 12 9.996e-06 9.996e-06 9.996e-06 0.00% BoxList::complementIn 12 5.244e-06 5.244e-06 5.244e-06 0.00% Gravity::set_mass_offset() 6 5.119e-06 5.119e-06 5.119e-06 0.00% Castro::retry_advance_ctu() 5 3.061e-06 3.061e-06 3.061e-06 0.00% ClusterList::chop() 4 2.052e-06 2.052e-06 2.052e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.544e-06 1.544e-06 1.544e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1725 KiB 9037 MiB Castro::reflux() 436 436 12 MiB 666 MiB Castro::initMFs() 258 258 344 MiB 576 MiB Castro::swap_state_time_levels() 175 175 176 MiB 340 MiB StateData::define() 175 175 217 MiB 340 MiB Castro::initialize_do_advance() 143 143 120 MiB 325 MiB FillPatchIterator::Initialize 899 899 4088 KiB 303 MiB Amr::writePlotFile() 56 56 17 MiB 189 MiB Castro::problem_post_timestep() 162 162 780 KiB 167 MiB Castro::FluxRegCrseInit 660 660 460 KiB 167 MiB FluxRegister::Reflux() 648 648 1569 KiB 160 MiB Castro::initialize_advance() 143 143 48 MiB 121 MiB Castro::construct_new_source() 143 143 247 KiB 67 MiB Castro::construct_old_source() 143 143 118 KiB 67 MiB Castro::buildMetrics() 140 140 36 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 27 MiB 60 MiB Castro::Castro() 210 210 4032 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2708 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 197 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 245 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 889 KiB 16 MiB FillPatchTwoLevels 300 300 7862 B 11 MiB FillPatchInterp(MF) 330 330 4778 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 135 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4535 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 764 KiB 7424 KiB Castro::build_fine_mask() 224 224 1247 KiB 6912 KiB AmrLevel::derive() 162 162 2575 B 6912 KiB BndryData::define() 3624 3624 283 KiB 4243 KiB MLCellLinOp::reflux() 450 450 5643 B 2376 KiB Castro::wd_update() 6 6 24 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 417 B 2095 KiB amrex::average_down 1483 1483 2359 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 7388 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 796 B 867 KiB MLCellLinOp::defineBC() 276 276 3853 B 689 KiB Castro::estTimeStep() 26 26 2561 B 480 KiB VisMF::Write(FabArray) 1568 1568 2328 B 320 KiB Castro::normalize_species() 87 87 7586 B 320 KiB Castro::volInBoundary() 70 70 3088 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 129 B 204 KiB FabArray::norminf(mask) 29 29 189 B 163 KiB amrex::Dot() 559 559 426 B 160 KiB FabArray::norminf() 470 470 423 B 160 KiB MultiFab::max() 18 18 30 B 160 KiB check_for_negative_density() 9 9 104 B 160 KiB Castro::initData() 1 1 42 B 160 KiB FabArray::setVal() 419 419 54 KiB 120 KiB MLMG::interpCorrection_1 34 34 27 B 91 KiB average_down_faces 99 99 633 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 285 B 57 KiB MLPoisson::Fsmooth() 228 228 3089 B 55 KiB FillBoundary_nowait() 751 751 453 B 53 KiB TagBoxArray::mapPRD 324 324 42 B 45 KiB OwnerMask() 168 168 12 B 38 KiB MLCellLinOp::applyBC() 3834 3834 144 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9432 B 25 KiB MultiFab::contains_nan() 18 18 21 B 20 KiB StateData::FillBoundary(geom) 2538 2538 41 B 12 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 622 B 3456 B MLCGSolver::bicgstab 155 155 25 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 178 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 12 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 607 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1264 B 278 KiB FabArray::setVal() 419 419 54 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 285 B 57 KiB MLPoisson::Fsmooth() 228 228 3089 B 55 KiB FillBoundary_nowait() 751 751 454 B 53 KiB MLCellLinOp::applyBC() 1917 1917 144 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9432 B 25 KiB Gravity::get_new_grav_vector() 18 18 3393 B 20 KiB Gravity::get_old_grav_vector() 12 12 6219 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 41 B 12 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1326 B 6304 B MLMG::prepareForSolve() 18 18 231 B 3712 B FabArray::norminf(mask) 29 29 129 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 622 B 3456 B Castro::FluxRegCrseInit 12 12 9 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 604 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (24.04-3-gd78e241d1ad4) finalized