Initializing AMReX (24.04-3-gd78e241d1ad4)... Initializing CUDA... CUDA initialized with 1 device. AMReX (24.04-3-gd78e241d1ad4) initialized Starting run at 20:52:11 UTC on 2024-04-02. Successfully read inputs file ... Castro git describe: 24.04-1-g6930369b2 AMReX git describe: 24.04-3-gd78e241d1 Microphysics git describe: 24.04 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.004049454 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.00182823 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009065308 Gravity::multilevel_solve_for_new_phi() time = 0.052657156 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.145427764 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003367238 on level 0 Castro::do_old_sources() time = 0.008857669 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.128489619 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.006817099 Gravity::multilevel_solve_for_new_phi() time = 0.040487371 Castro::construct_new_gravity() time = 0.04395236 on level 0 Castro::do_new_sources() time = 0.008328743 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.112662395 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.224474359 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002218048 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007431276 Gravity::multilevel_solve_for_new_phi() time = 0.059786297 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003343499 on level 0 Castro::do_old_sources() time = 0.006527051 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.168481903 on level 0 Castro::construct_old_gravity() time = 0.000342061 on level 1 Castro::do_old_sources() time = 0.00206807 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007765767 on level 1 Castro::reflux() at level 0 : time = 0.018820896 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007196306 Gravity::multilevel_solve_for_new_phi() time = 0.041089596 Castro::construct_new_gravity() time = 0.044511665 on level 0 Castro::do_new_sources() time = 0.00679906 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000390412 on level 1 Castro::do_new_sources() time = 0.002346267 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.320710348 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.369802678 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.002016368 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007207148 Gravity::multilevel_solve_for_new_phi() time = 0.015047069 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003401504 on level 0 Castro::do_old_sources() time = 0.006627793 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.155760034 on level 0 Castro::construct_old_gravity() time = 0.000327674 on level 1 Castro::do_old_sources() time = 0.0015092 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.010747593 on level 1 Castro::reflux() at level 0 : time = 0.01755265 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007216849 Gravity::multilevel_solve_for_new_phi() time = 0.028723093 Castro::construct_new_gravity() time = 0.032128288 on level 0 Castro::do_new_sources() time = 0.006720128 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.00039623 on level 1 Castro::do_new_sources() time = 0.00219978 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.648480174 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.301308466 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002134157 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007155207 Gravity::multilevel_solve_for_new_phi() time = 0.01499 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003337935 on level 0 Castro::do_old_sources() time = 0.006452503 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.115959408 on level 0 Castro::construct_old_gravity() time = 0.000334156 on level 1 Castro::do_old_sources() time = 0.001562531 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.013934713 on level 1 Castro::reflux() at level 0 : time = 0.020944146 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007255072 Gravity::multilevel_solve_for_new_phi() time = 0.028857464 Castro::construct_new_gravity() time = 0.032393168 on level 0 Castro::do_new_sources() time = 0.01659647 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000394897 on level 1 Castro::do_new_sources() time = 0.002320349 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.932985873 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.283622545 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.003207694 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007217347 Gravity::multilevel_solve_for_new_phi() time = 0.015147568 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.00336535 on level 0 Castro::do_old_sources() time = 0.006553545 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.110232816 on level 0 Castro::construct_old_gravity() time = 0.000355527 on level 1 Castro::do_old_sources() time = 0.001475283 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.012800274 on level 1 Castro::reflux() at level 0 : time = 0.020698143 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007277805 Gravity::multilevel_solve_for_new_phi() time = 0.029101002 Castro::construct_new_gravity() time = 0.032600548 on level 0 Castro::do_new_sources() time = 0.00982094 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000419264 on level 1 Castro::do_new_sources() time = 0.002367514 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 4.104499303 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.27998957 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.153772249 seconds Ending run at 20:52:14 UTC on 2024-04-02. Run time = 3.045322713 Run time without initialization = 1.613889896 Average number of zones advanced per microsecond: 3.066 Average number of zones advanced per microsecond per rank: 3.066 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.045 ... 3.045 ... 3.045 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0513 1.0513 1.0513 34.52% Castro::construct_ctu_hydro_source() 9 0.6923 0.6923 0.6923 22.73% VisMF::Write(FabArray) 3 0.2923 0.2923 0.2923 9.60% Castro::initMFs() 5 0.1476 0.1476 0.1476 4.85% Castro::computeTemp() 88 0.07795 0.07795 0.07795 2.56% Gravity::fill_multipole_BCs() 10 0.07192 0.07192 0.07192 2.36% Castro::normalize_species() 87 0.06792 0.06792 0.06792 2.23% MLCellLinOp::applyBC() 1917 0.04741 0.04741 0.04741 1.56% FillBoundary_nowait() 1728 0.04275 0.04275 0.04275 1.40% FabArray::setVal() 920 0.038 0.038 0.038 1.25% StateData::FillBoundary(geom) 650 0.03486 0.03486 0.03486 1.14% FabArray::ParallelCopy_nowait() 954 0.03021 0.03021 0.03021 0.99% Castro::volInBoundary() 42 0.02834 0.02834 0.02834 0.93% amrex::Copy() 441 0.02652 0.02652 0.02652 0.87% Castro::reset_internal_energy(MultiFab) 88 0.02309 0.02309 0.02309 0.76% FluxRegister::Reflux() 24 0.02241 0.02241 0.02241 0.74% MLCellLinOp::defineAuxData() 10 0.02048 0.02048 0.02048 0.67% Castro::enforce_min_density() 87 0.02009 0.02009 0.02009 0.66% amrex::Add() 136 0.01725 0.01725 0.01725 0.57% Castro::reflux() 4 0.01717 0.01717 0.01717 0.56% Castro::estTimeStep() 26 0.01665 0.01665 0.01665 0.55% FabArray::Saxpy() 604 0.01578 0.01578 0.01578 0.52% StateDataPhysBCFunct::() 95 0.01423 0.01423 0.01423 0.47% Castro::construct_new_source() 63 0.01421 0.01421 0.01421 0.47% BndryData::define() 26 0.01257 0.01257 0.01257 0.41% MLPoisson::Fsmooth() 1376 0.01234 0.01234 0.01234 0.41% Castro::problem_post_timestep() 10 0.01008 0.01008 0.01008 0.33% MLCellLinOp::reflux() 30 0.009873 0.009873 0.009873 0.32% amrex::Dot() 466 0.008913 0.008913 0.008913 0.29% FabArray::norminf() 439 0.008543 0.008543 0.008543 0.28% Castro::construct_old_gravity_source() 18 0.008033 0.008033 0.008033 0.26% Castro::FluxRegCrseInit 9 0.007937 0.007937 0.007937 0.26% MLPoisson::Fapply() 493 0.006772 0.006772 0.006772 0.22% Castro::initData() 1 0.006453 0.006453 0.006453 0.21% FabArray::Xpay() 353 0.006357 0.006357 0.006357 0.21% AmrMesh::MakeNewGrids() 6 0.006218 0.006218 0.006218 0.20% amrex::average_down 233 0.006186 0.006186 0.006186 0.20% Castro::construct_new_gravity_source() 9 0.005141 0.005141 0.005141 0.17% Castro::wd_update() 6 0.004734 0.004734 0.004734 0.16% Amr::writePlotFile() 2 0.004618 0.004618 0.004618 0.15% MLMG::addInterpCorrection() 155 0.004385 0.004385 0.004385 0.14% Castro::construct_old_source() 63 0.004234 0.004234 0.004234 0.14% Castro::reset_internal_energy(Fab) 1476 0.004096 0.004096 0.004096 0.13% Gravity::actual_solve_with_mlmg() 10 0.003906 0.003906 0.003906 0.13% FabArrayBase::CPC::define() 534 0.00379 0.00379 0.00379 0.12% FillPatchInterp(MF) 30 0.003648 0.003648 0.003648 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003616 0.003616 0.003616 0.12% FabArray::setDomainBndry() 92 0.003253 0.003253 0.003253 0.11% MultiFab::contains_nan() 18 0.00325 0.00325 0.00325 0.11% Castro::apply_tagging_restrictions() 6 0.00316 0.00316 0.00316 0.10% MLCellLinOp::compGrad() 18 0.00289 0.00289 0.00289 0.09% MLCellLinOp::defineBC() 10 0.00267 0.00267 0.00267 0.09% check_for_negative_density() 9 0.002581 0.002581 0.002581 0.08% FabArray::mult() 55 0.00258 0.00258 0.00258 0.08% Castro::enforce_speed_limit() 87 0.002421 0.002421 0.002421 0.08% MLCellLinOp::setLevelBC() 18 0.002409 0.002409 0.002409 0.08% MLCellLinOp::prepareForSolve() 10 0.001987 0.001987 0.001987 0.07% MLMG::prepareForSolve() 10 0.001871 0.001871 0.001871 0.06% Castro::fill_hybrid_hydro_source() 27 0.00187 0.00187 0.00187 0.06% MLPoisson::FFlux() 150 0.001466 0.001466 0.001466 0.05% MLCellLinOp::updateSolBC() 25 0.001369 0.001369 0.001369 0.04% TagBoxArray::mapPRD 6 0.001347 0.001347 0.001347 0.04% FabArray::norminf(mask) 21 0.001228 0.001228 0.001228 0.04% Gravity::get_new_grav_vector() 10 0.001206 0.001206 0.001206 0.04% FabArrayBase::getCPC() 1522 0.001164 0.001164 0.001164 0.04% MLCellLinOp::updateCorBC() 17 0.001004 0.001004 0.001004 0.03% OwnerMask() 6 0.001003 0.001003 0.001003 0.03% Gravity::get_old_grav_vector() 9 0.0009523 0.0009523 0.0009523 0.03% Castro::build_fine_mask() 44 0.000945 0.000945 0.000945 0.03% average_down_faces 48 0.0008741 0.0008741 0.0008741 0.03% Castro::post_timestep() 9 0.0008691 0.0008691 0.0008691 0.03% MLCGSolver::bicgstab 31 0.0007971 0.0007971 0.0007971 0.03% TagBoxArray::collate() 6 0.0007925 0.0007925 0.0007925 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0007694 0.0007694 0.0007694 0.03% FillPatchTwoLevels 31 0.000742 0.000742 0.000742 0.02% main() 1 0.0007153 0.0007153 0.0007153 0.02% Castro::FluxRegFineAdd() 9 0.0006586 0.0006586 0.0006586 0.02% AmrLevel::FillPatch() 62 0.0006478 0.0006478 0.0006478 0.02% MultiFab::max() 18 0.0006228 0.0006228 0.0006228 0.02% MLCellLinOp::smooth() 688 0.0006138 0.0006138 0.0006138 0.02% FillPatchIterator::Initialize 62 0.0005583 0.0005583 0.0005583 0.02% MultiFab::Multiply() 8 0.0005199 0.0005199 0.0005199 0.02% Castro::apply_problem_tags() 6 0.0004955 0.0004955 0.0004955 0.02% FabArrayBase::FB::FB() 37 0.000445 0.000445 0.000445 0.01% FabArray::FillBoundary() 1728 0.0004375 0.0004375 0.0004375 0.01% MLMG::interpCorrection_1 17 0.000402 0.000402 0.000402 0.01% Castro::Castro() 5 0.0003895 0.0003895 0.0003895 0.01% FabArray::ParallelCopy() 954 0.000362 0.000362 0.000362 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003605 0.0003605 0.0003605 0.01% Castro::clean_state() 87 0.0003508 0.0003508 0.0003508 0.01% Amr::regrid() 5 0.0003179 0.0003179 0.0003179 0.01% Castro::construct_new_rotation_source() 9 0.0002932 0.0002932 0.0002932 0.01% FabArrayBase::getFB() 1728 0.0002874 0.0002874 0.0002874 0.01% MLCellLinOp::apply() 493 0.0002797 0.0002797 0.0002797 0.01% Amr::coarseTimeStep() 5 0.0002675 0.0002675 0.0002675 0.01% Castro::subcycle_advance_ctu() 5 0.0002583 0.0002583 0.0002583 0.01% Gravity::update_max_rhs() 10 0.0002571 0.0002571 0.0002571 0.01% AMRErrorTag::operator() 6 0.0002471 0.0002471 0.0002471 0.01% Gravity::actual_multilevel_solve() 10 0.0002451 0.0002451 0.0002451 0.01% Castro::construct_old_rotation_source() 9 0.0002208 0.0002208 0.0002208 0.01% MLLinOp::defineGrids() 10 0.0002091 0.0002091 0.0002091 0.01% Castro::initialize_do_advance() 9 0.0001808 0.0001808 0.0001808 0.01% Castro::initialize_advance() 9 0.0001755 0.0001755 0.0001755 0.01% StateData::define() 25 0.0001572 0.0001572 0.0001572 0.01% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001453 0.0001453 0.0001453 0.00% Castro::enforce_consistent_e() 1 0.0001416 0.0001416 0.0001416 0.00% MLCGSolver::ParallelAllReduce 745 0.0001413 0.0001413 0.0001413 0.00% Castro::swap_state_time_levels() 9 0.0001285 0.0001285 0.0001285 0.00% Castro::do_new_sources() 9 0.0001271 0.0001271 0.0001271 0.00% Castro::construct_new_gravity() 9 0.0001228 0.0001228 0.0001228 0.00% Castro::finalize_do_advance() 9 0.0001187 0.0001187 0.0001187 0.00% Castro::construct_old_gravity() 9 0.0001155 0.0001155 0.0001155 0.00% MLMG::mgVcycle() 65 0.0001132 0.0001132 0.0001132 0.00% Amr::grid_places() 6 0.0001118 0.0001118 0.0001118 0.00% Castro::finalize_advance() 9 0.0001077 0.0001077 0.0001077 0.00% Castro::buildMetrics() 5 0.0001063 0.0001063 0.0001063 0.00% Castro::do_old_sources() 9 0.0001061 0.0001061 0.0001061 0.00% MLCellLinOp::correctionResidual() 189 0.0001055 0.0001055 0.0001055 0.00% Castro::post_regrid() 10 9.177e-05 9.177e-05 9.177e-05 0.00% AmrLevel::derive() 6 8.518e-05 8.518e-05 8.518e-05 0.00% Castro::do_advance_ctu() 5 8.263e-05 8.263e-05 8.263e-05 0.00% Amr::timeStep() 9 7.711e-05 7.711e-05 7.711e-05 0.00% MLMG::oneIter() 31 6.158e-05 6.158e-05 6.158e-05 0.00% FillPatchSingleLevel 92 5.947e-05 5.947e-05 5.947e-05 0.00% Castro::errorEst() 6 5.122e-05 5.122e-05 5.122e-05 0.00% FabArray::RecvLayoutMask() 8 4.944e-05 4.944e-05 4.944e-05 0.00% MLMG::solve() 10 4.877e-05 4.877e-05 4.877e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.848e-05 4.848e-05 4.848e-05 0.00% MLCellLinOp::solutionResidual() 71 4.762e-05 4.762e-05 4.762e-05 0.00% MLMG:computeResOfCorrection() 155 4.687e-05 4.687e-05 4.687e-05 0.00% Castro::create_source_corrector() 9 4.52e-05 4.52e-05 4.52e-05 0.00% MLMG::mgVcycle_down::0 31 4.363e-05 4.363e-05 4.363e-05 0.00% Castro::computeNewDt() 8 4.26e-05 4.26e-05 4.26e-05 0.00% Amr::writeSmallPlotFile() 1 4.088e-05 4.088e-05 4.088e-05 0.00% MLMG::actualBottomSolve() 31 4.079e-05 4.079e-05 4.079e-05 0.00% MLMG::mgVcycle_bottom 65 4.058e-05 4.058e-05 4.058e-05 0.00% MLMG::mgVcycle_down::1 31 3.952e-05 3.952e-05 3.952e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.711e-05 3.711e-05 3.711e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.632e-05 3.632e-05 3.632e-05 0.00% Amr::defBaseLevel() 1 3.465e-05 3.465e-05 3.465e-05 0.00% Gravity::solve_phi_with_mlmg() 10 3.459e-05 3.459e-05 3.459e-05 0.00% MLMG::mgVcycle_down::3 31 3.148e-05 3.148e-05 3.148e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.126e-05 3.126e-05 3.126e-05 0.00% MLMG::mgVcycle_down::2 31 3.037e-05 3.037e-05 3.037e-05 0.00% Castro::advance() 5 2.998e-05 2.998e-05 2.998e-05 0.00% Castro::react_state() 18 2.851e-05 2.851e-05 2.851e-05 0.00% MLPoisson::define() 10 2.83e-05 2.83e-05 2.83e-05 0.00% MLMG::mgVcycle_down::4 31 2.814e-05 2.814e-05 2.814e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.805e-05 2.805e-05 2.805e-05 0.00% MLMG::ResNormInf() 54 2.792e-05 2.792e-05 2.792e-05 0.00% makeSFC 50 2.701e-05 2.701e-05 2.701e-05 0.00% MLMG::mgVcycle_up::4 31 2.325e-05 2.325e-05 2.325e-05 0.00% MLMG::mgVcycle_up::3 31 2.141e-05 2.141e-05 2.141e-05 0.00% MLMG::mgVcycle_up::0 31 2.076e-05 2.076e-05 2.076e-05 0.00% MLMG::mgVcycle_up::1 31 2.054e-05 2.054e-05 2.054e-05 0.00% FabArrayBase::TheFPinfo() 25 2.03e-05 2.03e-05 2.03e-05 0.00% DistributionMapping::Distribute() 52 1.979e-05 1.979e-05 1.979e-05 0.00% MLMG::mgVcycle_up::2 31 1.935e-05 1.935e-05 1.935e-05 0.00% FPinfo::FPinfo() 3 1.892e-05 1.892e-05 1.892e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.641e-05 1.641e-05 1.641e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.552e-05 1.552e-05 1.552e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.473e-05 1.473e-05 1.473e-05 0.00% MLMG::computeResidual() 31 1.459e-05 1.459e-05 1.459e-05 0.00% Amr::initSubcycle() 1 1.45e-05 1.45e-05 1.45e-05 0.00% MLMG::miniCycle() 34 1.423e-05 1.423e-05 1.423e-05 0.00% Amr::FinalizeInit() 1 1.4e-05 1.4e-05 1.4e-05 0.00% MLMG::computeMLResidual() 15 1.324e-05 1.324e-05 1.324e-05 0.00% MLLinOp::define() 10 1.301e-05 1.301e-05 1.301e-05 0.00% ClusterList::intersect() 4 1.245e-05 1.245e-05 1.245e-05 0.00% Castro::check_for_nan() 18 1.144e-05 1.144e-05 1.144e-05 0.00% Castro::post_init() 1 1.143e-05 1.143e-05 1.143e-05 0.00% Castro::apply_source_to_state() 18 1.092e-05 1.092e-05 1.092e-05 0.00% MLMG::getGradSolution() 10 9.765e-06 9.765e-06 9.765e-06 0.00% Castro::construct_new_hybrid_source() 9 8.923e-06 8.923e-06 8.923e-06 0.00% Gravity::swapTimeLevels() 9 8.516e-06 8.516e-06 8.516e-06 0.00% Castro::avgDown(state_indx) 20 8.318e-06 8.318e-06 8.318e-06 0.00% Castro::expand_state() 13 8.098e-06 8.098e-06 8.098e-06 0.00% amrex::average_down_w_geom 20 8.096e-06 8.096e-06 8.096e-06 0.00% AmrMesh-cluster 4 7.594e-06 7.594e-06 7.594e-06 0.00% MLMG::MLResNormInf() 15 7.486e-06 7.486e-06 7.486e-06 0.00% MLPoisson::prepareForSolve() 10 7.363e-06 7.363e-06 7.363e-06 0.00% Amr::InitializeInit() 1 7.32e-06 7.32e-06 7.32e-06 0.00% Castro::construct_old_hybrid_source() 9 6.615e-06 6.615e-06 6.615e-06 0.00% MLMG::MLRhsNormInf() 10 6.113e-06 6.113e-06 6.113e-06 0.00% Castro::init(old) 3 5.199e-06 5.199e-06 5.199e-06 0.00% BoxList::complementIn 12 4.903e-06 4.903e-06 4.903e-06 0.00% Castro::avgDown() 4 4.85e-06 4.85e-06 4.85e-06 0.00% BoxList::parallelComplementIn() 12 4.692e-06 4.692e-06 4.692e-06 0.00% Gravity::set_mass_offset() 6 4.271e-06 4.271e-06 4.271e-06 0.00% Castro::derive() 6 3.529e-06 3.529e-06 3.529e-06 0.00% Castro::computeInitialDt() 2 3.068e-06 3.068e-06 3.068e-06 0.00% Castro::retry_advance_ctu() 5 2.859e-06 2.859e-06 2.859e-06 0.00% Amr::bldFineLevels() 1 2.668e-06 2.668e-06 2.668e-06 0.00% ClusterList::chop() 4 2.282e-06 2.282e-06 2.282e-06 0.00% Castro::init() 1 2.27e-06 2.27e-06 2.27e-06 0.00% Amr::init() 1 1.944e-06 1.944e-06 1.944e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.699e-06 1.699e-06 1.699e-06 0.00% Amr::initialInit() 1 1.454e-06 1.454e-06 1.454e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.045 3.045 3.045 100.00% Amr::coarseTimeStep() 5 1.459 1.459 1.459 47.92% Amr::timeStep() 9 1.454 1.454 1.454 47.75% Castro::advance() 5 1.235 1.235 1.235 40.55% Castro::subcycle_advance_ctu() 5 1.21 1.21 1.21 39.72% Castro::do_advance_ctu() 5 1.209 1.209 1.209 39.71% Amr::InitAmr() 1 1.051 1.051 1.051 34.52% Castro::construct_ctu_hydro_source() 9 0.7242 0.7242 0.7242 23.78% Amr::init() 1 0.38 0.38 0.38 12.48% Gravity::multilevel_solve_for_new_phi() 10 0.326 0.326 0.326 10.71% Gravity::actual_multilevel_solve() 10 0.3252 0.3252 0.3252 10.68% Gravity::solve_phi_with_mlmg() 10 0.3221 0.3221 0.3221 10.58% Amr::writePlotFile() 2 0.2994 0.2994 0.2994 9.83% VisMF::Write(FabArray) 3 0.2923 0.2923 0.2923 9.60% Gravity::actual_solve_with_mlmg() 10 0.2476 0.2476 0.2476 8.13% Amr::initialInit() 1 0.2345 0.2345 0.2345 7.70% MLMG::solve() 10 0.1953 0.1953 0.1953 6.41% Castro::clean_state() 87 0.1946 0.1946 0.1946 6.39% Castro::construct_new_gravity() 9 0.1873 0.1873 0.1873 6.15% MLMG::oneIter() 31 0.1649 0.1649 0.1649 5.42% Amr::InitializeInit() 1 0.1615 0.1615 0.1615 5.30% Amr::defBaseLevel() 1 0.1614 0.1614 0.1614 5.30% Amr::regrid() 5 0.1529 0.1529 0.1529 5.02% Castro::Castro() 5 0.1518 0.1518 0.1518 4.98% Castro::initMFs() 5 0.1476 0.1476 0.1476 4.85% MLMG::mgVcycle() 65 0.1414 0.1414 0.1414 4.64% Castro::post_regrid() 10 0.1374 0.1374 0.1374 4.51% Castro::computeTemp() 88 0.1051 0.1051 0.1051 3.45% MLCellLinOp::applyBC() 1917 0.09133 0.09133 0.09133 3.00% AmrLevel::FillPatch() 62 0.09093 0.09093 0.09093 2.99% MLCellLinOp::smooth() 688 0.08095 0.08095 0.08095 2.66% Castro::reflux() 4 0.07805 0.07805 0.07805 2.56% FillPatchIterator::Initialize 62 0.0765 0.0765 0.0765 2.51% Gravity::fill_multipole_BCs() 10 0.07396 0.07396 0.07396 2.43% Amr::FinalizeInit() 1 0.07301 0.07301 0.07301 2.40% FillPatchSingleLevel 92 0.06813 0.06813 0.06813 2.24% Castro::normalize_species() 87 0.06792 0.06792 0.06792 2.23% Castro::post_timestep() 9 0.06668 0.06668 0.06668 2.19% FillPatchIterator::FillFromLevel0() 31 0.06552 0.06552 0.06552 2.15% Castro::post_init() 1 0.06144 0.06144 0.06144 2.02% Castro::do_new_sources() 9 0.05757 0.05757 0.05757 1.89% Castro::initialize_do_advance() 9 0.05022 0.05022 0.05022 1.65% StateDataPhysBCFunct::() 95 0.04908 0.04908 0.04908 1.61% Castro::problem_post_timestep() 10 0.04856 0.04856 0.04856 1.59% FabArray::FillBoundary() 1728 0.04392 0.04392 0.04392 1.44% FillBoundary_nowait() 1728 0.04348 0.04348 0.04348 1.43% Castro::expand_state() 13 0.04181 0.04181 0.04181 1.37% Castro::do_old_sources() 9 0.04172 0.04172 0.04172 1.37% MLPoisson::define() 10 0.04161 0.04161 0.04161 1.37% FabArray::setVal() 920 0.038 0.038 0.038 1.25% MLMG::mgVcycle_bottom 65 0.03755 0.03755 0.03755 1.23% StateData::FillBoundary(geom) 650 0.03486 0.03486 0.03486 1.14% FabArray::ParallelCopy() 954 0.03461 0.03461 0.03461 1.14% FabArray::ParallelCopy_nowait() 954 0.03424 0.03424 0.03424 1.12% Castro::wd_update() 6 0.03309 0.03309 0.03309 1.09% MLMG::actualBottomSolve() 31 0.03052 0.03052 0.03052 1.00% MLCGSolver::bicgstab 31 0.03023 0.03023 0.03023 0.99% FluxRegister::Reflux() 24 0.0297 0.0297 0.0297 0.98% MLMG::mgVcycle_down::0 31 0.02918 0.02918 0.02918 0.96% Castro::volInBoundary() 42 0.02835 0.02835 0.02835 0.93% MLCellLinOp::apply() 493 0.02777 0.02777 0.02777 0.91% Castro::reset_internal_energy(MultiFab) 88 0.02718 0.02718 0.02718 0.89% Castro::construct_new_source() 63 0.02692 0.02692 0.02692 0.88% amrex::Copy() 441 0.02652 0.02652 0.02652 0.87% Castro::initialize_advance() 9 0.02517 0.02517 0.02517 0.83% MLCellLinOp::defineAuxData() 10 0.02384 0.02384 0.02384 0.78% Gravity::get_new_grav_vector() 10 0.02273 0.02273 0.02273 0.75% MLMG::mgVcycle_up::0 31 0.02172 0.02172 0.02172 0.71% Castro::enforce_min_density() 87 0.02009 0.02009 0.02009 0.66% Castro::construct_old_gravity() 9 0.01826 0.01826 0.01826 0.60% Gravity::get_old_grav_vector() 9 0.01815 0.01815 0.01815 0.60% MLCellLinOp::correctionResidual() 189 0.0181 0.0181 0.0181 0.59% MLCellLinOp::defineBC() 10 0.01746 0.01746 0.01746 0.57% amrex::Add() 136 0.01725 0.01725 0.01725 0.57% Castro::estTimeStep() 26 0.01665 0.01665 0.01665 0.55% MLCellLinOp::reflux() 30 0.01607 0.01607 0.01607 0.53% FabArray::Saxpy() 604 0.01578 0.01578 0.01578 0.52% Amr::grid_places() 6 0.01552 0.01552 0.01552 0.51% AmrMesh::MakeNewGrids() 6 0.01541 0.01541 0.01541 0.51% BndryData::define() 26 0.01465 0.01465 0.01465 0.48% MLCellLinOp::solutionResidual() 71 0.01458 0.01458 0.01458 0.48% MLMG:computeResOfCorrection() 155 0.01386 0.01386 0.01386 0.46% MLMG::computeResWithCrseSolFineCor() 17 0.01368 0.01368 0.01368 0.45% MLMG::computeMLResidual() 15 0.01304 0.01304 0.01304 0.43% MLPoisson::Fsmooth() 1376 0.01234 0.01234 0.01234 0.41% Castro::construct_old_source() 63 0.01231 0.01231 0.01231 0.40% MLMG::mgVcycle_down::1 31 0.01158 0.01158 0.01158 0.38% Castro::initData() 1 0.0113 0.0113 0.0113 0.37% amrex::average_down 233 0.009943 0.009943 0.009943 0.33% Castro::FluxRegCrseInit 9 0.008989 0.008989 0.008989 0.30% amrex::Dot() 466 0.008913 0.008913 0.008913 0.29% MLMG::prepareForSolve() 10 0.008787 0.008787 0.008787 0.29% FabArray::norminf() 439 0.008543 0.008543 0.008543 0.28% MLMG::mgVcycle_up::1 31 0.008371 0.008371 0.008371 0.27% Amr::bldFineLevels() 1 0.00819 0.00819 0.00819 0.27% Castro::construct_old_gravity_source() 18 0.008033 0.008033 0.008033 0.26% FillPatchIterator::FillFromTwoLevels() 31 0.007336 0.007336 0.007336 0.24% Castro::computeNewDt() 8 0.007336 0.007336 0.007336 0.24% FillPatchTwoLevels 31 0.007305 0.007305 0.007305 0.24% MLMG::miniCycle() 34 0.007048 0.007048 0.007048 0.23% Castro::finalize_do_advance() 9 0.006841 0.006841 0.006841 0.22% MLPoisson::Fapply() 493 0.006772 0.006772 0.006772 0.22% MLMG::addInterpCorrection() 155 0.006768 0.006768 0.006768 0.22% MLMG::mgVcycle_down::2 31 0.00667 0.00667 0.00667 0.22% FabArray::Xpay() 353 0.006357 0.006357 0.006357 0.21% MLMG::mgVcycle_down::3 31 0.006091 0.006091 0.006091 0.20% MLMG::mgVcycle_down::4 31 0.005976 0.005976 0.005976 0.20% MLMG::computeResidual() 31 0.005828 0.005828 0.005828 0.19% Castro::construct_new_gravity_source() 9 0.005141 0.005141 0.005141 0.17% MLCGSolver::ParallelAllReduce 745 0.00505 0.00505 0.00505 0.17% FabArrayBase::getCPC() 1522 0.004954 0.004954 0.004954 0.16% Castro::errorEst() 6 0.004886 0.004886 0.004886 0.16% MLMG::mgVcycle_up::4 31 0.004823 0.004823 0.004823 0.16% MLMG::mgVcycle_up::2 31 0.004658 0.004658 0.004658 0.15% MLMG::mgVcycle_up::3 31 0.004626 0.004626 0.004626 0.15% MLMG::getGradSolution() 10 0.004389 0.004389 0.004389 0.14% MLCellLinOp::compGrad() 18 0.004379 0.004379 0.004379 0.14% Castro::apply_source_to_state() 18 0.004219 0.004219 0.004219 0.14% Castro::reset_internal_energy(Fab) 1476 0.004096 0.004096 0.004096 0.13% FabArrayBase::CPC::define() 534 0.00379 0.00379 0.00379 0.12% FillPatchInterp(MF) 30 0.003648 0.003648 0.003648 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003616 0.003616 0.003616 0.12% MLMG::computeResWithCrseCorFineCor() 17 0.003509 0.003509 0.003509 0.12% MLCellLinOp::updateSolBC() 25 0.003312 0.003312 0.003312 0.11% Castro::check_for_nan() 18 0.003261 0.003261 0.003261 0.11% FabArray::setDomainBndry() 92 0.003253 0.003253 0.003253 0.11% MultiFab::contains_nan() 18 0.00325 0.00325 0.00325 0.11% TagBoxArray::mapPRD 6 0.003183 0.003183 0.003183 0.10% Castro::apply_tagging_restrictions() 6 0.00316 0.00316 0.00316 0.10% Castro::init(old) 3 0.003035 0.003035 0.003035 0.10% Castro::computeInitialDt() 2 0.002635 0.002635 0.002635 0.09% Castro::buildMetrics() 5 0.002594 0.002594 0.002594 0.09% check_for_negative_density() 9 0.002581 0.002581 0.002581 0.08% FabArray::mult() 55 0.00258 0.00258 0.00258 0.08% Castro::enforce_speed_limit() 87 0.002421 0.002421 0.002421 0.08% MLCellLinOp::setLevelBC() 18 0.002409 0.002409 0.002409 0.08% MLCellLinOp::updateCorBC() 17 0.002298 0.002298 0.002298 0.08% MLMG::ResNormInf() 54 0.002074 0.002074 0.002074 0.07% Gravity::update_max_rhs() 10 0.00204 0.00204 0.00204 0.07% MLPoisson::prepareForSolve() 10 0.001995 0.001995 0.001995 0.07% MLCellLinOp::prepareForSolve() 10 0.001987 0.001987 0.001987 0.07% Gravity::average_fine_ec_onto_crse_ec() 8 0.001956 0.001956 0.001956 0.06% Castro::fill_hybrid_hydro_source() 27 0.00187 0.00187 0.00187 0.06% MLPoisson::FFlux() 150 0.001466 0.001466 0.001466 0.05% average_down_faces 48 0.001281 0.001281 0.001281 0.04% Castro::construct_new_hybrid_source() 9 0.00125 0.00125 0.00125 0.04% FabArray::norminf(mask) 21 0.001228 0.001228 0.001228 0.04% Castro::avgDown() 4 0.001206 0.001206 0.001206 0.04% Castro::avgDown(state_indx) 20 0.001201 0.001201 0.001201 0.04% amrex::average_down_w_geom 20 0.001193 0.001193 0.001193 0.04% MLMG::MLResNormInf() 15 0.001145 0.001145 0.001145 0.04% OwnerMask() 6 0.001003 0.001003 0.001003 0.03% MLMG::interpCorrection_1 17 0.0009577 0.0009577 0.0009577 0.03% Castro::build_fine_mask() 44 0.000945 0.000945 0.000945 0.03% Castro::derive() 6 0.0009318 0.0009318 0.0009318 0.03% AmrLevel::derive() 6 0.0009282 0.0009282 0.0009282 0.03% Castro::init() 1 0.0009113 0.0009113 0.0009113 0.03% AmrLevel::FillCoarsePatch() 5 0.000909 0.000909 0.000909 0.03% TagBoxArray::collate() 6 0.0007925 0.0007925 0.0007925 0.03% FabArrayBase::getFB() 1728 0.0007324 0.0007324 0.0007324 0.02% Gravity::swapTimeLevels() 9 0.000674 0.000674 0.000674 0.02% Castro::FluxRegFineAdd() 9 0.0006586 0.0006586 0.0006586 0.02% Castro::construct_old_hybrid_source() 9 0.0006362 0.0006362 0.0006362 0.02% MultiFab::max() 18 0.0006228 0.0006228 0.0006228 0.02% MLMG::MLRhsNormInf() 10 0.0006034 0.0006034 0.0006034 0.02% MultiFab::Multiply() 8 0.0005199 0.0005199 0.0005199 0.02% Castro::apply_problem_tags() 6 0.0004955 0.0004955 0.0004955 0.02% FabArrayBase::FB::FB() 37 0.000445 0.000445 0.000445 0.01% Castro::react_state() 18 0.000377 0.000377 0.000377 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003605 0.0003605 0.0003605 0.01% Castro::construct_new_rotation_source() 9 0.0002932 0.0002932 0.0002932 0.01% MLLinOp::define() 10 0.0002841 0.0002841 0.0002841 0.01% MLLinOp::defineGrids() 10 0.0002711 0.0002711 0.0002711 0.01% AMRErrorTag::operator() 6 0.0002471 0.0002471 0.0002471 0.01% Castro::construct_old_rotation_source() 9 0.0002208 0.0002208 0.0002208 0.01% AmrLevel::AmrLevel(dm) 5 0.0001943 0.0001943 0.0001943 0.01% StateData::define() 25 0.0001572 0.0001572 0.0001572 0.01% Castro::enforce_consistent_e() 1 0.0001416 0.0001416 0.0001416 0.00% Castro::swap_state_time_levels() 9 0.0001285 0.0001285 0.0001285 0.00% Castro::finalize_advance() 9 0.0001077 0.0001077 0.0001077 0.00% MLLinOp::makeAgglomeratedDMap 10 6.03e-05 6.03e-05 6.03e-05 0.00% FabArray::RecvLayoutMask() 8 4.944e-05 4.944e-05 4.944e-05 0.00% Castro::create_source_corrector() 9 4.52e-05 4.52e-05 4.52e-05 0.00% makeSFC 50 4.478e-05 4.478e-05 4.478e-05 0.00% Amr::writeSmallPlotFile() 1 4.088e-05 4.088e-05 4.088e-05 0.00% FabArrayBase::TheFPinfo() 25 3.921e-05 3.921e-05 3.921e-05 0.00% AmrMesh-cluster 4 2.232e-05 2.232e-05 2.232e-05 0.00% DistributionMapping::Distribute() 52 1.979e-05 1.979e-05 1.979e-05 0.00% FPinfo::FPinfo() 3 1.892e-05 1.892e-05 1.892e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.844e-05 1.844e-05 1.844e-05 0.00% Amr::initSubcycle() 1 1.45e-05 1.45e-05 1.45e-05 0.00% ClusterList::intersect() 4 1.245e-05 1.245e-05 1.245e-05 0.00% BoxList::parallelComplementIn() 12 9.595e-06 9.595e-06 9.595e-06 0.00% BoxList::complementIn 12 4.903e-06 4.903e-06 4.903e-06 0.00% Gravity::set_mass_offset() 6 4.271e-06 4.271e-06 4.271e-06 0.00% Castro::retry_advance_ctu() 5 2.859e-06 2.859e-06 2.859e-06 0.00% ClusterList::chop() 4 2.282e-06 2.282e-06 2.282e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.699e-06 1.699e-06 1.699e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1715 KiB 9037 MiB Castro::reflux() 436 436 14 MiB 666 MiB Castro::initMFs() 258 258 344 MiB 576 MiB Castro::swap_state_time_levels() 175 175 177 MiB 340 MiB StateData::define() 175 175 218 MiB 340 MiB Castro::initialize_do_advance() 143 143 121 MiB 325 MiB FillPatchIterator::Initialize 899 899 4151 KiB 303 MiB Amr::writePlotFile() 56 56 17 MiB 189 MiB Castro::problem_post_timestep() 162 162 791 KiB 167 MiB Castro::FluxRegCrseInit 660 660 462 KiB 167 MiB FluxRegister::Reflux() 648 648 1583 KiB 160 MiB Castro::initialize_advance() 143 143 48 MiB 121 MiB Castro::construct_new_source() 143 143 249 KiB 67 MiB Castro::construct_old_source() 143 143 132 KiB 67 MiB Castro::buildMetrics() 140 140 36 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 27 MiB 60 MiB Castro::Castro() 210 210 4066 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2761 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 197 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 244 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 905 KiB 16 MiB FillPatchTwoLevels 300 300 7838 B 11 MiB FillPatchInterp(MF) 330 330 4827 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 137 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4610 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 776 KiB 7424 KiB Castro::build_fine_mask() 224 224 1294 KiB 6912 KiB AmrLevel::derive() 162 162 2662 B 6912 KiB BndryData::define() 3624 3624 288 KiB 4243 KiB MLCellLinOp::reflux() 450 450 6073 B 2376 KiB Castro::wd_update() 6 6 24 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 418 B 2095 KiB amrex::average_down 1483 1483 2402 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 5329 B 1042 KiB MLMG::addInterpCorrection() 1240 1240 807 B 867 KiB MLCellLinOp::defineBC() 276 276 3921 B 689 KiB Castro::estTimeStep() 26 26 2602 B 480 KiB VisMF::Write(FabArray) 1568 1568 2331 B 320 KiB Castro::normalize_species() 87 87 7265 B 320 KiB Castro::volInBoundary() 70 70 3017 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 127 B 204 KiB FabArray::norminf(mask) 29 29 192 B 163 KiB amrex::Dot() 559 559 433 B 160 KiB FabArray::norminf() 470 470 432 B 160 KiB MultiFab::max() 18 18 32 B 160 KiB check_for_negative_density() 9 9 137 B 160 KiB Castro::initData() 1 1 44 B 160 KiB FabArray::setVal() 419 419 54 KiB 120 KiB MLMG::interpCorrection_1 34 34 27 B 91 KiB average_down_faces 99 99 637 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 286 B 57 KiB MLPoisson::Fsmooth() 228 228 3151 B 55 KiB FillBoundary_nowait() 751 751 458 B 53 KiB TagBoxArray::mapPRD 324 324 42 B 45 KiB OwnerMask() 168 168 12 B 38 KiB MLCellLinOp::applyBC() 3834 3834 146 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9487 B 25 KiB MultiFab::contains_nan() 18 18 21 B 20 KiB StateData::FillBoundary(geom) 2538 2538 45 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 646 B 3456 B MLCGSolver::bicgstab 155 155 26 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 186 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 12 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 612 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1278 B 278 KiB FabArray::setVal() 419 419 54 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 286 B 57 KiB MLPoisson::Fsmooth() 228 228 3151 B 55 KiB FillBoundary_nowait() 751 751 459 B 53 KiB MLCellLinOp::applyBC() 1917 1917 146 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9487 B 25 KiB Gravity::get_new_grav_vector() 18 18 3474 B 20 KiB Gravity::get_old_grav_vector() 12 12 6207 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 45 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1331 B 6304 B MLMG::prepareForSolve() 18 18 235 B 3712 B FabArray::norminf(mask) 29 29 131 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 646 B 3456 B Castro::FluxRegCrseInit 12 12 9 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 609 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (24.04-3-gd78e241d1ad4) finalized