Initializing AMReX (v2024-30-g6e18c4232a10)... Initializing CUDA... CUDA initialized with 1 device. AMReX (v2024-30-g6e18c4232a10) initialized Starting run at 09:33:38 UTC on 2024-03-22. Successfully read inputs file ... Castro git describe: 24.03-26-g5707c0c2f AMReX git describe: v2024-30-g6e18c4232 Microphysics git describe: 24.03-21-g81de2adb reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003417881 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.00180314 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009203115 Gravity::multilevel_solve_for_new_phi() time = 0.053576507 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.145497506 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.00333004 on level 0 Castro::do_old_sources() time = 0.008953198 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.13263861 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.006357019 Gravity::multilevel_solve_for_new_phi() time = 0.040471128 Castro::construct_new_gravity() time = 0.044085255 on level 0 Castro::do_new_sources() time = 0.007498692 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.039453504 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.228477187 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002387401 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007133687 Gravity::multilevel_solve_for_new_phi() time = 0.060087845 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003399267 on level 0 Castro::do_old_sources() time = 0.00657743 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.120668538 on level 0 Castro::construct_old_gravity() time = 0.000417367 on level 1 Castro::do_old_sources() time = 0.0013532 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.010908108 on level 1 Castro::reflux() at level 0 : time = 0.019146406 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.006949546 Gravity::multilevel_solve_for_new_phi() time = 0.041496133 Castro::construct_new_gravity() time = 0.045156878 on level 0 Castro::do_new_sources() time = 0.01026714 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.00043868 on level 1 Castro::do_new_sources() time = 0.001616116 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.804669747 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.338616085 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.00344084 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.006898199 Gravity::multilevel_solve_for_new_phi() time = 0.014949932 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003534554 on level 0 Castro::do_old_sources() time = 0.006846443 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.11410493 on level 0 Castro::construct_old_gravity() time = 0.000424181 on level 1 Castro::do_old_sources() time = 0.001959648 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.011269913 on level 1 Castro::reflux() at level 0 : time = 0.017786906 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.006960403 Gravity::multilevel_solve_for_new_phi() time = 0.028823958 Castro::construct_new_gravity() time = 0.032501459 on level 0 Castro::do_new_sources() time = 0.006461936 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000447959 on level 1 Castro::do_new_sources() time = 0.002768016 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 4.080834721 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.28624323 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002267426 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.006942333 Gravity::multilevel_solve_for_new_phi() time = 0.015122304 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003305714 on level 0 Castro::do_old_sources() time = 0.010678425 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.136807976 on level 0 Castro::construct_old_gravity() time = 0.000411185 on level 1 Castro::do_old_sources() time = 0.001715034 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.009037719 on level 1 Castro::reflux() at level 0 : time = 0.017738153 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.006964091 Gravity::multilevel_solve_for_new_phi() time = 0.029093349 Castro::construct_new_gravity() time = 0.032901332 on level 0 Castro::do_new_sources() time = 0.006248766 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.00044994 on level 1 Castro::do_new_sources() time = 0.001894943 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.575652668 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.30421959 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.001813912 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.006882165 Gravity::multilevel_solve_for_new_phi() time = 0.015301985 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003375782 on level 0 Castro::do_old_sources() time = 0.006678405 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.178940814 on level 0 Castro::construct_old_gravity() time = 0.000386904 on level 1 Castro::do_old_sources() time = 0.001776489 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.008214826 on level 1 Castro::reflux() at level 0 : time = 0.018575056 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.006956081 Gravity::multilevel_solve_for_new_phi() time = 0.029134302 Castro::construct_new_gravity() time = 0.032711238 on level 0 Castro::do_new_sources() time = 0.006421297 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000444914 on level 1 Castro::do_new_sources() time = 0.002100328 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.343063519 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.323120822 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.156041046 seconds Ending run at 09:33:41 UTC on 2024-03-22. Run time = 3.078597565 Run time without initialization = 1.637598982 Average number of zones advanced per microsecond: 3.021 Average number of zones advanced per microsecond per rank: 3.021 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.079 ... 3.079 ... 3.079 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0505 1.0505 1.0505 34.12% Castro::construct_ctu_hydro_source() 9 0.6917 0.6917 0.6917 22.47% VisMF::Write(FabArray) 3 0.2947 0.2947 0.2947 9.57% Castro::initMFs() 5 0.1574 0.1574 0.1574 5.11% Castro::normalize_species() 87 0.08583 0.08583 0.08583 2.79% Castro::computeTemp() 88 0.08 0.08 0.08 2.60% Gravity::fill_multipole_BCs() 10 0.06923 0.06923 0.06923 2.25% MLCellLinOp::applyBC() 1917 0.04785 0.04785 0.04785 1.55% FillBoundary_nowait() 1728 0.04243 0.04243 0.04243 1.38% FabArray::setVal() 920 0.03833 0.03833 0.03833 1.25% StateData::FillBoundary(geom) 650 0.03519 0.03519 0.03519 1.14% Castro::volInBoundary() 42 0.03057 0.03057 0.03057 0.99% FabArray::ParallelCopy_nowait() 954 0.03047 0.03047 0.03047 0.99% amrex::Copy() 441 0.02671 0.02671 0.02671 0.87% Castro::reset_internal_energy(MultiFab) 88 0.02262 0.02262 0.02262 0.73% FluxRegister::Reflux() 24 0.02246 0.02246 0.02246 0.73% MLCellLinOp::defineAuxData() 10 0.02175 0.02175 0.02175 0.71% Castro::enforce_min_density() 87 0.02129 0.02129 0.02129 0.69% Castro::estTimeStep() 26 0.01749 0.01749 0.01749 0.57% amrex::Add() 136 0.01727 0.01727 0.01727 0.56% FabArray::Saxpy() 604 0.01598 0.01598 0.01598 0.52% StateDataPhysBCFunct::() 95 0.01559 0.01559 0.01559 0.51% BndryData::define() 26 0.01358 0.01358 0.01358 0.44% MLPoisson::Fsmooth() 1376 0.01273 0.01273 0.01273 0.41% Castro::reflux() 4 0.0122 0.0122 0.0122 0.40% Castro::problem_post_timestep() 10 0.01117 0.01117 0.01117 0.36% MLCellLinOp::reflux() 30 0.009602 0.009602 0.009602 0.31% amrex::Dot() 466 0.009276 0.009276 0.009276 0.30% FabArray::norminf() 439 0.008833 0.008833 0.008833 0.29% Castro::construct_old_gravity_source() 18 0.008687 0.008687 0.008687 0.28% Castro::construct_new_source() 63 0.008553 0.008553 0.008553 0.28% Castro::FluxRegCrseInit 9 0.007959 0.007959 0.007959 0.26% MLPoisson::Fapply() 493 0.006892 0.006892 0.006892 0.22% Castro::initData() 1 0.006602 0.006602 0.006602 0.21% FabArray::Xpay() 353 0.006494 0.006494 0.006494 0.21% amrex::average_down 233 0.006174 0.006174 0.006174 0.20% Castro::construct_new_gravity_source() 9 0.005789 0.005789 0.005789 0.19% Castro::reset_internal_energy(Fab) 1476 0.005714 0.005714 0.005714 0.19% AmrMesh::MakeNewGrids() 6 0.005461 0.005461 0.005461 0.18% Castro::wd_update() 6 0.004801 0.004801 0.004801 0.16% Amr::writePlotFile() 2 0.004536 0.004536 0.004536 0.15% MLMG::addInterpCorrection() 155 0.004505 0.004505 0.004505 0.15% Gravity::actual_solve_with_mlmg() 10 0.003967 0.003967 0.003967 0.13% FabArrayBase::CPC::define() 534 0.003746 0.003746 0.003746 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003714 0.003714 0.003714 0.12% FillPatchInterp(MF) 30 0.003701 0.003701 0.003701 0.12% Castro::apply_tagging_restrictions() 6 0.003463 0.003463 0.003463 0.11% FabArray::setDomainBndry() 92 0.003369 0.003369 0.003369 0.11% Castro::enforce_speed_limit() 87 0.0033 0.0033 0.0033 0.11% MultiFab::contains_nan() 18 0.003268 0.003268 0.003268 0.11% Castro::construct_old_source() 63 0.003209 0.003209 0.003209 0.10% MLCellLinOp::compGrad() 18 0.00293 0.00293 0.00293 0.10% MLCellLinOp::defineBC() 10 0.002793 0.002793 0.002793 0.09% FabArray::mult() 55 0.002589 0.002589 0.002589 0.08% MLCellLinOp::setLevelBC() 18 0.002569 0.002569 0.002569 0.08% MLCellLinOp::prepareForSolve() 10 0.002027 0.002027 0.002027 0.07% MLMG::prepareForSolve() 10 0.001893 0.001893 0.001893 0.06% Castro::fill_hybrid_hydro_source() 27 0.001692 0.001692 0.001692 0.05% MLPoisson::FFlux() 150 0.001566 0.001566 0.001566 0.05% Gravity::get_new_grav_vector() 10 0.001539 0.001539 0.001539 0.05% check_for_negative_density() 9 0.001465 0.001465 0.001465 0.05% TagBoxArray::mapPRD 6 0.001436 0.001436 0.001436 0.05% MLCellLinOp::updateSolBC() 25 0.001414 0.001414 0.001414 0.05% Castro::clean_state() 87 0.001238 0.001238 0.001238 0.04% FabArray::norminf(mask) 21 0.001238 0.001238 0.001238 0.04% Gravity::get_old_grav_vector() 9 0.001236 0.001236 0.001236 0.04% FabArrayBase::getCPC() 1522 0.001135 0.001135 0.001135 0.04% OwnerMask() 6 0.001061 0.001061 0.001061 0.03% MLCellLinOp::updateCorBC() 17 0.001051 0.001051 0.001051 0.03% Castro::build_fine_mask() 44 0.001031 0.001031 0.001031 0.03% average_down_faces 48 0.000902 0.000902 0.000902 0.03% main() 1 0.0008372 0.0008372 0.0008372 0.03% TagBoxArray::collate() 6 0.0008155 0.0008155 0.0008155 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0007889 0.0007889 0.0007889 0.03% FillPatchTwoLevels 31 0.0007712 0.0007712 0.0007712 0.03% MLCGSolver::bicgstab 31 0.0007188 0.0007188 0.0007188 0.02% Castro::FluxRegFineAdd() 9 0.0006602 0.0006602 0.0006602 0.02% AmrLevel::FillPatch() 62 0.0006438 0.0006438 0.0006438 0.02% MultiFab::max() 18 0.0006329 0.0006329 0.0006329 0.02% FillPatchIterator::Initialize 62 0.0005713 0.0005713 0.0005713 0.02% MultiFab::Multiply() 8 0.00052 0.00052 0.00052 0.02% MLCellLinOp::smooth() 688 0.0005182 0.0005182 0.0005182 0.02% Castro::apply_problem_tags() 6 0.0005175 0.0005175 0.0005175 0.02% FabArrayBase::FB::FB() 37 0.0004424 0.0004424 0.0004424 0.01% Castro::linear_to_hybrid_momentum() 1 0.0004243 0.0004243 0.0004243 0.01% FabArray::FillBoundary() 1728 0.0004142 0.0004142 0.0004142 0.01% Gravity::actual_multilevel_solve() 10 0.0004125 0.0004125 0.0004125 0.01% MLMG::interpCorrection_1 17 0.0004075 0.0004075 0.0004075 0.01% Amr::regrid() 5 0.0003759 0.0003759 0.0003759 0.01% Castro::initialize_do_advance() 9 0.0003422 0.0003422 0.0003422 0.01% Castro::Castro() 5 0.0003416 0.0003416 0.0003416 0.01% Castro::initialize_advance() 9 0.0003264 0.0003264 0.0003264 0.01% FabArray::ParallelCopy() 954 0.0003159 0.0003159 0.0003159 0.01% FabArrayBase::getFB() 1728 0.0003039 0.0003039 0.0003039 0.01% Castro::do_new_sources() 9 0.0002973 0.0002973 0.0002973 0.01% Castro::do_old_sources() 9 0.0002735 0.0002735 0.0002735 0.01% Castro::subcycle_advance_ctu() 5 0.0002613 0.0002613 0.0002613 0.01% Castro::finalize_do_advance() 9 0.0002601 0.0002601 0.0002601 0.01% Gravity::update_max_rhs() 10 0.0002578 0.0002578 0.0002578 0.01% Amr::coarseTimeStep() 5 0.0002447 0.0002447 0.0002447 0.01% Castro::post_regrid() 10 0.0002384 0.0002384 0.0002384 0.01% AMRErrorTag::operator() 6 0.0002353 0.0002353 0.0002353 0.01% Castro::post_timestep() 9 0.0002296 0.0002296 0.0002296 0.01% Castro::react_state() 18 0.0002264 0.0002264 0.0002264 0.01% Castro::construct_old_rotation_source() 9 0.0002227 0.0002227 0.0002227 0.01% MLCellLinOp::apply() 493 0.0002195 0.0002195 0.0002195 0.01% Castro::do_advance_ctu() 5 0.0002184 0.0002184 0.0002184 0.01% Castro::construct_old_gravity() 9 0.000218 0.000218 0.000218 0.01% Castro::construct_new_rotation_source() 9 0.0002093 0.0002093 0.0002093 0.01% MLLinOp::defineGrids() 10 0.0002038 0.0002038 0.0002038 0.01% Castro::construct_new_gravity() 9 0.0001891 0.0001891 0.0001891 0.01% StateData::define() 25 0.0001699 0.0001699 0.0001699 0.01% Castro::enforce_consistent_e() 1 0.0001496 0.0001496 0.0001496 0.00% MLCGSolver::ParallelAllReduce 745 0.0001318 0.0001318 0.0001318 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001312 0.0001312 0.0001312 0.00% Castro::swap_state_time_levels() 9 0.0001256 0.0001256 0.0001256 0.00% Castro::create_source_corrector() 9 0.0001191 0.0001191 0.0001191 0.00% Castro::advance() 5 0.0001128 0.0001128 0.0001128 0.00% MLCellLinOp::correctionResidual() 189 0.000105 0.000105 0.000105 0.00% MLMG::mgVcycle() 65 9.956e-05 9.956e-05 9.956e-05 0.00% Castro::buildMetrics() 5 9.948e-05 9.948e-05 9.948e-05 0.00% Castro::finalize_advance() 9 9.413e-05 9.413e-05 9.413e-05 0.00% Amr::timeStep() 9 9.153e-05 9.153e-05 9.153e-05 0.00% AmrLevel::derive() 6 8.649e-05 8.649e-05 8.649e-05 0.00% Amr::grid_places() 6 8.453e-05 8.453e-05 8.453e-05 0.00% Castro::computeNewDt() 8 6.838e-05 6.838e-05 6.838e-05 0.00% FillPatchSingleLevel 92 5.895e-05 5.895e-05 5.895e-05 0.00% MLMG::oneIter() 31 5.558e-05 5.558e-05 5.558e-05 0.00% MLMG:computeResOfCorrection() 155 5.242e-05 5.242e-05 5.242e-05 0.00% FabArray::RecvLayoutMask() 8 5.185e-05 5.185e-05 5.185e-05 0.00% Castro::errorEst() 6 4.972e-05 4.972e-05 4.972e-05 0.00% MLMG::solve() 10 4.77e-05 4.77e-05 4.77e-05 0.00% MLCellLinOp::solutionResidual() 71 4.451e-05 4.451e-05 4.451e-05 0.00% Amr::defBaseLevel() 1 4.219e-05 4.219e-05 4.219e-05 0.00% MLMG::mgVcycle_bottom 65 4.194e-05 4.194e-05 4.194e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.089e-05 4.089e-05 4.089e-05 0.00% MLMG::actualBottomSolve() 31 3.991e-05 3.991e-05 3.991e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.894e-05 3.894e-05 3.894e-05 0.00% Amr::writeSmallPlotFile() 1 3.876e-05 3.876e-05 3.876e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.731e-05 3.731e-05 3.731e-05 0.00% MLMG::mgVcycle_down::0 31 3.484e-05 3.484e-05 3.484e-05 0.00% MLMG::mgVcycle_down::1 31 3.263e-05 3.263e-05 3.263e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.196e-05 3.196e-05 3.196e-05 0.00% MLMG::mgVcycle_down::3 31 3.165e-05 3.165e-05 3.165e-05 0.00% MLMG::mgVcycle_down::2 31 3.093e-05 3.093e-05 3.093e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 2.987e-05 2.987e-05 2.987e-05 0.00% MLMG::mgVcycle_down::4 31 2.895e-05 2.895e-05 2.895e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.822e-05 2.822e-05 2.822e-05 0.00% makeSFC 50 2.751e-05 2.751e-05 2.751e-05 0.00% Gravity::solve_phi_with_mlmg() 10 2.561e-05 2.561e-05 2.561e-05 0.00% MLMG::ResNormInf() 54 2.496e-05 2.496e-05 2.496e-05 0.00% MLMG::mgVcycle_up::4 31 2.487e-05 2.487e-05 2.487e-05 0.00% MLPoisson::define() 10 2.479e-05 2.479e-05 2.479e-05 0.00% MLMG::mgVcycle_up::2 31 2.324e-05 2.324e-05 2.324e-05 0.00% MLMG::mgVcycle_up::3 31 2.136e-05 2.136e-05 2.136e-05 0.00% MLMG::mgVcycle_up::0 31 2.115e-05 2.115e-05 2.115e-05 0.00% MLMG::mgVcycle_up::1 31 2.02e-05 2.02e-05 2.02e-05 0.00% DistributionMapping::Distribute() 52 2.012e-05 2.012e-05 2.012e-05 0.00% FabArrayBase::TheFPinfo() 25 2.005e-05 2.005e-05 2.005e-05 0.00% FPinfo::FPinfo() 3 1.937e-05 1.937e-05 1.937e-05 0.00% MLMG::computeMLResidual() 15 1.443e-05 1.443e-05 1.443e-05 0.00% Amr::initSubcycle() 1 1.427e-05 1.427e-05 1.427e-05 0.00% MLMG::computeResidual() 31 1.422e-05 1.422e-05 1.422e-05 0.00% MLMG::miniCycle() 34 1.417e-05 1.417e-05 1.417e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.344e-05 1.344e-05 1.344e-05 0.00% ClusterList::intersect() 4 1.313e-05 1.313e-05 1.313e-05 0.00% Amr::FinalizeInit() 1 1.302e-05 1.302e-05 1.302e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.18e-05 1.18e-05 1.18e-05 0.00% Castro::check_for_nan() 18 1.052e-05 1.052e-05 1.052e-05 0.00% Castro::post_init() 1 1.027e-05 1.027e-05 1.027e-05 0.00% Castro::apply_source_to_state() 18 8.918e-06 8.918e-06 8.918e-06 0.00% Castro::expand_state() 13 8.819e-06 8.819e-06 8.819e-06 0.00% MLLinOp::define() 10 8.582e-06 8.582e-06 8.582e-06 0.00% Gravity::swapTimeLevels() 9 8.348e-06 8.348e-06 8.348e-06 0.00% Castro::avgDown(state_indx) 20 8.318e-06 8.318e-06 8.318e-06 0.00% Castro::construct_new_hybrid_source() 9 8.242e-06 8.242e-06 8.242e-06 0.00% MLMG::getGradSolution() 10 7.972e-06 7.972e-06 7.972e-06 0.00% amrex::average_down_w_geom 20 7.763e-06 7.763e-06 7.763e-06 0.00% MLPoisson::prepareForSolve() 10 7.389e-06 7.389e-06 7.389e-06 0.00% AmrMesh-cluster 4 7.269e-06 7.269e-06 7.269e-06 0.00% Amr::InitializeInit() 1 7.092e-06 7.092e-06 7.092e-06 0.00% MLMG::MLResNormInf() 15 7.085e-06 7.085e-06 7.085e-06 0.00% Castro::construct_old_hybrid_source() 9 6.481e-06 6.481e-06 6.481e-06 0.00% MLMG::MLRhsNormInf() 10 5.209e-06 5.209e-06 5.209e-06 0.00% Castro::init(old) 3 5.124e-06 5.124e-06 5.124e-06 0.00% Castro::avgDown() 4 4.504e-06 4.504e-06 4.504e-06 0.00% BoxList::parallelComplementIn() 12 4.362e-06 4.362e-06 4.362e-06 0.00% Castro::derive() 6 3.692e-06 3.692e-06 3.692e-06 0.00% Gravity::set_mass_offset() 6 3.667e-06 3.667e-06 3.667e-06 0.00% BoxList::complementIn 12 3.32e-06 3.32e-06 3.32e-06 0.00% Amr::bldFineLevels() 1 3.017e-06 3.017e-06 3.017e-06 0.00% Castro::retry_advance_ctu() 5 2.738e-06 2.738e-06 2.738e-06 0.00% Castro::computeInitialDt() 2 2.7e-06 2.7e-06 2.7e-06 0.00% Castro::init() 1 1.995e-06 1.995e-06 1.995e-06 0.00% Amr::init() 1 1.932e-06 1.932e-06 1.932e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.769e-06 1.769e-06 1.769e-06 0.00% ClusterList::chop() 4 1.568e-06 1.568e-06 1.568e-06 0.00% Amr::initialInit() 1 1.054e-06 1.054e-06 1.054e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.079 3.079 3.079 100.00% Amr::coarseTimeStep() 5 1.481 1.481 1.481 48.10% Amr::timeStep() 9 1.476 1.476 1.476 47.93% Castro::advance() 5 1.252 1.252 1.252 40.66% Castro::subcycle_advance_ctu() 5 1.222 1.222 1.222 39.68% Castro::do_advance_ctu() 5 1.221 1.221 1.221 39.67% Amr::InitAmr() 1 1.05 1.05 1.05 34.12% Castro::construct_ctu_hydro_source() 9 0.7226 0.7226 0.7226 23.47% Amr::init() 1 0.3903 0.3903 0.3903 12.68% Gravity::multilevel_solve_for_new_phi() 10 0.3282 0.3282 0.3282 10.66% Gravity::actual_multilevel_solve() 10 0.3274 0.3274 0.3274 10.63% Gravity::solve_phi_with_mlmg() 10 0.324 0.324 0.324 10.53% Amr::writePlotFile() 2 0.3017 0.3017 0.3017 9.80% VisMF::Write(FabArray) 3 0.2947 0.2947 0.2947 9.57% Gravity::actual_solve_with_mlmg() 10 0.2522 0.2522 0.2522 8.19% Amr::initialInit() 1 0.2447 0.2447 0.2447 7.95% Castro::clean_state() 87 0.2186 0.2186 0.2186 7.10% MLMG::solve() 10 0.1973 0.1973 0.1973 6.41% Castro::construct_new_gravity() 9 0.1892 0.1892 0.1892 6.15% Amr::InitializeInit() 1 0.1714 0.1714 0.1714 5.57% Amr::defBaseLevel() 1 0.1714 0.1714 0.1714 5.57% MLMG::oneIter() 31 0.1667 0.1667 0.1667 5.41% Castro::Castro() 5 0.1614 0.1614 0.1614 5.24% Castro::initMFs() 5 0.1574 0.1574 0.1574 5.11% Amr::regrid() 5 0.1566 0.1566 0.1566 5.09% MLMG::mgVcycle() 65 0.1431 0.1431 0.1431 4.65% Castro::post_regrid() 10 0.1405 0.1405 0.1405 4.56% Castro::computeTemp() 88 0.1083 0.1083 0.1083 3.52% AmrLevel::FillPatch() 62 0.09288 0.09288 0.09288 3.02% MLCellLinOp::applyBC() 1917 0.09144 0.09144 0.09144 2.97% Castro::normalize_species() 87 0.08583 0.08583 0.08583 2.79% MLCellLinOp::smooth() 688 0.08146 0.08146 0.08146 2.65% FillPatchIterator::Initialize 62 0.07841 0.07841 0.07841 2.55% Amr::FinalizeInit() 1 0.07335 0.07335 0.07335 2.38% Castro::reflux() 4 0.07328 0.07328 0.07328 2.38% Gravity::fill_multipole_BCs() 10 0.07137 0.07137 0.07137 2.32% FillPatchSingleLevel 92 0.06982 0.06982 0.06982 2.27% FillPatchIterator::FillFromLevel0() 31 0.06719 0.06719 0.06719 2.18% Castro::post_timestep() 9 0.06714 0.06714 0.06714 2.18% Castro::post_init() 1 0.06232 0.06232 0.06232 2.02% Castro::initialize_do_advance() 9 0.05969 0.05969 0.05969 1.94% Castro::problem_post_timestep() 10 0.05237 0.05237 0.05237 1.70% StateDataPhysBCFunct::() 95 0.05078 0.05078 0.05078 1.65% Castro::do_old_sources() 9 0.04662 0.04662 0.04662 1.51% Castro::do_new_sources() 9 0.04535 0.04535 0.04535 1.47% MLPoisson::define() 10 0.04408 0.04408 0.04408 1.43% FabArray::FillBoundary() 1728 0.04359 0.04359 0.04359 1.42% FillBoundary_nowait() 1728 0.04318 0.04318 0.04318 1.40% Castro::expand_state() 13 0.04248 0.04248 0.04248 1.38% MLMG::mgVcycle_bottom 65 0.03868 0.03868 0.03868 1.26% FabArray::setVal() 920 0.03833 0.03833 0.03833 1.25% Castro::wd_update() 6 0.03538 0.03538 0.03538 1.15% StateData::FillBoundary(geom) 650 0.03519 0.03519 0.03519 1.14% FabArray::ParallelCopy() 954 0.03478 0.03478 0.03478 1.13% FabArray::ParallelCopy_nowait() 954 0.03447 0.03447 0.03447 1.12% MLMG::actualBottomSolve() 31 0.0315 0.0315 0.0315 1.02% MLCGSolver::bicgstab 31 0.0312 0.0312 0.0312 1.01% Castro::volInBoundary() 42 0.03058 0.03058 0.03058 0.99% Castro::initialize_advance() 9 0.02983 0.02983 0.02983 0.97% FluxRegister::Reflux() 24 0.02978 0.02978 0.02978 0.97% MLMG::mgVcycle_down::0 31 0.02903 0.02903 0.02903 0.94% Castro::reset_internal_energy(MultiFab) 88 0.02834 0.02834 0.02834 0.92% MLCellLinOp::apply() 493 0.02781 0.02781 0.02781 0.90% amrex::Copy() 441 0.02671 0.02671 0.02671 0.87% MLCellLinOp::defineAuxData() 10 0.02516 0.02516 0.02516 0.82% Gravity::get_new_grav_vector() 10 0.02403 0.02403 0.02403 0.78% Castro::construct_new_source() 63 0.02159 0.02159 0.02159 0.70% MLMG::mgVcycle_up::0 31 0.02156 0.02156 0.02156 0.70% Castro::enforce_min_density() 87 0.02129 0.02129 0.02129 0.69% Castro::construct_old_gravity() 9 0.01867 0.01867 0.01867 0.61% MLCellLinOp::defineBC() 10 0.0186 0.0186 0.0186 0.60% Gravity::get_old_grav_vector() 9 0.01846 0.01846 0.01846 0.60% MLCellLinOp::correctionResidual() 189 0.01834 0.01834 0.01834 0.60% Castro::estTimeStep() 26 0.01749 0.01749 0.01749 0.57% amrex::Add() 136 0.01727 0.01727 0.01727 0.56% FabArray::Saxpy() 604 0.01598 0.01598 0.01598 0.52% MLCellLinOp::reflux() 30 0.01593 0.01593 0.01593 0.52% BndryData::define() 26 0.01566 0.01566 0.01566 0.51% Amr::grid_places() 6 0.01519 0.01519 0.01519 0.49% AmrMesh::MakeNewGrids() 6 0.0151 0.0151 0.0151 0.49% MLCellLinOp::solutionResidual() 71 0.01452 0.01452 0.01452 0.47% MLMG:computeResOfCorrection() 155 0.01398 0.01398 0.01398 0.45% MLMG::computeResWithCrseSolFineCor() 17 0.01355 0.01355 0.01355 0.44% MLMG::computeMLResidual() 15 0.01293 0.01293 0.01293 0.42% MLPoisson::Fsmooth() 1376 0.01273 0.01273 0.01273 0.41% Castro::initData() 1 0.01183 0.01183 0.01183 0.38% MLMG::mgVcycle_down::1 31 0.01164 0.01164 0.01164 0.38% Castro::construct_old_source() 63 0.01159 0.01159 0.01159 0.38% amrex::average_down 233 0.009939 0.009939 0.009939 0.32% amrex::Dot() 466 0.009276 0.009276 0.009276 0.30% Castro::FluxRegCrseInit 9 0.009012 0.009012 0.009012 0.29% MLMG::prepareForSolve() 10 0.009011 0.009011 0.009011 0.29% FabArray::norminf() 439 0.008833 0.008833 0.008833 0.29% Castro::construct_old_gravity_source() 18 0.008687 0.008687 0.008687 0.28% MLMG::mgVcycle_up::1 31 0.008491 0.008491 0.008491 0.28% Castro::computeNewDt() 8 0.007698 0.007698 0.007698 0.25% Amr::bldFineLevels() 1 0.007526 0.007526 0.007526 0.24% FillPatchIterator::FillFromTwoLevels() 31 0.00745 0.00745 0.00745 0.24% FillPatchTwoLevels 31 0.007418 0.007418 0.007418 0.24% Castro::finalize_do_advance() 9 0.007278 0.007278 0.007278 0.24% MLMG::miniCycle() 34 0.007196 0.007196 0.007196 0.23% MLMG::addInterpCorrection() 155 0.006943 0.006943 0.006943 0.23% MLPoisson::Fapply() 493 0.006892 0.006892 0.006892 0.22% MLMG::mgVcycle_down::2 31 0.006824 0.006824 0.006824 0.22% FabArray::Xpay() 353 0.006494 0.006494 0.006494 0.21% MLMG::mgVcycle_down::3 31 0.006244 0.006244 0.006244 0.20% MLMG::mgVcycle_down::4 31 0.006103 0.006103 0.006103 0.20% MLMG::computeResidual() 31 0.005884 0.005884 0.005884 0.19% Castro::construct_new_gravity_source() 9 0.005789 0.005789 0.005789 0.19% Castro::reset_internal_energy(Fab) 1476 0.005714 0.005714 0.005714 0.19% MLCGSolver::ParallelAllReduce 745 0.005259 0.005259 0.005259 0.17% Castro::errorEst() 6 0.005208 0.005208 0.005208 0.17% MLMG::mgVcycle_up::4 31 0.004938 0.004938 0.004938 0.16% FabArrayBase::getCPC() 1522 0.004881 0.004881 0.004881 0.16% MLMG::mgVcycle_up::2 31 0.004764 0.004764 0.004764 0.15% MLMG::mgVcycle_up::3 31 0.00473 0.00473 0.00473 0.15% MLMG::getGradSolution() 10 0.004326 0.004326 0.004326 0.14% MLCellLinOp::compGrad() 18 0.004318 0.004318 0.004318 0.14% Castro::apply_source_to_state() 18 0.004225 0.004225 0.004225 0.14% FabArrayBase::CPC::define() 534 0.003746 0.003746 0.003746 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003714 0.003714 0.003714 0.12% FillPatchInterp(MF) 30 0.003701 0.003701 0.003701 0.12% MLMG::computeResWithCrseCorFineCor() 17 0.003621 0.003621 0.003621 0.12% Castro::apply_tagging_restrictions() 6 0.003463 0.003463 0.003463 0.11% MLCellLinOp::updateSolBC() 25 0.003422 0.003422 0.003422 0.11% FabArray::setDomainBndry() 92 0.003369 0.003369 0.003369 0.11% Castro::enforce_speed_limit() 87 0.0033 0.0033 0.0033 0.11% TagBoxArray::mapPRD 6 0.003289 0.003289 0.003289 0.11% Castro::check_for_nan() 18 0.003278 0.003278 0.003278 0.11% MultiFab::contains_nan() 18 0.003268 0.003268 0.003268 0.11% Castro::init(old) 3 0.003036 0.003036 0.003036 0.10% Castro::computeInitialDt() 2 0.002843 0.002843 0.002843 0.09% FabArray::mult() 55 0.002589 0.002589 0.002589 0.08% MLCellLinOp::setLevelBC() 18 0.002569 0.002569 0.002569 0.08% Castro::buildMetrics() 5 0.002538 0.002538 0.002538 0.08% MLCellLinOp::updateCorBC() 17 0.002382 0.002382 0.002382 0.08% MLMG::ResNormInf() 54 0.002096 0.002096 0.002096 0.07% Gravity::update_max_rhs() 10 0.002066 0.002066 0.002066 0.07% MLPoisson::prepareForSolve() 10 0.002034 0.002034 0.002034 0.07% MLCellLinOp::prepareForSolve() 10 0.002027 0.002027 0.002027 0.07% Gravity::average_fine_ec_onto_crse_ec() 8 0.001999 0.001999 0.001999 0.06% Castro::fill_hybrid_hydro_source() 27 0.001692 0.001692 0.001692 0.05% MLPoisson::FFlux() 150 0.001566 0.001566 0.001566 0.05% check_for_negative_density() 9 0.001465 0.001465 0.001465 0.05% average_down_faces 48 0.001332 0.001332 0.001332 0.04% Castro::avgDown() 4 0.001256 0.001256 0.001256 0.04% Castro::avgDown(state_indx) 20 0.001252 0.001252 0.001252 0.04% amrex::average_down_w_geom 20 0.001244 0.001244 0.001244 0.04% FabArray::norminf(mask) 21 0.001238 0.001238 0.001238 0.04% MLMG::MLResNormInf() 15 0.00116 0.00116 0.00116 0.04% OwnerMask() 6 0.001061 0.001061 0.001061 0.03% Castro::construct_new_hybrid_source() 9 0.001044 0.001044 0.001044 0.03% Castro::build_fine_mask() 44 0.001031 0.001031 0.001031 0.03% MLMG::interpCorrection_1 17 0.0009768 0.0009768 0.0009768 0.03% Castro::derive() 6 0.0009425 0.0009425 0.0009425 0.03% AmrLevel::derive() 6 0.0009388 0.0009388 0.0009388 0.03% Castro::init() 1 0.0009086 0.0009086 0.0009086 0.03% AmrLevel::FillCoarsePatch() 5 0.0009066 0.0009066 0.0009066 0.03% TagBoxArray::collate() 6 0.0008155 0.0008155 0.0008155 0.03% FabArrayBase::getFB() 1728 0.0007464 0.0007464 0.0007464 0.02% Gravity::swapTimeLevels() 9 0.0006929 0.0006929 0.0006929 0.02% Castro::construct_old_hybrid_source() 9 0.000663 0.000663 0.000663 0.02% Castro::FluxRegFineAdd() 9 0.0006602 0.0006602 0.0006602 0.02% MultiFab::max() 18 0.0006329 0.0006329 0.0006329 0.02% MLMG::MLRhsNormInf() 10 0.0006041 0.0006041 0.0006041 0.02% Castro::react_state() 18 0.0005805 0.0005805 0.0005805 0.02% MultiFab::Multiply() 8 0.00052 0.00052 0.00052 0.02% Castro::apply_problem_tags() 6 0.0005175 0.0005175 0.0005175 0.02% FabArrayBase::FB::FB() 37 0.0004424 0.0004424 0.0004424 0.01% Castro::linear_to_hybrid_momentum() 1 0.0004243 0.0004243 0.0004243 0.01% MLLinOp::define() 10 0.0002899 0.0002899 0.0002899 0.01% MLLinOp::defineGrids() 10 0.0002813 0.0002813 0.0002813 0.01% AMRErrorTag::operator() 6 0.0002353 0.0002353 0.0002353 0.01% Castro::construct_old_rotation_source() 9 0.0002227 0.0002227 0.0002227 0.01% Castro::construct_new_rotation_source() 9 0.0002093 0.0002093 0.0002093 0.01% AmrLevel::AmrLevel(dm) 5 0.0002089 0.0002089 0.0002089 0.01% StateData::define() 25 0.0001699 0.0001699 0.0001699 0.01% Castro::enforce_consistent_e() 1 0.0001496 0.0001496 0.0001496 0.00% Castro::swap_state_time_levels() 9 0.0001256 0.0001256 0.0001256 0.00% Castro::create_source_corrector() 9 0.0001191 0.0001191 0.0001191 0.00% Castro::finalize_advance() 9 9.413e-05 9.413e-05 9.413e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 7.568e-05 7.568e-05 7.568e-05 0.00% FabArray::RecvLayoutMask() 8 5.185e-05 5.185e-05 5.185e-05 0.00% makeSFC 50 4.581e-05 4.581e-05 4.581e-05 0.00% FabArrayBase::TheFPinfo() 25 3.941e-05 3.941e-05 3.941e-05 0.00% Amr::writeSmallPlotFile() 1 3.876e-05 3.876e-05 3.876e-05 0.00% AmrMesh-cluster 4 2.197e-05 2.197e-05 2.197e-05 0.00% DistributionMapping::Distribute() 52 2.012e-05 2.012e-05 2.012e-05 0.00% FPinfo::FPinfo() 3 1.937e-05 1.937e-05 1.937e-05 0.00% Amr::initSubcycle() 1 1.427e-05 1.427e-05 1.427e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.362e-05 1.362e-05 1.362e-05 0.00% ClusterList::intersect() 4 1.313e-05 1.313e-05 1.313e-05 0.00% BoxList::parallelComplementIn() 12 7.682e-06 7.682e-06 7.682e-06 0.00% Gravity::set_mass_offset() 6 3.667e-06 3.667e-06 3.667e-06 0.00% BoxList::complementIn 12 3.32e-06 3.32e-06 3.32e-06 0.00% Castro::retry_advance_ctu() 5 2.738e-06 2.738e-06 2.738e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.769e-06 1.769e-06 1.769e-06 0.00% ClusterList::chop() 4 1.568e-06 1.568e-06 1.568e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1741 KiB 9037 MiB Castro::reflux() 436 436 13 MiB 666 MiB Castro::initMFs() 258 258 346 MiB 576 MiB Castro::swap_state_time_levels() 175 175 177 MiB 340 MiB StateData::define() 175 175 219 MiB 340 MiB Castro::initialize_do_advance() 143 143 120 MiB 325 MiB FillPatchIterator::Initialize 899 899 4185 KiB 303 MiB Amr::writePlotFile() 56 56 17 MiB 189 MiB Castro::problem_post_timestep() 162 162 814 KiB 167 MiB Castro::FluxRegCrseInit 660 660 458 KiB 167 MiB FluxRegister::Reflux() 648 648 1570 KiB 160 MiB Castro::initialize_advance() 143 143 48 MiB 121 MiB Castro::construct_new_source() 143 143 187 KiB 67 MiB Castro::construct_old_source() 143 143 117 KiB 67 MiB Castro::buildMetrics() 140 140 37 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 28 MiB 60 MiB Castro::Castro() 210 210 4081 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2756 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 195 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 254 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 909 KiB 16 MiB FillPatchTwoLevels 300 300 7818 B 11 MiB FillPatchInterp(MF) 330 330 4830 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 129 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4616 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 773 KiB 7424 KiB Castro::build_fine_mask() 224 224 1282 KiB 6912 KiB AmrLevel::derive() 162 162 2630 B 6912 KiB BndryData::define() 3624 3624 289 KiB 4243 KiB MLCellLinOp::reflux() 450 450 5688 B 2376 KiB Castro::wd_update() 6 6 25 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 422 B 2095 KiB amrex::average_down 1483 1483 2385 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 5165 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 809 B 867 KiB MLCellLinOp::defineBC() 276 276 3919 B 689 KiB Castro::estTimeStep() 26 26 2621 B 480 KiB VisMF::Write(FabArray) 1568 1568 2386 B 320 KiB Castro::normalize_species() 87 87 8139 B 320 KiB Castro::volInBoundary() 70 70 3223 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 130 B 204 KiB FabArray::norminf(mask) 29 29 192 B 163 KiB amrex::Dot() 559 559 448 B 160 KiB FabArray::norminf() 470 470 443 B 160 KiB MultiFab::max() 18 18 32 B 160 KiB check_for_negative_density() 9 9 76 B 160 KiB Castro::initData() 1 1 49 B 160 KiB FabArray::setVal() 419 419 54 KiB 120 KiB MLMG::interpCorrection_1 34 34 27 B 91 KiB average_down_faces 99 99 639 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 283 B 57 KiB MLPoisson::Fsmooth() 228 228 3148 B 55 KiB FillBoundary_nowait() 751 751 454 B 53 KiB TagBoxArray::mapPRD 324 324 43 B 45 KiB OwnerMask() 168 168 13 B 38 KiB MLCellLinOp::applyBC() 3834 3834 146 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9482 B 25 KiB MultiFab::contains_nan() 18 18 21 B 20 KiB StateData::FillBoundary(geom) 2538 2538 47 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 640 B 3456 B MLCGSolver::bicgstab 155 155 27 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 165 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 11 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 610 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1257 B 278 KiB FabArray::setVal() 419 419 54 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 283 B 57 KiB MLPoisson::Fsmooth() 228 228 3148 B 55 KiB FillBoundary_nowait() 751 751 455 B 53 KiB MLCellLinOp::applyBC() 1917 1917 146 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9482 B 25 KiB Gravity::get_new_grav_vector() 18 18 3300 B 20 KiB Gravity::get_old_grav_vector() 12 12 6340 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 47 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1334 B 6304 B MLMG::prepareForSolve() 18 18 235 B 3712 B FabArray::norminf(mask) 29 29 131 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 640 B 3456 B Castro::FluxRegCrseInit 12 12 9 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 610 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (v2024-30-g6e18c4232a10) finalized