Initializing AMReX (24.04-8-g2cd72a3bbaeb)... Initializing CUDA... CUDA initialized with 1 device. AMReX (24.04-8-g2cd72a3bbaeb) initialized Starting run at 08:32:37 UTC on 2024-04-08. Successfully read inputs file ... Castro git describe: 24.04-11-g2407e8176 AMReX git describe: 24.04-8-g2cd72a3bb Microphysics git describe: 24.04-4-ge5fecb7a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.0033615 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001769663 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009474536 Gravity::multilevel_solve_for_new_phi() time = 0.05402804 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.147140534 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003559938 on level 0 Castro::do_old_sources() time = 0.009551231 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.139839148 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.006805405 Gravity::multilevel_solve_for_new_phi() time = 0.040953186 Castro::construct_new_gravity() time = 0.044587076 on level 0 Castro::do_new_sources() time = 0.008030027 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.87251199 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.238571926 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002214393 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007463498 Gravity::multilevel_solve_for_new_phi() time = 0.068401634 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003438568 on level 0 Castro::do_old_sources() time = 0.006561691 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.179703206 on level 0 Castro::construct_old_gravity() time = 0.000356895 on level 1 Castro::do_old_sources() time = 0.001678102 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007588562 on level 1 Castro::reflux() at level 0 : time = 0.017928935 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.00736302 Gravity::multilevel_solve_for_new_phi() time = 0.041888415 Castro::construct_new_gravity() time = 0.045467686 on level 0 Castro::do_new_sources() time = 0.006817176 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000403108 on level 1 Castro::do_new_sources() time = 0.00272387 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.164101913 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.393102646 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.001982654 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.00732189 Gravity::multilevel_solve_for_new_phi() time = 0.015345177 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.00351298 on level 0 Castro::do_old_sources() time = 0.006686575 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.121873193 on level 0 Castro::construct_old_gravity() time = 0.000361422 on level 1 Castro::do_old_sources() time = 0.001465864 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.010757138 on level 1 Castro::reflux() at level 0 : time = 0.01771042 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007326414 Gravity::multilevel_solve_for_new_phi() time = 0.029052542 Castro::construct_new_gravity() time = 0.032581087 on level 0 Castro::do_new_sources() time = 0.006799685 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000380283 on level 1 Castro::do_new_sources() time = 0.002704087 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 4.126874124 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.276862103 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.003362452 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007277982 Gravity::multilevel_solve_for_new_phi() time = 0.015404675 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003394695 on level 0 Castro::do_old_sources() time = 0.010964877 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.098795833 on level 0 Castro::construct_old_gravity() time = 0.000364732 on level 1 Castro::do_old_sources() time = 0.002557693 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.006900023 on level 1 Castro::reflux() at level 0 : time = 0.017607361 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007228047 Gravity::multilevel_solve_for_new_phi() time = 0.029064722 Castro::construct_new_gravity() time = 0.03266896 on level 0 Castro::do_new_sources() time = 0.007034789 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000436312 on level 1 Castro::do_new_sources() time = 0.002442028 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 4.249448596 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.272934342 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002062207 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007282746 Gravity::multilevel_solve_for_new_phi() time = 0.015424578 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003398951 on level 0 Castro::do_old_sources() time = 0.006816508 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.170914737 on level 0 Castro::construct_old_gravity() time = 0.000363533 on level 1 Castro::do_old_sources() time = 0.00169162 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.009370695 on level 1 Castro::reflux() at level 0 : time = 0.017601492 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007208609 Gravity::multilevel_solve_for_new_phi() time = 0.029366038 Castro::construct_new_gravity() time = 0.033206565 on level 0 Castro::do_new_sources() time = 0.007269908 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000429932 on level 1 Castro::do_new_sources() time = 0.002440757 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.397136873 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.320019215 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.157804804 seconds Ending run at 08:32:41 UTC on 2024-04-08. Run time = 3.447372042 Run time without initialization = 1.660212913 Average number of zones advanced per microsecond: 2.980 Average number of zones advanced per microsecond per rank: 2.980 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.447 ... 3.447 ... 3.447 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.4025 1.4025 1.4025 40.68% Castro::construct_ctu_hydro_source() 9 0.7175 0.7175 0.7175 20.81% VisMF::Write(FabArray) 3 0.298 0.298 0.298 8.64% Castro::initMFs() 5 0.1486 0.1486 0.1486 4.31% Castro::computeTemp() 88 0.07454 0.07454 0.07454 2.16% Gravity::fill_multipole_BCs() 10 0.07273 0.07273 0.07273 2.11% Castro::normalize_species() 87 0.07185 0.07185 0.07185 2.08% MLCellLinOp::applyBC() 1917 0.04828 0.04828 0.04828 1.40% FillBoundary_nowait() 1728 0.04296 0.04296 0.04296 1.25% FabArray::setVal() 920 0.03828 0.03828 0.03828 1.11% StateData::FillBoundary(geom) 650 0.03592 0.03592 0.03592 1.04% FabArray::ParallelCopy_nowait() 954 0.03076 0.03076 0.03076 0.89% Castro::volInBoundary() 42 0.03059 0.03059 0.03059 0.89% amrex::Copy() 441 0.0267 0.0267 0.0267 0.77% Castro::reset_internal_energy(MultiFab) 88 0.02297 0.02297 0.02297 0.67% FluxRegister::Reflux() 24 0.02245 0.02245 0.02245 0.65% MLCellLinOp::defineAuxData() 10 0.02167 0.02167 0.02167 0.63% Castro::enforce_min_density() 87 0.01876 0.01876 0.01876 0.54% Castro::estTimeStep() 26 0.01728 0.01728 0.01728 0.50% amrex::Add() 136 0.01727 0.01727 0.01727 0.50% Castro::construct_new_source() 63 0.01655 0.01655 0.01655 0.48% FabArray::Saxpy() 604 0.01598 0.01598 0.01598 0.46% StateDataPhysBCFunct::() 95 0.01452 0.01452 0.01452 0.42% BndryData::define() 26 0.01346 0.01346 0.01346 0.39% MLPoisson::Fsmooth() 1376 0.01267 0.01267 0.01267 0.37% MLCellLinOp::compGrad() 18 0.0107 0.0107 0.0107 0.31% Castro::problem_post_timestep() 10 0.01069 0.01069 0.01069 0.31% Castro::reflux() 4 0.01046 0.01046 0.01046 0.30% amrex::Dot() 466 0.009258 0.009258 0.009258 0.27% MLCellLinOp::reflux() 30 0.00909 0.00909 0.00909 0.26% FabArray::norminf() 439 0.008769 0.008769 0.008769 0.25% Castro::construct_old_gravity_source() 18 0.008418 0.008418 0.008418 0.24% Castro::FluxRegCrseInit 9 0.007952 0.007952 0.007952 0.23% MLPoisson::Fapply() 493 0.006855 0.006855 0.006855 0.20% Castro::initData() 1 0.006748 0.006748 0.006748 0.20% FabArray::Xpay() 353 0.006491 0.006491 0.006491 0.19% Castro::reset_internal_energy(Fab) 1476 0.006314 0.006314 0.006314 0.18% amrex::average_down 233 0.006171 0.006171 0.006171 0.18% AmrMesh::MakeNewGrids() 6 0.005201 0.005201 0.005201 0.15% Castro::construct_new_gravity_source() 9 0.005159 0.005159 0.005159 0.15% Castro::wd_update() 6 0.00505 0.00505 0.00505 0.15% Castro::construct_old_source() 63 0.004883 0.004883 0.004883 0.14% Amr::writePlotFile() 2 0.004663 0.004663 0.004663 0.14% MLMG::addInterpCorrection() 155 0.004505 0.004505 0.004505 0.13% Gravity::actual_solve_with_mlmg() 10 0.003812 0.003812 0.003812 0.11% FabArrayBase::CPC::define() 534 0.00375 0.00375 0.00375 0.11% FillPatchInterp(MF) 30 0.003726 0.003726 0.003726 0.11% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003694 0.003694 0.003694 0.11% FabArray::setDomainBndry() 92 0.00338 0.00338 0.00338 0.10% Castro::apply_tagging_restrictions() 6 0.00336 0.00336 0.00336 0.10% MultiFab::contains_nan() 18 0.003252 0.003252 0.003252 0.09% Castro::enforce_speed_limit() 87 0.002947 0.002947 0.002947 0.09% MLCellLinOp::defineBC() 10 0.002787 0.002787 0.002787 0.08% FabArray::mult() 55 0.002589 0.002589 0.002589 0.08% MLCellLinOp::setLevelBC() 18 0.002563 0.002563 0.002563 0.07% Castro::clean_state() 87 0.002141 0.002141 0.002141 0.06% MLCellLinOp::prepareForSolve() 10 0.002066 0.002066 0.002066 0.06% MLMG::prepareForSolve() 10 0.001865 0.001865 0.001865 0.05% Castro::fill_hybrid_hydro_source() 27 0.001665 0.001665 0.001665 0.05% MLPoisson::FFlux() 150 0.001524 0.001524 0.001524 0.04% check_for_negative_density() 9 0.001439 0.001439 0.001439 0.04% TagBoxArray::mapPRD 6 0.001426 0.001426 0.001426 0.04% MLCellLinOp::updateSolBC() 25 0.00141 0.00141 0.00141 0.04% Gravity::get_new_grav_vector() 10 0.001279 0.001279 0.001279 0.04% FabArray::norminf(mask) 21 0.001227 0.001227 0.001227 0.04% FabArrayBase::getCPC() 1522 0.001169 0.001169 0.001169 0.03% Castro::initialize_do_advance() 9 0.001076 0.001076 0.001076 0.03% MLCellLinOp::updateCorBC() 17 0.001053 0.001053 0.001053 0.03% Castro::build_fine_mask() 44 0.001041 0.001041 0.001041 0.03% Gravity::get_old_grav_vector() 9 0.001029 0.001029 0.001029 0.03% OwnerMask() 6 0.001027 0.001027 0.001027 0.03% Castro::post_timestep() 9 0.0008679 0.0008679 0.0008679 0.03% average_down_faces 48 0.0008641 0.0008641 0.0008641 0.03% TagBoxArray::collate() 6 0.0008167 0.0008167 0.0008167 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.000811 0.000811 0.000811 0.02% FillPatchTwoLevels 31 0.0007767 0.0007767 0.0007767 0.02% MLCGSolver::bicgstab 31 0.00072 0.00072 0.00072 0.02% Castro::FluxRegFineAdd() 9 0.0007168 0.0007168 0.0007168 0.02% main() 1 0.0006955 0.0006955 0.0006955 0.02% AmrLevel::FillPatch() 62 0.0006492 0.0006492 0.0006492 0.02% FillPatchIterator::Initialize 62 0.0006294 0.0006294 0.0006294 0.02% MultiFab::max() 18 0.0006217 0.0006217 0.0006217 0.02% Castro::apply_problem_tags() 6 0.000525 0.000525 0.000525 0.02% MultiFab::Multiply() 8 0.0005156 0.0005156 0.0005156 0.01% MLCellLinOp::smooth() 688 0.0004872 0.0004872 0.0004872 0.01% FabArrayBase::FB::FB() 37 0.000437 0.000437 0.000437 0.01% Castro::Castro() 5 0.0004363 0.0004363 0.0004363 0.01% FabArray::FillBoundary() 1728 0.0004329 0.0004329 0.0004329 0.01% Castro::linear_to_hybrid_momentum() 1 0.0004241 0.0004241 0.0004241 0.01% MLMG::interpCorrection_1 17 0.0004111 0.0004111 0.0004111 0.01% FabArray::ParallelCopy() 954 0.0003432 0.0003432 0.0003432 0.01% Amr::regrid() 5 0.0003401 0.0003401 0.0003401 0.01% FabArrayBase::getFB() 1728 0.0003028 0.0003028 0.0003028 0.01% Amr::coarseTimeStep() 5 0.0002806 0.0002806 0.0002806 0.01% Gravity::actual_multilevel_solve() 10 0.0002482 0.0002482 0.0002482 0.01% Gravity::update_max_rhs() 10 0.0002479 0.0002479 0.0002479 0.01% AMRErrorTag::operator() 6 0.0002361 0.0002361 0.0002361 0.01% MLCellLinOp::apply() 493 0.0002331 0.0002331 0.0002331 0.01% Castro::construct_new_rotation_source() 9 0.0002315 0.0002315 0.0002315 0.01% Castro::subcycle_advance_ctu() 5 0.0002224 0.0002224 0.0002224 0.01% Castro::construct_old_rotation_source() 9 0.0002092 0.0002092 0.0002092 0.01% MLLinOp::defineGrids() 10 0.0002005 0.0002005 0.0002005 0.01% Castro::do_advance_ctu() 5 0.0001695 0.0001695 0.0001695 0.00% Castro::construct_new_gravity() 9 0.0001584 0.0001584 0.0001584 0.00% StateData::define() 25 0.0001571 0.0001571 0.0001571 0.00% Castro::enforce_consistent_e() 1 0.000152 0.000152 0.000152 0.00% Castro::finalize_do_advance() 9 0.0001479 0.0001479 0.0001479 0.00% Castro::initialize_advance() 9 0.0001459 0.0001459 0.0001459 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001379 0.0001379 0.0001379 0.00% MLCGSolver::ParallelAllReduce 745 0.000135 0.000135 0.000135 0.00% Castro::do_new_sources() 9 0.0001307 0.0001307 0.0001307 0.00% Castro::swap_state_time_levels() 9 0.0001248 0.0001248 0.0001248 0.00% Castro::finalize_advance() 9 0.00011 0.00011 0.00011 0.00% Castro::buildMetrics() 5 0.0001076 0.0001076 0.0001076 0.00% MLMG::mgVcycle() 65 0.0001019 0.0001019 0.0001019 0.00% Castro::do_old_sources() 9 0.0001011 0.0001011 0.0001011 0.00% Castro::construct_old_gravity() 9 9.966e-05 9.966e-05 9.966e-05 0.00% Castro::create_source_corrector() 9 9.79e-05 9.79e-05 9.79e-05 0.00% MLCellLinOp::correctionResidual() 189 9.43e-05 9.43e-05 9.43e-05 0.00% Amr::grid_places() 6 8.628e-05 8.628e-05 8.628e-05 0.00% Castro::advance() 5 8.046e-05 8.046e-05 8.046e-05 0.00% AmrLevel::derive() 6 7.762e-05 7.762e-05 7.762e-05 0.00% Amr::timeStep() 9 7.585e-05 7.585e-05 7.585e-05 0.00% Castro::post_regrid() 10 6.362e-05 6.362e-05 6.362e-05 0.00% FillPatchSingleLevel 92 5.917e-05 5.917e-05 5.917e-05 0.00% MLMG::oneIter() 31 5.174e-05 5.174e-05 5.174e-05 0.00% Castro::errorEst() 6 5.071e-05 5.071e-05 5.071e-05 0.00% MLMG:computeResOfCorrection() 155 5.018e-05 5.018e-05 5.018e-05 0.00% FabArray::RecvLayoutMask() 8 4.931e-05 4.931e-05 4.931e-05 0.00% MLMG::solve() 10 4.673e-05 4.673e-05 4.673e-05 0.00% MLCellLinOp::solutionResidual() 71 4.096e-05 4.096e-05 4.096e-05 0.00% AmrLevel::FillCoarsePatch() 5 4e-05 4e-05 4e-05 0.00% MLMG::mgVcycle_down::0 31 3.997e-05 3.997e-05 3.997e-05 0.00% Amr::writeSmallPlotFile() 1 3.996e-05 3.996e-05 3.996e-05 0.00% Amr::defBaseLevel() 1 3.904e-05 3.904e-05 3.904e-05 0.00% MLMG::actualBottomSolve() 31 3.887e-05 3.887e-05 3.887e-05 0.00% MLMG::mgVcycle_bottom 65 3.867e-05 3.867e-05 3.867e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.667e-05 3.667e-05 3.667e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.613e-05 3.613e-05 3.613e-05 0.00% Gravity::solve_phi_with_mlmg() 10 3.203e-05 3.203e-05 3.203e-05 0.00% MLMG::mgVcycle_down::1 31 3.121e-05 3.121e-05 3.121e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 2.986e-05 2.986e-05 2.986e-05 0.00% MLMG::mgVcycle_down::3 31 2.939e-05 2.939e-05 2.939e-05 0.00% MLMG::mgVcycle_down::2 31 2.904e-05 2.904e-05 2.904e-05 0.00% Castro::react_state() 18 2.851e-05 2.851e-05 2.851e-05 0.00% makeSFC 50 2.7e-05 2.7e-05 2.7e-05 0.00% MLPoisson::define() 10 2.65e-05 2.65e-05 2.65e-05 0.00% MLMG::mgVcycle_down::4 31 2.645e-05 2.645e-05 2.645e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.502e-05 2.502e-05 2.502e-05 0.00% Castro::computeNewDt() 8 2.488e-05 2.488e-05 2.488e-05 0.00% MLMG::ResNormInf() 54 2.379e-05 2.379e-05 2.379e-05 0.00% MLMG::mgVcycle_up::4 31 2.207e-05 2.207e-05 2.207e-05 0.00% MLMG::mgVcycle_up::2 31 2.121e-05 2.121e-05 2.121e-05 0.00% DistributionMapping::Distribute() 52 2.053e-05 2.053e-05 2.053e-05 0.00% MLMG::mgVcycle_up::3 31 2.021e-05 2.021e-05 2.021e-05 0.00% FabArrayBase::TheFPinfo() 25 1.964e-05 1.964e-05 1.964e-05 0.00% FPinfo::FPinfo() 3 1.905e-05 1.905e-05 1.905e-05 0.00% MLMG::mgVcycle_up::0 31 1.864e-05 1.864e-05 1.864e-05 0.00% MLMG::mgVcycle_up::1 31 1.85e-05 1.85e-05 1.85e-05 0.00% Amr::initSubcycle() 1 1.665e-05 1.665e-05 1.665e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.576e-05 1.576e-05 1.576e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.449e-05 1.449e-05 1.449e-05 0.00% MLMG::miniCycle() 34 1.429e-05 1.429e-05 1.429e-05 0.00% MLMG::computeResidual() 31 1.327e-05 1.327e-05 1.327e-05 0.00% MLLinOp::define() 10 1.314e-05 1.314e-05 1.314e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.314e-05 1.314e-05 1.314e-05 0.00% Amr::FinalizeInit() 1 1.313e-05 1.313e-05 1.313e-05 0.00% MLMG::computeMLResidual() 15 1.282e-05 1.282e-05 1.282e-05 0.00% ClusterList::intersect() 4 1.171e-05 1.171e-05 1.171e-05 0.00% Castro::check_for_nan() 18 1.111e-05 1.111e-05 1.111e-05 0.00% Castro::post_init() 1 1.003e-05 1.003e-05 1.003e-05 0.00% amrex::average_down_w_geom 20 9.28e-06 9.28e-06 9.28e-06 0.00% Castro::apply_source_to_state() 18 9.248e-06 9.248e-06 9.248e-06 0.00% Castro::expand_state() 13 8.992e-06 8.992e-06 8.992e-06 0.00% MLMG::getGradSolution() 10 8.887e-06 8.887e-06 8.887e-06 0.00% Castro::construct_old_hybrid_source() 9 8.771e-06 8.771e-06 8.771e-06 0.00% Castro::avgDown(state_indx) 20 8.702e-06 8.702e-06 8.702e-06 0.00% AmrMesh-cluster 4 8.23e-06 8.23e-06 8.23e-06 0.00% Amr::InitializeInit() 1 8.193e-06 8.193e-06 8.193e-06 0.00% Castro::construct_new_hybrid_source() 9 7.916e-06 7.916e-06 7.916e-06 0.00% MLPoisson::prepareForSolve() 10 7.428e-06 7.428e-06 7.428e-06 0.00% Gravity::swapTimeLevels() 9 7.363e-06 7.363e-06 7.363e-06 0.00% MLMG::MLResNormInf() 15 7.139e-06 7.139e-06 7.139e-06 0.00% MLMG::MLRhsNormInf() 10 5.15e-06 5.15e-06 5.15e-06 0.00% BoxList::parallelComplementIn() 12 4.842e-06 4.842e-06 4.842e-06 0.00% Castro::avgDown() 4 4.818e-06 4.818e-06 4.818e-06 0.00% Castro::init(old) 3 4.768e-06 4.768e-06 4.768e-06 0.00% BoxList::complementIn 12 4.564e-06 4.564e-06 4.564e-06 0.00% Gravity::set_mass_offset() 6 4.41e-06 4.41e-06 4.41e-06 0.00% Castro::derive() 6 3.79e-06 3.79e-06 3.79e-06 0.00% Castro::computeInitialDt() 2 2.82e-06 2.82e-06 2.82e-06 0.00% Castro::retry_advance_ctu() 5 2.753e-06 2.753e-06 2.753e-06 0.00% Amr::bldFineLevels() 1 2.455e-06 2.455e-06 2.455e-06 0.00% Amr::init() 1 2.033e-06 2.033e-06 2.033e-06 0.00% Castro::init() 1 1.933e-06 1.933e-06 1.933e-06 0.00% ClusterList::chop() 4 1.907e-06 1.907e-06 1.907e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.763e-06 1.763e-06 1.763e-06 0.00% Amr::initialInit() 1 1.147e-06 1.147e-06 1.147e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.447 3.447 3.447 100.00% Amr::coarseTimeStep() 5 1.502 1.502 1.502 43.56% Amr::timeStep() 9 1.496 1.496 1.496 43.41% Amr::InitAmr() 1 1.403 1.403 1.403 40.68% Castro::advance() 5 1.262 1.262 1.262 36.62% Castro::subcycle_advance_ctu() 5 1.236 1.236 1.236 35.84% Castro::do_advance_ctu() 5 1.235 1.235 1.235 35.83% Castro::construct_ctu_hydro_source() 9 0.7458 0.7458 0.7458 21.63% Amr::init() 1 0.3845 0.3845 0.3845 11.15% Gravity::multilevel_solve_for_new_phi() 10 0.3391 0.3391 0.3391 9.84% Gravity::actual_multilevel_solve() 10 0.3383 0.3383 0.3383 9.81% Gravity::solve_phi_with_mlmg() 10 0.3351 0.3351 0.3351 9.72% Amr::writePlotFile() 2 0.3051 0.3051 0.3051 8.85% VisMF::Write(FabArray) 3 0.298 0.298 0.298 8.64% Gravity::actual_solve_with_mlmg() 10 0.2597 0.2597 0.2597 7.53% Amr::initialInit() 1 0.2372 0.2372 0.2372 6.88% Castro::clean_state() 87 0.1981 0.1981 0.1981 5.75% MLMG::solve() 10 0.1973 0.1973 0.1973 5.72% Castro::construct_new_gravity() 9 0.1902 0.1902 0.1902 5.52% MLMG::oneIter() 31 0.1669 0.1669 0.1669 4.84% Amr::regrid() 5 0.1648 0.1648 0.1648 4.78% Amr::InitializeInit() 1 0.1631 0.1631 0.1631 4.73% Amr::defBaseLevel() 1 0.1631 0.1631 0.1631 4.73% Castro::Castro() 5 0.1528 0.1528 0.1528 4.43% Castro::post_regrid() 10 0.1494 0.1494 0.1494 4.33% Castro::initMFs() 5 0.1486 0.1486 0.1486 4.31% MLMG::mgVcycle() 65 0.1435 0.1435 0.1435 4.16% Castro::computeTemp() 88 0.1038 0.1038 0.1038 3.01% AmrLevel::FillPatch() 62 0.09284 0.09284 0.09284 2.69% MLCellLinOp::applyBC() 1917 0.09241 0.09241 0.09241 2.68% MLCellLinOp::smooth() 688 0.08195 0.08195 0.08195 2.38% FillPatchIterator::Initialize 62 0.07835 0.07835 0.07835 2.27% Gravity::fill_multipole_BCs() 10 0.07488 0.07488 0.07488 2.17% Amr::FinalizeInit() 1 0.07418 0.07418 0.07418 2.15% Castro::normalize_species() 87 0.07185 0.07185 0.07185 2.08% Castro::reflux() 4 0.07089 0.07089 0.07089 2.06% FillPatchSingleLevel 92 0.06965 0.06965 0.06965 2.02% Castro::post_timestep() 9 0.06916 0.06916 0.06916 2.01% FillPatchIterator::FillFromLevel0() 31 0.067 0.067 0.067 1.94% Castro::post_init() 1 0.06303 0.06303 0.06303 1.83% Castro::initialize_do_advance() 9 0.05988 0.05988 0.05988 1.74% Castro::problem_post_timestep() 10 0.05188 0.05188 0.05188 1.50% StateDataPhysBCFunct::() 95 0.05044 0.05044 0.05044 1.46% Castro::do_old_sources() 9 0.04806 0.04806 0.04806 1.39% Castro::do_new_sources() 9 0.04633 0.04633 0.04633 1.34% FabArray::FillBoundary() 1728 0.04414 0.04414 0.04414 1.28% MLPoisson::define() 10 0.04386 0.04386 0.04386 1.27% FillBoundary_nowait() 1728 0.0437 0.0437 0.0437 1.27% Castro::expand_state() 13 0.04195 0.04195 0.04195 1.22% MLMG::mgVcycle_bottom 65 0.03851 0.03851 0.03851 1.12% FabArray::setVal() 920 0.03828 0.03828 0.03828 1.11% StateData::FillBoundary(geom) 650 0.03592 0.03592 0.03592 1.04% Castro::wd_update() 6 0.03565 0.03565 0.03565 1.03% FabArray::ParallelCopy() 954 0.03512 0.03512 0.03512 1.02% FabArray::ParallelCopy_nowait() 954 0.03478 0.03478 0.03478 1.01% MLMG::actualBottomSolve() 31 0.03136 0.03136 0.03136 0.91% MLCGSolver::bicgstab 31 0.03106 0.03106 0.03106 0.90% Castro::volInBoundary() 42 0.0306 0.0306 0.0306 0.89% FluxRegister::Reflux() 24 0.02976 0.02976 0.02976 0.86% Castro::reset_internal_energy(MultiFab) 88 0.02928 0.02928 0.02928 0.85% MLMG::mgVcycle_down::0 31 0.02923 0.02923 0.02923 0.85% Castro::construct_new_source() 63 0.02903 0.02903 0.02903 0.84% MLCellLinOp::apply() 493 0.02808 0.02808 0.02808 0.81% Castro::initialize_advance() 9 0.02674 0.02674 0.02674 0.78% amrex::Copy() 441 0.0267 0.0267 0.0267 0.77% MLCellLinOp::defineAuxData() 10 0.02507 0.02507 0.02507 0.73% Gravity::get_new_grav_vector() 10 0.02376 0.02376 0.02376 0.69% MLMG::mgVcycle_up::0 31 0.02181 0.02181 0.02181 0.63% Castro::construct_old_gravity() 9 0.01885 0.01885 0.01885 0.55% Castro::enforce_min_density() 87 0.01876 0.01876 0.01876 0.54% Gravity::get_old_grav_vector() 9 0.01875 0.01875 0.01875 0.54% MLCellLinOp::defineBC() 10 0.01848 0.01848 0.01848 0.54% MLCellLinOp::correctionResidual() 189 0.01839 0.01839 0.01839 0.53% Castro::estTimeStep() 26 0.01728 0.01728 0.01728 0.50% amrex::Add() 136 0.01727 0.01727 0.01727 0.50% FabArray::Saxpy() 604 0.01598 0.01598 0.01598 0.46% BndryData::define() 26 0.01556 0.01556 0.01556 0.45% MLCellLinOp::reflux() 30 0.01542 0.01542 0.01542 0.45% Amr::grid_places() 6 0.01481 0.01481 0.01481 0.43% MLCellLinOp::solutionResidual() 71 0.01473 0.01473 0.01473 0.43% AmrMesh::MakeNewGrids() 6 0.01473 0.01473 0.01473 0.43% MLMG:computeResOfCorrection() 155 0.01403 0.01403 0.01403 0.41% MLMG::computeResWithCrseSolFineCor() 17 0.01338 0.01338 0.01338 0.39% Castro::construct_old_source() 63 0.01321 0.01321 0.01321 0.38% MLMG::computeMLResidual() 15 0.0127 0.0127 0.0127 0.37% MLPoisson::Fsmooth() 1376 0.01267 0.01267 0.01267 0.37% MLMG::getGradSolution() 10 0.01219 0.01219 0.01219 0.35% MLCellLinOp::compGrad() 18 0.01218 0.01218 0.01218 0.35% Castro::initData() 1 0.01199 0.01199 0.01199 0.35% MLMG::mgVcycle_down::1 31 0.01171 0.01171 0.01171 0.34% amrex::average_down 233 0.009999 0.009999 0.009999 0.29% amrex::Dot() 466 0.009258 0.009258 0.009258 0.27% Castro::FluxRegCrseInit 9 0.009013 0.009013 0.009013 0.26% MLMG::prepareForSolve() 10 0.008962 0.008962 0.008962 0.26% FabArray::norminf() 439 0.008769 0.008769 0.008769 0.25% MLMG::mgVcycle_up::1 31 0.008534 0.008534 0.008534 0.25% Castro::construct_old_gravity_source() 18 0.008418 0.008418 0.008418 0.24% Castro::computeNewDt() 8 0.007682 0.007682 0.007682 0.22% FillPatchIterator::FillFromTwoLevels() 31 0.00751 0.00751 0.00751 0.22% Amr::bldFineLevels() 1 0.007502 0.007502 0.007502 0.22% FillPatchTwoLevels 31 0.00748 0.00748 0.00748 0.22% MLMG::miniCycle() 34 0.007163 0.007163 0.007163 0.21% Castro::finalize_do_advance() 9 0.00699 0.00699 0.00699 0.20% MLMG::addInterpCorrection() 155 0.006967 0.006967 0.006967 0.20% MLPoisson::Fapply() 493 0.006855 0.006855 0.006855 0.20% MLMG::mgVcycle_down::2 31 0.006826 0.006826 0.006826 0.20% FabArray::Xpay() 353 0.006491 0.006491 0.006491 0.19% Castro::reset_internal_energy(Fab) 1476 0.006314 0.006314 0.006314 0.18% MLMG::mgVcycle_down::3 31 0.006224 0.006224 0.006224 0.18% MLMG::mgVcycle_down::4 31 0.00611 0.00611 0.00611 0.18% MLMG::computeResidual() 31 0.005995 0.005995 0.005995 0.17% MLCGSolver::ParallelAllReduce 745 0.005247 0.005247 0.005247 0.15% Castro::construct_new_gravity_source() 9 0.005159 0.005159 0.005159 0.15% Castro::errorEst() 6 0.005119 0.005119 0.005119 0.15% MLMG::mgVcycle_up::4 31 0.004957 0.004957 0.004957 0.14% FabArrayBase::getCPC() 1522 0.004919 0.004919 0.004919 0.14% MLMG::mgVcycle_up::3 31 0.004758 0.004758 0.004758 0.14% MLMG::mgVcycle_up::2 31 0.004753 0.004753 0.004753 0.14% Castro::apply_source_to_state() 18 0.004228 0.004228 0.004228 0.12% FabArrayBase::CPC::define() 534 0.00375 0.00375 0.00375 0.11% FillPatchInterp(MF) 30 0.003726 0.003726 0.003726 0.11% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003694 0.003694 0.003694 0.11% MLMG::computeResWithCrseCorFineCor() 17 0.003615 0.003615 0.003615 0.10% MLCellLinOp::updateSolBC() 25 0.00341 0.00341 0.00341 0.10% FabArray::setDomainBndry() 92 0.00338 0.00338 0.00338 0.10% Castro::apply_tagging_restrictions() 6 0.00336 0.00336 0.00336 0.10% TagBoxArray::mapPRD 6 0.003263 0.003263 0.003263 0.09% Castro::check_for_nan() 18 0.003263 0.003263 0.003263 0.09% MultiFab::contains_nan() 18 0.003252 0.003252 0.003252 0.09% Castro::init(old) 3 0.003069 0.003069 0.003069 0.09% Castro::enforce_speed_limit() 87 0.002947 0.002947 0.002947 0.09% Castro::computeInitialDt() 2 0.002779 0.002779 0.002779 0.08% Castro::buildMetrics() 5 0.002599 0.002599 0.002599 0.08% FabArray::mult() 55 0.002589 0.002589 0.002589 0.08% MLCellLinOp::setLevelBC() 18 0.002563 0.002563 0.002563 0.07% MLCellLinOp::updateCorBC() 17 0.002371 0.002371 0.002371 0.07% MLMG::ResNormInf() 54 0.002084 0.002084 0.002084 0.06% MLPoisson::prepareForSolve() 10 0.002073 0.002073 0.002073 0.06% MLCellLinOp::prepareForSolve() 10 0.002066 0.002066 0.002066 0.06% Gravity::update_max_rhs() 10 0.002042 0.002042 0.002042 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.001978 0.001978 0.001978 0.06% Castro::fill_hybrid_hydro_source() 27 0.001665 0.001665 0.001665 0.05% MLPoisson::FFlux() 150 0.001524 0.001524 0.001524 0.04% check_for_negative_density() 9 0.001439 0.001439 0.001439 0.04% average_down_faces 48 0.001298 0.001298 0.001298 0.04% Castro::avgDown() 4 0.001289 0.001289 0.001289 0.04% Castro::avgDown(state_indx) 20 0.001284 0.001284 0.001284 0.04% amrex::average_down_w_geom 20 0.001275 0.001275 0.001275 0.04% FabArray::norminf(mask) 21 0.001227 0.001227 0.001227 0.04% MLMG::MLResNormInf() 15 0.001149 0.001149 0.001149 0.03% Castro::construct_new_hybrid_source() 9 0.001058 0.001058 0.001058 0.03% Castro::build_fine_mask() 44 0.001041 0.001041 0.001041 0.03% OwnerMask() 6 0.001027 0.001027 0.001027 0.03% MLMG::interpCorrection_1 17 0.0009875 0.0009875 0.0009875 0.03% Castro::derive() 6 0.000947 0.000947 0.000947 0.03% AmrLevel::derive() 6 0.0009433 0.0009433 0.0009433 0.03% Castro::init() 1 0.0009209 0.0009209 0.0009209 0.03% AmrLevel::FillCoarsePatch() 5 0.000919 0.000919 0.000919 0.03% TagBoxArray::collate() 6 0.0008167 0.0008167 0.0008167 0.02% FabArrayBase::getFB() 1728 0.0007397 0.0007397 0.0007397 0.02% Castro::FluxRegFineAdd() 9 0.0007168 0.0007168 0.0007168 0.02% Gravity::swapTimeLevels() 9 0.000687 0.000687 0.000687 0.02% Castro::construct_old_hybrid_source() 9 0.0006235 0.0006235 0.0006235 0.02% MultiFab::max() 18 0.0006217 0.0006217 0.0006217 0.02% MLMG::MLRhsNormInf() 10 0.0006035 0.0006035 0.0006035 0.02% Castro::apply_problem_tags() 6 0.000525 0.000525 0.000525 0.02% MultiFab::Multiply() 8 0.0005156 0.0005156 0.0005156 0.01% FabArrayBase::FB::FB() 37 0.000437 0.000437 0.000437 0.01% Castro::linear_to_hybrid_momentum() 1 0.0004241 0.0004241 0.0004241 0.01% Castro::react_state() 18 0.0003874 0.0003874 0.0003874 0.01% MLLinOp::define() 10 0.0002755 0.0002755 0.0002755 0.01% MLLinOp::defineGrids() 10 0.0002624 0.0002624 0.0002624 0.01% AMRErrorTag::operator() 6 0.0002361 0.0002361 0.0002361 0.01% Castro::construct_new_rotation_source() 9 0.0002315 0.0002315 0.0002315 0.01% Castro::construct_old_rotation_source() 9 0.0002092 0.0002092 0.0002092 0.01% AmrLevel::AmrLevel(dm) 5 0.0001932 0.0001932 0.0001932 0.01% StateData::define() 25 0.0001571 0.0001571 0.0001571 0.00% Castro::enforce_consistent_e() 1 0.000152 0.000152 0.000152 0.00% Castro::swap_state_time_levels() 9 0.0001248 0.0001248 0.0001248 0.00% Castro::finalize_advance() 9 0.00011 0.00011 0.00011 0.00% Castro::create_source_corrector() 9 9.79e-05 9.79e-05 9.79e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 6.006e-05 6.006e-05 6.006e-05 0.00% FabArray::RecvLayoutMask() 8 4.931e-05 4.931e-05 4.931e-05 0.00% makeSFC 50 4.556e-05 4.556e-05 4.556e-05 0.00% Amr::writeSmallPlotFile() 1 3.996e-05 3.996e-05 3.996e-05 0.00% FabArrayBase::TheFPinfo() 25 3.87e-05 3.87e-05 3.87e-05 0.00% AmrMesh-cluster 4 2.185e-05 2.185e-05 2.185e-05 0.00% DistributionMapping::Distribute() 52 2.053e-05 2.053e-05 2.053e-05 0.00% FPinfo::FPinfo() 3 1.905e-05 1.905e-05 1.905e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.772e-05 1.772e-05 1.772e-05 0.00% Amr::initSubcycle() 1 1.665e-05 1.665e-05 1.665e-05 0.00% ClusterList::intersect() 4 1.171e-05 1.171e-05 1.171e-05 0.00% BoxList::parallelComplementIn() 12 9.406e-06 9.406e-06 9.406e-06 0.00% BoxList::complementIn 12 4.564e-06 4.564e-06 4.564e-06 0.00% Gravity::set_mass_offset() 6 4.41e-06 4.41e-06 4.41e-06 0.00% Castro::retry_advance_ctu() 5 2.753e-06 2.753e-06 2.753e-06 0.00% ClusterList::chop() 4 1.907e-06 1.907e-06 1.907e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.763e-06 1.763e-06 1.763e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1600 KiB 9037 MiB Castro::reflux() 436 436 11 MiB 666 MiB Castro::initMFs() 258 258 312 MiB 576 MiB Castro::swap_state_time_levels() 175 175 160 MiB 340 MiB StateData::define() 175 175 197 MiB 340 MiB Castro::initialize_do_advance() 143 143 109 MiB 325 MiB FillPatchIterator::Initialize 899 899 3711 KiB 303 MiB Amr::writePlotFile() 56 56 15 MiB 189 MiB Castro::problem_post_timestep() 162 162 736 KiB 167 MiB Castro::FluxRegCrseInit 660 660 409 KiB 167 MiB FluxRegister::Reflux() 648 648 1402 KiB 160 MiB Castro::initialize_advance() 143 143 43 MiB 121 MiB Castro::construct_new_source() 143 143 244 KiB 67 MiB Castro::construct_old_source() 143 143 128 KiB 67 MiB Castro::buildMetrics() 140 140 33 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 25 MiB 60 MiB Castro::Castro() 210 210 3736 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2562 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 180 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 226 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 849 KiB 16 MiB FillPatchTwoLevels 300 300 7052 B 11 MiB FillPatchInterp(MF) 330 330 4336 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 123 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4093 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 713 KiB 7424 KiB Castro::build_fine_mask() 224 224 1151 KiB 6912 KiB AmrLevel::derive() 162 162 2377 B 6912 KiB BndryData::define() 3624 3624 267 KiB 4243 KiB MLCellLinOp::reflux() 450 450 4658 B 2376 KiB Castro::wd_update() 6 6 22 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 382 B 2095 KiB amrex::average_down 1483 1483 2141 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 4490 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 724 B 867 KiB MLCellLinOp::defineBC() 276 276 3678 B 689 KiB Castro::estTimeStep() 26 26 2386 B 480 KiB VisMF::Write(FabArray) 1568 1568 2158 B 320 KiB Castro::normalize_species() 87 87 6783 B 320 KiB Castro::volInBoundary() 70 70 2880 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 115 B 204 KiB FabArray::norminf(mask) 29 29 178 B 163 KiB amrex::Dot() 559 559 398 B 160 KiB FabArray::norminf() 470 470 393 B 160 KiB MultiFab::max() 18 18 28 B 160 KiB check_for_negative_density() 9 9 66 B 160 KiB Castro::initData() 1 1 43 B 160 KiB FabArray::setVal() 419 419 49 KiB 120 KiB MLMG::interpCorrection_1 34 34 25 B 91 KiB average_down_faces 99 99 569 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 255 B 57 KiB MLPoisson::Fsmooth() 228 228 2944 B 55 KiB FillBoundary_nowait() 751 751 401 B 53 KiB TagBoxArray::mapPRD 324 324 38 B 45 KiB OwnerMask() 168 168 11 B 38 KiB MLCellLinOp::applyBC() 3834 3834 131 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 8577 B 25 KiB MultiFab::contains_nan() 18 18 19 B 20 KiB StateData::FillBoundary(geom) 2538 2538 38 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 574 B 3456 B MLCGSolver::bicgstab 155 155 24 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 165 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 11 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 550 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1130 B 278 KiB FabArray::setVal() 419 419 49 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 255 B 57 KiB MLPoisson::Fsmooth() 228 228 2944 B 55 KiB FillBoundary_nowait() 751 751 401 B 53 KiB MLCellLinOp::applyBC() 1917 1917 130 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 8577 B 25 KiB Gravity::get_new_grav_vector() 18 18 3156 B 20 KiB Gravity::get_old_grav_vector() 12 12 5624 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 38 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1208 B 6304 B MLMG::prepareForSolve() 18 18 218 B 3712 B FabArray::norminf(mask) 29 29 125 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 574 B 3456 B Castro::FluxRegCrseInit 12 12 8 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 544 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 2 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (24.04-8-g2cd72a3bbaeb) finalized