Initializing AMReX (24.04-6-g771c439170bf)... Initializing CUDA... CUDA initialized with 1 device. AMReX (24.04-6-g771c439170bf) initialized Starting run at 08:12:57 UTC on 2024-04-05. Successfully read inputs file ... Castro git describe: 24.04-3-g0462ceb8e AMReX git describe: 24.04-6-g771c43917 Microphysics git describe: 24.04-3-gd82c8c88 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003614348 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.002036789 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009471596 Gravity::multilevel_solve_for_new_phi() time = 0.054046532 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.204422711 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003425271 on level 0 Castro::do_old_sources() time = 0.008969383 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.135099402 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.007464414 Gravity::multilevel_solve_for_new_phi() time = 0.04273232 Castro::construct_new_gravity() time = 0.046409415 on level 0 Castro::do_new_sources() time = 0.008175634 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.934744183 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.234701694 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002348022 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007552719 Gravity::multilevel_solve_for_new_phi() time = 0.061222044 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003331082 on level 0 Castro::do_old_sources() time = 0.00666009 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.166304327 on level 0 Castro::construct_old_gravity() time = 0.000384295 on level 1 Castro::do_old_sources() time = 0.002254184 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.008026468 on level 1 Castro::reflux() at level 0 : time = 0.018658935 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007319463 Gravity::multilevel_solve_for_new_phi() time = 0.042098395 Castro::construct_new_gravity() time = 0.045692452 on level 0 Castro::do_new_sources() time = 0.006919768 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000380307 on level 1 Castro::do_new_sources() time = 0.00218622 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.303226817 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.374823776 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.002146338 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007197179 Gravity::multilevel_solve_for_new_phi() time = 0.015263173 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003447952 on level 0 Castro::do_old_sources() time = 0.006769284 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.174879643 on level 0 Castro::construct_old_gravity() time = 0.000357145 on level 1 Castro::do_old_sources() time = 0.002160864 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.00784972 on level 1 Castro::reflux() at level 0 : time = 0.017402265 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007263361 Gravity::multilevel_solve_for_new_phi() time = 0.029260259 Castro::construct_new_gravity() time = 0.032856096 on level 0 Castro::do_new_sources() time = 0.007359141 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000375803 on level 1 Castro::do_new_sources() time = 0.003159137 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.366332905 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.324358793 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002098212 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007257217 Gravity::multilevel_solve_for_new_phi() time = 0.015371072 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003423778 on level 0 Castro::do_old_sources() time = 0.006627377 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.159646702 on level 0 Castro::construct_old_gravity() time = 0.000364221 on level 1 Castro::do_old_sources() time = 0.001967139 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.009323113 on level 1 Castro::reflux() at level 0 : time = 0.017253662 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007190474 Gravity::multilevel_solve_for_new_phi() time = 0.029278099 Castro::construct_new_gravity() time = 0.032884014 on level 0 Castro::do_new_sources() time = 0.007106659 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000381672 on level 1 Castro::do_new_sources() time = 0.002438526 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.566121423 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.30625857 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002135734 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007260322 Gravity::multilevel_solve_for_new_phi() time = 0.015434547 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.00340808 on level 0 Castro::do_old_sources() time = 0.0066879 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.181607194 on level 0 Castro::construct_old_gravity() time = 0.00034883 on level 1 Castro::do_old_sources() time = 0.002137008 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007328966 on level 1 Castro::reflux() at level 0 : time = 0.017916745 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.00724729 Gravity::multilevel_solve_for_new_phi() time = 0.02939481 Castro::construct_new_gravity() time = 0.033014405 on level 0 Castro::do_new_sources() time = 0.007320931 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000399523 on level 1 Castro::do_new_sources() time = 0.002538201 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.293659482 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.32741457 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.154738004 seconds Ending run at 08:13:00 UTC on 2024-04-05. Run time = 3.210829943 Run time without initialization = 1.723166425 Average number of zones advanced per microsecond: 2.871 Average number of zones advanced per microsecond per rank: 2.871 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.211 ... 3.211 ... 3.211 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0437 1.0437 1.0437 32.50% Castro::construct_ctu_hydro_source() 9 0.8168 0.8168 0.8168 25.44% VisMF::Write(FabArray) 3 0.3524 0.3524 0.3524 10.97% Castro::initMFs() 5 0.1505 0.1505 0.1505 4.69% Gravity::fill_multipole_BCs() 10 0.07325 0.07325 0.07325 2.28% Castro::normalize_species() 87 0.06716 0.06716 0.06716 2.09% Castro::computeTemp() 88 0.06331 0.06331 0.06331 1.97% MLCellLinOp::applyBC() 1917 0.04883 0.04883 0.04883 1.52% FillBoundary_nowait() 1728 0.04359 0.04359 0.04359 1.36% FabArray::setVal() 920 0.03828 0.03828 0.03828 1.19% StateData::FillBoundary(geom) 650 0.03583 0.03583 0.03583 1.12% FabArray::ParallelCopy_nowait() 954 0.03088 0.03088 0.03088 0.96% Castro::volInBoundary() 42 0.02958 0.02958 0.02958 0.92% amrex::Copy() 441 0.02678 0.02678 0.02678 0.83% Castro::reset_internal_energy(MultiFab) 88 0.02318 0.02318 0.02318 0.72% FluxRegister::Reflux() 24 0.02245 0.02245 0.02245 0.70% MLCellLinOp::defineAuxData() 10 0.02158 0.02158 0.02158 0.67% amrex::Add() 136 0.01731 0.01731 0.01731 0.54% Castro::estTimeStep() 26 0.01702 0.01702 0.01702 0.53% Castro::construct_new_source() 63 0.01642 0.01642 0.01642 0.51% FabArray::Saxpy() 604 0.01599 0.01599 0.01599 0.50% StateDataPhysBCFunct::() 95 0.01414 0.01414 0.01414 0.44% BndryData::define() 26 0.0133 0.0133 0.0133 0.41% MLPoisson::Fsmooth() 1376 0.0128 0.0128 0.0128 0.40% Castro::enforce_min_density() 87 0.011 0.011 0.011 0.34% Castro::reflux() 4 0.0108 0.0108 0.0108 0.34% Castro::problem_post_timestep() 10 0.01073 0.01073 0.01073 0.33% MLCellLinOp::reflux() 30 0.009783 0.009783 0.009783 0.30% amrex::Dot() 466 0.009361 0.009361 0.009361 0.29% FabArray::norminf() 439 0.008864 0.008864 0.008864 0.28% Castro::construct_old_gravity_source() 18 0.008246 0.008246 0.008246 0.26% Castro::FluxRegCrseInit 9 0.007941 0.007941 0.007941 0.25% MLPoisson::Fapply() 493 0.006937 0.006937 0.006937 0.22% Castro::initData() 1 0.006845 0.006845 0.006845 0.21% FabArray::Xpay() 353 0.006508 0.006508 0.006508 0.20% amrex::average_down 233 0.006207 0.006207 0.006207 0.19% AmrMesh::MakeNewGrids() 6 0.006039 0.006039 0.006039 0.19% Castro::construct_new_gravity_source() 9 0.00522 0.00522 0.00522 0.16% Castro::wd_update() 6 0.004681 0.004681 0.004681 0.15% Castro::construct_old_source() 63 0.004652 0.004652 0.004652 0.14% Amr::writePlotFile() 2 0.004512 0.004512 0.004512 0.14% MLMG::addInterpCorrection() 155 0.004507 0.004507 0.004507 0.14% Castro::reset_internal_energy(Fab) 1476 0.004433 0.004433 0.004433 0.14% FabArrayBase::CPC::define() 534 0.003786 0.003786 0.003786 0.12% FillPatchInterp(MF) 30 0.003774 0.003774 0.003774 0.12% Gravity::actual_solve_with_mlmg() 10 0.003763 0.003763 0.003763 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003756 0.003756 0.003756 0.12% FabArray::setDomainBndry() 92 0.00338 0.00338 0.00338 0.11% MultiFab::contains_nan() 18 0.003248 0.003248 0.003248 0.10% Castro::enforce_speed_limit() 87 0.00309 0.00309 0.00309 0.10% MLCellLinOp::compGrad() 18 0.002941 0.002941 0.002941 0.09% check_for_negative_density() 9 0.002859 0.002859 0.002859 0.09% MLCellLinOp::defineBC() 10 0.002769 0.002769 0.002769 0.09% FabArray::mult() 55 0.002584 0.002584 0.002584 0.08% MLCellLinOp::setLevelBC() 18 0.002525 0.002525 0.002525 0.08% Castro::apply_tagging_restrictions() 6 0.002102 0.002102 0.002102 0.07% MLCellLinOp::prepareForSolve() 10 0.002056 0.002056 0.002056 0.06% MLMG::prepareForSolve() 10 0.001859 0.001859 0.001859 0.06% Castro::fill_hybrid_hydro_source() 27 0.001691 0.001691 0.001691 0.05% MLPoisson::FFlux() 150 0.001553 0.001553 0.001553 0.05% MLCellLinOp::updateSolBC() 25 0.001411 0.001411 0.001411 0.04% TagBoxArray::mapPRD 6 0.001398 0.001398 0.001398 0.04% Gravity::get_new_grav_vector() 10 0.001236 0.001236 0.001236 0.04% FabArray::norminf(mask) 21 0.001232 0.001232 0.001232 0.04% FabArrayBase::getCPC() 1522 0.001136 0.001136 0.001136 0.04% MLCellLinOp::updateCorBC() 17 0.001047 0.001047 0.001047 0.03% OwnerMask() 6 0.001041 0.001041 0.001041 0.03% Castro::build_fine_mask() 44 0.000997 0.000997 0.000997 0.03% Gravity::get_old_grav_vector() 9 0.0009967 0.0009967 0.0009967 0.03% average_down_faces 48 0.0008989 0.0008989 0.0008989 0.03% Castro::post_timestep() 9 0.0008705 0.0008705 0.0008705 0.03% TagBoxArray::collate() 6 0.0008472 0.0008472 0.0008472 0.03% Castro::advance() 5 0.000843 0.000843 0.000843 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0007976 0.0007976 0.0007976 0.02% FillPatchTwoLevels 31 0.0007563 0.0007563 0.0007563 0.02% MLCGSolver::bicgstab 31 0.000734 0.000734 0.000734 0.02% Castro::FluxRegFineAdd() 9 0.0006778 0.0006778 0.0006778 0.02% main() 1 0.0006672 0.0006672 0.0006672 0.02% AmrLevel::FillPatch() 62 0.0006264 0.0006264 0.0006264 0.02% MultiFab::max() 18 0.0006246 0.0006246 0.0006246 0.02% FillPatchIterator::Initialize 62 0.0006115 0.0006115 0.0006115 0.02% MLCellLinOp::smooth() 688 0.0005328 0.0005328 0.0005328 0.02% Castro::apply_problem_tags() 6 0.0005213 0.0005213 0.0005213 0.02% MultiFab::Multiply() 8 0.0005131 0.0005131 0.0005131 0.02% Castro::Castro() 5 0.0004441 0.0004441 0.0004441 0.01% FabArrayBase::FB::FB() 37 0.0004431 0.0004431 0.0004431 0.01% MLMG::interpCorrection_1 17 0.0004182 0.0004182 0.0004182 0.01% FabArray::FillBoundary() 1728 0.0004021 0.0004021 0.0004021 0.01% Castro::initialize_do_advance() 9 0.0003969 0.0003969 0.0003969 0.01% Amr::regrid() 5 0.0003605 0.0003605 0.0003605 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003524 0.0003524 0.0003524 0.01% FabArray::ParallelCopy() 954 0.0003411 0.0003411 0.0003411 0.01% Castro::clean_state() 87 0.00032 0.00032 0.00032 0.01% FabArrayBase::getFB() 1728 0.0002966 0.0002966 0.0002966 0.01% Amr::coarseTimeStep() 5 0.0002744 0.0002744 0.0002744 0.01% Gravity::update_max_rhs() 10 0.0002568 0.0002568 0.0002568 0.01% Castro::subcycle_advance_ctu() 5 0.0002496 0.0002496 0.0002496 0.01% Gravity::actual_multilevel_solve() 10 0.0002469 0.0002469 0.0002469 0.01% AMRErrorTag::operator() 6 0.0002383 0.0002383 0.0002383 0.01% Castro::construct_new_rotation_source() 9 0.000237 0.000237 0.000237 0.01% MLCellLinOp::apply() 493 0.0002368 0.0002368 0.0002368 0.01% Castro::construct_old_rotation_source() 9 0.0002168 0.0002168 0.0002168 0.01% MLLinOp::defineGrids() 10 0.0002004 0.0002004 0.0002004 0.01% Castro::construct_new_gravity() 9 0.0001734 0.0001734 0.0001734 0.01% StateData::define() 25 0.0001577 0.0001577 0.0001577 0.00% Castro::finalize_do_advance() 9 0.0001545 0.0001545 0.0001545 0.00% Castro::initialize_advance() 9 0.000153 0.000153 0.000153 0.00% Castro::enforce_consistent_e() 1 0.0001445 0.0001445 0.0001445 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001399 0.0001399 0.0001399 0.00% MLCGSolver::ParallelAllReduce 745 0.0001321 0.0001321 0.0001321 0.00% Castro::do_new_sources() 9 0.0001271 0.0001271 0.0001271 0.00% Castro::swap_state_time_levels() 9 0.0001249 0.0001249 0.0001249 0.00% Castro::do_advance_ctu() 5 0.0001141 0.0001141 0.0001141 0.00% Castro::do_old_sources() 9 0.0001041 0.0001041 0.0001041 0.00% Castro::buildMetrics() 5 0.0001041 0.0001041 0.0001041 0.00% Amr::grid_places() 6 0.0001018 0.0001018 0.0001018 0.00% MLMG::mgVcycle() 65 0.0001008 0.0001008 0.0001008 0.00% Castro::finalize_advance() 9 0.0001 0.0001 0.0001 0.00% MLCellLinOp::correctionResidual() 189 9.902e-05 9.902e-05 9.902e-05 0.00% Castro::construct_old_gravity() 9 9.547e-05 9.547e-05 9.547e-05 0.00% AmrLevel::derive() 6 7.794e-05 7.794e-05 7.794e-05 0.00% Amr::timeStep() 9 7.708e-05 7.708e-05 7.708e-05 0.00% Castro::post_regrid() 10 6.264e-05 6.264e-05 6.264e-05 0.00% Castro::create_source_corrector() 9 5.953e-05 5.953e-05 5.953e-05 0.00% FillPatchSingleLevel 92 5.87e-05 5.87e-05 5.87e-05 0.00% MLMG::oneIter() 31 5.616e-05 5.616e-05 5.616e-05 0.00% AmrLevel::AmrLevel(dm) 5 5.331e-05 5.331e-05 5.331e-05 0.00% MLMG:computeResOfCorrection() 155 5.23e-05 5.23e-05 5.23e-05 0.00% Castro::errorEst() 6 5.176e-05 5.176e-05 5.176e-05 0.00% FabArray::RecvLayoutMask() 8 4.917e-05 4.917e-05 4.917e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.773e-05 4.773e-05 4.773e-05 0.00% MLMG::solve() 10 4.646e-05 4.646e-05 4.646e-05 0.00% MLCellLinOp::solutionResidual() 71 4.308e-05 4.308e-05 4.308e-05 0.00% MLMG::mgVcycle_down::0 31 4.04e-05 4.04e-05 4.04e-05 0.00% MLMG::actualBottomSolve() 31 3.981e-05 3.981e-05 3.981e-05 0.00% MLMG::mgVcycle_bottom 65 3.904e-05 3.904e-05 3.904e-05 0.00% Amr::writeSmallPlotFile() 1 3.82e-05 3.82e-05 3.82e-05 0.00% Amr::defBaseLevel() 1 3.812e-05 3.812e-05 3.812e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.563e-05 3.563e-05 3.563e-05 0.00% MLMG::mgVcycle_down::1 31 3.275e-05 3.275e-05 3.275e-05 0.00% Gravity::solve_phi_with_mlmg() 10 3.248e-05 3.248e-05 3.248e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.087e-05 3.087e-05 3.087e-05 0.00% MLMG::mgVcycle_down::2 31 2.995e-05 2.995e-05 2.995e-05 0.00% MLMG::mgVcycle_down::3 31 2.982e-05 2.982e-05 2.982e-05 0.00% makeSFC 50 2.749e-05 2.749e-05 2.749e-05 0.00% Castro::react_state() 18 2.707e-05 2.707e-05 2.707e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.701e-05 2.701e-05 2.701e-05 0.00% MLPoisson::define() 10 2.655e-05 2.655e-05 2.655e-05 0.00% MLMG::mgVcycle_down::4 31 2.582e-05 2.582e-05 2.582e-05 0.00% Castro::computeNewDt() 8 2.471e-05 2.471e-05 2.471e-05 0.00% MLMG::ResNormInf() 54 2.413e-05 2.413e-05 2.413e-05 0.00% MLMG::mgVcycle_up::4 31 2.292e-05 2.292e-05 2.292e-05 0.00% MLMG::mgVcycle_up::3 31 2.099e-05 2.099e-05 2.099e-05 0.00% DistributionMapping::Distribute() 52 2.089e-05 2.089e-05 2.089e-05 0.00% MLMG::mgVcycle_up::0 31 2.005e-05 2.005e-05 2.005e-05 0.00% MLMG::mgVcycle_up::1 31 1.965e-05 1.965e-05 1.965e-05 0.00% FabArrayBase::TheFPinfo() 25 1.951e-05 1.951e-05 1.951e-05 0.00% FPinfo::FPinfo() 3 1.885e-05 1.885e-05 1.885e-05 0.00% MLMG::mgVcycle_up::2 31 1.837e-05 1.837e-05 1.837e-05 0.00% amrex::average_down_w_geom 20 1.665e-05 1.665e-05 1.665e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.617e-05 1.617e-05 1.617e-05 0.00% Amr::initSubcycle() 1 1.478e-05 1.478e-05 1.478e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.419e-05 1.419e-05 1.419e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.399e-05 1.399e-05 1.399e-05 0.00% MLMG::computeResidual() 31 1.389e-05 1.389e-05 1.389e-05 0.00% MLMG::miniCycle() 34 1.373e-05 1.373e-05 1.373e-05 0.00% MLLinOp::define() 10 1.34e-05 1.34e-05 1.34e-05 0.00% Amr::FinalizeInit() 1 1.336e-05 1.336e-05 1.336e-05 0.00% MLMG::computeMLResidual() 15 1.31e-05 1.31e-05 1.31e-05 0.00% ClusterList::intersect() 4 1.288e-05 1.288e-05 1.288e-05 0.00% Castro::post_init() 1 1.071e-05 1.071e-05 1.071e-05 0.00% Castro::check_for_nan() 18 1.064e-05 1.064e-05 1.064e-05 0.00% Castro::expand_state() 13 9.129e-06 9.129e-06 9.129e-06 0.00% Castro::construct_new_hybrid_source() 9 8.715e-06 8.715e-06 8.715e-06 0.00% Castro::apply_source_to_state() 18 8.53e-06 8.53e-06 8.53e-06 0.00% AmrMesh-cluster 4 8.356e-06 8.356e-06 8.356e-06 0.00% Amr::InitializeInit() 1 7.879e-06 7.879e-06 7.879e-06 0.00% Gravity::swapTimeLevels() 9 7.828e-06 7.828e-06 7.828e-06 0.00% MLMG::getGradSolution() 10 7.819e-06 7.819e-06 7.819e-06 0.00% MLMG::MLResNormInf() 15 7.289e-06 7.289e-06 7.289e-06 0.00% MLPoisson::prepareForSolve() 10 7.277e-06 7.277e-06 7.277e-06 0.00% Castro::avgDown(state_indx) 20 7.273e-06 7.273e-06 7.273e-06 0.00% Castro::construct_old_hybrid_source() 9 5.941e-06 5.941e-06 5.941e-06 0.00% MLMG::MLRhsNormInf() 10 5.345e-06 5.345e-06 5.345e-06 0.00% BoxList::complementIn 12 5.32e-06 5.32e-06 5.32e-06 0.00% Castro::init(old) 3 5.126e-06 5.126e-06 5.126e-06 0.00% BoxList::parallelComplementIn() 12 4.413e-06 4.413e-06 4.413e-06 0.00% Gravity::set_mass_offset() 6 4.182e-06 4.182e-06 4.182e-06 0.00% Castro::avgDown() 4 3.838e-06 3.838e-06 3.838e-06 0.00% Castro::derive() 6 3.757e-06 3.757e-06 3.757e-06 0.00% Castro::retry_advance_ctu() 5 2.897e-06 2.897e-06 2.897e-06 0.00% Castro::computeInitialDt() 2 2.874e-06 2.874e-06 2.874e-06 0.00% Amr::bldFineLevels() 1 2.682e-06 2.682e-06 2.682e-06 0.00% Amr::init() 1 2.383e-06 2.383e-06 2.383e-06 0.00% Castro::init() 1 2.234e-06 2.234e-06 2.234e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.78e-06 1.78e-06 1.78e-06 0.00% ClusterList::chop() 4 1.738e-06 1.738e-06 1.738e-06 0.00% Amr::initialInit() 1 1.281e-06 1.281e-06 1.281e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.211 3.211 3.211 100.00% Amr::coarseTimeStep() 5 1.568 1.568 1.568 48.83% Amr::timeStep() 9 1.562 1.562 1.562 48.66% Castro::advance() 5 1.35 1.35 1.35 42.04% Castro::subcycle_advance_ctu() 5 1.327 1.327 1.327 41.32% Castro::do_advance_ctu() 5 1.326 1.326 1.326 41.31% Amr::InitAmr() 1 1.044 1.044 1.044 32.50% Castro::construct_ctu_hydro_source() 9 0.8501 0.8501 0.8501 26.48% Amr::init() 1 0.4439 0.4439 0.4439 13.82% Amr::writePlotFile() 2 0.3593 0.3593 0.3593 11.19% VisMF::Write(FabArray) 3 0.3524 0.3524 0.3524 10.97% Gravity::multilevel_solve_for_new_phi() 10 0.3343 0.3343 0.3343 10.41% Gravity::actual_multilevel_solve() 10 0.3335 0.3335 0.3335 10.39% Gravity::solve_phi_with_mlmg() 10 0.3302 0.3302 0.3302 10.28% Gravity::actual_solve_with_mlmg() 10 0.2544 0.2544 0.2544 7.92% Amr::initialInit() 1 0.2393 0.2393 0.2393 7.45% MLMG::solve() 10 0.2 0.2 0.2 6.23% Castro::construct_new_gravity() 9 0.1925 0.1925 0.1925 5.99% Castro::clean_state() 87 0.1711 0.1711 0.1711 5.33% MLMG::oneIter() 31 0.169 0.169 0.169 5.26% Amr::InitializeInit() 1 0.1649 0.1649 0.1649 5.14% Amr::defBaseLevel() 1 0.1649 0.1649 0.1649 5.14% Castro::Castro() 5 0.1547 0.1547 0.1547 4.82% Castro::initMFs() 5 0.1505 0.1505 0.1505 4.69% Amr::regrid() 5 0.149 0.149 0.149 4.64% MLMG::mgVcycle() 65 0.145 0.145 0.145 4.52% Castro::post_regrid() 10 0.1341 0.1341 0.1341 4.18% MLCellLinOp::applyBC() 1917 0.09357 0.09357 0.09357 2.91% AmrLevel::FillPatch() 62 0.09235 0.09235 0.09235 2.88% Castro::computeTemp() 88 0.09092 0.09092 0.09092 2.83% MLCellLinOp::smooth() 688 0.08298 0.08298 0.08298 2.58% FillPatchIterator::Initialize 62 0.07786 0.07786 0.07786 2.42% Gravity::fill_multipole_BCs() 10 0.07535 0.07535 0.07535 2.35% Amr::FinalizeInit() 1 0.07442 0.07442 0.07442 2.32% Castro::reflux() 4 0.07127 0.07127 0.07127 2.22% FillPatchSingleLevel 92 0.06919 0.06919 0.06919 2.15% Castro::normalize_species() 87 0.06716 0.06716 0.06716 2.09% FillPatchIterator::FillFromLevel0() 31 0.06656 0.06656 0.06656 2.07% Castro::post_timestep() 9 0.06365 0.06365 0.06365 1.98% Castro::post_init() 1 0.06285 0.06285 0.06285 1.96% Castro::initialize_do_advance() 9 0.05321 0.05321 0.05321 1.66% Castro::problem_post_timestep() 10 0.05056 0.05056 0.05056 1.57% StateDataPhysBCFunct::() 95 0.04997 0.04997 0.04997 1.56% Castro::do_new_sources() 9 0.04728 0.04728 0.04728 1.47% FabArray::FillBoundary() 1728 0.04474 0.04474 0.04474 1.39% FillBoundary_nowait() 1728 0.04433 0.04433 0.04433 1.38% Castro::do_old_sources() 9 0.04432 0.04432 0.04432 1.38% MLPoisson::define() 10 0.04365 0.04365 0.04365 1.36% Castro::expand_state() 13 0.04166 0.04166 0.04166 1.30% MLMG::mgVcycle_bottom 65 0.03882 0.03882 0.03882 1.21% FabArray::setVal() 920 0.03828 0.03828 0.03828 1.19% StateData::FillBoundary(geom) 650 0.03583 0.03583 0.03583 1.12% FabArray::ParallelCopy() 954 0.03524 0.03524 0.03524 1.10% FabArray::ParallelCopy_nowait() 954 0.0349 0.0349 0.0349 1.09% Castro::wd_update() 6 0.03426 0.03426 0.03426 1.07% MLMG::actualBottomSolve() 31 0.03166 0.03166 0.03166 0.99% MLCGSolver::bicgstab 31 0.03136 0.03136 0.03136 0.98% FluxRegister::Reflux() 24 0.02976 0.02976 0.02976 0.93% Castro::volInBoundary() 42 0.02958 0.02958 0.02958 0.92% MLMG::mgVcycle_down::0 31 0.02945 0.02945 0.02945 0.92% Castro::construct_new_source() 63 0.02893 0.02893 0.02893 0.90% MLCellLinOp::apply() 493 0.02843 0.02843 0.02843 0.89% Castro::reset_internal_energy(MultiFab) 88 0.02761 0.02761 0.02761 0.86% amrex::Copy() 441 0.02678 0.02678 0.02678 0.83% MLCellLinOp::defineAuxData() 10 0.025 0.025 0.025 0.78% Gravity::get_new_grav_vector() 10 0.02345 0.02345 0.02345 0.73% Castro::initialize_advance() 9 0.02218 0.02218 0.02218 0.69% MLMG::mgVcycle_up::0 31 0.02215 0.02215 0.02215 0.69% Castro::construct_old_gravity() 9 0.01858 0.01858 0.01858 0.58% MLCellLinOp::correctionResidual() 189 0.01852 0.01852 0.01852 0.58% Gravity::get_old_grav_vector() 9 0.01848 0.01848 0.01848 0.58% MLCellLinOp::defineBC() 10 0.01835 0.01835 0.01835 0.57% amrex::Add() 136 0.01731 0.01731 0.01731 0.54% Castro::estTimeStep() 26 0.01702 0.01702 0.01702 0.53% MLCellLinOp::reflux() 30 0.01615 0.01615 0.01615 0.50% FabArray::Saxpy() 604 0.01599 0.01599 0.01599 0.50% BndryData::define() 26 0.01544 0.01544 0.01544 0.48% MLCellLinOp::solutionResidual() 71 0.01496 0.01496 0.01496 0.47% Amr::grid_places() 6 0.01444 0.01444 0.01444 0.45% AmrMesh::MakeNewGrids() 6 0.01434 0.01434 0.01434 0.45% MLMG:computeResOfCorrection() 155 0.01412 0.01412 0.01412 0.44% MLMG::computeResWithCrseSolFineCor() 17 0.01377 0.01377 0.01377 0.43% MLMG::computeMLResidual() 15 0.01324 0.01324 0.01324 0.41% Castro::construct_old_source() 63 0.01283 0.01283 0.01283 0.40% MLPoisson::Fsmooth() 1376 0.0128 0.0128 0.0128 0.40% Castro::initData() 1 0.01197 0.01197 0.01197 0.37% MLMG::mgVcycle_down::1 31 0.01191 0.01191 0.01191 0.37% Castro::enforce_min_density() 87 0.011 0.011 0.011 0.34% amrex::average_down 233 0.01002 0.01002 0.01002 0.31% amrex::Dot() 466 0.009361 0.009361 0.009361 0.29% Castro::FluxRegCrseInit 9 0.00901 0.00901 0.00901 0.28% MLMG::prepareForSolve() 10 0.008987 0.008987 0.008987 0.28% FabArray::norminf() 439 0.008864 0.008864 0.008864 0.28% MLMG::mgVcycle_up::1 31 0.008579 0.008579 0.008579 0.27% Castro::construct_old_gravity_source() 18 0.008246 0.008246 0.008246 0.26% Amr::bldFineLevels() 1 0.007886 0.007886 0.007886 0.25% Castro::computeNewDt() 8 0.00777 0.00777 0.00777 0.24% FillPatchIterator::FillFromTwoLevels() 31 0.007484 0.007484 0.007484 0.23% FillPatchTwoLevels 31 0.007453 0.007453 0.007453 0.23% MLMG::miniCycle() 34 0.007174 0.007174 0.007174 0.22% MLMG::addInterpCorrection() 155 0.006998 0.006998 0.006998 0.22% MLPoisson::Fapply() 493 0.006937 0.006937 0.006937 0.22% MLMG::mgVcycle_down::2 31 0.00692 0.00692 0.00692 0.22% Castro::finalize_do_advance() 9 0.006646 0.006646 0.006646 0.21% FabArray::Xpay() 353 0.006508 0.006508 0.006508 0.20% MLMG::mgVcycle_down::3 31 0.006309 0.006309 0.006309 0.20% MLMG::mgVcycle_down::4 31 0.006154 0.006154 0.006154 0.19% MLMG::computeResidual() 31 0.006018 0.006018 0.006018 0.19% MLCGSolver::ParallelAllReduce 745 0.005292 0.005292 0.005292 0.16% Castro::construct_new_gravity_source() 9 0.00522 0.00522 0.00522 0.16% MLMG::mgVcycle_up::4 31 0.004995 0.004995 0.004995 0.16% FabArrayBase::getCPC() 1522 0.004922 0.004922 0.004922 0.15% MLMG::mgVcycle_up::2 31 0.004841 0.004841 0.004841 0.15% MLMG::mgVcycle_up::3 31 0.004826 0.004826 0.004826 0.15% MLMG::getGradSolution() 10 0.004455 0.004455 0.004455 0.14% MLCellLinOp::compGrad() 18 0.004447 0.004447 0.004447 0.14% Castro::reset_internal_energy(Fab) 1476 0.004433 0.004433 0.004433 0.14% Castro::apply_source_to_state() 18 0.004223 0.004223 0.004223 0.13% Castro::errorEst() 6 0.003849 0.003849 0.003849 0.12% FabArrayBase::CPC::define() 534 0.003786 0.003786 0.003786 0.12% FillPatchInterp(MF) 30 0.003774 0.003774 0.003774 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003756 0.003756 0.003756 0.12% MLMG::computeResWithCrseCorFineCor() 17 0.003653 0.003653 0.003653 0.11% MLCellLinOp::updateSolBC() 25 0.00345 0.00345 0.00345 0.11% FabArray::setDomainBndry() 92 0.00338 0.00338 0.00338 0.11% TagBoxArray::mapPRD 6 0.003269 0.003269 0.003269 0.10% Castro::check_for_nan() 18 0.003259 0.003259 0.003259 0.10% MultiFab::contains_nan() 18 0.003248 0.003248 0.003248 0.10% Castro::init(old) 3 0.003093 0.003093 0.003093 0.10% Castro::enforce_speed_limit() 87 0.00309 0.00309 0.00309 0.10% check_for_negative_density() 9 0.002859 0.002859 0.002859 0.09% Castro::computeInitialDt() 2 0.002784 0.002784 0.002784 0.09% FabArray::mult() 55 0.002584 0.002584 0.002584 0.08% MLCellLinOp::setLevelBC() 18 0.002525 0.002525 0.002525 0.08% Castro::buildMetrics() 5 0.002517 0.002517 0.002517 0.08% MLCellLinOp::updateCorBC() 17 0.0024 0.0024 0.0024 0.07% MLMG::ResNormInf() 54 0.002118 0.002118 0.002118 0.07% Castro::apply_tagging_restrictions() 6 0.002102 0.002102 0.002102 0.07% Gravity::update_max_rhs() 10 0.002073 0.002073 0.002073 0.06% MLPoisson::prepareForSolve() 10 0.002063 0.002063 0.002063 0.06% MLCellLinOp::prepareForSolve() 10 0.002056 0.002056 0.002056 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.002028 0.002028 0.002028 0.06% Castro::fill_hybrid_hydro_source() 27 0.001691 0.001691 0.001691 0.05% MLPoisson::FFlux() 150 0.001553 0.001553 0.001553 0.05% average_down_faces 48 0.001335 0.001335 0.001335 0.04% FabArray::norminf(mask) 21 0.001232 0.001232 0.001232 0.04% Castro::avgDown() 4 0.001207 0.001207 0.001207 0.04% Castro::avgDown(state_indx) 20 0.001203 0.001203 0.001203 0.04% amrex::average_down_w_geom 20 0.001196 0.001196 0.001196 0.04% MLMG::MLResNormInf() 15 0.001156 0.001156 0.001156 0.04% OwnerMask() 6 0.001041 0.001041 0.001041 0.03% Castro::construct_new_hybrid_source() 9 0.001033 0.001033 0.001033 0.03% Castro::build_fine_mask() 44 0.000997 0.000997 0.000997 0.03% MLMG::interpCorrection_1 17 0.0009957 0.0009957 0.0009957 0.03% Castro::init() 1 0.000963 0.000963 0.000963 0.03% AmrLevel::FillCoarsePatch() 5 0.0009608 0.0009608 0.0009608 0.03% Castro::derive() 6 0.0009355 0.0009355 0.0009355 0.03% AmrLevel::derive() 6 0.0009317 0.0009317 0.0009317 0.03% TagBoxArray::collate() 6 0.0008472 0.0008472 0.0008472 0.03% FabArrayBase::getFB() 1728 0.0007397 0.0007397 0.0007397 0.02% Gravity::swapTimeLevels() 9 0.0006966 0.0006966 0.0006966 0.02% Castro::FluxRegFineAdd() 9 0.0006778 0.0006778 0.0006778 0.02% Castro::construct_old_hybrid_source() 9 0.0006719 0.0006719 0.0006719 0.02% MultiFab::max() 18 0.0006246 0.0006246 0.0006246 0.02% MLMG::MLRhsNormInf() 10 0.0006133 0.0006133 0.0006133 0.02% Castro::apply_problem_tags() 6 0.0005213 0.0005213 0.0005213 0.02% MultiFab::Multiply() 8 0.0005131 0.0005131 0.0005131 0.02% FabArrayBase::FB::FB() 37 0.0004431 0.0004431 0.0004431 0.01% Castro::react_state() 18 0.0003773 0.0003773 0.0003773 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003524 0.0003524 0.0003524 0.01% MLLinOp::define() 10 0.0002759 0.0002759 0.0002759 0.01% MLLinOp::defineGrids() 10 0.0002625 0.0002625 0.0002625 0.01% AMRErrorTag::operator() 6 0.0002383 0.0002383 0.0002383 0.01% Castro::construct_new_rotation_source() 9 0.000237 0.000237 0.000237 0.01% Castro::construct_old_rotation_source() 9 0.0002168 0.0002168 0.0002168 0.01% AmrLevel::AmrLevel(dm) 5 0.000211 0.000211 0.000211 0.01% StateData::define() 25 0.0001577 0.0001577 0.0001577 0.00% Castro::enforce_consistent_e() 1 0.0001445 0.0001445 0.0001445 0.00% Castro::swap_state_time_levels() 9 0.0001249 0.0001249 0.0001249 0.00% Castro::finalize_advance() 9 0.0001 0.0001 0.0001 0.00% MLLinOp::makeAgglomeratedDMap 10 6.034e-05 6.034e-05 6.034e-05 0.00% Castro::create_source_corrector() 9 5.953e-05 5.953e-05 5.953e-05 0.00% FabArray::RecvLayoutMask() 8 4.917e-05 4.917e-05 4.917e-05 0.00% makeSFC 50 4.634e-05 4.634e-05 4.634e-05 0.00% FabArrayBase::TheFPinfo() 25 3.836e-05 3.836e-05 3.836e-05 0.00% Amr::writeSmallPlotFile() 1 3.82e-05 3.82e-05 3.82e-05 0.00% AmrMesh-cluster 4 2.298e-05 2.298e-05 2.298e-05 0.00% DistributionMapping::Distribute() 52 2.089e-05 2.089e-05 2.089e-05 0.00% FPinfo::FPinfo() 3 1.885e-05 1.885e-05 1.885e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.821e-05 1.821e-05 1.821e-05 0.00% Amr::initSubcycle() 1 1.478e-05 1.478e-05 1.478e-05 0.00% ClusterList::intersect() 4 1.288e-05 1.288e-05 1.288e-05 0.00% BoxList::parallelComplementIn() 12 9.733e-06 9.733e-06 9.733e-06 0.00% BoxList::complementIn 12 5.32e-06 5.32e-06 5.32e-06 0.00% Gravity::set_mass_offset() 6 4.182e-06 4.182e-06 4.182e-06 0.00% Castro::retry_advance_ctu() 5 2.897e-06 2.897e-06 2.897e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.78e-06 1.78e-06 1.78e-06 0.00% ClusterList::chop() 4 1.738e-06 1.738e-06 1.738e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1702 KiB 9037 MiB Castro::reflux() 436 436 12 MiB 666 MiB Castro::initMFs() 258 258 355 MiB 576 MiB Castro::swap_state_time_levels() 175 175 179 MiB 340 MiB StateData::define() 175 175 224 MiB 340 MiB Castro::initialize_do_advance() 143 143 125 MiB 325 MiB FillPatchIterator::Initialize 899 899 3960 KiB 303 MiB Amr::writePlotFile() 56 56 20 MiB 189 MiB Castro::problem_post_timestep() 162 162 794 KiB 167 MiB Castro::FluxRegCrseInit 660 660 439 KiB 167 MiB FluxRegister::Reflux() 648 648 1505 KiB 160 MiB Castro::initialize_advance() 143 143 50 MiB 121 MiB Castro::construct_new_source() 143 143 268 KiB 67 MiB Castro::construct_old_source() 143 143 131 KiB 67 MiB Castro::buildMetrics() 140 140 38 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 28 MiB 60 MiB Castro::Castro() 210 210 4474 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2681 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 191 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 240 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 878 KiB 16 MiB FillPatchTwoLevels 300 300 7551 B 11 MiB FillPatchInterp(MF) 330 330 4695 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 132 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4451 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 755 KiB 7424 KiB Castro::build_fine_mask() 224 224 1183 KiB 6912 KiB AmrLevel::derive() 162 162 2528 B 6912 KiB BndryData::define() 3624 3624 280 KiB 4243 KiB MLCellLinOp::reflux() 450 450 5498 B 2376 KiB Castro::wd_update() 6 6 23 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 423 B 2095 KiB amrex::average_down 1483 1483 2370 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 4697 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 783 B 867 KiB MLCellLinOp::defineBC() 276 276 3792 B 689 KiB Castro::estTimeStep() 26 26 2523 B 480 KiB VisMF::Write(FabArray) 1568 1568 2300 B 320 KiB Castro::normalize_species() 87 87 6664 B 320 KiB Castro::volInBoundary() 70 70 2987 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 126 B 204 KiB FabArray::norminf(mask) 29 29 185 B 163 KiB amrex::Dot() 559 559 432 B 160 KiB FabArray::norminf() 470 470 427 B 160 KiB MultiFab::max() 18 18 30 B 160 KiB check_for_negative_density() 9 9 144 B 160 KiB Castro::initData() 1 1 43 B 160 KiB FabArray::setVal() 419 419 55 KiB 120 KiB MLMG::interpCorrection_1 34 34 27 B 91 KiB average_down_faces 99 99 638 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 273 B 57 KiB MLPoisson::Fsmooth() 228 228 3062 B 55 KiB FillBoundary_nowait() 751 751 443 B 53 KiB TagBoxArray::mapPRD 324 324 41 B 45 KiB OwnerMask() 168 168 12 B 38 KiB MLCellLinOp::applyBC() 3834 3834 142 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9638 B 25 KiB MultiFab::contains_nan() 18 18 20 B 20 KiB StateData::FillBoundary(geom) 2538 2538 40 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 590 B 3456 B MLCGSolver::bicgstab 155 155 26 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 171 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 11 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 713 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1221 B 278 KiB FabArray::setVal() 419 419 55 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 273 B 57 KiB MLPoisson::Fsmooth() 228 228 3062 B 55 KiB FillBoundary_nowait() 751 751 443 B 53 KiB MLCellLinOp::applyBC() 1917 1917 142 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9638 B 25 KiB Gravity::get_new_grav_vector() 18 18 3471 B 20 KiB Gravity::get_old_grav_vector() 12 12 6586 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 40 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1377 B 6304 B MLMG::prepareForSolve() 18 18 228 B 3712 B FabArray::norminf(mask) 29 29 127 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 590 B 3456 B Castro::FluxRegCrseInit 12 12 8 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 611 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (24.04-6-g771c439170bf) finalized