Initializing AMReX (v2024-26-g34a5327e2fef)... Initializing CUDA... CUDA initialized with 1 device. AMReX (v2024-26-g34a5327e2fef) initialized Starting run at 08:16:32 UTC on 2024-03-20. Successfully read inputs file ... Castro git describe: 24.03-24-gbc483ba16 AMReX git describe: v2024-26-g34a5327e2 Microphysics git describe: 24.03-17-gaa0a4ffe reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003482004 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001711628 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009255373 Gravity::multilevel_solve_for_new_phi() time = 0.052606103 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.145258458 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003776535 on level 0 Castro::do_old_sources() time = 0.008885385 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.131704031 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.006385997 Gravity::multilevel_solve_for_new_phi() time = 0.039433555 Castro::construct_new_gravity() time = 0.043474227 on level 0 Castro::do_new_sources() time = 0.007500007 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.069798861 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.226861599 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002210463 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007089493 Gravity::multilevel_solve_for_new_phi() time = 0.058970691 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003937102 on level 0 Castro::do_old_sources() time = 0.007033257 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.14638017 on level 0 Castro::construct_old_gravity() time = 0.000403791 on level 1 Castro::do_old_sources() time = 0.001666459 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.01353064 on level 1 Castro::reflux() at level 0 : time = 0.018212385 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.006932059 Gravity::multilevel_solve_for_new_phi() time = 0.040608908 Castro::construct_new_gravity() time = 0.044680268 on level 0 Castro::do_new_sources() time = 0.006404064 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000435872 on level 1 Castro::do_new_sources() time = 0.002606619 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.502627009 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.355355673 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.001836594 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.006877117 Gravity::multilevel_solve_for_new_phi() time = 0.014671702 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004094862 on level 0 Castro::do_old_sources() time = 0.007044482 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.116740174 on level 0 Castro::construct_old_gravity() time = 0.000407979 on level 1 Castro::do_old_sources() time = 0.001523753 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.010495721 on level 1 Castro::reflux() at level 0 : time = 0.019406155 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.006900838 Gravity::multilevel_solve_for_new_phi() time = 0.028223432 Castro::construct_new_gravity() time = 0.032304737 on level 0 Castro::do_new_sources() time = 0.009816306 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000433833 on level 1 Castro::do_new_sources() time = 0.002272034 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 4.07568003 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.278154235 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002961483 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.006921085 Gravity::multilevel_solve_for_new_phi() time = 0.014705415 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004100504 on level 0 Castro::do_old_sources() time = 0.008428244 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.133824931 on level 0 Castro::construct_old_gravity() time = 0.000388251 on level 1 Castro::do_old_sources() time = 0.001865354 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.012317833 on level 1 Castro::reflux() at level 0 : time = 0.01800268 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.00693958 Gravity::multilevel_solve_for_new_phi() time = 0.028347445 Castro::construct_new_gravity() time = 0.032500146 on level 0 Castro::do_new_sources() time = 0.006387159 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000433954 on level 1 Castro::do_new_sources() time = 0.002579325 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.718516351 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.304254635 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.003175495 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.006875766 Gravity::multilevel_solve_for_new_phi() time = 0.014653597 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004031908 on level 0 Castro::do_old_sources() time = 0.010388636 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.136103122 on level 0 Castro::construct_old_gravity() time = 0.000378607 on level 1 Castro::do_old_sources() time = 0.001797229 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.011032906 on level 1 Castro::reflux() at level 0 : time = 0.018849652 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.006929721 Gravity::multilevel_solve_for_new_phi() time = 0.028659289 Castro::construct_new_gravity() time = 0.033581356 on level 0 Castro::do_new_sources() time = 0.006571986 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000449718 on level 1 Castro::do_new_sources() time = 0.002110555 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.568067529 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.312252138 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.152546859 seconds Ending run at 08:16:36 UTC on 2024-03-20. Run time = 3.068716563 Run time without initialization = 1.630300772 Average number of zones advanced per microsecond: 3.035 Average number of zones advanced per microsecond per rank: 3.035 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.069 ... 3.069 ... 3.069 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0523 1.0523 1.0523 34.29% Castro::construct_ctu_hydro_source() 9 0.6793 0.6793 0.6793 22.14% VisMF::Write(FabArray) 3 0.2908 0.2908 0.2908 9.48% Castro::initMFs() 5 0.1548 0.1548 0.1548 5.04% Castro::computeTemp() 88 0.08975 0.08975 0.08975 2.92% Castro::normalize_species() 87 0.07557 0.07557 0.07557 2.46% Gravity::fill_multipole_BCs() 10 0.06917 0.06917 0.06917 2.25% MLCellLinOp::applyBC() 1917 0.04658 0.04658 0.04658 1.52% FillBoundary_nowait() 1728 0.04204 0.04204 0.04204 1.37% FabArray::setVal() 920 0.03779 0.03779 0.03779 1.23% StateData::FillBoundary(geom) 650 0.03528 0.03528 0.03528 1.15% FabArray::ParallelCopy_nowait() 954 0.02998 0.02998 0.02998 0.98% Castro::volInBoundary() 42 0.02968 0.02968 0.02968 0.97% amrex::Copy() 441 0.02652 0.02652 0.02652 0.86% Castro::enforce_min_density() 87 0.02523 0.02523 0.02523 0.82% Castro::reset_internal_energy(MultiFab) 88 0.02299 0.02299 0.02299 0.75% StateDataPhysBCFunct::() 95 0.02257 0.02257 0.02257 0.74% FluxRegister::Reflux() 24 0.02242 0.02242 0.02242 0.73% MLCellLinOp::defineAuxData() 10 0.02001 0.02001 0.02001 0.65% Castro::estTimeStep() 26 0.01914 0.01914 0.01914 0.62% amrex::Add() 136 0.01724 0.01724 0.01724 0.56% FabArray::Saxpy() 604 0.01574 0.01574 0.01574 0.51% Castro::reflux() 4 0.01346 0.01346 0.01346 0.44% BndryData::define() 26 0.01247 0.01247 0.01247 0.41% MLPoisson::Fsmooth() 1376 0.01211 0.01211 0.01211 0.39% MLCellLinOp::reflux() 30 0.0108 0.0108 0.0108 0.35% Castro::problem_post_timestep() 10 0.01048 0.01048 0.01048 0.34% Castro::construct_new_source() 63 0.01034 0.01034 0.01034 0.34% Castro::construct_old_gravity_source() 18 0.009125 0.009125 0.009125 0.30% amrex::Dot() 466 0.008836 0.008836 0.008836 0.29% FabArray::norminf() 439 0.008437 0.008437 0.008437 0.27% Castro::FluxRegCrseInit 9 0.007952 0.007952 0.007952 0.26% MLPoisson::Fapply() 493 0.006712 0.006712 0.006712 0.22% Castro::reset_internal_energy(Fab) 1476 0.006624 0.006624 0.006624 0.22% Castro::initData() 1 0.006619 0.006619 0.006619 0.22% FabArray::Xpay() 353 0.00637 0.00637 0.00637 0.21% amrex::average_down 233 0.006036 0.006036 0.006036 0.20% Castro::construct_new_gravity_source() 9 0.005823 0.005823 0.005823 0.19% AmrMesh::MakeNewGrids() 6 0.00544 0.00544 0.00544 0.18% Castro::wd_update() 6 0.004699 0.004699 0.004699 0.15% Amr::writePlotFile() 2 0.004682 0.004682 0.004682 0.15% MLMG::addInterpCorrection() 155 0.004428 0.004428 0.004428 0.14% Castro::apply_tagging_restrictions() 6 0.00402 0.00402 0.00402 0.13% Gravity::actual_solve_with_mlmg() 10 0.003975 0.003975 0.003975 0.13% FabArrayBase::CPC::define() 534 0.003745 0.003745 0.003745 0.12% FillPatchInterp(MF) 30 0.003609 0.003609 0.003609 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.00356 0.00356 0.00356 0.12% Castro::construct_old_source() 63 0.003552 0.003552 0.003552 0.12% MultiFab::contains_nan() 18 0.003256 0.003256 0.003256 0.11% FabArray::setDomainBndry() 92 0.003238 0.003238 0.003238 0.11% MLCellLinOp::compGrad() 18 0.00294 0.00294 0.00294 0.10% MLCellLinOp::defineBC() 10 0.002677 0.002677 0.002677 0.09% FabArray::mult() 55 0.002558 0.002558 0.002558 0.08% Castro::enforce_speed_limit() 87 0.002426 0.002426 0.002426 0.08% MLCellLinOp::setLevelBC() 18 0.00239 0.00239 0.00239 0.08% check_for_negative_density() 9 0.00226 0.00226 0.00226 0.07% MLCellLinOp::prepareForSolve() 10 0.001964 0.001964 0.001964 0.06% MLMG::prepareForSolve() 10 0.001867 0.001867 0.001867 0.06% Castro::fill_hybrid_hydro_source() 27 0.00166 0.00166 0.00166 0.05% Gravity::get_new_grav_vector() 10 0.001462 0.001462 0.001462 0.05% MLPoisson::FFlux() 150 0.00144 0.00144 0.00144 0.05% MLCellLinOp::updateSolBC() 25 0.00137 0.00137 0.00137 0.04% TagBoxArray::mapPRD 6 0.001325 0.001325 0.001325 0.04% FabArray::norminf(mask) 21 0.001224 0.001224 0.001224 0.04% Gravity::get_old_grav_vector() 9 0.001204 0.001204 0.001204 0.04% FabArrayBase::getCPC() 1522 0.001193 0.001193 0.001193 0.04% Castro::clean_state() 87 0.001014 0.001014 0.001014 0.03% MLCellLinOp::updateCorBC() 17 0.0009924 0.0009924 0.0009924 0.03% OwnerMask() 6 0.0009897 0.0009897 0.0009897 0.03% Castro::build_fine_mask() 44 0.0009751 0.0009751 0.0009751 0.03% average_down_faces 48 0.0008714 0.0008714 0.0008714 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.000795 0.000795 0.000795 0.03% TagBoxArray::collate() 6 0.0007631 0.0007631 0.0007631 0.02% FillPatchTwoLevels 31 0.0007595 0.0007595 0.0007595 0.02% main() 1 0.0007127 0.0007127 0.0007127 0.02% MLCGSolver::bicgstab 31 0.0006966 0.0006966 0.0006966 0.02% Castro::FluxRegFineAdd() 9 0.0006528 0.0006528 0.0006528 0.02% AmrLevel::FillPatch() 62 0.0006256 0.0006256 0.0006256 0.02% MultiFab::max() 18 0.0006143 0.0006143 0.0006143 0.02% FillPatchIterator::Initialize 62 0.0005624 0.0005624 0.0005624 0.02% MultiFab::Multiply() 8 0.0005056 0.0005056 0.0005056 0.02% Castro::apply_problem_tags() 6 0.0004605 0.0004605 0.0004605 0.02% MLCellLinOp::smooth() 688 0.0004551 0.0004551 0.0004551 0.01% FabArrayBase::FB::FB() 37 0.000441 0.000441 0.000441 0.01% Gravity::actual_multilevel_solve() 10 0.0004131 0.0004131 0.0004131 0.01% MLMG::interpCorrection_1 17 0.0003979 0.0003979 0.0003979 0.01% FabArray::FillBoundary() 1728 0.0003883 0.0003883 0.0003883 0.01% Castro::initialize_advance() 9 0.0003792 0.0003792 0.0003792 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003663 0.0003663 0.0003663 0.01% Castro::Castro() 5 0.000351 0.000351 0.000351 0.01% Amr::regrid() 5 0.0003271 0.0003271 0.0003271 0.01% FabArray::ParallelCopy() 954 0.0003232 0.0003232 0.0003232 0.01% Castro::do_new_sources() 9 0.000306 0.000306 0.000306 0.01% Castro::subcycle_advance_ctu() 5 0.0002997 0.0002997 0.0002997 0.01% FabArrayBase::getFB() 1728 0.0002974 0.0002974 0.0002974 0.01% Gravity::update_max_rhs() 10 0.0002731 0.0002731 0.0002731 0.01% Amr::coarseTimeStep() 5 0.0002694 0.0002694 0.0002694 0.01% Castro::finalize_do_advance() 9 0.000268 0.000268 0.000268 0.01% Castro::initialize_do_advance() 9 0.0002604 0.0002604 0.0002604 0.01% Castro::do_old_sources() 9 0.0002571 0.0002571 0.0002571 0.01% Castro::post_timestep() 9 0.0002503 0.0002503 0.0002503 0.01% AMRErrorTag::operator() 6 0.0002303 0.0002303 0.0002303 0.01% Castro::do_advance_ctu() 5 0.0002239 0.0002239 0.0002239 0.01% Castro::construct_old_gravity() 9 0.0002191 0.0002191 0.0002191 0.01% Castro::construct_old_rotation_source() 9 0.0002177 0.0002177 0.0002177 0.01% MLCellLinOp::apply() 493 0.0002146 0.0002146 0.0002146 0.01% Castro::construct_new_rotation_source() 9 0.0002086 0.0002086 0.0002086 0.01% MLLinOp::defineGrids() 10 0.0002061 0.0002061 0.0002061 0.01% Castro::react_state() 18 0.0001888 0.0001888 0.0001888 0.01% Castro::construct_new_gravity() 9 0.0001831 0.0001831 0.0001831 0.01% Castro::post_regrid() 10 0.0001641 0.0001641 0.0001641 0.01% StateData::define() 25 0.0001523 0.0001523 0.0001523 0.00% Castro::enforce_consistent_e() 1 0.0001446 0.0001446 0.0001446 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001395 0.0001395 0.0001395 0.00% MLCGSolver::ParallelAllReduce 745 0.0001329 0.0001329 0.0001329 0.00% Castro::computeNewDt() 8 0.000131 0.000131 0.000131 0.00% Castro::swap_state_time_levels() 9 0.0001271 0.0001271 0.0001271 0.00% Castro::finalize_advance() 9 0.0001209 0.0001209 0.0001209 0.00% MLMG::mgVcycle() 65 0.0001172 0.0001172 0.0001172 0.00% Castro::buildMetrics() 5 0.0001104 0.0001104 0.0001104 0.00% Castro::advance() 5 0.0001055 0.0001055 0.0001055 0.00% Amr::grid_places() 6 0.0001051 0.0001051 0.0001051 0.00% MLCellLinOp::correctionResidual() 189 9.891e-05 9.891e-05 9.891e-05 0.00% Castro::create_source_corrector() 9 8.401e-05 8.401e-05 8.401e-05 0.00% Amr::timeStep() 9 8.15e-05 8.15e-05 8.15e-05 0.00% AmrLevel::derive() 6 7.844e-05 7.844e-05 7.844e-05 0.00% FillPatchSingleLevel 92 5.78e-05 5.78e-05 5.78e-05 0.00% MLMG::oneIter() 31 5.577e-05 5.577e-05 5.577e-05 0.00% MLMG::solve() 10 5.374e-05 5.374e-05 5.374e-05 0.00% MLMG:computeResOfCorrection() 155 5.216e-05 5.216e-05 5.216e-05 0.00% FabArray::RecvLayoutMask() 8 5.053e-05 5.053e-05 5.053e-05 0.00% Castro::errorEst() 6 5.022e-05 5.022e-05 5.022e-05 0.00% MLCellLinOp::solutionResidual() 71 4.372e-05 4.372e-05 4.372e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.357e-05 4.357e-05 4.357e-05 0.00% MLMG::mgVcycle_bottom 65 4.192e-05 4.192e-05 4.192e-05 0.00% AmrLevel::AmrLevel(dm) 5 4.154e-05 4.154e-05 4.154e-05 0.00% MLMG::actualBottomSolve() 31 4.063e-05 4.063e-05 4.063e-05 0.00% Amr::writeSmallPlotFile() 1 3.98e-05 3.98e-05 3.98e-05 0.00% Amr::defBaseLevel() 1 3.953e-05 3.953e-05 3.953e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.868e-05 3.868e-05 3.868e-05 0.00% MLMG::mgVcycle_down::0 31 3.598e-05 3.598e-05 3.598e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.306e-05 3.306e-05 3.306e-05 0.00% MLMG::mgVcycle_down::1 31 3.241e-05 3.241e-05 3.241e-05 0.00% MLMG::mgVcycle_down::3 31 3.011e-05 3.011e-05 3.011e-05 0.00% MLMG::mgVcycle_down::2 31 2.866e-05 2.866e-05 2.866e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.773e-05 2.773e-05 2.773e-05 0.00% Gravity::solve_phi_with_mlmg() 10 2.687e-05 2.687e-05 2.687e-05 0.00% makeSFC 50 2.661e-05 2.661e-05 2.661e-05 0.00% MLMG::mgVcycle_down::4 31 2.639e-05 2.639e-05 2.639e-05 0.00% MLMG::ResNormInf() 54 2.566e-05 2.566e-05 2.566e-05 0.00% MLMG::mgVcycle_up::4 31 2.481e-05 2.481e-05 2.481e-05 0.00% MLPoisson::define() 10 2.19e-05 2.19e-05 2.19e-05 0.00% FabArrayBase::TheFPinfo() 25 2.164e-05 2.164e-05 2.164e-05 0.00% MLMG::mgVcycle_up::0 31 2.147e-05 2.147e-05 2.147e-05 0.00% DistributionMapping::Distribute() 52 2.05e-05 2.05e-05 2.05e-05 0.00% MLMG::mgVcycle_up::3 31 2.028e-05 2.028e-05 2.028e-05 0.00% FPinfo::FPinfo() 3 2.008e-05 2.008e-05 2.008e-05 0.00% MLMG::mgVcycle_up::1 31 1.985e-05 1.985e-05 1.985e-05 0.00% MLMG::mgVcycle_up::2 31 1.869e-05 1.869e-05 1.869e-05 0.00% ClusterList::intersect() 4 1.568e-05 1.568e-05 1.568e-05 0.00% Amr::FinalizeInit() 1 1.553e-05 1.553e-05 1.553e-05 0.00% MLMG::miniCycle() 34 1.499e-05 1.499e-05 1.499e-05 0.00% MLMG::computeMLResidual() 15 1.473e-05 1.473e-05 1.473e-05 0.00% MLMG::computeResidual() 31 1.437e-05 1.437e-05 1.437e-05 0.00% Amr::initSubcycle() 1 1.405e-05 1.405e-05 1.405e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.396e-05 1.396e-05 1.396e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.387e-05 1.387e-05 1.387e-05 0.00% MLLinOp::define() 10 1.286e-05 1.286e-05 1.286e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.27e-05 1.27e-05 1.27e-05 0.00% Castro::check_for_nan() 18 1.121e-05 1.121e-05 1.121e-05 0.00% Castro::apply_source_to_state() 18 9.579e-06 9.579e-06 9.579e-06 0.00% Castro::post_init() 1 9.033e-06 9.033e-06 9.033e-06 0.00% Castro::expand_state() 13 8.523e-06 8.523e-06 8.523e-06 0.00% MLPoisson::prepareForSolve() 10 8.1e-06 8.1e-06 8.1e-06 0.00% MLMG::getGradSolution() 10 8.033e-06 8.033e-06 8.033e-06 0.00% Gravity::swapTimeLevels() 9 7.848e-06 7.848e-06 7.848e-06 0.00% Castro::construct_new_hybrid_source() 9 7.338e-06 7.338e-06 7.338e-06 0.00% Castro::avgDown(state_indx) 20 7.236e-06 7.236e-06 7.236e-06 0.00% MLMG::MLResNormInf() 15 7.135e-06 7.135e-06 7.135e-06 0.00% AmrMesh-cluster 4 6.938e-06 6.938e-06 6.938e-06 0.00% amrex::average_down_w_geom 20 6.887e-06 6.887e-06 6.887e-06 0.00% Amr::InitializeInit() 1 6.198e-06 6.198e-06 6.198e-06 0.00% Castro::construct_old_hybrid_source() 9 5.962e-06 5.962e-06 5.962e-06 0.00% MLMG::MLRhsNormInf() 10 5.71e-06 5.71e-06 5.71e-06 0.00% Castro::init(old) 3 5.529e-06 5.529e-06 5.529e-06 0.00% BoxList::parallelComplementIn() 12 4.662e-06 4.662e-06 4.662e-06 0.00% BoxList::complementIn 12 4.17e-06 4.17e-06 4.17e-06 0.00% Castro::avgDown() 4 3.984e-06 3.984e-06 3.984e-06 0.00% Castro::computeInitialDt() 2 3.852e-06 3.852e-06 3.852e-06 0.00% Castro::derive() 6 3.77e-06 3.77e-06 3.77e-06 0.00% Gravity::set_mass_offset() 6 3.402e-06 3.402e-06 3.402e-06 0.00% Castro::retry_advance_ctu() 5 3.126e-06 3.126e-06 3.126e-06 0.00% Amr::bldFineLevels() 1 2.815e-06 2.815e-06 2.815e-06 0.00% Amr::init() 1 2.154e-06 2.154e-06 2.154e-06 0.00% Castro::init() 1 2.053e-06 2.053e-06 2.053e-06 0.00% ClusterList::chop() 4 1.854e-06 1.854e-06 1.854e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.694e-06 1.694e-06 1.694e-06 0.00% Amr::initialInit() 1 1.348e-06 1.348e-06 1.348e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.069 3.069 3.069 100.00% Amr::coarseTimeStep() 5 1.477 1.477 1.477 48.13% Amr::timeStep() 9 1.471 1.471 1.471 47.94% Castro::advance() 5 1.244 1.244 1.244 40.53% Castro::subcycle_advance_ctu() 5 1.209 1.209 1.209 39.41% Castro::do_advance_ctu() 5 1.209 1.209 1.209 39.40% Amr::InitAmr() 1 1.052 1.052 1.052 34.29% Castro::construct_ctu_hydro_source() 9 0.7122 0.7122 0.7122 23.21% Amr::init() 1 0.386 0.386 0.386 12.58% Gravity::multilevel_solve_for_new_phi() 10 0.321 0.321 0.321 10.46% Gravity::actual_multilevel_solve() 10 0.3202 0.3202 0.3202 10.43% Gravity::solve_phi_with_mlmg() 10 0.3169 0.3169 0.3169 10.33% Amr::writePlotFile() 2 0.2979 0.2979 0.2979 9.71% VisMF::Write(FabArray) 3 0.2908 0.2908 0.2908 9.48% Gravity::actual_solve_with_mlmg() 10 0.2452 0.2452 0.2452 7.99% Amr::initialInit() 1 0.2407 0.2407 0.2407 7.84% Castro::clean_state() 87 0.2222 0.2222 0.2222 7.24% MLMG::solve() 10 0.1936 0.1936 0.1936 6.31% Castro::construct_new_gravity() 9 0.1884 0.1884 0.1884 6.14% Amr::InitializeInit() 1 0.1686 0.1686 0.1686 5.50% Amr::defBaseLevel() 1 0.1686 0.1686 0.1686 5.50% MLMG::oneIter() 31 0.1632 0.1632 0.1632 5.32% Castro::Castro() 5 0.1588 0.1588 0.1588 5.17% Amr::regrid() 5 0.1585 0.1585 0.1585 5.17% Castro::initMFs() 5 0.1548 0.1548 0.1548 5.04% Castro::post_regrid() 10 0.1424 0.1424 0.1424 4.64% MLMG::mgVcycle() 65 0.1394 0.1394 0.1394 4.54% Castro::computeTemp() 88 0.1194 0.1194 0.1194 3.89% AmrLevel::FillPatch() 62 0.09957 0.09957 0.09957 3.24% MLCellLinOp::applyBC() 1917 0.08975 0.08975 0.08975 2.92% FillPatchIterator::Initialize 62 0.08517 0.08517 0.08517 2.78% MLCellLinOp::smooth() 688 0.07968 0.07968 0.07968 2.60% FillPatchSingleLevel 92 0.07682 0.07682 0.07682 2.50% Castro::normalize_species() 87 0.07557 0.07557 0.07557 2.46% Castro::reflux() 4 0.07451 0.07451 0.07451 2.43% FillPatchIterator::FillFromLevel0() 31 0.07423 0.07423 0.07423 2.42% Amr::FinalizeInit() 1 0.072 0.072 0.072 2.35% Gravity::fill_multipole_BCs() 10 0.07123 0.07123 0.07123 2.32% Castro::post_timestep() 9 0.06793 0.06793 0.06793 2.21% Castro::post_init() 1 0.06122 0.06122 0.06122 2.00% Castro::initialize_do_advance() 9 0.05834 0.05834 0.05834 1.90% StateDataPhysBCFunct::() 95 0.05786 0.05786 0.05786 1.89% Castro::problem_post_timestep() 10 0.05082 0.05082 0.05082 1.66% Castro::do_old_sources() 9 0.04871 0.04871 0.04871 1.59% Castro::do_new_sources() 9 0.04632 0.04632 0.04632 1.51% FabArray::FillBoundary() 1728 0.04317 0.04317 0.04317 1.41% FillBoundary_nowait() 1728 0.04278 0.04278 0.04278 1.39% Castro::expand_state() 13 0.04235 0.04235 0.04235 1.38% MLPoisson::define() 10 0.04096 0.04096 0.04096 1.33% FabArray::setVal() 920 0.03779 0.03779 0.03779 1.23% MLMG::mgVcycle_bottom 65 0.03698 0.03698 0.03698 1.21% StateData::FillBoundary(geom) 650 0.03528 0.03528 0.03528 1.15% Castro::wd_update() 6 0.03438 0.03438 0.03438 1.12% FabArray::ParallelCopy() 954 0.03433 0.03433 0.03433 1.12% Castro::initialize_advance() 9 0.03421 0.03421 0.03421 1.11% FabArray::ParallelCopy_nowait() 954 0.03401 0.03401 0.03401 1.11% MLMG::actualBottomSolve() 31 0.03003 0.03003 0.03003 0.98% MLCGSolver::bicgstab 31 0.02974 0.02974 0.02974 0.97% FluxRegister::Reflux() 24 0.0297 0.0297 0.0297 0.97% Castro::volInBoundary() 42 0.02968 0.02968 0.02968 0.97% Castro::reset_internal_energy(MultiFab) 88 0.02961 0.02961 0.02961 0.96% MLMG::mgVcycle_down::0 31 0.02885 0.02885 0.02885 0.94% MLCellLinOp::apply() 493 0.02711 0.02711 0.02711 0.88% Gravity::get_new_grav_vector() 10 0.02676 0.02676 0.02676 0.87% amrex::Copy() 441 0.02652 0.02652 0.02652 0.86% Castro::enforce_min_density() 87 0.02523 0.02523 0.02523 0.82% Castro::construct_new_source() 63 0.02338 0.02338 0.02338 0.76% MLCellLinOp::defineAuxData() 10 0.02334 0.02334 0.02334 0.76% Castro::construct_old_gravity() 9 0.02161 0.02161 0.02161 0.70% MLMG::mgVcycle_up::0 31 0.02142 0.02142 0.02142 0.70% Gravity::get_old_grav_vector() 9 0.02139 0.02139 0.02139 0.70% Castro::estTimeStep() 26 0.01914 0.01914 0.01914 0.62% MLCellLinOp::correctionResidual() 189 0.01793 0.01793 0.01793 0.58% MLCellLinOp::defineBC() 10 0.01732 0.01732 0.01732 0.56% amrex::Add() 136 0.01724 0.01724 0.01724 0.56% MLCellLinOp::reflux() 30 0.01692 0.01692 0.01692 0.55% FabArray::Saxpy() 604 0.01574 0.01574 0.01574 0.51% Amr::grid_places() 6 0.01544 0.01544 0.01544 0.50% AmrMesh::MakeNewGrids() 6 0.01533 0.01533 0.01533 0.50% BndryData::define() 26 0.0145 0.0145 0.0145 0.47% MLCellLinOp::solutionResidual() 71 0.01414 0.01414 0.01414 0.46% MLMG::computeResWithCrseSolFineCor() 17 0.01403 0.01403 0.01403 0.46% MLMG:computeResOfCorrection() 155 0.01377 0.01377 0.01377 0.45% MLMG::computeMLResidual() 15 0.01317 0.01317 0.01317 0.43% Castro::construct_old_source() 63 0.01219 0.01219 0.01219 0.40% MLPoisson::Fsmooth() 1376 0.01211 0.01211 0.01211 0.39% Castro::initData() 1 0.01162 0.01162 0.01162 0.38% MLMG::mgVcycle_down::1 31 0.01128 0.01128 0.01128 0.37% amrex::average_down 233 0.009753 0.009753 0.009753 0.32% Castro::construct_old_gravity_source() 18 0.009125 0.009125 0.009125 0.30% Castro::FluxRegCrseInit 9 0.008988 0.008988 0.008988 0.29% Castro::computeNewDt() 8 0.008917 0.008917 0.008917 0.29% amrex::Dot() 466 0.008836 0.008836 0.008836 0.29% MLMG::prepareForSolve() 10 0.00874 0.00874 0.00874 0.28% FabArray::norminf() 439 0.008437 0.008437 0.008437 0.27% MLMG::mgVcycle_up::1 31 0.008253 0.008253 0.008253 0.27% Castro::finalize_do_advance() 9 0.00786 0.00786 0.00786 0.26% Amr::bldFineLevels() 1 0.007357 0.007357 0.007357 0.24% FillPatchIterator::FillFromTwoLevels() 31 0.007319 0.007319 0.007319 0.24% FillPatchTwoLevels 31 0.007286 0.007286 0.007286 0.24% MLMG::miniCycle() 34 0.006969 0.006969 0.006969 0.23% MLMG::addInterpCorrection() 155 0.006776 0.006776 0.006776 0.22% MLPoisson::Fapply() 493 0.006712 0.006712 0.006712 0.22% MLMG::mgVcycle_down::2 31 0.006626 0.006626 0.006626 0.22% Castro::reset_internal_energy(Fab) 1476 0.006624 0.006624 0.006624 0.22% FabArray::Xpay() 353 0.00637 0.00637 0.00637 0.21% MLMG::mgVcycle_down::3 31 0.006023 0.006023 0.006023 0.20% MLMG::mgVcycle_down::4 31 0.005885 0.005885 0.005885 0.19% Castro::construct_new_gravity_source() 9 0.005823 0.005823 0.005823 0.19% MLMG::computeResidual() 31 0.005717 0.005717 0.005717 0.19% Castro::errorEst() 6 0.005692 0.005692 0.005692 0.19% MLCGSolver::ParallelAllReduce 745 0.005034 0.005034 0.005034 0.16% FabArrayBase::getCPC() 1522 0.004938 0.004938 0.004938 0.16% MLMG::mgVcycle_up::4 31 0.004768 0.004768 0.004768 0.16% MLMG::mgVcycle_up::2 31 0.004603 0.004603 0.004603 0.15% MLMG::mgVcycle_up::3 31 0.004567 0.004567 0.004567 0.15% MLMG::getGradSolution() 10 0.00431 0.00431 0.00431 0.14% MLCellLinOp::compGrad() 18 0.004302 0.004302 0.004302 0.14% Castro::apply_source_to_state() 18 0.004233 0.004233 0.004233 0.14% Castro::apply_tagging_restrictions() 6 0.00402 0.00402 0.00402 0.13% FabArrayBase::CPC::define() 534 0.003745 0.003745 0.003745 0.12% FillPatchInterp(MF) 30 0.003609 0.003609 0.003609 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.00356 0.00356 0.00356 0.12% MLMG::computeResWithCrseCorFineCor() 17 0.003452 0.003452 0.003452 0.11% MLCellLinOp::updateSolBC() 25 0.003281 0.003281 0.003281 0.11% Castro::check_for_nan() 18 0.003267 0.003267 0.003267 0.11% MultiFab::contains_nan() 18 0.003256 0.003256 0.003256 0.11% FabArray::setDomainBndry() 92 0.003238 0.003238 0.003238 0.11% TagBoxArray::mapPRD 6 0.00312 0.00312 0.00312 0.10% Castro::init(old) 3 0.003012 0.003012 0.003012 0.10% Castro::computeInitialDt() 2 0.002761 0.002761 0.002761 0.09% FabArray::mult() 55 0.002558 0.002558 0.002558 0.08% Castro::buildMetrics() 5 0.00249 0.00249 0.00249 0.08% Castro::enforce_speed_limit() 87 0.002426 0.002426 0.002426 0.08% MLCellLinOp::setLevelBC() 18 0.00239 0.00239 0.00239 0.08% check_for_negative_density() 9 0.00226 0.00226 0.00226 0.07% MLCellLinOp::updateCorBC() 17 0.002257 0.002257 0.002257 0.07% MLMG::ResNormInf() 54 0.002079 0.002079 0.002079 0.07% Gravity::update_max_rhs() 10 0.002044 0.002044 0.002044 0.07% MLPoisson::prepareForSolve() 10 0.001972 0.001972 0.001972 0.06% MLCellLinOp::prepareForSolve() 10 0.001964 0.001964 0.001964 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.001942 0.001942 0.001942 0.06% Castro::fill_hybrid_hydro_source() 27 0.00166 0.00166 0.00166 0.05% MLPoisson::FFlux() 150 0.00144 0.00144 0.00144 0.05% average_down_faces 48 0.001273 0.001273 0.001273 0.04% FabArray::norminf(mask) 21 0.001224 0.001224 0.001224 0.04% Castro::avgDown() 4 0.001177 0.001177 0.001177 0.04% Castro::avgDown(state_indx) 20 0.001173 0.001173 0.001173 0.04% amrex::average_down_w_geom 20 0.001165 0.001165 0.001165 0.04% MLMG::MLResNormInf() 15 0.001146 0.001146 0.001146 0.04% Castro::construct_new_hybrid_source() 9 0.001008 0.001008 0.001008 0.03% OwnerMask() 6 0.0009897 0.0009897 0.0009897 0.03% Castro::build_fine_mask() 44 0.0009751 0.0009751 0.0009751 0.03% MLMG::interpCorrection_1 17 0.0009504 0.0009504 0.0009504 0.03% Castro::derive() 6 0.0009306 0.0009306 0.0009306 0.03% AmrLevel::derive() 6 0.0009268 0.0009268 0.0009268 0.03% Castro::init() 1 0.0009002 0.0009002 0.0009002 0.03% AmrLevel::FillCoarsePatch() 5 0.0008981 0.0008981 0.0008981 0.03% TagBoxArray::collate() 6 0.0007631 0.0007631 0.0007631 0.02% FabArrayBase::getFB() 1728 0.0007383 0.0007383 0.0007383 0.02% Gravity::swapTimeLevels() 9 0.0006736 0.0006736 0.0006736 0.02% Castro::construct_old_hybrid_source() 9 0.0006654 0.0006654 0.0006654 0.02% Castro::FluxRegFineAdd() 9 0.0006528 0.0006528 0.0006528 0.02% MultiFab::max() 18 0.0006143 0.0006143 0.0006143 0.02% MLMG::MLRhsNormInf() 10 0.0005993 0.0005993 0.0005993 0.02% Castro::react_state() 18 0.0005338 0.0005338 0.0005338 0.02% MultiFab::Multiply() 8 0.0005056 0.0005056 0.0005056 0.02% Castro::apply_problem_tags() 6 0.0004605 0.0004605 0.0004605 0.02% FabArrayBase::FB::FB() 37 0.000441 0.000441 0.000441 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003663 0.0003663 0.0003663 0.01% MLLinOp::define() 10 0.00028 0.00028 0.00028 0.01% MLLinOp::defineGrids() 10 0.0002671 0.0002671 0.0002671 0.01% AMRErrorTag::operator() 6 0.0002303 0.0002303 0.0002303 0.01% Castro::construct_old_rotation_source() 9 0.0002177 0.0002177 0.0002177 0.01% Castro::construct_new_rotation_source() 9 0.0002086 0.0002086 0.0002086 0.01% AmrLevel::AmrLevel(dm) 5 0.0001938 0.0001938 0.0001938 0.01% StateData::define() 25 0.0001523 0.0001523 0.0001523 0.00% Castro::enforce_consistent_e() 1 0.0001446 0.0001446 0.0001446 0.00% Castro::swap_state_time_levels() 9 0.0001271 0.0001271 0.0001271 0.00% Castro::finalize_advance() 9 0.0001209 0.0001209 0.0001209 0.00% Castro::create_source_corrector() 9 8.401e-05 8.401e-05 8.401e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 5.936e-05 5.936e-05 5.936e-05 0.00% FabArray::RecvLayoutMask() 8 5.053e-05 5.053e-05 5.053e-05 0.00% makeSFC 50 4.54e-05 4.54e-05 4.54e-05 0.00% FabArrayBase::TheFPinfo() 25 4.172e-05 4.172e-05 4.172e-05 0.00% Amr::writeSmallPlotFile() 1 3.98e-05 3.98e-05 3.98e-05 0.00% AmrMesh-cluster 4 2.447e-05 2.447e-05 2.447e-05 0.00% DistributionMapping::Distribute() 52 2.05e-05 2.05e-05 2.05e-05 0.00% FPinfo::FPinfo() 3 2.008e-05 2.008e-05 2.008e-05 0.00% ClusterList::intersect() 4 1.568e-05 1.568e-05 1.568e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.441e-05 1.441e-05 1.441e-05 0.00% Amr::initSubcycle() 1 1.405e-05 1.405e-05 1.405e-05 0.00% BoxList::parallelComplementIn() 12 8.832e-06 8.832e-06 8.832e-06 0.00% BoxList::complementIn 12 4.17e-06 4.17e-06 4.17e-06 0.00% Gravity::set_mass_offset() 6 3.402e-06 3.402e-06 3.402e-06 0.00% Castro::retry_advance_ctu() 5 3.126e-06 3.126e-06 3.126e-06 0.00% ClusterList::chop() 4 1.854e-06 1.854e-06 1.854e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.694e-06 1.694e-06 1.694e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1566 KiB 9037 MiB Castro::reflux() 436 436 13 MiB 666 MiB Castro::initMFs() 258 258 345 MiB 576 MiB Castro::swap_state_time_levels() 175 175 177 MiB 340 MiB StateData::define() 175 175 218 MiB 340 MiB Castro::initialize_do_advance() 143 143 120 MiB 325 MiB FillPatchIterator::Initialize 899 899 4294 KiB 303 MiB Amr::writePlotFile() 56 56 17 MiB 189 MiB Castro::problem_post_timestep() 162 162 792 KiB 167 MiB Castro::FluxRegCrseInit 660 660 458 KiB 167 MiB FluxRegister::Reflux() 648 648 1571 KiB 160 MiB Castro::initialize_advance() 143 143 48 MiB 121 MiB Castro::construct_new_source() 143 143 189 KiB 67 MiB Castro::construct_old_source() 143 143 123 KiB 67 MiB Castro::buildMetrics() 140 140 37 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 27 MiB 60 MiB Castro::Castro() 210 210 4070 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2715 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 230 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 287 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 890 KiB 16 MiB FillPatchTwoLevels 300 300 7674 B 11 MiB FillPatchInterp(MF) 330 330 4729 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 129 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4568 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 758 KiB 7424 KiB Castro::build_fine_mask() 224 224 1275 KiB 6912 KiB AmrLevel::derive() 162 162 2614 B 6912 KiB BndryData::define() 3624 3624 283 KiB 4243 KiB MLCellLinOp::reflux() 450 450 6027 B 2376 KiB Castro::wd_update() 6 6 24 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 419 B 2095 KiB amrex::average_down 1483 1483 2357 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 5258 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 796 B 867 KiB MLCellLinOp::defineBC() 276 276 3863 B 689 KiB Castro::estTimeStep() 26 26 2769 B 480 KiB VisMF::Write(FabArray) 1568 1568 2323 B 320 KiB Castro::normalize_species() 87 87 7873 B 320 KiB Castro::volInBoundary() 70 70 3137 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 126 B 204 KiB FabArray::norminf(mask) 29 29 189 B 163 KiB amrex::Dot() 559 559 427 B 160 KiB FabArray::norminf() 470 470 424 B 160 KiB MultiFab::max() 18 18 31 B 160 KiB check_for_negative_density() 9 9 118 B 160 KiB Castro::initData() 1 1 45 B 160 KiB FabArray::setVal() 419 419 54 KiB 120 KiB MLMG::interpCorrection_1 34 34 27 B 91 KiB average_down_faces 99 99 636 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 282 B 57 KiB MLPoisson::Fsmooth() 228 228 3094 B 55 KiB FillBoundary_nowait() 751 751 453 B 53 KiB TagBoxArray::mapPRD 324 324 41 B 45 KiB OwnerMask() 168 168 12 B 38 KiB MLCellLinOp::applyBC() 3834 3834 144 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9457 B 25 KiB MultiFab::contains_nan() 18 18 21 B 20 KiB StateData::FillBoundary(geom) 2538 2538 60 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 636 B 3456 B MLCGSolver::bicgstab 155 155 25 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 162 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 11 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 604 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1260 B 278 KiB FabArray::setVal() 419 419 54 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 282 B 57 KiB MLPoisson::Fsmooth() 228 228 3094 B 55 KiB FillBoundary_nowait() 751 751 453 B 53 KiB MLCellLinOp::applyBC() 1917 1917 144 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9457 B 25 KiB Gravity::get_new_grav_vector() 18 18 3379 B 20 KiB Gravity::get_old_grav_vector() 12 12 6230 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 60 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1332 B 6304 B MLMG::prepareForSolve() 18 18 231 B 3712 B FabArray::norminf(mask) 29 29 129 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 636 B 3456 B Castro::FluxRegCrseInit 12 12 9 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 609 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (v2024-26-g34a5327e2fef) finalized