Initializing AMReX (v2024-35-gb892132f6144)... Initializing CUDA... CUDA initialized with 1 device. AMReX (v2024-35-gb892132f6144) initialized Starting run at 08:37:22 UTC on 2024-03-27. Successfully read inputs file ... Castro git describe: 24.03-31-g760ecc416 AMReX git describe: v2024-35-gb892132f6 Microphysics git describe: 24.03-22-gf47a7fcc reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003314148 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001837685 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009331727 Gravity::multilevel_solve_for_new_phi() time = 0.052488324 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.142496315 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.00469115 on level 0 Castro::do_old_sources() time = 0.009328304 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.133063876 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.006808047 Gravity::multilevel_solve_for_new_phi() time = 0.039983478 Castro::construct_new_gravity() time = 0.044919349 on level 0 Castro::do_new_sources() time = 0.007843871 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.982482884 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.231606564 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002406895 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007402889 Gravity::multilevel_solve_for_new_phi() time = 0.059698654 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004816722 on level 0 Castro::do_old_sources() time = 0.007022195 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.164415796 on level 0 Castro::construct_old_gravity() time = 0.000361355 on level 1 Castro::do_old_sources() time = 0.002169324 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007795829 on level 1 Castro::reflux() at level 0 : time = 0.018282531 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007244743 Gravity::multilevel_solve_for_new_phi() time = 0.041928331 Castro::construct_new_gravity() time = 0.046895936 on level 0 Castro::do_new_sources() time = 0.006525255 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000427672 on level 1 Castro::do_new_sources() time = 0.002447068 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.301647631 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.371541582 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.002390012 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007223883 Gravity::multilevel_solve_for_new_phi() time = 0.015234561 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004781621 on level 0 Castro::do_old_sources() time = 0.007116577 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.176446791 on level 0 Castro::construct_old_gravity() time = 0.0003855 on level 1 Castro::do_old_sources() time = 0.001620513 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007986456 on level 1 Castro::reflux() at level 0 : time = 0.018160408 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007309947 Gravity::multilevel_solve_for_new_phi() time = 0.029429435 Castro::construct_new_gravity() time = 0.03480209 on level 0 Castro::do_new_sources() time = 0.006659574 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000435065 on level 1 Castro::do_new_sources() time = 0.002477655 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.304571505 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.329677096 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002318979 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007194035 Gravity::multilevel_solve_for_new_phi() time = 0.015026038 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004622497 on level 0 Castro::do_old_sources() time = 0.007009918 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.152447398 on level 0 Castro::construct_old_gravity() time = 0.000322658 on level 1 Castro::do_old_sources() time = 0.001805853 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.013182556 on level 1 Castro::reflux() at level 0 : time = 0.017871445 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007231252 Gravity::multilevel_solve_for_new_phi() time = 0.036327618 Castro::construct_new_gravity() time = 0.041146901 on level 0 Castro::do_new_sources() time = 0.006543806 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000390362 on level 1 Castro::do_new_sources() time = 0.002465648 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.492917116 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.311218897 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002355286 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007243457 Gravity::multilevel_solve_for_new_phi() time = 0.015250428 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004612121 on level 0 Castro::do_old_sources() time = 0.007191455 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.132704172 on level 0 Castro::construct_old_gravity() time = 0.000333141 on level 1 Castro::do_old_sources() time = 0.001490819 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.01097148 on level 1 Castro::reflux() at level 0 : time = 0.019577961 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007227219 Gravity::multilevel_solve_for_new_phi() time = 0.029076694 Castro::construct_new_gravity() time = 0.033843974 on level 0 Castro::do_new_sources() time = 0.010027001 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000414323 on level 1 Castro::do_new_sources() time = 0.002261939 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.780301348 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.292794123 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.152713316 seconds Ending run at 08:37:26 UTC on 2024-03-27. Run time = 3.114882662 Run time without initialization = 1.690388658 Average number of zones advanced per microsecond: 2.927 Average number of zones advanced per microsecond per rank: 2.927 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.115 ... 3.115 ... 3.115 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0416 1.0416 1.0416 33.44% Castro::construct_ctu_hydro_source() 9 0.764 0.764 0.764 24.53% VisMF::Write(FabArray) 3 0.2885 0.2885 0.2885 9.26% Castro::initMFs() 5 0.1527 0.1527 0.1527 4.90% Gravity::fill_multipole_BCs() 10 0.07229 0.07229 0.07229 2.32% Castro::normalize_species() 87 0.06637 0.06637 0.06637 2.13% Castro::computeTemp() 88 0.06257 0.06257 0.06257 2.01% MLCellLinOp::applyBC() 1917 0.04693 0.04693 0.04693 1.51% FillBoundary_nowait() 1728 0.04269 0.04269 0.04269 1.37% StateDataPhysBCFunct::() 95 0.03916 0.03916 0.03916 1.26% FabArray::setVal() 920 0.03772 0.03772 0.03772 1.21% StateData::FillBoundary(geom) 650 0.0311 0.0311 0.0311 1.00% FabArray::ParallelCopy_nowait() 954 0.03035 0.03035 0.03035 0.97% Castro::volInBoundary() 42 0.02982 0.02982 0.02982 0.96% MLCellLinOp::defineAuxData() 10 0.02788 0.02788 0.02788 0.90% amrex::Copy() 441 0.0265 0.0265 0.0265 0.85% Castro::reset_internal_energy(MultiFab) 88 0.02323 0.02323 0.02323 0.75% FluxRegister::Reflux() 24 0.02245 0.02245 0.02245 0.72% amrex::Add() 136 0.01723 0.01723 0.01723 0.55% Castro::estTimeStep() 26 0.01659 0.01659 0.01659 0.53% FabArray::Saxpy() 604 0.01579 0.01579 0.01579 0.51% Castro::construct_new_source() 63 0.01421 0.01421 0.01421 0.46% Castro::enforce_min_density() 87 0.01364 0.01364 0.01364 0.44% BndryData::define() 26 0.01273 0.01273 0.01273 0.41% MLPoisson::Fsmooth() 1376 0.01226 0.01226 0.01226 0.39% Castro::reflux() 4 0.01206 0.01206 0.01206 0.39% MLCellLinOp::reflux() 30 0.01147 0.01147 0.01147 0.37% Castro::problem_post_timestep() 10 0.01031 0.01031 0.01031 0.33% amrex::Dot() 466 0.008871 0.008871 0.008871 0.28% FabArray::norminf() 439 0.008499 0.008499 0.008499 0.27% Castro::construct_old_gravity_source() 18 0.008329 0.008329 0.008329 0.27% Castro::FluxRegCrseInit 9 0.007998 0.007998 0.007998 0.26% MLPoisson::Fapply() 493 0.006716 0.006716 0.006716 0.22% Castro::initData() 1 0.006678 0.006678 0.006678 0.21% AmrMesh::MakeNewGrids() 6 0.006535 0.006535 0.006535 0.21% FabArray::Xpay() 353 0.006383 0.006383 0.006383 0.20% amrex::average_down 233 0.006045 0.006045 0.006045 0.19% Castro::construct_new_gravity_source() 9 0.005274 0.005274 0.005274 0.17% Castro::wd_update() 6 0.004638 0.004638 0.004638 0.15% Castro::construct_old_source() 63 0.004515 0.004515 0.004515 0.14% MLMG::addInterpCorrection() 155 0.004443 0.004443 0.004443 0.14% Amr::writePlotFile() 2 0.004432 0.004432 0.004432 0.14% Castro::reset_internal_energy(Fab) 1476 0.004177 0.004177 0.004177 0.13% Gravity::actual_solve_with_mlmg() 10 0.003882 0.003882 0.003882 0.12% FabArrayBase::CPC::define() 534 0.003831 0.003831 0.003831 0.12% Castro::enforce_speed_limit() 87 0.003739 0.003739 0.003739 0.12% FillPatchInterp(MF) 30 0.003666 0.003666 0.003666 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003585 0.003585 0.003585 0.12% check_for_negative_density() 9 0.00331 0.00331 0.00331 0.11% FabArray::setDomainBndry() 92 0.003288 0.003288 0.003288 0.11% MultiFab::contains_nan() 18 0.003236 0.003236 0.003236 0.10% MLCellLinOp::compGrad() 18 0.002895 0.002895 0.002895 0.09% MLCellLinOp::defineBC() 10 0.002733 0.002733 0.002733 0.09% FabArray::mult() 55 0.002585 0.002585 0.002585 0.08% MLCellLinOp::setLevelBC() 18 0.002443 0.002443 0.002443 0.08% Castro::apply_tagging_restrictions() 6 0.00209 0.00209 0.00209 0.07% MLCellLinOp::prepareForSolve() 10 0.00203 0.00203 0.00203 0.07% MLMG::prepareForSolve() 10 0.00192 0.00192 0.00192 0.06% Castro::fill_hybrid_hydro_source() 27 0.001871 0.001871 0.001871 0.06% MLPoisson::FFlux() 150 0.001475 0.001475 0.001475 0.05% MLCellLinOp::updateSolBC() 25 0.001392 0.001392 0.001392 0.04% TagBoxArray::mapPRD 6 0.001332 0.001332 0.001332 0.04% Gravity::get_new_grav_vector() 10 0.001226 0.001226 0.001226 0.04% FabArray::norminf(mask) 21 0.001223 0.001223 0.001223 0.04% FabArrayBase::getCPC() 1522 0.00121 0.00121 0.00121 0.04% MLCellLinOp::updateCorBC() 17 0.001029 0.001029 0.001029 0.03% OwnerMask() 6 0.001011 0.001011 0.001011 0.03% Castro::build_fine_mask() 44 0.0009733 0.0009733 0.0009733 0.03% Gravity::get_old_grav_vector() 9 0.0009662 0.0009662 0.0009662 0.03% average_down_faces 48 0.0008769 0.0008769 0.0008769 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.00087 0.00087 0.00087 0.03% Castro::create_source_corrector() 9 0.0008087 0.0008087 0.0008087 0.03% FillPatchTwoLevels 31 0.000792 0.000792 0.000792 0.03% TagBoxArray::collate() 6 0.0007663 0.0007663 0.0007663 0.02% Castro::post_timestep() 9 0.0007208 0.0007208 0.0007208 0.02% MLCGSolver::bicgstab 31 0.000711 0.000711 0.000711 0.02% Castro::FluxRegFineAdd() 9 0.0006886 0.0006886 0.0006886 0.02% AmrLevel::FillPatch() 62 0.0006789 0.0006789 0.0006789 0.02% main() 1 0.0006716 0.0006716 0.0006716 0.02% MultiFab::max() 18 0.000617 0.000617 0.000617 0.02% FillPatchIterator::Initialize 62 0.0005854 0.0005854 0.0005854 0.02% MultiFab::Multiply() 8 0.0005042 0.0005042 0.0005042 0.02% Castro::apply_problem_tags() 6 0.0004899 0.0004899 0.0004899 0.02% MLCellLinOp::smooth() 688 0.0004897 0.0004897 0.0004897 0.02% FabArrayBase::FB::FB() 37 0.0004441 0.0004441 0.0004441 0.01% Castro::Castro() 5 0.0004225 0.0004225 0.0004225 0.01% MLMG::interpCorrection_1 17 0.0004118 0.0004118 0.0004118 0.01% FabArray::FillBoundary() 1728 0.0004104 0.0004104 0.0004104 0.01% Castro::clean_state() 87 0.0003915 0.0003915 0.0003915 0.01% Amr::regrid() 5 0.0003814 0.0003814 0.0003814 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003708 0.0003708 0.0003708 0.01% FabArray::ParallelCopy() 954 0.000332 0.000332 0.000332 0.01% FabArrayBase::getFB() 1728 0.0003123 0.0003123 0.0003123 0.01% Gravity::actual_multilevel_solve() 10 0.000267 0.000267 0.000267 0.01% Castro::initialize_do_advance() 9 0.0002557 0.0002557 0.0002557 0.01% Gravity::update_max_rhs() 10 0.0002533 0.0002533 0.0002533 0.01% MLLinOp::defineGrids() 10 0.0002453 0.0002453 0.0002453 0.01% Castro::construct_new_rotation_source() 9 0.0002374 0.0002374 0.0002374 0.01% AMRErrorTag::operator() 6 0.0002353 0.0002353 0.0002353 0.01% Castro::subcycle_advance_ctu() 5 0.0002348 0.0002348 0.0002348 0.01% Amr::coarseTimeStep() 5 0.0002262 0.0002262 0.0002262 0.01% MLCellLinOp::apply() 493 0.0002195 0.0002195 0.0002195 0.01% Castro::do_new_sources() 9 0.000214 0.000214 0.000214 0.01% Castro::construct_old_rotation_source() 9 0.0002063 0.0002063 0.0002063 0.01% Castro::finalize_do_advance() 9 0.0001653 0.0001653 0.0001653 0.01% Castro::do_advance_ctu() 5 0.000162 0.000162 0.000162 0.01% StateData::define() 25 0.0001541 0.0001541 0.0001541 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001474 0.0001474 0.0001474 0.00% Castro::enforce_consistent_e() 1 0.0001469 0.0001469 0.0001469 0.00% MLCGSolver::ParallelAllReduce 745 0.0001371 0.0001371 0.0001371 0.00% Castro::construct_new_gravity() 9 0.0001294 0.0001294 0.0001294 0.00% Castro::initialize_advance() 9 0.0001287 0.0001287 0.0001287 0.00% Castro::swap_state_time_levels() 9 0.0001283 0.0001283 0.0001283 0.00% Castro::advance() 5 0.0001177 0.0001177 0.0001177 0.00% Amr::grid_places() 6 0.0001077 0.0001077 0.0001077 0.00% MLCellLinOp::correctionResidual() 189 0.0001059 0.0001059 0.0001059 0.00% MLMG::mgVcycle() 65 0.0001038 0.0001038 0.0001038 0.00% Castro::finalize_advance() 9 0.0001028 0.0001028 0.0001028 0.00% Castro::buildMetrics() 5 0.0001026 0.0001026 0.0001026 0.00% Castro::do_old_sources() 9 0.0001025 0.0001025 0.0001025 0.00% Castro::construct_old_gravity() 9 9.802e-05 9.802e-05 9.802e-05 0.00% AmrLevel::derive() 6 8.844e-05 8.844e-05 8.844e-05 0.00% Amr::timeStep() 9 8.268e-05 8.268e-05 8.268e-05 0.00% FillPatchSingleLevel 92 5.955e-05 5.955e-05 5.955e-05 0.00% MLMG::oneIter() 31 5.701e-05 5.701e-05 5.701e-05 0.00% MLMG::solve() 10 5.7e-05 5.7e-05 5.7e-05 0.00% MLMG:computeResOfCorrection() 155 5.158e-05 5.158e-05 5.158e-05 0.00% Castro::errorEst() 6 5.039e-05 5.039e-05 5.039e-05 0.00% FabArray::RecvLayoutMask() 8 5.036e-05 5.036e-05 5.036e-05 0.00% MLCellLinOp::solutionResidual() 71 4.767e-05 4.767e-05 4.767e-05 0.00% AmrLevel::AmrLevel(dm) 5 4.51e-05 4.51e-05 4.51e-05 0.00% Castro::post_regrid() 10 4.486e-05 4.486e-05 4.486e-05 0.00% MLMG::mgVcycle_bottom 65 4.39e-05 4.39e-05 4.39e-05 0.00% MLMG::actualBottomSolve() 31 4.101e-05 4.101e-05 4.101e-05 0.00% Amr::defBaseLevel() 1 4.097e-05 4.097e-05 4.097e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.012e-05 4.012e-05 4.012e-05 0.00% FillPatchIterator::FillFromLevel0() 31 4.003e-05 4.003e-05 4.003e-05 0.00% Amr::writeSmallPlotFile() 1 3.876e-05 3.876e-05 3.876e-05 0.00% Castro::react_state() 18 3.708e-05 3.708e-05 3.708e-05 0.00% MLMG::mgVcycle_down::0 31 3.584e-05 3.584e-05 3.584e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.446e-05 3.446e-05 3.446e-05 0.00% MLMG::mgVcycle_down::1 31 3.278e-05 3.278e-05 3.278e-05 0.00% MLMG::mgVcycle_down::3 31 3.099e-05 3.099e-05 3.099e-05 0.00% MLMG::mgVcycle_down::2 31 3.056e-05 3.056e-05 3.056e-05 0.00% Gravity::solve_phi_with_mlmg() 10 3.006e-05 3.006e-05 3.006e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.91e-05 2.91e-05 2.91e-05 0.00% makeSFC 50 2.847e-05 2.847e-05 2.847e-05 0.00% MLMG::mgVcycle_down::4 31 2.693e-05 2.693e-05 2.693e-05 0.00% Castro::computeNewDt() 8 2.641e-05 2.641e-05 2.641e-05 0.00% MLMG::ResNormInf() 54 2.602e-05 2.602e-05 2.602e-05 0.00% MLMG::mgVcycle_up::4 31 2.476e-05 2.476e-05 2.476e-05 0.00% FabArrayBase::TheFPinfo() 25 2.46e-05 2.46e-05 2.46e-05 0.00% FPinfo::FPinfo() 3 2.325e-05 2.325e-05 2.325e-05 0.00% MLPoisson::define() 10 2.243e-05 2.243e-05 2.243e-05 0.00% MLMG::mgVcycle_up::0 31 2.178e-05 2.178e-05 2.178e-05 0.00% DistributionMapping::Distribute() 52 2.117e-05 2.117e-05 2.117e-05 0.00% MLMG::mgVcycle_up::3 31 2.07e-05 2.07e-05 2.07e-05 0.00% MLMG::mgVcycle_up::1 31 1.98e-05 1.98e-05 1.98e-05 0.00% MLMG::mgVcycle_up::2 31 1.885e-05 1.885e-05 1.885e-05 0.00% MLMG::computeMLResidual() 15 1.707e-05 1.707e-05 1.707e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.547e-05 1.547e-05 1.547e-05 0.00% MLMG::miniCycle() 34 1.45e-05 1.45e-05 1.45e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.427e-05 1.427e-05 1.427e-05 0.00% MLMG::computeResidual() 31 1.392e-05 1.392e-05 1.392e-05 0.00% Amr::initSubcycle() 1 1.335e-05 1.335e-05 1.335e-05 0.00% Amr::FinalizeInit() 1 1.321e-05 1.321e-05 1.321e-05 0.00% ClusterList::intersect() 4 1.316e-05 1.316e-05 1.316e-05 0.00% MLLinOp::define() 10 1.302e-05 1.302e-05 1.302e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.227e-05 1.227e-05 1.227e-05 0.00% Castro::check_for_nan() 18 1.18e-05 1.18e-05 1.18e-05 0.00% Castro::apply_source_to_state() 18 1.053e-05 1.053e-05 1.053e-05 0.00% MLPoisson::prepareForSolve() 10 9.174e-06 9.174e-06 9.174e-06 0.00% Castro::construct_new_hybrid_source() 9 9.064e-06 9.064e-06 9.064e-06 0.00% Castro::expand_state() 13 8.741e-06 8.741e-06 8.741e-06 0.00% MLMG::getGradSolution() 10 8.424e-06 8.424e-06 8.424e-06 0.00% Castro::avgDown(state_indx) 20 8.003e-06 8.003e-06 8.003e-06 0.00% amrex::average_down_w_geom 20 7.896e-06 7.896e-06 7.896e-06 0.00% AmrMesh-cluster 4 7.807e-06 7.807e-06 7.807e-06 0.00% MLMG::MLResNormInf() 15 7.714e-06 7.714e-06 7.714e-06 0.00% Gravity::swapTimeLevels() 9 7.626e-06 7.626e-06 7.626e-06 0.00% Castro::construct_old_hybrid_source() 9 7.124e-06 7.124e-06 7.124e-06 0.00% Amr::InitializeInit() 1 7.052e-06 7.052e-06 7.052e-06 0.00% Castro::init(old) 3 6.187e-06 6.187e-06 6.187e-06 0.00% MLMG::MLRhsNormInf() 10 5.446e-06 5.446e-06 5.446e-06 0.00% Castro::post_init() 1 4.883e-06 4.883e-06 4.883e-06 0.00% BoxList::parallelComplementIn() 12 4.775e-06 4.775e-06 4.775e-06 0.00% Gravity::set_mass_offset() 6 4.612e-06 4.612e-06 4.612e-06 0.00% Castro::avgDown() 4 4.499e-06 4.499e-06 4.499e-06 0.00% Castro::derive() 6 4.329e-06 4.329e-06 4.329e-06 0.00% BoxList::complementIn 12 3.906e-06 3.906e-06 3.906e-06 0.00% Castro::retry_advance_ctu() 5 3.216e-06 3.216e-06 3.216e-06 0.00% Castro::computeInitialDt() 2 3.076e-06 3.076e-06 3.076e-06 0.00% Amr::bldFineLevels() 1 2.679e-06 2.679e-06 2.679e-06 0.00% Castro::init() 1 2.075e-06 2.075e-06 2.075e-06 0.00% ClusterList::chop() 4 2.053e-06 2.053e-06 2.053e-06 0.00% Amr::init() 1 1.969e-06 1.969e-06 1.969e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.823e-06 1.823e-06 1.823e-06 0.00% Amr::initialInit() 1 1.526e-06 1.526e-06 1.526e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.115 3.115 3.115 100.00% Amr::coarseTimeStep() 5 1.537 1.537 1.537 49.35% Amr::timeStep() 9 1.532 1.532 1.532 49.18% Castro::advance() 5 1.321 1.321 1.321 42.41% Castro::subcycle_advance_ctu() 5 1.3 1.3 1.3 41.73% Castro::do_advance_ctu() 5 1.3 1.3 1.3 41.72% Amr::InitAmr() 1 1.042 1.042 1.042 33.44% Castro::construct_ctu_hydro_source() 9 0.7991 0.7991 0.7991 25.65% Amr::init() 1 0.3827 0.3827 0.3827 12.29% Gravity::multilevel_solve_for_new_phi() 10 0.3346 0.3346 0.3346 10.74% Gravity::actual_multilevel_solve() 10 0.3338 0.3338 0.3338 10.71% Gravity::solve_phi_with_mlmg() 10 0.3306 0.3306 0.3306 10.61% Amr::writePlotFile() 2 0.2953 0.2953 0.2953 9.48% VisMF::Write(FabArray) 3 0.2885 0.2885 0.2885 9.26% Gravity::actual_solve_with_mlmg() 10 0.2557 0.2557 0.2557 8.21% Amr::initialInit() 1 0.2401 0.2401 0.2401 7.71% Castro::construct_new_gravity() 9 0.2034 0.2034 0.2034 6.53% MLMG::solve() 10 0.1958 0.1958 0.1958 6.29% Castro::clean_state() 87 0.1728 0.1728 0.1728 5.55% Amr::InitializeInit() 1 0.1667 0.1667 0.1667 5.35% Amr::defBaseLevel() 1 0.1667 0.1667 0.1667 5.35% MLMG::oneIter() 31 0.1648 0.1648 0.1648 5.29% Castro::Castro() 5 0.1567 0.1567 0.1567 5.03% Castro::initMFs() 5 0.1527 0.1527 0.1527 4.90% Amr::regrid() 5 0.1451 0.1451 0.1451 4.66% MLMG::mgVcycle() 65 0.1403 0.1403 0.1403 4.50% Castro::post_regrid() 10 0.1296 0.1296 0.1296 4.16% AmrLevel::FillPatch() 62 0.1126 0.1126 0.1126 3.62% FillPatchIterator::Initialize 62 0.09814 0.09814 0.09814 3.15% MLCellLinOp::applyBC() 1917 0.09078 0.09078 0.09078 2.91% Castro::computeTemp() 88 0.08997 0.08997 0.08997 2.89% FillPatchSingleLevel 92 0.08959 0.08959 0.08959 2.88% FillPatchIterator::FillFromLevel0() 31 0.08687 0.08687 0.08687 2.79% MLCellLinOp::smooth() 688 0.08035 0.08035 0.08035 2.58% Gravity::fill_multipole_BCs() 10 0.07434 0.07434 0.07434 2.39% Castro::reflux() 4 0.07393 0.07393 0.07393 2.37% Amr::FinalizeInit() 1 0.07339 0.07339 0.07339 2.36% StateDataPhysBCFunct::() 95 0.07026 0.07026 0.07026 2.26% Castro::normalize_species() 87 0.06637 0.06637 0.06637 2.13% Castro::post_timestep() 9 0.06585 0.06585 0.06585 2.11% Castro::post_init() 1 0.06261 0.06261 0.06261 2.01% Castro::initialize_do_advance() 9 0.05564 0.05564 0.05564 1.79% Castro::problem_post_timestep() 10 0.0503 0.0503 0.0503 1.61% MLPoisson::define() 10 0.04924 0.04924 0.04924 1.58% Castro::do_new_sources() 9 0.04733 0.04733 0.04733 1.52% Castro::expand_state() 13 0.04519 0.04519 0.04519 1.45% Castro::do_old_sources() 9 0.04484 0.04484 0.04484 1.44% FabArray::FillBoundary() 1728 0.04385 0.04385 0.04385 1.41% FillBoundary_nowait() 1728 0.04344 0.04344 0.04344 1.39% FabArray::setVal() 920 0.03772 0.03772 0.03772 1.21% MLMG::mgVcycle_bottom 65 0.03726 0.03726 0.03726 1.20% FabArray::ParallelCopy() 954 0.0348 0.0348 0.0348 1.12% FabArray::ParallelCopy_nowait() 954 0.03447 0.03447 0.03447 1.11% Castro::wd_update() 6 0.03447 0.03447 0.03447 1.11% Gravity::get_new_grav_vector() 10 0.03172 0.03172 0.03172 1.02% MLCellLinOp::defineAuxData() 10 0.03124 0.03124 0.03124 1.00% StateData::FillBoundary(geom) 650 0.0311 0.0311 0.0311 1.00% MLMG::actualBottomSolve() 31 0.03026 0.03026 0.03026 0.97% MLCGSolver::bicgstab 31 0.02997 0.02997 0.02997 0.96% Castro::volInBoundary() 42 0.02983 0.02983 0.02983 0.96% FluxRegister::Reflux() 24 0.02972 0.02972 0.02972 0.95% MLMG::mgVcycle_down::0 31 0.02888 0.02888 0.02888 0.93% MLCellLinOp::apply() 493 0.02757 0.02757 0.02757 0.88% Castro::reset_internal_energy(MultiFab) 88 0.0274 0.0274 0.0274 0.88% Castro::construct_new_source() 63 0.027 0.027 0.027 0.87% amrex::Copy() 441 0.0265 0.0265 0.0265 0.85% Castro::construct_old_gravity() 9 0.02502 0.02502 0.02502 0.80% Gravity::get_old_grav_vector() 9 0.02492 0.02492 0.02492 0.80% MLMG::mgVcycle_up::0 31 0.02158 0.02158 0.02158 0.69% Castro::initialize_advance() 9 0.02095 0.02095 0.02095 0.67% MLCellLinOp::correctionResidual() 189 0.01806 0.01806 0.01806 0.58% MLCellLinOp::defineBC() 10 0.01765 0.01765 0.01765 0.57% MLCellLinOp::reflux() 30 0.01761 0.01761 0.01761 0.57% amrex::Add() 136 0.01723 0.01723 0.01723 0.55% Castro::estTimeStep() 26 0.01659 0.01659 0.01659 0.53% FabArray::Saxpy() 604 0.01579 0.01579 0.01579 0.51% BndryData::define() 26 0.01478 0.01478 0.01478 0.47% Amr::grid_places() 6 0.01468 0.01468 0.01468 0.47% MLMG::computeResWithCrseSolFineCor() 17 0.01459 0.01459 0.01459 0.47% AmrMesh::MakeNewGrids() 6 0.01458 0.01458 0.01458 0.47% MLCellLinOp::solutionResidual() 71 0.01456 0.01456 0.01456 0.47% MLMG:computeResOfCorrection() 155 0.01383 0.01383 0.01383 0.44% Castro::enforce_min_density() 87 0.01364 0.01364 0.01364 0.44% MLMG::computeMLResidual() 15 0.01357 0.01357 0.01357 0.44% Castro::construct_old_source() 63 0.01275 0.01275 0.01275 0.41% MLPoisson::Fsmooth() 1376 0.01226 0.01226 0.01226 0.39% Castro::initData() 1 0.01162 0.01162 0.01162 0.37% MLMG::mgVcycle_down::1 31 0.0114 0.0114 0.0114 0.37% amrex::average_down 233 0.009751 0.009751 0.009751 0.31% Castro::FluxRegCrseInit 9 0.009064 0.009064 0.009064 0.29% MLMG::prepareForSolve() 10 0.0089 0.0089 0.0089 0.29% amrex::Dot() 466 0.008871 0.008871 0.008871 0.28% FabArray::norminf() 439 0.008499 0.008499 0.008499 0.27% MLMG::mgVcycle_up::1 31 0.008375 0.008375 0.008375 0.27% Castro::construct_old_gravity_source() 18 0.008329 0.008329 0.008329 0.27% FillPatchIterator::FillFromTwoLevels() 31 0.007578 0.007578 0.007578 0.24% FillPatchTwoLevels 31 0.007543 0.007543 0.007543 0.24% Castro::computeNewDt() 8 0.007427 0.007427 0.007427 0.24% Amr::bldFineLevels() 1 0.007348 0.007348 0.007348 0.24% MLMG::miniCycle() 34 0.007014 0.007014 0.007014 0.23% MLMG::addInterpCorrection() 155 0.006816 0.006816 0.006816 0.22% MLPoisson::Fapply() 493 0.006716 0.006716 0.006716 0.22% MLMG::mgVcycle_down::2 31 0.006684 0.006684 0.006684 0.21% Castro::finalize_do_advance() 9 0.006595 0.006595 0.006595 0.21% FabArray::Xpay() 353 0.006383 0.006383 0.006383 0.20% MLMG::mgVcycle_down::3 31 0.006025 0.006025 0.006025 0.19% MLMG::mgVcycle_down::4 31 0.005904 0.005904 0.005904 0.19% MLMG::computeResidual() 31 0.005877 0.005877 0.005877 0.19% Castro::construct_new_gravity_source() 9 0.005274 0.005274 0.005274 0.17% FabArrayBase::getCPC() 1522 0.005041 0.005041 0.005041 0.16% MLCGSolver::ParallelAllReduce 745 0.005027 0.005027 0.005027 0.16% MLMG::mgVcycle_up::4 31 0.004818 0.004818 0.004818 0.15% MLMG::mgVcycle_up::2 31 0.004648 0.004648 0.004648 0.15% MLMG::mgVcycle_up::3 31 0.004604 0.004604 0.004604 0.15% MLMG::getGradSolution() 10 0.004342 0.004342 0.004342 0.14% MLCellLinOp::compGrad() 18 0.004334 0.004334 0.004334 0.14% Castro::apply_source_to_state() 18 0.004223 0.004223 0.004223 0.14% Castro::reset_internal_energy(Fab) 1476 0.004177 0.004177 0.004177 0.13% FabArrayBase::CPC::define() 534 0.003831 0.003831 0.003831 0.12% Castro::errorEst() 6 0.003818 0.003818 0.003818 0.12% Castro::enforce_speed_limit() 87 0.003739 0.003739 0.003739 0.12% FillPatchInterp(MF) 30 0.003666 0.003666 0.003666 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003585 0.003585 0.003585 0.12% MLMG::computeResWithCrseCorFineCor() 17 0.003521 0.003521 0.003521 0.11% MLCellLinOp::updateSolBC() 25 0.003342 0.003342 0.003342 0.11% check_for_negative_density() 9 0.00331 0.00331 0.00331 0.11% FabArray::setDomainBndry() 92 0.003288 0.003288 0.003288 0.11% Castro::check_for_nan() 18 0.003248 0.003248 0.003248 0.10% MultiFab::contains_nan() 18 0.003236 0.003236 0.003236 0.10% TagBoxArray::mapPRD 6 0.003138 0.003138 0.003138 0.10% Castro::init(old) 3 0.003093 0.003093 0.003093 0.10% Castro::computeInitialDt() 2 0.002761 0.002761 0.002761 0.09% FabArray::mult() 55 0.002585 0.002585 0.002585 0.08% Castro::buildMetrics() 5 0.002474 0.002474 0.002474 0.08% MLCellLinOp::setLevelBC() 18 0.002443 0.002443 0.002443 0.08% MLCellLinOp::updateCorBC() 17 0.002312 0.002312 0.002312 0.07% Castro::apply_tagging_restrictions() 6 0.00209 0.00209 0.00209 0.07% MLMG::ResNormInf() 54 0.002077 0.002077 0.002077 0.07% MLPoisson::prepareForSolve() 10 0.002039 0.002039 0.002039 0.07% MLCellLinOp::prepareForSolve() 10 0.00203 0.00203 0.00203 0.07% Gravity::update_max_rhs() 10 0.002029 0.002029 0.002029 0.07% Gravity::average_fine_ec_onto_crse_ec() 8 0.001988 0.001988 0.001988 0.06% Castro::fill_hybrid_hydro_source() 27 0.001871 0.001871 0.001871 0.06% MLPoisson::FFlux() 150 0.001475 0.001475 0.001475 0.05% average_down_faces 48 0.001299 0.001299 0.001299 0.04% Castro::construct_new_hybrid_source() 9 0.001253 0.001253 0.001253 0.04% FabArray::norminf(mask) 21 0.001223 0.001223 0.001223 0.04% Castro::avgDown() 4 0.001187 0.001187 0.001187 0.04% Castro::avgDown(state_indx) 20 0.001183 0.001183 0.001183 0.04% amrex::average_down_w_geom 20 0.001175 0.001175 0.001175 0.04% MLMG::MLResNormInf() 15 0.001149 0.001149 0.001149 0.04% OwnerMask() 6 0.001011 0.001011 0.001011 0.03% Castro::build_fine_mask() 44 0.0009733 0.0009733 0.0009733 0.03% MLMG::interpCorrection_1 17 0.0009723 0.0009723 0.0009723 0.03% Castro::derive() 6 0.0009526 0.0009526 0.0009526 0.03% AmrLevel::derive() 6 0.0009483 0.0009483 0.0009483 0.03% Castro::init() 1 0.0008973 0.0008973 0.0008973 0.03% AmrLevel::FillCoarsePatch() 5 0.0008952 0.0008952 0.0008952 0.03% Castro::create_source_corrector() 9 0.0008087 0.0008087 0.0008087 0.03% TagBoxArray::collate() 6 0.0007663 0.0007663 0.0007663 0.02% FabArrayBase::getFB() 1728 0.0007564 0.0007564 0.0007564 0.02% Castro::FluxRegFineAdd() 9 0.0006886 0.0006886 0.0006886 0.02% Gravity::swapTimeLevels() 9 0.0006723 0.0006723 0.0006723 0.02% Castro::construct_old_hybrid_source() 9 0.0006338 0.0006338 0.0006338 0.02% MultiFab::max() 18 0.000617 0.000617 0.000617 0.02% MLMG::MLRhsNormInf() 10 0.0005974 0.0005974 0.0005974 0.02% MultiFab::Multiply() 8 0.0005042 0.0005042 0.0005042 0.02% Castro::apply_problem_tags() 6 0.0004899 0.0004899 0.0004899 0.02% FabArrayBase::FB::FB() 37 0.0004441 0.0004441 0.0004441 0.01% Castro::react_state() 18 0.0003886 0.0003886 0.0003886 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003708 0.0003708 0.0003708 0.01% MLLinOp::define() 10 0.0003233 0.0003233 0.0003233 0.01% MLLinOp::defineGrids() 10 0.0003103 0.0003103 0.0003103 0.01% Castro::construct_new_rotation_source() 9 0.0002374 0.0002374 0.0002374 0.01% AMRErrorTag::operator() 6 0.0002353 0.0002353 0.0002353 0.01% Castro::construct_old_rotation_source() 9 0.0002063 0.0002063 0.0002063 0.01% AmrLevel::AmrLevel(dm) 5 0.0001992 0.0001992 0.0001992 0.01% StateData::define() 25 0.0001541 0.0001541 0.0001541 0.00% Castro::enforce_consistent_e() 1 0.0001469 0.0001469 0.0001469 0.00% Castro::swap_state_time_levels() 9 0.0001283 0.0001283 0.0001283 0.00% Castro::finalize_advance() 9 0.0001028 0.0001028 0.0001028 0.00% MLLinOp::makeAgglomeratedDMap 10 6.321e-05 6.321e-05 6.321e-05 0.00% FabArray::RecvLayoutMask() 8 5.036e-05 5.036e-05 5.036e-05 0.00% FabArrayBase::TheFPinfo() 25 4.784e-05 4.784e-05 4.784e-05 0.00% makeSFC 50 4.774e-05 4.774e-05 4.774e-05 0.00% Amr::writeSmallPlotFile() 1 3.876e-05 3.876e-05 3.876e-05 0.00% FPinfo::FPinfo() 3 2.325e-05 2.325e-05 2.325e-05 0.00% AmrMesh-cluster 4 2.302e-05 2.302e-05 2.302e-05 0.00% DistributionMapping::Distribute() 52 2.117e-05 2.117e-05 2.117e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.417e-05 1.417e-05 1.417e-05 0.00% Amr::initSubcycle() 1 1.335e-05 1.335e-05 1.335e-05 0.00% ClusterList::intersect() 4 1.316e-05 1.316e-05 1.316e-05 0.00% BoxList::parallelComplementIn() 12 8.681e-06 8.681e-06 8.681e-06 0.00% Gravity::set_mass_offset() 6 4.612e-06 4.612e-06 4.612e-06 0.00% BoxList::complementIn 12 3.906e-06 3.906e-06 3.906e-06 0.00% Castro::retry_advance_ctu() 5 3.216e-06 3.216e-06 3.216e-06 0.00% ClusterList::chop() 4 2.053e-06 2.053e-06 2.053e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.823e-06 1.823e-06 1.823e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1688 KiB 9037 MiB Castro::reflux() 436 436 12 MiB 666 MiB Castro::initMFs() 258 258 350 MiB 576 MiB Castro::swap_state_time_levels() 175 175 181 MiB 340 MiB StateData::define() 175 175 221 MiB 340 MiB Castro::initialize_do_advance() 143 143 127 MiB 325 MiB FillPatchIterator::Initialize 899 899 4615 KiB 303 MiB Amr::writePlotFile() 56 56 17 MiB 189 MiB Castro::problem_post_timestep() 162 162 785 KiB 167 MiB Castro::FluxRegCrseInit 660 660 454 KiB 167 MiB FluxRegister::Reflux() 648 648 1549 KiB 160 MiB Castro::initialize_advance() 143 143 50 MiB 121 MiB Castro::construct_new_source() 143 143 225 KiB 67 MiB Castro::construct_old_source() 143 143 134 KiB 67 MiB Castro::buildMetrics() 140 140 37 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 28 MiB 60 MiB Castro::Castro() 210 210 4051 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2706 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 268 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 338 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 896 KiB 16 MiB FillPatchTwoLevels 300 300 7753 B 11 MiB FillPatchInterp(MF) 330 330 4711 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 134 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4493 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 779 KiB 7424 KiB Castro::build_fine_mask() 224 224 1253 KiB 6912 KiB AmrLevel::derive() 162 162 2623 B 6912 KiB BndryData::define() 3624 3624 283 KiB 4243 KiB MLCellLinOp::reflux() 450 450 6753 B 2376 KiB Castro::wd_update() 6 6 24 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 411 B 2095 KiB amrex::average_down 1483 1483 2368 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 4917 B 1042 KiB MLMG::addInterpCorrection() 1240 1240 788 B 867 KiB MLCellLinOp::defineBC() 276 276 3871 B 689 KiB Castro::estTimeStep() 26 26 2529 B 480 KiB VisMF::Write(FabArray) 1568 1568 2280 B 320 KiB Castro::normalize_species() 87 87 6940 B 320 KiB Castro::volInBoundary() 70 70 3106 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 127 B 204 KiB FabArray::norminf(mask) 29 29 188 B 163 KiB amrex::Dot() 559 559 422 B 160 KiB FabArray::norminf() 470 470 421 B 160 KiB MultiFab::max() 18 18 31 B 160 KiB check_for_negative_density() 9 9 172 B 160 KiB Castro::initData() 1 1 44 B 160 KiB FabArray::setVal() 419 419 55 KiB 120 KiB MLMG::interpCorrection_1 34 34 27 B 91 KiB average_down_faces 99 99 649 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 282 B 57 KiB MLPoisson::Fsmooth() 228 228 3073 B 55 KiB FillBoundary_nowait() 751 751 446 B 53 KiB TagBoxArray::mapPRD 324 324 41 B 45 KiB OwnerMask() 168 168 11 B 38 KiB MLCellLinOp::applyBC() 3834 3834 142 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9692 B 25 KiB MultiFab::contains_nan() 18 18 21 B 20 KiB StateData::FillBoundary(geom) 2538 2538 91 B 15 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 625 B 3456 B MLCGSolver::bicgstab 155 155 25 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 168 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 11 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 590 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1252 B 278 KiB FabArray::setVal() 419 419 55 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 282 B 57 KiB MLPoisson::Fsmooth() 228 228 3073 B 55 KiB FillBoundary_nowait() 751 751 446 B 53 KiB MLCellLinOp::applyBC() 1917 1917 142 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9692 B 25 KiB Gravity::get_new_grav_vector() 18 18 3390 B 20 KiB Gravity::get_old_grav_vector() 12 12 6561 B 20 KiB StateData::FillBoundary(geom) 2538 2538 91 B 15 KiB OwnerMask() 6 6 0 B 15 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1354 B 6304 B MLMG::prepareForSolve() 18 18 231 B 3712 B FabArray::norminf(mask) 29 29 129 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 625 B 3456 B Castro::FluxRegCrseInit 12 12 9 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 621 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (v2024-35-gb892132f6144) finalized