Initializing AMReX (v2024-34-g9e8f8d60eca3)... Initializing CUDA... CUDA initialized with 1 device. AMReX (v2024-34-g9e8f8d60eca3) initialized Starting run at 09:23:47 UTC on 2024-03-26. Successfully read inputs file ... Castro git describe: 24.03-26-g5707c0c2f AMReX git describe: v2024-34-g9e8f8d60e Microphysics git describe: 24.03-21-g81de2adb reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.00338104 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.002004782 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009210764 Gravity::multilevel_solve_for_new_phi() time = 0.052942326 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.145502473 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004916352 on level 0 Castro::do_old_sources() time = 0.00932338 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.137105276 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.006379219 Gravity::multilevel_solve_for_new_phi() time = 0.039579416 Castro::construct_new_gravity() time = 0.044787455 on level 0 Castro::do_new_sources() time = 0.007362959 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.914324009 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.235648683 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002311484 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007123818 Gravity::multilevel_solve_for_new_phi() time = 0.060716729 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004928566 on level 0 Castro::do_old_sources() time = 0.007503331 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.112586913 on level 0 Castro::construct_old_gravity() time = 0.000419697 on level 1 Castro::do_old_sources() time = 0.001880873 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.011102598 on level 1 Castro::reflux() at level 0 : time = 0.019573369 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.006919767 Gravity::multilevel_solve_for_new_phi() time = 0.041146942 Castro::construct_new_gravity() time = 0.046241188 on level 0 Castro::do_new_sources() time = 0.006219906 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000460837 on level 1 Castro::do_new_sources() time = 0.001914087 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.989998467 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.327835638 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.003456464 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.006876144 Gravity::multilevel_solve_for_new_phi() time = 0.014757259 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.005169152 on level 0 Castro::do_old_sources() time = 0.010755493 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.120994911 on level 0 Castro::construct_old_gravity() time = 0.000432112 on level 1 Castro::do_old_sources() time = 0.001740564 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007876127 on level 1 Castro::reflux() at level 0 : time = 0.019328902 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.00690629 Gravity::multilevel_solve_for_new_phi() time = 0.028991446 Castro::construct_new_gravity() time = 0.03434339 on level 0 Castro::do_new_sources() time = 0.00638571 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000470525 on level 1 Castro::do_new_sources() time = 0.002406125 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.878616628 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.29083042 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002506737 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.006867286 Gravity::multilevel_solve_for_new_phi() time = 0.014736794 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004950188 on level 0 Castro::do_old_sources() time = 0.007017835 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.113480396 on level 0 Castro::construct_old_gravity() time = 0.000390574 on level 1 Castro::do_old_sources() time = 0.001509869 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.013459304 on level 1 Castro::reflux() at level 0 : time = 0.021427867 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.006940078 Gravity::multilevel_solve_for_new_phi() time = 0.028933987 Castro::construct_new_gravity() time = 0.033653351 on level 0 Castro::do_new_sources() time = 0.009778097 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000449804 on level 1 Castro::do_new_sources() time = 0.001451836 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 4.030731084 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.28016029 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.003298485 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.006899649 Gravity::multilevel_solve_for_new_phi() time = 0.014949388 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.011896547 on level 0 Castro::do_old_sources() time = 0.007444881 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.121487359 on level 0 Castro::construct_old_gravity() time = 0.000412331 on level 1 Castro::do_old_sources() time = 0.001324418 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.010423475 on level 1 Castro::reflux() at level 0 : time = 0.018579931 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.006920863 Gravity::multilevel_solve_for_new_phi() time = 0.029198966 Castro::construct_new_gravity() time = 0.034329001 on level 0 Castro::do_new_sources() time = 0.006503713 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000457046 on level 1 Castro::do_new_sources() time = 0.001849342 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.896928211 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.289870715 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.15547129 seconds Ending run at 09:23:50 UTC on 2024-03-26. Run time = 3.016420989 Run time without initialization = 1.580709831 Average number of zones advanced per microsecond: 3.130 Average number of zones advanced per microsecond per rank: 3.130 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.016 ... 3.016 ... 3.016 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0440 1.0440 1.0440 34.61% Castro::construct_ctu_hydro_source() 9 0.6202 0.6202 0.6202 20.56% VisMF::Write(FabArray) 3 0.2938 0.2938 0.2938 9.74% Castro::initMFs() 5 0.1576 0.1576 0.1576 5.23% Castro::computeTemp() 88 0.07821 0.07821 0.07821 2.59% Castro::normalize_species() 87 0.07193 0.07193 0.07193 2.38% Gravity::fill_multipole_BCs() 10 0.06911 0.06911 0.06911 2.29% StateDataPhysBCFunct::() 95 0.05098 0.05098 0.05098 1.69% MLCellLinOp::applyBC() 1917 0.04709 0.04709 0.04709 1.56% FillBoundary_nowait() 1728 0.04288 0.04288 0.04288 1.42% FabArray::setVal() 920 0.03785 0.03785 0.03785 1.25% StateData::FillBoundary(geom) 650 0.03076 0.03076 0.03076 1.02% FabArray::ParallelCopy_nowait() 954 0.03026 0.03026 0.03026 1.00% Castro::volInBoundary() 42 0.02805 0.02805 0.02805 0.93% amrex::Copy() 441 0.02655 0.02655 0.02655 0.88% Castro::reset_internal_energy(MultiFab) 88 0.0226 0.0226 0.0226 0.75% FluxRegister::Reflux() 24 0.02244 0.02244 0.02244 0.74% MLCellLinOp::defineAuxData() 10 0.02025 0.02025 0.02025 0.67% Castro::enforce_min_density() 87 0.01971 0.01971 0.01971 0.65% Castro::estTimeStep() 26 0.01846 0.01846 0.01846 0.61% amrex::Add() 136 0.01725 0.01725 0.01725 0.57% Castro::reflux() 4 0.01635 0.01635 0.01635 0.54% FabArray::Saxpy() 604 0.0158 0.0158 0.0158 0.52% Castro::problem_post_timestep() 10 0.01328 0.01328 0.01328 0.44% MLCellLinOp::reflux() 30 0.01327 0.01327 0.01327 0.44% BndryData::define() 26 0.01274 0.01274 0.01274 0.42% MLPoisson::Fsmooth() 1376 0.01235 0.01235 0.01235 0.41% amrex::Dot() 466 0.008933 0.008933 0.008933 0.30% Castro::construct_old_gravity_source() 18 0.008847 0.008847 0.008847 0.29% Castro::construct_new_source() 63 0.008776 0.008776 0.008776 0.29% FabArray::norminf() 439 0.00854 0.00854 0.00854 0.28% Castro::FluxRegCrseInit 9 0.007953 0.007953 0.007953 0.26% Castro::initData() 1 0.007 0.007 0.007 0.23% AmrMesh::MakeNewGrids() 6 0.00698 0.00698 0.00698 0.23% MLPoisson::Fapply() 493 0.00673 0.00673 0.00673 0.22% FabArray::Xpay() 353 0.006407 0.006407 0.006407 0.21% amrex::average_down 233 0.006047 0.006047 0.006047 0.20% Castro::construct_new_gravity_source() 9 0.00584 0.00584 0.00584 0.19% Castro::reset_internal_energy(Fab) 1476 0.005302 0.005302 0.005302 0.18% Amr::writePlotFile() 2 0.004865 0.004865 0.004865 0.16% MLMG::addInterpCorrection() 155 0.004445 0.004445 0.004445 0.15% Castro::wd_update() 6 0.004436 0.004436 0.004436 0.15% Castro::apply_tagging_restrictions() 6 0.003993 0.003993 0.003993 0.13% Gravity::actual_solve_with_mlmg() 10 0.003941 0.003941 0.003941 0.13% FabArrayBase::CPC::define() 534 0.003766 0.003766 0.003766 0.12% FillPatchInterp(MF) 30 0.003628 0.003628 0.003628 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003582 0.003582 0.003582 0.12% FabArray::setDomainBndry() 92 0.003315 0.003315 0.003315 0.11% MultiFab::contains_nan() 18 0.00327 0.00327 0.00327 0.11% Castro::construct_old_source() 63 0.003109 0.003109 0.003109 0.10% MLCellLinOp::compGrad() 18 0.002919 0.002919 0.002919 0.10% MLCellLinOp::defineBC() 10 0.002697 0.002697 0.002697 0.09% FabArray::mult() 55 0.00259 0.00259 0.00259 0.09% MLCellLinOp::setLevelBC() 18 0.002416 0.002416 0.002416 0.08% Castro::enforce_speed_limit() 87 0.002004 0.002004 0.002004 0.07% MLCellLinOp::prepareForSolve() 10 0.001979 0.001979 0.001979 0.07% MLMG::prepareForSolve() 10 0.001872 0.001872 0.001872 0.06% Castro::fill_hybrid_hydro_source() 27 0.001663 0.001663 0.001663 0.06% Gravity::get_new_grav_vector() 10 0.001496 0.001496 0.001496 0.05% check_for_negative_density() 9 0.001488 0.001488 0.001488 0.05% MLPoisson::FFlux() 150 0.001464 0.001464 0.001464 0.05% MLCellLinOp::updateSolBC() 25 0.001376 0.001376 0.001376 0.05% TagBoxArray::mapPRD 6 0.001342 0.001342 0.001342 0.04% FabArray::norminf(mask) 21 0.001228 0.001228 0.001228 0.04% Gravity::get_old_grav_vector() 9 0.001198 0.001198 0.001198 0.04% FabArrayBase::getCPC() 1522 0.001151 0.001151 0.001151 0.04% MLCellLinOp::updateCorBC() 17 0.001014 0.001014 0.001014 0.03% OwnerMask() 6 0.001008 0.001008 0.001008 0.03% Castro::clean_state() 87 0.0009829 0.0009829 0.0009829 0.03% Castro::build_fine_mask() 44 0.0009709 0.0009709 0.0009709 0.03% average_down_faces 48 0.0008837 0.0008837 0.0008837 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0007872 0.0007872 0.0007872 0.03% TagBoxArray::collate() 6 0.0007674 0.0007674 0.0007674 0.03% FillPatchTwoLevels 31 0.0007623 0.0007623 0.0007623 0.03% main() 1 0.0007437 0.0007437 0.0007437 0.02% MLCGSolver::bicgstab 31 0.0007165 0.0007165 0.0007165 0.02% Castro::FluxRegFineAdd() 9 0.0006652 0.0006652 0.0006652 0.02% AmrLevel::FillPatch() 62 0.0006363 0.0006363 0.0006363 0.02% MultiFab::max() 18 0.0006298 0.0006298 0.0006298 0.02% FillPatchIterator::Initialize 62 0.0005863 0.0005863 0.0005863 0.02% MultiFab::Multiply() 8 0.0005056 0.0005056 0.0005056 0.02% MLCellLinOp::smooth() 688 0.0004965 0.0004965 0.0004965 0.02% Castro::apply_problem_tags() 6 0.0004859 0.0004859 0.0004859 0.02% FabArrayBase::FB::FB() 37 0.0004413 0.0004413 0.0004413 0.01% Gravity::actual_multilevel_solve() 10 0.0004178 0.0004178 0.0004178 0.01% FabArray::FillBoundary() 1728 0.0004041 0.0004041 0.0004041 0.01% MLMG::interpCorrection_1 17 0.0004022 0.0004022 0.0004022 0.01% Castro::linear_to_hybrid_momentum() 1 0.000367 0.000367 0.000367 0.01% Castro::initialize_advance() 9 0.0003459 0.0003459 0.0003459 0.01% Castro::Castro() 5 0.0003309 0.0003309 0.0003309 0.01% FabArray::ParallelCopy() 954 0.0003305 0.0003305 0.0003305 0.01% Castro::finalize_do_advance() 9 0.0003259 0.0003259 0.0003259 0.01% Amr::regrid() 5 0.0003231 0.0003231 0.0003231 0.01% Castro::subcycle_advance_ctu() 5 0.0003116 0.0003116 0.0003116 0.01% Castro::react_state() 18 0.0003108 0.0003108 0.0003108 0.01% Amr::coarseTimeStep() 5 0.0003086 0.0003086 0.0003086 0.01% FabArrayBase::getFB() 1728 0.000303 0.000303 0.000303 0.01% Castro::initialize_do_advance() 9 0.0003019 0.0003019 0.0003019 0.01% Gravity::update_max_rhs() 10 0.0002847 0.0002847 0.0002847 0.01% Castro::post_regrid() 10 0.0002807 0.0002807 0.0002807 0.01% Castro::post_timestep() 9 0.0002755 0.0002755 0.0002755 0.01% Castro::do_new_sources() 9 0.0002623 0.0002623 0.0002623 0.01% AMRErrorTag::operator() 6 0.0002356 0.0002356 0.0002356 0.01% Castro::construct_new_gravity() 9 0.0002304 0.0002304 0.0002304 0.01% Castro::construct_old_gravity() 9 0.0002265 0.0002265 0.0002265 0.01% Castro::do_old_sources() 9 0.0002183 0.0002183 0.0002183 0.01% Castro::construct_old_rotation_source() 9 0.0002176 0.0002176 0.0002176 0.01% MLCellLinOp::apply() 493 0.0002173 0.0002173 0.0002173 0.01% Castro::construct_new_rotation_source() 9 0.0002109 0.0002109 0.0002109 0.01% MLLinOp::defineGrids() 10 0.0002053 0.0002053 0.0002053 0.01% Castro::do_advance_ctu() 5 0.0001989 0.0001989 0.0001989 0.01% StateData::define() 25 0.000162 0.000162 0.000162 0.01% Castro::enforce_consistent_e() 1 0.0001477 0.0001477 0.0001477 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001313 0.0001313 0.0001313 0.00% MLCGSolver::ParallelAllReduce 745 0.0001305 0.0001305 0.0001305 0.00% Castro::create_source_corrector() 9 0.000128 0.000128 0.000128 0.00% Castro::advance() 5 0.0001262 0.0001262 0.0001262 0.00% Castro::swap_state_time_levels() 9 0.0001242 0.0001242 0.0001242 0.00% MLMG::mgVcycle() 65 0.0001121 0.0001121 0.0001121 0.00% MLCellLinOp::correctionResidual() 189 0.0001073 0.0001073 0.0001073 0.00% Castro::buildMetrics() 5 0.0001002 0.0001002 0.0001002 0.00% Castro::finalize_advance() 9 9.366e-05 9.366e-05 9.366e-05 0.00% Castro::computeNewDt() 8 8.622e-05 8.622e-05 8.622e-05 0.00% Amr::grid_places() 6 8.611e-05 8.611e-05 8.611e-05 0.00% AmrLevel::derive() 6 8.107e-05 8.107e-05 8.107e-05 0.00% Amr::timeStep() 9 7.889e-05 7.889e-05 7.889e-05 0.00% FillPatchSingleLevel 92 5.956e-05 5.956e-05 5.956e-05 0.00% MLMG::oneIter() 31 5.483e-05 5.483e-05 5.483e-05 0.00% MLMG:computeResOfCorrection() 155 5.243e-05 5.243e-05 5.243e-05 0.00% MLMG::solve() 10 5.136e-05 5.136e-05 5.136e-05 0.00% FabArray::RecvLayoutMask() 8 5.071e-05 5.071e-05 5.071e-05 0.00% Castro::errorEst() 6 4.964e-05 4.964e-05 4.964e-05 0.00% MLCellLinOp::solutionResidual() 71 4.594e-05 4.594e-05 4.594e-05 0.00% Amr::defBaseLevel() 1 4.424e-05 4.424e-05 4.424e-05 0.00% MLMG::mgVcycle_bottom 65 4.094e-05 4.094e-05 4.094e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.071e-05 4.071e-05 4.071e-05 0.00% MLMG::actualBottomSolve() 31 4.027e-05 4.027e-05 4.027e-05 0.00% AmrLevel::AmrLevel(dm) 5 4.003e-05 4.003e-05 4.003e-05 0.00% Amr::writeSmallPlotFile() 1 3.678e-05 3.678e-05 3.678e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.633e-05 3.633e-05 3.633e-05 0.00% MLMG::mgVcycle_down::0 31 3.59e-05 3.59e-05 3.59e-05 0.00% MLMG::mgVcycle_down::1 31 3.303e-05 3.303e-05 3.303e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.212e-05 3.212e-05 3.212e-05 0.00% MLMG::mgVcycle_down::3 31 3.125e-05 3.125e-05 3.125e-05 0.00% MLMG::ResNormInf() 54 3.12e-05 3.12e-05 3.12e-05 0.00% MLMG::mgVcycle_down::2 31 3.082e-05 3.082e-05 3.082e-05 0.00% MLMG::mgVcycle_down::4 31 2.747e-05 2.747e-05 2.747e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.714e-05 2.714e-05 2.714e-05 0.00% MLPoisson::define() 10 2.65e-05 2.65e-05 2.65e-05 0.00% makeSFC 50 2.588e-05 2.588e-05 2.588e-05 0.00% Gravity::solve_phi_with_mlmg() 10 2.577e-05 2.577e-05 2.577e-05 0.00% MLMG::mgVcycle_up::4 31 2.472e-05 2.472e-05 2.472e-05 0.00% MLMG::mgVcycle_up::0 31 2.283e-05 2.283e-05 2.283e-05 0.00% MLMG::mgVcycle_up::3 31 2.248e-05 2.248e-05 2.248e-05 0.00% FabArrayBase::TheFPinfo() 25 2.231e-05 2.231e-05 2.231e-05 0.00% MLMG::mgVcycle_up::1 31 2.072e-05 2.072e-05 2.072e-05 0.00% MLMG::mgVcycle_up::2 31 1.988e-05 1.988e-05 1.988e-05 0.00% DistributionMapping::Distribute() 52 1.972e-05 1.972e-05 1.972e-05 0.00% FPinfo::FPinfo() 3 1.921e-05 1.921e-05 1.921e-05 0.00% MLMG::computeResidual() 31 1.437e-05 1.437e-05 1.437e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.426e-05 1.426e-05 1.426e-05 0.00% MLMG::computeMLResidual() 15 1.411e-05 1.411e-05 1.411e-05 0.00% ClusterList::intersect() 4 1.403e-05 1.403e-05 1.403e-05 0.00% MLMG::miniCycle() 34 1.386e-05 1.386e-05 1.386e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.321e-05 1.321e-05 1.321e-05 0.00% Amr::initSubcycle() 1 1.315e-05 1.315e-05 1.315e-05 0.00% Amr::FinalizeInit() 1 1.312e-05 1.312e-05 1.312e-05 0.00% Castro::check_for_nan() 18 1.05e-05 1.05e-05 1.05e-05 0.00% Castro::post_init() 1 9.771e-06 9.771e-06 9.771e-06 0.00% Castro::apply_source_to_state() 18 9.037e-06 9.037e-06 9.037e-06 0.00% Castro::expand_state() 13 8.486e-06 8.486e-06 8.486e-06 0.00% MLMG::getGradSolution() 10 8.262e-06 8.262e-06 8.262e-06 0.00% Gravity::swapTimeLevels() 9 7.96e-06 7.96e-06 7.96e-06 0.00% MLPoisson::prepareForSolve() 10 7.858e-06 7.858e-06 7.858e-06 0.00% Castro::avgDown(state_indx) 20 7.791e-06 7.791e-06 7.791e-06 0.00% Amr::InitializeInit() 1 7.708e-06 7.708e-06 7.708e-06 0.00% MLLinOp::define() 10 7.67e-06 7.67e-06 7.67e-06 0.00% Castro::construct_new_hybrid_source() 9 7.644e-06 7.644e-06 7.644e-06 0.00% amrex::average_down_w_geom 20 7.319e-06 7.319e-06 7.319e-06 0.00% MLMG::MLResNormInf() 15 7.225e-06 7.225e-06 7.225e-06 0.00% Castro::construct_old_hybrid_source() 9 6.54e-06 6.54e-06 6.54e-06 0.00% AmrMesh-cluster 4 6.532e-06 6.532e-06 6.532e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 6.253e-06 6.253e-06 6.253e-06 0.00% MLMG::MLRhsNormInf() 10 4.987e-06 4.987e-06 4.987e-06 0.00% Castro::init(old) 3 4.872e-06 4.872e-06 4.872e-06 0.00% BoxList::parallelComplementIn() 12 4.868e-06 4.868e-06 4.868e-06 0.00% Castro::avgDown() 4 4.665e-06 4.665e-06 4.665e-06 0.00% Gravity::set_mass_offset() 6 4.599e-06 4.599e-06 4.599e-06 0.00% Castro::derive() 6 3.557e-06 3.557e-06 3.557e-06 0.00% BoxList::complementIn 12 3.474e-06 3.474e-06 3.474e-06 0.00% Castro::computeInitialDt() 2 3.25e-06 3.25e-06 3.25e-06 0.00% Amr::bldFineLevels() 1 3.067e-06 3.067e-06 3.067e-06 0.00% Castro::retry_advance_ctu() 5 2.74e-06 2.74e-06 2.74e-06 0.00% Castro::init() 1 2.118e-06 2.118e-06 2.118e-06 0.00% Amr::init() 1 1.952e-06 1.952e-06 1.952e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.876e-06 1.876e-06 1.876e-06 0.00% ClusterList::chop() 4 1.629e-06 1.629e-06 1.629e-06 0.00% Amr::initialInit() 1 1.18e-06 1.18e-06 1.18e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.016 3.016 3.016 100.00% Amr::coarseTimeStep() 5 1.425 1.425 1.425 47.23% Amr::timeStep() 9 1.419 1.419 1.419 47.04% Castro::advance() 5 1.189 1.189 1.189 39.41% Castro::subcycle_advance_ctu() 5 1.16 1.16 1.16 38.47% Castro::do_advance_ctu() 5 1.16 1.16 1.16 38.46% Amr::InitAmr() 1 1.044 1.044 1.044 34.61% Castro::construct_ctu_hydro_source() 9 0.6486 0.6486 0.6486 21.50% Amr::init() 1 0.3916 0.3916 0.3916 12.98% Gravity::multilevel_solve_for_new_phi() 10 0.3261 0.3261 0.3261 10.81% Gravity::actual_multilevel_solve() 10 0.3253 0.3253 0.3253 10.78% Gravity::solve_phi_with_mlmg() 10 0.322 0.322 0.322 10.67% Amr::writePlotFile() 2 0.3011 0.3011 0.3011 9.98% VisMF::Write(FabArray) 3 0.2938 0.2938 0.2938 9.74% Gravity::actual_solve_with_mlmg() 10 0.2503 0.2503 0.2503 8.30% Amr::initialInit() 1 0.246 0.246 0.246 8.15% Castro::clean_state() 87 0.1994 0.1994 0.1994 6.61% MLMG::solve() 10 0.1981 0.1981 0.1981 6.57% Castro::construct_new_gravity() 9 0.1953 0.1953 0.1953 6.47% Amr::InitializeInit() 1 0.1717 0.1717 0.1717 5.69% Amr::defBaseLevel() 1 0.1716 0.1716 0.1716 5.69% MLMG::oneIter() 31 0.1667 0.1667 0.1667 5.53% Amr::regrid() 5 0.1626 0.1626 0.1626 5.39% Castro::Castro() 5 0.1616 0.1616 0.1616 5.36% Castro::initMFs() 5 0.1576 0.1576 0.1576 5.23% Castro::post_regrid() 10 0.1448 0.1448 0.1448 4.80% MLMG::mgVcycle() 65 0.141 0.141 0.141 4.67% AmrLevel::FillPatch() 62 0.1238 0.1238 0.1238 4.10% FillPatchIterator::Initialize 62 0.1094 0.1094 0.1094 3.63% Castro::computeTemp() 88 0.1061 0.1061 0.1061 3.52% FillPatchSingleLevel 92 0.1009 0.1009 0.1009 3.34% FillPatchIterator::FillFromLevel0() 31 0.09823 0.09823 0.09823 3.26% MLCellLinOp::applyBC() 1917 0.09112 0.09112 0.09112 3.02% StateDataPhysBCFunct::() 95 0.08174 0.08174 0.08174 2.71% MLCellLinOp::smooth() 688 0.08078 0.08078 0.08078 2.68% Castro::reflux() 4 0.07894 0.07894 0.07894 2.62% Amr::FinalizeInit() 1 0.07433 0.07433 0.07433 2.46% Castro::normalize_species() 87 0.07193 0.07193 0.07193 2.38% Gravity::fill_multipole_BCs() 10 0.07116 0.07116 0.07116 2.36% Castro::post_timestep() 9 0.06703 0.06703 0.06703 2.22% Castro::post_init() 1 0.06337 0.06337 0.06337 2.10% Castro::initialize_do_advance() 9 0.05689 0.05689 0.05689 1.89% Castro::problem_post_timestep() 10 0.0517 0.0517 0.0517 1.71% Castro::do_old_sources() 9 0.04858 0.04858 0.04858 1.61% Castro::expand_state() 13 0.04645 0.04645 0.04645 1.54% FabArray::FillBoundary() 1728 0.04403 0.04403 0.04403 1.46% Castro::do_new_sources() 9 0.04394 0.04394 0.04394 1.46% FillBoundary_nowait() 1728 0.04362 0.04362 0.04362 1.45% MLPoisson::define() 10 0.0415 0.0415 0.0415 1.38% FabArray::setVal() 920 0.03785 0.03785 0.03785 1.25% MLMG::mgVcycle_bottom 65 0.03745 0.03745 0.03745 1.24% FabArray::ParallelCopy() 954 0.03461 0.03461 0.03461 1.15% FabArray::ParallelCopy_nowait() 954 0.03428 0.03428 0.03428 1.14% Castro::construct_old_gravity() 9 0.0336 0.0336 0.0336 1.11% Gravity::get_old_grav_vector() 9 0.03338 0.03338 0.03338 1.11% Gravity::get_new_grav_vector() 10 0.03292 0.03292 0.03292 1.09% Castro::wd_update() 6 0.0325 0.0325 0.0325 1.08% StateData::FillBoundary(geom) 650 0.03076 0.03076 0.03076 1.02% MLMG::actualBottomSolve() 31 0.03042 0.03042 0.03042 1.01% MLCGSolver::bicgstab 31 0.03013 0.03013 0.03013 1.00% FluxRegister::Reflux() 24 0.02972 0.02972 0.02972 0.99% MLMG::mgVcycle_down::0 31 0.02899 0.02899 0.02899 0.96% Castro::initialize_advance() 9 0.02826 0.02826 0.02826 0.94% Castro::volInBoundary() 42 0.02806 0.02806 0.02806 0.93% Castro::reset_internal_energy(MultiFab) 88 0.0279 0.0279 0.0279 0.92% MLCellLinOp::apply() 493 0.02757 0.02757 0.02757 0.91% amrex::Copy() 441 0.02655 0.02655 0.02655 0.88% MLCellLinOp::defineAuxData() 10 0.02357 0.02357 0.02357 0.78% Castro::construct_new_source() 63 0.02184 0.02184 0.02184 0.72% MLMG::mgVcycle_up::0 31 0.0217 0.0217 0.0217 0.72% Castro::enforce_min_density() 87 0.01971 0.01971 0.01971 0.65% MLCellLinOp::reflux() 30 0.01942 0.01942 0.01942 0.64% Castro::estTimeStep() 26 0.01846 0.01846 0.01846 0.61% MLCellLinOp::correctionResidual() 189 0.0181 0.0181 0.0181 0.60% MLCellLinOp::defineBC() 10 0.01763 0.01763 0.01763 0.58% amrex::Add() 136 0.01725 0.01725 0.01725 0.57% Amr::grid_places() 6 0.01702 0.01702 0.01702 0.56% AmrMesh::MakeNewGrids() 6 0.01693 0.01693 0.01693 0.56% MLMG::computeResWithCrseSolFineCor() 17 0.01589 0.01589 0.01589 0.53% FabArray::Saxpy() 604 0.0158 0.0158 0.0158 0.52% BndryData::define() 26 0.0148 0.0148 0.0148 0.49% MLCellLinOp::solutionResidual() 71 0.01449 0.01449 0.01449 0.48% MLMG::computeMLResidual() 15 0.01403 0.01403 0.01403 0.47% MLMG:computeResOfCorrection() 155 0.01387 0.01387 0.01387 0.46% MLPoisson::Fsmooth() 1376 0.01235 0.01235 0.01235 0.41% Castro::initData() 1 0.01186 0.01186 0.01186 0.39% Castro::construct_old_source() 63 0.0115 0.0115 0.0115 0.38% MLMG::mgVcycle_down::1 31 0.01145 0.01145 0.01145 0.38% amrex::average_down 233 0.009704 0.009704 0.009704 0.32% Castro::FluxRegCrseInit 9 0.009013 0.009013 0.009013 0.30% amrex::Dot() 466 0.008933 0.008933 0.008933 0.30% Castro::construct_old_gravity_source() 18 0.008847 0.008847 0.008847 0.29% MLMG::prepareForSolve() 10 0.008757 0.008757 0.008757 0.29% FabArray::norminf() 439 0.00854 0.00854 0.00854 0.28% MLMG::mgVcycle_up::1 31 0.008385 0.008385 0.008385 0.28% Castro::computeNewDt() 8 0.00838 0.00838 0.00838 0.28% Castro::finalize_do_advance() 9 0.007747 0.007747 0.007747 0.26% Amr::bldFineLevels() 1 0.00756 0.00756 0.00756 0.25% FillPatchIterator::FillFromTwoLevels() 31 0.007446 0.007446 0.007446 0.25% FillPatchTwoLevels 31 0.007414 0.007414 0.007414 0.25% MLMG::miniCycle() 34 0.007042 0.007042 0.007042 0.23% MLMG::addInterpCorrection() 155 0.00683 0.00683 0.00683 0.23% MLPoisson::Fapply() 493 0.00673 0.00673 0.00673 0.22% MLMG::mgVcycle_down::2 31 0.006699 0.006699 0.006699 0.22% FabArray::Xpay() 353 0.006407 0.006407 0.006407 0.21% MLMG::mgVcycle_down::3 31 0.00608 0.00608 0.00608 0.20% MLMG::mgVcycle_down::4 31 0.005951 0.005951 0.005951 0.20% MLMG::computeResidual() 31 0.005853 0.005853 0.005853 0.19% Castro::construct_new_gravity_source() 9 0.00584 0.00584 0.00584 0.19% Castro::errorEst() 6 0.0057 0.0057 0.0057 0.19% Castro::reset_internal_energy(Fab) 1476 0.005302 0.005302 0.005302 0.18% MLCGSolver::ParallelAllReduce 745 0.005095 0.005095 0.005095 0.17% FabArrayBase::getCPC() 1522 0.004917 0.004917 0.004917 0.16% MLMG::mgVcycle_up::4 31 0.004846 0.004846 0.004846 0.16% MLMG::mgVcycle_up::2 31 0.004676 0.004676 0.004676 0.16% MLMG::mgVcycle_up::3 31 0.004634 0.004634 0.004634 0.15% MLMG::getGradSolution() 10 0.004373 0.004373 0.004373 0.14% MLCellLinOp::compGrad() 18 0.004364 0.004364 0.004364 0.14% Castro::apply_source_to_state() 18 0.004223 0.004223 0.004223 0.14% Castro::apply_tagging_restrictions() 6 0.003993 0.003993 0.003993 0.13% FabArrayBase::CPC::define() 534 0.003766 0.003766 0.003766 0.12% FillPatchInterp(MF) 30 0.003628 0.003628 0.003628 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003582 0.003582 0.003582 0.12% MLMG::computeResWithCrseCorFineCor() 17 0.003514 0.003514 0.003514 0.12% MLCellLinOp::updateSolBC() 25 0.003318 0.003318 0.003318 0.11% FabArray::setDomainBndry() 92 0.003315 0.003315 0.003315 0.11% Castro::check_for_nan() 18 0.00328 0.00328 0.00328 0.11% MultiFab::contains_nan() 18 0.00327 0.00327 0.00327 0.11% TagBoxArray::mapPRD 6 0.003165 0.003165 0.003165 0.10% Castro::init(old) 3 0.00302 0.00302 0.00302 0.10% Castro::computeInitialDt() 2 0.002752 0.002752 0.002752 0.09% FabArray::mult() 55 0.00259 0.00259 0.00259 0.09% Castro::buildMetrics() 5 0.002496 0.002496 0.002496 0.08% MLCellLinOp::setLevelBC() 18 0.002416 0.002416 0.002416 0.08% MLCellLinOp::updateCorBC() 17 0.002307 0.002307 0.002307 0.08% Gravity::update_max_rhs() 10 0.002093 0.002093 0.002093 0.07% MLMG::ResNormInf() 54 0.002085 0.002085 0.002085 0.07% Castro::enforce_speed_limit() 87 0.002004 0.002004 0.002004 0.07% MLPoisson::prepareForSolve() 10 0.001987 0.001987 0.001987 0.07% MLCellLinOp::prepareForSolve() 10 0.001979 0.001979 0.001979 0.07% Gravity::average_fine_ec_onto_crse_ec() 8 0.001965 0.001965 0.001965 0.07% Castro::fill_hybrid_hydro_source() 27 0.001663 0.001663 0.001663 0.06% check_for_negative_density() 9 0.001488 0.001488 0.001488 0.05% MLPoisson::FFlux() 150 0.001464 0.001464 0.001464 0.05% average_down_faces 48 0.001303 0.001303 0.001303 0.04% FabArray::norminf(mask) 21 0.001228 0.001228 0.001228 0.04% Castro::avgDown() 4 0.001178 0.001178 0.001178 0.04% Castro::avgDown(state_indx) 20 0.001173 0.001173 0.001173 0.04% amrex::average_down_w_geom 20 0.001165 0.001165 0.001165 0.04% MLMG::MLResNormInf() 15 0.001155 0.001155 0.001155 0.04% Castro::construct_new_hybrid_source() 9 0.001026 0.001026 0.001026 0.03% OwnerMask() 6 0.001008 0.001008 0.001008 0.03% Castro::build_fine_mask() 44 0.0009709 0.0009709 0.0009709 0.03% MLMG::interpCorrection_1 17 0.0009608 0.0009608 0.0009608 0.03% Castro::derive() 6 0.0009353 0.0009353 0.0009353 0.03% AmrLevel::derive() 6 0.0009317 0.0009317 0.0009317 0.03% Castro::init() 1 0.0009099 0.0009099 0.0009099 0.03% AmrLevel::FillCoarsePatch() 5 0.0009077 0.0009077 0.0009077 0.03% TagBoxArray::collate() 6 0.0007674 0.0007674 0.0007674 0.03% FabArrayBase::getFB() 1728 0.0007443 0.0007443 0.0007443 0.02% Gravity::swapTimeLevels() 9 0.000681 0.000681 0.000681 0.02% Castro::react_state() 18 0.0006656 0.0006656 0.0006656 0.02% Castro::FluxRegFineAdd() 9 0.0006652 0.0006652 0.0006652 0.02% Castro::construct_old_hybrid_source() 9 0.0006513 0.0006513 0.0006513 0.02% MultiFab::max() 18 0.0006298 0.0006298 0.0006298 0.02% MLMG::MLRhsNormInf() 10 0.0006007 0.0006007 0.0006007 0.02% MultiFab::Multiply() 8 0.0005056 0.0005056 0.0005056 0.02% Castro::apply_problem_tags() 6 0.0004859 0.0004859 0.0004859 0.02% FabArrayBase::FB::FB() 37 0.0004413 0.0004413 0.0004413 0.01% Castro::linear_to_hybrid_momentum() 1 0.000367 0.000367 0.000367 0.01% MLLinOp::define() 10 0.000273 0.000273 0.000273 0.01% MLLinOp::defineGrids() 10 0.0002653 0.0002653 0.0002653 0.01% AMRErrorTag::operator() 6 0.0002356 0.0002356 0.0002356 0.01% Castro::construct_old_rotation_source() 9 0.0002176 0.0002176 0.0002176 0.01% Castro::construct_new_rotation_source() 9 0.0002109 0.0002109 0.0002109 0.01% AmrLevel::AmrLevel(dm) 5 0.000202 0.000202 0.000202 0.01% StateData::define() 25 0.000162 0.000162 0.000162 0.01% Castro::enforce_consistent_e() 1 0.0001477 0.0001477 0.0001477 0.00% Castro::create_source_corrector() 9 0.000128 0.000128 0.000128 0.00% Castro::swap_state_time_levels() 9 0.0001242 0.0001242 0.0001242 0.00% Castro::finalize_advance() 9 9.366e-05 9.366e-05 9.366e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 5.816e-05 5.816e-05 5.816e-05 0.00% FabArray::RecvLayoutMask() 8 5.071e-05 5.071e-05 5.071e-05 0.00% makeSFC 50 4.39e-05 4.39e-05 4.39e-05 0.00% FabArrayBase::TheFPinfo() 25 4.152e-05 4.152e-05 4.152e-05 0.00% Amr::writeSmallPlotFile() 1 3.678e-05 3.678e-05 3.678e-05 0.00% AmrMesh-cluster 4 2.219e-05 2.219e-05 2.219e-05 0.00% DistributionMapping::Distribute() 52 1.972e-05 1.972e-05 1.972e-05 0.00% FPinfo::FPinfo() 3 1.921e-05 1.921e-05 1.921e-05 0.00% ClusterList::intersect() 4 1.403e-05 1.403e-05 1.403e-05 0.00% Amr::initSubcycle() 1 1.315e-05 1.315e-05 1.315e-05 0.00% BoxList::parallelComplementIn() 12 8.342e-06 8.342e-06 8.342e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 7.955e-06 7.955e-06 7.955e-06 0.00% Gravity::set_mass_offset() 6 4.599e-06 4.599e-06 4.599e-06 0.00% BoxList::complementIn 12 3.474e-06 3.474e-06 3.474e-06 0.00% Castro::retry_advance_ctu() 5 2.74e-06 2.74e-06 2.74e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.876e-06 1.876e-06 1.876e-06 0.00% ClusterList::chop() 4 1.629e-06 1.629e-06 1.629e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1611 KiB 9037 MiB Castro::reflux() 436 436 14 MiB 666 MiB Castro::initMFs() 258 258 343 MiB 576 MiB Castro::swap_state_time_levels() 175 175 174 MiB 340 MiB StateData::define() 175 175 217 MiB 340 MiB Castro::initialize_do_advance() 143 143 117 MiB 325 MiB FillPatchIterator::Initialize 899 899 5014 KiB 303 MiB Amr::writePlotFile() 56 56 18 MiB 189 MiB Castro::problem_post_timestep() 162 162 946 KiB 167 MiB Castro::FluxRegCrseInit 660 660 466 KiB 167 MiB FluxRegister::Reflux() 648 648 1600 KiB 160 MiB Castro::initialize_advance() 143 143 47 MiB 121 MiB Castro::construct_new_source() 143 143 190 KiB 67 MiB Castro::construct_old_source() 143 143 118 KiB 67 MiB Castro::buildMetrics() 140 140 36 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 27 MiB 60 MiB Castro::Castro() 210 210 4194 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2829 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 371 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 362 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 931 KiB 16 MiB FillPatchTwoLevels 300 300 7869 B 11 MiB FillPatchInterp(MF) 330 330 4832 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 131 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4727 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 784 KiB 7424 KiB Castro::build_fine_mask() 224 224 1313 KiB 6912 KiB AmrLevel::derive() 162 162 2681 B 6912 KiB BndryData::define() 3624 3624 295 KiB 4243 KiB MLCellLinOp::reflux() 450 450 8301 B 2376 KiB Castro::wd_update() 6 6 23 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 428 B 2095 KiB amrex::average_down 1483 1483 2356 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 5915 B 1042 KiB MLMG::addInterpCorrection() 1240 1240 821 B 867 KiB MLCellLinOp::defineBC() 276 276 4040 B 689 KiB Castro::estTimeStep() 26 26 2696 B 480 KiB VisMF::Write(FabArray) 1568 1568 2387 B 320 KiB Castro::normalize_species() 87 87 7608 B 320 KiB Castro::volInBoundary() 70 70 3016 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 130 B 204 KiB FabArray::norminf(mask) 29 29 197 B 163 KiB amrex::Dot() 559 559 439 B 160 KiB FabArray::norminf() 470 470 437 B 160 KiB MultiFab::max() 18 18 32 B 160 KiB check_for_negative_density() 9 9 79 B 160 KiB Castro::initData() 1 1 46 B 160 KiB FabArray::setVal() 419 419 54 KiB 120 KiB MLMG::interpCorrection_1 34 34 27 B 91 KiB average_down_faces 99 99 623 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 290 B 57 KiB MLPoisson::Fsmooth() 228 228 3211 B 55 KiB FillBoundary_nowait() 751 751 463 B 53 KiB TagBoxArray::mapPRD 324 324 42 B 45 KiB OwnerMask() 168 168 12 B 38 KiB MLCellLinOp::applyBC() 3834 3834 147 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9337 B 25 KiB MultiFab::contains_nan() 18 18 21 B 20 KiB StateData::FillBoundary(geom) 2538 2538 107 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 655 B 3456 B MLCGSolver::bicgstab 155 155 26 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 167 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 12 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 621 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1280 B 278 KiB FabArray::setVal() 419 419 54 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 290 B 57 KiB MLPoisson::Fsmooth() 228 228 3211 B 55 KiB FillBoundary_nowait() 751 751 463 B 53 KiB MLCellLinOp::applyBC() 1917 1917 147 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9337 B 25 KiB Gravity::get_new_grav_vector() 18 18 3382 B 20 KiB Gravity::get_old_grav_vector() 12 12 6058 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 107 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1320 B 6304 B MLMG::prepareForSolve() 18 18 241 B 3712 B FabArray::norminf(mask) 29 29 135 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 655 B 3456 B Castro::FluxRegCrseInit 12 12 9 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 595 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (v2024-34-g9e8f8d60eca3) finalized