Initializing AMReX (24.04-9-g2a3955a5f5aa)... Initializing CUDA... CUDA initialized with 1 device. AMReX (24.04-9-g2a3955a5f5aa) initialized Starting run at 09:48:07 UTC on 2024-04-09. Successfully read inputs file ... Castro git describe: 24.04-11-g2407e8176 AMReX git describe: 24.04-9-g2a3955a5f Microphysics git describe: 24.04-4-ge5fecb7a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.004312551 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.002048343 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009258617 Gravity::multilevel_solve_for_new_phi() time = 0.052771366 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.142399246 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004653696 on level 0 Castro::do_old_sources() time = 0.009604167 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.136517082 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.007320405 Gravity::multilevel_solve_for_new_phi() time = 0.041770146 Castro::construct_new_gravity() time = 0.046800026 on level 0 Castro::do_new_sources() time = 0.008451064 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.877098464 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.237969624 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.00247859 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007457907 Gravity::multilevel_solve_for_new_phi() time = 0.060320521 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004655869 on level 0 Castro::do_old_sources() time = 0.007157339 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.178557912 on level 0 Castro::construct_old_gravity() time = 0.000369101 on level 1 Castro::do_old_sources() time = 0.001585022 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.008052357 on level 1 Castro::reflux() at level 0 : time = 0.018395913 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007216081 Gravity::multilevel_solve_for_new_phi() time = 0.041129605 Castro::construct_new_gravity() time = 0.046062291 on level 0 Castro::do_new_sources() time = 0.007081545 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000421598 on level 1 Castro::do_new_sources() time = 0.002409623 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.145077319 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.386554097 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.002254555 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007211901 Gravity::multilevel_solve_for_new_phi() time = 0.014996903 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003294612 on level 0 Castro::do_old_sources() time = 0.006907915 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.154026502 on level 0 Castro::construct_old_gravity() time = 0.000353294 on level 1 Castro::do_old_sources() time = 0.001512868 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.010025595 on level 1 Castro::reflux() at level 0 : time = 0.018735267 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.00722864 Gravity::multilevel_solve_for_new_phi() time = 0.028788482 Castro::construct_new_gravity() time = 0.033542571 on level 0 Castro::do_new_sources() time = 0.006743977 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000405643 on level 1 Castro::do_new_sources() time = 0.002070714 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.6334613 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.303780307 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002345019 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007183702 Gravity::multilevel_solve_for_new_phi() time = 0.015041574 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004664072 on level 0 Castro::do_old_sources() time = 0.00717983 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.147876628 on level 0 Castro::construct_old_gravity() time = 0.000328822 on level 1 Castro::do_old_sources() time = 0.001764996 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.011866323 on level 1 Castro::reflux() at level 0 : time = 0.020948706 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007236718 Gravity::multilevel_solve_for_new_phi() time = 0.036369765 Castro::construct_new_gravity() time = 0.041256766 on level 0 Castro::do_new_sources() time = 0.006625074 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000394532 on level 1 Castro::do_new_sources() time = 0.002522103 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.528504559 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.3072284 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002326665 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007224054 Gravity::multilevel_solve_for_new_phi() time = 0.01511461 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004712355 on level 0 Castro::do_old_sources() time = 0.007212988 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.172536021 on level 0 Castro::construct_old_gravity() time = 0.000354749 on level 1 Castro::do_old_sources() time = 0.001462144 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007130464 on level 1 Castro::reflux() at level 0 : time = 0.018094184 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007223231 Gravity::multilevel_solve_for_new_phi() time = 0.029154443 Castro::construct_new_gravity() time = 0.033875676 on level 0 Castro::do_new_sources() time = 0.006875801 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000417451 on level 1 Castro::do_new_sources() time = 0.002594943 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.37862297 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.320296079 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.152047635 seconds Ending run at 09:48:10 UTC on 2024-04-09. Run time = 3.148583445 Run time without initialization = 1.70879455 Average number of zones advanced per microsecond: 2.896 Average number of zones advanced per microsecond per rank: 2.896 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.149 ... 3.149 ... 3.149 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0576 1.0576 1.0576 33.59% Castro::construct_ctu_hydro_source() 9 0.79 0.79 0.79 25.09% VisMF::Write(FabArray) 3 0.2876 0.2876 0.2876 9.13% Castro::initMFs() 5 0.1506 0.1506 0.1506 4.78% Gravity::fill_multipole_BCs() 10 0.07265 0.07265 0.07265 2.31% Castro::normalize_species() 87 0.06321 0.06321 0.06321 2.01% Castro::computeTemp() 88 0.06171 0.06171 0.06171 1.96% MLCellLinOp::applyBC() 1917 0.05489 0.05489 0.05489 1.74% FillBoundary_nowait() 1728 0.0429 0.0429 0.0429 1.36% FabArray::setVal() 920 0.03787 0.03787 0.03787 1.20% StateDataPhysBCFunct::() 95 0.03659 0.03659 0.03659 1.16% StateData::FillBoundary(geom) 650 0.03079 0.03079 0.03079 0.98% FabArray::ParallelCopy_nowait() 954 0.03024 0.03024 0.03024 0.96% Castro::volInBoundary() 42 0.02905 0.02905 0.02905 0.92% amrex::Copy() 441 0.02651 0.02651 0.02651 0.84% Castro::reset_internal_energy(MultiFab) 88 0.02308 0.02308 0.02308 0.73% FluxRegister::Reflux() 24 0.0224 0.0224 0.0224 0.71% MLCellLinOp::defineAuxData() 10 0.02019 0.02019 0.02019 0.64% amrex::Add() 136 0.01729 0.01729 0.01729 0.55% Castro::estTimeStep() 26 0.01711 0.01711 0.01711 0.54% FabArray::Saxpy() 604 0.01581 0.01581 0.01581 0.50% Castro::reflux() 4 0.01464 0.01464 0.01464 0.47% Castro::construct_new_source() 63 0.0139 0.0139 0.0139 0.44% BndryData::define() 26 0.0125 0.0125 0.0125 0.40% MLPoisson::Fsmooth() 1376 0.01229 0.01229 0.01229 0.39% MLCellLinOp::reflux() 30 0.01185 0.01185 0.01185 0.38% Castro::enforce_min_density() 87 0.01136 0.01136 0.01136 0.36% Castro::problem_post_timestep() 10 0.01087 0.01087 0.01087 0.35% amrex::Dot() 466 0.009001 0.009001 0.009001 0.29% FabArray::norminf() 439 0.008587 0.008587 0.008587 0.27% Castro::construct_old_gravity_source() 18 0.008149 0.008149 0.008149 0.26% Castro::FluxRegCrseInit 9 0.007954 0.007954 0.007954 0.25% AmrMesh::MakeNewGrids() 6 0.007724 0.007724 0.007724 0.25% MLPoisson::Fapply() 493 0.006759 0.006759 0.006759 0.21% Castro::initData() 1 0.006455 0.006455 0.006455 0.21% FabArray::Xpay() 353 0.006452 0.006452 0.006452 0.20% amrex::average_down 233 0.006125 0.006125 0.006125 0.19% Castro::construct_new_gravity_source() 9 0.005329 0.005329 0.005329 0.17% Castro::wd_update() 6 0.004697 0.004697 0.004697 0.15% Castro::reset_internal_energy(Fab) 1476 0.004641 0.004641 0.004641 0.15% Amr::writePlotFile() 2 0.00463 0.00463 0.00463 0.15% Castro::construct_old_source() 63 0.004625 0.004625 0.004625 0.15% MLMG::addInterpCorrection() 155 0.004434 0.004434 0.004434 0.14% Gravity::actual_solve_with_mlmg() 10 0.003868 0.003868 0.003868 0.12% FabArrayBase::CPC::define() 534 0.00374 0.00374 0.00374 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003645 0.003645 0.003645 0.12% FillPatchInterp(MF) 30 0.003638 0.003638 0.003638 0.12% Castro::enforce_speed_limit() 87 0.003562 0.003562 0.003562 0.11% check_for_negative_density() 9 0.003516 0.003516 0.003516 0.11% FabArray::setDomainBndry() 92 0.003317 0.003317 0.003317 0.11% MultiFab::contains_nan() 18 0.003248 0.003248 0.003248 0.10% MLCellLinOp::compGrad() 18 0.002894 0.002894 0.002894 0.09% MLCellLinOp::defineBC() 10 0.002669 0.002669 0.002669 0.08% FabArray::mult() 55 0.002586 0.002586 0.002586 0.08% MLCellLinOp::setLevelBC() 18 0.002409 0.002409 0.002409 0.08% Castro::apply_tagging_restrictions() 6 0.002086 0.002086 0.002086 0.07% MLCellLinOp::prepareForSolve() 10 0.002011 0.002011 0.002011 0.06% MLMG::prepareForSolve() 10 0.001845 0.001845 0.001845 0.06% Castro::fill_hybrid_hydro_source() 27 0.00169 0.00169 0.00169 0.05% MLPoisson::FFlux() 150 0.0014 0.0014 0.0014 0.04% MLCellLinOp::updateSolBC() 25 0.001366 0.001366 0.001366 0.04% Gravity::get_new_grav_vector() 10 0.001331 0.001331 0.001331 0.04% TagBoxArray::mapPRD 6 0.001304 0.001304 0.001304 0.04% FabArray::norminf(mask) 21 0.001221 0.001221 0.001221 0.04% FabArrayBase::getCPC() 1522 0.001135 0.001135 0.001135 0.04% OwnerMask() 6 0.001001 0.001001 0.001001 0.03% Gravity::get_old_grav_vector() 9 0.0009956 0.0009956 0.0009956 0.03% MLCellLinOp::updateCorBC() 17 0.0009937 0.0009937 0.0009937 0.03% Castro::build_fine_mask() 44 0.000958 0.000958 0.000958 0.03% average_down_faces 48 0.0008561 0.0008561 0.0008561 0.03% Castro::post_timestep() 9 0.0008491 0.0008491 0.0008491 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0008295 0.0008295 0.0008295 0.03% TagBoxArray::collate() 6 0.0007667 0.0007667 0.0007667 0.02% FillPatchTwoLevels 31 0.000753 0.000753 0.000753 0.02% MLCGSolver::bicgstab 31 0.0007156 0.0007156 0.0007156 0.02% main() 1 0.0007084 0.0007084 0.0007084 0.02% Castro::FluxRegFineAdd() 9 0.0006542 0.0006542 0.0006542 0.02% AmrLevel::FillPatch() 62 0.0006298 0.0006298 0.0006298 0.02% MultiFab::max() 18 0.0006039 0.0006039 0.0006039 0.02% FillPatchIterator::Initialize 62 0.0005764 0.0005764 0.0005764 0.02% MultiFab::Multiply() 8 0.0005046 0.0005046 0.0005046 0.02% MLCellLinOp::smooth() 688 0.0004796 0.0004796 0.0004796 0.02% Castro::apply_problem_tags() 6 0.0004688 0.0004688 0.0004688 0.01% FabArrayBase::FB::FB() 37 0.0004364 0.0004364 0.0004364 0.01% MLMG::interpCorrection_1 17 0.0004097 0.0004097 0.0004097 0.01% FabArray::FillBoundary() 1728 0.0004026 0.0004026 0.0004026 0.01% Amr::regrid() 5 0.0003802 0.0003802 0.0003802 0.01% Castro::Castro() 5 0.0003767 0.0003767 0.0003767 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003565 0.0003565 0.0003565 0.01% Castro::clean_state() 87 0.0003309 0.0003309 0.0003309 0.01% FabArray::ParallelCopy() 954 0.0003304 0.0003304 0.0003304 0.01% FabArrayBase::getFB() 1728 0.0002994 0.0002994 0.0002994 0.01% Castro::initialize_do_advance() 9 0.0002777 0.0002777 0.0002777 0.01% Gravity::update_max_rhs() 10 0.0002716 0.0002716 0.0002716 0.01% Castro::subcycle_advance_ctu() 5 0.0002581 0.0002581 0.0002581 0.01% Amr::coarseTimeStep() 5 0.0002464 0.0002464 0.0002464 0.01% Gravity::actual_multilevel_solve() 10 0.0002436 0.0002436 0.0002436 0.01% MLCellLinOp::apply() 493 0.0002366 0.0002366 0.0002366 0.01% AMRErrorTag::operator() 6 0.0002325 0.0002325 0.0002325 0.01% Castro::construct_new_rotation_source() 9 0.000212 0.000212 0.000212 0.01% Castro::construct_old_rotation_source() 9 0.0002011 0.0002011 0.0002011 0.01% MLLinOp::defineGrids() 10 0.0001987 0.0001987 0.0001987 0.01% Castro::finalize_do_advance() 9 0.0001762 0.0001762 0.0001762 0.01% Castro::initialize_advance() 9 0.0001746 0.0001746 0.0001746 0.01% StateData::define() 25 0.0001739 0.0001739 0.0001739 0.01% Castro::enforce_consistent_e() 1 0.0001435 0.0001435 0.0001435 0.00% Castro::do_advance_ctu() 5 0.0001374 0.0001374 0.0001374 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001335 0.0001335 0.0001335 0.00% MLCGSolver::ParallelAllReduce 745 0.0001314 0.0001314 0.0001314 0.00% Castro::swap_state_time_levels() 9 0.000129 0.000129 0.000129 0.00% Castro::construct_new_gravity() 9 0.0001258 0.0001258 0.0001258 0.00% Castro::do_old_sources() 9 0.0001244 0.0001244 0.0001244 0.00% Castro::do_new_sources() 9 0.0001217 0.0001217 0.0001217 0.00% Castro::construct_old_gravity() 9 0.0001159 0.0001159 0.0001159 0.00% Castro::post_regrid() 10 0.0001074 0.0001074 0.0001074 0.00% MLMG::mgVcycle() 65 0.0001039 0.0001039 0.0001039 0.00% Castro::buildMetrics() 5 0.0001018 0.0001018 0.0001018 0.00% MLCellLinOp::correctionResidual() 189 9.944e-05 9.944e-05 9.944e-05 0.00% Castro::finalize_advance() 9 9.211e-05 9.211e-05 9.211e-05 0.00% Castro::advance() 5 9.133e-05 9.133e-05 9.133e-05 0.00% Amr::grid_places() 6 8.675e-05 8.675e-05 8.675e-05 0.00% AmrLevel::derive() 6 7.834e-05 7.834e-05 7.834e-05 0.00% Amr::timeStep() 9 7.715e-05 7.715e-05 7.715e-05 0.00% FillPatchSingleLevel 92 6.029e-05 6.029e-05 6.029e-05 0.00% MLMG::oneIter() 31 5.517e-05 5.517e-05 5.517e-05 0.00% Castro::errorEst() 6 5.054e-05 5.054e-05 5.054e-05 0.00% FabArray::RecvLayoutMask() 8 4.924e-05 4.924e-05 4.924e-05 0.00% MLMG:computeResOfCorrection() 155 4.813e-05 4.813e-05 4.813e-05 0.00% MLMG::solve() 10 4.729e-05 4.729e-05 4.729e-05 0.00% MLCellLinOp::solutionResidual() 71 4.248e-05 4.248e-05 4.248e-05 0.00% Amr::writeSmallPlotFile() 1 4.172e-05 4.172e-05 4.172e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.155e-05 4.155e-05 4.155e-05 0.00% MLMG::actualBottomSolve() 31 4.131e-05 4.131e-05 4.131e-05 0.00% Castro::react_state() 18 4.124e-05 4.124e-05 4.124e-05 0.00% Castro::computeNewDt() 8 4.093e-05 4.093e-05 4.093e-05 0.00% MLMG::mgVcycle_down::0 31 4.004e-05 4.004e-05 4.004e-05 0.00% MLMG::mgVcycle_bottom 65 3.979e-05 3.979e-05 3.979e-05 0.00% Castro::create_source_corrector() 9 3.961e-05 3.961e-05 3.961e-05 0.00% Gravity::solve_phi_with_mlmg() 10 3.86e-05 3.86e-05 3.86e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.804e-05 3.804e-05 3.804e-05 0.00% Amr::defBaseLevel() 1 3.703e-05 3.703e-05 3.703e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.649e-05 3.649e-05 3.649e-05 0.00% MLMG::mgVcycle_down::1 31 3.331e-05 3.331e-05 3.331e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.192e-05 3.192e-05 3.192e-05 0.00% MLMG::mgVcycle_down::3 31 3.002e-05 3.002e-05 3.002e-05 0.00% MLMG::mgVcycle_down::2 31 2.933e-05 2.933e-05 2.933e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.685e-05 2.685e-05 2.685e-05 0.00% makeSFC 50 2.663e-05 2.663e-05 2.663e-05 0.00% MLMG::mgVcycle_down::4 31 2.645e-05 2.645e-05 2.645e-05 0.00% MLMG::ResNormInf() 54 2.504e-05 2.504e-05 2.504e-05 0.00% MLMG::mgVcycle_up::4 31 2.259e-05 2.259e-05 2.259e-05 0.00% MLMG::mgVcycle_up::0 31 2.186e-05 2.186e-05 2.186e-05 0.00% MLMG::mgVcycle_up::3 31 2.145e-05 2.145e-05 2.145e-05 0.00% DistributionMapping::Distribute() 52 2.092e-05 2.092e-05 2.092e-05 0.00% MLMG::mgVcycle_up::1 31 2.066e-05 2.066e-05 2.066e-05 0.00% BoxList::parallelComplementIn() 12 2.023e-05 2.023e-05 2.023e-05 0.00% FabArrayBase::TheFPinfo() 25 1.997e-05 1.997e-05 1.997e-05 0.00% FPinfo::FPinfo() 3 1.965e-05 1.965e-05 1.965e-05 0.00% MLPoisson::define() 10 1.927e-05 1.927e-05 1.927e-05 0.00% MLMG::mgVcycle_up::2 31 1.908e-05 1.908e-05 1.908e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.543e-05 1.543e-05 1.543e-05 0.00% MLMG::miniCycle() 34 1.457e-05 1.457e-05 1.457e-05 0.00% Amr::FinalizeInit() 1 1.425e-05 1.425e-05 1.425e-05 0.00% Castro::construct_old_hybrid_source() 9 1.408e-05 1.408e-05 1.408e-05 0.00% Amr::initSubcycle() 1 1.407e-05 1.407e-05 1.407e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.384e-05 1.384e-05 1.384e-05 0.00% MLMG::computeResidual() 31 1.378e-05 1.378e-05 1.378e-05 0.00% Castro::construct_new_hybrid_source() 9 1.358e-05 1.358e-05 1.358e-05 0.00% MLMG::computeMLResidual() 15 1.344e-05 1.344e-05 1.344e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.332e-05 1.332e-05 1.332e-05 0.00% ClusterList::intersect() 4 1.237e-05 1.237e-05 1.237e-05 0.00% Castro::check_for_nan() 18 1.079e-05 1.079e-05 1.079e-05 0.00% Castro::post_init() 1 1.029e-05 1.029e-05 1.029e-05 0.00% Castro::apply_source_to_state() 18 8.848e-06 8.848e-06 8.848e-06 0.00% MLLinOp::define() 10 8.374e-06 8.374e-06 8.374e-06 0.00% MLMG::getGradSolution() 10 8.361e-06 8.361e-06 8.361e-06 0.00% Castro::expand_state() 13 8.18e-06 8.18e-06 8.18e-06 0.00% Gravity::swapTimeLevels() 9 7.508e-06 7.508e-06 7.508e-06 0.00% MLMG::MLResNormInf() 15 7.338e-06 7.338e-06 7.338e-06 0.00% AmrMesh-cluster 4 7.274e-06 7.274e-06 7.274e-06 0.00% MLPoisson::prepareForSolve() 10 7.224e-06 7.224e-06 7.224e-06 0.00% Castro::avgDown(state_indx) 20 7.144e-06 7.144e-06 7.144e-06 0.00% Amr::InitializeInit() 1 7.056e-06 7.056e-06 7.056e-06 0.00% amrex::average_down_w_geom 20 6.849e-06 6.849e-06 6.849e-06 0.00% MLMG::MLRhsNormInf() 10 5.108e-06 5.108e-06 5.108e-06 0.00% Castro::init(old) 3 4.763e-06 4.763e-06 4.763e-06 0.00% BoxList::complementIn 12 4.629e-06 4.629e-06 4.629e-06 0.00% Gravity::set_mass_offset() 6 4.319e-06 4.319e-06 4.319e-06 0.00% Castro::avgDown() 4 3.789e-06 3.789e-06 3.789e-06 0.00% Castro::derive() 6 3.577e-06 3.577e-06 3.577e-06 0.00% Castro::computeInitialDt() 2 3.1e-06 3.1e-06 3.1e-06 0.00% Castro::retry_advance_ctu() 5 2.794e-06 2.794e-06 2.794e-06 0.00% Amr::bldFineLevels() 1 2.513e-06 2.513e-06 2.513e-06 0.00% Castro::init() 1 2.28e-06 2.28e-06 2.28e-06 0.00% Amr::init() 1 2.079e-06 2.079e-06 2.079e-06 0.00% ClusterList::chop() 4 2.053e-06 2.053e-06 2.053e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.736e-06 1.736e-06 1.736e-06 0.00% Amr::initialInit() 1 1.099e-06 1.099e-06 1.099e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.149 3.149 3.149 100.00% Amr::coarseTimeStep() 5 1.556 1.556 1.556 49.42% Amr::timeStep() 9 1.551 1.551 1.551 49.25% Castro::advance() 5 1.342 1.342 1.342 42.64% Castro::subcycle_advance_ctu() 5 1.321 1.321 1.321 41.94% Castro::do_advance_ctu() 5 1.32 1.32 1.32 41.94% Amr::InitAmr() 1 1.058 1.058 1.058 33.59% Castro::construct_ctu_hydro_source() 9 0.8266 0.8266 0.8266 26.25% Amr::init() 1 0.382 0.382 0.382 12.13% Gravity::multilevel_solve_for_new_phi() 10 0.3356 0.3356 0.3356 10.66% Gravity::actual_multilevel_solve() 10 0.3348 0.3348 0.3348 10.63% Gravity::solve_phi_with_mlmg() 10 0.3317 0.3317 0.3317 10.53% Amr::writePlotFile() 2 0.2946 0.2946 0.2946 9.36% VisMF::Write(FabArray) 3 0.2876 0.2876 0.2876 9.13% Gravity::actual_solve_with_mlmg() 10 0.2565 0.2565 0.2565 8.15% Amr::initialInit() 1 0.2395 0.2395 0.2395 7.61% MLMG::solve() 10 0.2047 0.2047 0.2047 6.50% Castro::construct_new_gravity() 9 0.2033 0.2033 0.2033 6.46% MLMG::oneIter() 31 0.1736 0.1736 0.1736 5.51% Castro::clean_state() 87 0.1666 0.1666 0.1666 5.29% Amr::InitializeInit() 1 0.1643 0.1643 0.1643 5.22% Amr::defBaseLevel() 1 0.1643 0.1643 0.1643 5.22% Castro::Castro() 5 0.1545 0.1545 0.1545 4.91% Castro::initMFs() 5 0.1506 0.1506 0.1506 4.78% MLMG::mgVcycle() 65 0.1488 0.1488 0.1488 4.73% Amr::regrid() 5 0.1473 0.1473 0.1473 4.68% Castro::post_regrid() 10 0.1318 0.1318 0.1318 4.18% AmrLevel::FillPatch() 62 0.1094 0.1094 0.1094 3.47% MLCellLinOp::applyBC() 1917 0.09893 0.09893 0.09893 3.14% FillPatchIterator::Initialize 62 0.09495 0.09495 0.09495 3.02% Castro::computeTemp() 88 0.08943 0.08943 0.08943 2.84% MLCellLinOp::smooth() 688 0.08832 0.08832 0.08832 2.80% FillPatchSingleLevel 92 0.0865 0.0865 0.0865 2.75% FillPatchIterator::FillFromLevel0() 31 0.08385 0.08385 0.08385 2.66% Castro::reflux() 4 0.07621 0.07621 0.07621 2.42% Amr::FinalizeInit() 1 0.07525 0.07525 0.07525 2.39% Gravity::fill_multipole_BCs() 10 0.07468 0.07468 0.07468 2.37% StateDataPhysBCFunct::() 95 0.06738 0.06738 0.06738 2.14% Castro::normalize_species() 87 0.06321 0.06321 0.06321 2.01% Castro::post_init() 1 0.06314 0.06314 0.06314 2.01% Castro::post_timestep() 9 0.06123 0.06123 0.06123 1.94% Castro::initialize_do_advance() 9 0.05313 0.05313 0.05313 1.69% Castro::problem_post_timestep() 10 0.04994 0.04994 0.04994 1.59% Castro::do_new_sources() 9 0.04544 0.04544 0.04544 1.44% Castro::do_old_sources() 9 0.04447 0.04447 0.04447 1.41% Castro::expand_state() 13 0.04437 0.04437 0.04437 1.41% FabArray::FillBoundary() 1728 0.04403 0.04403 0.04403 1.40% FillBoundary_nowait() 1728 0.04363 0.04363 0.04363 1.39% MLPoisson::define() 10 0.04121 0.04121 0.04121 1.31% FabArray::setVal() 920 0.03787 0.03787 0.03787 1.20% MLMG::mgVcycle_bottom 65 0.03757 0.03757 0.03757 1.19% FabArray::ParallelCopy() 954 0.03455 0.03455 0.03455 1.10% FabArray::ParallelCopy_nowait() 954 0.03422 0.03422 0.03422 1.09% Castro::wd_update() 6 0.03375 0.03375 0.03375 1.07% Gravity::get_new_grav_vector() 10 0.03117 0.03117 0.03117 0.99% StateData::FillBoundary(geom) 650 0.03079 0.03079 0.03079 0.98% MLMG::actualBottomSolve() 31 0.03062 0.03062 0.03062 0.97% MLCGSolver::bicgstab 31 0.03032 0.03032 0.03032 0.96% FluxRegister::Reflux() 24 0.02967 0.02967 0.02967 0.94% MLMG::mgVcycle_down::0 31 0.02913 0.02913 0.02913 0.93% Castro::volInBoundary() 42 0.02905 0.02905 0.02905 0.92% MLCellLinOp::apply() 493 0.02782 0.02782 0.02782 0.88% Castro::reset_internal_energy(MultiFab) 88 0.02772 0.02772 0.02772 0.88% amrex::Copy() 441 0.02651 0.02651 0.02651 0.84% Castro::construct_new_source() 63 0.02646 0.02646 0.02646 0.84% MLCellLinOp::defineAuxData() 10 0.02353 0.02353 0.02353 0.75% Castro::construct_old_gravity() 9 0.02347 0.02347 0.02347 0.75% Gravity::get_old_grav_vector() 9 0.02336 0.02336 0.02336 0.74% MLMG::mgVcycle_up::0 31 0.02174 0.02174 0.02174 0.69% Castro::initialize_advance() 9 0.02162 0.02162 0.02162 0.69% MLCellLinOp::correctionResidual() 189 0.01813 0.01813 0.01813 0.58% MLCellLinOp::reflux() 30 0.01799 0.01799 0.01799 0.57% MLCellLinOp::defineBC() 10 0.0174 0.0174 0.0174 0.55% amrex::Add() 136 0.01729 0.01729 0.01729 0.55% Castro::estTimeStep() 26 0.01711 0.01711 0.01711 0.54% Amr::grid_places() 6 0.01582 0.01582 0.01582 0.50% FabArray::Saxpy() 604 0.01581 0.01581 0.01581 0.50% AmrMesh::MakeNewGrids() 6 0.01574 0.01574 0.01574 0.50% MLMG::computeResWithCrseSolFineCor() 17 0.01495 0.01495 0.01495 0.47% MLCellLinOp::solutionResidual() 71 0.01459 0.01459 0.01459 0.46% BndryData::define() 26 0.01459 0.01459 0.01459 0.46% MLMG:computeResOfCorrection() 155 0.01392 0.01392 0.01392 0.44% MLMG::computeMLResidual() 15 0.01367 0.01367 0.01367 0.43% Castro::construct_old_source() 63 0.01295 0.01295 0.01295 0.41% MLPoisson::Fsmooth() 1376 0.01229 0.01229 0.01229 0.39% MLMG::mgVcycle_up::2 31 0.01203 0.01203 0.01203 0.38% MLMG::mgVcycle_down::1 31 0.01153 0.01153 0.01153 0.37% Castro::enforce_min_density() 87 0.01136 0.01136 0.01136 0.36% Castro::initData() 1 0.01136 0.01136 0.01136 0.36% amrex::average_down 233 0.009776 0.009776 0.009776 0.31% amrex::Dot() 466 0.009001 0.009001 0.009001 0.29% Castro::FluxRegCrseInit 9 0.008995 0.008995 0.008995 0.29% MLMG::prepareForSolve() 10 0.008788 0.008788 0.008788 0.28% Amr::bldFineLevels() 1 0.008591 0.008591 0.008591 0.27% FabArray::norminf() 439 0.008587 0.008587 0.008587 0.27% MLMG::mgVcycle_up::1 31 0.008363 0.008363 0.008363 0.27% Castro::construct_old_gravity_source() 18 0.008149 0.008149 0.008149 0.26% Castro::computeNewDt() 8 0.007572 0.007572 0.007572 0.24% FillPatchIterator::FillFromTwoLevels() 31 0.007388 0.007388 0.007388 0.23% FillPatchTwoLevels 31 0.007356 0.007356 0.007356 0.23% Castro::finalize_do_advance() 9 0.007004 0.007004 0.007004 0.22% MLMG::miniCycle() 34 0.006969 0.006969 0.006969 0.22% MLMG::addInterpCorrection() 155 0.006821 0.006821 0.006821 0.22% MLPoisson::Fapply() 493 0.006759 0.006759 0.006759 0.21% MLMG::mgVcycle_down::2 31 0.006712 0.006712 0.006712 0.21% FabArray::Xpay() 353 0.006452 0.006452 0.006452 0.20% MLMG::mgVcycle_down::3 31 0.006125 0.006125 0.006125 0.19% MLMG::mgVcycle_down::4 31 0.005979 0.005979 0.005979 0.19% MLMG::computeResidual() 31 0.005835 0.005835 0.005835 0.19% Castro::construct_new_gravity_source() 9 0.005329 0.005329 0.005329 0.17% MLCGSolver::ParallelAllReduce 745 0.005087 0.005087 0.005087 0.16% FabArrayBase::getCPC() 1522 0.004874 0.004874 0.004874 0.15% MLMG::mgVcycle_up::4 31 0.004843 0.004843 0.004843 0.15% MLMG::mgVcycle_up::3 31 0.004652 0.004652 0.004652 0.15% Castro::reset_internal_energy(Fab) 1476 0.004641 0.004641 0.004641 0.15% MLMG::getGradSolution() 10 0.004354 0.004354 0.004354 0.14% MLCellLinOp::compGrad() 18 0.004346 0.004346 0.004346 0.14% Castro::apply_source_to_state() 18 0.00422 0.00422 0.00422 0.13% Castro::errorEst() 6 0.003766 0.003766 0.003766 0.12% FabArrayBase::CPC::define() 534 0.00374 0.00374 0.00374 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003645 0.003645 0.003645 0.12% FillPatchInterp(MF) 30 0.003638 0.003638 0.003638 0.12% Castro::enforce_speed_limit() 87 0.003562 0.003562 0.003562 0.11% check_for_negative_density() 9 0.003516 0.003516 0.003516 0.11% MLMG::computeResWithCrseCorFineCor() 17 0.003496 0.003496 0.003496 0.11% FabArray::setDomainBndry() 92 0.003317 0.003317 0.003317 0.11% MLCellLinOp::updateSolBC() 25 0.003285 0.003285 0.003285 0.10% Castro::check_for_nan() 18 0.003258 0.003258 0.003258 0.10% MultiFab::contains_nan() 18 0.003248 0.003248 0.003248 0.10% TagBoxArray::mapPRD 6 0.003151 0.003151 0.003151 0.10% Castro::init(old) 3 0.003029 0.003029 0.003029 0.10% Castro::computeInitialDt() 2 0.002753 0.002753 0.002753 0.09% FabArray::mult() 55 0.002586 0.002586 0.002586 0.08% Castro::buildMetrics() 5 0.002461 0.002461 0.002461 0.08% MLCellLinOp::setLevelBC() 18 0.002409 0.002409 0.002409 0.08% MLCellLinOp::updateCorBC() 17 0.002273 0.002273 0.002273 0.07% MLMG::ResNormInf() 54 0.002088 0.002088 0.002088 0.07% Castro::apply_tagging_restrictions() 6 0.002086 0.002086 0.002086 0.07% Gravity::update_max_rhs() 10 0.002051 0.002051 0.002051 0.07% MLPoisson::prepareForSolve() 10 0.002018 0.002018 0.002018 0.06% MLCellLinOp::prepareForSolve() 10 0.002011 0.002011 0.002011 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.001938 0.001938 0.001938 0.06% Castro::fill_hybrid_hydro_source() 27 0.00169 0.00169 0.00169 0.05% MLPoisson::FFlux() 150 0.0014 0.0014 0.0014 0.04% average_down_faces 48 0.001276 0.001276 0.001276 0.04% FabArray::norminf(mask) 21 0.001221 0.001221 0.001221 0.04% Castro::avgDown() 4 0.001184 0.001184 0.001184 0.04% Castro::avgDown(state_indx) 20 0.001181 0.001181 0.001181 0.04% amrex::average_down_w_geom 20 0.001174 0.001174 0.001174 0.04% MLMG::MLResNormInf() 15 0.001142 0.001142 0.001142 0.04% Castro::construct_new_hybrid_source() 9 0.001026 0.001026 0.001026 0.03% OwnerMask() 6 0.001001 0.001001 0.001001 0.03% MLMG::interpCorrection_1 17 0.0009649 0.0009649 0.0009649 0.03% Castro::build_fine_mask() 44 0.000958 0.000958 0.000958 0.03% Castro::derive() 6 0.0009282 0.0009282 0.0009282 0.03% AmrLevel::derive() 6 0.0009246 0.0009246 0.0009246 0.03% Castro::init() 1 0.0009236 0.0009236 0.0009236 0.03% AmrLevel::FillCoarsePatch() 5 0.0009213 0.0009213 0.0009213 0.03% TagBoxArray::collate() 6 0.0007667 0.0007667 0.0007667 0.02% FabArrayBase::getFB() 1728 0.0007358 0.0007358 0.0007358 0.02% Castro::construct_old_hybrid_source() 9 0.000691 0.000691 0.000691 0.02% Gravity::swapTimeLevels() 9 0.0006771 0.0006771 0.0006771 0.02% Castro::FluxRegFineAdd() 9 0.0006542 0.0006542 0.0006542 0.02% MultiFab::max() 18 0.0006039 0.0006039 0.0006039 0.02% MLMG::MLRhsNormInf() 10 0.0006036 0.0006036 0.0006036 0.02% MultiFab::Multiply() 8 0.0005046 0.0005046 0.0005046 0.02% Castro::apply_problem_tags() 6 0.0004688 0.0004688 0.0004688 0.01% FabArrayBase::FB::FB() 37 0.0004364 0.0004364 0.0004364 0.01% Castro::react_state() 18 0.0004216 0.0004216 0.0004216 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003565 0.0003565 0.0003565 0.01% MLLinOp::define() 10 0.00027 0.00027 0.00027 0.01% MLLinOp::defineGrids() 10 0.0002616 0.0002616 0.0002616 0.01% AMRErrorTag::operator() 6 0.0002325 0.0002325 0.0002325 0.01% Castro::construct_new_rotation_source() 9 0.000212 0.000212 0.000212 0.01% AmrLevel::AmrLevel(dm) 5 0.000212 0.000212 0.000212 0.01% Castro::construct_old_rotation_source() 9 0.0002011 0.0002011 0.0002011 0.01% StateData::define() 25 0.0001739 0.0001739 0.0001739 0.01% Castro::enforce_consistent_e() 1 0.0001435 0.0001435 0.0001435 0.00% Castro::swap_state_time_levels() 9 0.000129 0.000129 0.000129 0.00% Castro::finalize_advance() 9 9.211e-05 9.211e-05 9.211e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 6.113e-05 6.113e-05 6.113e-05 0.00% FabArray::RecvLayoutMask() 8 4.924e-05 4.924e-05 4.924e-05 0.00% makeSFC 50 4.57e-05 4.57e-05 4.57e-05 0.00% Amr::writeSmallPlotFile() 1 4.172e-05 4.172e-05 4.172e-05 0.00% FabArrayBase::TheFPinfo() 25 3.962e-05 3.962e-05 3.962e-05 0.00% Castro::create_source_corrector() 9 3.961e-05 3.961e-05 3.961e-05 0.00% BoxList::parallelComplementIn() 12 2.486e-05 2.486e-05 2.486e-05 0.00% AmrMesh-cluster 4 2.17e-05 2.17e-05 2.17e-05 0.00% DistributionMapping::Distribute() 52 2.092e-05 2.092e-05 2.092e-05 0.00% FPinfo::FPinfo() 3 1.965e-05 1.965e-05 1.965e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.569e-05 1.569e-05 1.569e-05 0.00% Amr::initSubcycle() 1 1.407e-05 1.407e-05 1.407e-05 0.00% ClusterList::intersect() 4 1.237e-05 1.237e-05 1.237e-05 0.00% BoxList::complementIn 12 4.629e-06 4.629e-06 4.629e-06 0.00% Gravity::set_mass_offset() 6 4.319e-06 4.319e-06 4.319e-06 0.00% Castro::retry_advance_ctu() 5 2.794e-06 2.794e-06 2.794e-06 0.00% ClusterList::chop() 4 2.053e-06 2.053e-06 2.053e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.736e-06 1.736e-06 1.736e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1621 KiB 9037 MiB Castro::reflux() 436 436 13 MiB 666 MiB Castro::initMFs() 258 258 349 MiB 576 MiB Castro::swap_state_time_levels() 175 175 181 MiB 340 MiB StateData::define() 175 175 221 MiB 340 MiB Castro::initialize_do_advance() 143 143 127 MiB 325 MiB FillPatchIterator::Initialize 899 899 4473 KiB 303 MiB Amr::writePlotFile() 56 56 16 MiB 189 MiB Castro::problem_post_timestep() 162 162 761 KiB 167 MiB Castro::FluxRegCrseInit 660 660 447 KiB 167 MiB FluxRegister::Reflux() 648 648 1530 KiB 160 MiB Castro::initialize_advance() 143 143 51 MiB 121 MiB Castro::construct_new_source() 143 143 252 KiB 67 MiB Castro::construct_old_source() 143 143 135 KiB 67 MiB Castro::buildMetrics() 140 140 37 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 28 MiB 60 MiB Castro::Castro() 210 210 4073 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2800 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 248 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 329 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 921 KiB 16 MiB FillPatchTwoLevels 300 300 7544 B 11 MiB FillPatchInterp(MF) 330 330 4656 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 134 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4479 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 773 KiB 7424 KiB Castro::build_fine_mask() 224 224 1211 KiB 6912 KiB AmrLevel::derive() 162 162 2549 B 6912 KiB BndryData::define() 3624 3624 291 KiB 4243 KiB MLCellLinOp::reflux() 450 450 7029 B 2376 KiB Castro::wd_update() 6 6 23 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 420 B 2095 KiB amrex::average_down 1483 1483 2357 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 5260 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 786 B 867 KiB MLCellLinOp::defineBC() 276 276 4014 B 689 KiB Castro::estTimeStep() 26 26 2582 B 480 KiB VisMF::Write(FabArray) 1568 1568 2261 B 320 KiB Castro::normalize_species() 87 87 6525 B 320 KiB Castro::volInBoundary() 70 70 2991 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 123 B 204 KiB FabArray::norminf(mask) 29 29 195 B 163 KiB amrex::Dot() 559 559 424 B 160 KiB FabArray::norminf() 470 470 421 B 160 KiB MultiFab::max() 18 18 30 B 160 KiB check_for_negative_density() 9 9 181 B 160 KiB Castro::initData() 1 1 43 B 160 KiB FabArray::setVal() 419 419 55 KiB 120 KiB MLMG::interpCorrection_1 34 34 26 B 91 KiB average_down_faces 99 99 643 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 278 B 57 KiB MLPoisson::Fsmooth() 228 228 3199 B 55 KiB FillBoundary_nowait() 751 751 448 B 53 KiB TagBoxArray::mapPRD 324 324 40 B 45 KiB OwnerMask() 168 168 11 B 38 KiB MLCellLinOp::applyBC() 3834 3834 144 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9687 B 25 KiB MultiFab::contains_nan() 18 18 20 B 20 KiB StateData::FillBoundary(geom) 2538 2538 83 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 604 B 3456 B MLCGSolver::bicgstab 155 155 25 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 167 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 17 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 581 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1244 B 278 KiB FabArray::setVal() 419 419 55 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 278 B 57 KiB MLPoisson::Fsmooth() 228 228 3199 B 55 KiB FillBoundary_nowait() 751 751 449 B 53 KiB MLCellLinOp::applyBC() 1917 1917 144 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9687 B 25 KiB Gravity::get_new_grav_vector() 18 18 3394 B 20 KiB Gravity::get_old_grav_vector() 12 12 6600 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 84 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1354 B 6304 B MLMG::prepareForSolve() 18 18 238 B 3712 B FabArray::norminf(mask) 29 29 136 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 604 B 3456 B Castro::FluxRegCrseInit 12 12 8 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 616 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1781 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (24.04-9-g2a3955a5f5aa) finalized