Initializing AMReX (24.04-3-gd78e241d1ad4)... Initializing CUDA... CUDA initialized with 1 device. AMReX (24.04-3-gd78e241d1ad4) initialized Starting run at 08:48:43 UTC on 2024-04-03. Successfully read inputs file ... Castro git describe: 24.04-1-g6930369b2 AMReX git describe: 24.04-3-gd78e241d1 Microphysics git describe: 24.04 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003384095 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001800598 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009293939 Gravity::multilevel_solve_for_new_phi() time = 0.052649006 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.144540141 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003292602 on level 0 Castro::do_old_sources() time = 0.009210458 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.12840908 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.006806361 Gravity::multilevel_solve_for_new_phi() time = 0.040066653 Castro::construct_new_gravity() time = 0.043570294 on level 0 Castro::do_new_sources() time = 0.008339839 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.113830369 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.224432712 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002217027 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007456282 Gravity::multilevel_solve_for_new_phi() time = 0.059798068 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003348855 on level 0 Castro::do_old_sources() time = 0.006532032 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.11810809 on level 0 Castro::construct_old_gravity() time = 0.00034776 on level 1 Castro::do_old_sources() time = 0.001455209 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.010348412 on level 1 Castro::reflux() at level 0 : time = 0.021472824 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007233618 Gravity::multilevel_solve_for_new_phi() time = 0.041332655 Castro::construct_new_gravity() time = 0.044701692 on level 0 Castro::do_new_sources() time = 0.010546103 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000395412 on level 1 Castro::do_new_sources() time = 0.002270695 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.832132504 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.333586908 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.003185368 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007251835 Gravity::multilevel_solve_for_new_phi() time = 0.01502581 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003430569 on level 0 Castro::do_old_sources() time = 0.006764053 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.13640638 on level 0 Castro::construct_old_gravity() time = 0.000340322 on level 1 Castro::do_old_sources() time = 0.001844053 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.011555578 on level 1 Castro::reflux() at level 0 : time = 0.017825457 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007249395 Gravity::multilevel_solve_for_new_phi() time = 0.028654484 Castro::construct_new_gravity() time = 0.032126173 on level 0 Castro::do_new_sources() time = 0.006838815 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000375015 on level 1 Castro::do_new_sources() time = 0.001578867 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.854491455 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.298793336 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.003143152 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007182247 Gravity::multilevel_solve_for_new_phi() time = 0.014908626 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003345797 on level 0 Castro::do_old_sources() time = 0.010011846 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.130262266 on level 0 Castro::construct_old_gravity() time = 0.000334603 on level 1 Castro::do_old_sources() time = 0.00188922 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.009988715 on level 1 Castro::reflux() at level 0 : time = 0.018467893 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.00724536 Gravity::multilevel_solve_for_new_phi() time = 0.028736804 Castro::construct_new_gravity() time = 0.032187804 on level 0 Castro::do_new_sources() time = 0.006628397 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000373993 on level 1 Castro::do_new_sources() time = 0.002123437 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.79671188 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.294941918 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002065224 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007221706 Gravity::multilevel_solve_for_new_phi() time = 0.015092015 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003613931 on level 0 Castro::do_old_sources() time = 0.007065739 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.15913824 on level 0 Castro::construct_old_gravity() time = 0.000325259 on level 1 Castro::do_old_sources() time = 0.001476805 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.008781606 on level 1 Castro::reflux() at level 0 : time = 0.01796973 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007348596 Gravity::multilevel_solve_for_new_phi() time = 0.029478593 Castro::construct_new_gravity() time = 0.033049507 on level 0 Castro::do_new_sources() time = 0.007426314 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000417482 on level 1 Castro::do_new_sources() time = 0.001650948 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.590581472 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.310780586 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.154024814 seconds Ending run at 08:48:46 UTC on 2024-04-03. Run time = 3.178503928 Run time without initialization = 1.617404181 Average number of zones advanced per microsecond: 3.059 Average number of zones advanced per microsecond per rank: 3.059 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.179 ... 3.179 ... 3.179 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.1422 1.1422 1.1422 35.93% Castro::construct_ctu_hydro_source() 9 0.6801 0.6801 0.6801 21.40% VisMF::Write(FabArray) 3 0.2918 0.2918 0.2918 9.18% Castro::initMFs() 5 0.1479 0.1479 0.1479 4.65% Castro::computeTemp() 88 0.08011 0.08011 0.08011 2.52% Gravity::fill_multipole_BCs() 10 0.07239 0.07239 0.07239 2.28% Castro::normalize_species() 87 0.07126 0.07126 0.07126 2.24% Castro::problem_post_timestep() 10 0.04952 0.04952 0.04952 1.56% MLCellLinOp::applyBC() 1917 0.04735 0.04735 0.04735 1.49% FillBoundary_nowait() 1728 0.04286 0.04286 0.04286 1.35% FabArray::setVal() 920 0.03795 0.03795 0.03795 1.19% StateData::FillBoundary(geom) 650 0.03475 0.03475 0.03475 1.09% FabArray::ParallelCopy_nowait() 954 0.03039 0.03039 0.03039 0.96% Castro::volInBoundary() 42 0.02761 0.02761 0.02761 0.87% amrex::Copy() 441 0.02658 0.02658 0.02658 0.84% Castro::enforce_min_density() 87 0.02378 0.02378 0.02378 0.75% Castro::reset_internal_energy(MultiFab) 88 0.02318 0.02318 0.02318 0.73% FluxRegister::Reflux() 24 0.02244 0.02244 0.02244 0.71% MLCellLinOp::defineAuxData() 10 0.02051 0.02051 0.02051 0.65% amrex::Add() 136 0.01725 0.01725 0.01725 0.54% Castro::estTimeStep() 26 0.01681 0.01681 0.01681 0.53% FabArray::Saxpy() 604 0.01571 0.01571 0.01571 0.49% Castro::reflux() 4 0.01547 0.01547 0.01547 0.49% StateDataPhysBCFunct::() 95 0.01458 0.01458 0.01458 0.46% Castro::construct_new_source() 63 0.01392 0.01392 0.01392 0.44% BndryData::define() 26 0.01268 0.01268 0.01268 0.40% MLPoisson::Fsmooth() 1376 0.0122 0.0122 0.0122 0.38% MLCellLinOp::reflux() 30 0.009803 0.009803 0.009803 0.31% amrex::Dot() 466 0.008878 0.008878 0.008878 0.28% FabArray::norminf() 439 0.008441 0.008441 0.008441 0.27% Amr::regrid() 5 0.008027 0.008027 0.008027 0.25% Castro::FluxRegCrseInit 9 0.007973 0.007973 0.007973 0.25% Castro::construct_old_gravity_source() 18 0.007788 0.007788 0.007788 0.25% MLPoisson::Fapply() 493 0.00672 0.00672 0.00672 0.21% Castro::initData() 1 0.006593 0.006593 0.006593 0.21% FabArray::Xpay() 353 0.006343 0.006343 0.006343 0.20% amrex::average_down 233 0.006147 0.006147 0.006147 0.19% AmrMesh::MakeNewGrids() 6 0.005529 0.005529 0.005529 0.17% Castro::construct_new_gravity_source() 9 0.005344 0.005344 0.005344 0.17% Castro::wd_update() 6 0.004786 0.004786 0.004786 0.15% Castro::construct_old_source() 63 0.004618 0.004618 0.004618 0.15% Amr::writePlotFile() 2 0.004581 0.004581 0.004581 0.14% MLMG::addInterpCorrection() 155 0.004401 0.004401 0.004401 0.14% Castro::apply_tagging_restrictions() 6 0.004235 0.004235 0.004235 0.13% Castro::reset_internal_energy(Fab) 1476 0.004112 0.004112 0.004112 0.13% Gravity::actual_solve_with_mlmg() 10 0.003934 0.003934 0.003934 0.12% FabArrayBase::CPC::define() 534 0.003834 0.003834 0.003834 0.12% FillPatchInterp(MF) 30 0.003636 0.003636 0.003636 0.11% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003633 0.003633 0.003633 0.11% FabArray::setDomainBndry() 92 0.00339 0.00339 0.00339 0.11% MultiFab::contains_nan() 18 0.00326 0.00326 0.00326 0.10% Castro::enforce_speed_limit() 87 0.003124 0.003124 0.003124 0.10% MLCellLinOp::compGrad() 18 0.002894 0.002894 0.002894 0.09% MLCellLinOp::defineBC() 10 0.002721 0.002721 0.002721 0.09% FabArray::mult() 55 0.002572 0.002572 0.002572 0.08% MLCellLinOp::setLevelBC() 18 0.002406 0.002406 0.002406 0.08% check_for_negative_density() 9 0.002229 0.002229 0.002229 0.07% MLCellLinOp::prepareForSolve() 10 0.001965 0.001965 0.001965 0.06% MLMG::prepareForSolve() 10 0.00187 0.00187 0.00187 0.06% Castro::fill_hybrid_hydro_source() 27 0.001858 0.001858 0.001858 0.06% MLPoisson::FFlux() 150 0.001482 0.001482 0.001482 0.05% MLCellLinOp::updateSolBC() 25 0.001397 0.001397 0.001397 0.04% TagBoxArray::mapPRD 6 0.001341 0.001341 0.001341 0.04% FabArray::norminf(mask) 21 0.001227 0.001227 0.001227 0.04% FabArrayBase::getCPC() 1522 0.001168 0.001168 0.001168 0.04% Gravity::get_new_grav_vector() 10 0.001142 0.001142 0.001142 0.04% MLCellLinOp::updateCorBC() 17 0.001012 0.001012 0.001012 0.03% OwnerMask() 6 0.0009997 0.0009997 0.0009997 0.03% Gravity::get_old_grav_vector() 9 0.0009801 0.0009801 0.0009801 0.03% Castro::build_fine_mask() 44 0.0009395 0.0009395 0.0009395 0.03% average_down_faces 48 0.0008879 0.0008879 0.0008879 0.03% TagBoxArray::collate() 6 0.0007978 0.0007978 0.0007978 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0007819 0.0007819 0.0007819 0.02% FillPatchTwoLevels 31 0.0007446 0.0007446 0.0007446 0.02% MLCGSolver::bicgstab 31 0.0006912 0.0006912 0.0006912 0.02% main() 1 0.0006673 0.0006673 0.0006673 0.02% Castro::FluxRegFineAdd() 9 0.0006501 0.0006501 0.0006501 0.02% AmrLevel::FillPatch() 62 0.0006281 0.0006281 0.0006281 0.02% MultiFab::max() 18 0.0006126 0.0006126 0.0006126 0.02% FillPatchIterator::Initialize 62 0.0006068 0.0006068 0.0006068 0.02% MultiFab::Multiply() 8 0.0005012 0.0005012 0.0005012 0.02% MLCellLinOp::smooth() 688 0.0004988 0.0004988 0.0004988 0.02% Castro::apply_problem_tags() 6 0.0004819 0.0004819 0.0004819 0.02% FabArrayBase::FB::FB() 37 0.0004413 0.0004413 0.0004413 0.01% MLMG::interpCorrection_1 17 0.0003992 0.0003992 0.0003992 0.01% FabArray::FillBoundary() 1728 0.0003962 0.0003962 0.0003962 0.01% Castro::Castro() 5 0.0003864 0.0003864 0.0003864 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003691 0.0003691 0.0003691 0.01% Castro::clean_state() 87 0.0003667 0.0003667 0.0003667 0.01% FabArray::ParallelCopy() 954 0.0003425 0.0003425 0.0003425 0.01% FabArrayBase::getFB() 1728 0.0002879 0.0002879 0.0002879 0.01% Gravity::update_max_rhs() 10 0.0002865 0.0002865 0.0002865 0.01% Castro::initialize_do_advance() 9 0.0002539 0.0002539 0.0002539 0.01% Gravity::actual_multilevel_solve() 10 0.0002484 0.0002484 0.0002484 0.01% Castro::construct_new_rotation_source() 9 0.0002355 0.0002355 0.0002355 0.01% AMRErrorTag::operator() 6 0.0002261 0.0002261 0.0002261 0.01% Amr::coarseTimeStep() 5 0.0002251 0.0002251 0.0002251 0.01% MLCellLinOp::apply() 493 0.0002224 0.0002224 0.0002224 0.01% Castro::construct_old_rotation_source() 9 0.0002162 0.0002162 0.0002162 0.01% Castro::subcycle_advance_ctu() 5 0.0002148 0.0002148 0.0002148 0.01% MLLinOp::defineGrids() 10 0.0002098 0.0002098 0.0002098 0.01% Castro::initialize_advance() 9 0.0002074 0.0002074 0.0002074 0.01% StateData::define() 25 0.0001562 0.0001562 0.0001562 0.00% Castro::enforce_consistent_e() 1 0.0001432 0.0001432 0.0001432 0.00% Castro::swap_state_time_levels() 9 0.0001354 0.0001354 0.0001354 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.000132 0.000132 0.000132 0.00% MLCGSolver::ParallelAllReduce 745 0.0001315 0.0001315 0.0001315 0.00% Castro::do_new_sources() 9 0.0001227 0.0001227 0.0001227 0.00% Castro::finalize_do_advance() 9 0.0001223 0.0001223 0.0001223 0.00% Castro::construct_new_gravity() 9 0.00012 0.00012 0.00012 0.00% Castro::construct_old_gravity() 9 0.0001142 0.0001142 0.0001142 0.00% MLMG::mgVcycle() 65 0.0001094 0.0001094 0.0001094 0.00% Castro::buildMetrics() 5 0.000104 0.000104 0.000104 0.00% Amr::grid_places() 6 0.0001016 0.0001016 0.0001016 0.00% Castro::do_advance_ctu() 5 9.992e-05 9.992e-05 9.992e-05 0.00% Castro::finalize_advance() 9 9.823e-05 9.823e-05 9.823e-05 0.00% Castro::post_regrid() 10 9.803e-05 9.803e-05 9.803e-05 0.00% Castro::do_old_sources() 9 9.779e-05 9.779e-05 9.779e-05 0.00% MLCellLinOp::correctionResidual() 189 9.383e-05 9.383e-05 9.383e-05 0.00% Amr::timeStep() 9 7.922e-05 7.922e-05 7.922e-05 0.00% AmrLevel::derive() 6 7.825e-05 7.825e-05 7.825e-05 0.00% Castro::post_timestep() 9 7.564e-05 7.564e-05 7.564e-05 0.00% FillPatchSingleLevel 92 6.069e-05 6.069e-05 6.069e-05 0.00% MLMG::oneIter() 31 5.73e-05 5.73e-05 5.73e-05 0.00% FabArray::RecvLayoutMask() 8 5.02e-05 5.02e-05 5.02e-05 0.00% Castro::errorEst() 6 4.942e-05 4.942e-05 4.942e-05 0.00% MLMG:computeResOfCorrection() 155 4.932e-05 4.932e-05 4.932e-05 0.00% MLMG::solve() 10 4.827e-05 4.827e-05 4.827e-05 0.00% MLMG::mgVcycle_down::0 31 4.801e-05 4.801e-05 4.801e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.696e-05 4.696e-05 4.696e-05 0.00% Castro::create_source_corrector() 9 4.417e-05 4.417e-05 4.417e-05 0.00% MLCellLinOp::solutionResidual() 71 4.415e-05 4.415e-05 4.415e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 4.15e-05 4.15e-05 4.15e-05 0.00% Castro::computeNewDt() 8 4.15e-05 4.15e-05 4.15e-05 0.00% MLMG::mgVcycle_bottom 65 3.964e-05 3.964e-05 3.964e-05 0.00% Amr::writeSmallPlotFile() 1 3.954e-05 3.954e-05 3.954e-05 0.00% MLMG::actualBottomSolve() 31 3.875e-05 3.875e-05 3.875e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.64e-05 3.64e-05 3.64e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.615e-05 3.615e-05 3.615e-05 0.00% MLMG::mgVcycle_down::1 31 3.604e-05 3.604e-05 3.604e-05 0.00% Amr::defBaseLevel() 1 3.487e-05 3.487e-05 3.487e-05 0.00% Amr::FinalizeInit() 1 3.241e-05 3.241e-05 3.241e-05 0.00% Gravity::solve_phi_with_mlmg() 10 3.18e-05 3.18e-05 3.18e-05 0.00% Castro::advance() 5 3.05e-05 3.05e-05 3.05e-05 0.00% makeSFC 50 2.976e-05 2.976e-05 2.976e-05 0.00% MLMG::mgVcycle_down::3 31 2.91e-05 2.91e-05 2.91e-05 0.00% MLMG::mgVcycle_down::2 31 2.9e-05 2.9e-05 2.9e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.862e-05 2.862e-05 2.862e-05 0.00% MLPoisson::define() 10 2.725e-05 2.725e-05 2.725e-05 0.00% Castro::react_state() 18 2.643e-05 2.643e-05 2.643e-05 0.00% MLMG::ResNormInf() 54 2.621e-05 2.621e-05 2.621e-05 0.00% MLMG::mgVcycle_down::4 31 2.611e-05 2.611e-05 2.611e-05 0.00% DistributionMapping::Distribute() 52 2.265e-05 2.265e-05 2.265e-05 0.00% MLMG::mgVcycle_up::4 31 2.196e-05 2.196e-05 2.196e-05 0.00% FabArrayBase::TheFPinfo() 25 2.074e-05 2.074e-05 2.074e-05 0.00% MLMG::mgVcycle_up::0 31 2.041e-05 2.041e-05 2.041e-05 0.00% MLMG::mgVcycle_up::3 31 1.995e-05 1.995e-05 1.995e-05 0.00% MLMG::mgVcycle_up::1 31 1.963e-05 1.963e-05 1.963e-05 0.00% FPinfo::FPinfo() 3 1.917e-05 1.917e-05 1.917e-05 0.00% MLMG::mgVcycle_up::2 31 1.819e-05 1.819e-05 1.819e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.631e-05 1.631e-05 1.631e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.492e-05 1.492e-05 1.492e-05 0.00% Amr::initSubcycle() 1 1.466e-05 1.466e-05 1.466e-05 0.00% MLMG::computeResidual() 31 1.458e-05 1.458e-05 1.458e-05 0.00% MLMG::miniCycle() 34 1.455e-05 1.455e-05 1.455e-05 0.00% MLLinOp::define() 10 1.405e-05 1.405e-05 1.405e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.389e-05 1.389e-05 1.389e-05 0.00% MLMG::computeMLResidual() 15 1.349e-05 1.349e-05 1.349e-05 0.00% Castro::post_init() 1 1.268e-05 1.268e-05 1.268e-05 0.00% ClusterList::intersect() 4 1.212e-05 1.212e-05 1.212e-05 0.00% Castro::check_for_nan() 18 1.076e-05 1.076e-05 1.076e-05 0.00% Castro::apply_source_to_state() 18 9.113e-06 9.113e-06 9.113e-06 0.00% MLMG::getGradSolution() 10 8.348e-06 8.348e-06 8.348e-06 0.00% Gravity::swapTimeLevels() 9 8.251e-06 8.251e-06 8.251e-06 0.00% Castro::expand_state() 13 8.232e-06 8.232e-06 8.232e-06 0.00% Castro::construct_new_hybrid_source() 9 7.892e-06 7.892e-06 7.892e-06 0.00% MLMG::MLResNormInf() 15 7.474e-06 7.474e-06 7.474e-06 0.00% MLPoisson::prepareForSolve() 10 7.33e-06 7.33e-06 7.33e-06 0.00% Castro::avgDown(state_indx) 20 7.244e-06 7.244e-06 7.244e-06 0.00% amrex::average_down_w_geom 20 7.227e-06 7.227e-06 7.227e-06 0.00% AmrMesh-cluster 4 7.009e-06 7.009e-06 7.009e-06 0.00% Amr::InitializeInit() 1 6.775e-06 6.775e-06 6.775e-06 0.00% Castro::construct_old_hybrid_source() 9 6.656e-06 6.656e-06 6.656e-06 0.00% MLMG::MLRhsNormInf() 10 5.505e-06 5.505e-06 5.505e-06 0.00% BoxList::complementIn 12 5.387e-06 5.387e-06 5.387e-06 0.00% BoxList::parallelComplementIn() 12 5.207e-06 5.207e-06 5.207e-06 0.00% Castro::init(old) 3 4.873e-06 4.873e-06 4.873e-06 0.00% Castro::computeInitialDt() 2 3.991e-06 3.991e-06 3.991e-06 0.00% Castro::avgDown() 4 3.806e-06 3.806e-06 3.806e-06 0.00% Castro::derive() 6 3.534e-06 3.534e-06 3.534e-06 0.00% Amr::init() 1 3.422e-06 3.422e-06 3.422e-06 0.00% Gravity::set_mass_offset() 6 3.288e-06 3.288e-06 3.288e-06 0.00% Castro::retry_advance_ctu() 5 2.987e-06 2.987e-06 2.987e-06 0.00% Amr::bldFineLevels() 1 2.718e-06 2.718e-06 2.718e-06 0.00% Castro::init() 1 2.19e-06 2.19e-06 2.19e-06 0.00% ClusterList::chop() 4 1.88e-06 1.88e-06 1.88e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.828e-06 1.828e-06 1.828e-06 0.00% Amr::initialInit() 1 1.495e-06 1.495e-06 1.495e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.179 3.179 3.179 100.00% Amr::coarseTimeStep() 5 1.463 1.463 1.463 46.02% Amr::timeStep() 9 1.457 1.457 1.457 45.85% Castro::advance() 5 1.225 1.225 1.225 38.53% Castro::subcycle_advance_ctu() 5 1.196 1.196 1.196 37.63% Castro::do_advance_ctu() 5 1.196 1.196 1.196 37.62% Amr::InitAmr() 1 1.142 1.142 1.142 35.94% Castro::construct_ctu_hydro_source() 9 0.713 0.713 0.713 22.43% Amr::init() 1 0.4188 0.4188 0.4188 13.18% Gravity::multilevel_solve_for_new_phi() 10 0.3259 0.3259 0.3259 10.25% Gravity::actual_multilevel_solve() 10 0.3251 0.3251 0.3251 10.23% Gravity::solve_phi_with_mlmg() 10 0.3219 0.3219 0.3219 10.13% Amr::writePlotFile() 2 0.2988 0.2988 0.2988 9.40% VisMF::Write(FabArray) 3 0.2918 0.2918 0.2918 9.18% Amr::initialInit() 1 0.2741 0.2741 0.2741 8.62% Gravity::actual_solve_with_mlmg() 10 0.2471 0.2471 0.2471 7.77% Castro::clean_state() 87 0.2046 0.2046 0.2046 6.44% MLMG::solve() 10 0.1945 0.1945 0.1945 6.12% Castro::construct_new_gravity() 9 0.1873 0.1873 0.1873 5.89% Amr::regrid() 5 0.1681 0.1681 0.1681 5.29% MLMG::oneIter() 31 0.164 0.164 0.164 5.16% Amr::InitializeInit() 1 0.162 0.162 0.162 5.10% Amr::defBaseLevel() 1 0.162 0.162 0.162 5.10% Castro::Castro() 5 0.152 0.152 0.152 4.78% Castro::initMFs() 5 0.1479 0.1479 0.1479 4.65% Castro::post_regrid() 10 0.144 0.144 0.144 4.53% MLMG::mgVcycle() 65 0.1403 0.1403 0.1403 4.41% Amr::FinalizeInit() 1 0.1121 0.1121 0.1121 3.53% Castro::computeTemp() 88 0.1074 0.1074 0.1074 3.38% Castro::post_init() 1 0.1011 0.1011 0.1011 3.18% AmrLevel::FillPatch() 62 0.09159 0.09159 0.09159 2.88% MLCellLinOp::applyBC() 1917 0.09133 0.09133 0.09133 2.87% Castro::problem_post_timestep() 10 0.08704 0.08704 0.08704 2.74% MLCellLinOp::smooth() 688 0.08061 0.08061 0.08061 2.54% FillPatchIterator::Initialize 62 0.07716 0.07716 0.07716 2.43% Castro::reflux() 4 0.07577 0.07577 0.07577 2.38% Gravity::fill_multipole_BCs() 10 0.07441 0.07441 0.07441 2.34% Castro::normalize_species() 87 0.07126 0.07126 0.07126 2.24% FillPatchSingleLevel 92 0.06859 0.06859 0.06859 2.16% FillPatchIterator::FillFromLevel0() 31 0.06595 0.06595 0.06595 2.07% Castro::post_timestep() 9 0.06461 0.06461 0.06461 2.03% Castro::initialize_do_advance() 9 0.05405 0.05405 0.05405 1.70% StateDataPhysBCFunct::() 95 0.04932 0.04932 0.04932 1.55% Castro::do_new_sources() 9 0.04747 0.04747 0.04747 1.49% Castro::do_old_sources() 9 0.04633 0.04633 0.04633 1.46% FabArray::FillBoundary() 1728 0.04398 0.04398 0.04398 1.38% FillBoundary_nowait() 1728 0.04359 0.04359 0.04359 1.37% MLPoisson::define() 10 0.04182 0.04182 0.04182 1.32% Castro::expand_state() 13 0.04158 0.04158 0.04158 1.31% FabArray::setVal() 920 0.03795 0.03795 0.03795 1.19% MLMG::mgVcycle_bottom 65 0.03707 0.03707 0.03707 1.17% FabArray::ParallelCopy() 954 0.03482 0.03482 0.03482 1.10% StateData::FillBoundary(geom) 650 0.03475 0.03475 0.03475 1.09% FabArray::ParallelCopy_nowait() 954 0.03448 0.03448 0.03448 1.08% Castro::wd_update() 6 0.0324 0.0324 0.0324 1.02% MLMG::actualBottomSolve() 31 0.03004 0.03004 0.03004 0.95% MLCGSolver::bicgstab 31 0.02976 0.02976 0.02976 0.94% FluxRegister::Reflux() 24 0.02971 0.02971 0.02971 0.93% MLMG::mgVcycle_down::0 31 0.02903 0.02903 0.02903 0.91% Castro::initialize_advance() 9 0.02834 0.02834 0.02834 0.89% MLCellLinOp::apply() 493 0.02771 0.02771 0.02771 0.87% Castro::volInBoundary() 42 0.02762 0.02762 0.02762 0.87% Castro::reset_internal_energy(MultiFab) 88 0.02729 0.02729 0.02729 0.86% Castro::construct_new_source() 63 0.02668 0.02668 0.02668 0.84% amrex::Copy() 441 0.02658 0.02658 0.02658 0.84% MLCellLinOp::defineAuxData() 10 0.02387 0.02387 0.02387 0.75% Castro::enforce_min_density() 87 0.02378 0.02378 0.02378 0.75% Gravity::get_new_grav_vector() 10 0.02287 0.02287 0.02287 0.72% MLMG::mgVcycle_up::0 31 0.0218 0.0218 0.0218 0.69% Castro::construct_old_gravity() 9 0.01847 0.01847 0.01847 0.58% Gravity::get_old_grav_vector() 9 0.01835 0.01835 0.01835 0.58% MLCellLinOp::correctionResidual() 189 0.01798 0.01798 0.01798 0.57% MLCellLinOp::defineBC() 10 0.01763 0.01763 0.01763 0.55% amrex::Add() 136 0.01725 0.01725 0.01725 0.54% Castro::estTimeStep() 26 0.01681 0.01681 0.01681 0.53% MLCellLinOp::reflux() 30 0.01611 0.01611 0.01611 0.51% Amr::grid_places() 6 0.01585 0.01585 0.01585 0.50% AmrMesh::MakeNewGrids() 6 0.01575 0.01575 0.01575 0.50% FabArray::Saxpy() 604 0.01571 0.01571 0.01571 0.49% MLCellLinOp::solutionResidual() 71 0.01478 0.01478 0.01478 0.47% BndryData::define() 26 0.01476 0.01476 0.01476 0.46% MLMG::computeResWithCrseSolFineCor() 17 0.01383 0.01383 0.01383 0.44% MLMG:computeResOfCorrection() 155 0.01374 0.01374 0.01374 0.43% MLMG::computeMLResidual() 15 0.013 0.013 0.013 0.41% Castro::construct_old_source() 63 0.01278 0.01278 0.01278 0.40% MLPoisson::Fsmooth() 1376 0.0122 0.0122 0.0122 0.38% Castro::initData() 1 0.0116 0.0116 0.0116 0.37% MLMG::mgVcycle_down::1 31 0.01152 0.01152 0.01152 0.36% amrex::average_down 233 0.00984 0.00984 0.00984 0.31% Castro::FluxRegCrseInit 9 0.009017 0.009017 0.009017 0.28% amrex::Dot() 466 0.008878 0.008878 0.008878 0.28% MLMG::prepareForSolve() 10 0.008776 0.008776 0.008776 0.28% FabArray::norminf() 439 0.008441 0.008441 0.008441 0.27% MLMG::mgVcycle_up::1 31 0.008291 0.008291 0.008291 0.26% Castro::construct_old_gravity_source() 18 0.007788 0.007788 0.007788 0.25% Castro::computeNewDt() 8 0.007754 0.007754 0.007754 0.24% Amr::bldFineLevels() 1 0.007453 0.007453 0.007453 0.23% FillPatchIterator::FillFromTwoLevels() 31 0.007382 0.007382 0.007382 0.23% FillPatchTwoLevels 31 0.00734 0.00734 0.00734 0.23% MLMG::miniCycle() 34 0.007042 0.007042 0.007042 0.22% MLMG::addInterpCorrection() 155 0.006774 0.006774 0.006774 0.21% MLPoisson::Fapply() 493 0.00672 0.00672 0.00672 0.21% MLMG::mgVcycle_down::2 31 0.006644 0.006644 0.006644 0.21% Castro::finalize_do_advance() 9 0.006493 0.006493 0.006493 0.20% FabArray::Xpay() 353 0.006343 0.006343 0.006343 0.20% MLMG::mgVcycle_down::3 31 0.005999 0.005999 0.005999 0.19% MLMG::computeResidual() 31 0.005968 0.005968 0.005968 0.19% Castro::errorEst() 6 0.005924 0.005924 0.005924 0.19% MLMG::mgVcycle_down::4 31 0.005854 0.005854 0.005854 0.18% Castro::construct_new_gravity_source() 9 0.005344 0.005344 0.005344 0.17% MLCGSolver::ParallelAllReduce 745 0.005054 0.005054 0.005054 0.16% FabArrayBase::getCPC() 1522 0.005002 0.005002 0.005002 0.16% MLMG::mgVcycle_up::4 31 0.004758 0.004758 0.004758 0.15% MLMG::mgVcycle_up::2 31 0.004633 0.004633 0.004633 0.15% MLMG::mgVcycle_up::3 31 0.004595 0.004595 0.004595 0.14% MLMG::getGradSolution() 10 0.004399 0.004399 0.004399 0.14% MLCellLinOp::compGrad() 18 0.00439 0.00439 0.00439 0.14% Castro::apply_tagging_restrictions() 6 0.004235 0.004235 0.004235 0.13% Castro::apply_source_to_state() 18 0.004222 0.004222 0.004222 0.13% Castro::reset_internal_energy(Fab) 1476 0.004112 0.004112 0.004112 0.13% FabArrayBase::CPC::define() 534 0.003834 0.003834 0.003834 0.12% FillPatchInterp(MF) 30 0.003636 0.003636 0.003636 0.11% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003633 0.003633 0.003633 0.11% MLMG::computeResWithCrseCorFineCor() 17 0.003494 0.003494 0.003494 0.11% FabArray::setDomainBndry() 92 0.00339 0.00339 0.00339 0.11% MLCellLinOp::updateSolBC() 25 0.003382 0.003382 0.003382 0.11% Castro::check_for_nan() 18 0.003271 0.003271 0.003271 0.10% MultiFab::contains_nan() 18 0.00326 0.00326 0.00326 0.10% TagBoxArray::mapPRD 6 0.003168 0.003168 0.003168 0.10% Castro::enforce_speed_limit() 87 0.003124 0.003124 0.003124 0.10% Castro::init(old) 3 0.00304 0.00304 0.00304 0.10% Castro::computeInitialDt() 2 0.002731 0.002731 0.002731 0.09% FabArray::mult() 55 0.002572 0.002572 0.002572 0.08% Castro::buildMetrics() 5 0.002484 0.002484 0.002484 0.08% MLCellLinOp::setLevelBC() 18 0.002406 0.002406 0.002406 0.08% MLCellLinOp::updateCorBC() 17 0.002292 0.002292 0.002292 0.07% check_for_negative_density() 9 0.002229 0.002229 0.002229 0.07% MLMG::ResNormInf() 54 0.002092 0.002092 0.002092 0.07% Gravity::update_max_rhs() 10 0.002085 0.002085 0.002085 0.07% MLPoisson::prepareForSolve() 10 0.001972 0.001972 0.001972 0.06% MLCellLinOp::prepareForSolve() 10 0.001965 0.001965 0.001965 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.00196 0.00196 0.00196 0.06% Castro::fill_hybrid_hydro_source() 27 0.001858 0.001858 0.001858 0.06% MLPoisson::FFlux() 150 0.001482 0.001482 0.001482 0.05% average_down_faces 48 0.001299 0.001299 0.001299 0.04% FabArray::norminf(mask) 21 0.001227 0.001227 0.001227 0.04% Castro::construct_new_hybrid_source() 9 0.00119 0.00119 0.00119 0.04% Castro::avgDown() 4 0.001172 0.001172 0.001172 0.04% Castro::avgDown(state_indx) 20 0.001168 0.001168 0.001168 0.04% amrex::average_down_w_geom 20 0.001161 0.001161 0.001161 0.04% MLMG::MLResNormInf() 15 0.001155 0.001155 0.001155 0.04% OwnerMask() 6 0.0009997 0.0009997 0.0009997 0.03% MLMG::interpCorrection_1 17 0.0009588 0.0009588 0.0009588 0.03% Castro::build_fine_mask() 44 0.0009395 0.0009395 0.0009395 0.03% Castro::derive() 6 0.0009314 0.0009314 0.0009314 0.03% AmrLevel::derive() 6 0.0009278 0.0009278 0.0009278 0.03% Castro::init() 1 0.000905 0.000905 0.000905 0.03% AmrLevel::FillCoarsePatch() 5 0.0009028 0.0009028 0.0009028 0.03% TagBoxArray::collate() 6 0.0007978 0.0007978 0.0007978 0.03% FabArrayBase::getFB() 1728 0.0007292 0.0007292 0.0007292 0.02% Gravity::swapTimeLevels() 9 0.0006915 0.0006915 0.0006915 0.02% Castro::construct_old_hybrid_source() 9 0.0006825 0.0006825 0.0006825 0.02% Castro::FluxRegFineAdd() 9 0.0006501 0.0006501 0.0006501 0.02% MultiFab::max() 18 0.0006126 0.0006126 0.0006126 0.02% MLMG::MLRhsNormInf() 10 0.0005984 0.0005984 0.0005984 0.02% MultiFab::Multiply() 8 0.0005012 0.0005012 0.0005012 0.02% Castro::apply_problem_tags() 6 0.0004819 0.0004819 0.0004819 0.02% FabArrayBase::FB::FB() 37 0.0004413 0.0004413 0.0004413 0.01% Castro::react_state() 18 0.0003723 0.0003723 0.0003723 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003691 0.0003691 0.0003691 0.01% MLLinOp::define() 10 0.000291 0.000291 0.000291 0.01% MLLinOp::defineGrids() 10 0.000277 0.000277 0.000277 0.01% Castro::construct_new_rotation_source() 9 0.0002355 0.0002355 0.0002355 0.01% AMRErrorTag::operator() 6 0.0002261 0.0002261 0.0002261 0.01% Castro::construct_old_rotation_source() 9 0.0002162 0.0002162 0.0002162 0.01% AmrLevel::AmrLevel(dm) 5 0.0001924 0.0001924 0.0001924 0.01% StateData::define() 25 0.0001562 0.0001562 0.0001562 0.00% Castro::enforce_consistent_e() 1 0.0001432 0.0001432 0.0001432 0.00% Castro::swap_state_time_levels() 9 0.0001354 0.0001354 0.0001354 0.00% Castro::finalize_advance() 9 9.823e-05 9.823e-05 9.823e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 6.536e-05 6.536e-05 6.536e-05 0.00% makeSFC 50 5.044e-05 5.044e-05 5.044e-05 0.00% FabArray::RecvLayoutMask() 8 5.02e-05 5.02e-05 5.02e-05 0.00% Castro::create_source_corrector() 9 4.417e-05 4.417e-05 4.417e-05 0.00% FabArrayBase::TheFPinfo() 25 3.991e-05 3.991e-05 3.991e-05 0.00% Amr::writeSmallPlotFile() 1 3.954e-05 3.954e-05 3.954e-05 0.00% DistributionMapping::Distribute() 52 2.265e-05 2.265e-05 2.265e-05 0.00% AmrMesh-cluster 4 2.101e-05 2.101e-05 2.101e-05 0.00% FPinfo::FPinfo() 3 1.917e-05 1.917e-05 1.917e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.828e-05 1.828e-05 1.828e-05 0.00% Amr::initSubcycle() 1 1.466e-05 1.466e-05 1.466e-05 0.00% ClusterList::intersect() 4 1.212e-05 1.212e-05 1.212e-05 0.00% BoxList::parallelComplementIn() 12 1.059e-05 1.059e-05 1.059e-05 0.00% BoxList::complementIn 12 5.387e-06 5.387e-06 5.387e-06 0.00% Gravity::set_mass_offset() 6 3.288e-06 3.288e-06 3.288e-06 0.00% Castro::retry_advance_ctu() 5 2.987e-06 2.987e-06 2.987e-06 0.00% ClusterList::chop() 4 1.88e-06 1.88e-06 1.88e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.828e-06 1.828e-06 1.828e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1648 KiB 9037 MiB Castro::reflux() 436 436 13 MiB 666 MiB Castro::initMFs() 258 258 337 MiB 576 MiB Castro::swap_state_time_levels() 175 175 170 MiB 340 MiB StateData::define() 175 175 213 MiB 340 MiB Castro::initialize_do_advance() 143 143 115 MiB 325 MiB FillPatchIterator::Initialize 899 899 3997 KiB 303 MiB Amr::writePlotFile() 56 56 16 MiB 189 MiB Castro::problem_post_timestep() 162 162 741 KiB 167 MiB Castro::FluxRegCrseInit 660 660 443 KiB 167 MiB FluxRegister::Reflux() 648 648 1517 KiB 160 MiB Castro::initialize_advance() 143 143 46 MiB 121 MiB Castro::construct_new_source() 143 143 244 KiB 67 MiB Castro::construct_old_source() 143 143 135 KiB 67 MiB Castro::buildMetrics() 140 140 36 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 27 MiB 60 MiB Castro::Castro() 210 210 4212 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2635 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 191 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 236 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 866 KiB 16 MiB FillPatchTwoLevels 300 300 7491 B 11 MiB FillPatchInterp(MF) 330 330 4598 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 132 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4497 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 743 KiB 7424 KiB Castro::build_fine_mask() 224 224 1244 KiB 6912 KiB AmrLevel::derive() 162 162 2517 B 6912 KiB BndryData::define() 3624 3624 275 KiB 4243 KiB MLCellLinOp::reflux() 450 450 5681 B 2376 KiB Castro::wd_update() 6 6 22 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 398 B 2095 KiB amrex::average_down 1483 1483 2299 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 5217 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 781 B 867 KiB MLCellLinOp::defineBC() 276 276 3753 B 689 KiB Castro::estTimeStep() 26 26 2510 B 480 KiB VisMF::Write(FabArray) 1568 1568 2228 B 320 KiB Castro::normalize_species() 87 87 7302 B 320 KiB Castro::volInBoundary() 70 70 2815 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 123 B 204 KiB FabArray::norminf(mask) 29 29 184 B 163 KiB amrex::Dot() 559 559 412 B 160 KiB FabArray::norminf() 470 470 409 B 160 KiB MultiFab::max() 18 18 30 B 160 KiB check_for_negative_density() 9 9 113 B 160 KiB Castro::initData() 1 1 43 B 160 KiB FabArray::setVal() 419 419 52 KiB 120 KiB MLMG::interpCorrection_1 34 34 26 B 91 KiB average_down_faces 99 99 611 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 277 B 57 KiB MLPoisson::Fsmooth() 228 228 3007 B 55 KiB FillBoundary_nowait() 751 751 441 B 53 KiB TagBoxArray::mapPRD 324 324 40 B 45 KiB OwnerMask() 168 168 11 B 38 KiB MLCellLinOp::applyBC() 3834 3834 140 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9084 B 25 KiB MultiFab::contains_nan() 18 18 20 B 20 KiB StateData::FillBoundary(geom) 2538 2538 42 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 621 B 3456 B MLCGSolver::bicgstab 155 155 24 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 177 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 20 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 585 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1226 B 278 KiB FabArray::setVal() 419 419 52 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 277 B 57 KiB MLPoisson::Fsmooth() 228 228 3007 B 55 KiB FillBoundary_nowait() 751 751 442 B 53 KiB MLCellLinOp::applyBC() 1917 1917 139 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9084 B 25 KiB Gravity::get_new_grav_vector() 18 18 3288 B 20 KiB Gravity::get_old_grav_vector() 12 12 6078 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 42 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1303 B 6304 B MLMG::prepareForSolve() 18 18 225 B 3712 B FabArray::norminf(mask) 29 29 126 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 621 B 3456 B Castro::FluxRegCrseInit 12 12 8 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 583 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (24.04-3-gd78e241d1ad4) finalized