Initializing CUDA... CUDA initialized with 1 GPU AMReX (22.05-5-g3ca867b8cce8) initialized Starting run at 08:46:03 UTC on 2022-05-09. Successfully read inputs file ... Castro git describe: 22.05-12-gb79cf4624 AMReX git describe: 22.05-5-g3ca867b8c Microphysics git describe: 22.05 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.002607325 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.00220331 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.008377781 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.152002077 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006599523 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.081600548 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008479078 Gravity::solve_for_phi() time = 0.045443852 Castro::do_new_sources() time = 0.007369873 ...estimated hydro-limited timestep at level 0: 0.05461684804 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 5.068678225 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.183270335 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002796355 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.008761748 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007908542 Gravity::solve_for_phi() time = 0.048113079 Castro::do_old_sources() time = 0.004554997 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.133238531 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.00785831 Gravity::solve_for_phi() time = 0.023254685 Castro::do_new_sources() time = 0.006509705 ...estimated hydro-limited timestep at level 0: 0.05461716053 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.486359834 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.002165061 Castro::do_old_sources() time = 0.001575554 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.005153024 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.011414723 Castro::do_new_sources() time = 0.001924775 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.087255138 [Level 1 step 2] Advanced 65536 cells Castro::do_new_sources() time = 0.00203005 Castro::do_new_sources() time = 0.006060029 Castro::reflux() at level 0 : time = 0.024274416 Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.394849978 [STEP 2] FAB kilobyte spread across MPI nodes: [2075961 ... 2075961] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.003589621 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.008850336 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008164123 Gravity::solve_for_phi() time = 0.048720102 Castro::do_old_sources() time = 0.006789538 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.115942945 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007898493 Gravity::solve_for_phi() time = 0.023578645 Castro::do_new_sources() time = 0.010301348 ...estimated hydro-limited timestep at level 0: 0.0008044237461 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.615566074 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.001934333 Castro::do_old_sources() time = 0.001747707 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.006200495 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007001647 Castro::do_new_sources() time = 0.002207139 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.316808994 [Level 1 step 3] Advanced 65536 cells Castro::do_new_sources() time = 0.001659938 Castro::do_new_sources() time = 0.006038587 Castro::reflux() at level 0 : time = 0.023702269 Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.351587865 [STEP 3] FAB kilobyte spread across MPI nodes: [2075961 ... 2075961] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002017448 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.008688668 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007828362 Gravity::solve_for_phi() time = 0.04858108 Castro::do_old_sources() time = 0.004341741 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.134152289 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007816499 Gravity::solve_for_phi() time = 0.023545522 Castro::do_new_sources() time = 0.007030838 ...estimated hydro-limited timestep at level 0: 0.0008043112215 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.432163544 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00192243 Castro::do_old_sources() time = 0.00160458 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.006570444 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00704889 Castro::do_new_sources() time = 0.001575405 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.421707898 [Level 1 step 4] Advanced 65536 cells Castro::do_new_sources() time = 0.002421947 Castro::do_new_sources() time = 0.006671101 Castro::reflux() at level 0 : time = 0.024058735 Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.354845292 [STEP 4] FAB kilobyte spread across MPI nodes: [2075961 ... 2075961] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002278828 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.008563959 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007831538 Gravity::solve_for_phi() time = 0.048649572 Castro::do_old_sources() time = 0.004489336 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.099381326 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.007866645 Gravity::solve_for_phi() time = 0.023581931 Castro::do_new_sources() time = 0.006487731 ...estimated hydro-limited timestep at level 0: 0.0006805523364 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.075223548 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.001929657 Castro::do_old_sources() time = 0.001640211 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.008560567 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007043011 Castro::do_new_sources() time = 0.001508871 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.324827118 [Level 1 step 5] Advanced 65536 cells Castro::do_new_sources() time = 0.001338977 Castro::do_new_sources() time = 0.010647329 Castro::reflux() at level 0 : time = 0.032430991 Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.322283518 [STEP 5] FAB kilobyte spread across MPI nodes: [2075961 ... 2075961] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.161071065 seconds Ending run at 08:46:07 UTC on 2022-05-09. Run time = 3.302912471 Run time without initialization = 1.768595385 Average number of zones advanced per microsecond: 2.649 Average number of zones advanced per microsecond per rank: 2.649 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9489481728 TinyProfiler total time across processes [min...avg...max]: 3.303 ... 3.303 ... 3.303 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.1453 1.1453 1.1453 34.67% Castro::construct_ctu_hydro_source() 9 0.5908 0.5908 0.5908 17.89% VisMF::Write(FabArray) 3 0.3071 0.3071 0.3071 9.30% Castro::initMFs() 5 0.1527 0.1527 0.1527 4.62% Gravity::fill_multipole_BCs() 14 0.1144 0.1144 0.1144 3.46% MLPoisson::Fsmooth() 2800 0.09629 0.09629 0.09629 2.92% MLCellLinOp::applyBC() 3868 0.08615 0.08615 0.08615 2.61% Castro::computeTemp() 104 0.08002 0.08002 0.08002 2.42% Castro::normalize_species() 103 0.07424 0.07424 0.07424 2.25% FillBoundary_nowait() 3516 0.04655 0.04655 0.04655 1.41% FabArray::setVal() 1497 0.04314 0.04314 0.04314 1.31% MLCellLinOp::defineAuxData() 22 0.03076 0.03076 0.03076 0.93% FabArray::ParallelCopy_nowait() 1190 0.02947 0.02947 0.02947 0.89% StateData::FillBoundary(geom) 546 0.02846 0.02846 0.02846 0.86% Castro::volInBoundary() 42 0.02819 0.02819 0.02819 0.85% Castro::reset_internal_energy(MultiFab) 104 0.02814 0.02814 0.02814 0.85% FluxRegister::Reflux() 24 0.02152 0.02152 0.02152 0.65% Castro::enforce_min_density() 103 0.02105 0.02105 0.02105 0.64% Castro::construct_new_source() 119 0.01965 0.01965 0.01965 0.60% MLCGSolver::bicgstab 70 0.01922 0.01922 0.01922 0.58% MultiFab::Dot() 972 0.01884 0.01884 0.01884 0.57% MultiFab::Saxpy() 77 0.0181 0.0181 0.0181 0.55% Castro::reflux() 4 0.01665 0.01665 0.01665 0.50% BndryData::define() 30 0.01621 0.01621 0.01621 0.49% Castro::estTimeStep() 26 0.01449 0.01449 0.01449 0.44% MLPoisson::Fapply() 1025 0.01272 0.01272 0.01272 0.39% StateDataPhysBCFunct::() 91 0.01192 0.01192 0.01192 0.36% Castro::do_advance_ctu() 9 0.01148 0.01148 0.01148 0.35% MultiFab::LinComb() 1364 0.01127 0.01127 0.01127 0.34% MultiFab::Xpay() 539 0.01009 0.01009 0.01009 0.31% Castro::problem_post_timestep() 10 0.009663 0.009663 0.009663 0.29% amrex::average_down 392 0.009657 0.009657 0.009657 0.29% MLMG::addInterpCorrection() 340 0.008773 0.008773 0.008773 0.27% Castro::construct_new_gravity_source() 17 0.008374 0.008374 0.008374 0.25% Castro::FluxRegCrseInit 9 0.007835 0.007835 0.007835 0.24% AmrMesh::MakeNewGrids() 6 0.007445 0.007445 0.007445 0.23% Castro::construct_old_gravity_source() 18 0.007319 0.007319 0.007319 0.22% Castro::expand_state() 9 0.006289 0.006289 0.006289 0.19% Amr::writePlotFile() 2 0.00606 0.00606 0.00606 0.18% MLCellLinOp::reflux() 17 0.005445 0.005445 0.005445 0.16% FillPatchInterp(Fab) 30 0.005393 0.005393 0.005393 0.16% Castro::reset_internal_energy(Fab) 1708 0.004736 0.004736 0.004736 0.14% FabArray::setVal(val, thecmd, scomp, ncomp) 960 0.004678 0.004678 0.004678 0.14% Gravity::actual_solve_with_mlmg() 22 0.004424 0.004424 0.004424 0.13% Castro::initData() 1 0.004342 0.004342 0.004342 0.13% Castro::fill_hybrid_hydro_source() 43 0.004279 0.004279 0.004279 0.13% MLCellLinOp::setLevelBC() 26 0.004256 0.004256 0.004256 0.13% Castro::construct_old_source() 63 0.00421 0.00421 0.00421 0.13% FabArrayBase::CPC::define() 909 0.004169 0.004169 0.004169 0.13% Castro::enforce_speed_limit() 103 0.004079 0.004079 0.004079 0.12% MLCellLinOp::compGrad() 26 0.003934 0.003934 0.003934 0.12% MLMG::oneIter() 70 0.003579 0.003579 0.003579 0.11% Castro::wd_update() 6 0.003323 0.003323 0.003323 0.10% MultiFab::contains_nan() 18 0.003152 0.003152 0.003152 0.10% Gravity::get_new_grav_vector() 10 0.002995 0.002995 0.002995 0.09% MLCellLinOp::prepareForSolve() 22 0.00298 0.00298 0.00298 0.09% CellConservativeLinear::interp() 160 0.00293 0.00293 0.00293 0.09% Castro::apply_tagging_restrictions() 6 0.002808 0.002808 0.002808 0.09% MLMG::ResNormInf() 99 0.002769 0.002769 0.002769 0.08% FabArray::mult() 63 0.002668 0.002668 0.002668 0.08% FabArray::setDomainBndry() 88 0.002606 0.002606 0.002606 0.08% Gravity::get_old_grav_vector() 9 0.002501 0.002501 0.002501 0.08% MLMG::prepareForSolve() 22 0.002422 0.002422 0.002422 0.07% Castro::construct_old_gravity() 9 0.001779 0.001779 0.001779 0.05% FabArrayBase::getCPC() 2138 0.001704 0.001704 0.001704 0.05% MLCellLinOp::defineBC() 22 0.00149 0.00149 0.00149 0.05% Castro::construct_new_gravity() 9 0.001269 0.001269 0.001269 0.04% TagBoxArray::mapPRD 6 0.001159 0.001159 0.001159 0.04% Gravity::solve_for_phi() 17 0.001127 0.001127 0.001127 0.03% Castro::clean_state() 103 0.001111 0.001111 0.001111 0.03% MLCellLinOp::smooth() 1400 0.001043 0.001043 0.001043 0.03% MultiFab::Subtract() 20 0.0009936 0.0009936 0.0009936 0.03% FabArrayBase::FB::FB() 84 0.0009428 0.0009428 0.0009428 0.03% Castro::finalize_advance() 9 0.0009282 0.0009282 0.0009282 0.03% Gravity::create_comp_minus_level_grad_phi() 4 0.0009173 0.0009173 0.0009173 0.03% OwnerMask() 6 0.000897 0.000897 0.000897 0.03% Castro::build_fine_mask() 44 0.0008818 0.0008818 0.0008818 0.03% FabArray::FillBoundary() 3516 0.0008432 0.0008432 0.0008432 0.03% MultiFab::Copy() 26 0.0008256 0.0008256 0.0008256 0.02% Gravity::update_max_rhs() 10 0.0008196 0.0008196 0.0008196 0.02% MLCellLinOp::updateSolBC() 14 0.0007567 0.0007567 0.0007567 0.02% MLPoisson::FFlux() 85 0.0007315 0.0007315 0.0007315 0.02% FabArrayBase::getFB() 3516 0.0007065 0.0007065 0.0007065 0.02% main() 1 0.0006774 0.0006774 0.0006774 0.02% TagBoxArray::collate() 6 0.0006656 0.0006656 0.0006656 0.02% MLCellLinOp::updateCorBC() 10 0.0005815 0.0005815 0.0005815 0.02% Castro::FluxRegFineAdd() 9 0.0005753 0.0005753 0.0005753 0.02% FillPatchTwoLevels 31 0.0005615 0.0005615 0.0005615 0.02% FillPatchIterator::Initialize 58 0.0005491 0.0005491 0.0005491 0.02% MultiFab::max() 18 0.0005271 0.0005271 0.0005271 0.02% MLMG::MLRhsNormInf() 22 0.0005216 0.0005216 0.0005216 0.02% Castro::init(old) 3 0.0005058 0.0005058 0.0005058 0.02% Castro::apply_problem_tags() 6 0.000499 0.000499 0.000499 0.02% MultiFab::norm0(mask) 11 0.000496 0.000496 0.000496 0.02% MLCellLinOp::apply() 1025 0.000489 0.000489 0.000489 0.01% Gravity::average_fine_ec_onto_crse_ec() 4 0.0004653 0.0004653 0.0004653 0.01% FabArray::ParallelCopy() 1190 0.0004187 0.0004187 0.0004187 0.01% MLMG::mgVcycle() 90 0.0004106 0.0004106 0.0004106 0.01% MLLinOp::defineGrids() 22 0.0004038 0.0004038 0.0004038 0.01% CGSolver::sxay() 1356 0.0003941 0.0003941 0.0003941 0.01% Castro::derive() 6 0.0003858 0.0003858 0.0003858 0.01% Gravity::actual_multilevel_solve() 5 0.0003678 0.0003678 0.0003678 0.01% Castro::Castro() 5 0.0003595 0.0003595 0.0003595 0.01% Amr::regrid() 5 0.000341 0.000341 0.000341 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003383 0.0003383 0.0003383 0.01% MLCGSolver::ParallelAllReduce 1304 0.000295 0.000295 0.000295 0.01% Castro::subcycle_advance_ctu() 9 0.0002826 0.0002826 0.0002826 0.01% Castro::construct_new_rotation_source() 17 0.0002787 0.0002787 0.0002787 0.01% Gravity::multilevel_solve_for_new_phi() 5 0.0002496 0.0002496 0.0002496 0.01% MLCellLinOp::correctionResidual() 430 0.0002446 0.0002446 0.0002446 0.01% MultiFab::Multiply() 4 0.0002376 0.0002376 0.0002376 0.01% StateData::define() 25 0.0002072 0.0002072 0.0002072 0.01% MLMG::interpCorrection_1 10 0.0002039 0.0002039 0.0002039 0.01% Castro::initialize_advance() 9 0.0002 0.0002 0.0002 0.01% Castro::construct_old_rotation_source() 9 0.0001823 0.0001823 0.0001823 0.01% AMRErrorTag::operator() 6 0.0001811 0.0001811 0.0001811 0.01% Castro::swap_state_time_levels() 9 0.0001435 0.0001435 0.0001435 0.00% Castro::create_source_corrector() 9 0.0001434 0.0001434 0.0001434 0.00% MLMG:computeResOfCorrection() 340 0.0001424 0.0001424 0.0001424 0.00% Castro::advance() 9 0.0001353 0.0001353 0.0001353 0.00% Castro::initialize_do_advance() 9 0.0001263 0.0001263 0.0001263 0.00% Castro::do_new_sources() 17 0.0001204 0.0001204 0.0001204 0.00% Gravity::GetCrsePhi() 8 0.0001203 0.0001203 0.0001203 0.00% Castro::enforce_consistent_e() 1 0.0001149 0.0001149 0.0001149 0.00% MLMG::actualBottomSolve() 70 0.0001132 0.0001132 0.0001132 0.00% MLMG::computeResWithCrseSolFineCor() 10 0.0001118 0.0001118 0.0001118 0.00% Castro::buildMetrics() 5 0.0001105 0.0001105 0.0001105 0.00% MLMG::computeResWithCrseCorFineCor() 10 0.0001096 0.0001096 0.0001096 0.00% Amr::grid_places() 6 9.933e-05 9.933e-05 9.933e-05 0.00% MLMG::solve() 22 9.598e-05 9.598e-05 9.598e-05 0.00% Gravity::solve_phi_with_mlmg() 22 9.217e-05 9.217e-05 9.217e-05 0.00% MLMG::mgVcycle_down::0 70 9.099e-05 9.099e-05 9.099e-05 0.00% MLMG::mgVcycle_down::1 70 8.731e-05 8.731e-05 8.731e-05 0.00% Amr::coarseTimeStep() 5 8.464e-05 8.464e-05 8.464e-05 0.00% Castro::finalize_do_advance() 9 8.04e-05 8.04e-05 8.04e-05 0.00% MLMG::mgVcycle_down::2 70 7.73e-05 7.73e-05 7.73e-05 0.00% AmrLevel::FillCoarsePatch() 5 7.28e-05 7.28e-05 7.28e-05 0.00% Castro::post_timestep() 9 7.006e-05 7.006e-05 7.006e-05 0.00% MLMG::mgVcycle_down::3 70 6.967e-05 6.967e-05 6.967e-05 0.00% MLCellLinOp::solutionResidual() 109 6.693e-05 6.693e-05 6.693e-05 0.00% MLMG::buildFineMask() 22 6.461e-05 6.461e-05 6.461e-05 0.00% Amr::timeStep() 9 6.28e-05 6.28e-05 6.28e-05 0.00% Castro::do_old_sources() 9 5.727e-05 5.727e-05 5.727e-05 0.00% MLMG::mgVcycle_down::4 60 5.71e-05 5.71e-05 5.71e-05 0.00% FillPatchSingleLevel 88 5.501e-05 5.501e-05 5.501e-05 0.00% MLMG::mgVcycle_bottom 90 5.354e-05 5.354e-05 5.354e-05 0.00% Castro::post_regrid() 10 5.121e-05 5.121e-05 5.121e-05 0.00% MLMG::mgVcycle_up::0 70 4.984e-05 4.984e-05 4.984e-05 0.00% makeSFC 102 4.892e-05 4.892e-05 4.892e-05 0.00% MLMG::mgVcycle_up::4 60 4.778e-05 4.778e-05 4.778e-05 0.00% MLMG::mgVcycle_up::3 70 4.485e-05 4.485e-05 4.485e-05 0.00% Castro::errorEst() 6 4.447e-05 4.447e-05 4.447e-05 0.00% AmrLevel::AmrLevel(dm) 5 4.4e-05 4.4e-05 4.4e-05 0.00% MLMG::mgVcycle_up::1 70 4.29e-05 4.29e-05 4.29e-05 0.00% MLMG::mgVcycle_up::2 70 4.037e-05 4.037e-05 4.037e-05 0.00% Castro::react_state() 18 3.894e-05 3.894e-05 3.894e-05 0.00% MLPoisson::define() 22 3.802e-05 3.802e-05 3.802e-05 0.00% Amr::defBaseLevel() 1 3.667e-05 3.667e-05 3.667e-05 0.00% DistributionMapping::Distribute() 104 3.488e-05 3.488e-05 3.488e-05 0.00% Amr::writeSmallPlotFile() 1 3.383e-05 3.383e-05 3.383e-05 0.00% MLMG::computeResidual() 70 3.323e-05 3.323e-05 3.323e-05 0.00% MLLinOp::define() 22 3.219e-05 3.219e-05 3.219e-05 0.00% MLLinOp::makeAgglomeratedDMap 22 2.99e-05 2.99e-05 2.99e-05 0.00% Castro::computeNewDt() 8 2.539e-05 2.539e-05 2.539e-05 0.00% FPinfo::FPinfo() 3 2.179e-05 2.179e-05 2.179e-05 0.00% FabArrayBase::TheFPinfo() 25 1.9e-05 1.9e-05 1.9e-05 0.00% MLMG::computeMLResidual() 25 1.773e-05 1.773e-05 1.773e-05 0.00% Castro::apply_source_to_state() 34 1.629e-05 1.629e-05 1.629e-05 0.00% MLPoisson::prepareForSolve() 22 1.523e-05 1.523e-05 1.523e-05 0.00% Amr::FinalizeInit() 1 1.517e-05 1.517e-05 1.517e-05 0.00% Amr::initSubcycle() 1 1.311e-05 1.311e-05 1.311e-05 0.00% Castro::construct_new_hybrid_source() 17 1.304e-05 1.304e-05 1.304e-05 0.00% FabArray::RecvLayoutMask() 4 1.293e-05 1.293e-05 1.293e-05 0.00% ClusterList::intersect() 4 1.241e-05 1.241e-05 1.241e-05 0.00% MLMG::getGradSolution() 22 1.208e-05 1.208e-05 1.208e-05 0.00% MLMG::MLResNormInf() 25 1.188e-05 1.188e-05 1.188e-05 0.00% Castro::check_for_nan() 18 1.084e-05 1.084e-05 1.084e-05 0.00% MLMG::miniCycle() 20 9.119e-06 9.119e-06 9.119e-06 0.00% Castro::avgDown(state_indx) 20 8.726e-06 8.726e-06 8.726e-06 0.00% Gravity::swapTimeLevels() 9 8.692e-06 8.692e-06 8.692e-06 0.00% Castro::post_init() 1 8.264e-06 8.264e-06 8.264e-06 0.00% amrex::average_down_w_geom 20 7.966e-06 7.966e-06 7.966e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 6.559e-06 6.559e-06 6.559e-06 0.00% Castro::construct_old_hybrid_source() 9 6.056e-06 6.056e-06 6.056e-06 0.00% AmrMesh-cluster 4 6.052e-06 6.052e-06 6.052e-06 0.00% Amr::InitializeInit() 1 5.64e-06 5.64e-06 5.64e-06 0.00% BoxList::parallelComplementIn() 12 4.864e-06 4.864e-06 4.864e-06 0.00% MLLinOp::makeSubCommunicator() 22 4.475e-06 4.475e-06 4.475e-06 0.00% Castro::avgDown() 4 4.287e-06 4.287e-06 4.287e-06 0.00% BoxList::complementIn 12 4.132e-06 4.132e-06 4.132e-06 0.00% Castro::retry_advance_ctu() 9 3.968e-06 3.968e-06 3.968e-06 0.00% Gravity::set_mass_offset() 6 3.461e-06 3.461e-06 3.461e-06 0.00% Castro::computeInitialDt() 2 2.653e-06 2.653e-06 2.653e-06 0.00% Castro::init() 1 2.447e-06 2.447e-06 2.447e-06 0.00% Amr::bldFineLevels() 1 2.368e-06 2.368e-06 2.368e-06 0.00% Amr::init() 1 2.159e-06 2.159e-06 2.159e-06 0.00% ClusterList::chop() 4 1.598e-06 1.598e-06 1.598e-06 0.00% Amr::initialInit() 1 9.54e-07 9.54e-07 9.54e-07 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.303 3.303 3.303 100.00% Amr::coarseTimeStep() 5 1.607 1.607 1.607 48.65% Amr::timeStep() 9 1.602 1.602 1.602 48.50% Castro::advance() 9 1.263 1.263 1.263 38.24% Castro::subcycle_advance_ctu() 9 1.229 1.229 1.229 37.21% Castro::do_advance_ctu() 9 1.229 1.229 1.229 37.20% Amr::InitAmr() 1 1.145 1.145 1.145 34.67% Castro::construct_ctu_hydro_source() 9 0.5908 0.5908 0.5908 17.89% Gravity::solve_phi_with_mlmg() 22 0.5587 0.5587 0.5587 16.92% Gravity::actual_solve_with_mlmg() 22 0.4415 0.4415 0.4415 13.37% Amr::init() 1 0.3889 0.3889 0.3889 11.77% Gravity::solve_for_phi() 17 0.3741 0.3741 0.3741 11.33% MLMG::solve() 22 0.3703 0.3703 0.3703 11.21% MLMG::oneIter() 70 0.333 0.333 0.333 10.08% MLMG::mgVcycle() 90 0.3191 0.3191 0.3191 9.66% Amr::writePlotFile() 2 0.3132 0.3132 0.3132 9.48% VisMF::Write(FabArray) 3 0.3071 0.3071 0.3071 9.30% Amr::initialInit() 1 0.2368 0.2368 0.2368 7.17% Castro::construct_old_gravity() 9 0.2237 0.2237 0.2237 6.77% Castro::clean_state() 103 0.2115 0.2115 0.2115 6.40% MLCellLinOp::smooth() 1400 0.1959 0.1959 0.1959 5.93% Castro::construct_new_gravity() 9 0.1919 0.1919 0.1919 5.81% Gravity::multilevel_solve_for_new_phi() 5 0.1875 0.1875 0.1875 5.68% Gravity::actual_multilevel_solve() 5 0.1872 0.1872 0.1872 5.67% Amr::regrid() 5 0.1757 0.1757 0.1757 5.32% Castro::post_timestep() 9 0.1656 0.1656 0.1656 5.01% Amr::InitializeInit() 1 0.1635 0.1635 0.1635 4.95% Amr::defBaseLevel() 1 0.1635 0.1635 0.1635 4.95% Castro::post_regrid() 10 0.1579 0.1579 0.1579 4.78% Castro::Castro() 5 0.1549 0.1549 0.1549 4.69% Castro::initMFs() 5 0.1527 0.1527 0.1527 4.62% MLCellLinOp::applyBC() 3868 0.1344 0.1344 0.1344 4.07% Gravity::fill_multipole_BCs() 14 0.115 0.115 0.115 3.48% Castro::computeTemp() 104 0.1129 0.1129 0.1129 3.42% Castro::reflux() 4 0.1045 0.1045 0.1045 3.16% MLPoisson::Fsmooth() 2800 0.09629 0.09629 0.09629 2.92% Castro::do_new_sources() 17 0.08185 0.08185 0.08185 2.48% Castro::normalize_species() 103 0.07424 0.07424 0.07424 2.25% Amr::FinalizeInit() 1 0.07329 0.07329 0.07329 2.22% MLMG::mgVcycle_bottom 90 0.07099 0.07099 0.07099 2.15% MLMG::mgVcycle_down::0 70 0.06847 0.06847 0.06847 2.07% MLMG::actualBottomSolve() 70 0.06711 0.06711 0.06711 2.03% FillPatchIterator::Initialize 58 0.06704 0.06704 0.06704 2.03% MLCGSolver::bicgstab 70 0.06645 0.06645 0.06645 2.01% Castro::post_init() 1 0.06199 0.06199 0.06199 1.88% MLMG::mgVcycle_up::0 70 0.0594 0.0594 0.0594 1.80% MLPoisson::define() 22 0.05614 0.05614 0.05614 1.70% FillPatchSingleLevel 88 0.05476 0.05476 0.05476 1.66% Castro::initialize_do_advance() 9 0.04909 0.04909 0.04909 1.49% FabArray::FillBoundary() 3516 0.04904 0.04904 0.04904 1.48% FillBoundary_nowait() 3516 0.0482 0.0482 0.0482 1.46% Castro::problem_post_timestep() 10 0.0466 0.0466 0.0466 1.41% MLCellLinOp::apply() 1025 0.04657 0.04657 0.04657 1.41% FabArray::setVal() 1497 0.04314 0.04314 0.04314 1.31% Castro::construct_new_source() 119 0.04121 0.04121 0.04121 1.25% StateDataPhysBCFunct::() 91 0.04038 0.04038 0.04038 1.22% MLCellLinOp::defineAuxData() 22 0.03533 0.03533 0.03533 1.07% FabArray::ParallelCopy() 1190 0.03352 0.03352 0.03352 1.01% Castro::do_old_sources() 9 0.03339 0.03339 0.03339 1.01% FabArray::ParallelCopy_nowait() 1190 0.0331 0.0331 0.0331 1.00% Castro::reset_internal_energy(MultiFab) 104 0.03288 0.03288 0.03288 1.00% Castro::wd_update() 6 0.03152 0.03152 0.03152 0.95% FluxRegister::Reflux() 24 0.02909 0.02909 0.02909 0.88% StateData::FillBoundary(geom) 546 0.02846 0.02846 0.02846 0.86% MLCellLinOp::correctionResidual() 430 0.02836 0.02836 0.02836 0.86% Castro::volInBoundary() 42 0.0282 0.0282 0.0282 0.85% Castro::expand_state() 9 0.02756 0.02756 0.02756 0.83% MLMG::mgVcycle_down::1 70 0.02675 0.02675 0.02675 0.81% Castro::initialize_advance() 9 0.02354 0.02354 0.02354 0.71% MLMG:computeResOfCorrection() 340 0.02347 0.02347 0.02347 0.71% MLMG::mgVcycle_up::1 70 0.02193 0.02193 0.02193 0.66% Gravity::get_new_grav_vector() 10 0.02176 0.02176 0.02176 0.66% Castro::enforce_min_density() 103 0.02105 0.02105 0.02105 0.64% MLCellLinOp::defineBC() 22 0.02022 0.02022 0.02022 0.61% MLCellLinOp::solutionResidual() 109 0.01891 0.01891 0.01891 0.57% MultiFab::Dot() 972 0.01884 0.01884 0.01884 0.57% BndryData::define() 30 0.01865 0.01865 0.01865 0.56% MultiFab::Saxpy() 77 0.0181 0.0181 0.0181 0.55% Gravity::get_old_grav_vector() 9 0.01807 0.01807 0.01807 0.55% amrex::average_down 392 0.01587 0.01587 0.01587 0.48% Amr::grid_places() 6 0.01556 0.01556 0.01556 0.47% AmrMesh::MakeNewGrids() 6 0.01546 0.01546 0.01546 0.47% MLMG::mgVcycle_down::2 70 0.01488 0.01488 0.01488 0.45% Castro::estTimeStep() 26 0.01449 0.01449 0.01449 0.44% MLMG::addInterpCorrection() 340 0.01413 0.01413 0.01413 0.43% MLMG::mgVcycle_down::3 70 0.0141 0.0141 0.0141 0.43% Castro::construct_old_source() 63 0.01329 0.01329 0.01329 0.40% MLMG::prepareForSolve() 22 0.01277 0.01277 0.01277 0.39% MLPoisson::Fapply() 1025 0.01272 0.01272 0.01272 0.39% MLMG::computeResidual() 70 0.01193 0.01193 0.01193 0.36% FillPatchTwoLevels 31 0.01178 0.01178 0.01178 0.36% MultiFab::LinComb() 1364 0.01127 0.01127 0.01127 0.34% MLMG::mgVcycle_down::4 60 0.01126 0.01126 0.01126 0.34% CGSolver::sxay() 1356 0.01116 0.01116 0.01116 0.34% MLMG::mgVcycle_up::2 70 0.01095 0.01095 0.01095 0.33% MLMG::mgVcycle_up::3 70 0.01093 0.01093 0.01093 0.33% MLCGSolver::ParallelAllReduce 1304 0.0108 0.0108 0.0108 0.33% Castro::finalize_advance() 9 0.01036 0.01036 0.01036 0.31% Castro::initData() 1 0.01027 0.01027 0.01027 0.31% MultiFab::Xpay() 539 0.01009 0.01009 0.01009 0.31% MLMG::mgVcycle_up::4 60 0.009072 0.009072 0.009072 0.27% Castro::FluxRegCrseInit 9 0.008856 0.008856 0.008856 0.27% MLMG::computeMLResidual() 25 0.008609 0.008609 0.008609 0.26% Castro::construct_new_gravity_source() 17 0.008374 0.008374 0.008374 0.25% Amr::bldFineLevels() 1 0.008355 0.008355 0.008355 0.25% FillPatchInterp(Fab) 30 0.008323 0.008323 0.008323 0.25% MLCellLinOp::reflux() 17 0.007856 0.007856 0.007856 0.24% Castro::apply_source_to_state() 34 0.007576 0.007576 0.007576 0.23% MLMG::computeResWithCrseSolFineCor() 10 0.007375 0.007375 0.007375 0.22% Castro::construct_old_gravity_source() 18 0.007319 0.007319 0.007319 0.22% Castro::computeNewDt() 8 0.006986 0.006986 0.006986 0.21% FabArrayBase::getCPC() 2138 0.005873 0.005873 0.005873 0.18% MLMG::getGradSolution() 22 0.005832 0.005832 0.005832 0.18% MLCellLinOp::compGrad() 26 0.00582 0.00582 0.00582 0.18% MLCellLinOp::setLevelBC() 26 0.004849 0.004849 0.004849 0.15% Castro::reset_internal_energy(Fab) 1708 0.004736 0.004736 0.004736 0.14% FabArray::setVal(val, thecmd, scomp, ncomp) 960 0.004678 0.004678 0.004678 0.14% Castro::errorEst() 6 0.004317 0.004317 0.004317 0.13% Castro::fill_hybrid_hydro_source() 43 0.004279 0.004279 0.004279 0.13% FabArrayBase::CPC::define() 909 0.004169 0.004169 0.004169 0.13% Castro::enforce_speed_limit() 103 0.004079 0.004079 0.004079 0.12% MLMG::miniCycle() 20 0.003861 0.003861 0.003861 0.12% Castro::init(old) 3 0.003713 0.003713 0.003713 0.11% Castro::check_for_nan() 18 0.003163 0.003163 0.003163 0.10% MultiFab::contains_nan() 18 0.003152 0.003152 0.003152 0.10% MLMG::ResNormInf() 99 0.003106 0.003106 0.003106 0.09% MLPoisson::prepareForSolve() 22 0.002995 0.002995 0.002995 0.09% MLCellLinOp::prepareForSolve() 22 0.00298 0.00298 0.00298 0.09% CellConservativeLinear::interp() 160 0.00293 0.00293 0.00293 0.09% Castro::apply_tagging_restrictions() 6 0.002808 0.002808 0.002808 0.09% TagBoxArray::mapPRD 6 0.002775 0.002775 0.002775 0.08% FabArray::mult() 63 0.002668 0.002668 0.002668 0.08% FabArray::setDomainBndry() 88 0.002606 0.002606 0.002606 0.08% Castro::construct_old_hybrid_source() 9 0.002304 0.002304 0.002304 0.07% Castro::computeInitialDt() 2 0.002136 0.002136 0.002136 0.06% MLMG::computeResWithCrseCorFineCor() 10 0.002029 0.002029 0.002029 0.06% Castro::construct_new_hybrid_source() 17 0.001993 0.001993 0.001993 0.06% MLCellLinOp::updateSolBC() 14 0.00183 0.00183 0.00183 0.06% Gravity::update_max_rhs() 10 0.001799 0.001799 0.001799 0.05% Gravity::create_comp_minus_level_grad_phi() 4 0.001711 0.001711 0.001711 0.05% FabArrayBase::getFB() 3516 0.001649 0.001649 0.001649 0.05% Gravity::GetCrsePhi() 8 0.001441 0.001441 0.001441 0.04% MLCellLinOp::updateCorBC() 10 0.001327 0.001327 0.001327 0.04% Castro::avgDown() 4 0.001251 0.001251 0.001251 0.04% Castro::avgDown(state_indx) 20 0.001247 0.001247 0.001247 0.04% amrex::average_down_w_geom 20 0.001238 0.001238 0.001238 0.04% MultiFab::Subtract() 20 0.0009936 0.0009936 0.0009936 0.03% MLMG::MLResNormInf() 25 0.0009615 0.0009615 0.0009615 0.03% Castro::init() 1 0.0009579 0.0009579 0.0009579 0.03% AmrLevel::FillCoarsePatch() 5 0.0009554 0.0009554 0.0009554 0.03% Gravity::average_fine_ec_onto_crse_ec() 4 0.0009473 0.0009473 0.0009473 0.03% FabArrayBase::FB::FB() 84 0.0009428 0.0009428 0.0009428 0.03% OwnerMask() 6 0.000897 0.000897 0.000897 0.03% Castro::build_fine_mask() 44 0.0008818 0.0008818 0.0008818 0.03% MultiFab::Copy() 26 0.0008256 0.0008256 0.0008256 0.02% Castro::derive() 6 0.000784 0.000784 0.000784 0.02% MLPoisson::FFlux() 85 0.0007315 0.0007315 0.0007315 0.02% Castro::buildMetrics() 5 0.0006841 0.0006841 0.0006841 0.02% MLMG::MLRhsNormInf() 22 0.0006801 0.0006801 0.0006801 0.02% TagBoxArray::collate() 6 0.0006656 0.0006656 0.0006656 0.02% Gravity::swapTimeLevels() 9 0.0006304 0.0006304 0.0006304 0.02% Castro::FluxRegFineAdd() 9 0.0005753 0.0005753 0.0005753 0.02% MLLinOp::define() 22 0.000552 0.000552 0.000552 0.02% MLMG::interpCorrection_1 10 0.0005496 0.0005496 0.0005496 0.02% MultiFab::max() 18 0.0005271 0.0005271 0.0005271 0.02% MLLinOp::defineGrids() 22 0.0005198 0.0005198 0.0005198 0.02% Castro::apply_problem_tags() 6 0.000499 0.000499 0.000499 0.02% MultiFab::norm0(mask) 11 0.000496 0.000496 0.000496 0.02% Castro::react_state() 18 0.0003548 0.0003548 0.0003548 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003383 0.0003383 0.0003383 0.01% Castro::construct_new_rotation_source() 17 0.0002787 0.0002787 0.0002787 0.01% AmrLevel::AmrLevel(dm) 5 0.0002512 0.0002512 0.0002512 0.01% MultiFab::Multiply() 4 0.0002376 0.0002376 0.0002376 0.01% MLMG::buildFineMask() 22 0.0002375 0.0002375 0.0002375 0.01% StateData::define() 25 0.0002072 0.0002072 0.0002072 0.01% Castro::construct_old_rotation_source() 9 0.0001823 0.0001823 0.0001823 0.01% AMRErrorTag::operator() 6 0.0001811 0.0001811 0.0001811 0.01% Castro::swap_state_time_levels() 9 0.0001435 0.0001435 0.0001435 0.00% Castro::create_source_corrector() 9 0.0001434 0.0001434 0.0001434 0.00% Castro::enforce_consistent_e() 1 0.0001149 0.0001149 0.0001149 0.00% MLLinOp::makeAgglomeratedDMap 22 0.0001115 0.0001115 0.0001115 0.00% makeSFC 102 8.16e-05 8.16e-05 8.16e-05 0.00% Castro::finalize_do_advance() 9 8.04e-05 8.04e-05 8.04e-05 0.00% FabArrayBase::TheFPinfo() 25 4.078e-05 4.078e-05 4.078e-05 0.00% DistributionMapping::Distribute() 104 3.488e-05 3.488e-05 3.488e-05 0.00% Amr::writeSmallPlotFile() 1 3.383e-05 3.383e-05 3.383e-05 0.00% FPinfo::FPinfo() 3 2.179e-05 2.179e-05 2.179e-05 0.00% AmrMesh-cluster 4 2.006e-05 2.006e-05 2.006e-05 0.00% Amr::initSubcycle() 1 1.311e-05 1.311e-05 1.311e-05 0.00% FabArray::RecvLayoutMask() 4 1.293e-05 1.293e-05 1.293e-05 0.00% ClusterList::intersect() 4 1.241e-05 1.241e-05 1.241e-05 0.00% BoxList::parallelComplementIn() 12 8.996e-06 8.996e-06 8.996e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.754e-06 8.754e-06 8.754e-06 0.00% MLLinOp::makeSubCommunicator() 22 4.475e-06 4.475e-06 4.475e-06 0.00% BoxList::complementIn 12 4.132e-06 4.132e-06 4.132e-06 0.00% Castro::retry_advance_ctu() 9 3.968e-06 3.968e-06 3.968e-06 0.00% Gravity::set_mass_offset() 6 3.461e-06 3.461e-06 3.461e-06 0.00% ClusterList::chop() 4 1.598e-06 1.598e-06 1.598e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0e0, 0.0e0, 0.0e0] [TOP]::mg.v(nvals = 1) :: [2] Total GPU global memory (MB): 12066 Free GPU global memory (MB): 2455 [The Arena] space allocated (MB): 9049 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (22.05-5-g3ca867b8cce8) finalized