Initializing AMReX (v2024-42-g7437aa17d36f)... Initializing CUDA... CUDA initialized with 1 device. AMReX (v2024-42-g7437aa17d36f) initialized Starting run at 11:41:35 UTC on 2024-03-28. Successfully read inputs file ... Castro git describe: 24.03-37-g6b90dd1c0 AMReX git describe: v2024-42-g7437aa17d Microphysics git describe: 24.03-23-g3112c13a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003317001 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001715303 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.008996851 Gravity::multilevel_solve_for_new_phi() time = 0.052291442 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.144385795 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003302123 on level 0 Castro::do_old_sources() time = 0.009146696 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.100263677 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.006963276 Gravity::multilevel_solve_for_new_phi() time = 0.040204363 Castro::construct_new_gravity() time = 0.043756242 on level 0 Castro::do_new_sources() time = 0.008315745 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.724844923 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.196890256 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002139717 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007454349 Gravity::multilevel_solve_for_new_phi() time = 0.05950088 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003225167 on level 0 Castro::do_old_sources() time = 0.006619666 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.151734015 on level 0 Castro::construct_old_gravity() time = 0.000359617 on level 1 Castro::do_old_sources() time = 0.001786801 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.011641668 on level 1 Castro::reflux() at level 0 : time = 0.018420503 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.00724055 Gravity::multilevel_solve_for_new_phi() time = 0.040834515 Castro::construct_new_gravity() time = 0.04424124 on level 0 Castro::do_new_sources() time = 0.00707792 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000382024 on level 1 Castro::do_new_sources() time = 0.002392553 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.490107756 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.353610887 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.002052195 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007231562 Gravity::multilevel_solve_for_new_phi() time = 0.014950498 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003417091 on level 0 Castro::do_old_sources() time = 0.006734397 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.17524823 on level 0 Castro::construct_old_gravity() time = 0.00037604 on level 1 Castro::do_old_sources() time = 0.001518025 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007467885 on level 1 Castro::reflux() at level 0 : time = 0.017895168 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007240215 Gravity::multilevel_solve_for_new_phi() time = 0.028533569 Castro::construct_new_gravity() time = 0.032147051 on level 0 Castro::do_new_sources() time = 0.00679233 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000411843 on level 1 Castro::do_new_sources() time = 0.002538682 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.378964735 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.321453104 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.003228028 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.00723071 Gravity::multilevel_solve_for_new_phi() time = 0.01504653 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003427931 on level 0 Castro::do_old_sources() time = 0.006522087 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.152701134 on level 0 Castro::construct_old_gravity() time = 0.000324763 on level 1 Castro::do_old_sources() time = 0.001503404 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.012912449 on level 1 Castro::reflux() at level 0 : time = 0.017816241 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007252092 Gravity::multilevel_solve_for_new_phi() time = 0.028524034 Castro::construct_new_gravity() time = 0.032018551 on level 0 Castro::do_new_sources() time = 0.006536731 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000380751 on level 1 Castro::do_new_sources() time = 0.002117857 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.657583867 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.299149249 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002049068 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.013783335 Gravity::multilevel_solve_for_new_phi() time = 0.021616843 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.00347933 on level 0 Castro::do_old_sources() time = 0.006664593 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.169048419 on level 0 Castro::construct_old_gravity() time = 0.000337099 on level 1 Castro::do_old_sources() time = 0.001537456 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.006710704 on level 1 Castro::reflux() at level 0 : time = 0.018002234 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007260228 Gravity::multilevel_solve_for_new_phi() time = 0.028804119 Castro::construct_new_gravity() time = 0.03223526 on level 0 Castro::do_new_sources() time = 0.006768164 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000395326 on level 1 Castro::do_new_sources() time = 0.002088245 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.458171785 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.320580715 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.154853836 seconds Ending run at 11:41:38 UTC on 2024-03-28. Run time = 3.090303639 Run time without initialization = 1.647405685 Average number of zones advanced per microsecond: 3.003 Average number of zones advanced per microsecond per rank: 3.003 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.09 ... 3.09 ... 3.09 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0602 1.0602 1.0602 34.31% Castro::construct_ctu_hydro_source() 9 0.7495 0.7495 0.7495 24.25% VisMF::Write(FabArray) 3 0.2923 0.2923 0.2923 9.46% Castro::initMFs() 5 0.1522 0.1522 0.1522 4.93% Gravity::fill_multipole_BCs() 10 0.07875 0.07875 0.07875 2.55% Castro::normalize_species() 87 0.06682 0.06682 0.06682 2.16% Castro::computeTemp() 88 0.06076 0.06076 0.06076 1.97% MLCellLinOp::applyBC() 1917 0.04727 0.04727 0.04727 1.53% FillBoundary_nowait() 1728 0.04249 0.04249 0.04249 1.37% FabArray::setVal() 920 0.03774 0.03774 0.03774 1.22% StateData::FillBoundary(geom) 650 0.03458 0.03458 0.03458 1.12% FabArray::ParallelCopy_nowait() 954 0.03015 0.03015 0.03015 0.98% Castro::volInBoundary() 42 0.02795 0.02795 0.02795 0.90% amrex::Copy() 441 0.02645 0.02645 0.02645 0.86% Castro::reset_internal_energy(MultiFab) 88 0.02332 0.02332 0.02332 0.75% FluxRegister::Reflux() 24 0.02245 0.02245 0.02245 0.73% MLCellLinOp::defineAuxData() 10 0.02009 0.02009 0.02009 0.65% amrex::Add() 136 0.01723 0.01723 0.01723 0.56% Castro::estTimeStep() 26 0.01611 0.01611 0.01611 0.52% FabArray::Saxpy() 604 0.01576 0.01576 0.01576 0.51% StateDataPhysBCFunct::() 95 0.01471 0.01471 0.01471 0.48% Castro::construct_new_source() 63 0.0134 0.0134 0.0134 0.43% BndryData::define() 26 0.01251 0.01251 0.01251 0.40% MLPoisson::Fsmooth() 1376 0.01214 0.01214 0.01214 0.39% Castro::enforce_min_density() 87 0.01146 0.01146 0.01146 0.37% Castro::reflux() 4 0.01145 0.01145 0.01145 0.37% Castro::problem_post_timestep() 10 0.01016 0.01016 0.01016 0.33% MLCellLinOp::reflux() 30 0.009869 0.009869 0.009869 0.32% amrex::Dot() 466 0.008845 0.008845 0.008845 0.29% FabArray::norminf() 439 0.008411 0.008411 0.008411 0.27% Castro::construct_old_gravity_source() 18 0.008202 0.008202 0.008202 0.27% Castro::FluxRegCrseInit 9 0.00794 0.00794 0.00794 0.26% Castro::initData() 1 0.006817 0.006817 0.006817 0.22% MLPoisson::Fapply() 493 0.006669 0.006669 0.006669 0.22% AmrMesh::MakeNewGrids() 6 0.006495 0.006495 0.006495 0.21% FabArray::Xpay() 353 0.006361 0.006361 0.006361 0.21% amrex::average_down 233 0.006077 0.006077 0.006077 0.20% Castro::construct_new_gravity_source() 9 0.005299 0.005299 0.005299 0.17% Castro::wd_update() 6 0.004672 0.004672 0.004672 0.15% Amr::writePlotFile() 2 0.004648 0.004648 0.004648 0.15% Castro::construct_old_source() 63 0.004506 0.004506 0.004506 0.15% MLMG::addInterpCorrection() 155 0.004379 0.004379 0.004379 0.14% Castro::reset_internal_energy(Fab) 1476 0.004197 0.004197 0.004197 0.14% Gravity::actual_solve_with_mlmg() 10 0.003894 0.003894 0.003894 0.13% FabArrayBase::CPC::define() 534 0.003731 0.003731 0.003731 0.12% check_for_negative_density() 9 0.003691 0.003691 0.003691 0.12% FillPatchInterp(MF) 30 0.003622 0.003622 0.003622 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003501 0.003501 0.003501 0.11% MultiFab::contains_nan() 18 0.003258 0.003258 0.003258 0.11% FabArray::setDomainBndry() 92 0.003257 0.003257 0.003257 0.11% MLCellLinOp::compGrad() 18 0.002872 0.002872 0.002872 0.09% Castro::enforce_speed_limit() 87 0.002803 0.002803 0.002803 0.09% MLCellLinOp::defineBC() 10 0.00266 0.00266 0.00266 0.09% FabArray::mult() 55 0.002559 0.002559 0.002559 0.08% MLCellLinOp::setLevelBC() 18 0.002393 0.002393 0.002393 0.08% Castro::apply_tagging_restrictions() 6 0.002006 0.002006 0.002006 0.06% MLCellLinOp::prepareForSolve() 10 0.001955 0.001955 0.001955 0.06% MLMG::prepareForSolve() 10 0.001846 0.001846 0.001846 0.06% Castro::fill_hybrid_hydro_source() 27 0.001666 0.001666 0.001666 0.05% MLPoisson::FFlux() 150 0.001449 0.001449 0.001449 0.05% MLCellLinOp::updateSolBC() 25 0.001364 0.001364 0.001364 0.04% TagBoxArray::mapPRD 6 0.001337 0.001337 0.001337 0.04% FabArray::norminf(mask) 21 0.00122 0.00122 0.00122 0.04% Gravity::get_new_grav_vector() 10 0.001203 0.001203 0.001203 0.04% FabArrayBase::getCPC() 1522 0.001148 0.001148 0.001148 0.04% Castro::clean_state() 87 0.001121 0.001121 0.001121 0.04% OwnerMask() 6 0.001008 0.001008 0.001008 0.03% MLCellLinOp::updateCorBC() 17 0.0009913 0.0009913 0.0009913 0.03% Gravity::get_old_grav_vector() 9 0.000985 0.000985 0.000985 0.03% Castro::build_fine_mask() 44 0.0009409 0.0009409 0.0009409 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0008597 0.0008597 0.0008597 0.03% average_down_faces 48 0.0008557 0.0008557 0.0008557 0.03% Castro::advance() 5 0.0008536 0.0008536 0.0008536 0.03% Castro::post_timestep() 9 0.00085 0.00085 0.00085 0.03% Castro::create_source_corrector() 9 0.0008368 0.0008368 0.0008368 0.03% TagBoxArray::collate() 6 0.0007899 0.0007899 0.0007899 0.03% FillPatchTwoLevels 31 0.0007522 0.0007522 0.0007522 0.02% MLCGSolver::bicgstab 31 0.0006957 0.0006957 0.0006957 0.02% main() 1 0.0006578 0.0006578 0.0006578 0.02% Castro::FluxRegFineAdd() 9 0.0006569 0.0006569 0.0006569 0.02% AmrLevel::FillPatch() 62 0.0006282 0.0006282 0.0006282 0.02% MultiFab::max() 18 0.0006256 0.0006256 0.0006256 0.02% FillPatchIterator::Initialize 62 0.0005885 0.0005885 0.0005885 0.02% MultiFab::Multiply() 8 0.0005076 0.0005076 0.0005076 0.02% Castro::apply_problem_tags() 6 0.0004833 0.0004833 0.0004833 0.02% MLCellLinOp::smooth() 688 0.0004829 0.0004829 0.0004829 0.02% FabArrayBase::FB::FB() 37 0.0004406 0.0004406 0.0004406 0.01% FabArray::FillBoundary() 1728 0.0004297 0.0004297 0.0004297 0.01% MLMG::interpCorrection_1 17 0.0003988 0.0003988 0.0003988 0.01% Castro::Castro() 5 0.0003663 0.0003663 0.0003663 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003625 0.0003625 0.0003625 0.01% FabArray::ParallelCopy() 954 0.000341 0.000341 0.000341 0.01% Amr::regrid() 5 0.000325 0.000325 0.000325 0.01% FabArrayBase::getFB() 1728 0.0003085 0.0003085 0.0003085 0.01% Castro::subcycle_advance_ctu() 5 0.0003081 0.0003081 0.0003081 0.01% Castro::do_new_sources() 9 0.0002956 0.0002956 0.0002956 0.01% Castro::initialize_do_advance() 9 0.0002772 0.0002772 0.0002772 0.01% Amr::coarseTimeStep() 5 0.0002621 0.0002621 0.0002621 0.01% Gravity::update_max_rhs() 10 0.00025 0.00025 0.00025 0.01% Gravity::actual_multilevel_solve() 10 0.0002451 0.0002451 0.0002451 0.01% AMRErrorTag::operator() 6 0.0002276 0.0002276 0.0002276 0.01% Castro::construct_old_rotation_source() 9 0.0002188 0.0002188 0.0002188 0.01% MLCellLinOp::apply() 493 0.0002176 0.0002176 0.0002176 0.01% MLLinOp::defineGrids() 10 0.0002128 0.0002128 0.0002128 0.01% Castro::construct_new_rotation_source() 9 0.0002055 0.0002055 0.0002055 0.01% StateData::define() 25 0.0001577 0.0001577 0.0001577 0.01% Castro::do_old_sources() 9 0.0001471 0.0001471 0.0001471 0.00% Castro::initialize_advance() 9 0.0001461 0.0001461 0.0001461 0.00% Castro::construct_new_gravity() 9 0.0001424 0.0001424 0.0001424 0.00% Castro::enforce_consistent_e() 1 0.0001415 0.0001415 0.0001415 0.00% Castro::finalize_do_advance() 9 0.0001375 0.0001375 0.0001375 0.00% MLCGSolver::ParallelAllReduce 745 0.0001319 0.0001319 0.0001319 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001295 0.0001295 0.0001295 0.00% Castro::swap_state_time_levels() 9 0.0001265 0.0001265 0.0001265 0.00% Amr::grid_places() 6 0.0001044 0.0001044 0.0001044 0.00% MLMG::mgVcycle() 65 0.0001028 0.0001028 0.0001028 0.00% Castro::finalize_advance() 9 0.0001023 0.0001023 0.0001023 0.00% Castro::buildMetrics() 5 0.0001005 0.0001005 0.0001005 0.00% MLCellLinOp::correctionResidual() 189 9.388e-05 9.388e-05 9.388e-05 0.00% Castro::construct_old_gravity() 9 9.244e-05 9.244e-05 9.244e-05 0.00% Castro::do_advance_ctu() 5 9.237e-05 9.237e-05 9.237e-05 0.00% AmrLevel::derive() 6 8.094e-05 8.094e-05 8.094e-05 0.00% Amr::timeStep() 9 7.429e-05 7.429e-05 7.429e-05 0.00% Castro::post_regrid() 10 6.129e-05 6.129e-05 6.129e-05 0.00% FillPatchSingleLevel 92 5.666e-05 5.666e-05 5.666e-05 0.00% MLMG::oneIter() 31 5.482e-05 5.482e-05 5.482e-05 0.00% MLMG::solve() 10 5.302e-05 5.302e-05 5.302e-05 0.00% FabArray::RecvLayoutMask() 8 5.025e-05 5.025e-05 5.025e-05 0.00% Castro::errorEst() 6 5.023e-05 5.023e-05 5.023e-05 0.00% MLMG:computeResOfCorrection() 155 4.85e-05 4.85e-05 4.85e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.756e-05 4.756e-05 4.756e-05 0.00% Castro::react_state() 18 4.626e-05 4.626e-05 4.626e-05 0.00% MLCellLinOp::solutionResidual() 71 4.579e-05 4.579e-05 4.579e-05 0.00% Amr::defBaseLevel() 1 4.324e-05 4.324e-05 4.324e-05 0.00% MLMG::mgVcycle_down::1 31 4.09e-05 4.09e-05 4.09e-05 0.00% MLMG::mgVcycle_bottom 65 3.974e-05 3.974e-05 3.974e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.952e-05 3.952e-05 3.952e-05 0.00% MLMG::actualBottomSolve() 31 3.946e-05 3.946e-05 3.946e-05 0.00% Amr::writeSmallPlotFile() 1 3.788e-05 3.788e-05 3.788e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.7e-05 3.7e-05 3.7e-05 0.00% MLMG::mgVcycle_down::0 31 3.604e-05 3.604e-05 3.604e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.078e-05 3.078e-05 3.078e-05 0.00% MLMG::mgVcycle_down::3 31 2.849e-05 2.849e-05 2.849e-05 0.00% MLMG::mgVcycle_down::2 31 2.806e-05 2.806e-05 2.806e-05 0.00% makeSFC 50 2.617e-05 2.617e-05 2.617e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.573e-05 2.573e-05 2.573e-05 0.00% Gravity::solve_phi_with_mlmg() 10 2.517e-05 2.517e-05 2.517e-05 0.00% MLMG::mgVcycle_down::4 31 2.501e-05 2.501e-05 2.501e-05 0.00% Castro::computeNewDt() 8 2.444e-05 2.444e-05 2.444e-05 0.00% MLMG::ResNormInf() 54 2.399e-05 2.399e-05 2.399e-05 0.00% MLMG::mgVcycle_up::4 31 2.287e-05 2.287e-05 2.287e-05 0.00% FabArrayBase::TheFPinfo() 25 2.17e-05 2.17e-05 2.17e-05 0.00% MLPoisson::define() 10 2.124e-05 2.124e-05 2.124e-05 0.00% DistributionMapping::Distribute() 52 2.006e-05 2.006e-05 2.006e-05 0.00% MLMG::mgVcycle_up::3 31 1.96e-05 1.96e-05 1.96e-05 0.00% MLMG::mgVcycle_up::0 31 1.908e-05 1.908e-05 1.908e-05 0.00% ClusterList::intersect() 4 1.894e-05 1.894e-05 1.894e-05 0.00% FPinfo::FPinfo() 3 1.815e-05 1.815e-05 1.815e-05 0.00% MLMG::mgVcycle_up::1 31 1.812e-05 1.812e-05 1.812e-05 0.00% MLMG::mgVcycle_up::2 31 1.74e-05 1.74e-05 1.74e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.446e-05 1.446e-05 1.446e-05 0.00% MLMG::miniCycle() 34 1.406e-05 1.406e-05 1.406e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.403e-05 1.403e-05 1.403e-05 0.00% Amr::FinalizeInit() 1 1.393e-05 1.393e-05 1.393e-05 0.00% MLMG::computeResidual() 31 1.366e-05 1.366e-05 1.366e-05 0.00% Amr::initSubcycle() 1 1.358e-05 1.358e-05 1.358e-05 0.00% MLMG::computeMLResidual() 15 1.328e-05 1.328e-05 1.328e-05 0.00% Gravity::swapTimeLevels() 9 1.288e-05 1.288e-05 1.288e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.251e-05 1.251e-05 1.251e-05 0.00% Castro::check_for_nan() 18 1.209e-05 1.209e-05 1.209e-05 0.00% Castro::expand_state() 13 9.666e-06 9.666e-06 9.666e-06 0.00% Castro::apply_source_to_state() 18 9.085e-06 9.085e-06 9.085e-06 0.00% MLMG::getGradSolution() 10 8.564e-06 8.564e-06 8.564e-06 0.00% Amr::InitializeInit() 1 8.497e-06 8.497e-06 8.497e-06 0.00% MLPoisson::prepareForSolve() 10 8.489e-06 8.489e-06 8.489e-06 0.00% MLLinOp::define() 10 8.148e-06 8.148e-06 8.148e-06 0.00% Castro::construct_new_hybrid_source() 9 8.073e-06 8.073e-06 8.073e-06 0.00% amrex::average_down_w_geom 20 8.013e-06 8.013e-06 8.013e-06 0.00% Castro::avgDown(state_indx) 20 7.679e-06 7.679e-06 7.679e-06 0.00% MLMG::MLResNormInf() 15 6.983e-06 6.983e-06 6.983e-06 0.00% AmrMesh-cluster 4 6.837e-06 6.837e-06 6.837e-06 0.00% Castro::construct_old_hybrid_source() 9 6.333e-06 6.333e-06 6.333e-06 0.00% Castro::init(old) 3 5.8e-06 5.8e-06 5.8e-06 0.00% MLMG::MLRhsNormInf() 10 5.09e-06 5.09e-06 5.09e-06 0.00% Gravity::set_mass_offset() 6 4.492e-06 4.492e-06 4.492e-06 0.00% BoxList::parallelComplementIn() 12 4.213e-06 4.213e-06 4.213e-06 0.00% Castro::avgDown() 4 4.035e-06 4.035e-06 4.035e-06 0.00% Castro::derive() 6 3.85e-06 3.85e-06 3.85e-06 0.00% Castro::post_init() 1 3.842e-06 3.842e-06 3.842e-06 0.00% BoxList::complementIn 12 3.822e-06 3.822e-06 3.822e-06 0.00% Castro::computeInitialDt() 2 3.578e-06 3.578e-06 3.578e-06 0.00% Castro::retry_advance_ctu() 5 3.048e-06 3.048e-06 3.048e-06 0.00% Castro::init() 1 2.582e-06 2.582e-06 2.582e-06 0.00% Amr::bldFineLevels() 1 2.236e-06 2.236e-06 2.236e-06 0.00% Amr::init() 1 1.654e-06 1.654e-06 1.654e-06 0.00% ClusterList::chop() 4 1.644e-06 1.644e-06 1.644e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.632e-06 1.632e-06 1.632e-06 0.00% Amr::initialInit() 1 1.104e-06 1.104e-06 1.104e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.09 3.09 3.09 100.00% Amr::coarseTimeStep() 5 1.492 1.492 1.492 48.28% Amr::timeStep() 9 1.487 1.487 1.487 48.11% Castro::advance() 5 1.275 1.275 1.275 41.27% Castro::subcycle_advance_ctu() 5 1.252 1.252 1.252 40.53% Castro::do_advance_ctu() 5 1.252 1.252 1.252 40.52% Amr::InitAmr() 1 1.06 1.06 1.06 34.31% Castro::construct_ctu_hydro_source() 9 0.7878 0.7878 0.7878 25.49% Amr::init() 1 0.3826 0.3826 0.3826 12.38% Gravity::multilevel_solve_for_new_phi() 10 0.3305 0.3305 0.3305 10.69% Gravity::actual_multilevel_solve() 10 0.3296 0.3296 0.3296 10.67% Gravity::solve_phi_with_mlmg() 10 0.3265 0.3265 0.3265 10.56% Amr::writePlotFile() 2 0.2994 0.2994 0.2994 9.69% VisMF::Write(FabArray) 3 0.2923 0.2923 0.2923 9.46% Gravity::actual_solve_with_mlmg() 10 0.2452 0.2452 0.2452 7.94% Amr::initialInit() 1 0.2381 0.2381 0.2381 7.71% MLMG::solve() 10 0.1937 0.1937 0.1937 6.27% Castro::construct_new_gravity() 9 0.186 0.186 0.186 6.02% Castro::clean_state() 87 0.1691 0.1691 0.1691 5.47% Amr::InitializeInit() 1 0.1664 0.1664 0.1664 5.39% Amr::defBaseLevel() 1 0.1664 0.1664 0.1664 5.39% MLMG::oneIter() 31 0.1637 0.1637 0.1637 5.30% Castro::Castro() 5 0.1562 0.1562 0.1562 5.05% Castro::initMFs() 5 0.1522 0.1522 0.1522 4.93% Amr::regrid() 5 0.1515 0.1515 0.1515 4.90% MLMG::mgVcycle() 65 0.1403 0.1403 0.1403 4.54% Castro::post_regrid() 10 0.1364 0.1364 0.1364 4.41% AmrLevel::FillPatch() 62 0.09111 0.09111 0.09111 2.95% MLCellLinOp::applyBC() 1917 0.09094 0.09094 0.09094 2.94% Castro::computeTemp() 88 0.08828 0.08828 0.08828 2.86% Gravity::fill_multipole_BCs() 10 0.08077 0.08077 0.08077 2.61% MLCellLinOp::smooth() 688 0.0806 0.0806 0.0806 2.61% FillPatchIterator::Initialize 62 0.0767 0.0767 0.0767 2.48% Castro::reflux() 4 0.07217 0.07217 0.07217 2.34% Amr::FinalizeInit() 1 0.07168 0.07168 0.07168 2.32% FillPatchSingleLevel 92 0.06831 0.06831 0.06831 2.21% Castro::normalize_species() 87 0.06682 0.06682 0.06682 2.16% FillPatchIterator::FillFromLevel0() 31 0.06574 0.06574 0.06574 2.13% Castro::post_init() 1 0.0609 0.0609 0.0609 1.97% Castro::post_timestep() 9 0.06032 0.06032 0.06032 1.95% Castro::initialize_do_advance() 9 0.05266 0.05266 0.05266 1.70% StateDataPhysBCFunct::() 95 0.04929 0.04929 0.04929 1.60% Castro::problem_post_timestep() 10 0.04817 0.04817 0.04817 1.56% Castro::do_new_sources() 9 0.0447 0.0447 0.0447 1.45% FabArray::FillBoundary() 1728 0.04367 0.04367 0.04367 1.41% FillBoundary_nowait() 1728 0.04324 0.04324 0.04324 1.40% Castro::do_old_sources() 9 0.04211 0.04211 0.04211 1.36% Castro::expand_state() 13 0.04185 0.04185 0.04185 1.35% MLPoisson::define() 10 0.04099 0.04099 0.04099 1.33% FabArray::setVal() 920 0.03774 0.03774 0.03774 1.22% MLMG::mgVcycle_bottom 65 0.03708 0.03708 0.03708 1.20% StateData::FillBoundary(geom) 650 0.03458 0.03458 0.03458 1.12% FabArray::ParallelCopy() 954 0.03449 0.03449 0.03449 1.12% FabArray::ParallelCopy_nowait() 954 0.03415 0.03415 0.03415 1.10% Castro::wd_update() 6 0.03263 0.03263 0.03263 1.06% MLMG::actualBottomSolve() 31 0.03011 0.03011 0.03011 0.97% MLCGSolver::bicgstab 31 0.02982 0.02982 0.02982 0.96% FluxRegister::Reflux() 24 0.02971 0.02971 0.02971 0.96% MLMG::mgVcycle_down::0 31 0.02917 0.02917 0.02917 0.94% Castro::volInBoundary() 42 0.02795 0.02795 0.02795 0.90% Castro::reset_internal_energy(MultiFab) 88 0.02751 0.02751 0.02751 0.89% MLCellLinOp::apply() 493 0.02734 0.02734 0.02734 0.88% amrex::Copy() 441 0.02645 0.02645 0.02645 0.86% Castro::construct_new_source() 63 0.0259 0.0259 0.0259 0.84% MLCellLinOp::defineAuxData() 10 0.02336 0.02336 0.02336 0.76% Gravity::get_new_grav_vector() 10 0.0227 0.0227 0.0227 0.73% Castro::initialize_advance() 9 0.02199 0.02199 0.02199 0.71% MLMG::mgVcycle_up::0 31 0.02164 0.02164 0.02164 0.70% Castro::construct_old_gravity() 9 0.01834 0.01834 0.01834 0.59% Gravity::get_old_grav_vector() 9 0.01824 0.01824 0.01824 0.59% MLCellLinOp::correctionResidual() 189 0.01805 0.01805 0.01805 0.58% MLCellLinOp::defineBC() 10 0.01733 0.01733 0.01733 0.56% amrex::Add() 136 0.01723 0.01723 0.01723 0.56% Castro::estTimeStep() 26 0.01611 0.01611 0.01611 0.52% MLCellLinOp::reflux() 30 0.01606 0.01606 0.01606 0.52% FabArray::Saxpy() 604 0.01576 0.01576 0.01576 0.51% Amr::grid_places() 6 0.01456 0.01456 0.01456 0.47% BndryData::define() 26 0.01453 0.01453 0.01453 0.47% AmrMesh::MakeNewGrids() 6 0.01446 0.01446 0.01446 0.47% MLCellLinOp::solutionResidual() 71 0.0142 0.0142 0.0142 0.46% MLMG:computeResOfCorrection() 155 0.01385 0.01385 0.01385 0.45% MLMG::computeResWithCrseSolFineCor() 17 0.01351 0.01351 0.01351 0.44% Castro::construct_old_source() 63 0.01283 0.01283 0.01283 0.42% MLMG::computeMLResidual() 15 0.01282 0.01282 0.01282 0.41% MLPoisson::Fsmooth() 1376 0.01214 0.01214 0.01214 0.39% Castro::initData() 1 0.01182 0.01182 0.01182 0.38% Castro::enforce_min_density() 87 0.01146 0.01146 0.01146 0.37% MLMG::mgVcycle_down::1 31 0.01143 0.01143 0.01143 0.37% amrex::average_down 233 0.009826 0.009826 0.009826 0.32% Castro::FluxRegCrseInit 9 0.008991 0.008991 0.008991 0.29% amrex::Dot() 466 0.008845 0.008845 0.008845 0.29% MLMG::prepareForSolve() 10 0.008694 0.008694 0.008694 0.28% FabArray::norminf() 439 0.008411 0.008411 0.008411 0.27% MLMG::mgVcycle_up::1 31 0.008311 0.008311 0.008311 0.27% Castro::construct_old_gravity_source() 18 0.008202 0.008202 0.008202 0.27% Amr::bldFineLevels() 1 0.007312 0.007312 0.007312 0.24% FillPatchIterator::FillFromTwoLevels() 31 0.007296 0.007296 0.007296 0.24% FillPatchTwoLevels 31 0.007265 0.007265 0.007265 0.24% Castro::computeNewDt() 8 0.007014 0.007014 0.007014 0.23% MLMG::miniCycle() 34 0.006985 0.006985 0.006985 0.23% MLMG::addInterpCorrection() 155 0.00673 0.00673 0.00673 0.22% MLPoisson::Fapply() 493 0.006669 0.006669 0.006669 0.22% Castro::finalize_do_advance() 9 0.006645 0.006645 0.006645 0.22% MLMG::mgVcycle_down::2 31 0.006636 0.006636 0.006636 0.21% FabArray::Xpay() 353 0.006361 0.006361 0.006361 0.21% MLMG::mgVcycle_down::3 31 0.006062 0.006062 0.006062 0.20% MLMG::mgVcycle_down::4 31 0.005899 0.005899 0.005899 0.19% MLMG::computeResidual() 31 0.00579 0.00579 0.00579 0.19% Castro::construct_new_gravity_source() 9 0.005299 0.005299 0.005299 0.17% MLCGSolver::ParallelAllReduce 745 0.005016 0.005016 0.005016 0.16% FabArrayBase::getCPC() 1522 0.004879 0.004879 0.004879 0.16% MLMG::mgVcycle_up::4 31 0.004795 0.004795 0.004795 0.16% MLMG::mgVcycle_up::2 31 0.004621 0.004621 0.004621 0.15% MLMG::mgVcycle_up::3 31 0.004611 0.004611 0.004611 0.15% MLMG::getGradSolution() 10 0.004283 0.004283 0.004283 0.14% MLCellLinOp::compGrad() 18 0.004274 0.004274 0.004274 0.14% Castro::apply_source_to_state() 18 0.00423 0.00423 0.00423 0.14% Castro::reset_internal_energy(Fab) 1476 0.004197 0.004197 0.004197 0.14% FabArrayBase::CPC::define() 534 0.003731 0.003731 0.003731 0.12% Castro::errorEst() 6 0.003699 0.003699 0.003699 0.12% check_for_negative_density() 9 0.003691 0.003691 0.003691 0.12% FillPatchInterp(MF) 30 0.003622 0.003622 0.003622 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003501 0.003501 0.003501 0.11% MLMG::computeResWithCrseCorFineCor() 17 0.003482 0.003482 0.003482 0.11% MLCellLinOp::updateSolBC() 25 0.003287 0.003287 0.003287 0.11% Castro::check_for_nan() 18 0.003271 0.003271 0.003271 0.11% MultiFab::contains_nan() 18 0.003258 0.003258 0.003258 0.11% FabArray::setDomainBndry() 92 0.003257 0.003257 0.003257 0.11% TagBoxArray::mapPRD 6 0.003155 0.003155 0.003155 0.10% Castro::init(old) 3 0.002985 0.002985 0.002985 0.10% Castro::enforce_speed_limit() 87 0.002803 0.002803 0.002803 0.09% Castro::computeInitialDt() 2 0.002617 0.002617 0.002617 0.08% FabArray::mult() 55 0.002559 0.002559 0.002559 0.08% Castro::buildMetrics() 5 0.002466 0.002466 0.002466 0.08% MLCellLinOp::setLevelBC() 18 0.002393 0.002393 0.002393 0.08% MLCellLinOp::updateCorBC() 17 0.002277 0.002277 0.002277 0.07% MLMG::ResNormInf() 54 0.002056 0.002056 0.002056 0.07% Gravity::update_max_rhs() 10 0.002016 0.002016 0.002016 0.07% Castro::apply_tagging_restrictions() 6 0.002006 0.002006 0.002006 0.06% MLPoisson::prepareForSolve() 10 0.001963 0.001963 0.001963 0.06% MLCellLinOp::prepareForSolve() 10 0.001955 0.001955 0.001955 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.001923 0.001923 0.001923 0.06% Castro::fill_hybrid_hydro_source() 27 0.001666 0.001666 0.001666 0.05% MLPoisson::FFlux() 150 0.001449 0.001449 0.001449 0.05% average_down_faces 48 0.001276 0.001276 0.001276 0.04% Castro::avgDown() 4 0.001231 0.001231 0.001231 0.04% Castro::avgDown(state_indx) 20 0.001227 0.001227 0.001227 0.04% FabArray::norminf(mask) 21 0.00122 0.00122 0.00122 0.04% amrex::average_down_w_geom 20 0.001219 0.001219 0.001219 0.04% MLMG::MLResNormInf() 15 0.001133 0.001133 0.001133 0.04% OwnerMask() 6 0.001008 0.001008 0.001008 0.03% Castro::construct_new_hybrid_source() 9 0.001005 0.001005 0.001005 0.03% MLMG::interpCorrection_1 17 0.0009535 0.0009535 0.0009535 0.03% Castro::build_fine_mask() 44 0.0009409 0.0009409 0.0009409 0.03% Castro::derive() 6 0.0009318 0.0009318 0.0009318 0.03% AmrLevel::derive() 6 0.000928 0.000928 0.000928 0.03% Castro::init() 1 0.0009112 0.0009112 0.0009112 0.03% AmrLevel::FillCoarsePatch() 5 0.0009086 0.0009086 0.0009086 0.03% Castro::create_source_corrector() 9 0.0008368 0.0008368 0.0008368 0.03% TagBoxArray::collate() 6 0.0007899 0.0007899 0.0007899 0.03% FabArrayBase::getFB() 1728 0.0007491 0.0007491 0.0007491 0.02% Gravity::swapTimeLevels() 9 0.0006761 0.0006761 0.0006761 0.02% Castro::construct_old_hybrid_source() 9 0.0006748 0.0006748 0.0006748 0.02% Castro::FluxRegFineAdd() 9 0.0006569 0.0006569 0.0006569 0.02% MultiFab::max() 18 0.0006256 0.0006256 0.0006256 0.02% MLMG::MLRhsNormInf() 10 0.0005982 0.0005982 0.0005982 0.02% MultiFab::Multiply() 8 0.0005076 0.0005076 0.0005076 0.02% Castro::apply_problem_tags() 6 0.0004833 0.0004833 0.0004833 0.02% FabArrayBase::FB::FB() 37 0.0004406 0.0004406 0.0004406 0.01% Castro::react_state() 18 0.0003931 0.0003931 0.0003931 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003625 0.0003625 0.0003625 0.01% MLLinOp::define() 10 0.0002815 0.0002815 0.0002815 0.01% MLLinOp::defineGrids() 10 0.0002734 0.0002734 0.0002734 0.01% AMRErrorTag::operator() 6 0.0002276 0.0002276 0.0002276 0.01% Castro::construct_old_rotation_source() 9 0.0002188 0.0002188 0.0002188 0.01% Castro::construct_new_rotation_source() 9 0.0002055 0.0002055 0.0002055 0.01% AmrLevel::AmrLevel(dm) 5 0.0001973 0.0001973 0.0001973 0.01% StateData::define() 25 0.0001577 0.0001577 0.0001577 0.01% Castro::enforce_consistent_e() 1 0.0001415 0.0001415 0.0001415 0.00% Castro::swap_state_time_levels() 9 0.0001265 0.0001265 0.0001265 0.00% Castro::finalize_advance() 9 0.0001023 0.0001023 0.0001023 0.00% MLLinOp::makeAgglomeratedDMap 10 5.888e-05 5.888e-05 5.888e-05 0.00% FabArray::RecvLayoutMask() 8 5.025e-05 5.025e-05 5.025e-05 0.00% makeSFC 50 4.442e-05 4.442e-05 4.442e-05 0.00% FabArrayBase::TheFPinfo() 25 3.985e-05 3.985e-05 3.985e-05 0.00% Amr::writeSmallPlotFile() 1 3.788e-05 3.788e-05 3.788e-05 0.00% AmrMesh-cluster 4 2.742e-05 2.742e-05 2.742e-05 0.00% DistributionMapping::Distribute() 52 2.006e-05 2.006e-05 2.006e-05 0.00% ClusterList::intersect() 4 1.894e-05 1.894e-05 1.894e-05 0.00% FPinfo::FPinfo() 3 1.815e-05 1.815e-05 1.815e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.585e-05 1.585e-05 1.585e-05 0.00% Amr::initSubcycle() 1 1.358e-05 1.358e-05 1.358e-05 0.00% BoxList::parallelComplementIn() 12 8.035e-06 8.035e-06 8.035e-06 0.00% Gravity::set_mass_offset() 6 4.492e-06 4.492e-06 4.492e-06 0.00% BoxList::complementIn 12 3.822e-06 3.822e-06 3.822e-06 0.00% Castro::retry_advance_ctu() 5 3.048e-06 3.048e-06 3.048e-06 0.00% ClusterList::chop() 4 1.644e-06 1.644e-06 1.644e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.632e-06 1.632e-06 1.632e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1612 KiB 9037 MiB Castro::reflux() 436 436 12 MiB 666 MiB Castro::initMFs() 258 258 346 MiB 576 MiB Castro::swap_state_time_levels() 175 175 178 MiB 340 MiB StateData::define() 175 175 219 MiB 340 MiB Castro::initialize_do_advance() 143 143 123 MiB 325 MiB FillPatchIterator::Initialize 899 899 4105 KiB 303 MiB Amr::writePlotFile() 56 56 17 MiB 189 MiB Castro::problem_post_timestep() 162 162 784 KiB 167 MiB Castro::FluxRegCrseInit 660 660 455 KiB 167 MiB FluxRegister::Reflux() 648 648 1561 KiB 160 MiB Castro::initialize_advance() 143 143 49 MiB 121 MiB Castro::construct_new_source() 143 143 251 KiB 67 MiB Castro::construct_old_source() 143 143 136 KiB 67 MiB Castro::buildMetrics() 140 140 37 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 28 MiB 60 MiB Castro::Castro() 210 210 3812 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2698 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 196 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 241 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 884 KiB 16 MiB FillPatchTwoLevels 300 300 7637 B 11 MiB FillPatchInterp(MF) 330 330 4709 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 151 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4503 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 776 KiB 7424 KiB Castro::build_fine_mask() 224 224 1217 KiB 6912 KiB AmrLevel::derive() 162 162 2591 B 6912 KiB BndryData::define() 3624 3624 282 KiB 4243 KiB MLCellLinOp::reflux() 450 450 5955 B 2376 KiB Castro::wd_update() 6 6 23 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 414 B 2095 KiB amrex::average_down 1483 1483 2394 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 4921 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 794 B 867 KiB MLCellLinOp::defineBC() 276 276 3830 B 689 KiB Castro::estTimeStep() 26 26 2479 B 480 KiB VisMF::Write(FabArray) 1568 1568 2289 B 320 KiB Castro::normalize_species() 87 87 7028 B 320 KiB Castro::volInBoundary() 70 70 2931 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 124 B 204 KiB FabArray::norminf(mask) 29 29 188 B 163 KiB amrex::Dot() 559 559 424 B 160 KiB FabArray::norminf() 470 470 421 B 160 KiB MultiFab::max() 18 18 31 B 160 KiB check_for_negative_density() 9 9 193 B 160 KiB Castro::initData() 1 1 44 B 160 KiB FabArray::setVal() 419 419 54 KiB 120 KiB MLMG::interpCorrection_1 34 34 27 B 91 KiB average_down_faces 99 99 645 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 283 B 57 KiB MLPoisson::Fsmooth() 228 228 3082 B 55 KiB FillBoundary_nowait() 751 751 445 B 53 KiB TagBoxArray::mapPRD 324 324 41 B 45 KiB OwnerMask() 168 168 12 B 38 KiB MLCellLinOp::applyBC() 3834 3834 143 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9599 B 25 KiB MultiFab::contains_nan() 18 18 21 B 20 KiB StateData::FillBoundary(geom) 2538 2538 44 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 607 B 3456 B MLCGSolver::bicgstab 155 155 25 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 154 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 12 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 604 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1261 B 278 KiB FabArray::setVal() 419 419 54 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 283 B 57 KiB MLPoisson::Fsmooth() 228 228 3082 B 55 KiB FillBoundary_nowait() 751 751 446 B 53 KiB MLCellLinOp::applyBC() 1917 1917 143 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9600 B 25 KiB Gravity::get_new_grav_vector() 18 18 3199 B 20 KiB Gravity::get_old_grav_vector() 12 12 6672 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 44 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1336 B 6304 B MLMG::prepareForSolve() 18 18 230 B 3712 B FabArray::norminf(mask) 29 29 128 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 607 B 3456 B Castro::FluxRegCrseInit 12 12 9 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 617 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1856 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (v2024-42-g7437aa17d36f) finalized