Initializing AMReX (24.04-9-g2a3955a5f5aa)... Initializing CUDA... CUDA initialized with 1 device. AMReX (24.04-9-g2a3955a5f5aa) initialized Starting run at 08:12:25 UTC on 2024-04-10. Successfully read inputs file ... Castro git describe: 24.04-11-g2407e8176 AMReX git describe: 24.04-9-g2a3955a5f Microphysics git describe: 24.04-5-g43dc7a53 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003259909 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001708705 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009365898 Gravity::multilevel_solve_for_new_phi() time = 0.053942661 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.14774059 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003358873 on level 0 Castro::do_old_sources() time = 0.009333589 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.136553768 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.007397191 Gravity::multilevel_solve_for_new_phi() time = 0.042864401 Castro::construct_new_gravity() time = 0.046675667 on level 0 Castro::do_new_sources() time = 0.009461786 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.878295271 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.237872067 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002092509 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007413039 Gravity::multilevel_solve_for_new_phi() time = 0.060345065 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003494819 on level 0 Castro::do_old_sources() time = 0.006728058 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.166616683 on level 0 Castro::construct_old_gravity() time = 0.00034732 on level 1 Castro::do_old_sources() time = 0.001727595 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007865432 on level 1 Castro::reflux() at level 0 : time = 0.017876954 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007263956 Gravity::multilevel_solve_for_new_phi() time = 0.041492235 Castro::construct_new_gravity() time = 0.045062625 on level 0 Castro::do_new_sources() time = 0.006670407 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.00039229 on level 1 Castro::do_new_sources() time = 0.003693666 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.313165788 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.371423596 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.002089174 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007214192 Gravity::multilevel_solve_for_new_phi() time = 0.01521486 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003453868 on level 0 Castro::do_old_sources() time = 0.006833699 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.165831178 on level 0 Castro::construct_old_gravity() time = 0.000334777 on level 1 Castro::do_old_sources() time = 0.001784412 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007134665 on level 1 Castro::reflux() at level 0 : time = 0.017844724 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007284329 Gravity::multilevel_solve_for_new_phi() time = 0.029036135 Castro::construct_new_gravity() time = 0.032621497 on level 0 Castro::do_new_sources() time = 0.007312441 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000374248 on level 1 Castro::do_new_sources() time = 0.002753009 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.519546678 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.312452823 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002135283 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007201257 Gravity::multilevel_solve_for_new_phi() time = 0.015221966 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003458824 on level 0 Castro::do_old_sources() time = 0.00659437 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.123600126 on level 0 Castro::construct_old_gravity() time = 0.000358996 on level 1 Castro::do_old_sources() time = 0.001781637 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.014389753 on level 1 Castro::reflux() at level 0 : time = 0.021922459 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007245795 Gravity::multilevel_solve_for_new_phi() time = 0.029744676 Castro::construct_new_gravity() time = 0.035417335 on level 0 Castro::do_new_sources() time = 0.011019248 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.00043255 on level 1 Castro::do_new_sources() time = 0.001684821 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.813419148 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.292172996 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.003668583 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007149848 Gravity::multilevel_solve_for_new_phi() time = 0.015420614 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.005337949 on level 0 Castro::do_old_sources() time = 0.007597822 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.141493731 on level 0 Castro::construct_old_gravity() time = 0.000359184 on level 1 Castro::do_old_sources() time = 0.001364208 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.012058188 on level 1 Castro::reflux() at level 0 : time = 0.020018571 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.00728502 Gravity::multilevel_solve_for_new_phi() time = 0.029624267 Castro::construct_new_gravity() time = 0.033267506 on level 0 Castro::do_new_sources() time = 0.010691224 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.000398655 on level 1 Castro::do_new_sources() time = 0.00232736 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.569786805 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.32070762 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.156801199 seconds Ending run at 08:12:29 UTC on 2024-04-10. Run time = 3.508046653 Run time without initialization = 1.692211669 Average number of zones advanced per microsecond: 2.924 Average number of zones advanced per microsecond per rank: 2.924 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.508 ... 3.508 ... 3.508 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.4096 1.4096 1.4096 40.18% Castro::construct_ctu_hydro_source() 9 0.7398 0.7398 0.7398 21.09% VisMF::Write(FabArray) 3 0.2976 0.2976 0.2976 8.48% Castro::initMFs() 5 0.148 0.148 0.148 4.22% Castro::computeTemp() 88 0.075 0.075 0.075 2.14% Castro::normalize_species() 87 0.07439 0.07439 0.07439 2.12% Gravity::fill_multipole_BCs() 10 0.07282 0.07282 0.07282 2.08% MLCellLinOp::applyBC() 1917 0.04869 0.04869 0.04869 1.39% FillBoundary_nowait() 1728 0.04322 0.04322 0.04322 1.23% FabArray::setVal() 920 0.03834 0.03834 0.03834 1.09% Castro::problem_post_timestep() 10 0.03594 0.03594 0.03594 1.02% StateData::FillBoundary(geom) 650 0.0353 0.0353 0.0353 1.01% FabArray::ParallelCopy_nowait() 954 0.0307 0.0307 0.0307 0.88% Castro::volInBoundary() 42 0.02882 0.02882 0.02882 0.82% amrex::Copy() 441 0.02671 0.02671 0.02671 0.76% Castro::reset_internal_energy(MultiFab) 88 0.0241 0.0241 0.0241 0.69% Castro::enforce_min_density() 87 0.02407 0.02407 0.02407 0.69% FluxRegister::Reflux() 24 0.02243 0.02243 0.02243 0.64% MLCellLinOp::defineAuxData() 10 0.02146 0.02146 0.02146 0.61% StateDataPhysBCFunct::() 95 0.02041 0.02041 0.02041 0.58% Castro::estTimeStep() 26 0.01747 0.01747 0.01747 0.50% amrex::Add() 136 0.01732 0.01732 0.01732 0.49% Castro::reflux() 4 0.01647 0.01647 0.01647 0.47% FabArray::Saxpy() 604 0.01602 0.01602 0.01602 0.46% Castro::construct_new_source() 63 0.01525 0.01525 0.01525 0.43% BndryData::define() 26 0.01326 0.01326 0.01326 0.38% MLPoisson::Fsmooth() 1376 0.01276 0.01276 0.01276 0.36% MLCellLinOp::reflux() 30 0.01002 0.01002 0.01002 0.29% amrex::Dot() 466 0.009381 0.009381 0.009381 0.27% FabArray::norminf() 439 0.008865 0.008865 0.008865 0.25% Castro::construct_old_gravity_source() 18 0.008234 0.008234 0.008234 0.23% Castro::FluxRegCrseInit 9 0.007968 0.007968 0.007968 0.23% Castro::initData() 1 0.007008 0.007008 0.007008 0.20% MLPoisson::Fapply() 493 0.006928 0.006928 0.006928 0.20% FabArray::Xpay() 353 0.006534 0.006534 0.006534 0.19% amrex::average_down 233 0.006218 0.006218 0.006218 0.18% AmrMesh::MakeNewGrids() 6 0.005455 0.005455 0.005455 0.16% Castro::construct_new_gravity_source() 9 0.005187 0.005187 0.005187 0.15% Castro::construct_old_source() 63 0.004875 0.004875 0.004875 0.14% Castro::wd_update() 6 0.00485 0.00485 0.00485 0.14% Amr::writePlotFile() 2 0.004705 0.004705 0.004705 0.13% MLMG::addInterpCorrection() 155 0.004549 0.004549 0.004549 0.13% Castro::reset_internal_energy(Fab) 1476 0.004378 0.004378 0.004378 0.12% Gravity::actual_solve_with_mlmg() 10 0.003765 0.003765 0.003765 0.11% FabArrayBase::CPC::define() 534 0.003743 0.003743 0.003743 0.11% FillPatchInterp(MF) 30 0.003731 0.003731 0.003731 0.11% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.00372 0.00372 0.00372 0.11% FabArray::setDomainBndry() 92 0.003354 0.003354 0.003354 0.10% Castro::apply_tagging_restrictions() 6 0.003323 0.003323 0.003323 0.09% check_for_negative_density() 9 0.00331 0.00331 0.00331 0.09% MultiFab::contains_nan() 18 0.003257 0.003257 0.003257 0.09% MLCellLinOp::compGrad() 18 0.002966 0.002966 0.002966 0.08% MLCellLinOp::defineBC() 10 0.002745 0.002745 0.002745 0.08% FabArray::mult() 55 0.002584 0.002584 0.002584 0.07% MLCellLinOp::setLevelBC() 18 0.00253 0.00253 0.00253 0.07% Castro::fill_hybrid_hydro_source() 27 0.002073 0.002073 0.002073 0.06% MLCellLinOp::prepareForSolve() 10 0.002043 0.002043 0.002043 0.06% MLMG::prepareForSolve() 10 0.001841 0.001841 0.001841 0.05% Castro::enforce_speed_limit() 87 0.001819 0.001819 0.001819 0.05% MLPoisson::FFlux() 150 0.001512 0.001512 0.001512 0.04% MLCellLinOp::updateSolBC() 25 0.001401 0.001401 0.001401 0.04% TagBoxArray::mapPRD 6 0.001391 0.001391 0.001391 0.04% Gravity::get_new_grav_vector() 10 0.001243 0.001243 0.001243 0.04% FabArray::norminf(mask) 21 0.001235 0.001235 0.001235 0.04% FabArrayBase::getCPC() 1522 0.001126 0.001126 0.001126 0.03% OwnerMask() 6 0.001035 0.001035 0.001035 0.03% MLCellLinOp::updateCorBC() 17 0.001028 0.001028 0.001028 0.03% Castro::build_fine_mask() 44 0.00102 0.00102 0.00102 0.03% Gravity::get_old_grav_vector() 9 0.000983 0.000983 0.000983 0.03% average_down_faces 48 0.000898 0.000898 0.000898 0.03% TagBoxArray::collate() 6 0.0008095 0.0008095 0.0008095 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.0007871 0.0007871 0.0007871 0.02% FillPatchTwoLevels 31 0.0007449 0.0007449 0.0007449 0.02% MLCGSolver::bicgstab 31 0.0007049 0.0007049 0.0007049 0.02% Castro::FluxRegFineAdd() 9 0.0006606 0.0006606 0.0006606 0.02% main() 1 0.0006448 0.0006448 0.0006448 0.02% AmrLevel::FillPatch() 62 0.0006275 0.0006275 0.0006275 0.02% MultiFab::max() 18 0.0006142 0.0006142 0.0006142 0.02% FillPatchIterator::Initialize 62 0.0005739 0.0005739 0.0005739 0.02% Castro::apply_problem_tags() 6 0.00052 0.00052 0.00052 0.01% MultiFab::Multiply() 8 0.0005132 0.0005132 0.0005132 0.01% MLCellLinOp::smooth() 688 0.0004731 0.0004731 0.0004731 0.01% FabArrayBase::FB::FB() 37 0.0004409 0.0004409 0.0004409 0.01% MLMG::interpCorrection_1 17 0.0004108 0.0004108 0.0004108 0.01% Castro::linear_to_hybrid_momentum() 1 0.0004061 0.0004061 0.0004061 0.01% FabArray::FillBoundary() 1728 0.000401 0.000401 0.000401 0.01% Castro::Castro() 5 0.0003629 0.0003629 0.0003629 0.01% Amr::regrid() 5 0.0003452 0.0003452 0.0003452 0.01% FabArray::ParallelCopy() 954 0.000343 0.000343 0.000343 0.01% Castro::initialize_do_advance() 9 0.0003249 0.0003249 0.0003249 0.01% FabArrayBase::getFB() 1728 0.0002999 0.0002999 0.0002999 0.01% Gravity::update_max_rhs() 10 0.0002663 0.0002663 0.0002663 0.01% Castro::subcycle_advance_ctu() 5 0.0002447 0.0002447 0.0002447 0.01% Gravity::actual_multilevel_solve() 10 0.0002423 0.0002423 0.0002423 0.01% AMRErrorTag::operator() 6 0.0002386 0.0002386 0.0002386 0.01% Castro::construct_new_rotation_source() 9 0.0002358 0.0002358 0.0002358 0.01% MLCellLinOp::apply() 493 0.0002349 0.0002349 0.0002349 0.01% Castro::clean_state() 87 0.0002305 0.0002305 0.0002305 0.01% Castro::construct_old_rotation_source() 9 0.0002037 0.0002037 0.0002037 0.01% MLLinOp::defineGrids() 10 0.0001989 0.0001989 0.0001989 0.01% Amr::coarseTimeStep() 5 0.0001944 0.0001944 0.0001944 0.01% Castro::finalize_do_advance() 9 0.0001648 0.0001648 0.0001648 0.00% StateData::define() 25 0.0001546 0.0001546 0.0001546 0.00% Castro::enforce_consistent_e() 1 0.000151 0.000151 0.000151 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001308 0.0001308 0.0001308 0.00% MLCGSolver::ParallelAllReduce 745 0.0001304 0.0001304 0.0001304 0.00% Castro::swap_state_time_levels() 9 0.0001267 0.0001267 0.0001267 0.00% Castro::construct_new_gravity() 9 0.000126 0.000126 0.000126 0.00% Castro::do_old_sources() 9 0.0001246 0.0001246 0.0001246 0.00% Castro::initialize_advance() 9 0.0001191 0.0001191 0.0001191 0.00% Castro::do_advance_ctu() 5 0.0001154 0.0001154 0.0001154 0.00% Castro::finalize_advance() 9 0.0001112 0.0001112 0.0001112 0.00% Amr::grid_places() 6 0.0001022 0.0001022 0.0001022 0.00% Castro::buildMetrics() 5 0.0001015 0.0001015 0.0001015 0.00% MLMG::mgVcycle() 65 9.807e-05 9.807e-05 9.807e-05 0.00% Castro::construct_old_gravity() 9 9.759e-05 9.759e-05 9.759e-05 0.00% MLCellLinOp::correctionResidual() 189 9.544e-05 9.544e-05 9.544e-05 0.00% Castro::do_new_sources() 9 8.834e-05 8.834e-05 8.834e-05 0.00% Castro::advance() 5 8.379e-05 8.379e-05 8.379e-05 0.00% AmrLevel::derive() 6 7.85e-05 7.85e-05 7.85e-05 0.00% Amr::timeStep() 9 7.517e-05 7.517e-05 7.517e-05 0.00% Castro::post_regrid() 10 7.221e-05 7.221e-05 7.221e-05 0.00% FillPatchSingleLevel 92 5.992e-05 5.992e-05 5.992e-05 0.00% AmrLevel::AmrLevel(dm) 5 5.259e-05 5.259e-05 5.259e-05 0.00% MLMG::oneIter() 31 5.254e-05 5.254e-05 5.254e-05 0.00% Castro::errorEst() 6 5.243e-05 5.243e-05 5.243e-05 0.00% FabArray::RecvLayoutMask() 8 4.927e-05 4.927e-05 4.927e-05 0.00% Castro::react_state() 18 4.877e-05 4.877e-05 4.877e-05 0.00% MLMG::solve() 10 4.865e-05 4.865e-05 4.865e-05 0.00% Castro::create_source_corrector() 9 4.823e-05 4.823e-05 4.823e-05 0.00% MLMG:computeResOfCorrection() 155 4.81e-05 4.81e-05 4.81e-05 0.00% Castro::post_timestep() 9 4.64e-05 4.64e-05 4.64e-05 0.00% Castro::computeNewDt() 8 4.203e-05 4.203e-05 4.203e-05 0.00% FillPatchIterator::FillFromLevel0() 31 4.2e-05 4.2e-05 4.2e-05 0.00% MLCellLinOp::solutionResidual() 71 4.134e-05 4.134e-05 4.134e-05 0.00% MLMG::mgVcycle_down::0 31 4.089e-05 4.089e-05 4.089e-05 0.00% MLMG::mgVcycle_bottom 65 3.953e-05 3.953e-05 3.953e-05 0.00% AmrLevel::FillCoarsePatch() 5 3.937e-05 3.937e-05 3.937e-05 0.00% Amr::writeSmallPlotFile() 1 3.895e-05 3.895e-05 3.895e-05 0.00% MLMG::actualBottomSolve() 31 3.839e-05 3.839e-05 3.839e-05 0.00% Amr::defBaseLevel() 1 3.707e-05 3.707e-05 3.707e-05 0.00% MLMG::mgVcycle_down::1 31 3.252e-05 3.252e-05 3.252e-05 0.00% Amr::FinalizeInit() 1 3.122e-05 3.122e-05 3.122e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 3.088e-05 3.088e-05 3.088e-05 0.00% MLMG::mgVcycle_down::3 31 3.064e-05 3.064e-05 3.064e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.958e-05 2.958e-05 2.958e-05 0.00% MLMG::mgVcycle_down::2 31 2.931e-05 2.931e-05 2.931e-05 0.00% makeSFC 50 2.8e-05 2.8e-05 2.8e-05 0.00% MLMG::mgVcycle_down::4 31 2.651e-05 2.651e-05 2.651e-05 0.00% Gravity::solve_phi_with_mlmg() 10 2.636e-05 2.636e-05 2.636e-05 0.00% MLMG::ResNormInf() 54 2.465e-05 2.465e-05 2.465e-05 0.00% MLMG::mgVcycle_up::4 31 2.21e-05 2.21e-05 2.21e-05 0.00% MLMG::mgVcycle_up::0 31 2.152e-05 2.152e-05 2.152e-05 0.00% DistributionMapping::Distribute() 52 2.053e-05 2.053e-05 2.053e-05 0.00% MLMG::mgVcycle_up::3 31 1.98e-05 1.98e-05 1.98e-05 0.00% FabArrayBase::TheFPinfo() 25 1.975e-05 1.975e-05 1.975e-05 0.00% MLMG::mgVcycle_up::1 31 1.972e-05 1.972e-05 1.972e-05 0.00% MLPoisson::define() 10 1.95e-05 1.95e-05 1.95e-05 0.00% FPinfo::FPinfo() 3 1.851e-05 1.851e-05 1.851e-05 0.00% MLMG::mgVcycle_up::2 31 1.849e-05 1.849e-05 1.849e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.497e-05 1.497e-05 1.497e-05 0.00% MLMG::computeResidual() 31 1.453e-05 1.453e-05 1.453e-05 0.00% MLMG::miniCycle() 34 1.393e-05 1.393e-05 1.393e-05 0.00% Amr::initSubcycle() 1 1.379e-05 1.379e-05 1.379e-05 0.00% MLMG::computeMLResidual() 15 1.373e-05 1.373e-05 1.373e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.321e-05 1.321e-05 1.321e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.291e-05 1.291e-05 1.291e-05 0.00% ClusterList::intersect() 4 1.213e-05 1.213e-05 1.213e-05 0.00% Castro::post_init() 1 1.212e-05 1.212e-05 1.212e-05 0.00% Castro::check_for_nan() 18 1.132e-05 1.132e-05 1.132e-05 0.00% Castro::expand_state() 13 9.305e-06 9.305e-06 9.305e-06 0.00% Castro::apply_source_to_state() 18 9.283e-06 9.283e-06 9.283e-06 0.00% MLLinOp::define() 10 8.574e-06 8.574e-06 8.574e-06 0.00% Castro::construct_new_hybrid_source() 9 8.382e-06 8.382e-06 8.382e-06 0.00% MLMG::getGradSolution() 10 8.261e-06 8.261e-06 8.261e-06 0.00% MLMG::MLResNormInf() 15 7.684e-06 7.684e-06 7.684e-06 0.00% Gravity::swapTimeLevels() 9 7.579e-06 7.579e-06 7.579e-06 0.00% Castro::avgDown(state_indx) 20 7.555e-06 7.555e-06 7.555e-06 0.00% amrex::average_down_w_geom 20 7.363e-06 7.363e-06 7.363e-06 0.00% AmrMesh-cluster 4 7.232e-06 7.232e-06 7.232e-06 0.00% Castro::construct_old_hybrid_source() 9 7.193e-06 7.193e-06 7.193e-06 0.00% MLPoisson::prepareForSolve() 10 6.934e-06 6.934e-06 6.934e-06 0.00% Amr::InitializeInit() 1 6.911e-06 6.911e-06 6.911e-06 0.00% BoxList::parallelComplementIn() 12 5.179e-06 5.179e-06 5.179e-06 0.00% MLMG::MLRhsNormInf() 10 5.041e-06 5.041e-06 5.041e-06 0.00% Castro::init(old) 3 4.715e-06 4.715e-06 4.715e-06 0.00% BoxList::complementIn 12 4.649e-06 4.649e-06 4.649e-06 0.00% Castro::avgDown() 4 4.231e-06 4.231e-06 4.231e-06 0.00% Castro::computeInitialDt() 2 3.859e-06 3.859e-06 3.859e-06 0.00% Castro::derive() 6 3.371e-06 3.371e-06 3.371e-06 0.00% Gravity::set_mass_offset() 6 3.03e-06 3.03e-06 3.03e-06 0.00% Castro::retry_advance_ctu() 5 2.801e-06 2.801e-06 2.801e-06 0.00% Amr::init() 1 2.608e-06 2.608e-06 2.608e-06 0.00% Amr::bldFineLevels() 1 2.422e-06 2.422e-06 2.422e-06 0.00% Castro::init() 1 1.949e-06 1.949e-06 1.949e-06 0.00% ClusterList::chop() 4 1.946e-06 1.946e-06 1.946e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.871e-06 1.871e-06 1.871e-06 0.00% Amr::initialInit() 1 1.46e-06 1.46e-06 1.46e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.508 3.508 3.508 100.00% Amr::coarseTimeStep() 5 1.535 1.535 1.535 43.75% Amr::timeStep() 9 1.529 1.529 1.529 43.60% Amr::InitAmr() 1 1.41 1.41 1.41 40.18% Castro::advance() 5 1.3 1.3 1.3 37.07% Castro::subcycle_advance_ctu() 5 1.276 1.276 1.276 36.37% Castro::do_advance_ctu() 5 1.276 1.276 1.276 36.36% Castro::construct_ctu_hydro_source() 9 0.7756 0.7756 0.7756 22.11% Amr::init() 1 0.4061 0.4061 0.4061 11.58% Gravity::multilevel_solve_for_new_phi() 10 0.3331 0.3331 0.3331 9.49% Gravity::actual_multilevel_solve() 10 0.3323 0.3323 0.3323 9.47% Gravity::solve_phi_with_mlmg() 10 0.3291 0.3291 0.3291 9.38% Amr::writePlotFile() 2 0.3048 0.3048 0.3048 8.69% VisMF::Write(FabArray) 3 0.2976 0.2976 0.2976 8.48% Amr::initialInit() 1 0.2582 0.2582 0.2582 7.36% Gravity::actual_solve_with_mlmg() 10 0.2536 0.2536 0.2536 7.23% Castro::clean_state() 87 0.2026 0.2026 0.2026 5.77% MLMG::solve() 10 0.1995 0.1995 0.1995 5.69% Castro::construct_new_gravity() 9 0.1947 0.1947 0.1947 5.55% MLMG::oneIter() 31 0.1685 0.1685 0.1685 4.80% Amr::InitializeInit() 1 0.1626 0.1626 0.1626 4.64% Amr::defBaseLevel() 1 0.1626 0.1626 0.1626 4.64% Amr::regrid() 5 0.1563 0.1563 0.1563 4.46% Castro::Castro() 5 0.1521 0.1521 0.1521 4.33% Castro::initMFs() 5 0.148 0.148 0.148 4.22% MLMG::mgVcycle() 65 0.1446 0.1446 0.1446 4.12% Castro::post_regrid() 10 0.1407 0.1407 0.1407 4.01% Castro::computeTemp() 88 0.1035 0.1035 0.1035 2.95% AmrLevel::FillPatch() 62 0.09798 0.09798 0.09798 2.79% Amr::FinalizeInit() 1 0.09557 0.09557 0.09557 2.72% MLCellLinOp::applyBC() 1917 0.09306 0.09306 0.09306 2.65% Castro::post_init() 1 0.08472 0.08472 0.08472 2.41% FillPatchIterator::Initialize 62 0.08352 0.08352 0.08352 2.38% MLCellLinOp::smooth() 688 0.08251 0.08251 0.08251 2.35% Castro::reflux() 4 0.0777 0.0777 0.0777 2.21% Castro::problem_post_timestep() 10 0.07522 0.07522 0.07522 2.14% Gravity::fill_multipole_BCs() 10 0.07495 0.07495 0.07495 2.14% FillPatchSingleLevel 92 0.07495 0.07495 0.07495 2.14% Castro::normalize_species() 87 0.07439 0.07439 0.07439 2.12% Castro::post_timestep() 9 0.07287 0.07287 0.07287 2.08% FillPatchIterator::FillFromLevel0() 31 0.0723 0.0723 0.0723 2.06% StateDataPhysBCFunct::() 95 0.05571 0.05571 0.05571 1.59% Castro::do_new_sources() 9 0.05569 0.05569 0.05569 1.59% Castro::initialize_do_advance() 9 0.05193 0.05193 0.05193 1.48% FabArray::FillBoundary() 1728 0.04437 0.04437 0.04437 1.26% FillBoundary_nowait() 1728 0.04396 0.04396 0.04396 1.25% Castro::do_old_sources() 9 0.04383 0.04383 0.04383 1.25% MLPoisson::define() 10 0.0434 0.0434 0.0434 1.24% Castro::expand_state() 13 0.0425 0.0425 0.0425 1.21% MLMG::mgVcycle_bottom 65 0.03885 0.03885 0.03885 1.11% FabArray::setVal() 920 0.03834 0.03834 0.03834 1.09% StateData::FillBoundary(geom) 650 0.0353 0.0353 0.0353 1.01% FabArray::ParallelCopy() 954 0.03503 0.03503 0.03503 1.00% FabArray::ParallelCopy_nowait() 954 0.03469 0.03469 0.03469 0.99% Castro::wd_update() 6 0.03367 0.03367 0.03367 0.96% MLMG::actualBottomSolve() 31 0.03172 0.03172 0.03172 0.90% MLCGSolver::bicgstab 31 0.03142 0.03142 0.03142 0.90% FluxRegister::Reflux() 24 0.02974 0.02974 0.02974 0.85% MLMG::mgVcycle_down::0 31 0.02931 0.02931 0.02931 0.84% Castro::volInBoundary() 42 0.02882 0.02882 0.02882 0.82% Castro::reset_internal_energy(MultiFab) 88 0.02848 0.02848 0.02848 0.81% MLCellLinOp::apply() 493 0.0283 0.0283 0.0283 0.81% Castro::construct_new_source() 63 0.02814 0.02814 0.02814 0.80% amrex::Copy() 441 0.02671 0.02671 0.02671 0.76% Gravity::get_new_grav_vector() 10 0.02576 0.02576 0.02576 0.73% MLCellLinOp::defineAuxData() 10 0.02485 0.02485 0.02485 0.71% Castro::initialize_advance() 9 0.02438 0.02438 0.02438 0.69% Castro::enforce_min_density() 87 0.02407 0.02407 0.02407 0.69% MLMG::mgVcycle_up::0 31 0.02196 0.02196 0.02196 0.63% Castro::construct_old_gravity() 9 0.0206 0.0206 0.0206 0.59% Gravity::get_old_grav_vector() 9 0.0205 0.0205 0.0205 0.58% MLCellLinOp::correctionResidual() 189 0.01845 0.01845 0.01845 0.53% MLCellLinOp::defineBC() 10 0.01825 0.01825 0.01825 0.52% Castro::estTimeStep() 26 0.01747 0.01747 0.01747 0.50% amrex::Add() 136 0.01732 0.01732 0.01732 0.49% MLCellLinOp::reflux() 30 0.0163 0.0163 0.0163 0.46% FabArray::Saxpy() 604 0.01602 0.01602 0.01602 0.46% BndryData::define() 26 0.01536 0.01536 0.01536 0.44% Amr::grid_places() 6 0.01501 0.01501 0.01501 0.43% AmrMesh::MakeNewGrids() 6 0.01491 0.01491 0.01491 0.43% MLCellLinOp::solutionResidual() 71 0.0148 0.0148 0.0148 0.42% MLMG:computeResOfCorrection() 155 0.0141 0.0141 0.0141 0.40% MLMG::computeResWithCrseSolFineCor() 17 0.01382 0.01382 0.01382 0.39% MLMG::computeMLResidual() 15 0.01325 0.01325 0.01325 0.38% Castro::construct_old_source() 63 0.01295 0.01295 0.01295 0.37% MLPoisson::Fsmooth() 1376 0.01276 0.01276 0.01276 0.36% Castro::initData() 1 0.01215 0.01215 0.01215 0.35% MLMG::mgVcycle_down::1 31 0.01175 0.01175 0.01175 0.34% amrex::average_down 233 0.009969 0.009969 0.009969 0.28% amrex::Dot() 466 0.009381 0.009381 0.009381 0.27% Castro::FluxRegCrseInit 9 0.009033 0.009033 0.009033 0.26% MLMG::prepareForSolve() 10 0.008959 0.008959 0.008959 0.26% FabArray::norminf() 439 0.008865 0.008865 0.008865 0.25% MLMG::mgVcycle_up::1 31 0.008605 0.008605 0.008605 0.25% Castro::construct_old_gravity_source() 18 0.008234 0.008234 0.008234 0.23% Castro::computeNewDt() 8 0.00749 0.00749 0.00749 0.21% FillPatchIterator::FillFromTwoLevels() 31 0.007463 0.007463 0.007463 0.21% FillPatchTwoLevels 31 0.007432 0.007432 0.007432 0.21% Castro::finalize_do_advance() 9 0.00742 0.00742 0.00742 0.21% Amr::bldFineLevels() 1 0.007199 0.007199 0.007199 0.21% MLMG::miniCycle() 34 0.007137 0.007137 0.007137 0.20% MLMG::addInterpCorrection() 155 0.007016 0.007016 0.007016 0.20% MLPoisson::Fapply() 493 0.006928 0.006928 0.006928 0.20% MLMG::mgVcycle_down::2 31 0.006909 0.006909 0.006909 0.20% FabArray::Xpay() 353 0.006534 0.006534 0.006534 0.19% MLMG::mgVcycle_down::3 31 0.006299 0.006299 0.006299 0.18% MLMG::mgVcycle_down::4 31 0.006164 0.006164 0.006164 0.18% MLMG::computeResidual() 31 0.005953 0.005953 0.005953 0.17% MLCGSolver::ParallelAllReduce 745 0.005301 0.005301 0.005301 0.15% Castro::construct_new_gravity_source() 9 0.005187 0.005187 0.005187 0.15% Castro::errorEst() 6 0.005065 0.005065 0.005065 0.14% MLMG::mgVcycle_up::4 31 0.005064 0.005064 0.005064 0.14% FabArrayBase::getCPC() 1522 0.004869 0.004869 0.004869 0.14% MLMG::mgVcycle_up::2 31 0.004823 0.004823 0.004823 0.14% MLMG::mgVcycle_up::3 31 0.004812 0.004812 0.004812 0.14% MLMG::getGradSolution() 10 0.004472 0.004472 0.004472 0.13% MLCellLinOp::compGrad() 18 0.004464 0.004464 0.004464 0.13% Castro::reset_internal_energy(Fab) 1476 0.004378 0.004378 0.004378 0.12% Castro::apply_source_to_state() 18 0.004227 0.004227 0.004227 0.12% FabArrayBase::CPC::define() 534 0.003743 0.003743 0.003743 0.11% FillPatchInterp(MF) 30 0.003731 0.003731 0.003731 0.11% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.00372 0.00372 0.00372 0.11% MLMG::computeResWithCrseCorFineCor() 17 0.003607 0.003607 0.003607 0.10% MLCellLinOp::updateSolBC() 25 0.003394 0.003394 0.003394 0.10% FabArray::setDomainBndry() 92 0.003354 0.003354 0.003354 0.10% Castro::apply_tagging_restrictions() 6 0.003323 0.003323 0.003323 0.09% check_for_negative_density() 9 0.00331 0.00331 0.00331 0.09% Castro::check_for_nan() 18 0.003268 0.003268 0.003268 0.09% TagBoxArray::mapPRD 6 0.003258 0.003258 0.003258 0.09% MultiFab::contains_nan() 18 0.003257 0.003257 0.003257 0.09% Castro::init(old) 3 0.003072 0.003072 0.003072 0.09% Castro::computeInitialDt() 2 0.002773 0.002773 0.002773 0.08% FabArray::mult() 55 0.002584 0.002584 0.002584 0.07% MLCellLinOp::setLevelBC() 18 0.00253 0.00253 0.00253 0.07% Castro::buildMetrics() 5 0.002492 0.002492 0.002492 0.07% MLCellLinOp::updateCorBC() 17 0.002358 0.002358 0.002358 0.07% MLMG::ResNormInf() 54 0.002118 0.002118 0.002118 0.06% Castro::fill_hybrid_hydro_source() 27 0.002073 0.002073 0.002073 0.06% MLPoisson::prepareForSolve() 10 0.00205 0.00205 0.00205 0.06% MLCellLinOp::prepareForSolve() 10 0.002043 0.002043 0.002043 0.06% Gravity::update_max_rhs() 10 0.00204 0.00204 0.00204 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.001998 0.001998 0.001998 0.06% Castro::enforce_speed_limit() 87 0.001819 0.001819 0.001819 0.05% MLPoisson::FFlux() 150 0.001512 0.001512 0.001512 0.04% Castro::construct_new_hybrid_source() 9 0.001456 0.001456 0.001456 0.04% average_down_faces 48 0.001333 0.001333 0.001333 0.04% FabArray::norminf(mask) 21 0.001235 0.001235 0.001235 0.04% Castro::avgDown() 4 0.001206 0.001206 0.001206 0.03% Castro::avgDown(state_indx) 20 0.001202 0.001202 0.001202 0.03% amrex::average_down_w_geom 20 0.001194 0.001194 0.001194 0.03% MLMG::MLResNormInf() 15 0.00116 0.00116 0.00116 0.03% OwnerMask() 6 0.001035 0.001035 0.001035 0.03% Castro::build_fine_mask() 44 0.00102 0.00102 0.00102 0.03% MLMG::interpCorrection_1 17 0.0009858 0.0009858 0.0009858 0.03% Castro::derive() 6 0.0009309 0.0009309 0.0009309 0.03% AmrLevel::derive() 6 0.0009276 0.0009276 0.0009276 0.03% Castro::init() 1 0.000922 0.000922 0.000922 0.03% AmrLevel::FillCoarsePatch() 5 0.00092 0.00092 0.00092 0.03% TagBoxArray::collate() 6 0.0008095 0.0008095 0.0008095 0.02% FabArrayBase::getFB() 1728 0.0007407 0.0007407 0.0007407 0.02% Gravity::swapTimeLevels() 9 0.0006926 0.0006926 0.0006926 0.02% Castro::FluxRegFineAdd() 9 0.0006606 0.0006606 0.0006606 0.02% Castro::construct_old_hybrid_source() 9 0.0006323 0.0006323 0.0006323 0.02% MultiFab::max() 18 0.0006142 0.0006142 0.0006142 0.02% MLMG::MLRhsNormInf() 10 0.0006082 0.0006082 0.0006082 0.02% Castro::apply_problem_tags() 6 0.00052 0.00052 0.00052 0.01% MultiFab::Multiply() 8 0.0005132 0.0005132 0.0005132 0.01% Castro::react_state() 18 0.0004561 0.0004561 0.0004561 0.01% FabArrayBase::FB::FB() 37 0.0004409 0.0004409 0.0004409 0.01% Castro::linear_to_hybrid_momentum() 1 0.0004061 0.0004061 0.0004061 0.01% MLLinOp::define() 10 0.0002708 0.0002708 0.0002708 0.01% MLLinOp::defineGrids() 10 0.0002623 0.0002623 0.0002623 0.01% AMRErrorTag::operator() 6 0.0002386 0.0002386 0.0002386 0.01% Castro::construct_new_rotation_source() 9 0.0002358 0.0002358 0.0002358 0.01% AmrLevel::AmrLevel(dm) 5 0.0002072 0.0002072 0.0002072 0.01% Castro::construct_old_rotation_source() 9 0.0002037 0.0002037 0.0002037 0.01% StateData::define() 25 0.0001546 0.0001546 0.0001546 0.00% Castro::enforce_consistent_e() 1 0.000151 0.000151 0.000151 0.00% Castro::swap_state_time_levels() 9 0.0001267 0.0001267 0.0001267 0.00% Castro::finalize_advance() 9 0.0001112 0.0001112 0.0001112 0.00% MLLinOp::makeAgglomeratedDMap 10 6.154e-05 6.154e-05 6.154e-05 0.00% FabArray::RecvLayoutMask() 8 4.927e-05 4.927e-05 4.927e-05 0.00% Castro::create_source_corrector() 9 4.823e-05 4.823e-05 4.823e-05 0.00% makeSFC 50 4.656e-05 4.656e-05 4.656e-05 0.00% Amr::writeSmallPlotFile() 1 3.895e-05 3.895e-05 3.895e-05 0.00% FabArrayBase::TheFPinfo() 25 3.826e-05 3.826e-05 3.826e-05 0.00% AmrMesh-cluster 4 2.131e-05 2.131e-05 2.131e-05 0.00% DistributionMapping::Distribute() 52 2.053e-05 2.053e-05 2.053e-05 0.00% FPinfo::FPinfo() 3 1.851e-05 1.851e-05 1.851e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.489e-05 1.489e-05 1.489e-05 0.00% Amr::initSubcycle() 1 1.379e-05 1.379e-05 1.379e-05 0.00% ClusterList::intersect() 4 1.213e-05 1.213e-05 1.213e-05 0.00% BoxList::parallelComplementIn() 12 9.828e-06 9.828e-06 9.828e-06 0.00% BoxList::complementIn 12 4.649e-06 4.649e-06 4.649e-06 0.00% Gravity::set_mass_offset() 6 3.03e-06 3.03e-06 3.03e-06 0.00% Castro::retry_advance_ctu() 5 2.801e-06 2.801e-06 2.801e-06 0.00% ClusterList::chop() 4 1.946e-06 1.946e-06 1.946e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.871e-06 1.871e-06 1.871e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1551 KiB 9037 MiB Castro::reflux() 436 436 12 MiB 666 MiB Castro::initMFs() 258 258 314 MiB 576 MiB Castro::swap_state_time_levels() 175 175 161 MiB 340 MiB StateData::define() 175 175 199 MiB 340 MiB Castro::initialize_do_advance() 143 143 111 MiB 325 MiB FillPatchIterator::Initialize 899 899 3735 KiB 303 MiB Amr::writePlotFile() 56 56 15 MiB 189 MiB Castro::problem_post_timestep() 162 162 880 KiB 167 MiB Castro::FluxRegCrseInit 660 660 403 KiB 167 MiB FluxRegister::Reflux() 648 648 1376 KiB 160 MiB Castro::initialize_advance() 143 143 44 MiB 121 MiB Castro::construct_new_source() 143 143 222 KiB 67 MiB Castro::construct_old_source() 143 143 128 KiB 67 MiB Castro::buildMetrics() 140 140 33 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 25 MiB 60 MiB Castro::Castro() 210 210 3810 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2448 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 194 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 242 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 800 KiB 16 MiB FillPatchTwoLevels 300 300 6890 B 11 MiB FillPatchInterp(MF) 330 330 4253 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 120 KiB 7469 KiB Gravity::update_max_rhs() 286 286 3993 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 688 KiB 7424 KiB Castro::build_fine_mask() 224 224 1157 KiB 6912 KiB AmrLevel::derive() 162 162 2309 B 6912 KiB BndryData::define() 3624 3624 255 KiB 4243 KiB MLCellLinOp::reflux() 450 450 5334 B 2376 KiB Castro::wd_update() 6 6 21 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 376 B 2095 KiB amrex::average_down 1483 1483 2131 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 4470 B 1042 KiB MLMG::addInterpCorrection() 1240 1240 716 B 867 KiB MLCellLinOp::defineBC() 276 276 3455 B 689 KiB Castro::estTimeStep() 26 26 2373 B 480 KiB VisMF::Write(FabArray) 1568 1568 2092 B 320 KiB Castro::normalize_species() 87 87 6910 B 320 KiB Castro::volInBoundary() 70 70 2664 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 114 B 204 KiB FabArray::norminf(mask) 29 29 168 B 163 KiB amrex::Dot() 559 559 396 B 160 KiB FabArray::norminf() 470 470 390 B 160 KiB MultiFab::max() 18 18 27 B 160 KiB check_for_negative_density() 9 9 153 B 160 KiB Castro::initData() 1 1 42 B 160 KiB FabArray::setVal() 419 419 49 KiB 120 KiB MLMG::interpCorrection_1 34 34 24 B 91 KiB average_down_faces 99 99 579 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 249 B 57 KiB MLPoisson::Fsmooth() 228 228 2789 B 55 KiB FillBoundary_nowait() 751 751 403 B 53 KiB TagBoxArray::mapPRD 324 324 37 B 45 KiB OwnerMask() 168 168 10 B 38 KiB MLCellLinOp::applyBC() 3834 3834 129 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 5 B 25 KiB amrex::Copy() 176 176 8604 B 25 KiB MultiFab::contains_nan() 18 18 18 B 20 KiB StateData::FillBoundary(geom) 2538 2538 48 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 577 B 3456 B MLCGSolver::bicgstab 155 155 23 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 152 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 10 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 541 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1118 B 278 KiB FabArray::setVal() 419 419 49 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 249 B 57 KiB MLPoisson::Fsmooth() 228 228 2789 B 55 KiB FillBoundary_nowait() 751 751 403 B 53 KiB MLCellLinOp::applyBC() 1917 1917 129 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 5 B 25 KiB amrex::Copy() 176 176 8604 B 25 KiB Gravity::get_new_grav_vector() 18 18 3166 B 20 KiB Gravity::get_old_grav_vector() 12 12 5770 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 48 B 14 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1220 B 6304 B MLMG::prepareForSolve() 18 18 208 B 3712 B FabArray::norminf(mask) 29 29 115 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 577 B 3456 B Castro::FluxRegCrseInit 12 12 8 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 554 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 2 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1781 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (24.04-9-g2a3955a5f5aa) finalized