Initializing AMReX (24.04-15-g7813bb7d6bc6)... Initializing CUDA... CUDA initialized with 1 device. AMReX (24.04-15-g7813bb7d6bc6) initialized Starting run at 08:24:49 UTC on 2024-04-12. Successfully read inputs file ... Castro git describe: 24.04-14-g3d76cd5a0 AMReX git describe: 24.04-15-g7813bb7d6 Microphysics git describe: 24.04-7-gd4312a6c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003424627 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.001877918 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.009061261 Gravity::multilevel_solve_for_new_phi() time = 0.05338174 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.144705428 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.00341181 on level 0 Castro::do_old_sources() time = 0.009195741 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.140288034 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.007507638 Gravity::multilevel_solve_for_new_phi() time = 0.042944118 Castro::construct_new_gravity() time = 0.046644976 on level 0 Castro::do_new_sources() time = 0.00794727 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.844749968 [Level 0 step 1] Advanced 884736 cells Updating the rotational period from 30.54368673 s to 30.46017574 s. [STEP 1] Coarse TimeStep time: 0.239681217 [STEP 1] FAB kilobyte spread across MPI nodes: [2005477 ... 2005477] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.002220801 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007475909 Gravity::multilevel_solve_for_new_phi() time = 0.060837361 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135647e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (104,88,99) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135647e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135647e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.0033776 on level 0 Castro::do_old_sources() time = 0.006641696 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.171222886 on level 0 Castro::construct_old_gravity() time = 0.000373902 on level 1 Castro::do_old_sources() time = 0.001530109 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007871833 on level 1 Castro::reflux() at level 0 : time = 0.017974837 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007247498 Gravity::multilevel_solve_for_new_phi() time = 0.042426209 Castro::construct_new_gravity() time = 0.046041531 on level 0 Castro::do_new_sources() time = 0.006963108 on level 0 ...estimated hydro-limited timestep at level 0: 0.05461716053 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716053 Castro::construct_new_gravity() time = 0.000403453 on level 1 Castro::do_new_sources() time = 0.002647431 on level 1 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.250306672 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135647e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Updating the rotational period from 30.46017574 s to 30.52759479 s. [STEP 2] Coarse TimeStep time: 0.378007776 [STEP 2] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 2 TIME = 0.005426075163 DT = 2.526135647e-09 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008044208529 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.697001619e-07 ... but limiting to: 2.778749212e-09 = 1.1 * 2.526135647e-09 Now regridding at level lbase = 0 grid_places() time: 0.002124269 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007273904 Gravity::multilevel_solve_for_new_phi() time = 0.015314579 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0008044208529 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044208529 ...estimated hydro-limited timestep at level 1: 6.697001619e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.697001619e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778749212e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003483665 on level 0 Castro::do_old_sources() time = 0.006866588 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.178129778 on level 0 Castro::construct_old_gravity() time = 0.000338951 on level 1 Castro::do_old_sources() time = 0.002158088 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007002566 on level 1 Castro::reflux() at level 0 : time = 0.017884177 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007262314 Gravity::multilevel_solve_for_new_phi() time = 0.029156947 Castro::construct_new_gravity() time = 0.032746651 on level 0 Castro::do_new_sources() time = 0.006901355 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008044237461 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008044237461 Castro::construct_new_gravity() time = 0.000381495 on level 1 Castro::do_new_sources() time = 0.00244765 on level 1 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.346896901 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778749212e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Updating the rotational period from 30.52759479 s to 30.52761298 s. [STEP 3] Coarse TimeStep time: 0.324048003 [STEP 3] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 3 TIME = 0.005426077942 DT = 2.778749212e-09 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.000804308035 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.965184638e-07 ... but limiting to: 3.056624133e-09 = 1.1 * 2.778749212e-09 Now regridding at level lbase = 0 grid_places() time: 0.002038197 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.00716237 Gravity::multilevel_solve_for_new_phi() time = 0.015380307 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.000804308035 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000804308035 ...estimated hydro-limited timestep at level 1: 6.965184638e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.965184638e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056624133e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.003357326 on level 0 Castro::do_old_sources() time = 0.006524141 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.166412203 on level 0 Castro::construct_old_gravity() time = 0.000346415 on level 1 Castro::do_old_sources() time = 0.001784863 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.007750304 on level 1 Castro::reflux() at level 0 : time = 0.017662998 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.007019342 Gravity::multilevel_solve_for_new_phi() time = 0.028960878 Castro::construct_new_gravity() time = 0.032486962 on level 0 Castro::do_new_sources() time = 0.006693839 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008043112215 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008043112215 Castro::construct_new_gravity() time = 0.000392043 on level 1 Castro::do_new_sources() time = 0.003106984 on level 1 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.514680054 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056624133e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Updating the rotational period from 30.52761298 s to 30.52761297 s. [STEP 4] Coarse TimeStep time: 0.309224854 [STEP 4] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 4 TIME = 0.005426080998 DT = 3.056624133e-09 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002497928903 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 7.255166705e-07 ... but limiting to: 3.362286546e-09 = 1.1 * 3.056624133e-09 Now regridding at level lbase = 0 grid_places() time: 0.002091284 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.007094864 Gravity::multilevel_solve_for_new_phi() time = 0.015273384 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 2 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.0002497928903 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002497928903 ...estimated hydro-limited timestep at level 1: 7.255166705e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.255166705e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286546e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.00343304 on level 0 Castro::do_old_sources() time = 0.006627986 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.169433233 on level 0 Castro::construct_old_gravity() time = 0.000354346 on level 1 Castro::do_old_sources() time = 0.001638896 on level 1 ... Entering construct_ctu_hydro_source() on level 1 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 0.006888425 on level 1 Castro::reflux() at level 0 : time = 0.017860001 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.0072042 Gravity::multilevel_solve_for_new_phi() time = 0.0292257 Castro::construct_new_gravity() time = 0.032805704 on level 0 Castro::do_new_sources() time = 0.006988261 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006805523364 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006805523364 Castro::construct_new_gravity() time = 0.0004053 on level 1 Castro::do_new_sources() time = 0.002425587 on level 1 ...estimated hydro-limited timestep at level 1: 7.553385904e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.553385904e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 3.451131291 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286546e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Updating the rotational period from 30.52761297 s to 30.52761296 s. [STEP 5] Coarse TimeStep time: 0.31489035 [STEP 5] FAB kilobyte spread across MPI nodes: [2667545 ... 2667545] STEP = 5 TIME = 0.005426084361 DT = 3.362286546e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.171953256 seconds Ending run at 08:24:52 UTC on 2024-04-12. Run time = 3.219892156 Run time without initialization = 1.738655815 Average number of zones advanced per microsecond: 2.846 Average number of zones advanced per microsecond per rank: 2.846 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9476456448 TinyProfiler total time across processes [min...avg...max]: 3.22 ... 3.22 ... 3.22 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.0998 1.0998 1.0998 34.16% Castro::construct_ctu_hydro_source() 9 0.8175 0.8175 0.8175 25.39% VisMF::Write(FabArray) 3 0.3096 0.3096 0.3096 9.61% Castro::initMFs() 5 0.1494 0.1494 0.1494 4.64% Gravity::fill_multipole_BCs() 10 0.07232 0.07232 0.07232 2.25% Castro::normalize_species() 87 0.06619 0.06619 0.06619 2.06% Castro::computeTemp() 88 0.06473 0.06473 0.06473 2.01% MLCellLinOp::applyBC() 1917 0.04852 0.04852 0.04852 1.51% FillBoundary_nowait() 1728 0.04346 0.04346 0.04346 1.35% FabArray::setVal() 920 0.03848 0.03848 0.03848 1.20% StateData::FillBoundary(geom) 650 0.03547 0.03547 0.03547 1.10% FabArray::ParallelCopy_nowait() 954 0.03067 0.03067 0.03067 0.95% Castro::volInBoundary() 42 0.02948 0.02948 0.02948 0.92% amrex::Copy() 441 0.0267 0.0267 0.0267 0.83% Castro::reset_internal_energy(MultiFab) 88 0.0226 0.0226 0.0226 0.70% FluxRegister::Reflux() 24 0.02242 0.02242 0.02242 0.70% MLCellLinOp::defineAuxData() 10 0.02167 0.02167 0.02167 0.67% amrex::Add() 136 0.01732 0.01732 0.01732 0.54% Castro::construct_new_source() 63 0.0161 0.0161 0.0161 0.50% FabArray::Saxpy() 604 0.01605 0.01605 0.01605 0.50% Castro::estTimeStep() 26 0.01598 0.01598 0.01598 0.50% StateDataPhysBCFunct::() 95 0.01474 0.01474 0.01474 0.46% BndryData::define() 26 0.0135 0.0135 0.0135 0.42% MLPoisson::Fsmooth() 1376 0.01283 0.01283 0.01283 0.40% Castro::enforce_min_density() 87 0.01145 0.01145 0.01145 0.36% Castro::reflux() 4 0.01079 0.01079 0.01079 0.34% MLCellLinOp::reflux() 30 0.009492 0.009492 0.009492 0.29% amrex::Dot() 466 0.009401 0.009401 0.009401 0.29% FabArray::norminf() 439 0.008916 0.008916 0.008916 0.28% Castro::construct_old_gravity_source() 18 0.007975 0.007975 0.007975 0.25% Castro::FluxRegCrseInit 9 0.007948 0.007948 0.007948 0.25% Castro::problem_post_timestep() 10 0.007514 0.007514 0.007514 0.23% MLPoisson::Fapply() 493 0.007006 0.007006 0.007006 0.22% FabArray::Xpay() 353 0.006548 0.006548 0.006548 0.20% Castro::initData() 1 0.006364 0.006364 0.006364 0.20% amrex::average_down 233 0.006208 0.006208 0.006208 0.19% AmrMesh::MakeNewGrids() 6 0.00556 0.00556 0.00556 0.17% Castro::reset_internal_energy(Fab) 1476 0.005503 0.005503 0.005503 0.17% Castro::construct_new_gravity_source() 9 0.005026 0.005026 0.005026 0.16% Amr::writePlotFile() 2 0.004802 0.004802 0.004802 0.15% Castro::wd_update() 6 0.004729 0.004729 0.004729 0.15% MLMG::addInterpCorrection() 155 0.004494 0.004494 0.004494 0.14% Castro::construct_old_source() 63 0.004486 0.004486 0.004486 0.14% FabArrayBase::CPC::define() 534 0.003833 0.003833 0.003833 0.12% Gravity::actual_solve_with_mlmg() 10 0.003762 0.003762 0.003762 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003734 0.003734 0.003734 0.12% FillPatchInterp(MF) 30 0.003704 0.003704 0.003704 0.12% FabArray::setDomainBndry() 92 0.003399 0.003399 0.003399 0.11% check_for_negative_density() 9 0.003253 0.003253 0.003253 0.10% MultiFab::contains_nan() 18 0.003245 0.003245 0.003245 0.10% Castro::enforce_speed_limit() 87 0.003017 0.003017 0.003017 0.09% MLCellLinOp::compGrad() 18 0.002958 0.002958 0.002958 0.09% MLCellLinOp::defineBC() 10 0.002784 0.002784 0.002784 0.09% FabArray::mult() 55 0.002589 0.002589 0.002589 0.08% MLCellLinOp::setLevelBC() 18 0.002557 0.002557 0.002557 0.08% Castro::apply_tagging_restrictions() 6 0.00205 0.00205 0.00205 0.06% MLCellLinOp::prepareForSolve() 10 0.002024 0.002024 0.002024 0.06% Castro::clean_state() 87 0.001951 0.001951 0.001951 0.06% MLMG::prepareForSolve() 10 0.001869 0.001869 0.001869 0.06% Castro::post_timestep() 9 0.001668 0.001668 0.001668 0.05% Castro::fill_hybrid_hydro_source() 27 0.00166 0.00166 0.00166 0.05% MLPoisson::FFlux() 150 0.001495 0.001495 0.001495 0.05% MLCellLinOp::updateSolBC() 25 0.001415 0.001415 0.001415 0.04% TagBoxArray::mapPRD 6 0.001394 0.001394 0.001394 0.04% Gravity::get_new_grav_vector() 10 0.001231 0.001231 0.001231 0.04% FabArray::norminf(mask) 21 0.001223 0.001223 0.001223 0.04% FabArrayBase::getCPC() 1522 0.001147 0.001147 0.001147 0.04% MLCellLinOp::updateCorBC() 17 0.001051 0.001051 0.001051 0.03% OwnerMask() 6 0.00103 0.00103 0.00103 0.03% Castro::build_fine_mask() 44 0.001007 0.001007 0.001007 0.03% Gravity::get_old_grav_vector() 9 0.0009633 0.0009633 0.0009633 0.03% average_down_faces 48 0.0009235 0.0009235 0.0009235 0.03% TagBoxArray::collate() 6 0.000811 0.000811 0.000811 0.03% Gravity::multilevel_solve_for_new_phi() 10 0.0007886 0.0007886 0.0007886 0.02% FillPatchTwoLevels 31 0.0007601 0.0007601 0.0007601 0.02% MLCGSolver::bicgstab 31 0.000739 0.000739 0.000739 0.02% main() 1 0.0007068 0.0007068 0.0007068 0.02% Castro::FluxRegFineAdd() 9 0.0006882 0.0006882 0.0006882 0.02% AmrLevel::FillPatch() 62 0.0006346 0.0006346 0.0006346 0.02% MultiFab::max() 18 0.0006154 0.0006154 0.0006154 0.02% FillPatchIterator::Initialize 62 0.0005954 0.0005954 0.0005954 0.02% Castro::apply_problem_tags() 6 0.0005472 0.0005472 0.0005472 0.02% MLCellLinOp::smooth() 688 0.0005191 0.0005191 0.0005191 0.02% MultiFab::Multiply() 8 0.0005056 0.0005056 0.0005056 0.02% FabArrayBase::FB::FB() 37 0.0004394 0.0004394 0.0004394 0.01% Castro::Castro() 5 0.000429 0.000429 0.000429 0.01% MLMG::interpCorrection_1 17 0.0004142 0.0004142 0.0004142 0.01% FabArray::FillBoundary() 1728 0.0003826 0.0003826 0.0003826 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003683 0.0003683 0.0003683 0.01% Amr::regrid() 5 0.0003537 0.0003537 0.0003537 0.01% FabArray::ParallelCopy() 954 0.0003357 0.0003357 0.0003357 0.01% Castro::initialize_do_advance() 9 0.0002963 0.0002963 0.0002963 0.01% FabArrayBase::getFB() 1728 0.0002898 0.0002898 0.0002898 0.01% Gravity::actual_multilevel_solve() 10 0.0002467 0.0002467 0.0002467 0.01% Gravity::update_max_rhs() 10 0.000243 0.000243 0.000243 0.01% AMRErrorTag::operator() 6 0.0002328 0.0002328 0.0002328 0.01% MLCellLinOp::apply() 493 0.0002325 0.0002325 0.0002325 0.01% Amr::coarseTimeStep() 5 0.0002324 0.0002324 0.0002324 0.01% Castro::construct_new_rotation_source() 9 0.0002208 0.0002208 0.0002208 0.01% Castro::subcycle_advance_ctu() 5 0.0002108 0.0002108 0.0002108 0.01% MLLinOp::defineGrids() 10 0.0001983 0.0001983 0.0001983 0.01% Castro::construct_old_rotation_source() 9 0.0001962 0.0001962 0.0001962 0.01% Castro::construct_new_gravity() 9 0.0001757 0.0001757 0.0001757 0.01% StateData::define() 25 0.0001593 0.0001593 0.0001593 0.00% Castro::enforce_consistent_e() 1 0.000157 0.000157 0.000157 0.00% Castro::initialize_advance() 9 0.0001492 0.0001492 0.0001492 0.00% MLCGSolver::ParallelAllReduce 745 0.0001345 0.0001345 0.0001345 0.00% Castro::do_new_sources() 9 0.000132 0.000132 0.000132 0.00% Castro::swap_state_time_levels() 9 0.0001314 0.0001314 0.0001314 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0001296 0.0001296 0.0001296 0.00% Castro::finalize_advance() 9 0.0001113 0.0001113 0.0001113 0.00% Castro::do_advance_ctu() 5 0.0001097 0.0001097 0.0001097 0.00% MLMG::mgVcycle() 65 0.0001059 0.0001059 0.0001059 0.00% Castro::finalize_do_advance() 9 0.0001056 0.0001056 0.0001056 0.00% Castro::buildMetrics() 5 0.0001026 0.0001026 0.0001026 0.00% MLCellLinOp::correctionResidual() 189 0.0001016 0.0001016 0.0001016 0.00% Castro::do_old_sources() 9 0.0001013 0.0001013 0.0001013 0.00% Castro::construct_old_gravity() 9 9.705e-05 9.705e-05 9.705e-05 0.00% Amr::grid_places() 6 8.654e-05 8.654e-05 8.654e-05 0.00% AmrLevel::derive() 6 7.872e-05 7.872e-05 7.872e-05 0.00% Amr::timeStep() 9 7.814e-05 7.814e-05 7.814e-05 0.00% Castro::create_source_corrector() 9 7.423e-05 7.423e-05 7.423e-05 0.00% Castro::post_regrid() 10 6.24e-05 6.24e-05 6.24e-05 0.00% FillPatchSingleLevel 92 6.055e-05 6.055e-05 6.055e-05 0.00% MLMG::oneIter() 31 5.759e-05 5.759e-05 5.759e-05 0.00% Castro::errorEst() 6 5.261e-05 5.261e-05 5.261e-05 0.00% AmrLevel::AmrLevel(dm) 5 5.206e-05 5.206e-05 5.206e-05 0.00% FabArray::RecvLayoutMask() 8 4.983e-05 4.983e-05 4.983e-05 0.00% MLMG:computeResOfCorrection() 155 4.867e-05 4.867e-05 4.867e-05 0.00% AmrLevel::FillCoarsePatch() 5 4.7e-05 4.7e-05 4.7e-05 0.00% MLMG::solve() 10 4.679e-05 4.679e-05 4.679e-05 0.00% MLCellLinOp::solutionResidual() 71 4.371e-05 4.371e-05 4.371e-05 0.00% Amr::defBaseLevel() 1 4.281e-05 4.281e-05 4.281e-05 0.00% MLMG::actualBottomSolve() 31 4.137e-05 4.137e-05 4.137e-05 0.00% MLMG::mgVcycle_bottom 65 4.133e-05 4.133e-05 4.133e-05 0.00% MLMG::mgVcycle_down::0 31 4.127e-05 4.127e-05 4.127e-05 0.00% Amr::writeSmallPlotFile() 1 3.767e-05 3.767e-05 3.767e-05 0.00% FillPatchIterator::FillFromLevel0() 31 3.67e-05 3.67e-05 3.67e-05 0.00% MLMG::mgVcycle_down::2 31 3.333e-05 3.333e-05 3.333e-05 0.00% Castro::advance() 5 3.205e-05 3.205e-05 3.205e-05 0.00% MLMG::mgVcycle_down::3 31 3.151e-05 3.151e-05 3.151e-05 0.00% MLMG::mgVcycle_down::1 31 3.138e-05 3.138e-05 3.138e-05 0.00% Castro::react_state() 18 2.997e-05 2.997e-05 2.997e-05 0.00% FillPatchIterator::FillFromTwoLevels() 31 2.965e-05 2.965e-05 2.965e-05 0.00% MLMG::ResNormInf() 54 2.856e-05 2.856e-05 2.856e-05 0.00% makeSFC 50 2.769e-05 2.769e-05 2.769e-05 0.00% MLMG::mgVcycle_down::4 31 2.765e-05 2.765e-05 2.765e-05 0.00% MLPoisson::define() 10 2.585e-05 2.585e-05 2.585e-05 0.00% MLMG::computeResWithCrseSolFineCor() 17 2.554e-05 2.554e-05 2.554e-05 0.00% Gravity::solve_phi_with_mlmg() 10 2.472e-05 2.472e-05 2.472e-05 0.00% Castro::computeNewDt() 8 2.425e-05 2.425e-05 2.425e-05 0.00% MLMG::mgVcycle_up::4 31 2.318e-05 2.318e-05 2.318e-05 0.00% MLMG::mgVcycle_up::3 31 2.181e-05 2.181e-05 2.181e-05 0.00% MLMG::mgVcycle_up::0 31 2.046e-05 2.046e-05 2.046e-05 0.00% DistributionMapping::Distribute() 52 2.035e-05 2.035e-05 2.035e-05 0.00% FabArrayBase::TheFPinfo() 25 2.005e-05 2.005e-05 2.005e-05 0.00% MLMG::mgVcycle_up::1 31 1.964e-05 1.964e-05 1.964e-05 0.00% MLMG::mgVcycle_up::2 31 1.952e-05 1.952e-05 1.952e-05 0.00% FPinfo::FPinfo() 3 1.876e-05 1.876e-05 1.876e-05 0.00% MLMG::computeMLResidual() 15 1.812e-05 1.812e-05 1.812e-05 0.00% Amr::initSubcycle() 1 1.576e-05 1.576e-05 1.576e-05 0.00% MLMG::miniCycle() 34 1.446e-05 1.446e-05 1.446e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 1.414e-05 1.414e-05 1.414e-05 0.00% MLMG::computeResidual() 31 1.41e-05 1.41e-05 1.41e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 1.406e-05 1.406e-05 1.406e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.324e-05 1.324e-05 1.324e-05 0.00% Amr::FinalizeInit() 1 1.305e-05 1.305e-05 1.305e-05 0.00% MLLinOp::define() 10 1.243e-05 1.243e-05 1.243e-05 0.00% Castro::check_for_nan() 18 1.19e-05 1.19e-05 1.19e-05 0.00% ClusterList::intersect() 4 1.171e-05 1.171e-05 1.171e-05 0.00% Castro::post_init() 1 1.103e-05 1.103e-05 1.103e-05 0.00% Castro::apply_source_to_state() 18 9.922e-06 9.922e-06 9.922e-06 0.00% Castro::expand_state() 13 8.747e-06 8.747e-06 8.747e-06 0.00% Castro::construct_new_hybrid_source() 9 8.694e-06 8.694e-06 8.694e-06 0.00% MLMG::getGradSolution() 10 8.534e-06 8.534e-06 8.534e-06 0.00% Gravity::swapTimeLevels() 9 8.25e-06 8.25e-06 8.25e-06 0.00% amrex::average_down_w_geom 20 7.448e-06 7.448e-06 7.448e-06 0.00% AmrMesh-cluster 4 7.315e-06 7.315e-06 7.315e-06 0.00% MLMG::MLResNormInf() 15 7.297e-06 7.297e-06 7.297e-06 0.00% Castro::avgDown(state_indx) 20 7.099e-06 7.099e-06 7.099e-06 0.00% Amr::InitializeInit() 1 6.796e-06 6.796e-06 6.796e-06 0.00% Castro::construct_old_hybrid_source() 9 6.698e-06 6.698e-06 6.698e-06 0.00% MLPoisson::prepareForSolve() 10 6.624e-06 6.624e-06 6.624e-06 0.00% MLMG::MLRhsNormInf() 10 5.622e-06 5.622e-06 5.622e-06 0.00% Castro::init(old) 3 5.116e-06 5.116e-06 5.116e-06 0.00% BoxList::parallelComplementIn() 12 4.967e-06 4.967e-06 4.967e-06 0.00% Gravity::set_mass_offset() 6 4.675e-06 4.675e-06 4.675e-06 0.00% Castro::derive() 6 4.321e-06 4.321e-06 4.321e-06 0.00% BoxList::complementIn 12 4.285e-06 4.285e-06 4.285e-06 0.00% Castro::avgDown() 4 3.779e-06 3.779e-06 3.779e-06 0.00% Castro::retry_advance_ctu() 5 2.995e-06 2.995e-06 2.995e-06 0.00% Castro::computeInitialDt() 2 2.778e-06 2.778e-06 2.778e-06 0.00% Amr::bldFineLevels() 1 2.4e-06 2.4e-06 2.4e-06 0.00% Castro::init() 1 2.313e-06 2.313e-06 2.313e-06 0.00% ClusterList::chop() 4 1.872e-06 1.872e-06 1.872e-06 0.00% Amr::init() 1 1.85e-06 1.85e-06 1.85e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.77e-06 1.77e-06 1.77e-06 0.00% Amr::initialInit() 1 1.151e-06 1.151e-06 1.151e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 3.22 3.22 3.22 100.00% Amr::coarseTimeStep() 5 1.566 1.566 1.566 48.64% Amr::timeStep() 9 1.561 1.561 1.561 48.48% Castro::advance() 5 1.352 1.352 1.352 41.99% Castro::subcycle_advance_ctu() 5 1.33 1.33 1.33 41.29% Castro::do_advance_ctu() 5 1.329 1.329 1.329 41.29% Amr::InitAmr() 1 1.1 1.1 1.1 34.16% Castro::construct_ctu_hydro_source() 9 0.8551 0.8551 0.8551 26.56% Amr::init() 1 0.3812 0.3812 0.3812 11.84% Gravity::multilevel_solve_for_new_phi() 10 0.3331 0.3331 0.3331 10.34% Gravity::actual_multilevel_solve() 10 0.3323 0.3323 0.3323 10.32% Gravity::solve_phi_with_mlmg() 10 0.329 0.329 0.329 10.22% Amr::writePlotFile() 2 0.3168 0.3168 0.3168 9.84% VisMF::Write(FabArray) 3 0.3096 0.3096 0.3096 9.61% Gravity::actual_solve_with_mlmg() 10 0.2541 0.2541 0.2541 7.89% Amr::initialInit() 1 0.2364 0.2364 0.2364 7.34% MLMG::solve() 10 0.1994 0.1994 0.1994 6.19% Castro::construct_new_gravity() 9 0.1924 0.1924 0.1924 5.97% Castro::clean_state() 87 0.174 0.174 0.174 5.40% MLMG::oneIter() 31 0.1687 0.1687 0.1687 5.24% Amr::InitializeInit() 1 0.1633 0.1633 0.1633 5.07% Amr::defBaseLevel() 1 0.1632 0.1632 0.1632 5.07% Castro::Castro() 5 0.1536 0.1536 0.1536 4.77% Castro::initMFs() 5 0.1494 0.1494 0.1494 4.64% Amr::regrid() 5 0.1479 0.1479 0.1479 4.59% MLMG::mgVcycle() 65 0.145 0.145 0.145 4.50% Castro::post_regrid() 10 0.1334 0.1334 0.1334 4.14% MLCellLinOp::applyBC() 1917 0.09309 0.09309 0.09309 2.89% Castro::computeTemp() 88 0.09283 0.09283 0.09283 2.88% AmrLevel::FillPatch() 62 0.09248 0.09248 0.09248 2.87% MLCellLinOp::smooth() 688 0.08259 0.08259 0.08259 2.57% FillPatchIterator::Initialize 62 0.07802 0.07802 0.07802 2.42% Gravity::fill_multipole_BCs() 10 0.07443 0.07443 0.07443 2.31% Amr::FinalizeInit() 1 0.07317 0.07317 0.07317 2.27% Castro::reflux() 4 0.07142 0.07142 0.07142 2.22% FillPatchSingleLevel 92 0.06939 0.06939 0.06939 2.16% FillPatchIterator::FillFromLevel0() 31 0.06672 0.06672 0.06672 2.07% Castro::normalize_species() 87 0.06619 0.06619 0.06619 2.06% Castro::post_init() 1 0.06213 0.06213 0.06213 1.93% Castro::post_timestep() 9 0.06146 0.06146 0.06146 1.91% Castro::initialize_do_advance() 9 0.05354 0.05354 0.05354 1.66% StateDataPhysBCFunct::() 95 0.05021 0.05021 0.05021 1.56% Castro::problem_post_timestep() 10 0.04718 0.04718 0.04718 1.47% Castro::do_new_sources() 9 0.0462 0.0462 0.0462 1.43% FabArray::FillBoundary() 1728 0.04457 0.04457 0.04457 1.38% FillBoundary_nowait() 1728 0.04419 0.04419 0.04419 1.37% MLPoisson::define() 10 0.04396 0.04396 0.04396 1.37% Castro::do_old_sources() 9 0.04305 0.04305 0.04305 1.34% Castro::expand_state() 13 0.0418 0.0418 0.0418 1.30% MLMG::mgVcycle_bottom 65 0.03907 0.03907 0.03907 1.21% FabArray::setVal() 920 0.03848 0.03848 0.03848 1.20% StateData::FillBoundary(geom) 650 0.03547 0.03547 0.03547 1.10% FabArray::ParallelCopy() 954 0.03506 0.03506 0.03506 1.09% FabArray::ParallelCopy_nowait() 954 0.03473 0.03473 0.03473 1.08% Castro::wd_update() 6 0.03422 0.03422 0.03422 1.06% MLMG::actualBottomSolve() 31 0.03188 0.03188 0.03188 0.99% MLCGSolver::bicgstab 31 0.03158 0.03158 0.03158 0.98% FluxRegister::Reflux() 24 0.02973 0.02973 0.02973 0.92% Castro::volInBoundary() 42 0.02949 0.02949 0.02949 0.92% MLMG::mgVcycle_down::0 31 0.02949 0.02949 0.02949 0.92% MLCellLinOp::apply() 493 0.02843 0.02843 0.02843 0.88% Castro::construct_new_source() 63 0.0284 0.0284 0.0284 0.88% Castro::reset_internal_energy(MultiFab) 88 0.0281 0.0281 0.0281 0.87% amrex::Copy() 441 0.0267 0.0267 0.0267 0.83% MLCellLinOp::defineAuxData() 10 0.0251 0.0251 0.0251 0.78% Gravity::get_new_grav_vector() 10 0.02338 0.02338 0.02338 0.73% Castro::initialize_advance() 9 0.02243 0.02243 0.02243 0.70% MLMG::mgVcycle_up::0 31 0.02198 0.02198 0.02198 0.68% MLCellLinOp::correctionResidual() 189 0.01859 0.01859 0.01859 0.58% Castro::construct_old_gravity() 9 0.01857 0.01857 0.01857 0.58% MLCellLinOp::defineBC() 10 0.01856 0.01856 0.01856 0.58% Gravity::get_old_grav_vector() 9 0.01847 0.01847 0.01847 0.57% amrex::Add() 136 0.01732 0.01732 0.01732 0.54% FabArray::Saxpy() 604 0.01605 0.01605 0.01605 0.50% Castro::estTimeStep() 26 0.01598 0.01598 0.01598 0.50% MLCellLinOp::reflux() 30 0.01577 0.01577 0.01577 0.49% BndryData::define() 26 0.01563 0.01563 0.01563 0.49% MLCellLinOp::solutionResidual() 71 0.01485 0.01485 0.01485 0.46% MLMG:computeResOfCorrection() 155 0.01419 0.01419 0.01419 0.44% Amr::grid_places() 6 0.01384 0.01384 0.01384 0.43% AmrMesh::MakeNewGrids() 6 0.01375 0.01375 0.01375 0.43% MLMG::computeResWithCrseSolFineCor() 17 0.01364 0.01364 0.01364 0.42% MLMG::computeMLResidual() 15 0.01292 0.01292 0.01292 0.40% MLPoisson::Fsmooth() 1376 0.01283 0.01283 0.01283 0.40% Castro::construct_old_source() 63 0.01247 0.01247 0.01247 0.39% MLMG::mgVcycle_down::1 31 0.01177 0.01177 0.01177 0.37% Castro::enforce_min_density() 87 0.01145 0.01145 0.01145 0.36% Castro::initData() 1 0.01135 0.01135 0.01135 0.35% amrex::average_down 233 0.009981 0.009981 0.009981 0.31% amrex::Dot() 466 0.009401 0.009401 0.009401 0.29% Castro::FluxRegCrseInit 9 0.009008 0.009008 0.009008 0.28% MLMG::prepareForSolve() 10 0.008998 0.008998 0.008998 0.28% FabArray::norminf() 439 0.008916 0.008916 0.008916 0.28% MLMG::mgVcycle_up::1 31 0.008554 0.008554 0.008554 0.27% Castro::construct_old_gravity_source() 18 0.007975 0.007975 0.007975 0.25% Amr::bldFineLevels() 1 0.007512 0.007512 0.007512 0.23% FillPatchIterator::FillFromTwoLevels() 31 0.00748 0.00748 0.00748 0.23% FillPatchTwoLevels 31 0.00745 0.00745 0.00745 0.23% MLMG::miniCycle() 34 0.007196 0.007196 0.007196 0.22% MLPoisson::Fapply() 493 0.007006 0.007006 0.007006 0.22% MLMG::addInterpCorrection() 155 0.006992 0.006992 0.006992 0.22% MLMG::mgVcycle_down::2 31 0.006912 0.006912 0.006912 0.21% Castro::computeNewDt() 8 0.006834 0.006834 0.006834 0.21% FabArray::Xpay() 353 0.006548 0.006548 0.006548 0.20% Castro::finalize_do_advance() 9 0.006516 0.006516 0.006516 0.20% MLMG::mgVcycle_down::3 31 0.006298 0.006298 0.006298 0.20% MLMG::mgVcycle_down::4 31 0.006195 0.006195 0.006195 0.19% MLMG::computeResidual() 31 0.005996 0.005996 0.005996 0.19% Castro::reset_internal_energy(Fab) 1476 0.005503 0.005503 0.005503 0.17% MLCGSolver::ParallelAllReduce 745 0.005311 0.005311 0.005311 0.16% Castro::construct_new_gravity_source() 9 0.005026 0.005026 0.005026 0.16% MLMG::mgVcycle_up::4 31 0.004997 0.004997 0.004997 0.16% FabArrayBase::getCPC() 1522 0.00498 0.00498 0.00498 0.15% MLMG::mgVcycle_up::2 31 0.004804 0.004804 0.004804 0.15% MLMG::mgVcycle_up::3 31 0.004799 0.004799 0.004799 0.15% MLMG::getGradSolution() 10 0.004465 0.004465 0.004465 0.14% MLCellLinOp::compGrad() 18 0.004457 0.004457 0.004457 0.14% Castro::apply_source_to_state() 18 0.00423 0.00423 0.00423 0.13% FabArrayBase::CPC::define() 534 0.003833 0.003833 0.003833 0.12% Castro::errorEst() 6 0.003813 0.003813 0.003813 0.12% FabArray::setVal(val, thecmd, scomp, ncomp) 580 0.003734 0.003734 0.003734 0.12% FillPatchInterp(MF) 30 0.003704 0.003704 0.003704 0.12% MLMG::computeResWithCrseCorFineCor() 17 0.003641 0.003641 0.003641 0.11% MLCellLinOp::updateSolBC() 25 0.003423 0.003423 0.003423 0.11% FabArray::setDomainBndry() 92 0.003399 0.003399 0.003399 0.11% Castro::check_for_nan() 18 0.003256 0.003256 0.003256 0.10% check_for_negative_density() 9 0.003253 0.003253 0.003253 0.10% TagBoxArray::mapPRD 6 0.003251 0.003251 0.003251 0.10% MultiFab::contains_nan() 18 0.003245 0.003245 0.003245 0.10% Castro::init(old) 3 0.003034 0.003034 0.003034 0.09% Castro::enforce_speed_limit() 87 0.003017 0.003017 0.003017 0.09% Castro::computeInitialDt() 2 0.002767 0.002767 0.002767 0.09% FabArray::mult() 55 0.002589 0.002589 0.002589 0.08% MLCellLinOp::setLevelBC() 18 0.002557 0.002557 0.002557 0.08% Castro::buildMetrics() 5 0.002516 0.002516 0.002516 0.08% MLCellLinOp::updateCorBC() 17 0.002388 0.002388 0.002388 0.07% MLMG::ResNormInf() 54 0.0021 0.0021 0.0021 0.07% Castro::apply_tagging_restrictions() 6 0.00205 0.00205 0.00205 0.06% MLPoisson::prepareForSolve() 10 0.002031 0.002031 0.002031 0.06% Gravity::update_max_rhs() 10 0.00203 0.00203 0.00203 0.06% Gravity::average_fine_ec_onto_crse_ec() 8 0.002028 0.002028 0.002028 0.06% MLCellLinOp::prepareForSolve() 10 0.002024 0.002024 0.002024 0.06% Castro::fill_hybrid_hydro_source() 27 0.00166 0.00166 0.00166 0.05% MLPoisson::FFlux() 150 0.001495 0.001495 0.001495 0.05% average_down_faces 48 0.001361 0.001361 0.001361 0.04% FabArray::norminf(mask) 21 0.001223 0.001223 0.001223 0.04% Castro::avgDown() 4 0.001206 0.001206 0.001206 0.04% Castro::avgDown(state_indx) 20 0.001202 0.001202 0.001202 0.04% amrex::average_down_w_geom 20 0.001195 0.001195 0.001195 0.04% MLMG::MLResNormInf() 15 0.001147 0.001147 0.001147 0.04% Castro::construct_new_hybrid_source() 9 0.001048 0.001048 0.001048 0.03% OwnerMask() 6 0.00103 0.00103 0.00103 0.03% Castro::build_fine_mask() 44 0.001007 0.001007 0.001007 0.03% MLMG::interpCorrection_1 17 0.0009892 0.0009892 0.0009892 0.03% Castro::init() 1 0.00094 0.00094 0.00094 0.03% AmrLevel::FillCoarsePatch() 5 0.0009376 0.0009376 0.0009376 0.03% Castro::derive() 6 0.0009299 0.0009299 0.0009299 0.03% AmrLevel::derive() 6 0.0009256 0.0009256 0.0009256 0.03% TagBoxArray::collate() 6 0.000811 0.000811 0.000811 0.03% FabArrayBase::getFB() 1728 0.0007292 0.0007292 0.0007292 0.02% Gravity::swapTimeLevels() 9 0.000692 0.000692 0.000692 0.02% Castro::FluxRegFineAdd() 9 0.0006882 0.0006882 0.0006882 0.02% Castro::construct_old_hybrid_source() 9 0.0006277 0.0006277 0.0006277 0.02% MultiFab::max() 18 0.0006154 0.0006154 0.0006154 0.02% MLMG::MLRhsNormInf() 10 0.0006064 0.0006064 0.0006064 0.02% Castro::apply_problem_tags() 6 0.0005472 0.0005472 0.0005472 0.02% MultiFab::Multiply() 8 0.0005056 0.0005056 0.0005056 0.02% FabArrayBase::FB::FB() 37 0.0004394 0.0004394 0.0004394 0.01% Castro::react_state() 18 0.0003949 0.0003949 0.0003949 0.01% Castro::linear_to_hybrid_momentum() 1 0.0003683 0.0003683 0.0003683 0.01% MLLinOp::define() 10 0.0002727 0.0002727 0.0002727 0.01% MLLinOp::defineGrids() 10 0.0002603 0.0002603 0.0002603 0.01% AMRErrorTag::operator() 6 0.0002328 0.0002328 0.0002328 0.01% Castro::construct_new_rotation_source() 9 0.0002208 0.0002208 0.0002208 0.01% AmrLevel::AmrLevel(dm) 5 0.0002113 0.0002113 0.0002113 0.01% Castro::construct_old_rotation_source() 9 0.0001962 0.0001962 0.0001962 0.01% StateData::define() 25 0.0001593 0.0001593 0.0001593 0.00% Castro::enforce_consistent_e() 1 0.000157 0.000157 0.000157 0.00% Castro::swap_state_time_levels() 9 0.0001314 0.0001314 0.0001314 0.00% Castro::finalize_advance() 9 0.0001113 0.0001113 0.0001113 0.00% Castro::create_source_corrector() 9 7.423e-05 7.423e-05 7.423e-05 0.00% MLLinOp::makeAgglomeratedDMap 10 6.024e-05 6.024e-05 6.024e-05 0.00% FabArray::RecvLayoutMask() 8 4.983e-05 4.983e-05 4.983e-05 0.00% makeSFC 50 4.618e-05 4.618e-05 4.618e-05 0.00% FabArrayBase::TheFPinfo() 25 3.881e-05 3.881e-05 3.881e-05 0.00% Amr::writeSmallPlotFile() 1 3.767e-05 3.767e-05 3.767e-05 0.00% AmrMesh-cluster 4 2.09e-05 2.09e-05 2.09e-05 0.00% DistributionMapping::Distribute() 52 2.035e-05 2.035e-05 2.035e-05 0.00% FPinfo::FPinfo() 3 1.876e-05 1.876e-05 1.876e-05 0.00% Amr::initSubcycle() 1 1.576e-05 1.576e-05 1.576e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.51e-05 1.51e-05 1.51e-05 0.00% ClusterList::intersect() 4 1.171e-05 1.171e-05 1.171e-05 0.00% BoxList::parallelComplementIn() 12 9.252e-06 9.252e-06 9.252e-06 0.00% Gravity::set_mass_offset() 6 4.675e-06 4.675e-06 4.675e-06 0.00% BoxList::complementIn 12 4.285e-06 4.285e-06 4.285e-06 0.00% Castro::retry_advance_ctu() 5 2.995e-06 2.995e-06 2.995e-06 0.00% ClusterList::chop() 4 1.872e-06 1.872e-06 1.872e-06 0.00% MLLinOp::makeSubCommunicator() 10 1.77e-06 1.77e-06 1.77e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Device Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Arena::Initialize() 1 1 1525 KiB 9037 MiB Castro::reflux() 436 436 12 MiB 666 MiB Castro::initMFs() 258 258 346 MiB 576 MiB Castro::swap_state_time_levels() 175 175 180 MiB 340 MiB StateData::define() 175 175 219 MiB 340 MiB Castro::initialize_do_advance() 143 143 125 MiB 325 MiB FillPatchIterator::Initialize 899 899 3961 KiB 303 MiB Amr::writePlotFile() 56 56 16 MiB 189 MiB Castro::problem_post_timestep() 162 162 613 KiB 167 MiB Castro::FluxRegCrseInit 660 660 438 KiB 167 MiB FluxRegister::Reflux() 648 648 1499 KiB 160 MiB Castro::initialize_advance() 143 143 50 MiB 121 MiB Castro::construct_new_source() 143 143 253 KiB 67 MiB Castro::construct_old_source() 143 143 130 KiB 67 MiB Castro::buildMetrics() 140 140 37 MiB 61 MiB Gravity::multilevel_solve_for_new_phi() 858 858 28 MiB 60 MiB Castro::Castro() 210 210 4003 KiB 50 MiB MLMG::prepareForSolve() 1902 1902 2665 KiB 42 MiB Gravity::get_old_grav_vector() 155 155 190 KiB 33 MiB Gravity::get_new_grav_vector() 188 188 238 KiB 33 MiB ResizeRandomSeed 1 1 30 MiB 30 MiB MLCellLinOp::defineAuxData() 5608 5608 874 KiB 16 MiB FillPatchTwoLevels 300 300 7550 B 11 MiB FillPatchInterp(MF) 330 330 4650 B 7955 KiB Gravity::fill_multipole_BCs() 346 346 130 KiB 7469 KiB Gravity::update_max_rhs() 286 286 4360 B 7424 KiB Gravity::actual_multilevel_solve() 286 286 750 KiB 7424 KiB Castro::build_fine_mask() 224 224 1205 KiB 6912 KiB AmrLevel::derive() 162 162 2499 B 6912 KiB BndryData::define() 3624 3624 279 KiB 4243 KiB MLCellLinOp::reflux() 450 450 5360 B 2376 KiB Castro::wd_update() 6 6 23 KiB 2240 KiB AmrLevel::FillCoarsePatch() 10 10 412 B 2095 KiB amrex::average_down 1483 1483 2340 B 1474 KiB AmrMesh::MakeNewGrids() 324 324 4487 B 1041 KiB MLMG::addInterpCorrection() 1240 1240 789 B 867 KiB MLCellLinOp::defineBC() 276 276 3770 B 689 KiB Castro::estTimeStep() 26 26 2356 B 480 KiB VisMF::Write(FabArray) 1568 1568 2282 B 320 KiB Castro::normalize_species() 87 87 6682 B 320 KiB Castro::volInBoundary() 70 70 2969 B 320 KiB Gravity::average_fine_ec_onto_crse_ec() 48 48 126 B 204 KiB FabArray::norminf(mask) 29 29 183 B 163 KiB amrex::Dot() 559 559 434 B 160 KiB FabArray::norminf() 470 470 429 B 160 KiB MultiFab::max() 18 18 30 B 160 KiB check_for_negative_density() 9 9 163 B 160 KiB Castro::initData() 1 1 44 B 160 KiB FabArray::setVal() 419 419 55 KiB 120 KiB MLMG::interpCorrection_1 34 34 26 B 91 KiB average_down_faces 99 99 645 B 70 KiB FabArray::ParallelCopy_nowait() 942 942 271 B 57 KiB MLPoisson::Fsmooth() 228 228 3047 B 55 KiB FillBoundary_nowait() 751 751 434 B 53 KiB TagBoxArray::mapPRD 324 324 41 B 45 KiB OwnerMask() 168 168 11 B 38 KiB MLCellLinOp::applyBC() 3834 3834 140 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9604 B 25 KiB MultiFab::contains_nan() 18 18 20 B 20 KiB StateData::FillBoundary(geom) 2538 2538 42 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B MultiFab::Multiply() 8 8 601 B 3456 B MLCGSolver::bicgstab 155 155 26 B 2688 B TagBoxArray::collate() 14 14 0 B 640 B ------------------------------------------------------------------------------ Managed Memory Usage: ----------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem ----------------------------------------------------------------- The_Managed_Arena::Initialize() 1 1 151 B 8192 KiB ----------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------ Name Nalloc Nfree AvgMem MaxMem ------------------------------------------------------------------------------ The_Pinned_Arena::Initialize() 1 1 11 KiB 8192 KiB VisMF::Write(FabArray) 1624 1624 582 KiB 7168 KiB Gravity::fill_multipole_BCs() 30 30 1212 B 278 KiB FabArray::setVal() 419 419 55 KiB 120 KiB FabArray::ParallelCopy_nowait() 942 942 271 B 57 KiB MLPoisson::Fsmooth() 228 228 3047 B 55 KiB FillBoundary_nowait() 751 751 435 B 53 KiB MLCellLinOp::applyBC() 1917 1917 140 B 30 KiB MLCellLinOp::prepareForSolve() 68 68 6 B 25 KiB amrex::Copy() 176 176 9604 B 25 KiB Gravity::get_new_grav_vector() 18 18 3335 B 20 KiB Gravity::get_old_grav_vector() 12 12 6639 B 20 KiB OwnerMask() 6 6 0 B 15 KiB StateData::FillBoundary(geom) 2538 2538 42 B 13 KiB FabArray::setVal(val, thecmd, scomp, ncomp) 244 244 3 B 9808 B amrex::average_down 149 149 1345 B 6304 B MLMG::prepareForSolve() 18 18 227 B 3712 B FabArray::norminf(mask) 29 29 126 B 3472 B MLMG::addInterpCorrection() 62 62 2 B 3456 B MultiFab::Multiply() 8 8 601 B 3456 B Castro::FluxRegCrseInit 12 12 8 B 3456 B FillPatchInterp(MF) 140 140 3 B 3232 B MLCellLinOp::setLevelBC() 68 68 0 B 2592 B average_down_faces 51 51 617 B 2272 B TagBoxArray::collate() 16 16 0 B 640 B amrex::Dot() 559 559 3 B 400 B Castro::build_fine_mask() 8 8 0 B 208 B MLCellLinOp::defineAuxData() 8 8 0 B 208 B Castro::reflux() 4 4 0 B 208 B FabArray::norminf() 470 470 1 B 144 B Castro::wd_update() 6 6 1 B 112 B Castro::problem_post_timestep() 19 19 0 B 48 B Castro::estTimeStep() 26 26 0 B 32 B MultiFab::contains_nan() 18 18 0 B 16 B MultiFab::max() 18 18 0 B 16 B Castro::volInBoundary() 70 70 0 B 16 B Castro::normalize_species() 87 87 0 B 16 B Castro::initData() 1 1 0 B 16 B check_for_negative_density() 9 9 0 B 16 B ------------------------------------------------------------------------------ Total GPU global memory (MB): 12049 Free GPU global memory (MB): 1781 [The Arena] space allocated (MB): 9037 [The Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (24.04-15-g7813bb7d6bc6) finalized