Initializing CUDA... CUDA initialized with 1 GPU AMReX (22.01-46-g89153db246e4) initialized Starting run at 15:00:05 UTC on 2022-02-01. Successfully read inputs file ... Castro git describe: 21.12-28-g756d00e43 AMReX git describe: 22.01-46-g89153db24 Microphysics git describe: 22.02 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.003799928 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.003587802 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Gravity::fill_multipole_BCs() time = 0.012222018 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.2032558 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 ...estimated hydro-limited timestep at level 1: 0.02713036318 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02713036318 [Level 0 step 1] ADVANCE with dt = 0.002713036318  Beginning subcycle 1 starting at time 0 with dt = 0.002713036318 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008062839 Gravity::solve_for_phi() time = 0.049239247 Castro::do_old_sources() time = 0.005277392 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.317818652 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008107726 Gravity::solve_for_phi() time = 0.04503592 Castro::do_new_sources() time = 0.011079209 ...estimated hydro-limited timestep at level 0: 0.05551272919 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272919  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.648149537 [Level 0 step 1] Advanced 884736 cells [Level 1 step 1] ADVANCE with dt = 0.002713036318  Beginning subcycle 1 starting at time 0 with dt = 0.002713036318 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003701165 Castro::do_old_sources() time = 0.002413762 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.03235517 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029476562 Castro::do_new_sources() time = 0.003814376 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.926455567 [Level 1 step 1] Advanced 393216 cells Castro::do_new_sources() time = 0.00330179 Castro::do_new_sources() time = 0.006437027 Castro::reflux() at level 0 : time = 0.02569481 Updating the rotational period from 30.54368673 s to 30.52206572 s. [STEP 1] Coarse TimeStep time: 0.6976926 [STEP 1] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 1 TIME = 0.002713036318 DT = 0.002713036318 ...estimated hydro-limited timestep at level 0: 0.05551272816 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272816 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05551272816 ... but limiting to: 0.00298433995 = 1.1 * 0.002713036318 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02775634251 ... but limiting to: 0.00298433995 = 1.1 * 0.002713036318 Now regridding at level lbase = 0 grid_places() time: 0.002099631 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.011068356 STEP = 1 TIME = 0.002713036318 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05551272816 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272816 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251 [Level 0 step 2] ADVANCE with dt = 0.00298433995  Beginning subcycle 1 starting at time 0.002713036318 with dt = 0.00298433995 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008148858 Gravity::solve_for_phi() time = 0.049901656 Castro::do_old_sources() time = 0.004323586 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.104715922 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008026148 Gravity::solve_for_phi() time = 0.045651964 Castro::do_new_sources() time = 0.006914667 ...estimated hydro-limited timestep at level 0: 0.05665145362 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.58741865 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE with dt = 0.00298433995  Beginning subcycle 1 starting at time 0.002713036318 with dt = 0.00298433995 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003509654 Castro::do_old_sources() time = 0.002460383 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.051433454 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029264399 Castro::do_new_sources() time = 0.005402403 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.635358364 [Level 1 step 2] Advanced 393216 cells Castro::do_new_sources() time = 0.005347353 Castro::do_new_sources() time = 0.009544116 Castro::reflux() at level 0 : time = 0.038282484 Updating the rotational period from 30.52206572 s to 30.52210616 s. [STEP 2] Coarse TimeStep time: 0.499404919 [STEP 2] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 2 TIME = 0.005697376269 DT = 0.00298433995 ...estimated hydro-limited timestep at level 0: 0.05665145259 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145259 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05665145259 ... but limiting to: 0.003282773945 = 1.1 * 0.00298433995 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02832568214 ... but limiting to: 0.003282773945 = 1.1 * 0.00298433995 Now regridding at level lbase = 0 grid_places() time: 0.002008394 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.011002155 STEP = 2 TIME = 0.005697376269 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05665145259 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145259 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214 [Level 0 step 3] ADVANCE with dt = 0.003282773945  Beginning subcycle 1 starting at time 0.005697376269 with dt = 0.003282773945 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008119045 Gravity::solve_for_phi() time = 0.050119929 Castro::do_old_sources() time = 0.004456991 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.12465601 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008039419 Gravity::solve_for_phi() time = 0.046392598 Castro::do_new_sources() time = 0.006734591 ...estimated hydro-limited timestep at level 0: 0.05769010785 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010785  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.304266199 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE with dt = 0.003282773945  Beginning subcycle 1 starting at time 0.005697376269 with dt = 0.003282773945 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00352427 Castro::do_old_sources() time = 0.002335554 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.032368407 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029117455 Castro::do_new_sources() time = 0.004368859 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.609549907 [Level 1 step 3] Advanced 393216 cells Castro::do_new_sources() time = 0.003392922 Castro::do_new_sources() time = 0.006663977 Castro::reflux() at level 0 : time = 0.025797626 Updating the rotational period from 30.52210616 s to 30.52203124 s. [STEP 3] Coarse TimeStep time: 0.476677517 [STEP 3] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 3 TIME = 0.008980150214 DT = 0.003282773945 ...estimated hydro-limited timestep at level 0: 0.05769010675 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010675 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05769010675 ... but limiting to: 0.00361105134 = 1.1 * 0.003282773945 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02884498561 ... but limiting to: 0.00361105134 = 1.1 * 0.003282773945 Now regridding at level lbase = 0 grid_places() time: 0.002033472 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.010971431 STEP = 3 TIME = 0.008980150214 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05769010675 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010675 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561 [Level 0 step 4] ADVANCE with dt = 0.00361105134  Beginning subcycle 1 starting at time 0.008980150214 with dt = 0.00361105134 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008089798 Gravity::solve_for_phi() time = 0.050634063 Castro::do_old_sources() time = 0.004265443 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.112748335 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008115258 Gravity::solve_for_phi() time = 0.046725783 Castro::do_new_sources() time = 0.006768171 ...estimated hydro-limited timestep at level 0: 0.05863574591 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574591  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.413336217 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE with dt = 0.00361105134  Beginning subcycle 1 starting at time 0.008980150214 with dt = 0.00361105134 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003556725 Castro::do_old_sources() time = 0.002328787 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.056542855 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029314487 Castro::do_new_sources() time = 0.004176693 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.598608603 [Level 1 step 4] Advanced 393216 cells Castro::do_new_sources() time = 0.003395969 Castro::do_new_sources() time = 0.006020024 Castro::reflux() at level 0 : time = 0.025135009 Updating the rotational period from 30.52203124 s to 30.52194705 s. [STEP 4] Coarse TimeStep time: 0.502080898 [STEP 4] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 4 TIME = 0.01259120155 DT = 0.00361105134 ...estimated hydro-limited timestep at level 0: 0.05863574483 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574483 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05863574483 ... but limiting to: 0.003972156474 = 1.1 * 0.00361105134 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02931778012 ... but limiting to: 0.003972156474 = 1.1 * 0.00361105134 Now regridding at level lbase = 0 grid_places() time: 0.00205845 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.011082472 STEP = 4 TIME = 0.01259120155 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05863574483 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574483 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012 [Level 0 step 5] ADVANCE with dt = 0.003972156474  Beginning subcycle 1 starting at time 0.01259120155 with dt = 0.003972156474 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.00811242 Gravity::solve_for_phi() time = 0.050755107 Castro::do_old_sources() time = 0.004465842 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.101739606 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008106039 Gravity::solve_for_phi() time = 0.046538186 Castro::do_new_sources() time = 0.006733924 ...estimated hydro-limited timestep at level 0: 0.0594445305 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0594445305  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.620712283 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE with dt = 0.003972156474  Beginning subcycle 1 starting at time 0.01259120155 with dt = 0.003972156474 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003639593 Castro::do_old_sources() time = 0.002330481 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.039765991 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029589907 Castro::do_new_sources() time = 0.003658414 ...estimated hydro-limited timestep at level 1: 0.02974830524 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02974830524  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.184108967 [Level 1 step 5] Advanced 393216 cells Castro::do_new_sources() time = 0.003367385 Castro::do_new_sources() time = 0.00679271 Castro::reflux() at level 0 : time = 0.025961905 Updating the rotational period from 30.52194705 s to 30.52185024 s. [STEP 5] Coarse TimeStep time: 0.475163088 [STEP 5] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 5 TIME = 0.01656335803 DT = 0.003972156474 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.199770061 seconds Ending run at 15:00:10 UTC on 2022-02-01. Run time = 4.784014127 Run time without initialization = 2.851582479 Average number of zones advanced per microsecond: 2.241 Average number of zones advanced per microsecond per rank: 2.241 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9489481728 TinyProfiler total time across processes [min...avg...max]: 4.784 ... 4.784 ... 4.784 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.3511 1.3511 1.3511 28.24% Castro::construct_ctu_hydro_source() 10 0.9742 0.9742 0.9742 20.36% VisMF::Write(FabArray) 4 0.396 0.396 0.396 8.28% MLCellLinOp::applyBC() 6611 0.1719 0.1719 0.1719 3.59% MLPoisson::Fsmooth() 4616 0.1602 0.1602 0.1602 3.35% FabArray::setVal() 2104 0.1591 0.1591 0.1591 3.33% Amr::defBaseLevel() 1 0.1574 0.1574 0.1574 3.29% Gravity::fill_multipole_BCs() 15 0.1365 0.1365 0.1365 2.85% FabArray::ParallelCopy_nowait() 2596 0.1028 0.1028 0.1028 2.15% Castro::computeTemp() 122 0.09353 0.09353 0.09353 1.96% FillBoundary_nowait() 6022 0.0817 0.0817 0.0817 1.71% Castro::derive() 607 0.07309 0.07309 0.07309 1.53% Castro::normalize_species() 119 0.06944 0.06944 0.06944 1.45% MultiFab::Dot() 2078 0.03927 0.03927 0.03927 0.82% Castro::reset_internal_energy() 122 0.03888 0.03888 0.03888 0.81% MLCellLinOp::reflux() 34 0.03841 0.03841 0.03841 0.80% MLCGSolver::bicgstab 117 0.03814 0.03814 0.03814 0.80% MLCellLinOp::defineAuxData() 25 0.03769 0.03769 0.03769 0.79% Castro::construct_new_source() 140 0.03023 0.03023 0.03023 0.63% Castro::expand_state() 10 0.02857 0.02857 0.02857 0.60% FluxRegister::Reflux() 30 0.02758 0.02758 0.02758 0.58% StateData::FillBoundary(geom) 546 0.02728 0.02728 0.02728 0.57% MultiFab::Saxpy() 90 0.02681 0.02681 0.02681 0.56% Castro::estTimeStep() 29 0.02589 0.02589 0.02589 0.54% StateDataPhysBCFunct::() 798 0.02451 0.02451 0.02451 0.51% MultiFab::LinComb() 2972 0.02348 0.02348 0.02348 0.49% FabArray::setDomainBndry() 798 0.02322 0.02322 0.02322 0.49% MLPoisson::Fapply() 1931 0.02313 0.02313 0.02313 0.48% BndryData::define() 35 0.02282 0.02282 0.02282 0.48% MultiFab::Multiply() 408 0.02091 0.02091 0.02091 0.44% Castro::enforce_min_density() 119 0.0207 0.0207 0.0207 0.43% Castro::reflux() 5 0.01978 0.01978 0.01978 0.41% amrex::average_down 644 0.01895 0.01895 0.01895 0.40% MultiFab::Xpay() 892 0.01778 0.01778 0.01778 0.37% MLMG::addInterpCorrection() 555 0.01527 0.01527 0.01527 0.32% Castro::construct_new_gravity_source() 20 0.01286 0.01286 0.01286 0.27% Castro::construct_old_gravity_source() 20 0.0111 0.0111 0.0111 0.23% Castro::volWgtSum() 156 0.01077 0.01077 0.01077 0.23% MLPoisson::FFlux() 1326 0.01062 0.01062 0.01062 0.22% Castro::finalize_advance() 10 0.01001 0.01001 0.01001 0.21% Castro::do_advance_ctu() 10 0.009557 0.009557 0.009557 0.20% FabArray::setVal(val, thecmd, scomp, ncomp) 1095 0.008938 0.008938 0.008938 0.19% MLCellLinOp::setLevelBC() 30 0.008079 0.008079 0.008079 0.17% FabArrayBase::CPC::define() 1033 0.008063 0.008063 0.008063 0.17% FillPatchInterp(Fab) 33 0.007933 0.007933 0.007933 0.17% MLCellLinOp::compGrad() 30 0.007887 0.007887 0.007887 0.16% Castro::volInBoundary() 42 0.007184 0.007184 0.007184 0.15% MLMG::oneIter() 117 0.007152 0.007152 0.007152 0.15% Amr::writePlotFile() 2 0.007129 0.007129 0.007129 0.15% AmrMesh::MakeNewGrids() 6 0.006973 0.006973 0.006973 0.15% FillPatchIterator::Initialize 765 0.006491 0.006491 0.006491 0.14% Gravity::actual_solve_with_mlmg() 25 0.006395 0.006395 0.006395 0.13% Castro::initData() 3 0.005697 0.005697 0.005697 0.12% MLCellLinOp::updateSolBC() 27 0.005515 0.005515 0.005515 0.12% MLCellLinOp::defineBC() 25 0.004768 0.004768 0.004768 0.10% MLCellLinOp::updateCorBC() 22 0.004574 0.004574 0.004574 0.10% MLMG::ResNormInf() 154 0.004492 0.004492 0.004492 0.09% Castro::construct_old_source() 70 0.004484 0.004484 0.004484 0.09% Amr::regrid() 5 0.004341 0.004341 0.004341 0.09% Gravity::get_new_grav_vector() 12 0.004065 0.004065 0.004065 0.08% Castro::problem_post_timestep() 11 0.004062 0.004062 0.004062 0.08% MLCellLinOp::prepareForSolve() 25 0.00378 0.00378 0.00378 0.08% CellConservativeLinear::interp() 198 0.003677 0.003677 0.003677 0.08% Castro::fill_hybrid_hydro_source() 50 0.003576 0.003576 0.003576 0.07% FabArray::mult() 72 0.003571 0.003571 0.003571 0.07% Gravity::get_old_grav_vector() 10 0.003288 0.003288 0.003288 0.07% MLMG::prepareForSolve() 25 0.003104 0.003104 0.003104 0.06% Castro::wd_update() 6 0.002886 0.002886 0.002886 0.06% Castro::construct_old_gravity() 10 0.002522 0.002522 0.002522 0.05% Castro::init(old) 4 0.002501 0.002501 0.002501 0.05% FabArrayBase::getCPC() 2980 0.002483 0.002483 0.002483 0.05% Castro::locWgtSum() 36 0.002429 0.002429 0.002429 0.05% Castro::FluxRegFineAdd() 10 0.001988 0.001988 0.001988 0.04% MLCellLinOp::smooth() 2308 0.00197 0.00197 0.00197 0.04% Gravity::solve_for_phi() 20 0.001883 0.001883 0.001883 0.04% Castro::construct_new_gravity() 10 0.001866 0.001866 0.001866 0.04% MultiFab::max() 56 0.001765 0.001765 0.001765 0.04% FabArray::FillBoundary() 6022 0.001382 0.001382 0.001382 0.03% FabArrayBase::getFB() 6022 0.001238 0.001238 0.001238 0.03% MultiFab::Subtract() 25 0.001231 0.001231 0.001231 0.03% Gravity::create_comp_minus_level_grad_phi() 5 0.001215 0.001215 0.001215 0.03% MultiFab::Copy() 30 0.001167 0.001167 0.001167 0.02% FabArrayBase::FB::FB() 98 0.001144 0.001144 0.001144 0.02% MLMG::interpCorrection_1 22 0.001131 0.001131 0.001131 0.02% TagBoxArray::mapPRD 6 0.001122 0.001122 0.001122 0.02% Castro::build_fine_mask() 166 0.00111 0.00111 0.00111 0.02% Gravity::update_max_rhs() 10 0.001089 0.001089 0.001089 0.02% FabArray::ParallelCopy() 2596 0.0009797 0.0009797 0.0009797 0.02% Castro::volProductSum() 12 0.0009423 0.0009423 0.0009423 0.02% Gravity::average_fine_ec_onto_crse_ec() 5 0.0009401 0.0009401 0.0009401 0.02% Amr::bldFineLevels() 1 0.00093 0.00093 0.00093 0.02% FillPatchTwoLevels 387 0.0009276 0.0009276 0.0009276 0.02% MLCellLinOp::apply() 1931 0.0009274 0.0009274 0.0009274 0.02% OwnerMask() 6 0.000894 0.000894 0.000894 0.02% CGSolver::sxay() 2962 0.0008803 0.0008803 0.0008803 0.02% TagBoxArray::collate() 6 0.0007796 0.0007796 0.0007796 0.02% MultiFab::norm0(mask) 17 0.0007723 0.0007723 0.0007723 0.02% main() 1 0.0007581 0.0007581 0.0007581 0.02% MLMG::MLRhsNormInf() 25 0.0006847 0.0006847 0.0006847 0.01% Castro::clean_state() 119 0.0006341 0.0006341 0.0006341 0.01% MLCGSolver::ParallelAllReduce 2754 0.0006206 0.0006206 0.0006206 0.01% MLMG::mgVcycle() 161 0.0005989 0.0005989 0.0005989 0.01% MultiFab::min() 10 0.0005572 0.0005572 0.0005572 0.01% Gravity::actual_multilevel_solve() 5 0.0005311 0.0005311 0.0005311 0.01% Castro::apply_problem_tags() 6 0.0004998 0.0004998 0.0004998 0.01% Castro::subcycle_advance_ctu() 10 0.000487 0.000487 0.000487 0.01% MLMG::computeResWithCrseSolFineCor() 22 0.0004712 0.0004712 0.0004712 0.01% MLMG::computeResWithCrseCorFineCor() 22 0.0004679 0.0004679 0.0004679 0.01% Castro::apply_tagging_restrictions() 6 0.0004559 0.0004559 0.0004559 0.01% Castro::construct_new_rotation_source() 20 0.0003867 0.0003867 0.0003867 0.01% MLCellLinOp::correctionResidual() 716 0.0003851 0.0003851 0.0003851 0.01% MLLinOp::defineGrids() 25 0.0003775 0.0003775 0.0003775 0.01% FillPatchSingleLevel 798 0.000325 0.000325 0.000325 0.01% StateData::define() 35 0.0003241 0.0003241 0.0003241 0.01% Gravity::multilevel_solve_for_new_phi() 5 0.0003189 0.0003189 0.0003189 0.01% Castro::swap_state_time_levels() 10 0.0002583 0.0002583 0.0002583 0.01% Castro::initialize_advance() 10 0.0002492 0.0002492 0.0002492 0.01% MLMG:computeResOfCorrection() 555 0.0002165 0.0002165 0.0002165 0.00% Castro::enforce_consistent_e() 3 0.0002137 0.0002137 0.0002137 0.00% Gravity::GetCrsePhi() 10 0.0002124 0.0002124 0.0002124 0.00% Castro::linear_to_hybrid_momentum() 3 0.0002121 0.0002121 0.0002121 0.00% Gravity::solve_phi_with_mlmg() 25 0.0002108 0.0002108 0.0002108 0.00% Castro::create_source_corrector() 10 0.0002094 0.0002094 0.0002094 0.00% Castro::construct_old_rotation_source() 10 0.000204 0.000204 0.000204 0.00% MLMG::actualBottomSolve() 117 0.0001787 0.0001787 0.0001787 0.00% AMRErrorTag::operator() 6 0.0001783 0.0001783 0.0001783 0.00% Castro::initialize_do_advance() 10 0.0001773 0.0001773 0.0001773 0.00% MLMG::mgVcycle_down::0 117 0.0001444 0.0001444 0.0001444 0.00% MLMG::solve() 25 0.0001315 0.0001315 0.0001315 0.00% MLMG::mgVcycle_down::1 117 0.0001307 0.0001307 0.0001307 0.00% MLMG::mgVcycle_down::2 117 0.0001178 0.0001178 0.0001178 0.00% MLMG::mgVcycle_down::3 117 0.0001152 0.0001152 0.0001152 0.00% Castro::do_new_sources() 20 0.000111 0.000111 0.000111 0.00% MLCellLinOp::solutionResidual() 176 0.0001108 0.0001108 0.0001108 0.00% Amr::grid_places() 6 0.0001078 0.0001078 0.0001078 0.00% Castro::post_regrid() 12 0.0001045 0.0001045 0.0001045 0.00% Castro::advance() 10 0.000101 0.000101 0.000101 0.00% Amr::coarseTimeStep() 5 9.774e-05 9.774e-05 9.774e-05 0.00% MLMG::mgVcycle_bottom 161 8.886e-05 8.886e-05 8.886e-05 0.00% MLMG::mgVcycle_up::0 117 8.811e-05 8.811e-05 8.811e-05 0.00% MLMG::mgVcycle_up::3 117 8.026e-05 8.026e-05 8.026e-05 0.00% MLMG::mgVcycle_down::4 87 7.854e-05 7.854e-05 7.854e-05 0.00% MLMG::buildFineMask() 25 7.79e-05 7.79e-05 7.79e-05 0.00% MLMG::mgVcycle_up::1 117 7.65e-05 7.65e-05 7.65e-05 0.00% AmrLevel::AmrLevel(dm) 7 7.32e-05 7.32e-05 7.32e-05 0.00% Amr::timeStep() 10 7.264e-05 7.264e-05 7.264e-05 0.00% MLMG::mgVcycle_up::2 117 7.173e-05 7.173e-05 7.173e-05 0.00% MLMG::mgVcycle_up::4 87 6.944e-05 6.944e-05 6.944e-05 0.00% Castro::do_old_sources() 10 6.176e-05 6.176e-05 6.176e-05 0.00% Castro::finalize_do_advance() 10 6.068e-05 6.068e-05 6.068e-05 0.00% MLMG::computeResidual() 117 5.886e-05 5.886e-05 5.886e-05 0.00% makeSFC 115 5.87e-05 5.87e-05 5.87e-05 0.00% Castro::enforce_speed_limit() 119 5.517e-05 5.517e-05 5.517e-05 0.00% MLPoisson::define() 25 4.71e-05 4.71e-05 4.71e-05 0.00% Castro::errorEst() 6 4.262e-05 4.262e-05 4.262e-05 0.00% Castro::computeInitialDt() 2 3.716e-05 3.716e-05 3.716e-05 0.00% DistributionMapping::Distribute() 117 3.651e-05 3.651e-05 3.651e-05 0.00% Castro::post_init() 2 3.639e-05 3.639e-05 3.639e-05 0.00% Amr::writeSmallPlotFile() 1 3.603e-05 3.603e-05 3.603e-05 0.00% MLLinOp::define() 25 3.447e-05 3.447e-05 3.447e-05 0.00% MLLinOp::makeAgglomeratedDMap 25 3.158e-05 3.158e-05 3.158e-05 0.00% Castro::computeNewDt() 8 2.985e-05 2.985e-05 2.985e-05 0.00% FabArrayBase::TheFPinfo() 33 2.644e-05 2.644e-05 2.644e-05 0.00% FPinfo::FPinfo() 3 2.547e-05 2.547e-05 2.547e-05 0.00% FabArray::RecvLayoutMask() 5 2.455e-05 2.455e-05 2.455e-05 0.00% MLMG::computeMLResidual() 32 2.318e-05 2.318e-05 2.318e-05 0.00% Castro::apply_source_to_state() 40 1.969e-05 1.969e-05 1.969e-05 0.00% ClusterList::intersect() 6 1.905e-05 1.905e-05 1.905e-05 0.00% MLMG::miniCycle() 44 1.837e-05 1.837e-05 1.837e-05 0.00% MLPoisson::prepareForSolve() 25 1.69e-05 1.69e-05 1.69e-05 0.00% Amr::FinalizeInit() 1 1.681e-05 1.681e-05 1.681e-05 0.00% MLMG::MLResNormInf() 32 1.616e-05 1.616e-05 1.616e-05 0.00% MLMG::getGradSolution() 25 1.592e-05 1.592e-05 1.592e-05 0.00% Castro::construct_new_hybrid_source() 20 1.552e-05 1.552e-05 1.552e-05 0.00% amrex::average_down_w_geom 30 1.384e-05 1.384e-05 1.384e-05 0.00% Castro::avgDown(state_indx) 30 1.255e-05 1.255e-05 1.255e-05 0.00% Castro::post_timestep() 10 1.212e-05 1.212e-05 1.212e-05 0.00% Castro::react_state() 20 1.17e-05 1.17e-05 1.17e-05 0.00% Gravity::swapTimeLevels() 10 1.132e-05 1.132e-05 1.132e-05 0.00% AmrMesh-cluster 6 1.124e-05 1.124e-05 1.124e-05 0.00% Amr::initSubcycle() 1 9.719e-06 9.719e-06 9.719e-06 0.00% BoxList::parallelComplementIn() 12 7.763e-06 7.763e-06 7.763e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 7.131e-06 7.131e-06 7.131e-06 0.00% Castro::construct_old_hybrid_source() 10 6.32e-06 6.32e-06 6.32e-06 0.00% Castro::avgDown() 6 5.971e-06 5.971e-06 5.971e-06 0.00% BoxList::complementIn 12 5.765e-06 5.765e-06 5.765e-06 0.00% MLLinOp::makeSubCommunicator() 25 4.656e-06 4.656e-06 4.656e-06 0.00% Castro::retry_advance_ctu() 10 4.402e-06 4.402e-06 4.402e-06 0.00% Amr::InitializeInit() 1 4e-06 4e-06 4e-06 0.00% Gravity::set_mass_offset() 6 2.912e-06 2.912e-06 2.912e-06 0.00% ClusterList::chop() 6 1.832e-06 1.832e-06 1.832e-06 0.00% Amr::init() 1 1.631e-06 1.631e-06 1.631e-06 0.00% Amr::initialInit() 1 1.154e-06 1.154e-06 1.154e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 4.784 4.784 4.784 100.00% Amr::coarseTimeStep() 5 2.651 2.651 2.651 55.42% Amr::timeStep() 10 2.64 2.64 2.64 55.19% Castro::advance() 10 2.052 2.052 2.052 42.89% Castro::subcycle_advance_ctu() 10 1.967 1.967 1.967 41.12% Castro::do_advance_ctu() 10 1.967 1.967 1.967 41.11% Amr::InitAmr() 1 1.351 1.351 1.351 28.24% Castro::construct_ctu_hydro_source() 10 0.9742 0.9742 0.9742 20.36% Gravity::solve_phi_with_mlmg() 25 0.9716 0.9716 0.9716 20.31% Gravity::actual_solve_with_mlmg() 25 0.8312 0.8312 0.8312 17.37% MLMG::solve() 25 0.7271 0.7271 0.7271 15.20% MLMG::oneIter() 117 0.6469 0.6469 0.6469 13.52% Gravity::solve_for_phi() 20 0.6463 0.6463 0.6463 13.51% MLMG::mgVcycle() 161 0.5864 0.5864 0.5864 12.26% Amr::init() 1 0.5812 0.5812 0.5812 12.15% Castro::construct_new_gravity() 10 0.4042 0.4042 0.4042 8.45% Amr::writePlotFile() 2 0.4032 0.4032 0.4032 8.43% VisMF::Write(FabArray) 4 0.396 0.396 0.396 8.28% Amr::initialInit() 1 0.3779 0.3779 0.3779 7.90% MLCellLinOp::smooth() 2308 0.3464 0.3464 0.3464 7.24% Gravity::multilevel_solve_for_new_phi() 5 0.3312 0.3312 0.3312 6.92% Gravity::actual_multilevel_solve() 5 0.3309 0.3309 0.3309 6.92% Castro::post_timestep() 10 0.3076 0.3076 0.3076 6.43% Castro::construct_old_gravity() 10 0.299 0.299 0.299 6.25% Amr::regrid() 5 0.296 0.296 0.296 6.19% Castro::post_regrid() 12 0.2566 0.2566 0.2566 5.36% MLCellLinOp::applyBC() 6611 0.2564 0.2564 0.2564 5.36% Castro::clean_state() 119 0.2201 0.2201 0.2201 4.60% Amr::InitializeInit() 1 0.1931 0.1931 0.1931 4.04% Amr::defBaseLevel() 1 0.193 0.193 0.193 4.04% Amr::FinalizeInit() 1 0.1848 0.1848 0.1848 3.86% Castro::problem_post_timestep() 11 0.1826 0.1826 0.1826 3.82% FillPatchIterator::Initialize 765 0.1661 0.1661 0.1661 3.47% MLPoisson::Fsmooth() 4616 0.1602 0.1602 0.1602 3.35% MLMG::mgVcycle_bottom 161 0.1602 0.1602 0.1602 3.35% FabArray::setVal() 2104 0.1591 0.1591 0.1591 3.33% MLMG::actualBottomSolve() 117 0.1415 0.1415 0.1415 2.96% Castro::post_init() 2 0.1415 0.1415 0.1415 2.96% Castro::reflux() 5 0.1409 0.1409 0.1409 2.95% MLCGSolver::bicgstab 117 0.1404 0.1404 0.1404 2.93% Gravity::fill_multipole_BCs() 15 0.1375 0.1375 0.1375 2.87% Castro::computeTemp() 122 0.1324 0.1324 0.1324 2.77% Castro::derive() 607 0.1273 0.1273 0.1273 2.66% FillPatchSingleLevel 798 0.1203 0.1203 0.1203 2.51% Castro::do_new_sources() 20 0.114 0.114 0.114 2.38% MLMG::mgVcycle_down::0 117 0.1135 0.1135 0.1135 2.37% FabArray::ParallelCopy() 2596 0.1115 0.1115 0.1115 2.33% FabArray::ParallelCopy_nowait() 2596 0.1105 0.1105 0.1105 2.31% Castro::initialize_do_advance() 10 0.09916 0.09916 0.09916 2.07% MLMG::mgVcycle_up::0 117 0.0986 0.0986 0.0986 2.06% MLCellLinOp::apply() 1931 0.09165 0.09165 0.09165 1.92% FabArray::FillBoundary() 6022 0.08546 0.08546 0.08546 1.79% FillBoundary_nowait() 6022 0.08408 0.08408 0.08408 1.76% MLPoisson::define() 25 0.07791 0.07791 0.07791 1.63% Castro::expand_state() 10 0.07453 0.07453 0.07453 1.56% Castro::initialize_advance() 10 0.07065 0.07065 0.07065 1.48% Castro::normalize_species() 119 0.06944 0.06944 0.06944 1.45% Castro::wd_update() 6 0.06822 0.06822 0.06822 1.43% Castro::construct_new_source() 140 0.06243 0.06243 0.06243 1.30% MLCellLinOp::correctionResidual() 716 0.05674 0.05674 0.05674 1.19% MLCellLinOp::reflux() 34 0.0542 0.0542 0.0542 1.13% StateDataPhysBCFunct::() 798 0.05179 0.05179 0.05179 1.08% Castro::volWgtSum() 156 0.05173 0.05173 0.05173 1.08% Castro::volInBoundary() 42 0.05153 0.05153 0.05153 1.08% MLMG::mgVcycle_down::1 117 0.04732 0.04732 0.04732 0.99% MLCellLinOp::defineAuxData() 25 0.04488 0.04488 0.04488 0.94% FillPatchTwoLevels 387 0.04035 0.04035 0.04035 0.84% MLMG:computeResOfCorrection() 555 0.04012 0.04012 0.04012 0.84% Amr::bldFineLevels() 1 0.03989 0.03989 0.03989 0.83% MLMG::computeResWithCrseSolFineCor() 22 0.0395 0.0395 0.0395 0.83% MLMG::mgVcycle_up::1 117 0.03943 0.03943 0.03943 0.82% MultiFab::Dot() 2078 0.03927 0.03927 0.03927 0.82% Castro::reset_internal_energy() 122 0.03888 0.03888 0.03888 0.81% MLCellLinOp::solutionResidual() 176 0.03795 0.03795 0.03795 0.79% FluxRegister::Reflux() 30 0.03738 0.03738 0.03738 0.78% Castro::do_old_sources() 10 0.03471 0.03471 0.03471 0.73% MLCellLinOp::defineBC() 25 0.03245 0.03245 0.03245 0.68% amrex::average_down 644 0.03187 0.03187 0.03187 0.67% MLMG::computeMLResidual() 32 0.03171 0.03171 0.03171 0.66% Gravity::get_new_grav_vector() 12 0.02963 0.02963 0.02963 0.62% BndryData::define() 35 0.02753 0.02753 0.02753 0.58% StateData::FillBoundary(geom) 546 0.02728 0.02728 0.02728 0.57% MLMG::mgVcycle_down::2 117 0.02722 0.02722 0.02722 0.57% MultiFab::Saxpy() 90 0.02681 0.02681 0.02681 0.56% MLMG::mgVcycle_down::3 117 0.02617 0.02617 0.02617 0.55% Castro::estTimeStep() 29 0.02589 0.02589 0.02589 0.54% MLMG::addInterpCorrection() 555 0.02559 0.02559 0.02559 0.53% Gravity::get_old_grav_vector() 10 0.02558 0.02558 0.02558 0.53% MLMG::computeResidual() 117 0.02528 0.02528 0.02528 0.53% CGSolver::sxay() 2962 0.02368 0.02368 0.02368 0.49% MultiFab::LinComb() 2972 0.02348 0.02348 0.02348 0.49% FabArray::setDomainBndry() 798 0.02322 0.02322 0.02322 0.49% MLPoisson::Fapply() 1931 0.02313 0.02313 0.02313 0.48% MLCGSolver::ParallelAllReduce 2754 0.02247 0.02247 0.02247 0.47% MultiFab::Multiply() 408 0.02091 0.02091 0.02091 0.44% Castro::enforce_min_density() 119 0.0207 0.0207 0.0207 0.43% MLMG::mgVcycle_up::3 117 0.02056 0.02056 0.02056 0.43% MLMG::mgVcycle_up::2 117 0.02029 0.02029 0.02029 0.42% MLMG::miniCycle() 44 0.01875 0.01875 0.01875 0.39% MLMG::mgVcycle_down::4 87 0.01803 0.01803 0.01803 0.38% MultiFab::Xpay() 892 0.01778 0.01778 0.01778 0.37% MLMG::prepareForSolve() 25 0.01708 0.01708 0.01708 0.36% Amr::grid_places() 6 0.01567 0.01567 0.01567 0.33% AmrMesh::MakeNewGrids() 6 0.01556 0.01556 0.01556 0.33% Castro::construct_old_source() 70 0.01497 0.01497 0.01497 0.31% Castro::initData() 3 0.01494 0.01494 0.01494 0.31% MLMG::mgVcycle_up::4 87 0.01451 0.01451 0.01451 0.30% Castro::finalize_advance() 10 0.01378 0.01378 0.01378 0.29% Castro::computeNewDt() 8 0.01346 0.01346 0.01346 0.28% Castro::construct_new_gravity_source() 20 0.01286 0.01286 0.01286 0.27% FillPatchInterp(Fab) 33 0.01161 0.01161 0.01161 0.24% Castro::apply_source_to_state() 40 0.01142 0.01142 0.01142 0.24% Castro::construct_old_gravity_source() 20 0.0111 0.0111 0.0111 0.23% MLPoisson::FFlux() 1326 0.01062 0.01062 0.01062 0.22% FabArrayBase::getCPC() 2980 0.01055 0.01055 0.01055 0.22% MLMG::getGradSolution() 25 0.01045 0.01045 0.01045 0.22% MLCellLinOp::compGrad() 30 0.01044 0.01044 0.01044 0.22% MLMG::computeResWithCrseCorFineCor() 22 0.01024 0.01024 0.01024 0.21% Castro::init(old) 4 0.009593 0.009593 0.009593 0.20% MLCellLinOp::setLevelBC() 30 0.009395 0.009395 0.009395 0.20% MLCellLinOp::updateSolBC() 27 0.009037 0.009037 0.009037 0.19% FabArray::setVal(val, thecmd, scomp, ncomp) 1095 0.008938 0.008938 0.008938 0.19% FabArrayBase::CPC::define() 1033 0.008063 0.008063 0.008063 0.17% MLCellLinOp::updateCorBC() 22 0.007274 0.007274 0.007274 0.15% Castro::locWgtSum() 36 0.006834 0.006834 0.006834 0.14% MLMG::ResNormInf() 154 0.005068 0.005068 0.005068 0.11% Castro::errorEst() 6 0.004326 0.004326 0.004326 0.09% Castro::computeInitialDt() 2 0.00427 0.00427 0.00427 0.09% Gravity::swapTimeLevels() 10 0.004205 0.004205 0.004205 0.09% Castro::volProductSum() 12 0.003895 0.003895 0.003895 0.08% MLPoisson::prepareForSolve() 25 0.003797 0.003797 0.003797 0.08% MLCellLinOp::prepareForSolve() 25 0.00378 0.00378 0.00378 0.08% CellConservativeLinear::interp() 198 0.003677 0.003677 0.003677 0.08% Castro::avgDown() 6 0.003671 0.003671 0.003671 0.08% Castro::avgDown(state_indx) 30 0.003665 0.003665 0.003665 0.08% amrex::average_down_w_geom 30 0.003652 0.003652 0.003652 0.08% Castro::fill_hybrid_hydro_source() 50 0.003576 0.003576 0.003576 0.07% FabArray::mult() 72 0.003571 0.003571 0.003571 0.07% TagBoxArray::mapPRD 6 0.002768 0.002768 0.002768 0.06% Castro::construct_new_hybrid_source() 20 0.002726 0.002726 0.002726 0.06% Gravity::average_fine_ec_onto_crse_ec() 5 0.002392 0.002392 0.002392 0.05% FabArrayBase::getFB() 6022 0.002382 0.002382 0.002382 0.05% Gravity::update_max_rhs() 10 0.002303 0.002303 0.002303 0.05% MLMG::interpCorrection_1 22 0.002277 0.002277 0.002277 0.05% Gravity::create_comp_minus_level_grad_phi() 5 0.002193 0.002193 0.002193 0.05% Castro::FluxRegFineAdd() 10 0.001988 0.001988 0.001988 0.04% Gravity::GetCrsePhi() 10 0.001919 0.001919 0.001919 0.04% MultiFab::max() 56 0.001765 0.001765 0.001765 0.04% MLMG::MLResNormInf() 32 0.00138 0.00138 0.00138 0.03% MultiFab::Subtract() 25 0.001231 0.001231 0.001231 0.03% MultiFab::Copy() 30 0.001167 0.001167 0.001167 0.02% FabArrayBase::FB::FB() 98 0.001144 0.001144 0.001144 0.02% Castro::build_fine_mask() 166 0.00111 0.00111 0.00111 0.02% OwnerMask() 6 0.000894 0.000894 0.000894 0.02% MLMG::MLRhsNormInf() 25 0.0008815 0.0008815 0.0008815 0.02% Castro::construct_old_hybrid_source() 10 0.0008711 0.0008711 0.0008711 0.02% TagBoxArray::collate() 6 0.0007796 0.0007796 0.0007796 0.02% MultiFab::norm0(mask) 17 0.0007723 0.0007723 0.0007723 0.02% MultiFab::min() 10 0.0005572 0.0005572 0.0005572 0.01% MLLinOp::define() 25 0.0005416 0.0005416 0.0005416 0.01% MLLinOp::defineGrids() 25 0.0005071 0.0005071 0.0005071 0.01% Castro::apply_problem_tags() 6 0.0004998 0.0004998 0.0004998 0.01% Castro::apply_tagging_restrictions() 6 0.0004559 0.0004559 0.0004559 0.01% Castro::react_state() 20 0.0004221 0.0004221 0.0004221 0.01% AmrLevel::AmrLevel(dm) 7 0.0003973 0.0003973 0.0003973 0.01% Castro::construct_new_rotation_source() 20 0.0003867 0.0003867 0.0003867 0.01% MLMG::buildFineMask() 25 0.0003436 0.0003436 0.0003436 0.01% StateData::define() 35 0.0003241 0.0003241 0.0003241 0.01% Castro::swap_state_time_levels() 10 0.0002583 0.0002583 0.0002583 0.01% Castro::enforce_consistent_e() 3 0.0002137 0.0002137 0.0002137 0.00% Castro::linear_to_hybrid_momentum() 3 0.0002121 0.0002121 0.0002121 0.00% Castro::create_source_corrector() 10 0.0002094 0.0002094 0.0002094 0.00% Castro::construct_old_rotation_source() 10 0.000204 0.000204 0.000204 0.00% AMRErrorTag::operator() 6 0.0001783 0.0001783 0.0001783 0.00% MLLinOp::makeAgglomeratedDMap 25 0.0001249 0.0001249 0.0001249 0.00% makeSFC 115 9.332e-05 9.332e-05 9.332e-05 0.00% Castro::finalize_do_advance() 10 6.068e-05 6.068e-05 6.068e-05 0.00% Castro::enforce_speed_limit() 119 5.517e-05 5.517e-05 5.517e-05 0.00% FabArrayBase::TheFPinfo() 33 5.191e-05 5.191e-05 5.191e-05 0.00% DistributionMapping::Distribute() 117 3.651e-05 3.651e-05 3.651e-05 0.00% Amr::writeSmallPlotFile() 1 3.603e-05 3.603e-05 3.603e-05 0.00% AmrMesh-cluster 6 3.212e-05 3.212e-05 3.212e-05 0.00% FPinfo::FPinfo() 3 2.547e-05 2.547e-05 2.547e-05 0.00% FabArray::RecvLayoutMask() 5 2.455e-05 2.455e-05 2.455e-05 0.00% ClusterList::intersect() 6 1.905e-05 1.905e-05 1.905e-05 0.00% BoxList::parallelComplementIn() 12 1.353e-05 1.353e-05 1.353e-05 0.00% Amr::initSubcycle() 1 9.719e-06 9.719e-06 9.719e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 9.026e-06 9.026e-06 9.026e-06 0.00% BoxList::complementIn 12 5.765e-06 5.765e-06 5.765e-06 0.00% MLLinOp::makeSubCommunicator() 25 4.656e-06 4.656e-06 4.656e-06 0.00% Castro::retry_advance_ctu() 10 4.402e-06 4.402e-06 4.402e-06 0.00% Gravity::set_mass_offset() 6 2.912e-06 2.912e-06 2.912e-06 0.00% ClusterList::chop() 6 1.832e-06 1.832e-06 1.832e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0e0, 0.0e0, 0.0e0] [TOP]::mg.v(nvals = 1) :: [2] Total GPU global memory (MB): 12066 Free GPU global memory (MB): 4849 [The Arena] space allocated (MB): 9049 [The Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (22.01-46-g89153db246e4) finalized