Initializing CUDA... CUDA initialized with 1 GPU AMReX (22.03-26-ge213d767baab) initialized Starting run at 08:44:58 UTC on 2022-03-23. Successfully read inputs file ... Castro git describe: 22.02-14-g23fc313a7 AMReX git describe: 22.03-26-ge213d767b Microphysics git describe: 22.03-9-g65902e18 reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.00383869 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.003593297 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Gravity::fill_multipole_BCs() time = 0.012122866 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.232273459 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 ...estimated hydro-limited timestep at level 1: 0.02713036318 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02713036318 [Level 0 step 1] ADVANCE with dt = 0.002713036318 [1m[32m Beginning subcycle 1 starting at time 0 with dt = 0.002713036318[0m Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008040524 Gravity::solve_for_phi() time = 0.049204587 Castro::do_old_sources() time = 0.005981082 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.319030221 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008067238 Gravity::solve_for_phi() time = 0.044965488 Castro::do_new_sources() time = 0.011384568 ...estimated hydro-limited timestep at level 0: 0.05551272919 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272919 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 1.644231831 [Level 0 step 1] Advanced 884736 cells [Level 1 step 1] ADVANCE with dt = 0.002713036318 [1m[32m Beginning subcycle 1 starting at time 0 with dt = 0.002713036318[0m Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003705912 Castro::do_old_sources() time = 0.002345619 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.045863657 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029134347 Castro::do_new_sources() time = 0.003398211 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 3.494955097 [Level 1 step 1] Advanced 393216 cells Castro::do_new_sources() time = 0.003420817 Castro::do_new_sources() time = 0.006567271 Castro::reflux() at level 0 : time = 0.025915644 Updating the rotational period from 30.54368673 s to 30.52206572 s. [STEP 1] Coarse TimeStep time: 0.710868214 [STEP 1] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 1 TIME = 0.002713036318 DT = 0.002713036318 ...estimated hydro-limited timestep at level 0: 0.05551272816 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272816 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05551272816 ... but limiting to: 0.00298433995 = 1.1 * 0.002713036318 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02775634251 ... but limiting to: 0.00298433995 = 1.1 * 0.002713036318 Now regridding at level lbase = 0 grid_places() time: 0.002070686 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.011221306 STEP = 1 TIME = 0.002713036318 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05551272816 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05551272816 ...estimated hydro-limited timestep at level 1: 0.02775634251 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02775634251 [Level 0 step 2] ADVANCE with dt = 0.00298433995 [1m[32m Beginning subcycle 1 starting at time 0.002713036318 with dt = 0.00298433995[0m Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008284399 Gravity::solve_for_phi() time = 0.049797146 Castro::do_old_sources() time = 0.00445814 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.113122296 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008309393 Gravity::solve_for_phi() time = 0.045895782 Castro::do_new_sources() time = 0.00676011 ...estimated hydro-limited timestep at level 0: 0.05665145362 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145362 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 3.42974171 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE with dt = 0.00298433995 [1m[32m Beginning subcycle 1 starting at time 0.002713036318 with dt = 0.00298433995[0m Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003552228 Castro::do_old_sources() time = 0.002374356 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.056484869 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.0290132 Castro::do_new_sources() time = 0.003368804 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 3.654735497 [Level 1 step 2] Advanced 393216 cells Castro::do_new_sources() time = 0.003207914 Castro::do_new_sources() time = 0.006459299 Castro::reflux() at level 0 : time = 0.024934428 Updating the rotational period from 30.52206572 s to 30.52210616 s. [STEP 2] Coarse TimeStep time: 0.493070919 [STEP 2] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 2 TIME = 0.005697376269 DT = 0.00298433995 ...estimated hydro-limited timestep at level 0: 0.05665145259 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145259 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05665145259 ... but limiting to: 0.003282773945 = 1.1 * 0.00298433995 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02832568214 ... but limiting to: 0.003282773945 = 1.1 * 0.00298433995 Now regridding at level lbase = 0 grid_places() time: 0.002014684 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.011246292 STEP = 2 TIME = 0.005697376269 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05665145259 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05665145259 ...estimated hydro-limited timestep at level 1: 0.02832568214 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02832568214 [Level 0 step 3] ADVANCE with dt = 0.003282773945 [1m[32m Beginning subcycle 1 starting at time 0.005697376269 with dt = 0.003282773945[0m Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008268221 Gravity::solve_for_phi() time = 0.050409466 Castro::do_old_sources() time = 0.004373941 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.094898743 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008247116 Gravity::solve_for_phi() time = 0.046599488 Castro::do_new_sources() time = 0.006731457 ...estimated hydro-limited timestep at level 0: 0.05769010785 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010785 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 3.728223396 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE with dt = 0.003282773945 [1m[32m Beginning subcycle 1 starting at time 0.005697376269 with dt = 0.003282773945[0m Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003547862 Castro::do_old_sources() time = 0.002293283 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.048746734 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.028836185 Castro::do_new_sources() time = 0.005451511 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 3.760699446 [Level 1 step 3] Advanced 393216 cells Castro::do_new_sources() time = 0.004625735 Castro::do_new_sources() time = 0.009740889 Castro::reflux() at level 0 : time = 0.037844432 Updating the rotational period from 30.52210616 s to 30.52203124 s. [STEP 3] Coarse TimeStep time: 0.4866819 [STEP 3] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 3 TIME = 0.008980150214 DT = 0.003282773945 ...estimated hydro-limited timestep at level 0: 0.05769010675 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010675 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05769010675 ... but limiting to: 0.00361105134 = 1.1 * 0.003282773945 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02884498561 ... but limiting to: 0.00361105134 = 1.1 * 0.003282773945 Now regridding at level lbase = 0 grid_places() time: 0.00202717 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.011192947 STEP = 3 TIME = 0.008980150214 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05769010675 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05769010675 ...estimated hydro-limited timestep at level 1: 0.02884498561 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02884498561 [Level 0 step 4] ADVANCE with dt = 0.00361105134 [1m[32m Beginning subcycle 1 starting at time 0.008980150214 with dt = 0.00361105134[0m Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008282812 Gravity::solve_for_phi() time = 0.050637877 Castro::do_old_sources() time = 0.00429998 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.136683553 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008239936 Gravity::solve_for_phi() time = 0.046891228 Castro::do_new_sources() time = 0.006789504 ...estimated hydro-limited timestep at level 0: 0.05863574591 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574591 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 3.152311506 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE with dt = 0.00361105134 [1m[32m Beginning subcycle 1 starting at time 0.008980150214 with dt = 0.00361105134[0m Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003584497 Castro::do_old_sources() time = 0.002806681 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.032910004 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029049116 Castro::do_new_sources() time = 0.003633479 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 4.630420023 [Level 1 step 4] Advanced 393216 cells Castro::do_new_sources() time = 0.003581672 Castro::do_new_sources() time = 0.005935097 Castro::reflux() at level 0 : time = 0.024830184 Updating the rotational period from 30.52203124 s to 30.52194705 s. [STEP 4] Coarse TimeStep time: 0.500631161 [STEP 4] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 4 TIME = 0.01259120155 DT = 0.00361105134 ...estimated hydro-limited timestep at level 0: 0.05863574483 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574483 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05863574483 ... but limiting to: 0.003972156474 = 1.1 * 0.00361105134 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02931778012 ... but limiting to: 0.003972156474 = 1.1 * 0.00361105134 Now regridding at level lbase = 0 grid_places() time: 0.002012092 new finest: 1 Castro::numpts_1d at level 1 is 340 Warning: the following castro.* parameters are ignored castro.center = 0.0e0 0.0e0 0.0e0 Gravity::fill_multipole_BCs() time = 0.011269452 STEP = 4 TIME = 0.01259120155 : REGRID with lbase = 0 Level 1 12 grids 393216 cells 5.555555556 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 ...estimated hydro-limited timestep at level 0: 0.05863574483 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05863574483 ...estimated hydro-limited timestep at level 1: 0.02931778012 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02931778012 [Level 0 step 5] ADVANCE with dt = 0.003972156474 [1m[32m Beginning subcycle 1 starting at time 0.01259120155 with dt = 0.003972156474[0m Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008254329 Gravity::solve_for_phi() time = 0.050666774 Castro::do_old_sources() time = 0.00441955 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106998321 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.008304782 Gravity::solve_for_phi() time = 0.047125666 Castro::do_new_sources() time = 0.006915336 ...estimated hydro-limited timestep at level 0: 0.0594445305 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0594445305 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 3.495816117 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE with dt = 0.003972156474 [1m[32m Beginning subcycle 1 starting at time 0.01259120155 with dt = 0.003972156474[0m Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.003641191 Castro::do_old_sources() time = 0.002274059 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.057263856 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.029457425 Castro::do_new_sources() time = 0.003232947 ...estimated hydro-limited timestep at level 1: 0.02974830524 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02974830524 [1m[32m Subcycle completed[0m Subcycling complete Zones advanced per microsecond at this level: 3.599253722 [Level 1 step 5] Advanced 393216 cells Castro::do_new_sources() time = 0.003174469 Castro::do_new_sources() time = 0.006581206 Castro::reflux() at level 0 : time = 0.02553517 Updating the rotational period from 30.52194705 s to 30.52185024 s. [STEP 5] Coarse TimeStep time: 0.497841264 [STEP 5] FAB kilobyte spread across MPI nodes: [2435294 ... 2435294] STEP = 5 TIME = 0.01656335803 DT = 0.003972156474 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.20787107 seconds Ending run at 08:45:03 UTC on 2022-03-23. Run time = 4.695077962 Run time without initialization = 2.897811399 Average number of zones advanced per microsecond: 2.205 Average number of zones advanced per microsecond per rank: 2.205 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 9489481728 TinyProfiler total time across processes [min...avg...max]: 4.695 ... 4.695 ... 4.695 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Amr::InitAmr() 1 1.1836 1.1836 1.1836 25.21% Castro::construct_ctu_hydro_source() 10 1.012 1.012 1.012 21.56% VisMF::Write(FabArray) 4 0.4075 0.4075 0.4075 8.68% MLCellLinOp::applyBC() 6611 0.1718 0.1718 0.1718 3.66% FabArray::setVal() 2104 0.1612 0.1612 0.1612 3.43% MLPoisson::Fsmooth() 4616 0.1608 0.1608 0.1608 3.43% Amr::defBaseLevel() 1 0.1532 0.1532 0.1532 3.26% Gravity::fill_multipole_BCs() 15 0.1386 0.1386 0.1386 2.95% FabArray::ParallelCopy_nowait() 2596 0.1027 0.1027 0.1027 2.19% Castro::computeTemp() 122 0.0934 0.0934 0.0934 1.99% FillBoundary_nowait() 6022 0.08254 0.08254 0.08254 1.76% Castro::derive() 607 0.07221 0.07221 0.07221 1.54% Castro::normalize_species() 119 0.06762 0.06762 0.06762 1.44% MLCellLinOp::reflux() 34 0.04831 0.04831 0.04831 1.03% Castro::reset_internal_energy() 122 0.04176 0.04176 0.04176 0.89% MultiFab::Dot() 2078 0.03882 0.03882 0.03882 0.83% MLCGSolver::bicgstab 117 0.03791 0.03791 0.03791 0.81% MLCellLinOp::defineAuxData() 25 0.03783 0.03783 0.03783 0.81% Amr::writePlotFile() 2 0.03278 0.03278 0.03278 0.70% Castro::construct_new_source() 140 0.0296 0.0296 0.0296 0.63% Castro::expand_state() 10 0.02869 0.02869 0.02869 0.61% FluxRegister::Reflux() 30 0.02755 0.02755 0.02755 0.59% StateData::FillBoundary(geom) 546 0.02707 0.02707 0.02707 0.58% MultiFab::Saxpy() 90 0.02682 0.02682 0.02682 0.57% StateDataPhysBCFunct::() 798 0.02524 0.02524 0.02524 0.54% Castro::estTimeStep() 29 0.02364 0.02364 0.02364 0.50% FabArray::setDomainBndry() 798 0.02345 0.02345 0.02345 0.50% MultiFab::LinComb() 2972 0.02338 0.02338 0.02338 0.50% MLPoisson::Fapply() 1931 0.02325 0.02325 0.02325 0.50% BndryData::define() 35 0.02309 0.02309 0.02309 0.49% MultiFab::Multiply() 408 0.02087 0.02087 0.02087 0.44% Castro::reflux() 5 0.0197 0.0197 0.0197 0.42% Castro::enforce_min_density() 119 0.01963 0.01963 0.01963 0.42% amrex::average_down 644 0.01877 0.01877 0.01877 0.40% MultiFab::Xpay() 892 0.01772 0.01772 0.01772 0.38% MLMG::addInterpCorrection() 555 0.01519 0.01519 0.01519 0.32% Castro::construct_new_gravity_source() 20 0.01211 0.01211 0.01211 0.26% Castro::volWgtSum() 156 0.01095 0.01095 0.01095 0.23% MLPoisson::FFlux() 1326 0.01072 0.01072 0.01072 0.23% Castro::finalize_advance() 10 0.009997 0.009997 0.009997 0.21% Castro::construct_old_gravity_source() 20 0.009774 0.009774 0.009774 0.21% Castro::do_advance_ctu() 10 0.009281 0.009281 0.009281 0.20% FabArray::setVal(val, thecmd, scomp, ncomp) 1095 0.008944 0.008944 0.008944 0.19% MLCellLinOp::setLevelBC() 30 0.008179 0.008179 0.008179 0.17% MLCellLinOp::compGrad() 30 0.00796 0.00796 0.00796 0.17% FabArrayBase::CPC::define() 1033 0.007558 0.007558 0.007558 0.16% MLMG::oneIter() 117 0.007093 0.007093 0.007093 0.15% Castro::volInBoundary() 42 0.007055 0.007055 0.007055 0.15% AmrMesh::MakeNewGrids() 6 0.006886 0.006886 0.006886 0.15% FillPatchIterator::Initialize 765 0.006526 0.006526 0.006526 0.14% Castro::initData() 3 0.006488 0.006488 0.006488 0.14% Gravity::actual_solve_with_mlmg() 25 0.006261 0.006261 0.006261 0.13% MLCellLinOp::updateSolBC() 27 0.005687 0.005687 0.005687 0.12% FillPatchInterp(Fab) 33 0.005618 0.005618 0.005618 0.12% Castro::construct_old_source() 70 0.005116 0.005116 0.005116 0.11% MLCellLinOp::defineBC() 25 0.004876 0.004876 0.004876 0.10% MLCellLinOp::updateCorBC() 22 0.004717 0.004717 0.004717 0.10% MLMG::ResNormInf() 154 0.004553 0.004553 0.004553 0.10% Amr::regrid() 5 0.004135 0.004135 0.004135 0.09% Castro::problem_post_timestep() 11 0.004067 0.004067 0.004067 0.09% Gravity::get_new_grav_vector() 12 0.004039 0.004039 0.004039 0.09% MLCellLinOp::prepareForSolve() 25 0.003824 0.003824 0.003824 0.08% CellConservativeLinear::interp() 198 0.003736 0.003736 0.003736 0.08% Castro::fill_hybrid_hydro_source() 50 0.003676 0.003676 0.003676 0.08% FabArray::mult() 72 0.003571 0.003571 0.003571 0.08% Gravity::get_old_grav_vector() 10 0.003258 0.003258 0.003258 0.07% MLMG::prepareForSolve() 25 0.003124 0.003124 0.003124 0.07% Castro::wd_update() 6 0.002669 0.002669 0.002669 0.06% Castro::locWgtSum() 36 0.002514 0.002514 0.002514 0.05% Castro::init(old) 4 0.002503 0.002503 0.002503 0.05% FabArrayBase::getCPC() 2980 0.002376 0.002376 0.002376 0.05% Castro::construct_old_gravity() 10 0.002272 0.002272 0.002272 0.05% Castro::FluxRegFineAdd() 10 0.002007 0.002007 0.002007 0.04% MLCellLinOp::smooth() 2308 0.001859 0.001859 0.001859 0.04% MultiFab::max() 56 0.001759 0.001759 0.001759 0.04% Castro::construct_new_gravity() 10 0.001659 0.001659 0.001659 0.04% Gravity::solve_for_phi() 20 0.001645 0.001645 0.001645 0.04% FabArray::FillBoundary() 6022 0.001397 0.001397 0.001397 0.03% FabArrayBase::getFB() 6022 0.001258 0.001258 0.001258 0.03% MultiFab::Subtract() 25 0.001246 0.001246 0.001246 0.03% Gravity::create_comp_minus_level_grad_phi() 5 0.001209 0.001209 0.001209 0.03% MultiFab::Copy() 30 0.001172 0.001172 0.001172 0.02% TagBoxArray::mapPRD 6 0.001138 0.001138 0.001138 0.02% MLMG::interpCorrection_1 22 0.001128 0.001128 0.001128 0.02% Gravity::update_max_rhs() 10 0.001091 0.001091 0.001091 0.02% FabArrayBase::FB::FB() 98 0.001084 0.001084 0.001084 0.02% Castro::build_fine_mask() 166 0.001071 0.001071 0.001071 0.02% MLCellLinOp::apply() 1931 0.0009516 0.0009516 0.0009516 0.02% Gravity::average_fine_ec_onto_crse_ec() 5 0.0009459 0.0009459 0.0009459 0.02% Amr::bldFineLevels() 1 0.0009441 0.0009441 0.0009441 0.02% Castro::volProductSum() 12 0.0009437 0.0009437 0.0009437 0.02% FabArray::ParallelCopy() 2596 0.0009036 0.0009036 0.0009036 0.02% FillPatchTwoLevels 387 0.0008999 0.0008999 0.0008999 0.02% OwnerMask() 6 0.0008965 0.0008965 0.0008965 0.02% CGSolver::sxay() 2962 0.0008814 0.0008814 0.0008814 0.02% main() 1 0.0008207 0.0008207 0.0008207 0.02% TagBoxArray::collate() 6 0.0007798 0.0007798 0.0007798 0.02% MultiFab::norm0(mask) 17 0.000778 0.000778 0.000778 0.02% MLMG::MLRhsNormInf() 25 0.0006889 0.0006889 0.0006889 0.01% MLMG::mgVcycle() 161 0.0006411 0.0006411 0.0006411 0.01% MLCGSolver::ParallelAllReduce 2754 0.0006071 0.0006071 0.0006071 0.01% MultiFab::min() 10 0.0005855 0.0005855 0.0005855 0.01% Castro::clean_state() 119 0.0005346 0.0005346 0.0005346 0.01% Gravity::actual_multilevel_solve() 5 0.0005199 0.0005199 0.0005199 0.01% Castro::apply_problem_tags() 6 0.0004982 0.0004982 0.0004982 0.01% MLMG::computeResWithCrseSolFineCor() 22 0.0004772 0.0004772 0.0004772 0.01% MLMG::computeResWithCrseCorFineCor() 22 0.000476 0.000476 0.000476 0.01% Castro::subcycle_advance_ctu() 10 0.00047 0.00047 0.00047 0.01% Castro::apply_tagging_restrictions() 6 0.0004432 0.0004432 0.0004432 0.01% Castro::enforce_speed_limit() 119 0.000407 0.000407 0.000407 0.01% Castro::construct_new_rotation_source() 20 0.0004066 0.0004066 0.0004066 0.01% Castro::linear_to_hybrid_momentum() 3 0.0003939 0.0003939 0.0003939 0.01% MLCellLinOp::correctionResidual() 716 0.0003872 0.0003872 0.0003872 0.01% MLLinOp::defineGrids() 25 0.0003654 0.0003654 0.0003654 0.01% FillPatchSingleLevel 798 0.0003652 0.0003652 0.0003652 0.01% StateData::define() 35 0.000357 0.000357 0.000357 0.01% Gravity::multilevel_solve_for_new_phi() 5 0.0003115 0.0003115 0.0003115 0.01% Castro::swap_state_time_levels() 10 0.0002506 0.0002506 0.0002506 0.01% Castro::construct_old_rotation_source() 10 0.0002365 0.0002365 0.0002365 0.01% MLMG:computeResOfCorrection() 555 0.0002321 0.0002321 0.0002321 0.00% Gravity::GetCrsePhi() 10 0.0002184 0.0002184 0.0002184 0.00% Castro::enforce_consistent_e() 3 0.000209 0.000209 0.000209 0.00% Castro::create_source_corrector() 10 0.000194 0.000194 0.000194 0.00% MLMG::actualBottomSolve() 117 0.0001805 0.0001805 0.0001805 0.00% AMRErrorTag::operator() 6 0.0001782 0.0001782 0.0001782 0.00% Castro::initialize_advance() 10 0.0001755 0.0001755 0.0001755 0.00% Castro::initialize_do_advance() 10 0.0001575 0.0001575 0.0001575 0.00% MLMG::mgVcycle_down::0 117 0.0001548 0.0001548 0.0001548 0.00% MLMG::solve() 25 0.000152 0.000152 0.000152 0.00% MLMG::mgVcycle_down::1 117 0.0001507 0.0001507 0.0001507 0.00% MLMG::mgVcycle_down::2 117 0.0001376 0.0001376 0.0001376 0.00% MLMG::mgVcycle_down::3 117 0.0001348 0.0001348 0.0001348 0.00% Castro::do_new_sources() 20 0.0001187 0.0001187 0.0001187 0.00% Gravity::solve_phi_with_mlmg() 25 0.0001154 0.0001154 0.0001154 0.00% MLCellLinOp::solutionResidual() 176 0.0001134 0.0001134 0.0001134 0.00% Amr::grid_places() 6 0.0001028 0.0001028 0.0001028 0.00% MLMG::mgVcycle_bottom 161 9.621e-05 9.621e-05 9.621e-05 0.00% MLMG::mgVcycle_down::4 87 9.466e-05 9.466e-05 9.466e-05 0.00% Amr::coarseTimeStep() 5 9.453e-05 9.453e-05 9.453e-05 0.00% MLMG::mgVcycle_up::0 117 8.942e-05 8.942e-05 8.942e-05 0.00% Amr::timeStep() 10 8.466e-05 8.466e-05 8.466e-05 0.00% MLMG::buildFineMask() 25 8.377e-05 8.377e-05 8.377e-05 0.00% MLMG::mgVcycle_up::3 117 8.343e-05 8.343e-05 8.343e-05 0.00% MLMG::mgVcycle_up::1 117 8.338e-05 8.338e-05 8.338e-05 0.00% MLMG::mgVcycle_up::2 117 7.661e-05 7.661e-05 7.661e-05 0.00% AmrLevel::AmrLevel(dm) 7 7.587e-05 7.587e-05 7.587e-05 0.00% MLMG::mgVcycle_up::4 87 7.295e-05 7.295e-05 7.295e-05 0.00% Castro::advance() 10 7.162e-05 7.162e-05 7.162e-05 0.00% Castro::do_old_sources() 10 6.437e-05 6.437e-05 6.437e-05 0.00% makeSFC 115 6.297e-05 6.297e-05 6.297e-05 0.00% Castro::post_regrid() 12 6.269e-05 6.269e-05 6.269e-05 0.00% MLMG::computeResidual() 117 6.137e-05 6.137e-05 6.137e-05 0.00% Castro::finalize_do_advance() 10 5.994e-05 5.994e-05 5.994e-05 0.00% Amr::writeSmallPlotFile() 1 4.857e-05 4.857e-05 4.857e-05 0.00% MLPoisson::define() 25 4.632e-05 4.632e-05 4.632e-05 0.00% Castro::errorEst() 6 4.237e-05 4.237e-05 4.237e-05 0.00% DistributionMapping::Distribute() 117 3.868e-05 3.868e-05 3.868e-05 0.00% MLLinOp::define() 25 3.645e-05 3.645e-05 3.645e-05 0.00% FPinfo::FPinfo() 3 3.353e-05 3.353e-05 3.353e-05 0.00% MLLinOp::makeAgglomeratedDMap 25 3.143e-05 3.143e-05 3.143e-05 0.00% Castro::post_timestep() 10 2.97e-05 2.97e-05 2.97e-05 0.00% Castro::computeNewDt() 8 2.785e-05 2.785e-05 2.785e-05 0.00% FabArrayBase::TheFPinfo() 33 2.695e-05 2.695e-05 2.695e-05 0.00% FabArray::RecvLayoutMask() 5 2.611e-05 2.611e-05 2.611e-05 0.00% MLMG::computeMLResidual() 32 2.277e-05 2.277e-05 2.277e-05 0.00% Amr::FinalizeInit() 1 1.997e-05 1.997e-05 1.997e-05 0.00% MLPoisson::prepareForSolve() 25 1.967e-05 1.967e-05 1.967e-05 0.00% Castro::apply_source_to_state() 40 1.892e-05 1.892e-05 1.892e-05 0.00% ClusterList::intersect() 6 1.887e-05 1.887e-05 1.887e-05 0.00% MLMG::miniCycle() 44 1.863e-05 1.863e-05 1.863e-05 0.00% Castro::avgDown(state_indx) 30 1.791e-05 1.791e-05 1.791e-05 0.00% MLMG::MLResNormInf() 32 1.776e-05 1.776e-05 1.776e-05 0.00% Castro::construct_new_hybrid_source() 20 1.482e-05 1.482e-05 1.482e-05 0.00% MLMG::getGradSolution() 25 1.473e-05 1.473e-05 1.473e-05 0.00% Amr::initSubcycle() 1 1.45e-05 1.45e-05 1.45e-05 0.00% Castro::react_state() 20 1.274e-05 1.274e-05 1.274e-05 0.00% Castro::post_init() 2 1.241e-05 1.241e-05 1.241e-05 0.00% Gravity::swapTimeLevels() 10 1.151e-05 1.151e-05 1.151e-05 0.00% amrex::average_down_w_geom 30 1.125e-05 1.125e-05 1.125e-05 0.00% AmrMesh-cluster 6 9.588e-06 9.588e-06 9.588e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.705e-06 8.705e-06 8.705e-06 0.00% Castro::construct_old_hybrid_source() 10 6.603e-06 6.603e-06 6.603e-06 0.00% Amr::InitializeInit() 1 6.155e-06 6.155e-06 6.155e-06 0.00% Castro::avgDown() 6 6.112e-06 6.112e-06 6.112e-06 0.00% BoxList::parallelComplementIn() 12 4.948e-06 4.948e-06 4.948e-06 0.00% Castro::retry_advance_ctu() 10 4.909e-06 4.909e-06 4.909e-06 0.00% MLLinOp::makeSubCommunicator() 25 4.278e-06 4.278e-06 4.278e-06 0.00% BoxList::complementIn 12 4.054e-06 4.054e-06 4.054e-06 0.00% Castro::computeInitialDt() 2 3.261e-06 3.261e-06 3.261e-06 0.00% Gravity::set_mass_offset() 6 2.746e-06 2.746e-06 2.746e-06 0.00% ClusterList::chop() 6 2.089e-06 2.089e-06 2.089e-06 0.00% Amr::init() 1 1.649e-06 1.649e-06 1.649e-06 0.00% Amr::initialInit() 1 1.114e-06 1.114e-06 1.114e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 4.695 4.695 4.695 100.00% Amr::coarseTimeStep() 5 2.689 2.689 2.689 57.28% Amr::timeStep() 10 2.68 2.68 2.68 57.07% Castro::advance() 10 2.086 2.086 2.086 44.43% Castro::subcycle_advance_ctu() 10 2.001 2.001 2.001 42.62% Castro::do_advance_ctu() 10 2.001 2.001 2.001 42.61% Amr::InitAmr() 1 1.184 1.184 1.184 25.21% Castro::construct_ctu_hydro_source() 10 1.012 1.012 1.012 21.56% Gravity::solve_phi_with_mlmg() 25 0.9847 0.9847 0.9847 20.97% Gravity::actual_solve_with_mlmg() 25 0.8423 0.8423 0.8423 17.94% MLMG::solve() 25 0.7377 0.7377 0.7377 15.71% MLMG::oneIter() 117 0.6532 0.6532 0.6532 13.91% Gravity::solve_for_phi() 20 0.646 0.646 0.646 13.76% Amr::init() 1 0.6136 0.6136 0.6136 13.07% MLMG::mgVcycle() 161 0.5862 0.5862 0.5862 12.49% Amr::writePlotFile() 2 0.4403 0.4403 0.4403 9.38% VisMF::Write(FabArray) 4 0.4075 0.4075 0.4075 8.68% Castro::construct_new_gravity() 10 0.4038 0.4038 0.4038 8.60% Amr::initialInit() 1 0.3812 0.3812 0.3812 8.12% MLCellLinOp::smooth() 2308 0.3469 0.3469 0.3469 7.39% Gravity::multilevel_solve_for_new_phi() 5 0.3442 0.3442 0.3442 7.33% Gravity::actual_multilevel_solve() 5 0.3439 0.3439 0.3439 7.32% Castro::post_timestep() 10 0.3048 0.3048 0.3048 6.49% Amr::regrid() 5 0.3038 0.3038 0.3038 6.47% Castro::construct_old_gravity() 10 0.2987 0.2987 0.2987 6.36% Castro::post_regrid() 12 0.2645 0.2645 0.2645 5.63% MLCellLinOp::applyBC() 6611 0.257 0.257 0.257 5.47% Castro::clean_state() 119 0.2197 0.2197 0.2197 4.68% Amr::InitializeInit() 1 0.1908 0.1908 0.1908 4.06% Amr::defBaseLevel() 1 0.1908 0.1908 0.1908 4.06% Amr::FinalizeInit() 1 0.1904 0.1904 0.1904 4.05% Castro::problem_post_timestep() 11 0.1806 0.1806 0.1806 3.85% FillPatchIterator::Initialize 765 0.1644 0.1644 0.1644 3.50% FabArray::setVal() 2104 0.1612 0.1612 0.1612 3.43% MLPoisson::Fsmooth() 4616 0.1608 0.1608 0.1608 3.43% MLMG::mgVcycle_bottom 161 0.16 0.16 0.16 3.41% Castro::post_init() 2 0.1467 0.1467 0.1467 3.12% MLMG::actualBottomSolve() 117 0.1409 0.1409 0.1409 3.00% MLCGSolver::bicgstab 117 0.1398 0.1398 0.1398 2.98% Gravity::fill_multipole_BCs() 15 0.1395 0.1395 0.1395 2.97% Castro::reflux() 5 0.1391 0.1391 0.1391 2.96% Castro::computeTemp() 122 0.1352 0.1352 0.1352 2.88% Castro::derive() 607 0.1262 0.1262 0.1262 2.69% FillPatchSingleLevel 798 0.1206 0.1206 0.1206 2.57% MLMG::mgVcycle_down::0 117 0.1141 0.1141 0.1141 2.43% Castro::do_new_sources() 20 0.111 0.111 0.111 2.37% FabArray::ParallelCopy() 2596 0.1109 0.1109 0.1109 2.36% FabArray::ParallelCopy_nowait() 2596 0.11 0.11 0.11 2.34% Castro::initialize_do_advance() 10 0.09907 0.09907 0.09907 2.11% MLMG::mgVcycle_up::0 117 0.09893 0.09893 0.09893 2.11% MLCellLinOp::apply() 1931 0.09236 0.09236 0.09236 1.97% FabArray::FillBoundary() 6022 0.08628 0.08628 0.08628 1.84% FillBoundary_nowait() 6022 0.08488 0.08488 0.08488 1.81% MLPoisson::define() 25 0.07825 0.07825 0.07825 1.67% Castro::expand_state() 10 0.07453 0.07453 0.07453 1.59% Castro::initialize_advance() 10 0.07096 0.07096 0.07096 1.51% Castro::normalize_species() 119 0.06762 0.06762 0.06762 1.44% Castro::wd_update() 6 0.06621 0.06621 0.06621 1.41% MLCellLinOp::reflux() 34 0.06428 0.06428 0.06428 1.37% Castro::construct_new_source() 140 0.06115 0.06115 0.06115 1.30% MLCellLinOp::correctionResidual() 716 0.05713 0.05713 0.05713 1.22% Castro::volWgtSum() 156 0.05232 0.05232 0.05232 1.11% StateDataPhysBCFunct::() 798 0.05231 0.05231 0.05231 1.11% Castro::volInBoundary() 42 0.05045 0.05045 0.05045 1.07% MLMG::mgVcycle_down::1 117 0.04709 0.04709 0.04709 1.00% MLMG::computeResWithCrseSolFineCor() 22 0.04591 0.04591 0.04591 0.98% MLCellLinOp::defineAuxData() 25 0.04491 0.04491 0.04491 0.96% Castro::reset_internal_energy() 122 0.04176 0.04176 0.04176 0.89% MLMG:computeResOfCorrection() 555 0.0403 0.0403 0.0403 0.86% Amr::bldFineLevels() 1 0.04029 0.04029 0.04029 0.86% MLMG::mgVcycle_up::1 117 0.03915 0.03915 0.03915 0.83% MultiFab::Dot() 2078 0.03882 0.03882 0.03882 0.83% MLCellLinOp::solutionResidual() 176 0.03828 0.03828 0.03828 0.82% FillPatchTwoLevels 387 0.03784 0.03784 0.03784 0.81% FluxRegister::Reflux() 30 0.03735 0.03735 0.03735 0.80% Castro::do_old_sources() 10 0.03567 0.03567 0.03567 0.76% MLMG::computeMLResidual() 32 0.03551 0.03551 0.03551 0.76% MLCellLinOp::defineBC() 25 0.03276 0.03276 0.03276 0.70% amrex::average_down 644 0.03155 0.03155 0.03155 0.67% Gravity::get_new_grav_vector() 12 0.03002 0.03002 0.03002 0.64% BndryData::define() 35 0.02773 0.02773 0.02773 0.59% MLMG::mgVcycle_down::2 117 0.02712 0.02712 0.02712 0.58% StateData::FillBoundary(geom) 546 0.02707 0.02707 0.02707 0.58% MultiFab::Saxpy() 90 0.02682 0.02682 0.02682 0.57% MLMG::mgVcycle_down::3 117 0.026 0.026 0.026 0.55% MLMG::computeResidual() 117 0.02553 0.02553 0.02553 0.54% MLMG::addInterpCorrection() 555 0.02539 0.02539 0.02539 0.54% Gravity::get_old_grav_vector() 10 0.02533 0.02533 0.02533 0.54% Castro::estTimeStep() 29 0.02364 0.02364 0.02364 0.50% CGSolver::sxay() 2962 0.02357 0.02357 0.02357 0.50% FabArray::setDomainBndry() 798 0.02345 0.02345 0.02345 0.50% MultiFab::LinComb() 2972 0.02338 0.02338 0.02338 0.50% MLPoisson::Fapply() 1931 0.02325 0.02325 0.02325 0.50% MLCGSolver::ParallelAllReduce 2754 0.02218 0.02218 0.02218 0.47% MultiFab::Multiply() 408 0.02087 0.02087 0.02087 0.44% MLMG::mgVcycle_up::3 117 0.02043 0.02043 0.02043 0.44% MLMG::mgVcycle_up::2 117 0.02014 0.02014 0.02014 0.43% Castro::enforce_min_density() 119 0.01963 0.01963 0.01963 0.42% MLMG::miniCycle() 44 0.01916 0.01916 0.01916 0.41% MLMG::mgVcycle_down::4 87 0.01795 0.01795 0.01795 0.38% MultiFab::Xpay() 892 0.01772 0.01772 0.01772 0.38% MLMG::prepareForSolve() 25 0.01723 0.01723 0.01723 0.37% Castro::initData() 3 0.01665 0.01665 0.01665 0.35% Amr::grid_places() 6 0.01563 0.01563 0.01563 0.33% AmrMesh::MakeNewGrids() 6 0.01553 0.01553 0.01553 0.33% Castro::construct_old_source() 70 0.01511 0.01511 0.01511 0.32% MLMG::mgVcycle_up::4 87 0.0146 0.0146 0.0146 0.31% Castro::finalize_advance() 10 0.01377 0.01377 0.01377 0.29% Castro::computeNewDt() 8 0.01238 0.01238 0.01238 0.26% Castro::construct_new_gravity_source() 20 0.01211 0.01211 0.01211 0.26% Castro::apply_source_to_state() 40 0.01142 0.01142 0.01142 0.24% MLPoisson::FFlux() 1326 0.01072 0.01072 0.01072 0.23% MLMG::getGradSolution() 25 0.01053 0.01053 0.01053 0.22% MLCellLinOp::compGrad() 30 0.01052 0.01052 0.01052 0.22% MLMG::computeResWithCrseCorFineCor() 22 0.0105 0.0105 0.0105 0.22% FabArrayBase::getCPC() 2980 0.009934 0.009934 0.009934 0.21% Castro::construct_old_gravity_source() 20 0.009774 0.009774 0.009774 0.21% Castro::init(old) 4 0.009734 0.009734 0.009734 0.21% MLCellLinOp::setLevelBC() 30 0.009511 0.009511 0.009511 0.20% FillPatchInterp(Fab) 33 0.009354 0.009354 0.009354 0.20% MLCellLinOp::updateSolBC() 27 0.00916 0.00916 0.00916 0.20% FabArray::setVal(val, thecmd, scomp, ncomp) 1095 0.008944 0.008944 0.008944 0.19% FabArrayBase::CPC::define() 1033 0.007558 0.007558 0.007558 0.16% MLCellLinOp::updateCorBC() 22 0.007516 0.007516 0.007516 0.16% Castro::locWgtSum() 36 0.006918 0.006918 0.006918 0.15% MLMG::ResNormInf() 154 0.005129 0.005129 0.005129 0.11% Castro::errorEst() 6 0.004311 0.004311 0.004311 0.09% Gravity::swapTimeLevels() 10 0.004255 0.004255 0.004255 0.09% Castro::volProductSum() 12 0.003884 0.003884 0.003884 0.08% MLPoisson::prepareForSolve() 25 0.003843 0.003843 0.003843 0.08% MLCellLinOp::prepareForSolve() 25 0.003824 0.003824 0.003824 0.08% Castro::computeInitialDt() 2 0.003821 0.003821 0.003821 0.08% CellConservativeLinear::interp() 198 0.003736 0.003736 0.003736 0.08% Castro::fill_hybrid_hydro_source() 50 0.003676 0.003676 0.003676 0.08% Castro::avgDown() 6 0.00363 0.00363 0.00363 0.08% Castro::avgDown(state_indx) 30 0.003623 0.003623 0.003623 0.08% amrex::average_down_w_geom 30 0.003606 0.003606 0.003606 0.08% FabArray::mult() 72 0.003571 0.003571 0.003571 0.08% Castro::construct_new_hybrid_source() 20 0.002787 0.002787 0.002787 0.06% TagBoxArray::mapPRD 6 0.002786 0.002786 0.002786 0.06% FabArrayBase::getFB() 6022 0.002343 0.002343 0.002343 0.05% Gravity::update_max_rhs() 10 0.002295 0.002295 0.002295 0.05% MLMG::interpCorrection_1 22 0.002293 0.002293 0.002293 0.05% Gravity::average_fine_ec_onto_crse_ec() 5 0.002293 0.002293 0.002293 0.05% Gravity::create_comp_minus_level_grad_phi() 5 0.002193 0.002193 0.002193 0.05% Castro::FluxRegFineAdd() 10 0.002007 0.002007 0.002007 0.04% Gravity::GetCrsePhi() 10 0.001919 0.001919 0.001919 0.04% MultiFab::max() 56 0.001759 0.001759 0.001759 0.04% MLMG::MLResNormInf() 32 0.001389 0.001389 0.001389 0.03% MultiFab::Subtract() 25 0.001246 0.001246 0.001246 0.03% MultiFab::Copy() 30 0.001172 0.001172 0.001172 0.02% FabArrayBase::FB::FB() 98 0.001084 0.001084 0.001084 0.02% Castro::build_fine_mask() 166 0.001071 0.001071 0.001071 0.02% Castro::construct_old_hybrid_source() 10 0.0009097 0.0009097 0.0009097 0.02% OwnerMask() 6 0.0008965 0.0008965 0.0008965 0.02% MLMG::MLRhsNormInf() 25 0.0008908 0.0008908 0.0008908 0.02% TagBoxArray::collate() 6 0.0007798 0.0007798 0.0007798 0.02% MultiFab::norm0(mask) 17 0.000778 0.000778 0.000778 0.02% MultiFab::min() 10 0.0005855 0.0005855 0.0005855 0.01% MLLinOp::define() 25 0.000537 0.000537 0.000537 0.01% MLLinOp::defineGrids() 25 0.0005005 0.0005005 0.0005005 0.01% Castro::apply_problem_tags() 6 0.0004982 0.0004982 0.0004982 0.01% Castro::apply_tagging_restrictions() 6 0.0004432 0.0004432 0.0004432 0.01% AmrLevel::AmrLevel(dm) 7 0.0004329 0.0004329 0.0004329 0.01% Castro::react_state() 20 0.0004187 0.0004187 0.0004187 0.01% Castro::enforce_speed_limit() 119 0.000407 0.000407 0.000407 0.01% Castro::construct_new_rotation_source() 20 0.0004066 0.0004066 0.0004066 0.01% Castro::linear_to_hybrid_momentum() 3 0.0003939 0.0003939 0.0003939 0.01% StateData::define() 35 0.000357 0.000357 0.000357 0.01% MLMG::buildFineMask() 25 0.0003509 0.0003509 0.0003509 0.01% Castro::swap_state_time_levels() 10 0.0002506 0.0002506 0.0002506 0.01% Castro::construct_old_rotation_source() 10 0.0002365 0.0002365 0.0002365 0.01% Castro::enforce_consistent_e() 3 0.000209 0.000209 0.000209 0.00% Castro::create_source_corrector() 10 0.000194 0.000194 0.000194 0.00% AMRErrorTag::operator() 6 0.0001782 0.0001782 0.0001782 0.00% MLLinOp::makeAgglomeratedDMap 25 0.0001308 0.0001308 0.0001308 0.00% makeSFC 115 9.941e-05 9.941e-05 9.941e-05 0.00% FabArrayBase::TheFPinfo() 33 6.048e-05 6.048e-05 6.048e-05 0.00% Castro::finalize_do_advance() 10 5.994e-05 5.994e-05 5.994e-05 0.00% Amr::writeSmallPlotFile() 1 4.857e-05 4.857e-05 4.857e-05 0.00% DistributionMapping::Distribute() 117 3.868e-05 3.868e-05 3.868e-05 0.00% FPinfo::FPinfo() 3 3.353e-05 3.353e-05 3.353e-05 0.00% AmrMesh-cluster 6 3.055e-05 3.055e-05 3.055e-05 0.00% FabArray::RecvLayoutMask() 5 2.611e-05 2.611e-05 2.611e-05 0.00% ClusterList::intersect() 6 1.887e-05 1.887e-05 1.887e-05 0.00% Amr::initSubcycle() 1 1.45e-05 1.45e-05 1.45e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.095e-05 1.095e-05 1.095e-05 0.00% BoxList::parallelComplementIn() 12 9.002e-06 9.002e-06 9.002e-06 0.00% Castro::retry_advance_ctu() 10 4.909e-06 4.909e-06 4.909e-06 0.00% MLLinOp::makeSubCommunicator() 25 4.278e-06 4.278e-06 4.278e-06 0.00% BoxList::complementIn 12 4.054e-06 4.054e-06 4.054e-06 0.00% Gravity::set_mass_offset() 6 2.746e-06 2.746e-06 2.746e-06 0.00% ClusterList::chop() 6 2.089e-06 2.089e-06 2.089e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0e0, 0.0e0, 0.0e0] [TOP]::mg.v(nvals = 1) :: [2] Total GPU global memory (MB): 12066 Free GPU global memory (MB): 4849 [The Arena] space allocated (MB): 9049 [The Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (22.03-26-ge213d767baab) finalized