Initializing CUDA... CUDA initialized with 1 GPU AMReX (22.08-17-g8294c3afbcbb) initialized Starting run at 16:00:55 UTC on 2022-08-24. Successfully read inputs file ... Castro git describe: 22.08-12-gb5ab86608 AMReX git describe: 22.08-17-g8294c3afb Microphysics git describe: 22.08-4-gb9a0f9aa reading extern runtime parameters ... Initializing rate table 7 Species: He4 C12 O16 Ne20 Mg24 Si28 Ni56 Successfully read inputs file ... base density = 2435870.811 199752737.7 base density = 1259960.404 1396785590 Castro::numpts_1d at level 0 is 164 Setting the gravity type to ConstantGrav Installing Diffusion level 0 Initializing the data at level 0 Done initializing the level 0 data hydro CFL timestep constrained at (i,j,k) = (0,0,0) ...estimated hydro-limited timestep at level 0: 5.962924686e-07 ...estimated diffusion-limited timestep at level 0: 0.03400874767 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.962924686e-07 grid_places() time: 0.00111436 new finest: 1 Castro::numpts_1d at level 1 is 635 Installing Diffusion level 1 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.000625984 new finest: 1 Castro::numpts_1d at level 1 is 635 Installing Diffusion level 1 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 32 grids 8388608 cells 25 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 INITIAL GRIDS Level 0 2 grids 524288 cells 100 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 Level 1 32 grids 8388608 cells 25 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 PLOTFILE: file = flame_wave-3d_plt00000 Write plotfile time = 4.500876988 seconds hydro CFL timestep constrained at (i,j,k) = (0,0,0) ...estimated hydro-limited timestep at level 0: 5.956151822e-07 ...estimated diffusion-limited timestep at level 0: 0.03410590779 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.956151822e-07 hydro CFL timestep constrained at (i,j,k) = (0,0,0) ...estimated hydro-limited timestep at level 1: 1.463901697e-07 ...estimated diffusion-limited timestep at level 1: 0.001444905148 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.463901697e-07 [Level 0 step 1] ADVANCE with dt = 5.855606787e-08  Beginning subcycle 1 starting at time 0 with dt = 5.855606787e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.019704049 ... compute diffusive term at level 0 Castro::do_old_sources() time = 0.006149549 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.201828329 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.010010539 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.010890132 hydro CFL timestep constrained at (i,j,k) = (0,0,0) ...estimated hydro-limited timestep at level 0: 5.955565339e-07 ...estimated diffusion-limited timestep at level 0: 0.03422898903 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.955565339e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.810588312 [Level 0 step 1] Advanced 524288 cells [Level 1 step 1] ADVANCE with dt = 1.463901697e-08  Beginning subcycle 1 starting at time 0 with dt = 1.463901697e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.630324186 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.06692579 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.08678451 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.833654938 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.449414073 hydro CFL timestep constrained at (i,j,k) = (507,0,37) ...estimated hydro-limited timestep at level 1: 1.105911959e-07 ...estimated diffusion-limited timestep at level 1: 0.001442942058 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.105911959e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.969120676 [Level 1 step 1] Advanced 8388608 cells [Level 1 step 2] ADVANCE with dt = 1.463901697e-08  Beginning subcycle 1 starting at time 1.463901697e-08 with dt = 1.463901697e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (507,0,37) ...estimated hydro-limited timestep at level 1: 1.105911959e-07 ...estimated diffusion-limited timestep at level 1: 0.001442942058 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.105911959e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.620596218 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.13278895 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.741576441 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.551071639 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.470092842 hydro CFL timestep constrained at (i,j,k) = (4,0,37) ...estimated hydro-limited timestep at level 1: 1.088448009e-07 ...estimated diffusion-limited timestep at level 1: 0.00144166338 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.088448009e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.120601984 [Level 1 step 2] Advanced 8388608 cells [Level 1 step 3] ADVANCE with dt = 1.463901697e-08  Beginning subcycle 1 starting at time 2.927803394e-08 with dt = 1.463901697e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (4,0,37) ...estimated hydro-limited timestep at level 1: 1.088448009e-07 ...estimated diffusion-limited timestep at level 1: 0.00144166338 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.088448009e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.630465207 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.068002134 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.581637376 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.130752148 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.466186475 hydro CFL timestep constrained at (i,j,k) = (4,0,37) ...estimated hydro-limited timestep at level 1: 1.075653951e-07 ...estimated diffusion-limited timestep at level 1: 0.001441027508 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.075653951e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.912030232 [Level 1 step 3] Advanced 8388608 cells [Level 1 step 4] ADVANCE with dt = 1.463901697e-08  Beginning subcycle 1 starting at time 4.39170509e-08 with dt = 1.463901697e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (4,0,37) ...estimated hydro-limited timestep at level 1: 1.075653951e-07 ...estimated diffusion-limited timestep at level 1: 0.001441027508 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.075653951e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.629248576 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.752086393 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.567003315 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.471691069 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.429441952 hydro CFL timestep constrained at (i,j,k) = (511,247,37) ...estimated hydro-limited timestep at level 1: 1.062722315e-07 ...estimated diffusion-limited timestep at level 1: 0.001441017873 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.062722315e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.786745208 [Level 1 step 4] Advanced 8388608 cells ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.229933319 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.031461699 Castro::reflux() at level 0 : time = 0.476224936 [STEP 1] Coarse TimeStep time: 18.54832363 [STEP 1] FAB kilobyte spread across MPI nodes: [11388286 ... 11388286] STEP = 1 TIME = 5.855606787e-08 DT = 5.855606787e-08 hydro CFL timestep constrained at (i,j,k) = (0,0,0) ...estimated hydro-limited timestep at level 0: 5.956125921e-07 ...estimated diffusion-limited timestep at level 0: 0.03412422782 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.956125921e-07 hydro CFL timestep constrained at (i,j,k) = (511,247,37) ...estimated hydro-limited timestep at level 1: 1.062722315e-07 ...estimated diffusion-limited timestep at level 1: 0.001441017873 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.062722315e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 5.956125921e-07 ... but limiting to: 6.441167466e-08 = 1.1 * 5.855606787e-08 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 1.062722315e-07 ... but limiting to: 1.610291866e-08 = 1.1 * 1.463901697e-08 [Level 0 step 2] ADVANCE with dt = 6.441167466e-08  Beginning subcycle 1 starting at time 5.855606787e-08 with dt = 6.441167466e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.012713918 ... compute diffusive term at level 0 Castro::do_old_sources() time = 0.006632797 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.04953277 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.014084665 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.010840516 hydro CFL timestep constrained at (i,j,k) = (127,0,10) ...estimated hydro-limited timestep at level 0: 5.775611698e-07 ...estimated diffusion-limited timestep at level 0: 0.02495612599 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.775611698e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.977001316 [Level 0 step 2] Advanced 524288 cells [Level 1 step 5] ADVANCE with dt = 1.610291866e-08  Beginning subcycle 1 starting at time 5.855606787e-08 with dt = 1.610291866e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.633453937 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.065164488 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.912692586 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.153522975 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.464463862 hydro CFL timestep constrained at (i,j,k) = (511,247,37) ...estimated hydro-limited timestep at level 1: 1.04291752e-07 ...estimated diffusion-limited timestep at level 1: 0.001441678669 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.04291752e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.954426798 [Level 1 step 5] Advanced 8388608 cells [Level 1 step 6] ADVANCE with dt = 1.610291866e-08  Beginning subcycle 1 starting at time 7.465898654e-08 with dt = 1.610291866e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (511,247,37) ...estimated hydro-limited timestep at level 1: 1.04291752e-07 ...estimated diffusion-limited timestep at level 1: 0.001441678669 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.04291752e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.614312693 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.74604243 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.44220787 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.44290717 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.431591901 hydro CFL timestep constrained at (i,j,k) = (511,247,37) ...estimated hydro-limited timestep at level 1: 1.029901919e-07 ...estimated diffusion-limited timestep at level 1: 0.001443031491 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.029901919e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.867310401 [Level 1 step 6] Advanced 8388608 cells [Level 1 step 7] ADVANCE with dt = 1.610291866e-08  Beginning subcycle 1 starting at time 9.07619052e-08 with dt = 1.610291866e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (511,247,37) ...estimated hydro-limited timestep at level 1: 1.029901919e-07 ...estimated diffusion-limited timestep at level 1: 0.001443031491 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.029901919e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.62391415 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.063615147 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.838534351 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.156750569 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.462597154 hydro CFL timestep constrained at (i,j,k) = (511,247,37) ...estimated hydro-limited timestep at level 1: 1.020593119e-07 ...estimated diffusion-limited timestep at level 1: 0.001412972282 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.020593119e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.933968531 [Level 1 step 7] Advanced 8388608 cells [Level 1 step 8] ADVANCE with dt = 1.610291866e-08  Beginning subcycle 1 starting at time 1.068648239e-07 with dt = 1.610291866e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (511,247,37) ...estimated hydro-limited timestep at level 1: 1.020593119e-07 ...estimated diffusion-limited timestep at level 1: 0.001412972282 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.020593119e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.623461203 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.750102861 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.425557349 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.415641703 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.429903742 hydro CFL timestep constrained at (i,j,k) = (4,255,37) ...estimated hydro-limited timestep at level 1: 1.007917421e-07 ...estimated diffusion-limited timestep at level 1: 0.001417864623 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.007917421e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.854673653 [Level 1 step 8] Advanced 8388608 cells ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.211613313 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.029458149 Castro::reflux() at level 0 : time = 0.427928733 [STEP 2] Coarse TimeStep time: 18.27576421 [STEP 2] FAB kilobyte spread across MPI nodes: [11388286 ... 11388286] STEP = 2 TIME = 1.229677425e-07 DT = 6.441167466e-08 hydro CFL timestep constrained at (i,j,k) = (0,0,0) ...estimated hydro-limited timestep at level 0: 5.956095787e-07 ...estimated diffusion-limited timestep at level 0: 0.0342002105 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.956095787e-07 hydro CFL timestep constrained at (i,j,k) = (4,255,37) ...estimated hydro-limited timestep at level 1: 1.007917421e-07 ...estimated diffusion-limited timestep at level 1: 0.001417864623 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.007917421e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 5.956095787e-07 ... but limiting to: 7.085284213e-08 = 1.1 * 6.441167466e-08 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 1.007917421e-07 ... but limiting to: 1.771321053e-08 = 1.1 * 1.610291866e-08 Now regridding at level lbase = 0 grid_places() time: 0.005552748 new finest: 1 Castro::numpts_1d at level 1 is 635 Installing Diffusion level 1 STEP = 2 TIME = 1.229677425e-07 : REGRID with lbase = 0 Level 1 32 grids 8388608 cells 25 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 hydro CFL timestep constrained at (i,j,k) = (0,0,0) ...estimated hydro-limited timestep at level 0: 5.956095787e-07 ...estimated diffusion-limited timestep at level 0: 0.0342002105 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.956095787e-07 hydro CFL timestep constrained at (i,j,k) = (4,255,37) ...estimated hydro-limited timestep at level 1: 1.007917421e-07 ...estimated diffusion-limited timestep at level 1: 0.001417864623 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.007917421e-07 [Level 0 step 3] ADVANCE with dt = 7.085284213e-08  Beginning subcycle 1 starting at time 1.229677425e-07 with dt = 7.085284213e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.012962486 ... compute diffusive term at level 0 Castro::do_old_sources() time = 0.008354156 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.069519498 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.014223506 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.010592786 hydro CFL timestep constrained at (i,j,k) = (127,0,10) ...estimated hydro-limited timestep at level 0: 5.548608925e-07 ...estimated diffusion-limited timestep at level 0: 0.0251050223 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.548608925e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.846029026 [Level 0 step 3] Advanced 524288 cells [Level 1 step 9] ADVANCE with dt = 1.771321053e-08  Beginning subcycle 1 starting at time 1.229677425e-07 with dt = 1.771321053e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.626255078 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.164666906 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.448929361 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.188806042 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.44414969 hydro CFL timestep constrained at (i,j,k) = (4,255,37) ...estimated hydro-limited timestep at level 1: 9.946434489e-08 ...estimated diffusion-limited timestep at level 1: 0.001423573546 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.946434489e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.29403821 [Level 1 step 9] Advanced 8388608 cells [Level 1 step 10] ADVANCE with dt = 1.771321053e-08  Beginning subcycle 1 starting at time 1.406809531e-07 with dt = 1.771321053e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (4,255,37) ...estimated hydro-limited timestep at level 1: 9.946434489e-08 ...estimated diffusion-limited timestep at level 1: 0.001423573546 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.946434489e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.62901889 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.241585911 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.462102528 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.670068898 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.466556465 hydro CFL timestep constrained at (i,j,k) = (4,255,37) ...estimated hydro-limited timestep at level 1: 9.833722462e-08 ...estimated diffusion-limited timestep at level 1: 0.001429585926 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.833722462e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.747052395 [Level 1 step 10] Advanced 8388608 cells [Level 1 step 11] ADVANCE with dt = 1.771321053e-08  Beginning subcycle 1 starting at time 1.583941636e-07 with dt = 1.771321053e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (4,255,37) ...estimated hydro-limited timestep at level 1: 9.833722462e-08 ...estimated diffusion-limited timestep at level 1: 0.001429585926 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.833722462e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.626846596 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.078232423 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.418816582 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.24958029 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.44066771 hydro CFL timestep constrained at (i,j,k) = (4,255,37) ...estimated hydro-limited timestep at level 1: 9.739475519e-08 ...estimated diffusion-limited timestep at level 1: 0.001435878378 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.739475519e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.305274128 [Level 1 step 11] Advanced 8388608 cells [Level 1 step 12] ADVANCE with dt = 1.771321053e-08  Beginning subcycle 1 starting at time 1.761073741e-07 with dt = 1.771321053e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (4,255,37) ...estimated hydro-limited timestep at level 1: 9.739475519e-08 ...estimated diffusion-limited timestep at level 1: 0.001435878378 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.739475519e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.608627988 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.316198326 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.389535871 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.517560959 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.462170567 hydro CFL timestep constrained at (i,j,k) = (4,255,37) ...estimated hydro-limited timestep at level 1: 9.661827205e-08 ...estimated diffusion-limited timestep at level 1: 0.001442426424 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.661827205e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.724186575 [Level 1 step 12] Advanced 8388608 cells ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.264960915 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.034778114 Castro::reflux() at level 0 : time = 0.408046534 [STEP 3] Coarse TimeStep time: 17.94514612 [STEP 3] FAB kilobyte spread across MPI nodes: [11951674 ... 11951674] STEP = 3 TIME = 1.938205847e-07 DT = 7.085284213e-08 hydro CFL timestep constrained at (i,j,k) = (0,0,10) ...estimated hydro-limited timestep at level 0: 5.691818737e-07 ...estimated diffusion-limited timestep at level 0: 0.03433354803 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.691818737e-07 hydro CFL timestep constrained at (i,j,k) = (4,255,37) ...estimated hydro-limited timestep at level 1: 9.661827205e-08 ...estimated diffusion-limited timestep at level 1: 0.001442426424 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.661827205e-08 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 5.691818737e-07 ... but limiting to: 7.793812634e-08 = 1.1 * 7.085284213e-08 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 9.661827205e-08 ... but limiting to: 1.948453158e-08 = 1.1 * 1.771321053e-08 [Level 0 step 4] ADVANCE with dt = 7.793812634e-08  Beginning subcycle 1 starting at time 1.938205847e-07 with dt = 7.793812634e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.013312198 ... compute diffusive term at level 0 Castro::do_old_sources() time = 0.009394525 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.059106829 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.010401587 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.010414275 hydro CFL timestep constrained at (i,j,k) = (127,0,10) ...estimated hydro-limited timestep at level 0: 5.352544053e-07 ...estimated diffusion-limited timestep at level 0: 0.02510680508 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.352544053e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.108867883 [Level 0 step 4] Advanced 524288 cells [Level 1 step 13] ADVANCE with dt = 1.948453158e-08  Beginning subcycle 1 starting at time 1.938205847e-07 with dt = 1.948453158e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.622043916 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.06794954 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.479621351 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.253072958 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.438172358 hydro CFL timestep constrained at (i,j,k) = (507,255,37) ...estimated hydro-limited timestep at level 1: 9.596779956e-08 ...estimated diffusion-limited timestep at level 1: 0.00144991653 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.596779956e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.263805704 [Level 1 step 13] Advanced 8388608 cells [Level 1 step 14] ADVANCE with dt = 1.948453158e-08  Beginning subcycle 1 starting at time 2.133051162e-07 with dt = 1.948453158e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (507,255,37) ...estimated hydro-limited timestep at level 1: 9.596779956e-08 ...estimated diffusion-limited timestep at level 1: 0.00144991653 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.596779956e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.614719077 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.417318558 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.308750717 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.356317184 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.465992673 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 9.452287775e-08 ...estimated diffusion-limited timestep at level 1: 0.001457655536 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.452287775e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.802972319 [Level 1 step 14] Advanced 8388608 cells [Level 1 step 15] ADVANCE with dt = 1.948453158e-08  Beginning subcycle 1 starting at time 2.327896478e-07 with dt = 1.948453158e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 9.452287775e-08 ...estimated diffusion-limited timestep at level 1: 0.001457655536 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.452287775e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.637353122 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.063224868 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.506699837 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.254074632 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.443638501 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 9.194135814e-08 ...estimated diffusion-limited timestep at level 1: 0.001465621248 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.194135814e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.175443568 [Level 1 step 15] Advanced 8388608 cells [Level 1 step 16] ADVANCE with dt = 1.948453158e-08  Beginning subcycle 1 starting at time 2.522741794e-07 with dt = 1.948453158e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 9.194135814e-08 ...estimated diffusion-limited timestep at level 1: 0.001465621248 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.194135814e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.610865149 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.410281058 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.359022549 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.342883863 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.463583666 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 8.980934715e-08 ...estimated diffusion-limited timestep at level 1: 0.001473788583 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.980934715e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.79940588 [Level 1 step 16] Advanced 8388608 cells ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.185588095 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.02853628 Castro::reflux() at level 0 : time = 0.30715678 [STEP 4] Coarse TimeStep time: 17.37824986 [STEP 4] FAB kilobyte spread across MPI nodes: [11951674 ... 11951674] STEP = 4 TIME = 2.71758711e-07 DT = 7.793812634e-08 hydro CFL timestep constrained at (i,j,k) = (0,0,10) ...estimated hydro-limited timestep at level 0: 5.321820281e-07 ...estimated diffusion-limited timestep at level 0: 0.03454094543 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.321820281e-07 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 8.980934715e-08 ...estimated diffusion-limited timestep at level 1: 0.001473788583 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.980934715e-08 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 5.321820281e-07 ... but limiting to: 8.573193897e-08 = 1.1 * 7.793812634e-08 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 8.980934715e-08 ... but limiting to: 2.143298474e-08 = 1.1 * 1.948453158e-08 Now regridding at level lbase = 0 grid_places() time: 0.001029588 new finest: 1 Castro::numpts_1d at level 1 is 635 Installing Diffusion level 1 STEP = 4 TIME = 2.71758711e-07 : REGRID with lbase = 0 Level 1 32 grids 8388608 cells 25 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 hydro CFL timestep constrained at (i,j,k) = (0,0,10) ...estimated hydro-limited timestep at level 0: 5.321820281e-07 ...estimated diffusion-limited timestep at level 0: 0.03454094543 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.321820281e-07 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 8.980934715e-08 ...estimated diffusion-limited timestep at level 1: 0.001473788583 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.980934715e-08 [Level 0 step 5] ADVANCE with dt = 8.573193897e-08  Beginning subcycle 1 starting at time 2.71758711e-07 with dt = 8.573193897e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.0128455 ... compute diffusive term at level 0 Castro::do_old_sources() time = 0.014728913 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.0718891 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.010477053 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.010567634 hydro CFL timestep constrained at (i,j,k) = (127,0,10) ...estimated hydro-limited timestep at level 0: 5.189796522e-07 ...estimated diffusion-limited timestep at level 0: 0.02532684875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.189796522e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.71330996 [Level 0 step 5] Advanced 524288 cells [Level 1 step 17] ADVANCE with dt = 2.143298474e-08  Beginning subcycle 1 starting at time 2.71758711e-07 with dt = 2.143298474e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.617998887 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.199552085 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.236699063 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.488811069 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.465984888 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 8.78491966e-08 ...estimated diffusion-limited timestep at level 1: 0.001483009535 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.78491966e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.10456847 [Level 1 step 17] Advanced 8388608 cells [Level 1 step 18] ADVANCE with dt = 2.143298474e-08  Beginning subcycle 1 starting at time 2.931916957e-07 with dt = 2.143298474e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 8.78491966e-08 ...estimated diffusion-limited timestep at level 1: 0.001483009535 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.78491966e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.615416574 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.177016403 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.915711075 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.441229938 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.456102904 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 8.655410317e-08 ...estimated diffusion-limited timestep at level 1: 0.001471170931 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.655410317e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.334760835 [Level 1 step 18] Advanced 8388608 cells [Level 1 step 19] ADVANCE with dt = 2.143298474e-08  Beginning subcycle 1 starting at time 3.146246805e-07 with dt = 2.143298474e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 8.655410317e-08 ...estimated diffusion-limited timestep at level 1: 0.001471170931 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.655410317e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.613348413 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.326812845 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.444650526 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.584471149 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.466861192 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 8.564324989e-08 ...estimated diffusion-limited timestep at level 1: 0.001378651818 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.564324989e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.734421813 [Level 1 step 19] Advanced 8388608 cells [Level 1 step 20] ADVANCE with dt = 2.143298474e-08  Beginning subcycle 1 starting at time 3.360576652e-07 with dt = 2.143298474e-08 Estimated number of subcycles remaining: 1 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 8.564324989e-08 ...estimated diffusion-limited timestep at level 1: 0.001378651818 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.564324989e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.613891537 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.200584651 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.911139271 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.370801766 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.454477182 hydro CFL timestep constrained at (i,j,k) = (508,255,38) ...estimated hydro-limited timestep at level 1: 8.50375645e-08 ...estimated diffusion-limited timestep at level 1: 0.001396857724 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.50375645e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.359609783 [Level 1 step 20] Advanced 8388608 cells ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.286775942 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.024766186 Castro::reflux() at level 0 : time = 0.559848642 [STEP 5] Coarse TimeStep time: 17.39494728 [STEP 5] FAB kilobyte spread across MPI nodes: [11951674 ... 11951674] STEP = 5 TIME = 3.5749065e-07 DT = 8.573193897e-08 PLOTFILE: file = flame_wave-3d_plt00005 Write plotfile time = 5.821006143 seconds Ending run at 16:02:36 UTC on 2022-08-24. Run time = 101.4805401 Run time without initialization = 95.36524361 Average number of zones advanced per microsecond: 1.787 Average number of zones advanced per microsecond per rank: 1.787 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 13982508544 TinyProfiler total time across processes [min...avg...max]: 101.5 ... 101.5 ... 101.5 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 25 28.9298 28.9298 28.9298 28.51% Castro::react_state() 50 21.62 21.62 21.62 21.30% FabArray::setVal() 802 9.619 9.619 9.619 9.48% VisMF::Write(FabArray) 4 7.993 7.993 7.993 7.88% Castro::FluxRegFineAdd() 25 4.225 4.225 4.225 4.16% FabArray::ParallelCopy_nowait() 1250 3.937 3.937 3.937 3.88% Castro::expand_state() 30 2.797 2.797 2.797 2.76% Castro::do_advance_ctu() 25 2.167 2.167 2.167 2.14% Castro::getTempDiffusionTerm() 95 1.93 1.93 1.93 1.90% FabArray::setDomainBndry() 596 1.699 1.699 1.699 1.67% Castro::normalize_species() 233 1.669 1.669 1.669 1.64% Castro::reset_internal_energy(MultiFab) 236 1.431 1.431 1.431 1.41% Gravity::get_new_grav_vector() 27 1.377 1.377 1.377 1.36% Castro::computeTemp() 236 1.315 1.315 1.315 1.30% Amr::InitAmr() 1 1.107 1.107 1.107 1.09% Amr::writePlotFile() 2 1.1 1.1 1.1 1.08% MultiFab::Saxpy() 260 1.026 1.026 1.026 1.01% Castro::construct_new_gravity_source() 35 1.019 1.019 1.019 1.00% FillPatchSingleLevel 596 0.8579 0.8579 0.8579 0.85% Castro::construct_new_rotation_source() 35 0.6766 0.6766 0.6766 0.67% Castro::derive() 144 0.6633 0.6633 0.6633 0.65% Castro::estTimeStep() 55 0.6167 0.6167 0.6167 0.61% Gravity::get_old_grav_vector() 25 0.5045 0.5045 0.5045 0.50% StateDataPhysBCFunct::() 596 0.379 0.379 0.379 0.37% Castro::reflux() 5 0.3787 0.3787 0.3787 0.37% Diffusion::applyop_mlmg() 95 0.3754 0.3754 0.3754 0.37% Castro::construct_old_gravity_source() 25 0.244 0.244 0.244 0.24% MultiFab::contains_nan() 50 0.1826 0.1826 0.1826 0.18% BndryData::define() 95 0.1733 0.1733 0.1733 0.17% StateData::FillBoundary(geom) 4538 0.1517 0.1517 0.1517 0.15% Castro::enforce_min_density() 233 0.1465 0.1465 0.1465 0.14% Castro::construct_new_source() 245 0.1392 0.1392 0.1392 0.14% FillPatchInterp(Fab) 130 0.1315 0.1315 0.1315 0.13% MLCellLinOp::defineAuxData() 95 0.1295 0.1295 0.1295 0.13% Castro::init(old) 2 0.1201 0.1201 0.1201 0.12% MLCellLinOp::setLevelBC() 95 0.09478 0.09478 0.09478 0.09% Castro::construct_old_rotation_source() 25 0.08457 0.08457 0.08457 0.08% MLABecLaplacian::Fapply() 95 0.07795 0.07795 0.07795 0.08% Castro::initData() 3 0.04699 0.04699 0.04699 0.05% amrex::average_down 30 0.04206 0.04206 0.04206 0.04% FluxRegister::Reflux() 30 0.03142 0.03142 0.03142 0.03% MultiFab::Xpay() 95 0.02561 0.02561 0.02561 0.03% Castro::reset_internal_energy(Fab) 5812 0.02447 0.02447 0.02447 0.02% FabArray::mult() 95 0.01744 0.01744 0.01744 0.02% FillBoundary_nowait() 145 0.0169 0.0169 0.0169 0.02% Castro::initMFs() 5 0.01532 0.01532 0.01532 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 1140 0.01498 0.01498 0.01498 0.01% FillPatchIterator::Initialize 466 0.0143 0.0143 0.0143 0.01% MLABecLaplacian::define() 95 0.01347 0.01347 0.01347 0.01% MLCellLinOp::prepareForSolve() 95 0.0132 0.0132 0.0132 0.01% MultiFab::min() 100 0.01291 0.01291 0.01291 0.01% Amr::timeStep() 25 0.01084 0.01084 0.01084 0.01% Castro::buildMetrics() 5 0.01077 0.01077 0.01077 0.01% MLCellLinOp::applyBC() 95 0.009859 0.009859 0.009859 0.01% FabArrayBase::CPC::define() 310 0.009843 0.009843 0.009843 0.01% MultiFab::max() 50 0.006449 0.006449 0.006449 0.01% MLMG::apply() 95 0.005274 0.005274 0.005274 0.01% Amr::grid_places() 4 0.004471 0.004471 0.004471 0.00% Castro::enforce_speed_limit() 233 0.00417 0.00417 0.00417 0.00% Castro::FluxRegCrseInit 25 0.00384 0.00384 0.00384 0.00% FillPatchTwoLevels 238 0.003742 0.003742 0.003742 0.00% CellConservativeLinear::interp() 130 0.003273 0.003273 0.003273 0.00% FabArrayBase::getCPC() 2178 0.002434 0.002434 0.002434 0.00% Castro::add_temp_diffusion_to_sources() 95 0.002264 0.002264 0.002264 0.00% AmrMesh::MakeNewGrids() 4 0.001533 0.001533 0.001533 0.00% Castro::initialize_do_advance() 25 0.001503 0.001503 0.001503 0.00% Castro::enforce_consistent_e() 3 0.00144 0.00144 0.00144 0.00% Castro::initialize_advance() 25 0.001345 0.001345 0.001345 0.00% MLCellLinOp::defineBC() 95 0.001293 0.001293 0.001293 0.00% Castro::subcycle_advance_ctu() 25 0.001205 0.001205 0.001205 0.00% Castro::construct_new_diff_source() 35 0.001184 0.001184 0.001184 0.00% Amr::coarseTimeStep() 5 0.001158 0.001158 0.001158 0.00% Castro::finalize_advance() 25 0.0009615 0.0009615 0.0009615 0.00% Castro::apply_tagging_restrictions() 4 0.0009488 0.0009488 0.0009488 0.00% Amr::regrid() 3 0.0009253 0.0009253 0.0009253 0.00% Castro::construct_old_diff_source() 25 0.0009237 0.0009237 0.0009237 0.00% Castro::advance() 25 0.0009169 0.0009169 0.0009169 0.00% Castro::create_source_corrector() 25 0.0008449 0.0008449 0.0008449 0.00% main() 1 0.0006982 0.0006982 0.0006982 0.00% StateData::define() 25 0.0006018 0.0006018 0.0006018 0.00% Castro::construct_old_source() 175 0.0005862 0.0005862 0.0005862 0.00% Castro::swap_state_time_levels() 25 0.0005649 0.0005649 0.0005649 0.00% FabArray::ParallelCopy() 1250 0.000532 0.000532 0.000532 0.00% Castro::clean_state() 233 0.0005248 0.0005248 0.0005248 0.00% Castro::do_new_sources() 35 0.0004571 0.0004571 0.0004571 0.00% Castro::Castro() 5 0.0004048 0.0004048 0.0004048 0.00% MLLinOp::defineGrids() 95 0.0003771 0.0003771 0.0003771 0.00% Castro::finalize_do_advance() 25 0.0003118 0.0003118 0.0003118 0.00% Castro::do_old_sources() 25 0.0002914 0.0002914 0.0002914 0.00% TagBoxArray::collate() 4 0.0002676 0.0002676 0.0002676 0.00% Castro::build_fine_mask() 5 0.0002411 0.0002411 0.0002411 0.00% TagBoxArray::mapPRD 4 0.0002294 0.0002294 0.0002294 0.00% FabArrayBase::TheFPinfo() 130 0.0002247 0.0002247 0.0002247 0.00% MLABecLaplacian::prepareForSolve() 95 0.0001739 0.0001739 0.0001739 0.00% OwnerMask() 4 0.0001663 0.0001663 0.0001663 0.00% Castro::apply_problem_tags() 4 0.0001435 0.0001435 0.0001435 0.00% FabArrayBase::getFB() 145 0.0001111 0.0001111 0.0001111 0.00% MLLinOp::define() 95 0.0001082 0.0001082 0.0001082 0.00% FabArrayBase::FB::FB() 3 0.0001072 0.0001072 0.0001072 0.00% MLCellLinOp::solutionResidual() 95 0.0001064 0.0001064 0.0001064 0.00% MLCellLinOp::apply() 95 9.377e-05 9.377e-05 9.377e-05 0.00% Castro::construct_old_gravity() 25 9.215e-05 9.215e-05 9.215e-05 0.00% FabArray::FillBoundary() 145 8.165e-05 8.165e-05 8.165e-05 0.00% ClusterList::intersect() 4 7.887e-05 7.887e-05 7.887e-05 0.00% Castro::construct_new_gravity() 25 7.227e-05 7.227e-05 7.227e-05 0.00% Castro::apply_source_to_state() 70 6.741e-05 6.741e-05 6.741e-05 0.00% Castro::post_timestep() 25 5.609e-05 5.609e-05 5.609e-05 0.00% Castro::computeNewDt() 6 4.911e-05 4.911e-05 4.911e-05 0.00% AmrMesh-cluster 4 4.895e-05 4.895e-05 4.895e-05 0.00% MLABecLaplacian::averageDownCoeffs() 95 4.621e-05 4.621e-05 4.621e-05 0.00% Amr::writeSmallPlotFile() 1 4.56e-05 4.56e-05 4.56e-05 0.00% Castro::check_for_nan() 50 4.434e-05 4.434e-05 4.434e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.161e-05 3.161e-05 3.161e-05 0.00% Castro::avgDown(state_indx) 30 2.61e-05 2.61e-05 2.61e-05 0.00% Gravity::swapTimeLevels() 25 2.359e-05 2.359e-05 2.359e-05 0.00% FPinfo::FPinfo() 3 2.359e-05 2.359e-05 2.359e-05 0.00% Castro::retry_advance_ctu() 25 2.344e-05 2.344e-05 2.344e-05 0.00% amrex::average_down_w_geom 30 1.882e-05 1.882e-05 1.882e-05 0.00% Amr::FinalizeInit() 1 1.704e-05 1.704e-05 1.704e-05 0.00% Amr::defBaseLevel() 1 1.475e-05 1.475e-05 1.475e-05 0.00% Amr::bldFineLevels() 1 1.435e-05 1.435e-05 1.435e-05 0.00% Amr::initSubcycle() 1 1.043e-05 1.043e-05 1.043e-05 0.00% Castro::avgDown() 6 9.341e-06 9.341e-06 9.341e-06 0.00% Castro::post_regrid() 8 8.477e-06 8.477e-06 8.477e-06 0.00% Amr::InitializeInit() 1 7.689e-06 7.689e-06 7.689e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 6.752e-06 6.752e-06 6.752e-06 0.00% Castro::computeInitialDt() 2 6.709e-06 6.709e-06 6.709e-06 0.00% BoxList::complementIn 8 5.168e-06 5.168e-06 5.168e-06 0.00% BoxList::parallelComplementIn() 8 5.114e-06 5.114e-06 5.114e-06 0.00% Gravity::set_mass_offset() 5 4.67e-06 4.67e-06 4.67e-06 0.00% Castro::errorEst() 4 4.639e-06 4.639e-06 4.639e-06 0.00% Castro::post_init() 2 2.895e-06 2.895e-06 2.895e-06 0.00% Amr::init() 1 1.964e-06 1.964e-06 1.964e-06 0.00% DistributionMapping::Distribute() 2 1.876e-06 1.876e-06 1.876e-06 0.00% ClusterList::chop() 4 1.462e-06 1.462e-06 1.462e-06 0.00% Amr::initialInit() 1 9.53e-07 9.53e-07 9.53e-07 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 101.5 101.5 101.5 100.00% Amr::coarseTimeStep() 5 89.54 89.54 89.54 88.24% Amr::timeStep() 25 89.46 89.46 89.46 88.16% Castro::advance() 25 85.58 85.58 85.58 84.33% Castro::subcycle_advance_ctu() 25 76.81 76.81 76.81 75.69% Castro::do_advance_ctu() 25 76.81 76.81 76.81 75.69% Castro::construct_ctu_hydro_source() 25 28.93 28.93 28.93 28.51% Castro::react_state() 50 21.64 21.64 21.64 21.32% Amr::writePlotFile() 2 10.32 10.32 10.32 10.17% FabArray::setVal() 802 9.619 9.619 9.619 9.48% Castro::do_new_sources() 35 9.261 9.261 9.261 9.13% VisMF::Write(FabArray) 4 7.993 7.993 7.993 7.88% FillPatchIterator::Initialize 466 7.165 7.165 7.165 7.06% Castro::add_temp_diffusion_to_sources() 95 6.952 6.952 6.952 6.85% Castro::getTempDiffusionTerm() 95 6.827 6.827 6.827 6.73% Castro::construct_new_source() 245 6.475 6.475 6.475 6.38% Castro::do_old_sources() 25 5.354 5.354 5.354 5.28% FillPatchTwoLevels 238 5.351 5.351 5.351 5.27% FillPatchSingleLevel 596 5.189 5.189 5.189 5.11% Amr::init() 1 5.008 5.008 5.008 4.94% Castro::initialize_do_advance() 25 4.7 4.7 4.7 4.63% Castro::construct_new_diff_source() 35 4.64 4.64 4.64 4.57% Castro::clean_state() 233 4.572 4.572 4.572 4.51% Castro::initialize_advance() 25 4.532 4.532 4.532 4.47% Castro::expand_state() 30 4.409 4.409 4.409 4.34% Castro::finalize_advance() 25 4.233 4.233 4.233 4.17% Castro::FluxRegFineAdd() 25 4.225 4.225 4.225 4.16% FabArray::ParallelCopy() 1250 3.949 3.949 3.949 3.89% FabArray::ParallelCopy_nowait() 1250 3.948 3.948 3.948 3.89% Castro::post_timestep() 25 2.883 2.883 2.883 2.84% Castro::computeTemp() 236 2.77 2.77 2.77 2.73% Castro::construct_old_source() 175 2.643 2.643 2.643 2.60% Castro::construct_old_diff_source() 25 2.314 2.314 2.314 2.28% Castro::reflux() 5 2.179 2.179 2.179 2.15% Castro::construct_new_gravity() 25 1.875 1.875 1.875 1.85% FabArray::setDomainBndry() 596 1.699 1.699 1.699 1.67% Castro::normalize_species() 233 1.669 1.669 1.669 1.64% Castro::reset_internal_energy(MultiFab) 236 1.455 1.455 1.455 1.43% Castro::construct_old_gravity() 25 1.417 1.417 1.417 1.40% Gravity::get_new_grav_vector() 27 1.404 1.404 1.404 1.38% Castro::derive() 144 1.229 1.229 1.229 1.21% Amr::regrid() 3 1.187 1.187 1.187 1.17% Gravity::get_old_grav_vector() 25 1.171 1.171 1.171 1.15% Amr::InitAmr() 1 1.107 1.107 1.107 1.09% Diffusion::applyop_mlmg() 95 1.086 1.086 1.086 1.07% MultiFab::Saxpy() 260 1.026 1.026 1.026 1.01% Castro::construct_new_gravity_source() 35 1.019 1.019 1.019 1.00% Castro::apply_source_to_state() 70 0.9402 0.9402 0.9402 0.93% Castro::init(old) 2 0.6905 0.6905 0.6905 0.68% Castro::construct_new_rotation_source() 35 0.6766 0.6766 0.6766 0.67% Castro::estTimeStep() 55 0.6167 0.6167 0.6167 0.61% Castro::Castro() 5 0.5603 0.5603 0.5603 0.55% StateDataPhysBCFunct::() 596 0.5307 0.5307 0.5307 0.52% Amr::initialInit() 1 0.5073 0.5073 0.5073 0.50% Amr::FinalizeInit() 1 0.4788 0.4788 0.4788 0.47% Amr::bldFineLevels() 1 0.4572 0.4572 0.4572 0.45% MLABecLaplacian::define() 95 0.3344 0.3344 0.3344 0.33% MLMG::apply() 95 0.2523 0.2523 0.2523 0.25% Castro::construct_old_gravity_source() 25 0.244 0.244 0.244 0.24% MLCellLinOp::defineBC() 95 0.1836 0.1836 0.1836 0.18% Castro::check_for_nan() 50 0.1827 0.1827 0.1827 0.18% MultiFab::contains_nan() 50 0.1826 0.1826 0.1826 0.18% BndryData::define() 95 0.1823 0.1823 0.1823 0.18% StateData::FillBoundary(geom) 4538 0.1517 0.1517 0.1517 0.15% Castro::enforce_min_density() 233 0.1465 0.1465 0.1465 0.14% MLCellLinOp::defineAuxData() 95 0.1369 0.1369 0.1369 0.13% FillPatchInterp(Fab) 130 0.1348 0.1348 0.1348 0.13% MLCellLinOp::solutionResidual() 95 0.1296 0.1296 0.1296 0.13% MLCellLinOp::apply() 95 0.1038 0.1038 0.1038 0.10% MLCellLinOp::setLevelBC() 95 0.1023 0.1023 0.1023 0.10% Castro::buildMetrics() 5 0.1015 0.1015 0.1015 0.10% Castro::post_regrid() 8 0.101 0.101 0.101 0.10% Castro::initData() 3 0.09809 0.09809 0.09809 0.10% Castro::computeNewDt() 6 0.09069 0.09069 0.09069 0.09% Castro::construct_old_rotation_source() 25 0.08457 0.08457 0.08457 0.08% MLABecLaplacian::Fapply() 95 0.07795 0.07795 0.07795 0.08% Castro::avgDown() 6 0.05388 0.05388 0.05388 0.05% Castro::avgDown(state_indx) 30 0.05387 0.05387 0.05387 0.05% amrex::average_down_w_geom 30 0.05385 0.05385 0.05385 0.05% amrex::average_down 30 0.05383 0.05383 0.05383 0.05% FluxRegister::Reflux() 30 0.0457 0.0457 0.0457 0.05% Amr::InitializeInit() 1 0.02847 0.02847 0.02847 0.03% Amr::defBaseLevel() 1 0.02846 0.02846 0.02846 0.03% MLCellLinOp::applyBC() 95 0.02579 0.02579 0.02579 0.03% MultiFab::Xpay() 95 0.02561 0.02561 0.02561 0.03% Castro::reset_internal_energy(Fab) 5812 0.02447 0.02447 0.02447 0.02% Castro::computeInitialDt() 2 0.02077 0.02077 0.02077 0.02% FabArray::mult() 95 0.01744 0.01744 0.01744 0.02% FabArray::FillBoundary() 145 0.0172 0.0172 0.0172 0.02% FillBoundary_nowait() 145 0.01712 0.01712 0.01712 0.02% Castro::initMFs() 5 0.01532 0.01532 0.01532 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 1140 0.01498 0.01498 0.01498 0.01% MLABecLaplacian::prepareForSolve() 95 0.01342 0.01342 0.01342 0.01% MLCellLinOp::prepareForSolve() 95 0.0132 0.0132 0.0132 0.01% MultiFab::min() 100 0.01291 0.01291 0.01291 0.01% FabArrayBase::getCPC() 2178 0.01228 0.01228 0.01228 0.01% FabArrayBase::CPC::define() 310 0.009843 0.009843 0.009843 0.01% Amr::grid_places() 4 0.008375 0.008375 0.008375 0.01% Castro::FluxRegCrseInit 25 0.006715 0.006715 0.006715 0.01% MultiFab::max() 50 0.006449 0.006449 0.006449 0.01% Castro::post_init() 2 0.005998 0.005998 0.005998 0.01% Castro::enforce_speed_limit() 233 0.00417 0.00417 0.00417 0.00% AmrMesh::MakeNewGrids() 4 0.003904 0.003904 0.003904 0.00% CellConservativeLinear::interp() 130 0.003273 0.003273 0.003273 0.00% Castro::enforce_consistent_e() 3 0.00144 0.00144 0.00144 0.00% Castro::errorEst() 4 0.001097 0.001097 0.001097 0.00% Castro::apply_tagging_restrictions() 4 0.0009488 0.0009488 0.0009488 0.00% Castro::create_source_corrector() 25 0.0008449 0.0008449 0.0008449 0.00% TagBoxArray::mapPRD 4 0.0006483 0.0006483 0.0006483 0.00% AmrLevel::AmrLevel(dm) 5 0.0006334 0.0006334 0.0006334 0.00% StateData::define() 25 0.0006018 0.0006018 0.0006018 0.00% Castro::swap_state_time_levels() 25 0.0005649 0.0005649 0.0005649 0.00% MLLinOp::define() 95 0.0004853 0.0004853 0.0004853 0.00% MLLinOp::defineGrids() 95 0.0003771 0.0003771 0.0003771 0.00% Castro::finalize_do_advance() 25 0.0003118 0.0003118 0.0003118 0.00% TagBoxArray::collate() 4 0.0002676 0.0002676 0.0002676 0.00% FabArrayBase::TheFPinfo() 130 0.0002482 0.0002482 0.0002482 0.00% Castro::build_fine_mask() 5 0.0002411 0.0002411 0.0002411 0.00% FabArrayBase::getFB() 145 0.0002183 0.0002183 0.0002183 0.00% OwnerMask() 4 0.0001663 0.0001663 0.0001663 0.00% Castro::apply_problem_tags() 4 0.0001435 0.0001435 0.0001435 0.00% AmrMesh-cluster 4 0.0001293 0.0001293 0.0001293 0.00% FabArrayBase::FB::FB() 3 0.0001072 0.0001072 0.0001072 0.00% ClusterList::intersect() 4 7.887e-05 7.887e-05 7.887e-05 0.00% MLABecLaplacian::averageDownCoeffs() 95 4.621e-05 4.621e-05 4.621e-05 0.00% Amr::writeSmallPlotFile() 1 4.56e-05 4.56e-05 4.56e-05 0.00% Gravity::swapTimeLevels() 25 2.359e-05 2.359e-05 2.359e-05 0.00% FPinfo::FPinfo() 3 2.359e-05 2.359e-05 2.359e-05 0.00% Castro::retry_advance_ctu() 25 2.344e-05 2.344e-05 2.344e-05 0.00% Amr::initSubcycle() 1 1.043e-05 1.043e-05 1.043e-05 0.00% BoxList::parallelComplementIn() 8 1.028e-05 1.028e-05 1.028e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.628e-06 8.628e-06 8.628e-06 0.00% BoxList::complementIn 8 5.168e-06 5.168e-06 5.168e-06 0.00% Gravity::set_mass_offset() 5 4.67e-06 4.67e-06 4.67e-06 0.00% DistributionMapping::Distribute() 2 1.876e-06 1.876e-06 1.876e-06 0.00% ClusterList::chop() 4 1.462e-06 1.462e-06 1.462e-06 0.00% -------------------------------------------------------------------------------------------- Total GPU global memory (MB): 12066 Free GPU global memory (MB): 3 [The Arena] space allocated (MB): 13334 [The Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 236 [The Pinned Arena] space used (MB): 0 AMReX (22.08-17-g8294c3afbcbb) finalized