Initializing CUDA... CUDA initialized with 1 GPU AMReX (22.07-13-g4b7e20057a3d) initialized Starting run at 08:39:17 UTC on 2022-07-26. Successfully read inputs file ... Castro git describe: 22.07-13-g4177c4b30 AMReX git describe: 22.07-13-g4b7e20057 Microphysics git describe: 22.07-15-ga4952214 reading extern runtime parameters ... Initializing rate table 7 Species: He4 C12 O16 Ne20 Mg24 Si28 Ni56 Successfully read inputs file ... base density = 2435870.811 199752737.7 base density = 1259960.404 1396785590 Castro::numpts_1d at level 0 is 164 Setting the gravity type to ConstantGrav Installing Diffusion level 0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 5.962924686e-07 ...estimated diffusion-limited timestep at level 0: 0.03400874767 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.962924686e-07 grid_places() time: 0.00085598 new finest: 1 Castro::numpts_1d at level 1 is 635 Installing Diffusion level 1 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.000677368 new finest: 1 Castro::numpts_1d at level 1 is 635 Installing Diffusion level 1 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 32 grids 8388608 cells 25 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 INITIAL GRIDS Level 0 2 grids 524288 cells 100 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 Level 1 32 grids 8388608 cells 25 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 PLOTFILE: file = flame_wave-3d_plt00000 Write plotfile time = 4.445000745 seconds ...estimated hydro-limited timestep at level 0: 5.956151822e-07 ...estimated diffusion-limited timestep at level 0: 0.03410590779 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.956151822e-07 ...estimated hydro-limited timestep at level 1: 1.463901697e-07 ...estimated diffusion-limited timestep at level 1: 0.001444905148 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.463901697e-07 [Level 0 step 1] ADVANCE with dt = 5.855606787e-08  Beginning subcycle 1 starting at time 0 with dt = 5.855606787e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.019460196 ... compute diffusive term at level 0 Castro::do_old_sources() time = 0.00635376 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.183445413 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.010071101 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.010535214 ...estimated hydro-limited timestep at level 0: 5.955565339e-07 ...estimated diffusion-limited timestep at level 0: 0.03422898903 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.955565339e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.970070898 [Level 0 step 1] Advanced 524288 cells [Level 1 step 1] ADVANCE with dt = 1.463901697e-08  Beginning subcycle 1 starting at time 0 with dt = 1.463901697e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.627148988 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.062630261 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.999939959 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.81481315 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.451582497 ...estimated hydro-limited timestep at level 1: 1.105911959e-07 ...estimated diffusion-limited timestep at level 1: 0.001442942058 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.105911959e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.015294337 [Level 1 step 1] Advanced 8388608 cells [Level 1 step 2] ADVANCE with dt = 1.463901697e-08  Beginning subcycle 1 starting at time 1.463901697e-08 with dt = 1.463901697e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 1.105911959e-07 ...estimated diffusion-limited timestep at level 1: 0.001442942058 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.105911959e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.621549691 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.127051765 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.757155944 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.57534475 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.469383618 ...estimated hydro-limited timestep at level 1: 1.088448009e-07 ...estimated diffusion-limited timestep at level 1: 0.00144166338 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.088448009e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.10376871 [Level 1 step 2] Advanced 8388608 cells [Level 1 step 3] ADVANCE with dt = 1.463901697e-08  Beginning subcycle 1 starting at time 2.927803394e-08 with dt = 1.463901697e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 1.088448009e-07 ...estimated diffusion-limited timestep at level 1: 0.00144166338 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.088448009e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.627056996 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.063792424 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.593769652 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.120155112 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.470118792 ...estimated hydro-limited timestep at level 1: 1.075653951e-07 ...estimated diffusion-limited timestep at level 1: 0.001441027508 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.075653951e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.916530176 [Level 1 step 3] Advanced 8388608 cells [Level 1 step 4] ADVANCE with dt = 1.463901697e-08  Beginning subcycle 1 starting at time 4.39170509e-08 with dt = 1.463901697e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 1.075653951e-07 ...estimated diffusion-limited timestep at level 1: 0.001441027508 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.075653951e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.619839477 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.706197859 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.488008626 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.473188555 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.430961412 ...estimated hydro-limited timestep at level 1: 1.062722315e-07 ...estimated diffusion-limited timestep at level 1: 0.001441017873 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.062722315e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.838631913 [Level 1 step 4] Advanced 8388608 cells ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.230043917 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.030396253 Castro::reflux() at level 0 : time = 0.568126724 [STEP 1] Coarse TimeStep time: 18.4665966 [STEP 1] FAB kilobyte spread across MPI nodes: [11388286 ... 11388286] STEP = 1 TIME = 5.855606787e-08 DT = 5.855606787e-08 ...estimated hydro-limited timestep at level 0: 5.956125921e-07 ...estimated diffusion-limited timestep at level 0: 0.03412422782 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.956125921e-07 ...estimated hydro-limited timestep at level 1: 1.062722315e-07 ...estimated diffusion-limited timestep at level 1: 0.001441017873 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.062722315e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 5.956125921e-07 ... but limiting to: 6.441167466e-08 = 1.1 * 5.855606787e-08 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 1.062722315e-07 ... but limiting to: 1.610291866e-08 = 1.1 * 1.463901697e-08 [Level 0 step 2] ADVANCE with dt = 6.441167466e-08  Beginning subcycle 1 starting at time 5.855606787e-08 with dt = 6.441167466e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.012831262 ... compute diffusive term at level 0 Castro::do_old_sources() time = 0.007413304 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.055440534 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.011255505 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.010593235 ...estimated hydro-limited timestep at level 0: 5.775611698e-07 ...estimated diffusion-limited timestep at level 0: 0.02495612599 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.775611698e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 3.910878942 [Level 0 step 2] Advanced 524288 cells [Level 1 step 5] ADVANCE with dt = 1.610291866e-08  Beginning subcycle 1 starting at time 5.855606787e-08 with dt = 1.610291866e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.622350629 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.077385674 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.867186337 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.157214017 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.461796552 ...estimated hydro-limited timestep at level 1: 1.04291752e-07 ...estimated diffusion-limited timestep at level 1: 0.001441678669 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.04291752e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.96900788 [Level 1 step 5] Advanced 8388608 cells [Level 1 step 6] ADVANCE with dt = 1.610291866e-08  Beginning subcycle 1 starting at time 7.465898654e-08 with dt = 1.610291866e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 1.04291752e-07 ...estimated diffusion-limited timestep at level 1: 0.001441678669 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.04291752e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.624697509 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.751700828 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.493103969 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.463057711 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.429813204 ...estimated hydro-limited timestep at level 1: 1.029901919e-07 ...estimated diffusion-limited timestep at level 1: 0.001443031491 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.029901919e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.82078346 [Level 1 step 6] Advanced 8388608 cells [Level 1 step 7] ADVANCE with dt = 1.610291866e-08  Beginning subcycle 1 starting at time 9.07619052e-08 with dt = 1.610291866e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 1.029901919e-07 ...estimated diffusion-limited timestep at level 1: 0.001443031491 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.029901919e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.626480122 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.067743514 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.863789175 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.160138025 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.466060601 ...estimated hydro-limited timestep at level 1: 1.020593119e-07 ...estimated diffusion-limited timestep at level 1: 0.001412972282 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.020593119e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.921975665 [Level 1 step 7] Advanced 8388608 cells [Level 1 step 8] ADVANCE with dt = 1.610291866e-08  Beginning subcycle 1 starting at time 1.068648239e-07 with dt = 1.610291866e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 1.020593119e-07 ...estimated diffusion-limited timestep at level 1: 0.001412972282 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.020593119e-07 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.625526812 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.746913846 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.433700991 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.457366171 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.429607962 ...estimated hydro-limited timestep at level 1: 1.007917421e-07 ...estimated diffusion-limited timestep at level 1: 0.001417864623 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.007917421e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.833847915 [Level 1 step 8] Advanced 8388608 cells ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.19888345 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.030390806 Castro::reflux() at level 0 : time = 0.415545104 [STEP 2] Coarse TimeStep time: 18.42628079 [STEP 2] FAB kilobyte spread across MPI nodes: [11388286 ... 11388286] STEP = 2 TIME = 1.229677425e-07 DT = 6.441167466e-08 ...estimated hydro-limited timestep at level 0: 5.956095787e-07 ...estimated diffusion-limited timestep at level 0: 0.0342002105 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.956095787e-07 ...estimated hydro-limited timestep at level 1: 1.007917421e-07 ...estimated diffusion-limited timestep at level 1: 0.001417864623 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.007917421e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 5.956095787e-07 ... but limiting to: 7.085284213e-08 = 1.1 * 6.441167466e-08 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 1.007917421e-07 ... but limiting to: 1.771321053e-08 = 1.1 * 1.610291866e-08 Now regridding at level lbase = 0 grid_places() time: 0.000686171 new finest: 1 Castro::numpts_1d at level 1 is 635 Installing Diffusion level 1 STEP = 2 TIME = 1.229677425e-07 : REGRID with lbase = 0 Level 1 32 grids 8388608 cells 25 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 ...estimated hydro-limited timestep at level 0: 5.956095787e-07 ...estimated diffusion-limited timestep at level 0: 0.0342002105 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.956095787e-07 ...estimated hydro-limited timestep at level 1: 1.007917421e-07 ...estimated diffusion-limited timestep at level 1: 0.001417864623 Castro::estTimeStep (hydro-limited) at level 1: estdt = 1.007917421e-07 [Level 0 step 3] ADVANCE with dt = 7.085284213e-08  Beginning subcycle 1 starting at time 1.229677425e-07 with dt = 7.085284213e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.013116826 ... compute diffusive term at level 0 Castro::do_old_sources() time = 0.009000279 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.06250561 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.014133175 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.010895332 ...estimated hydro-limited timestep at level 0: 5.548608925e-07 ...estimated diffusion-limited timestep at level 0: 0.0251050223 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.548608925e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.045998913 [Level 0 step 3] Advanced 524288 cells [Level 1 step 9] ADVANCE with dt = 1.771321053e-08  Beginning subcycle 1 starting at time 1.229677425e-07 with dt = 1.771321053e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.628529776 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.139632554 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.46535478 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.194045993 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.440723383 ...estimated hydro-limited timestep at level 1: 9.946434489e-08 ...estimated diffusion-limited timestep at level 1: 0.001423573546 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.946434489e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.294118784 [Level 1 step 9] Advanced 8388608 cells [Level 1 step 10] ADVANCE with dt = 1.771321053e-08  Beginning subcycle 1 starting at time 1.406809531e-07 with dt = 1.771321053e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 9.946434489e-08 ...estimated diffusion-limited timestep at level 1: 0.001423573546 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.946434489e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.618685267 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.219766229 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.217329283 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.584491335 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.466268575 ...estimated hydro-limited timestep at level 1: 9.833722462e-08 ...estimated diffusion-limited timestep at level 1: 0.001429585926 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.833722462e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.853324468 [Level 1 step 10] Advanced 8388608 cells [Level 1 step 11] ADVANCE with dt = 1.771321053e-08  Beginning subcycle 1 starting at time 1.583941636e-07 with dt = 1.771321053e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 9.833722462e-08 ...estimated diffusion-limited timestep at level 1: 0.001429585926 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.833722462e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.62648679 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.080932172 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.516217391 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.253214442 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.442651658 ...estimated hydro-limited timestep at level 1: 9.739475519e-08 ...estimated diffusion-limited timestep at level 1: 0.001435878378 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.739475519e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.172225218 [Level 1 step 11] Advanced 8388608 cells [Level 1 step 12] ADVANCE with dt = 1.771321053e-08  Beginning subcycle 1 starting at time 1.761073741e-07 with dt = 1.771321053e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 9.739475519e-08 ...estimated diffusion-limited timestep at level 1: 0.001435878378 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.739475519e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.614886676 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.276448718 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.317363596 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.563150626 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.463551004 ...estimated hydro-limited timestep at level 1: 9.661827205e-08 ...estimated diffusion-limited timestep at level 1: 0.001442426424 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.661827205e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.758477869 [Level 1 step 12] Advanced 8388608 cells ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.223644665 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.03272347 Castro::reflux() at level 0 : time = 0.371816321 [STEP 3] Coarse TimeStep time: 17.88576358 [STEP 3] FAB kilobyte spread across MPI nodes: [11951674 ... 11951674] STEP = 3 TIME = 1.938205847e-07 DT = 7.085284213e-08 ...estimated hydro-limited timestep at level 0: 5.691818737e-07 ...estimated diffusion-limited timestep at level 0: 0.03433354803 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.691818737e-07 ...estimated hydro-limited timestep at level 1: 9.661827205e-08 ...estimated diffusion-limited timestep at level 1: 0.001442426424 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.661827205e-08 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 5.691818737e-07 ... but limiting to: 7.793812634e-08 = 1.1 * 7.085284213e-08 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 9.661827205e-08 ... but limiting to: 1.948453158e-08 = 1.1 * 1.771321053e-08 [Level 0 step 4] ADVANCE with dt = 7.793812634e-08  Beginning subcycle 1 starting at time 1.938205847e-07 with dt = 7.793812634e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.013474856 ... compute diffusive term at level 0 Castro::do_old_sources() time = 0.006654177 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.048487272 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.015008886 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.010889713 ...estimated hydro-limited timestep at level 0: 5.352544053e-07 ...estimated diffusion-limited timestep at level 0: 0.02510680508 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.352544053e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.432866476 [Level 0 step 4] Advanced 524288 cells [Level 1 step 13] ADVANCE with dt = 1.948453158e-08  Beginning subcycle 1 starting at time 1.938205847e-07 with dt = 1.948453158e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.621604865 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.074977638 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.483282534 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.252750988 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.435519778 ...estimated hydro-limited timestep at level 1: 9.596779956e-08 ...estimated diffusion-limited timestep at level 1: 0.00144991653 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.596779956e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.241191348 [Level 1 step 13] Advanced 8388608 cells [Level 1 step 14] ADVANCE with dt = 1.948453158e-08  Beginning subcycle 1 starting at time 2.133051162e-07 with dt = 1.948453158e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 9.596779956e-08 ...estimated diffusion-limited timestep at level 1: 0.00144991653 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.596779956e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.615460409 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.366213695 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.036609429 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.284456475 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.460594792 ...estimated hydro-limited timestep at level 1: 9.452287775e-08 ...estimated diffusion-limited timestep at level 1: 0.001457655536 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.452287775e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.062078767 [Level 1 step 14] Advanced 8388608 cells [Level 1 step 15] ADVANCE with dt = 1.948453158e-08  Beginning subcycle 1 starting at time 2.327896478e-07 with dt = 1.948453158e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 9.452287775e-08 ...estimated diffusion-limited timestep at level 1: 0.001457655536 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.452287775e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.624048392 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.062640242 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.300669105 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.226400199 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.437169923 ...estimated hydro-limited timestep at level 1: 9.194135814e-08 ...estimated diffusion-limited timestep at level 1: 0.001465621248 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.194135814e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.436742462 [Level 1 step 15] Advanced 8388608 cells [Level 1 step 16] ADVANCE with dt = 1.948453158e-08  Beginning subcycle 1 starting at time 2.522741794e-07 with dt = 1.948453158e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 9.194135814e-08 ...estimated diffusion-limited timestep at level 1: 0.001465621248 Castro::estTimeStep (hydro-limited) at level 1: estdt = 9.194135814e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.611413461 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.586678212 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.007023287 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.274482021 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.4677624 ...estimated hydro-limited timestep at level 1: 8.980934715e-08 ...estimated diffusion-limited timestep at level 1: 0.001473788583 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.980934715e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.063849782 [Level 1 step 16] Advanced 8388608 cells ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.20240134 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.021062462 Castro::reflux() at level 0 : time = 0.319505027 [STEP 4] Coarse TimeStep time: 15.82155714 [STEP 4] FAB kilobyte spread across MPI nodes: [11951674 ... 11951674] STEP = 4 TIME = 2.71758711e-07 DT = 7.793812634e-08 ...estimated hydro-limited timestep at level 0: 5.321820281e-07 ...estimated diffusion-limited timestep at level 0: 0.03454094543 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.321820281e-07 ...estimated hydro-limited timestep at level 1: 8.980934715e-08 ...estimated diffusion-limited timestep at level 1: 0.001473788583 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.980934715e-08 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 5.321820281e-07 ... but limiting to: 8.573193897e-08 = 1.1 * 7.793812634e-08 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 8.980934715e-08 ... but limiting to: 2.143298474e-08 = 1.1 * 1.948453158e-08 Now regridding at level lbase = 0 grid_places() time: 0.000678993 new finest: 1 Castro::numpts_1d at level 1 is 635 Installing Diffusion level 1 STEP = 4 TIME = 2.71758711e-07 : REGRID with lbase = 0 Level 1 32 grids 8388608 cells 25 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 ...estimated hydro-limited timestep at level 0: 5.321820281e-07 ...estimated diffusion-limited timestep at level 0: 0.03454094543 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.321820281e-07 ...estimated hydro-limited timestep at level 1: 8.980934715e-08 ...estimated diffusion-limited timestep at level 1: 0.001473788583 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.980934715e-08 [Level 0 step 5] ADVANCE with dt = 8.573193897e-08  Beginning subcycle 1 starting at time 2.71758711e-07 with dt = 8.573193897e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.012956934 ... compute diffusive term at level 0 Castro::do_old_sources() time = 0.008607718 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.048600552 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.013990961 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.009756682 ...estimated hydro-limited timestep at level 0: 5.189796522e-07 ...estimated diffusion-limited timestep at level 0: 0.02532684875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 5.189796522e-07  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 4.706504614 [Level 0 step 5] Advanced 524288 cells [Level 1 step 17] ADVANCE with dt = 2.143298474e-08  Beginning subcycle 1 starting at time 2.71758711e-07 with dt = 2.143298474e-08 Estimated number of subcycles remaining: 1 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.631816702 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.172116845 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.962524615 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.406992145 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.462895262 ...estimated hydro-limited timestep at level 1: 8.78491966e-08 ...estimated diffusion-limited timestep at level 1: 0.001483009535 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.78491966e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.474128232 [Level 1 step 17] Advanced 8388608 cells [Level 1 step 18] ADVANCE with dt = 2.143298474e-08  Beginning subcycle 1 starting at time 2.931916957e-07 with dt = 2.143298474e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 8.78491966e-08 ...estimated diffusion-limited timestep at level 1: 0.001483009535 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.78491966e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.605770377 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.267224713 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.806426154 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.475866019 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.45781888 ...estimated hydro-limited timestep at level 1: 8.655410317e-08 ...estimated diffusion-limited timestep at level 1: 0.001471170931 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.655410317e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.652943322 [Level 1 step 18] Advanced 8388608 cells [Level 1 step 19] ADVANCE with dt = 2.143298474e-08  Beginning subcycle 1 starting at time 3.146246805e-07 with dt = 2.143298474e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 8.655410317e-08 ...estimated diffusion-limited timestep at level 1: 0.001471170931 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.655410317e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.620358444 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.373173519 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.381375231 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.344823648 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.462936363 ...estimated hydro-limited timestep at level 1: 8.564324989e-08 ...estimated diffusion-limited timestep at level 1: 0.001378651818 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.564324989e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.124917291 [Level 1 step 19] Advanced 8388608 cells [Level 1 step 20] ADVANCE with dt = 2.143298474e-08  Beginning subcycle 1 starting at time 3.360576652e-07 with dt = 2.143298474e-08 Estimated number of subcycles remaining: 1 ...estimated hydro-limited timestep at level 1: 8.564324989e-08 ...estimated diffusion-limited timestep at level 1: 0.001378651818 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.564324989e-08 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.621038506 ... compute diffusive term at level 1 Castro::do_old_sources() time = 0.498874559 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.705272225 ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.175701574 ... Entering burner and doing half-timestep of burning. ... Leaving burner after completing half-timestep of burning. Castro::react_state() time = 0.466402246 ...estimated hydro-limited timestep at level 1: 8.50375645e-08 ...estimated diffusion-limited timestep at level 1: 0.001396857724 Castro::estTimeStep (hydro-limited) at level 1: estdt = 8.50375645e-08  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 2.036347858 [Level 1 step 20] Advanced 8388608 cells ... compute diffusive term at level 1 ... compute diffusive term at level 1 Castro::do_new_sources() time = 0.524431434 ... compute diffusive term at level 0 ... compute diffusive term at level 0 Castro::do_new_sources() time = 0.030612463 Castro::reflux() at level 0 : time = 0.672086238 [STEP 5] Coarse TimeStep time: 16.0193705 [STEP 5] FAB kilobyte spread across MPI nodes: [11951674 ... 11951674] STEP = 5 TIME = 3.5749065e-07 DT = 8.573193897e-08 PLOTFILE: file = flame_wave-3d_plt00005 Write plotfile time = 6.401598124 seconds Ending run at 08:40:56 UTC on 2022-07-26. Run time = 99.05641421 Run time without initialization = 93.02214165 Average number of zones advanced per microsecond: 1.832 Average number of zones advanced per microsecond per rank: 1.832 CPU(0): Heap Space (bytes) used by Coalescing FAB Arena: 13984017280 TinyProfiler total time across processes [min...avg...max]: 99.06 ... 99.06 ... 99.06 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 25 28.0948 28.0948 28.0948 28.36% Castro::react_state() 50 21.61 21.61 21.61 21.82% FabArray::setVal() 802 8.688 8.688 8.688 8.77% VisMF::Write(FabArray) 4 8.495 8.495 8.495 8.58% Castro::FluxRegFineAdd() 25 3.605 3.605 3.605 3.64% FabArray::ParallelCopy_nowait() 1250 3.463 3.463 3.463 3.50% Castro::expand_state() 30 2.828 2.828 2.828 2.85% Castro::getTempDiffusionTerm() 95 1.953 1.953 1.953 1.97% Castro::do_advance_ctu() 25 1.873 1.873 1.873 1.89% Castro::normalize_species() 233 1.767 1.767 1.767 1.78% Castro::reset_internal_energy(MultiFab) 236 1.641 1.641 1.641 1.66% FabArray::setDomainBndry() 596 1.449 1.449 1.449 1.46% Castro::computeTemp() 236 1.372 1.372 1.372 1.38% Gravity::get_new_grav_vector() 27 1.348 1.348 1.348 1.36% Castro::construct_new_gravity_source() 35 1.231 1.231 1.231 1.24% MultiFab::Saxpy() 260 1.147 1.147 1.147 1.16% Amr::InitAmr() 1 1.093 1.093 1.093 1.10% Amr::writePlotFile() 2 1.075 1.075 1.075 1.09% FillPatchSingleLevel 596 0.7794 0.7794 0.7794 0.79% Castro::construct_new_rotation_source() 35 0.7705 0.7705 0.7705 0.78% Castro::derive() 144 0.6871 0.6871 0.6871 0.69% Castro::estTimeStep() 55 0.6012 0.6012 0.6012 0.61% StateDataPhysBCFunct::() 596 0.4266 0.4266 0.4266 0.43% Castro::reflux() 5 0.3658 0.3658 0.3658 0.37% Diffusion::applyop_mlmg() 95 0.3515 0.3515 0.3515 0.35% Gravity::get_old_grav_vector() 25 0.2653 0.2653 0.2653 0.27% StateData::FillBoundary(geom) 4538 0.2243 0.2243 0.2243 0.23% Castro::enforce_min_density() 233 0.1846 0.1846 0.1846 0.19% BndryData::define() 95 0.1798 0.1798 0.1798 0.18% Castro::construct_old_gravity_source() 25 0.1681 0.1681 0.1681 0.17% MultiFab::contains_nan() 50 0.1587 0.1587 0.1587 0.16% MLCellLinOp::defineAuxData() 95 0.138 0.138 0.138 0.14% Castro::init(old) 2 0.1152 0.1152 0.1152 0.12% Castro::construct_new_source() 245 0.1105 0.1105 0.1105 0.11% FillPatchInterp(Fab) 130 0.1075 0.1075 0.1075 0.11% MLABecLaplacian::Fapply() 95 0.1007 0.1007 0.1007 0.10% MLCellLinOp::setLevelBC() 95 0.09049 0.09049 0.09049 0.09% amrex::average_down 30 0.08946 0.08946 0.08946 0.09% Castro::construct_old_rotation_source() 25 0.08915 0.08915 0.08915 0.09% Castro::initData() 3 0.04798 0.04798 0.04798 0.05% FluxRegister::Reflux() 30 0.03457 0.03457 0.03457 0.03% MultiFab::Xpay() 95 0.0256 0.0256 0.0256 0.03% Castro::reset_internal_energy(Fab) 5812 0.02285 0.02285 0.02285 0.02% FabArray::mult() 95 0.0173 0.0173 0.0173 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 1140 0.01513 0.01513 0.01513 0.02% MLCellLinOp::prepareForSolve() 95 0.01457 0.01457 0.01457 0.01% FillPatchIterator::Initialize 466 0.01388 0.01388 0.01388 0.01% FillBoundary_nowait() 145 0.01303 0.01303 0.01303 0.01% Castro::initMFs() 5 0.01303 0.01303 0.01303 0.01% MLABecLaplacian::define() 95 0.01292 0.01292 0.01292 0.01% MultiFab::min() 100 0.0128 0.0128 0.0128 0.01% FabArrayBase::CPC::define() 310 0.009617 0.009617 0.009617 0.01% MLCellLinOp::applyBC() 95 0.009418 0.009418 0.009418 0.01% MultiFab::max() 50 0.00642 0.00642 0.00642 0.01% MLMG::apply() 95 0.00464 0.00464 0.00464 0.00% Castro::enforce_speed_limit() 233 0.004549 0.004549 0.004549 0.00% Castro::FluxRegCrseInit 25 0.00385 0.00385 0.00385 0.00% FillPatchTwoLevels 238 0.003819 0.003819 0.003819 0.00% CellConservativeLinear::interp() 130 0.003265 0.003265 0.003265 0.00% FabArrayBase::getCPC() 2178 0.002433 0.002433 0.002433 0.00% Castro::add_temp_diffusion_to_sources() 95 0.002282 0.002282 0.002282 0.00% Castro::build_fine_mask() 5 0.002012 0.002012 0.002012 0.00% Castro::enforce_consistent_e() 3 0.001441 0.001441 0.001441 0.00% AmrMesh::MakeNewGrids() 4 0.001435 0.001435 0.001435 0.00% Castro::initialize_do_advance() 25 0.001324 0.001324 0.001324 0.00% Castro::finalize_advance() 25 0.001237 0.001237 0.001237 0.00% Castro::initialize_advance() 25 0.001233 0.001233 0.001233 0.00% MLCellLinOp::defineBC() 95 0.00117 0.00117 0.00117 0.00% Castro::construct_new_diff_source() 35 0.00104 0.00104 0.00104 0.00% Castro::subcycle_advance_ctu() 25 0.001009 0.001009 0.001009 0.00% Castro::create_source_corrector() 25 0.0008324 0.0008324 0.0008324 0.00% Amr::regrid() 3 0.0008024 0.0008024 0.0008024 0.00% Castro::construct_old_diff_source() 25 0.0007703 0.0007703 0.0007703 0.00% main() 1 0.0007166 0.0007166 0.0007166 0.00% Castro::construct_old_source() 175 0.0005958 0.0005958 0.0005958 0.00% StateData::define() 25 0.000588 0.000588 0.000588 0.00% Castro::swap_state_time_levels() 25 0.0005528 0.0005528 0.0005528 0.00% Castro::advance() 25 0.0005496 0.0005496 0.0005496 0.00% FabArray::ParallelCopy() 1250 0.0005439 0.0005439 0.0005439 0.00% Castro::buildMetrics() 5 0.0005079 0.0005079 0.0005079 0.00% Castro::clean_state() 233 0.000434 0.000434 0.000434 0.00% Amr::timeStep() 25 0.0003674 0.0003674 0.0003674 0.00% Castro::do_new_sources() 35 0.0003597 0.0003597 0.0003597 0.00% Castro::Castro() 5 0.0003441 0.0003441 0.0003441 0.00% MLLinOp::defineGrids() 95 0.0003335 0.0003335 0.0003335 0.00% Amr::coarseTimeStep() 5 0.0003204 0.0003204 0.0003204 0.00% Castro::finalize_do_advance() 25 0.0003133 0.0003133 0.0003133 0.00% TagBoxArray::collate() 4 0.0002686 0.0002686 0.0002686 0.00% Castro::do_old_sources() 25 0.0002561 0.0002561 0.0002561 0.00% TagBoxArray::mapPRD 4 0.0001984 0.0001984 0.0001984 0.00% FabArrayBase::TheFPinfo() 130 0.0001784 0.0001784 0.0001784 0.00% OwnerMask() 4 0.0001734 0.0001734 0.0001734 0.00% MLABecLaplacian::prepareForSolve() 95 0.0001395 0.0001395 0.0001395 0.00% Castro::post_timestep() 25 0.0001304 0.0001304 0.0001304 0.00% Castro::apply_problem_tags() 4 0.000128 0.000128 0.000128 0.00% MLLinOp::define() 95 0.0001141 0.0001141 0.0001141 0.00% FabArrayBase::FB::FB() 3 0.000107 0.000107 0.000107 0.00% FabArrayBase::getFB() 145 9.81e-05 9.81e-05 9.81e-05 0.00% MLCellLinOp::solutionResidual() 95 9.759e-05 9.759e-05 9.759e-05 0.00% Castro::apply_tagging_restrictions() 4 9.151e-05 9.151e-05 9.151e-05 0.00% MLCellLinOp::apply() 95 8.826e-05 8.826e-05 8.826e-05 0.00% ClusterList::intersect() 4 8.275e-05 8.275e-05 8.275e-05 0.00% Castro::construct_new_gravity() 25 7.807e-05 7.807e-05 7.807e-05 0.00% FabArray::FillBoundary() 145 7.306e-05 7.306e-05 7.306e-05 0.00% Castro::computeNewDt() 6 6.888e-05 6.888e-05 6.888e-05 0.00% Amr::grid_places() 4 6.401e-05 6.401e-05 6.401e-05 0.00% Castro::apply_source_to_state() 70 5.992e-05 5.992e-05 5.992e-05 0.00% Castro::construct_old_gravity() 25 5.664e-05 5.664e-05 5.664e-05 0.00% Castro::check_for_nan() 50 5.321e-05 5.321e-05 5.321e-05 0.00% AmrMesh-cluster 4 4.854e-05 4.854e-05 4.854e-05 0.00% Amr::writeSmallPlotFile() 1 4.49e-05 4.49e-05 4.49e-05 0.00% MLABecLaplacian::averageDownCoeffs() 95 4.285e-05 4.285e-05 4.285e-05 0.00% FPinfo::FPinfo() 3 3.324e-05 3.324e-05 3.324e-05 0.00% AmrLevel::AmrLevel(dm) 5 2.922e-05 2.922e-05 2.922e-05 0.00% Castro::avgDown(state_indx) 30 2.584e-05 2.584e-05 2.584e-05 0.00% Amr::bldFineLevels() 1 1.98e-05 1.98e-05 1.98e-05 0.00% Gravity::swapTimeLevels() 25 1.966e-05 1.966e-05 1.966e-05 0.00% amrex::average_down_w_geom 30 1.952e-05 1.952e-05 1.952e-05 0.00% Castro::retry_advance_ctu() 25 1.943e-05 1.943e-05 1.943e-05 0.00% BoxList::complementIn 8 1.866e-05 1.866e-05 1.866e-05 0.00% Amr::defBaseLevel() 1 1.853e-05 1.853e-05 1.853e-05 0.00% Amr::FinalizeInit() 1 1.636e-05 1.636e-05 1.636e-05 0.00% Amr::initSubcycle() 1 1.145e-05 1.145e-05 1.145e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.674e-06 8.674e-06 8.674e-06 0.00% Amr::InitializeInit() 1 7.813e-06 7.813e-06 7.813e-06 0.00% Castro::post_regrid() 8 7.762e-06 7.762e-06 7.762e-06 0.00% Castro::avgDown() 6 7.024e-06 7.024e-06 7.024e-06 0.00% Castro::computeInitialDt() 2 5.566e-06 5.566e-06 5.566e-06 0.00% Amr::init() 1 4.158e-06 4.158e-06 4.158e-06 0.00% BoxList::parallelComplementIn() 8 3.356e-06 3.356e-06 3.356e-06 0.00% Gravity::set_mass_offset() 5 3.337e-06 3.337e-06 3.337e-06 0.00% Castro::post_init() 2 3.167e-06 3.167e-06 3.167e-06 0.00% Castro::errorEst() 4 3.099e-06 3.099e-06 3.099e-06 0.00% DistributionMapping::Distribute() 2 2.248e-06 2.248e-06 2.248e-06 0.00% ClusterList::chop() 4 1.407e-06 1.407e-06 1.407e-06 0.00% Amr::initialInit() 1 1.06e-06 1.06e-06 1.06e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 99.06 99.06 99.06 100.00% Amr::coarseTimeStep() 5 86.62 86.62 86.62 87.44% Amr::timeStep() 25 86.54 86.54 86.54 87.37% Castro::advance() 25 82.41 82.41 82.41 83.19% Castro::subcycle_advance_ctu() 25 74.55 74.55 74.55 75.27% Castro::do_advance_ctu() 25 74.55 74.55 74.55 75.26% Castro::construct_ctu_hydro_source() 25 28.09 28.09 28.09 28.36% Castro::react_state() 50 21.63 21.63 21.63 21.84% Amr::writePlotFile() 2 10.85 10.85 10.85 10.95% Castro::do_new_sources() 35 8.847 8.847 8.847 8.93% FabArray::setVal() 802 8.688 8.688 8.688 8.77% VisMF::Write(FabArray) 4 8.495 8.495 8.495 8.58% Castro::add_temp_diffusion_to_sources() 95 6.792 6.792 6.792 6.86% Castro::construct_new_source() 245 6.682 6.682 6.682 6.75% Castro::getTempDiffusionTerm() 95 6.627 6.627 6.627 6.69% FillPatchIterator::Initialize 466 6.46 6.46 6.46 6.52% Castro::do_old_sources() 25 5.76 5.76 5.76 5.82% Castro::clean_state() 233 4.974 4.974 4.974 5.02% Amr::init() 1 4.941 4.941 4.941 4.99% FillPatchTwoLevels 238 4.895 4.895 4.895 4.94% FillPatchSingleLevel 596 4.776 4.776 4.776 4.82% Castro::construct_new_diff_source() 35 4.57 4.57 4.57 4.61% Castro::initialize_do_advance() 25 4.478 4.478 4.478 4.52% Castro::initialize_advance() 25 4.241 4.241 4.241 4.28% Castro::expand_state() 30 4.022 4.022 4.022 4.06% Castro::finalize_advance() 25 3.612 3.612 3.612 3.65% Castro::FluxRegFineAdd() 25 3.605 3.605 3.605 3.64% FabArray::ParallelCopy() 1250 3.474 3.474 3.474 3.51% FabArray::ParallelCopy_nowait() 1250 3.474 3.474 3.474 3.51% Castro::post_timestep() 25 3.263 3.263 3.263 3.29% Castro::computeTemp() 236 3.036 3.036 3.036 3.06% Castro::construct_old_source() 175 2.481 2.481 2.481 2.51% Castro::reflux() 5 2.347 2.347 2.347 2.37% Castro::construct_old_diff_source() 25 2.224 2.224 2.224 2.24% Castro::construct_new_gravity() 25 1.843 1.843 1.843 1.86% Castro::normalize_species() 233 1.767 1.767 1.767 1.78% Castro::reset_internal_energy(MultiFab) 236 1.664 1.664 1.664 1.68% FabArray::setDomainBndry() 596 1.449 1.449 1.449 1.46% Gravity::get_new_grav_vector() 27 1.383 1.383 1.383 1.40% Castro::derive() 144 1.277 1.277 1.277 1.29% Castro::construct_new_gravity_source() 35 1.231 1.231 1.231 1.24% MultiFab::Saxpy() 260 1.147 1.147 1.147 1.16% Amr::InitAmr() 1 1.093 1.093 1.093 1.10% Diffusion::applyop_mlmg() 95 1.088 1.088 1.088 1.10% Amr::regrid() 3 1.056 1.056 1.056 1.07% Castro::apply_source_to_state() 70 1.017 1.017 1.017 1.03% Castro::construct_old_gravity() 25 0.8701 0.8701 0.8701 0.88% Castro::construct_new_rotation_source() 35 0.7705 0.7705 0.7705 0.78% Gravity::get_old_grav_vector() 25 0.7391 0.7391 0.7391 0.75% StateDataPhysBCFunct::() 596 0.6508 0.6508 0.6508 0.66% Castro::init(old) 2 0.6025 0.6025 0.6025 0.61% Castro::estTimeStep() 55 0.6012 0.6012 0.6012 0.61% Castro::Castro() 5 0.5283 0.5283 0.5283 0.53% Amr::initialInit() 1 0.496 0.496 0.496 0.50% Amr::FinalizeInit() 1 0.4669 0.4669 0.4669 0.47% Amr::bldFineLevels() 1 0.4454 0.4454 0.4454 0.45% MLABecLaplacian::define() 95 0.349 0.349 0.349 0.35% MLMG::apply() 95 0.268 0.268 0.268 0.27% StateData::FillBoundary(geom) 4538 0.2243 0.2243 0.2243 0.23% MLCellLinOp::defineBC() 95 0.1902 0.1902 0.1902 0.19% BndryData::define() 95 0.189 0.189 0.189 0.19% Castro::enforce_min_density() 233 0.1846 0.1846 0.1846 0.19% Castro::construct_old_gravity_source() 25 0.1681 0.1681 0.1681 0.17% Castro::check_for_nan() 50 0.1588 0.1588 0.1588 0.16% MultiFab::contains_nan() 50 0.1587 0.1587 0.1587 0.16% MLCellLinOp::solutionResidual() 95 0.148 0.148 0.148 0.15% MLCellLinOp::defineAuxData() 95 0.1454 0.1454 0.1454 0.15% MLCellLinOp::apply() 95 0.1223 0.1223 0.1223 0.12% FillPatchInterp(Fab) 130 0.1108 0.1108 0.1108 0.11% MLABecLaplacian::Fapply() 95 0.1007 0.1007 0.1007 0.10% Castro::avgDown() 6 0.09976 0.09976 0.09976 0.10% Castro::avgDown(state_indx) 30 0.09975 0.09975 0.09975 0.10% amrex::average_down_w_geom 30 0.09973 0.09973 0.09973 0.10% amrex::average_down 30 0.09971 0.09971 0.09971 0.10% Castro::initData() 3 0.09936 0.09936 0.09936 0.10% MLCellLinOp::setLevelBC() 95 0.09802 0.09802 0.09802 0.10% Castro::post_regrid() 8 0.09446 0.09446 0.09446 0.10% Castro::construct_old_rotation_source() 25 0.08915 0.08915 0.08915 0.09% Castro::computeNewDt() 6 0.08874 0.08874 0.08874 0.09% Castro::buildMetrics() 5 0.08683 0.08683 0.08683 0.09% FluxRegister::Reflux() 30 0.04473 0.04473 0.04473 0.05% Amr::InitializeInit() 1 0.02903 0.02903 0.02903 0.03% Amr::defBaseLevel() 1 0.02902 0.02902 0.02902 0.03% MultiFab::Xpay() 95 0.0256 0.0256 0.0256 0.03% Castro::reset_internal_energy(Fab) 5812 0.02285 0.02285 0.02285 0.02% MLCellLinOp::applyBC() 95 0.02155 0.02155 0.02155 0.02% Castro::computeInitialDt() 2 0.02012 0.02012 0.02012 0.02% FabArray::mult() 95 0.0173 0.0173 0.0173 0.02% FabArray::setVal(val, thecmd, scomp, ncomp) 1140 0.01513 0.01513 0.01513 0.02% MLABecLaplacian::prepareForSolve() 95 0.01475 0.01475 0.01475 0.01% MLCellLinOp::prepareForSolve() 95 0.01457 0.01457 0.01457 0.01% FabArray::FillBoundary() 145 0.01331 0.01331 0.01331 0.01% FillBoundary_nowait() 145 0.01324 0.01324 0.01324 0.01% Castro::initMFs() 5 0.01303 0.01303 0.01303 0.01% MultiFab::min() 100 0.0128 0.0128 0.0128 0.01% FabArrayBase::getCPC() 2178 0.01205 0.01205 0.01205 0.01% FabArrayBase::CPC::define() 310 0.009617 0.009617 0.009617 0.01% MultiFab::max() 50 0.00642 0.00642 0.00642 0.01% Castro::post_init() 2 0.006275 0.006275 0.006275 0.01% Castro::FluxRegCrseInit 25 0.006149 0.006149 0.006149 0.01% Castro::enforce_speed_limit() 233 0.004549 0.004549 0.004549 0.00% CellConservativeLinear::interp() 130 0.003265 0.003265 0.003265 0.00% Amr::grid_places() 4 0.002942 0.002942 0.002942 0.00% AmrMesh::MakeNewGrids() 4 0.002878 0.002878 0.002878 0.00% Castro::build_fine_mask() 5 0.002012 0.002012 0.002012 0.00% Castro::enforce_consistent_e() 3 0.001441 0.001441 0.001441 0.00% Castro::create_source_corrector() 25 0.0008324 0.0008324 0.0008324 0.00% TagBoxArray::mapPRD 4 0.0006311 0.0006311 0.0006311 0.00% AmrLevel::AmrLevel(dm) 5 0.0006173 0.0006173 0.0006173 0.00% StateData::define() 25 0.000588 0.000588 0.000588 0.00% Castro::swap_state_time_levels() 25 0.0005528 0.0005528 0.0005528 0.00% MLLinOp::define() 95 0.0004476 0.0004476 0.0004476 0.00% MLLinOp::defineGrids() 95 0.0003335 0.0003335 0.0003335 0.00% Castro::finalize_do_advance() 25 0.0003133 0.0003133 0.0003133 0.00% TagBoxArray::collate() 4 0.0002686 0.0002686 0.0002686 0.00% Castro::errorEst() 4 0.0002226 0.0002226 0.0002226 0.00% FabArrayBase::TheFPinfo() 130 0.0002116 0.0002116 0.0002116 0.00% FabArrayBase::getFB() 145 0.0002051 0.0002051 0.0002051 0.00% OwnerMask() 4 0.0001734 0.0001734 0.0001734 0.00% AmrMesh-cluster 4 0.0001327 0.0001327 0.0001327 0.00% Castro::apply_problem_tags() 4 0.000128 0.000128 0.000128 0.00% FabArrayBase::FB::FB() 3 0.000107 0.000107 0.000107 0.00% Castro::apply_tagging_restrictions() 4 9.151e-05 9.151e-05 9.151e-05 0.00% ClusterList::intersect() 4 8.275e-05 8.275e-05 8.275e-05 0.00% Amr::writeSmallPlotFile() 1 4.49e-05 4.49e-05 4.49e-05 0.00% MLABecLaplacian::averageDownCoeffs() 95 4.285e-05 4.285e-05 4.285e-05 0.00% FPinfo::FPinfo() 3 3.324e-05 3.324e-05 3.324e-05 0.00% BoxList::parallelComplementIn() 8 2.202e-05 2.202e-05 2.202e-05 0.00% Gravity::swapTimeLevels() 25 1.966e-05 1.966e-05 1.966e-05 0.00% Castro::retry_advance_ctu() 25 1.943e-05 1.943e-05 1.943e-05 0.00% BoxList::complementIn 8 1.866e-05 1.866e-05 1.866e-05 0.00% Amr::initSubcycle() 1 1.145e-05 1.145e-05 1.145e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 1.092e-05 1.092e-05 1.092e-05 0.00% Gravity::set_mass_offset() 5 3.337e-06 3.337e-06 3.337e-06 0.00% DistributionMapping::Distribute() 2 2.248e-06 2.248e-06 2.248e-06 0.00% ClusterList::chop() 4 1.407e-06 1.407e-06 1.407e-06 0.00% -------------------------------------------------------------------------------------------- Total GPU global memory (MB): 12066 Free GPU global memory (MB): 3 [The Arena] space allocated (MB): 13336 [The Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 236 [The Pinned Arena] space used (MB): 0 AMReX (22.07-13-g4b7e20057a3d) finalized