Initializing CUDA... CUDA initialized with 1 GPU AMReX (20.07-40-gcbbe896e9ab2) initialized Calling Setup() Calling ReadParameters() WARNING: burning_cutoff_density_lo not supplied in the inputs file WARNING: setting burning_cutoff_density_lo = base_cutoff_density reading extern runtime parameters ... Calling VariableSetup() Initializing Helmholtz EOS and using Coulomb corrections. Calling set_method_params() Calling BCSetup() Calling BaseStateGeometry::Init() Calling init_base_state_geometry() Calling Init() Calling InitData() initdata model_File = kepler_new_6.25e8.hybrid.hse.320 model file = kepler_new_6.25e8.hybrid.hse.320 reading initial model 320 points found in the initial model 6 variables found in the initial model model file mapping (spherical base state) dr of MAESTRO base state = 781250.000000 dr of input file data = 1562500.000000 maximum radius (cell-centered) of input model = 499218750.000000 setting r_cutoff to 239 radius at r_cutoff 187109375 Maximum HSE Error = 0.002311 (after putting initial model into base state arrays, and for density < base_cutoff_density) Writing plotfile wdconvect-amr_pltInitData after InitData inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.4377646 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Doing initial projection Calling nodal solver MLMG: Initial rhs = 185424520.7 MLMG: Initial residual (resid0) = 185424520.7 MLMG: Final Iter. 10 resid, resid/bnorm = 0.01339600945, 7.224508066e-11 MLMG: Timers: Solve = 1.941577404 Iter = 1.899206438 Bottom = 0.000738557 Done calling nodal solver Writing plotfile wdconvect-amr_pltafter_InitProj after InitProj inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.410562996 Call to firstdt for level 0 gives dt_lev = 0.005789678157 Multiplying dt_lev by init_shrink; dt_lev = 0.0005789678157 Call to firstdt for level 1 gives dt_lev = 0.002885721563 Multiplying dt_lev by init_shrink; dt_lev = 0.0002885721563 Minimum firstdt over all levels = 0.0002885721563 Doing initial divu iteration #1 Calling nodal solver MLMG: Initial rhs = 72482174.27 MLMG: Initial residual (resid0) = 72482174.27 MLMG: Final Iter. 2 resid, resid/bnorm = 0.5223139889, 7.206102661e-09 MLMG: Timers: Solve = 0.43485661 Iter = 0.394367481 Bottom = 0.000174405 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 1 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Doing initial divu iteration #2 Calling nodal solver MLMG: Initial rhs = 43334804.49 MLMG: Initial residual (resid0) = 43334804.49 MLMG: Final Iter. 2 resid, resid/bnorm = 0.02298274692, 5.303530774e-10 MLMG: Timers: Solve = 0.433197489 Iter = 0.392713571 Bottom = 0.000157774 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 2 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Doing initial divu iteration #3 Calling nodal solver MLMG: Initial rhs = 32768245.23 MLMG: Initial residual (resid0) = 32768245.23 MLMG: Final Iter. 3 resid, resid/bnorm = 0.001478955848, 4.513381286e-11 MLMG: Timers: Solve = 0.623023955 Iter = 0.582493585 Bottom = 0.000267879 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 3 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Writing plotfile wdconvect-amr_pltafter_DivuIter after final DivuIter inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.396417937 Doing initial pressure iteration #1 Timestep 0 starts with TIME = 0 DT = 0.0002885721563 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 224625388.6 MLMG: Initial residual (resid0) = 224625388.6 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02028143406, 9.029003436e-11 MLMG: Timers: Solve = 0.125208738 Iter = 0.115139825 Bottom = 0.008969423 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 224625389.4 MLMG: Initial residual (resid0) = 3940.279655 MLMG: Final Iter. 2 resid, resid/bnorm = 0.04907618412, 2.184801293e-10 MLMG: Timers: Solve = 0.042207874 Iter = 0.034402581 Bottom = 0.002551069 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 35718891.54 MLMG: Initial residual (resid0) = 35718891.54 MLMG: Final Iter. 31 resid, resid/bnorm = 0.003148806092, 8.815520182e-11 MLMG: Timers: Solve = 5.913954769 Iter = 5.870225561 Bottom = 0.002278669 Done calling nodal solver Timestep 0 ends with TIME = 0.0002885721563 DT = 0.0002885721563 Timing summary: Advection :1.737649715 seconds MAC Proj :0.283521845 seconds Nodal Proj :6.055154769 seconds Reactions :0.174342512 seconds Misc :0.069544546 seconds Base State :0.042117583 seconds Time to advance time step: 8.320708996 Writing plotfile 0 after all initialization inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.400814516 Calling Evolve() Timestep 1 starts with TIME = 0 DT = 0.0002885721563 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 224625175.9 MLMG: Initial residual (resid0) = 224625175.9 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02050752938, 9.129666473e-11 MLMG: Timers: Solve = 0.105549383 Iter = 0.097565493 Bottom = 0.007596208 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 224625175.8 MLMG: Initial residual (resid0) = 0.7033640931 MLMG: Final Iter. 1 resid, resid/bnorm = 0.04446259187, 1.979412669e-10 MLMG: Timers: Solve = 0.026539334 Iter = 0.018652861 Bottom = 0.001259459 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 25278219.2 MLMG: Initial residual (resid0) = 25278219.2 MLMG: Final Iter. 10 resid, resid/bnorm = 0.001846274594, 7.303815903e-11 MLMG: Timers: Solve = 1.958660456 Iter = 1.918161241 Bottom = 0.000765399 Done calling nodal solver Timestep 1 ends with TIME = 0.0002885721563 DT = 0.0002885721563 Timing summary: Advection :1.703563101 seconds MAC Proj :0.235160454 seconds Nodal Proj :2.099997549 seconds Reactions :0.174429019 seconds Misc :0.079172914 seconds Base State :0.045787226 seconds Time to advance time step: 4.292811202 Writing plotfile 1 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.404418959 Call to estdt for level 0 gives dt_lev = 2.657850077 Call to estdt for level 1 gives dt_lev = 0.6581035052 Minimum estdt over all levels = 0.6581035052 Call to estdt at beginning of step 2 gives dt =0.6581035052 dt_growth factor limits the new dt = 0.000317429372 Timestep 2 starts with TIME = 0.0002885721563 DT = 0.000317429372 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 221100139 MLMG: Initial residual (resid0) = 221100139 MLMG: Final Iter. 6 resid, resid/bnorm = 0.01983717084, 8.972030017e-11 MLMG: Timers: Solve = 0.105592244 Iter = 0.097590414 Bottom = 0.007570345 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 221100138.8 MLMG: Initial residual (resid0) = 0.652565344 MLMG: Final Iter. 1 resid, resid/bnorm = 0.04140532434, 1.872695538e-10 MLMG: Timers: Solve = 0.026823203 Iter = 0.018928618 Bottom = 0.001337304 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 19841168.99 MLMG: Initial residual (resid0) = 19841168.99 MLMG: Final Iter. 10 resid, resid/bnorm = 0.001567835803, 7.901932612e-11 MLMG: Timers: Solve = 1.939741388 Iter = 1.899200446 Bottom = 0.000806828 Done calling nodal solver Timestep 2 ends with TIME = 0.0006060015283 DT = 0.000317429372 Timing summary: Advection :1.686458167 seconds MAC Proj :0.235191746 seconds Nodal Proj :2.077693656 seconds Reactions :0.176220333 seconds Misc :0.068580039 seconds Base State :0.041306837 seconds Time to advance time step: 4.24456299 Writing plotfile 2 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.401851564 Time to regrid: 0.06175049 Call to estdt for level 0 gives dt_lev = 3.830037616 Call to estdt for level 1 gives dt_lev = 0.8027988743 Minimum estdt over all levels = 0.8027988743 Call to estdt at beginning of step 3 gives dt =0.8027988743 dt_growth factor limits the new dt = 0.0003491723092 Timestep 3 starts with TIME = 0.0006060015283 DT = 0.0003491723092 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 221012973.3 MLMG: Initial residual (resid0) = 221012973.3 MLMG: Final Iter. 5 resid, resid/bnorm = 0.2166522741, 9.802694878e-10 MLMG: Timers: Solve = 0.089443698 Iter = 0.081502197 Bottom = 0.006265026 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 221012973.1 MLMG: Initial residual (resid0) = 0.6485630107 MLMG: Final Iter. 1 resid, resid/bnorm = 0.04097023949, 1.853748172e-10 MLMG: Timers: Solve = 0.026409752 Iter = 0.018531018 Bottom = 0.001111213 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 15859855.11 MLMG: Initial residual (resid0) = 15859855.11 MLMG: Final Iter. 11 resid, resid/bnorm = 0.001177112688, 7.421963693e-11 MLMG: Timers: Solve = 2.126169368 Iter = 2.085339493 Bottom = 0.000827391 Done calling nodal solver Timestep 3 ends with TIME = 0.0009551738375 DT = 0.0003491723092 Timing summary: Advection :1.700385596 seconds MAC Proj :0.21963466 seconds Nodal Proj :2.266153152 seconds Reactions :0.17322208 seconds Misc :0.074776469 seconds Base State :0.045948548 seconds Time to advance time step: 4.434604549 Writing plotfile 3 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.40404049 Total Time: 32.179684 Unused ParmParse Variables: [TOP]::maestro.v(nvals = 1) :: [1] [TOP]::amr.check_file(nvals = 1) :: [wdconvect-amr_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB): 12066 Free GPU global memory (MB): 9257 [The Arena] space allocated (MB): 9049 [The Arena] space used (MB): 0 [The Device Arena] space allocated (MB): 8 [The Device Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (20.07-40-gcbbe896e9ab2) finalized