Initializing CUDA... CUDA initialized with 1 GPU AMReX (20.08-42-g04d0eecf4a09) initialized Calling Setup() Calling ReadParameters() WARNING: burning_cutoff_density_lo not supplied in the inputs file WARNING: setting burning_cutoff_density_lo = base_cutoff_density reading extern runtime parameters ... Calling VariableSetup() Initializing Helmholtz EOS and using Coulomb corrections. Calling set_method_params() Calling BCSetup() Calling BaseStateGeometry::Init() Calling init_base_state_geometry() Calling Init() Calling InitData() initdata model_File = kepler_new_6.25e8.hybrid.hse.320 model file = kepler_new_6.25e8.hybrid.hse.320 reading initial model 320 points found in the initial model 6 variables found in the initial model model file mapping (spherical base state) dr of MAESTRO base state = 781250.000000 dr of input file data = 1562500.000000 maximum radius (cell-centered) of input model = 499218750.000000 setting r_cutoff to 239 radius at r_cutoff 187109375 Maximum HSE Error = 0.002311 (after putting initial model into base state arrays, and for density < base_cutoff_density) Writing plotfile wdconvect-amr_pltInitData after InitData inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.436384983 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Doing initial projection Calling nodal solver MLMG: Initial rhs = 223792658.9 MLMG: Initial residual (resid0) = 223792658.9 MLMG: Final Iter. 5 resid, resid/bnorm = 0.01302976906, 5.822250438e-11 MLMG: Timers: Solve = 1.010174497 Iter = 0.968241598 Bottom = 0.000383753 Done calling nodal solver Writing plotfile wdconvect-amr_pltafter_InitProj after InitProj inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.420182714 Call to firstdt for level 0 gives dt_lev = 0.005789678157 Multiplying dt_lev by init_shrink; dt_lev = 0.0005789678157 Call to firstdt for level 1 gives dt_lev = 0.002885721563 Multiplying dt_lev by init_shrink; dt_lev = 0.0002885721563 Minimum firstdt over all levels = 0.0002885721563 Doing initial divu iteration #1 Calling nodal solver MLMG: Initial rhs = 96748240.18 MLMG: Initial residual (resid0) = 96748240.18 MLMG: Final Iter. 2 resid, resid/bnorm = 0.7442735398, 7.692889694e-09 MLMG: Timers: Solve = 0.431366933 Iter = 0.391924796 Bottom = 0.000162619 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 1 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Doing initial divu iteration #2 Calling nodal solver MLMG: Initial rhs = 53052451.02 MLMG: Initial residual (resid0) = 53052451.02 MLMG: Final Iter. 2 resid, resid/bnorm = 0.01898677269, 3.578868144e-10 MLMG: Timers: Solve = 0.430261037 Iter = 0.39087795 Bottom = 0.000164155 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 2 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Doing initial divu iteration #3 Calling nodal solver MLMG: Initial rhs = 33080059.37 MLMG: Initial residual (resid0) = 33080059.37 MLMG: Final Iter. 3 resid, resid/bnorm = 0.001913452565, 5.784308136e-11 MLMG: Timers: Solve = 0.633541646 Iter = 0.59406033 Bottom = 0.000253063 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 3 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Writing plotfile wdconvect-amr_pltafter_DivuIter after final DivuIter inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.397536848 Doing initial pressure iteration #1 Timestep 0 starts with TIME = 0 DT = 0.0002885721563 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216054224.6 MLMG: Initial residual (resid0) = 216054224.6 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02237911895, 1.035810292e-10 MLMG: Timers: Solve = 0.105883555 Iter = 0.096003105 Bottom = 0.007474738 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216054224.3 MLMG: Initial residual (resid0) = 10665.17408 MLMG: Final Iter. 3 resid, resid/bnorm = 0.004752751111, 2.199795503e-11 MLMG: Timers: Solve = 0.057438956 Iter = 0.049338711 Bottom = 0.003821416 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 35718898.91 MLMG: Initial residual (resid0) = 35718898.91 MLMG: Final Iter. 31 resid, resid/bnorm = 0.002826651558, 7.913602167e-11 MLMG: Timers: Solve = 5.965959424 Iter = 5.922962981 Bottom = 0.002322859 Done calling nodal solver Timestep 0 ends with TIME = 0.0002885721563 DT = 0.0002885721563 Timing summary: Advection :1.811972523 seconds MAC Proj :0.271196728 seconds Nodal Proj :6.115237406 seconds Reactions :0.175339381 seconds Misc :0.07561851 seconds Base State :0.045474478 seconds Time to advance time step: 8.449865589 Writing plotfile 0 after all initialization inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.462649563 Calling Evolve() Timestep 1 starts with TIME = 0 DT = 0.0002885721563 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216054534.3 MLMG: Initial residual (resid0) = 216054534.3 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02259198949, 1.045661437e-10 MLMG: Timers: Solve = 0.10336694 Iter = 0.095559809 Bottom = 0.007477483 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216054534.1 MLMG: Initial residual (resid0) = 0.3517592385 MLMG: Final Iter. 1 resid, resid/bnorm = 0.02233633469, 1.033828556e-10 MLMG: Timers: Solve = 0.026388928 Iter = 0.018590696 Bottom = 0.001261727 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 22362132.14 MLMG: Initial residual (resid0) = 22362132.14 MLMG: Final Iter. 10 resid, resid/bnorm = 0.001655275002, 7.402134071e-11 MLMG: Timers: Solve = 1.93958444 Iter = 1.897489115 Bottom = 0.000755514 Done calling nodal solver Timestep 1 ends with TIME = 0.0002885721563 DT = 0.0002885721563 Timing summary: Advection :1.793961657 seconds MAC Proj :0.233835193 seconds Nodal Proj :2.111212225 seconds Reactions :0.186182817 seconds Misc :0.078295569 seconds Base State :0.046753462 seconds Time to advance time step: 4.403966746 Writing plotfile 1 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.408828791 Call to estdt for level 0 gives dt_lev = 2.560503025 Call to estdt for level 1 gives dt_lev = 0.5423221224 Minimum estdt over all levels = 0.5423221224 Call to estdt at beginning of step 2 gives dt =0.5423221224 dt_growth factor limits the new dt = 0.000317429372 Timestep 2 starts with TIME = 0.0002885721563 DT = 0.000317429372 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216551625.1 MLMG: Initial residual (resid0) = 216551625.1 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02230187505, 1.029864128e-10 MLMG: Timers: Solve = 0.104066824 Iter = 0.096232816 Bottom = 0.007541038 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216551624.9 MLMG: Initial residual (resid0) = 0.3069432157 MLMG: Final Iter. 1 resid, resid/bnorm = 0.01958142748, 9.042383074e-11 MLMG: Timers: Solve = 0.026222244 Iter = 0.018389998 Bottom = 0.001247795 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 16291326.17 MLMG: Initial residual (resid0) = 16291326.17 MLMG: Final Iter. 10 resid, resid/bnorm = 0.001410159282, 8.655890057e-11 MLMG: Timers: Solve = 1.932992664 Iter = 1.893215122 Bottom = 0.000770381 Done calling nodal solver Timestep 2 ends with TIME = 0.0006060015283 DT = 0.000317429372 Timing summary: Advection :1.728304733 seconds MAC Proj :0.232974309 seconds Nodal Proj :2.081419115 seconds Reactions :0.177492259 seconds Misc :0.067906029 seconds Base State :0.044980107 seconds Time to advance time step: 4.288559705 Writing plotfile 2 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.406355824 Time to regrid: 0.064084542 Call to estdt for level 0 gives dt_lev = 3.523490791 Call to estdt for level 1 gives dt_lev = 0.6591885313 Minimum estdt over all levels = 0.6591885313 Call to estdt at beginning of step 3 gives dt =0.6591885313 dt_growth factor limits the new dt = 0.0003491723092 Timestep 3 starts with TIME = 0.0006060015283 DT = 0.0003491723092 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216573205.8 MLMG: Initial residual (resid0) = 216573205.8 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02218363062, 1.024301715e-10 MLMG: Timers: Solve = 0.103767877 Iter = 0.095975097 Bottom = 0.007540571 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216573205.6 MLMG: Initial residual (resid0) = 0.269582452 MLMG: Final Iter. 1 resid, resid/bnorm = 0.01713669305, 7.912656139e-11 MLMG: Timers: Solve = 0.026371156 Iter = 0.018554056 Bottom = 0.001248183 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 13124031.6 MLMG: Initial residual (resid0) = 13124031.6 MLMG: Final Iter. 11 resid, resid/bnorm = 0.001057907008, 8.060838618e-11 MLMG: Timers: Solve = 2.118686658 Iter = 2.079148261 Bottom = 0.000836224 Done calling nodal solver Timestep 3 ends with TIME = 0.0009551738375 DT = 0.0003491723092 Timing summary: Advection :1.738228583 seconds MAC Proj :0.233115201 seconds Nodal Proj :2.264740396 seconds Reactions :0.174139794 seconds Misc :0.074460765 seconds Base State :0.047239716 seconds Time to advance time step: 4.48510823 Writing plotfile 3 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.404975948 Total Time: 31.77831555 Unused ParmParse Variables: [TOP]::maestro.v(nvals = 1) :: [1] [TOP]::amr.check_file(nvals = 1) :: [wdconvect-amr_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB): 12066 Free GPU global memory (MB): 9387 [The Arena] space allocated (MB): 9049 [The Arena] space used (MB): 0 [The Device Arena] space allocated (MB): 8 [The Device Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (20.08-42-g04d0eecf4a09) finalized