Initializing CUDA... CUDA initialized with 1 GPU AMReX (20.12-22-g81a56bd628b9) initialized Calling Setup() Calling ReadParameters() WARNING: burning_cutoff_density_lo not supplied in the inputs file WARNING: setting burning_cutoff_density_lo = base_cutoff_density reading extern runtime parameters ... Calling VariableSetup() Initializing Helmholtz EOS and using Coulomb corrections. Calling set_method_params() Calling BCSetup() Calling BaseStateGeometry::Init() Calling init_base_state_geometry() Calling Init() Calling InitData() initdata model_File = kepler_new_6.25e8.hybrid.hse.320 model file = kepler_new_6.25e8.hybrid.hse.320 reading initial model 320 points found in the initial model 6 variables found in the initial model model file mapping (spherical base state) dr of MAESTRO base state = 781250.000000 dr of input file data = 1562500.000000 maximum radius (cell-centered) of input model = 499218750.000000 setting r_cutoff to 239 radius at r_cutoff 187109375 Maximum HSE Error = 0.002311 (after putting initial model into base state arrays, and for density < base_cutoff_density) Writing plotfile wdconvect-amr_pltInitData after InitData inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.466541545 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Doing initial projection Calling nodal solver MLMG: Initial rhs = 223792658.9 MLMG: Initial residual (resid0) = 223792658.9 MLMG: Final Iter. 5 resid, resid/bnorm = 0.01302976906, 5.822250438e-11 MLMG: Timers: Solve = 1.005447413 Iter = 0.964941427 Bottom = 0.000404712 Done calling nodal solver Writing plotfile wdconvect-amr_pltafter_InitProj after InitProj inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.442516895 Call to firstdt for level 0 gives dt_lev = 0.005789678157 Multiplying dt_lev by init_shrink; dt_lev = 0.0005789678157 Call to firstdt for level 1 gives dt_lev = 0.002885721563 Multiplying dt_lev by init_shrink; dt_lev = 0.0002885721563 Minimum firstdt over all levels = 0.0002885721563 Doing initial divu iteration #1 Calling nodal solver MLMG: Initial rhs = 96748240.18 MLMG: Initial residual (resid0) = 96748240.18 MLMG: Final Iter. 2 resid, resid/bnorm = 0.7442729427, 7.692883522e-09 MLMG: Timers: Solve = 0.428367622 Iter = 0.389394098 Bottom = 0.000162172 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 1 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Doing initial divu iteration #2 Calling nodal solver MLMG: Initial rhs = 53052451.02 MLMG: Initial residual (resid0) = 53052451.02 MLMG: Final Iter. 2 resid, resid/bnorm = 0.01898695052, 3.578901663e-10 MLMG: Timers: Solve = 0.427895745 Iter = 0.388869064 Bottom = 0.000166195 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 2 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Doing initial divu iteration #3 Calling nodal solver MLMG: Initial rhs = 33080059.37 MLMG: Initial residual (resid0) = 33080059.37 MLMG: Final Iter. 3 resid, resid/bnorm = 0.001913454252, 5.784313233e-11 MLMG: Timers: Solve = 0.629909521 Iter = 0.591047177 Bottom = 0.00034327 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 3 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Writing plotfile wdconvect-amr_pltafter_DivuIter after final DivuIter inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.432989603 Doing initial pressure iteration #1 Timestep 0 starts with TIME = 0 DT = 0.0002885721563 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216054224.6 MLMG: Initial residual (resid0) = 216054224.6 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02237911895, 1.035810292e-10 MLMG: Timers: Solve = 0.07936487 Iter = 0.071458378 Bottom = 0.007335006 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216054224.3 MLMG: Initial residual (resid0) = 10665.17397 MLMG: Final Iter. 3 resid, resid/bnorm = 0.004752771968, 2.199805157e-11 MLMG: Timers: Solve = 0.04246556 Iter = 0.03665382 Bottom = 0.003710951 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 35718898.93 MLMG: Initial residual (resid0) = 35718898.93 MLMG: Final Iter. 31 resid, resid/bnorm = 0.00282661058, 7.91348744e-11 MLMG: Timers: Solve = 5.868531693 Iter = 5.825590633 Bottom = 0.002301698 Done calling nodal solver Timestep 0 ends with TIME = 0.0002885721563 DT = 0.0002885721563 Timing summary: Advection :1.774753686 seconds MAC Proj :0.217034323 seconds Nodal Proj :6.028860027 seconds Reactions :0.165324188 seconds Misc :0.10605404 seconds Base State :0.044260598 seconds Time to advance time step: 8.292499906 Writing plotfile 0 after all initialization inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.430922336 Calling Evolve() Timestep 1 starts with TIME = 0 DT = 0.0002885721563 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216054534.3 MLMG: Initial residual (resid0) = 216054534.3 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02259197459, 1.045660748e-10 MLMG: Timers: Solve = 0.077063246 Iter = 0.071176102 Bottom = 0.007395859 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216054534.1 MLMG: Initial residual (resid0) = 0.3517590652 MLMG: Final Iter. 1 resid, resid/bnorm = 0.02233632537, 1.033828124e-10 MLMG: Timers: Solve = 0.019556554 Iter = 0.013673793 Bottom = 0.001279257 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 22362132.14 MLMG: Initial residual (resid0) = 22362132.14 MLMG: Final Iter. 10 resid, resid/bnorm = 0.001655267552, 7.402100754e-11 MLMG: Timers: Solve = 1.915184409 Iter = 1.876479687 Bottom = 0.000815009 Done calling nodal solver Timestep 1 ends with TIME = 0.0002885721563 DT = 0.0002885721563 Timing summary: Advection :1.701456699 seconds MAC Proj :0.184511525 seconds Nodal Proj :2.069488479 seconds Reactions :0.161367357 seconds Misc :0.117866616 seconds Base State :0.043652389 seconds Time to advance time step: 4.235162114 Writing plotfile 1 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.432760423 Call to estdt for level 0 gives dt_lev = 2.560503026 Call to estdt for level 1 gives dt_lev = 0.5423221224 Minimum estdt over all levels = 0.5423221224 Call to estdt at beginning of step 2 gives dt =0.5423221224 dt_growth factor limits the new dt = 0.000317429372 Timestep 2 starts with TIME = 0.0002885721563 DT = 0.000317429372 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216551625.1 MLMG: Initial residual (resid0) = 216551625.1 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02230188251, 1.029864472e-10 MLMG: Timers: Solve = 0.077000044 Iter = 0.071208921 Bottom = 0.007339778 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216551624.9 MLMG: Initial residual (resid0) = 0.306943228 MLMG: Final Iter. 1 resid, resid/bnorm = 0.01958141199, 9.042375924e-11 MLMG: Timers: Solve = 0.019296976 Iter = 0.013542086 Bottom = 0.001225135 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 16291326.17 MLMG: Initial residual (resid0) = 16291326.17 MLMG: Final Iter. 10 resid, resid/bnorm = 0.001410151832, 8.655844324e-11 MLMG: Timers: Solve = 1.913430938 Iter = 1.874681513 Bottom = 0.000871377 Done calling nodal solver Timestep 2 ends with TIME = 0.0006060015283 DT = 0.000317429372 Timing summary: Advection :1.696322267 seconds MAC Proj :0.183977777 seconds Nodal Proj :2.066589076 seconds Reactions :0.166104858 seconds Misc :0.117037713 seconds Base State :0.042811365 seconds Time to advance time step: 4.230495489 Writing plotfile 2 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.433719117 Time to regrid: 0.11746002 Call to estdt for level 0 gives dt_lev = 3.523490799 Call to estdt for level 1 gives dt_lev = 0.6591885311 Minimum estdt over all levels = 0.6591885311 Call to estdt at beginning of step 3 gives dt =0.6591885311 dt_growth factor limits the new dt = 0.0003491723092 Timestep 3 starts with TIME = 0.0006060015283 DT = 0.0003491723092 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216573205.8 MLMG: Initial residual (resid0) = 216573205.8 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02218363434, 1.024301887e-10 MLMG: Timers: Solve = 0.077238525 Iter = 0.071412301 Bottom = 0.007483076 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216573205.6 MLMG: Initial residual (resid0) = 0.2695823647 MLMG: Final Iter. 1 resid, resid/bnorm = 0.01713669087, 7.912655135e-11 MLMG: Timers: Solve = 0.01915954 Iter = 0.013449733 Bottom = 0.001228319 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 13124031.6 MLMG: Initial residual (resid0) = 13124031.6 MLMG: Final Iter. 11 resid, resid/bnorm = 0.001057910733, 8.060867003e-11 MLMG: Timers: Solve = 2.103220793 Iter = 2.064515557 Bottom = 0.000986319 Done calling nodal solver Timestep 3 ends with TIME = 0.0009551738375 DT = 0.0003491723092 Timing summary: Advection :1.697207914 seconds MAC Proj :0.184892059 seconds Nodal Proj :2.258865626 seconds Reactions :0.160688924 seconds Misc :0.117579908 seconds Base State :0.047310226 seconds Time to advance time step: 4.419717691 Writing plotfile 3 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.469043667 Total Time: 31.45499357 Unused ParmParse Variables: [TOP]::maestro.v(nvals = 1) :: [1] [TOP]::amr.check_file(nvals = 1) :: [wdconvect-amr_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB): 12066 Free GPU global memory (MB): 9249 [The Arena] space allocated (MB): 9049 [The Arena] space used (MB): 0 [The Device Arena] space allocated (MB): 8 [The Device Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (20.12-22-g81a56bd628b9) finalized