Initializing CUDA... CUDA initialized with 1 GPU AMReX (20.07-52-g97ca27aa8a3b) initialized Calling Setup() Calling ReadParameters() WARNING: burning_cutoff_density_lo not supplied in the inputs file WARNING: setting burning_cutoff_density_lo = base_cutoff_density reading extern runtime parameters ... Calling VariableSetup() Initializing Helmholtz EOS and using Coulomb corrections. Calling set_method_params() Calling BCSetup() Calling BaseStateGeometry::Init() Calling init_base_state_geometry() Calling Init() Calling InitData() initdata model_File = kepler_new_6.25e8.hybrid.hse.320 model file = kepler_new_6.25e8.hybrid.hse.320 reading initial model 320 points found in the initial model 6 variables found in the initial model model file mapping (spherical base state) dr of MAESTRO base state = 781250.000000 dr of input file data = 1562500.000000 maximum radius (cell-centered) of input model = 499218750.000000 setting r_cutoff to 239 radius at r_cutoff 187109375 Maximum HSE Error = 0.002311 (after putting initial model into base state arrays, and for density < base_cutoff_density) Writing plotfile wdconvect-amr_pltInitData after InitData inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.425588231 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Doing initial projection Calling nodal solver MLMG: Initial rhs = 185424520.7 MLMG: Initial residual (resid0) = 185424520.7 MLMG: Final Iter. 10 resid, resid/bnorm = 0.01339600922, 7.22450794e-11 MLMG: Timers: Solve = 1.92923088 Iter = 1.887679262 Bottom = 0.000734425 Done calling nodal solver Writing plotfile wdconvect-amr_pltafter_InitProj after InitProj inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.416553313 Call to firstdt for level 0 gives dt_lev = 0.005789678157 Multiplying dt_lev by init_shrink; dt_lev = 0.0005789678157 Call to firstdt for level 1 gives dt_lev = 0.002885721563 Multiplying dt_lev by init_shrink; dt_lev = 0.0002885721563 Minimum firstdt over all levels = 0.0002885721563 Doing initial divu iteration #1 Calling nodal solver MLMG: Initial rhs = 72482174.27 MLMG: Initial residual (resid0) = 72482174.27 MLMG: Final Iter. 2 resid, resid/bnorm = 0.5223139885, 7.206102656e-09 MLMG: Timers: Solve = 0.432033587 Iter = 0.392336867 Bottom = 0.00016678 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 1 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Doing initial divu iteration #2 Calling nodal solver MLMG: Initial rhs = 43334804.49 MLMG: Initial residual (resid0) = 43334804.49 MLMG: Final Iter. 2 resid, resid/bnorm = 0.02298274693, 5.303530776e-10 MLMG: Timers: Solve = 0.433580113 Iter = 0.393435854 Bottom = 0.000164539 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 2 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Doing initial divu iteration #3 Calling nodal solver MLMG: Initial rhs = 32768245.23 MLMG: Initial residual (resid0) = 32768245.23 MLMG: Final Iter. 3 resid, resid/bnorm = 0.001478955965, 4.513381641e-11 MLMG: Timers: Solve = 0.621898236 Iter = 0.582027668 Bottom = 0.000261829 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 5.916319527 Call to estdt for level 1 gives dt_lev = 2.341804478 Minimum estdt over all levels = 2.341804478 Call to estdt at end of istep_divu_iter = 3 gives dt = 2.341804478 Multiplying dt by init_shrink; dt = 0.2341804478 Ignoring this new dt since it's larger than the previous dt = 0.0002885721563 Writing plotfile wdconvect-amr_pltafter_DivuIter after final DivuIter inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.440646153 Doing initial pressure iteration #1 Timestep 0 starts with TIME = 0 DT = 0.0002885721563 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 224625388.6 MLMG: Initial residual (resid0) = 224625388.6 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02028143406, 9.029003436e-11 MLMG: Timers: Solve = 0.103883277 Iter = 0.094083646 Bottom = 0.007445944 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 224625389.4 MLMG: Initial residual (resid0) = 3940.279675 MLMG: Final Iter. 2 resid, resid/bnorm = 0.04907622382, 2.18480306e-10 MLMG: Timers: Solve = 0.040999755 Iter = 0.03322838 Bottom = 0.002507414 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 35718891.53 MLMG: Initial residual (resid0) = 35718891.53 MLMG: Final Iter. 31 resid, resid/bnorm = 0.003148799777, 8.815502503e-11 MLMG: Timers: Solve = 5.887271457 Iter = 5.845073561 Bottom = 0.002190751 Done calling nodal solver Timestep 0 ends with TIME = 0.0002885721563 DT = 0.0002885721563 Timing summary: Advection :1.639905786 seconds MAC Proj :0.250443241 seconds Nodal Proj :6.03331377 seconds Reactions :0.17374056 seconds Misc :0.076653892 seconds Base State :0.041306501 seconds Time to advance time step: 8.174539886 Writing plotfile 0 after all initialization inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.39820284 Calling Evolve() Timestep 1 starts with TIME = 0 DT = 0.0002885721563 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 224625175.9 MLMG: Initial residual (resid0) = 224625175.9 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02050754428, 9.129673107e-11 MLMG: Timers: Solve = 0.101415523 Iter = 0.093667772 Bottom = 0.007421745 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 224625175.8 MLMG: Initial residual (resid0) = 0.7033640904 MLMG: Final Iter. 1 resid, resid/bnorm = 0.04446259175, 1.979412664e-10 MLMG: Timers: Solve = 0.025794931 Iter = 0.018086495 Bottom = 0.001239208 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 25278219.2 MLMG: Initial residual (resid0) = 25278219.2 MLMG: Final Iter. 10 resid, resid/bnorm = 0.001846275176, 7.303818205e-11 MLMG: Timers: Solve = 1.936153534 Iter = 1.896291514 Bottom = 0.00074932 Done calling nodal solver Timestep 1 ends with TIME = 0.0002885721563 DT = 0.0002885721563 Timing summary: Advection :1.710424603 seconds MAC Proj :0.229007936 seconds Nodal Proj :2.077573909 seconds Reactions :0.172889154 seconds Misc :0.071983832 seconds Base State :0.04639478 seconds Time to advance time step: 4.262326385 Writing plotfile 1 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.399632266 Call to estdt for level 0 gives dt_lev = 2.657850076 Call to estdt for level 1 gives dt_lev = 0.6581035052 Minimum estdt over all levels = 0.6581035052 Call to estdt at beginning of step 2 gives dt =0.6581035052 dt_growth factor limits the new dt = 0.000317429372 Timestep 2 starts with TIME = 0.0002885721563 DT = 0.000317429372 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 221100139 MLMG: Initial residual (resid0) = 221100139 MLMG: Final Iter. 6 resid, resid/bnorm = 0.01983711123, 8.972003059e-11 MLMG: Timers: Solve = 0.101108113 Iter = 0.093326509 Bottom = 0.007231597 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 221100138.8 MLMG: Initial residual (resid0) = 0.6525653444 MLMG: Final Iter. 1 resid, resid/bnorm = 0.04140532154, 1.872695411e-10 MLMG: Timers: Solve = 0.02593096 Iter = 0.018111561 Bottom = 0.001211017 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 19841168.99 MLMG: Initial residual (resid0) = 19841168.99 MLMG: Final Iter. 10 resid, resid/bnorm = 0.001567834639, 7.901926744e-11 MLMG: Timers: Solve = 1.936875949 Iter = 1.897062598 Bottom = 0.000741578 Done calling nodal solver Timestep 2 ends with TIME = 0.0006060015283 DT = 0.000317429372 Timing summary: Advection :1.799028089 seconds MAC Proj :0.232886163 seconds Nodal Proj :2.083889938 seconds Reactions :0.183746831 seconds Misc :0.072054228 seconds Base State :0.047267884 seconds Time to advance time step: 4.372081279 Writing plotfile 2 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.405742629 Time to regrid: 0.066858929 Call to estdt for level 0 gives dt_lev = 3.830037619 Call to estdt for level 1 gives dt_lev = 0.8027988744 Minimum estdt over all levels = 0.8027988744 Call to estdt at beginning of step 3 gives dt =0.8027988744 dt_growth factor limits the new dt = 0.0003491723092 Timestep 3 starts with TIME = 0.0006060015283 DT = 0.0003491723092 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 221012973.3 MLMG: Initial residual (resid0) = 221012973.3 MLMG: Final Iter. 5 resid, resid/bnorm = 0.2166523039, 9.802696226e-10 MLMG: Timers: Solve = 0.086098419 Iter = 0.078462736 Bottom = 0.005999161 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 221012973.1 MLMG: Initial residual (resid0) = 0.6485630027 MLMG: Final Iter. 1 resid, resid/bnorm = 0.04097023597, 1.853748013e-10 MLMG: Timers: Solve = 0.025604051 Iter = 0.017886688 Bottom = 0.001080573 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 15859855.11 MLMG: Initial residual (resid0) = 15859855.11 MLMG: Final Iter. 11 resid, resid/bnorm = 0.001177115017, 7.421978373e-11 MLMG: Timers: Solve = 2.124777105 Iter = 2.084869247 Bottom = 0.00084559 Done calling nodal solver Timestep 3 ends with TIME = 0.0009551738375 DT = 0.0003491723092 Timing summary: Advection :1.750342957 seconds MAC Proj :0.217587018 seconds Nodal Proj :2.25998885 seconds Reactions :0.17549663 seconds Misc :0.075638052 seconds Base State :0.05017437 seconds Time to advance time step: 4.479483961 Writing plotfile 3 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.450610099 Total Time: 32.25267403 Unused ParmParse Variables: [TOP]::maestro.v(nvals = 1) :: [1] [TOP]::amr.check_file(nvals = 1) :: [wdconvect-amr_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB): 12066 Free GPU global memory (MB): 9257 [The Arena] space allocated (MB): 9049 [The Arena] space used (MB): 0 [The Device Arena] space allocated (MB): 8 [The Device Arena] space used (MB): 0 [The Managed Arena] space allocated (MB): 8 [The Managed Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 8 [The Pinned Arena] space used (MB): 0 AMReX (20.07-52-g97ca27aa8a3b) finalized