Initializing CUDA... CUDA initialized with 1 GPU AMReX (22.01-12-g1404c4a9acc6) initialized Calling Setup() Calling ReadParameters() reading extern runtime parameters ... Calling VariableSetup() Calling BCSetup() Calling BaseStateGeometry::Init() Calling Init() Calling InitData() initdata model_File = kepler_new_6.25e8.hybrid.hse.320 model file = kepler_new_6.25e8.hybrid.hse.320 reading initial model 320 points found in the initial model 6 variables found in the initial model WARNING: variable not found: ash WARNING: magnesium-24 not provided in inputs file model file mapping (spherical base state) dr of MAESTRO base state = 781250.000000 dr of input file data = 1562500.000000 maximum radius (cell-centered) of input model = 499218750.000000 setting r_cutoff to 239 radius at r_cutoff 187109375 Maximum HSE Error = 0.002311 (after putting initial model into base state arrays, and for density < base_cutoff_density) Writing plotfile wdconvect-amr_pltInitData after InitData inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.369113762 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Doing initial projection Calling nodal solver MLMG: Initial rhs = 223792109.4 MLMG: Initial residual (resid0) = 223792109.4 MLMG: Final Iter. 4 resid, resid/bnorm = 0.01715009583, 7.663405059e-11 MLMG: Timers: Solve = 1.316275548 Iter = 1.254541587 Bottom = 0.000258792 Done calling nodal solver Writing plotfile wdconvect-amr_pltafter_InitProj after InitProj inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.349602863 Call to firstdt for level 0 gives dt_lev = 0.005789736987 Multiplying dt_lev by init_shrink; dt_lev = 0.0005789736987 Call to firstdt for level 1 gives dt_lev = 0.002885750885 Multiplying dt_lev by init_shrink; dt_lev = 0.0002885750885 Minimum firstdt over all levels = 0.0002885750885 Doing initial divu iteration #1 Calling nodal solver MLMG: Initial rhs = 96748113.54 MLMG: Initial residual (resid0) = 96748113.54 MLMG: Final Iter. 1 resid, resid/bnorm = 10.35489981, 1.070294751e-07 MLMG: Timers: Solve = 0.386087937 Iter = 0.325445482 Bottom = 5.975e-05 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 21.60061365 Call to estdt for level 1 gives dt_lev = 11.21229293 Minimum estdt over all levels = 11.21229293 Call to estdt at end of istep_divu_iter = 1 gives dt = 11.21229293 Multiplying dt by init_shrink; dt = 1.121229293 Ignoring this new dt since it's larger than the previous dt = 0.0002885750885 Doing initial divu iteration #2 Calling nodal solver MLMG: Initial rhs = 53052389.3 MLMG: Initial residual (resid0) = 53052389.3 MLMG: Final Iter. 1 resid, resid/bnorm = 0.2186066424, 4.12058053e-09 MLMG: Timers: Solve = 0.383849383 Iter = 0.324772645 Bottom = 6.025e-05 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 21.60061365 Call to estdt for level 1 gives dt_lev = 11.22745362 Minimum estdt over all levels = 11.22745362 Call to estdt at end of istep_divu_iter = 2 gives dt = 11.22745362 Multiplying dt by init_shrink; dt = 1.122745362 Ignoring this new dt since it's larger than the previous dt = 0.0002885750885 Doing initial divu iteration #3 Calling nodal solver MLMG: Initial rhs = 33080017.02 MLMG: Initial residual (resid0) = 33080017.02 MLMG: Final Iter. 3 resid, resid/bnorm = 0.002709050849, 8.189387713e-11 MLMG: Timers: Solve = 1.011943098 Iter = 0.95262665 Bottom = 0.00020425 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 21.60061365 Call to estdt for level 1 gives dt_lev = 11.20744185 Minimum estdt over all levels = 11.20744185 Call to estdt at end of istep_divu_iter = 3 gives dt = 11.20744185 Multiplying dt by init_shrink; dt = 1.120744185 Ignoring this new dt since it's larger than the previous dt = 0.0002885750885 Writing plotfile wdconvect-amr_pltafter_DivuIter after final DivuIter inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.328235872 Doing initial pressure iteration #1 Timestep 0 starts with TIME = 0 DT = 0.0002885750885 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216054180.2 MLMG: Initial residual (resid0) = 216054180.2 MLMG: Final Iter. 6 resid, resid/bnorm = 0.0224490203, 1.039045867e-10 MLMG: Timers: Solve = 0.058606319 Iter = 0.053449833 Bottom = 0.007241416 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216054180 MLMG: Initial residual (resid0) = 4063.444174 MLMG: Final Iter. 2 resid, resid/bnorm = 0.04702966003, 2.176753074e-10 MLMG: Timers: Solve = 0.023542586 Iter = 0.01903752 Bottom = 0.002433306 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 14621038.7 MLMG: Initial residual (resid0) = 14621038.7 MLMG: Final Iter. 19 resid, resid/bnorm = 0.0008470257162, 5.793197963e-11 MLMG: Timers: Solve = 5.857961716 Iter = 5.797553804 Bottom = 0.001956926 Done calling nodal solver Timestep 0 ends with TIME = 0.0002885750885 DT = 0.0002885750885 Timing summary: Advection :2.198646982 seconds MAC Proj :0.18632464 seconds Nodal Proj :6.065686474 seconds Reactions :0.239527722 seconds Misc :0.090708662 seconds Base State :0.064733189 seconds Time to advance time step: 8.781433107 Writing plotfile 0 after all initialization inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.333325317 Calling Evolve() Timestep 1 starts with TIME = 0 DT = 0.0002885750885 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216054489.9 MLMG: Initial residual (resid0) = 216054489.9 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02244241908, 1.038738843e-10 MLMG: Timers: Solve = 0.057074728 Iter = 0.052554328 Bottom = 0.007296204 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216054489.7 MLMG: Initial residual (resid0) = 0.3527048053 MLMG: Final Iter. 1 resid, resid/bnorm = 0.02240421663, 1.036970658e-10 MLMG: Timers: Solve = 0.015113083 Iter = 0.010270015 Bottom = 0.00119559 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 22362103.76 MLMG: Initial residual (resid0) = 22362103.76 MLMG: Final Iter. 5 resid, resid/bnorm = 0.001080892519, 4.83359048e-11 MLMG: Timers: Solve = 1.611173239 Iter = 1.551580789 Bottom = 0.000620461 Done calling nodal solver Timestep 1 ends with TIME = 0.0002885750885 DT = 0.0002885750885 Timing summary: Advection :2.15824597 seconds MAC Proj :0.170330887 seconds Nodal Proj :1.822974309 seconds Reactions :0.238568384 seconds Misc :0.086854266 seconds Base State :0.06052637 seconds Time to advance time step: 4.477488777 Writing plotfile 1 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.329013418 Call to estdt for level 0 gives dt_lev = 2.560516355 Call to estdt for level 1 gives dt_lev = 0.5423247709 Minimum estdt over all levels = 0.5423247709 Call to estdt at beginning of step 2 gives dt =0.5423247709 dt_growth factor limits the new dt = 0.0003174325974 Timestep 2 starts with TIME = 0.0002885750885 DT = 0.0003174325974 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216551218.7 MLMG: Initial residual (resid0) = 216551218.7 MLMG: Final Iter. 6 resid, resid/bnorm = 0.02222342789, 1.026243492e-10 MLMG: Timers: Solve = 0.057236937 Iter = 0.052599995 Bottom = 0.00729333 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216551218.6 MLMG: Initial residual (resid0) = 0.4579974225 MLMG: Final Iter. 1 resid, resid/bnorm = 0.01965397086, 9.075899453e-11 MLMG: Timers: Solve = 0.01466008 Iter = 0.010080972 Bottom = 0.001242841 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 16291309.39 MLMG: Initial residual (resid0) = 16291309.39 MLMG: Final Iter. 5 resid, resid/bnorm = 0.001264760614, 7.763406756e-11 MLMG: Timers: Solve = 1.629522172 Iter = 1.569961847 Bottom = 0.00061942 Done calling nodal solver Timestep 2 ends with TIME = 0.0006060076859 DT = 0.0003174325974 Timing summary: Advection :2.166217054 seconds MAC Proj :0.170756722 seconds Nodal Proj :1.832871406 seconds Reactions :0.236783539 seconds Misc :0.084862671 seconds Base State :0.0640916 seconds Time to advance time step: 4.492030981 Writing plotfile 2 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.327797412 Time to regrid: 0.072225602 Call to estdt for level 0 gives dt_lev = 3.523509294 Call to estdt for level 1 gives dt_lev = 0.6591917221 Minimum estdt over all levels = 0.6591917221 Call to estdt at beginning of step 3 gives dt =0.6591917221 dt_growth factor limits the new dt = 0.0003491758571 Timestep 3 starts with TIME = 0.0006060076859 DT = 0.0003491758571 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 216572797.4 MLMG: Initial residual (resid0) = 216572797.4 MLMG: Final Iter. 6 resid, resid/bnorm = 0.0219149515, 1.011897698e-10 MLMG: Timers: Solve = 0.057023436 Iter = 0.052541161 Bottom = 0.007291665 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 216572797.2 MLMG: Initial residual (resid0) = 0.2694439256 MLMG: Final Iter. 1 resid, resid/bnorm = 0.01715105085, 7.91930061e-11 MLMG: Timers: Solve = 0.014644455 Iter = 0.010184098 Bottom = 0.001256256 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 13124019.97 MLMG: Initial residual (resid0) = 13124019.97 MLMG: Final Iter. 6 resid, resid/bnorm = 0.0005545876266, 4.225745068e-11 MLMG: Timers: Solve = 1.94940479 Iter = 1.889786174 Bottom = 0.00069517 Done calling nodal solver Timestep 3 ends with TIME = 0.0009551835431 DT = 0.0003491758571 Timing summary: Advection :2.20991121 seconds MAC Proj :0.171370808 seconds Nodal Proj :2.155842499 seconds Reactions :0.241504566 seconds Misc :0.092670464 seconds Base State :0.065658943 seconds Time to advance time step: 4.871847217 Writing plotfile 3 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.328316206 Total Time: 31.35786698 Unused ParmParse Variables: [TOP]::maestro.v(nvals = 1) :: [1] [TOP]::amr.check_file(nvals = 1) :: [wdconvect-amr_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB): 12066 Free GPU global memory (MB): 10130 [The Arena] space allocated (MB): 9049 [The Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 33 [The Pinned Arena] space used (MB): 0 AMReX (22.01-12-g1404c4a9acc6) finalized