Initializing CUDA... CUDA initialized with 1 device. AMReX (23.01-18-gd6f8b2cce0fb) initialized Calling Setup() Calling ReadParameters() reading extern runtime parameters ... Calling VariableSetup() Calling BCSetup() Calling BaseStateGeometry::Init() Calling Init() Calling InitData() initdata model_File = kepler_new_6.25e8.hybrid.hse.320 model file = kepler_new_6.25e8.hybrid.hse.320 reading initial model 320 points found in the initial model 6 variables found in the initial model WARNING: variable not found: ash WARNING: magnesium-24 not provided in inputs file model file mapping (spherical base state) dr of MAESTRO base state = 781250.000000 dr of input file data = 1562500.000000 maximum radius (cell-centered) of input model = 499218750.000000 setting r_cutoff to 239 radius at r_cutoff 187109375 Maximum HSE Error = 0.002311 (after putting initial model into base state arrays, and for density < base_cutoff_density) Writing plotfile wdconvect-amr_pltInitData after InitData inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.414620436 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Doing initial projection Calling nodal solver MLMG: Initial rhs = 214086148.6 MLMG: Initial residual (resid0) = 214086148.6 MLMG: Final Iter. 5 resid, resid/bnorm = 0.005460712518, 2.550707999e-11 MLMG: Timers: Solve = 2.116580205 Iter = 2.07191734 Bottom = 0.00036826 Done calling nodal solver Writing plotfile wdconvect-amr_pltafter_InitProj after InitProj inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.385445869 Call to firstdt for level 0 gives dt_lev = 0.005789736987 Multiplying dt_lev by init_shrink; dt_lev = 0.0005789736987 Call to firstdt for level 1 gives dt_lev = 0.002885750885 Multiplying dt_lev by init_shrink; dt_lev = 0.0002885750885 Minimum firstdt over all levels = 0.0002885750885 Doing initial divu iteration #1 Calling nodal solver MLMG: Initial rhs = 98262295.15 MLMG: Initial residual (resid0) = 98262295.15 MLMG: Final Iter. 1 resid, resid/bnorm = 6.201650534, 6.311322694e-08 MLMG: Timers: Solve = 0.450487524 Iter = 0.407190436 Bottom = 0.000129302 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 21.60061365 Call to estdt for level 1 gives dt_lev = 10.10291125 Minimum estdt over all levels = 10.10291125 Call to estdt at end of istep_divu_iter = 1 gives dt = 10.10291125 Multiplying dt by init_shrink; dt = 1.010291125 Ignoring this new dt since it's larger than the previous dt = 0.0002885750885 Doing initial divu iteration #2 Calling nodal solver MLMG: Initial rhs = 57185021.56 MLMG: Initial residual (resid0) = 57185021.56 MLMG: Final Iter. 1 resid, resid/bnorm = 0.1141292164, 1.99578864e-09 MLMG: Timers: Solve = 0.448320364 Iter = 0.407100008 Bottom = 0.000111209 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 21.60061365 Call to estdt for level 1 gives dt_lev = 10.47579657 Minimum estdt over all levels = 10.47579657 Call to estdt at end of istep_divu_iter = 2 gives dt = 10.47579657 Multiplying dt by init_shrink; dt = 1.047579657 Ignoring this new dt since it's larger than the previous dt = 0.0002885750885 Doing initial divu iteration #3 Calling nodal solver MLMG: Initial rhs = 36948393.66 MLMG: Initial residual (resid0) = 36948393.66 MLMG: Final Iter. 3 resid, resid/bnorm = 0.003112264979, 8.423275469e-11 MLMG: Timers: Solve = 1.264516685 Iter = 1.22326369 Bottom = 0.000251821 Done calling nodal solver Call to estdt for level 0 gives dt_lev = 21.60061365 Call to estdt for level 1 gives dt_lev = 10.62248182 Minimum estdt over all levels = 10.62248182 Call to estdt at end of istep_divu_iter = 3 gives dt = 10.62248182 Multiplying dt by init_shrink; dt = 1.062248182 Ignoring this new dt since it's larger than the previous dt = 0.0002885750885 Writing plotfile wdconvect-amr_pltafter_DivuIter after final DivuIter inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.347284192 Doing initial pressure iteration #1 Timestep 0 starts with TIME = 0 DT = 0.0002885750885 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 300731019.7 MLMG: Initial residual (resid0) = 300731019.7 MLMG: Final Iter. 5 resid, resid/bnorm = 0.2849788219, 9.476203092e-10 MLMG: Timers: Solve = 0.046179948 Iter = 0.041422956 Bottom = 0.004841675 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 300731020.2 MLMG: Initial residual (resid0) = 1282.174763 MLMG: Final Iter. 2 resid, resid/bnorm = 0.01771812087, 5.891683824e-11 MLMG: Timers: Solve = 0.021165837 Iter = 0.01682895 Bottom = 0.00195619 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 16091212.77 MLMG: Initial residual (resid0) = 16091212.77 MLMG: Final Iter. 18 resid, resid/bnorm = 0.001556653995, 9.673938302e-11 MLMG: Timers: Solve = 7.326863373 Iter = 7.281449768 Bottom = 0.00105084 Done calling nodal solver Timestep 0 ends with TIME = 0.0002885750885 DT = 0.0002885750885 Timing summary: Advection :1.752003862 seconds MAC Proj :0.149965549 seconds Nodal Proj :7.481781108 seconds Reactions :0.180549624 seconds Misc :0.076998978 seconds Base State :0.048452205 seconds Time to advance time step: 9.641895672 Writing plotfile 0 after all initialization inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.364227055 Calling Evolve() Timestep 1 starts with TIME = 0 DT = 0.0002885750885 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 300732039.4 MLMG: Initial residual (resid0) = 300732039.4 MLMG: Final Iter. 5 resid, resid/bnorm = 0.2849641293, 9.475682402e-10 MLMG: Timers: Solve = 0.045015604 Iter = 0.040668634 Bottom = 0.004898021 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 300732039.2 MLMG: Initial residual (resid0) = 0.4613403517 MLMG: Final Iter. 1 resid, resid/bnorm = 0.02874185051, 9.557295787e-11 MLMG: Timers: Solve = 0.0136583 Iter = 0.009511597 Bottom = 0.000896399 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 27933872.39 MLMG: Initial residual (resid0) = 27933872.39 MLMG: Final Iter. 5 resid, resid/bnorm = 0.001094802748, 3.919265948e-11 MLMG: Timers: Solve = 2.11162237 Iter = 2.06721757 Bottom = 0.000524537 Done calling nodal solver Timestep 1 ends with TIME = 0.0002885750885 DT = 0.0002885750885 Timing summary: Advection :1.766541654 seconds MAC Proj :0.140163589 seconds Nodal Proj :2.26889633 seconds Reactions :0.179119464 seconds Misc :0.074849255 seconds Base State :0.052121877 seconds Time to advance time step: 4.430188507 Writing plotfile 1 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.483620735 Call to estdt for level 0 gives dt_lev = 2.502711311 Call to estdt for level 1 gives dt_lev = 0.5259217834 Minimum estdt over all levels = 0.5259217834 Call to estdt at beginning of step 2 gives dt =0.5259217834 dt_growth factor limits the new dt = 0.0003174325974 Timestep 2 starts with TIME = 0.0002885750885 DT = 0.0003174325974 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 294777750.2 MLMG: Initial residual (resid0) = 294777750.2 MLMG: Final Iter. 5 resid, resid/bnorm = 0.2824536264, 9.581918114e-10 MLMG: Timers: Solve = 0.044987703 Iter = 0.040456476 Bottom = 0.004865777 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 294777750 MLMG: Initial residual (resid0) = 0.4034976006 MLMG: Final Iter. 1 resid, resid/bnorm = 0.02507372783, 8.505977073e-11 MLMG: Timers: Solve = 0.013883616 Iter = 0.009613457 Bottom = 0.000855665 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 21482439.4 MLMG: Initial residual (resid0) = 21482439.4 MLMG: Final Iter. 5 resid, resid/bnorm = 0.00126458313, 5.886590003e-11 MLMG: Timers: Solve = 2.11600809 Iter = 2.072014518 Bottom = 0.000527643 Done calling nodal solver Timestep 2 ends with TIME = 0.0006060076859 DT = 0.0003174325974 Timing summary: Advection :1.778937016 seconds MAC Proj :0.14003891 seconds Nodal Proj :2.27104996 seconds Reactions :0.180094063 seconds Misc :0.073460274 seconds Base State :0.056481745 seconds Time to advance time step: 4.444193872 Writing plotfile 2 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.366846227 Time to regrid: 0.05987427 Call to estdt for level 0 gives dt_lev = 3.210069119 Call to estdt for level 1 gives dt_lev = 0.6510223113 Minimum estdt over all levels = 0.6510223113 Call to estdt at beginning of step 3 gives dt =0.6510223113 dt_growth factor limits the new dt = 0.0003491758571 Timestep 3 starts with TIME = 0.0006060076859 DT = 0.0003491758571 Cell Count: Level 0, 262144 cells Level 1, 304128 cells inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 <<< STEP 1 : react state >>> <<< STEP 2 : make w0 >>> <<< STEP 3 : create MAC velocities >>> MLMG: Initial rhs = 292704984.1 MLMG: Initial residual (resid0) = 292704984.1 MLMG: Final Iter. 5 resid, resid/bnorm = 0.273159638, 9.332251001e-10 MLMG: Timers: Solve = 0.04494854 Iter = 0.040628177 Bottom = 0.004881141 <<< STEP 4 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 4a: thermal conduct >>> <<< STEP 5 : react state >>> <<< STEP 6 : make new S and new w0 >>> <<< STEP 7 : create MAC velocities >>> MLMG: Initial rhs = 292704983.8 MLMG: Initial residual (resid0) = 0.3807753602 MLMG: Final Iter. 1 resid, resid/bnorm = 0.02360978279, 8.066067917e-11 MLMG: Timers: Solve = 0.013677548 Iter = 0.009413722 Bottom = 0.000891296 <<< STEP 8 : advect base >>> : density_advance >>> : tracer_advance >>> : enthalpy_advance >>> <<< STEP 8a: thermal conduct >>> <<< STEP 9 : react state >>> <<< STEP 10: make new S >>> <<< STEP 11: update and project new velocity >>> Calling nodal solver MLMG: Initial rhs = 16800418.13 MLMG: Initial residual (resid0) = 16800418.13 MLMG: Final Iter. 5 resid, resid/bnorm = 0.001389111143, 8.268312921e-11 MLMG: Timers: Solve = 2.085979994 Iter = 2.04435617 Bottom = 0.00045789 Done calling nodal solver Timestep 3 ends with TIME = 0.0009551835431 DT = 0.0003491758571 Timing summary: Advection :1.761423455 seconds MAC Proj :0.139594934 seconds Nodal Proj :2.240798069 seconds Reactions :0.185991267 seconds Misc :0.072700623 seconds Base State :0.053507419 seconds Time to advance time step: 4.401080332 Writing plotfile 3 inner sponge: r_sp , r_tp : 151953125, 183203125 outer sponge: r_sp_outer, r_tp_outer: 183203125, 198828125 Time to write plotfile: 0.351709288 Total Time: 32.44675201 Unused ParmParse Variables: [TOP]::maestro.v(nvals = 1) :: [1] [TOP]::amr.check_file(nvals = 1) :: [wdconvect-amr_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB): 12056 Free GPU global memory (MB): 10129 [The Arena] space allocated (MB): 9042 [The Arena] space used (MB): 0 [The Device Arena] space allocated (MB): 8 [The Device Arena] space used (MB): 0 [The Pinned Arena] space allocated (MB): 33 [The Pinned Arena] space used (MB): 0 AMReX (23.01-18-gd6f8b2cce0fb) finalized