MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.03-31-g619630d18031) initialized Starting run at 05:38:17 UTC on 2022-03-25. Successfully read inputs file ... Castro git describe: 22.02-15-g933259a8d AMReX git describe: 22.03-31-g619630d18 Microphysics git describe: 22.03-11-g198df193 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.01395823 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.018401027 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.02973814 Gravity::fill_multipole_BCs() time = 0.029568186 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.600661298 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027936745 Gravity::solve_for_phi() time = 0.402443954 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -8.796435372e+22 ymom added: -5.666839779e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 2.748779069e+11 Castro::do_old_sources() time = 0.143961753 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.462939604 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026262025 Gravity::solve_for_phi() time = 0.360653887 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.156111486 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08271398838 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009271973 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009967509 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107753525 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048416461 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010605524 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01564863682 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008929142 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009115932 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106617091 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045721662 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010078384 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01454242966 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028606391 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010011739 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.148565982 Castro::reflux() at level 0 : time = 1.031902584 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 5.019620853 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009516583 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029558241 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028343665 Gravity::solve_for_phi() time = 0.405419055 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852869e+30 ymom added: 2.372403433e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.13235603 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.463257838 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025033602 Gravity::solve_for_phi() time = 0.350207354 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.15273933 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08415183175 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008461573 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009148093 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107614036 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043039521 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.009907359 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01636574349 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008167691 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.00911915 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106452289 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042876398 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.009908471 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01499545988 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028522236 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010052171 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770254e+28 zmom added: 8.082913462e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.146417962 Castro::reflux() at level 0 : time = 0.991677063 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.304893608 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009574978 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028385705 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029925012 Gravity::solve_for_phi() time = 0.382684867 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939025e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.133468505 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.438701889 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024326791 Gravity::solve_for_phi() time = 0.331274155 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.153819265 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08601982333 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008394051 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009245803 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106908031 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042961477 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010043503 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01645077832 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008522426 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.008926036 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105900371 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042836467 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.009878966 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01510811994 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028451253 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.009975172 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655088e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342334e+27 ymom added: 5.311566494e+28 zmom added: 5.31240218e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.14536634 Castro::reflux() at level 0 : time = 0.990332543 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.11786599 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009542779 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028573517 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029151464 Gravity::solve_for_phi() time = 0.381829194 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700663e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.130123712 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.435617354 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024647134 Gravity::solve_for_phi() time = 0.332598289 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.149323996 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08645015614 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008124432 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.008972774 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106571235 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043170004 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010026691 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0165137619 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008194451 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009037746 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106508263 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042861268 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010027612 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01505850885 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028428551 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010090219 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.44439047e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.14589533 Castro::reflux() at level 0 : time = 0.930584551 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.042208519 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009695688 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028543858 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029174817 Gravity::solve_for_phi() time = 0.381958414 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150497e+30 ymom added: 3.39980379e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.129648768 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.437408864 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027875795 Gravity::solve_for_phi() time = 0.337367971 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591232e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.15490663 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08620667985 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009039871 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009355174 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107941013 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044407341 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010276317 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01615559338 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008893171 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009202399 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107083123 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.0429859 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.009970545 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01499249129 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02843893 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010244004 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277777e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.145531348 Castro::reflux() at level 0 : time = 0.930711097 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.041106747 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009441821 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028865229 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029892121 Gravity::solve_for_phi() time = 0.383473068 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919306e+30 ymom added: 4.094511425e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.129963944 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.436239585 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024285423 Gravity::solve_for_phi() time = 0.332893531 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245024e+27 ymom added: -5.297264704e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.149188463 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08650196771 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008306755 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009000225 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106643445 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042716024 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.009944942 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01649396965 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008112648 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.008941408 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107377866 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.0429532 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.009933342 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0150870309 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028304989 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010165603 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781791e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.151099054 Castro::reflux() at level 0 : time = 0.941197928 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.03625568 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009667624 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028987333 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025034881 Gravity::solve_for_phi() time = 0.37744854 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151117e+30 ymom added: 4.515687996e+30 zmom added: 4.515608962e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.130172256 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.437219579 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024345187 Gravity::solve_for_phi() time = 0.329813335 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.88175262e+28 zmom added: -2.881735257e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.151240518 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08655592584 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008402331 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009039595 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106317294 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04291385 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.009891046 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01655070419 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008356254 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.00906406 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106335217 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042930569 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010044756 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01514906988 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028393727 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.009869218 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.145391213 Castro::reflux() at level 0 : time = 0.928754525 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.091137435 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009496815 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028390094 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02781018 Gravity::solve_for_phi() time = 0.380579245 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064107e+30 ymom added: 4.889542979e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.13006 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.437920789 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024350786 Gravity::solve_for_phi() time = 0.378007203 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.149263931 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08518729275 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008305803 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.008959496 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106304743 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042986737 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010043939 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01652899272 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007985965 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009019748 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10577277 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042812701 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010074106 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0151244398 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028347298 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.009928066 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478815e+29 ymom added: 5.931907363e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.145891205 Castro::reflux() at level 0 : time = 0.930414681 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.14198712 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009618436 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028244105 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027902832 Gravity::solve_for_phi() time = 0.380341772 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036359e+30 ymom added: 5.530451564e+30 zmom added: 5.530356437e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.13137411 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.437311413 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024498886 Gravity::solve_for_phi() time = 0.376637746 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170339e+28 zmom added: -5.061201607e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.149183344 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08516244715 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008417426 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.008943391 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106468141 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042975693 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010094055 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01652833881 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008376269 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009024083 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10606867 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043080267 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.009938883 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01517384462 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028664077 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.010032908 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.14567965 Castro::reflux() at level 0 : time = 0.929525361 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.150137883 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009595065 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028541619 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027887319 Gravity::solve_for_phi() time = 0.380732511 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167188e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.130154583 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.439713796 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024460508 Gravity::solve_for_phi() time = 0.37665843 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.151324841 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08523115411 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00804145 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009071342 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106720227 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048612653 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.01003311 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01616802194 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008282092 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009016926 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106439195 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048517404 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.009950591 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01486844328 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028439089 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.009902963 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914878e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.145703533 Castro::reflux() at level 0 : time = 0.992061774 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.222274822 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.544636197 seconds Ending run at 05:39:11 UTC on 2022-03-25. Run time = 54.05861094 Run time without initialization = 51.69567856 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.06 ... 54.06 ... 54.06 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.4083 16.4601 16.5399 30.60% MLPoisson::Fsmooth() 11992 4.168 4.337 4.735 8.76% Castro::reset_internal_energy() 257 2.968 3.032 3.118 5.77% MultiFab::AddProduct() 4648 2.62 2.629 2.638 4.88% FabArray::setVal() 9464 2.318 2.335 2.358 4.36% MLPoisson::Fapply() 2422 1.856 1.874 1.912 3.54% MLCellLinOp::applyBC() 14630 1.453 1.521 1.684 3.11% MultiFab::Subtract() 601 1.67 1.676 1.681 3.11% FabArray::ParallelCopy_nowait() 5320 1.387 1.41 1.431 2.65% FabArray::ParallelCopy_finish() 5320 0.5178 1.031 1.301 2.41% Castro::enforce_min_density() 254 1.037 1.096 1.197 2.21% Gravity::fill_multipole_BCs() 41 1.054 1.069 1.085 2.01% Castro::derive() 397 0.9276 0.9302 0.9318 1.72% MultiFab::sum() 4648 0.8584 0.8603 0.8639 1.60% FluxRegister::Reflux() 180 0.811 0.8114 0.8123 1.50% FillBoundary_finish() 13093 0.4364 0.674 0.8089 1.50% MultiFab::Xpay() 2190 0.712 0.7196 0.7339 1.36% Castro::reflux() 10 0.6909 0.6925 0.6956 1.29% FillBoundary_nowait() 13093 0.6514 0.6674 0.6923 1.28% Castro::construct_new_gravity_source() 50 0.5993 0.6045 0.6116 1.13% Castro::volWgtSum() 242 0.5161 0.5491 0.5724 1.06% CellConservativeLinear::interp() 130 0.3657 0.4546 0.5436 1.01% Castro::normalize_species() 254 0.5113 0.5147 0.5185 0.96% Castro::computeTemp() 257 0.4687 0.4717 0.4752 0.88% Castro::estTimeStep() 69 0.2286 0.3276 0.4694 0.87% MLPoisson::FFlux() 1043 0.3811 0.3814 0.3817 0.71% Castro::finalize_advance() 30 0.3469 0.352 0.3549 0.66% FillPatchSingleLevel 853 0.3258 0.3304 0.3397 0.63% Gravity::get_new_grav_vector() 52 0.329 0.331 0.3339 0.62% StateData::FillBoundary(geom) 63 0.3251 0.3266 0.3284 0.61% amrex::average_down 1713 0.2697 0.2729 0.2818 0.52% MLMG::addInterpCorrection() 1421 0.2581 0.2626 0.2752 0.51% MultiFab::Saxpy() 100 0.2741 0.2745 0.2748 0.51% FillPatchIterator::Initialize 723 0.2401 0.2618 0.2709 0.50% Castro::do_advance_ctu() 30 0.2157 0.2166 0.2174 0.40% MLMG::oneIter() 333 0.2119 0.2122 0.2126 0.39% Castro::expand_state() 30 0.1897 0.1901 0.1903 0.35% MLCellLinOp::defineAuxData() 81 0.1743 0.1777 0.1864 0.34% MLCellLinOp::reflux() 116 0.1747 0.1755 0.1773 0.33% VisMF::Write(FabArray) 4 0.1627 0.1663 0.1747 0.32% MLCellLinOp::compGrad() 100 0.1705 0.171 0.1718 0.32% MultiFab::min() 30 0.007125 0.1049 0.1664 0.31% Gravity::get_old_grav_vector() 30 0.1643 0.1648 0.1657 0.31% MultiFab::Multiply() 164 0.1461 0.1463 0.1465 0.27% FabArray::mult() 294 0.1372 0.1384 0.1394 0.26% Castro::construct_old_gravity_source() 30 0.1331 0.1335 0.1339 0.25% FabArray::setDomainBndry() 853 0.1267 0.1285 0.1317 0.24% Amr::writePlotFile() 2 0.1189 0.1256 0.1298 0.24% Castro::post_timestep() 30 0.07576 0.09593 0.1203 0.22% Castro::initData() 3 0.05822 0.085 0.1134 0.21% MLMG::ResNormInf() 450 0.09092 0.0996 0.1048 0.19% MultiFab::contains_nan() 60 0.09093 0.09154 0.09233 0.17% MultiFab::max() 40 0.0118 0.03275 0.09211 0.17% BndryData::define() 123 0.08695 0.08773 0.08897 0.16% MultiFab::LinComb() 628 0.07079 0.07594 0.08827 0.16% Castro::construct_old_gravity() 30 0.08702 0.0873 0.0875 0.16% MLMG::prepareForSolve() 80 0.08 0.08131 0.08426 0.16% Castro::evaluate_source_change() 591 0.07772 0.07824 0.07854 0.15% Gravity::test_level_grad_phi_curr() 20 0.07152 0.07197 0.0725 0.13% Gravity::gravity_sync() 10 0.07102 0.07128 0.07167 0.13% Castro::construct_new_gravity() 30 0.05291 0.0565 0.06425 0.12% MLCellLinOp::updateSolBC() 99 0.05672 0.05726 0.05769 0.11% MLCGSolver::bicgstab 83 0 0.01432 0.05727 0.11% Castro::volProductSum() 22 0.04828 0.0508 0.05357 0.10% MultiFab::norm0(mask) 57 0.04621 0.04637 0.0465 0.09% MLCellLinOp::updateCorBC() 78 0.04478 0.04528 0.04565 0.08% Gravity::create_comp_minus_level_grad_phi() 10 0.04486 0.04512 0.04534 0.08% FabArrayBase::CPC::define() 2260 0.02785 0.03195 0.04305 0.08% FabArrayBase::getCPC() 8152 0.041 0.0414 0.04182 0.08% MLCellLinOp::setLevelBC() 102 0.04023 0.04072 0.04151 0.08% Gravity::test_level_grad_phi_prev() 30 0.04036 0.04078 0.04115 0.08% Gravity::actual_solve_with_mlmg() 81 0.03704 0.03848 0.04092 0.08% MLMG::buildFineMask() 80 0.04028 0.0404 0.04055 0.08% MultiFab::Copy() 100 0.03919 0.03929 0.03935 0.07% Castro::initialize_do_advance() 30 0.03378 0.0365 0.03917 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03659 0.03779 0.03882 0.07% AmrMesh::MakeNewGrids() 11 0.03425 0.03541 0.0375 0.07% FabArray::FillBoundary() 13093 0.03101 0.03197 0.03426 0.06% Gravity::solve_for_phi() 60 0.02658 0.02863 0.03191 0.06% MLCellLinOp::prepareForSolve() 81 0.02464 0.02563 0.02812 0.05% MLCellLinOp::smooth() 5996 0.02585 0.02658 0.028 0.05% Castro::initialize_advance() 30 0.02549 0.0261 0.02688 0.05% Castro::init(old) 9 0.02605 0.02621 0.02638 0.05% Amr::defBaseLevel() 1 0.02105 0.02344 0.02589 0.05% FabArrayBase::getFB() 13093 0.02278 0.02342 0.02521 0.05% Gravity::update_max_rhs() 20 0.02388 0.02414 0.02448 0.05% MLCellLinOp::defineBC() 81 0.02368 0.024 0.02435 0.05% Castro::apply_tagging_restrictions() 11 0.02079 0.02181 0.02283 0.04% MLMG::interpCorrection_1 78 0.02265 0.02276 0.02283 0.04% Castro::finalize_do_advance() 30 0.002511 0.01521 0.02172 0.04% Castro::post_init() 2 0.0003979 0.009029 0.02011 0.04% Castro::build_fine_mask() 153 0.01811 0.01825 0.0184 0.03% StateData::define() 48 0.01487 0.01631 0.01774 0.03% FillPatchTwoLevels 394 0.01517 0.01576 0.01654 0.03% FabArray::ParallelCopy() 5320 0.0143 0.01449 0.01476 0.03% Castro::swap_state_time_levels() 30 0.01321 0.01347 0.01405 0.03% Gravity::actual_multilevel_solve() 10 0.01195 0.0121 0.01236 0.02% MLMG::MLRhsNormInf() 80 0.01185 0.0119 0.01197 0.02% MultiFab::Dot() 463 0 0.002774 0.0111 0.02% Amr::regrid() 10 0.009509 0.01009 0.01104 0.02% Gravity::GetCrsePhi() 40 0.009501 0.00974 0.009933 0.02% StateDataPhysBCFunct::() 853 0.008706 0.009177 0.009814 0.02% MLCellLinOp::apply() 2422 0.005682 0.006552 0.009029 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008254 0.00853 0.009004 0.02% Castro::apply_problem_tags() 11 0.007466 0.00761 0.007766 0.01% MLLinOp::defineGrids() 81 0.006796 0.007256 0.007604 0.01% Castro::FluxRegFineAdd() 30 0.00715 0.007257 0.007395 0.01% MLLinOp::makeSubCommunicator() 81 0.002555 0.005246 0.007162 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001778 0.007113 0.01% Castro::enforce_consistent_e() 3 0.003497 0.005494 0.006994 0.01% MLMG::solve() 80 0.003205 0.005043 0.006077 0.01% MLCellLinOp::correctionResidual() 1660 0.004577 0.004899 0.00576 0.01% Castro::do_new_sources() 50 0.0008601 0.002329 0.00556 0.01% AMRErrorTag::operator() 11 0.004634 0.004974 0.005322 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.00508 0.005099 0.005116 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004873 0.004914 0.004959 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004863 0.00488 0.004907 0.01% CGSolver::sxay() 588 0 0.001193 0.00477 0.01% main() 1 0.002724 0.003547 0.004373 0.01% Gravity::test_composite_phi() 1 0.003834 0.004015 0.00431 0.01% MLMG::mgVcycle() 489 0.003994 0.004076 0.004186 0.01% MLMG:computeResOfCorrection() 1421 0.003305 0.003361 0.003461 0.01% MLMG::actualBottomSolve() 333 0.0003925 0.001151 0.003417 0.01% Castro::do_old_sources() 30 0.0004983 0.001242 0.002657 0.00% Amr::InitAmr() 1 0.002483 0.002497 0.002511 0.00% FabArrayBase::FB::FB() 131 0.0008758 0.001266 0.002421 0.00% MLMG::mgVcycle_down::0 333 0.002268 0.002287 0.002308 0.00% MLMG::mgVcycle_down::1 333 0.002059 0.002135 0.002211 0.00% MLMG::mgVcycle_down::2 333 0.001901 0.001951 0.002031 0.00% FillPatchInterp(Fab) 130 0.001688 0.001862 0.001988 0.00% DistributionMapping::LeastUsedCPUs() 5 0.001266 0.001503 0.001979 0.00% MLCellLinOp::solutionResidual() 530 0.001898 0.00194 0.001977 0.00% Castro::subcycle_advance_ctu() 30 0.0001967 0.0006293 0.00192 0.00% Gravity::solve_phi_with_mlmg() 71 0.001612 0.001673 0.001792 0.00% TagBoxArray::collate() 11 0.0008938 0.001368 0.001692 0.00% OwnerMask() 11 0.001451 0.001557 0.001613 0.00% Castro::clean_state() 254 0.001559 0.001576 0.001601 0.00% MLMG::mgVcycle_up::0 333 0.001551 0.001572 0.001597 0.00% MLMG::mgVcycle_up::2 333 0.001327 0.001365 0.001457 0.00% MLMG::mgVcycle_up::1 333 0.001322 0.001367 0.00143 0.00% MLMG::mgVcycle_bottom 489 0.001293 0.001319 0.001345 0.00% MLMG::mgVcycle_down::3 211 0.001167 0.001218 0.00133 0.00% MLMG::mgVcycle_down::4 211 0.001128 0.001174 0.0013 0.00% makeSFC 243 0.00106 0.001189 0.001281 0.00% MLMG::MLResNormInf() 97 0.0007197 0.0008394 0.0009606 0.00% Amr::bldFineLevels() 1 0.0007716 0.0008437 0.0009289 0.00% MLMG::mgVcycle_up::4 211 0.0007481 0.0008049 0.0009243 0.00% TagBoxArray::mapPRD 11 0.000827 0.0008687 0.0008869 0.00% MLMG::mgVcycle_up::3 211 0.0007314 0.0007801 0.0008808 0.00% MLMG::computeResidual() 333 0.0008359 0.0008455 0.000854 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007574 0.0008025 0.0008524 0.00% Amr::coarseTimeStep() 10 0.0006267 0.0006821 0.0007187 0.00% MLPoisson::define() 81 0.0005719 0.0006412 0.000708 0.00% Amr::timeStep() 30 0.0004679 0.0005167 0.0006471 0.00% Castro::construct_new_source() 250 0.0005721 0.0006049 0.0006434 0.00% Amr::grid_places() 11 0.0005033 0.000541 0.0005785 0.00% FabArrayBase::TheFPinfo() 130 0.0005037 0.0005259 0.0005445 0.00% DistributionMapping::Distribute() 245 0.0004822 0.0004941 0.0005106 0.00% Castro::enforce_speed_limit() 254 0.0003986 0.0004078 0.0004205 0.00% MLPoisson::prepareForSolve() 81 0.0003328 0.000359 0.0003793 0.00% Castro::apply_source_to_state() 100 0.0003379 0.0003561 0.0003696 0.00% Castro::computeNewDt() 18 0.0001192 0.0001827 0.0003569 0.00% MLMG::computeMLResidual() 97 0.0002979 0.0003107 0.00032 0.00% MLLinOp::define() 81 0.0002829 0.0002916 0.0003007 0.00% Castro::construct_old_source() 150 0.0002907 0.0002932 0.0002955 0.00% MLMG::miniCycle() 156 0.0002744 0.0002787 0.0002846 0.00% AmrLevel::AmrLevel(dm) 12 0.000251 0.000259 0.0002715 0.00% Castro::advance() 30 0.0002058 0.0002284 0.0002707 0.00% Castro::post_regrid() 22 0.000234 0.0002473 0.0002646 0.00% MLMG::getGradSolution() 80 0.00025 0.0002562 0.0002621 0.00% ClusterList::intersect() 2 0 5.408e-05 0.0002163 0.00% Gravity::swapTimeLevels() 30 0.0001813 0.0001958 0.0002045 0.00% FabArray::RecvLayoutMask() 21 0.0001931 0.0001965 0.0001994 0.00% Castro::check_for_nan() 60 0.0001792 0.0001833 0.0001871 0.00% Castro::errorEst() 11 0.0001225 0.0001271 0.0001336 0.00% Castro::avgDown(state_indx) 44 0.0001121 0.0001172 0.0001196 0.00% FPinfo::FPinfo() 3 0.0001027 0.000108 0.0001129 0.00% Amr::FinalizeInit() 1 2.051e-05 4.37e-05 0.0001109 0.00% Gravity::solve_for_delta_phi 10 7.567e-05 8.643e-05 9.369e-05 0.00% Castro::create_source_corrector() 30 8.098e-05 8.53e-05 9.361e-05 0.00% amrex::average_down_w_geom 44 8.717e-05 9.002e-05 9.197e-05 0.00% AmrMesh-cluster 2 0 2.258e-05 9.034e-05 0.00% Castro::retry_advance_ctu() 30 4.868e-05 6.195e-05 7.427e-05 0.00% Amr::writeSmallPlotFile() 1 7.195e-05 7.231e-05 7.307e-05 0.00% knapsack() 3 6.13e-05 6.235e-05 6.394e-05 0.00% Castro::avgDown() 11 5.446e-05 5.819e-05 6.083e-05 0.00% Amr::initSubcycle() 1 3.499e-05 4.735e-05 5.958e-05 0.00% Castro::gwstrain() 22 3.841e-05 4.137e-05 4.796e-05 0.00% BoxList::parallelComplementIn() 22 3.946e-05 4.179e-05 4.394e-05 0.00% BoxList::complementIn 22 3.817e-05 3.919e-05 4.073e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.167e-05 3.564e-05 3.892e-05 0.00% DistributionMapping::KnapSackDoIt() 3 3.001e-05 3.167e-05 3.513e-05 0.00% Gravity::set_mass_offset() 11 2.598e-05 2.913e-05 3.303e-05 0.00% ClusterList::chop() 2 0 4.961e-06 1.984e-05 0.00% MLMG::compResidual() 1 1.158e-05 1.234e-05 1.341e-05 0.00% Castro::computeInitialDt() 2 1.159e-05 1.223e-05 1.266e-05 0.00% Amr::InitializeInit() 1 5.266e-06 7.565e-06 1.056e-05 0.00% Amr::init() 1 6.797e-06 7.831e-06 8.83e-06 0.00% knapsack()swap 2 4.862e-06 5.273e-06 6.049e-06 0.00% Amr::initialInit() 1 4.19e-06 4.592e-06 5.267e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.06 54.06 54.06 100.00% Amr::coarseTimeStep() 10 51.15 51.15 51.15 94.61% Amr::timeStep() 30 51.05 51.05 51.07 94.47% Castro::advance() 30 35.93 35.93 35.93 66.47% Castro::subcycle_advance_ctu() 30 34.16 34.18 34.19 63.25% Castro::do_advance_ctu() 30 34.16 34.18 34.19 63.25% Castro::construct_ctu_hydro_source() 30 16.41 16.46 16.54 30.60% Gravity::actual_solve_with_mlmg() 81 13.36 13.36 13.36 24.71% MLMG::solve() 80 12.64 12.65 12.66 23.41% Castro::post_timestep() 30 12.06 12.06 12.08 22.34% Castro::clean_state() 254 10.48 10.58 10.7 19.79% MLMG::oneIter() 333 10.65 10.66 10.68 19.76% Gravity::solve_phi_with_mlmg() 71 10.03 10.05 10.08 18.65% Castro::reflux() 10 9.576 9.589 9.598 17.75% MLMG::mgVcycle() 489 9.351 9.368 9.407 17.40% Gravity::solve_for_phi() 60 8.358 8.375 8.399 15.54% MLCellLinOp::smooth() 5996 6.423 6.558 6.93 12.82% Castro::computeTemp() 257 6.242 6.305 6.387 11.81% Castro::reset_internal_energy() 257 5.772 5.833 5.914 10.94% Castro::construct_new_gravity() 30 5.088 5.097 5.104 9.44% Gravity::gravity_sync() 10 5.06 5.06 5.06 9.36% Castro::construct_old_gravity() 30 4.719 4.732 4.748 8.78% MLPoisson::Fsmooth() 11992 4.168 4.337 4.735 8.76% Castro::evaluate_source_change() 591 4.483 4.497 4.517 8.36% Gravity::solve_for_delta_phi 10 4.245 4.246 4.246 7.86% MLMG::mgVcycle_down::0 333 3.992 4 4.016 7.43% Castro::enforce_min_density() 254 3.799 3.869 3.959 7.32% FillPatchIterator::Initialize 723 3.275 3.28 3.29 6.09% Castro::do_new_sources() 50 3.211 3.244 3.282 6.07% Amr::regrid() 10 3.127 3.171 3.191 5.90% Castro::post_regrid() 22 2.933 2.996 3.021 5.59% MLMG::mgVcycle_up::0 333 2.8 2.96 3.017 5.58% MLCellLinOp::applyBC() 14630 2.859 2.899 2.953 5.46% FabArray::ParallelCopy() 5320 2.019 2.506 2.771 5.13% MultiFab::AddProduct() 4648 2.62 2.629 2.638 4.88% MLCellLinOp::apply() 2422 2.506 2.518 2.544 4.71% Castro::initialize_do_advance() 30 2.493 2.507 2.519 4.66% Amr::init() 1 2.36 2.36 2.36 4.37% FabArray::setVal() 9464 2.318 2.335 2.358 4.36% FillPatchSingleLevel 853 2.198 2.235 2.254 4.17% MLPoisson::Fapply() 2422 1.856 1.874 1.912 3.54% MLCellLinOp::solutionResidual() 530 1.707 1.745 1.765 3.26% Amr::initialInit() 1 1.759 1.759 1.759 3.25% MLCellLinOp::correctionResidual() 1660 1.624 1.646 1.693 3.13% Gravity::multilevel_solve_for_new_phi() 10 1.681 1.681 1.681 3.11% MultiFab::Subtract() 601 1.67 1.676 1.681 3.11% Gravity::actual_multilevel_solve() 10 1.672 1.673 1.673 3.09% Castro::derive() 397 1.633 1.635 1.638 3.03% MLMG:computeResOfCorrection() 1421 1.489 1.503 1.537 2.84% FabArray::FillBoundary() 13093 1.191 1.398 1.515 2.80% Castro::do_old_sources() 30 1.489 1.492 1.499 2.77% FabArray::ParallelCopy_nowait() 5320 1.435 1.46 1.486 2.75% Amr::FinalizeInit() 1 1.319 1.358 1.463 2.71% Castro::volWgtSum() 242 1.326 1.359 1.383 2.56% Castro::initialize_advance() 30 1.36 1.365 1.369 2.53% FabArray::ParallelCopy_finish() 5320 0.5178 1.031 1.301 2.41% FillPatchTwoLevels 394 1.155 1.174 1.185 2.19% Castro::expand_state() 30 1.159 1.169 1.183 2.19% Amr::writePlotFile() 2 1.146 1.146 1.146 2.12% Gravity::fill_multipole_BCs() 41 1.091 1.106 1.121 2.07% FluxRegister::Reflux() 180 1.101 1.103 1.104 2.04% Castro::post_init() 2 0.9477 0.9682 1.028 1.90% Gravity::get_new_grav_vector() 52 0.9898 0.9956 0.9992 1.85% MLMG::addInterpCorrection() 1421 0.306 0.8226 0.9977 1.85% MLMG::computeResWithCrseSolFineCor() 78 0.9232 0.9237 0.924 1.71% MLMG::computeResidual() 333 0.8965 0.9133 0.9209 1.70% MultiFab::sum() 4648 0.8584 0.8603 0.8639 1.60% FillBoundary_finish() 13093 0.4364 0.674 0.8089 1.50% MLMG::mgVcycle_down::1 333 0.6928 0.7139 0.7736 1.43% MultiFab::Xpay() 2190 0.712 0.7196 0.7339 1.36% FillBoundary_nowait() 13093 0.675 0.6921 0.7199 1.33% MLCellLinOp::reflux() 116 0.6483 0.6503 0.6525 1.21% MLMG::mgVcycle_up::2 333 0.212 0.5385 0.6496 1.20% Castro::construct_new_source() 250 0.5999 0.6051 0.6122 1.13% Castro::construct_new_gravity_source() 50 0.5993 0.6045 0.6116 1.13% MLMG::computeMLResidual() 97 0.5832 0.6021 0.6107 1.13% FillPatchInterp(Fab) 130 0.3677 0.4565 0.5453 1.01% MLMG::mgVcycle_up::1 333 0.4744 0.4926 0.5452 1.01% CellConservativeLinear::interp() 130 0.3657 0.4546 0.5436 1.01% Gravity::get_old_grav_vector() 30 0.5197 0.523 0.5265 0.97% Castro::normalize_species() 254 0.5113 0.5147 0.5185 0.96% Castro::estTimeStep() 69 0.2286 0.3276 0.4694 0.87% Amr::InitializeInit() 1 0.2964 0.4007 0.4397 0.81% Amr::defBaseLevel() 1 0.2964 0.4007 0.4397 0.81% Castro::initData() 3 0.2671 0.3649 0.4085 0.76% Castro::finalize_advance() 30 0.3834 0.3907 0.404 0.75% MLPoisson::define() 81 0.3712 0.3792 0.3915 0.72% MLPoisson::FFlux() 1043 0.3811 0.3814 0.3817 0.71% StateDataPhysBCFunct::() 853 0.3339 0.3358 0.3383 0.63% StateData::FillBoundary(geom) 63 0.3251 0.3266 0.3284 0.61% MLMG::prepareForSolve() 80 0.3079 0.3127 0.3255 0.60% amrex::average_down 1713 0.2938 0.3009 0.3212 0.59% MLMG::mgVcycle_bottom 489 0.1622 0.2016 0.3199 0.59% Castro::apply_source_to_state() 100 0.2744 0.2748 0.2751 0.51% MultiFab::Saxpy() 100 0.2741 0.2745 0.2748 0.51% MLMG::mgVcycle_down::2 333 0.2474 0.2541 0.2742 0.51% MLCellLinOp::defineAuxData() 81 0.2155 0.2217 0.2381 0.44% Amr::bldFineLevels() 1 0.1734 0.2163 0.2314 0.43% MLMG::getGradSolution() 80 0.2159 0.2166 0.2172 0.40% MLCellLinOp::compGrad() 100 0.2157 0.2163 0.2169 0.40% MLMG::mgVcycle_down::3 211 0.0331 0.07377 0.194 0.36% VisMF::Write(FabArray) 4 0.1627 0.1663 0.1747 0.32% MultiFab::min() 30 0.007125 0.1049 0.1664 0.31% Castro::computeNewDt() 18 0.1344 0.1564 0.1648 0.30% MLMG::miniCycle() 156 0.1617 0.1621 0.1631 0.30% Castro::computeInitialDt() 2 0.01708 0.056 0.1604 0.30% MLMG::actualBottomSolve() 333 0.0003925 0.03946 0.1567 0.29% Castro::init(old) 9 0.15 0.151 0.1524 0.28% MLCGSolver::bicgstab 83 0 0.03763 0.1505 0.28% MultiFab::Multiply() 164 0.1461 0.1463 0.1465 0.27% MLCellLinOp::defineBC() 81 0.1403 0.1416 0.1432 0.26% FabArray::mult() 294 0.1372 0.1384 0.1394 0.26% MLMG::mgVcycle_up::3 211 0.02481 0.05341 0.1379 0.26% MLMG::ResNormInf() 450 0.1212 0.1299 0.135 0.25% Castro::construct_old_source() 150 0.1334 0.1338 0.1341 0.25% Castro::construct_old_gravity_source() 30 0.1331 0.1335 0.1339 0.25% FabArray::setDomainBndry() 853 0.1267 0.1285 0.1317 0.24% Gravity::update_max_rhs() 20 0.04601 0.06667 0.1257 0.23% Castro::volProductSum() 22 0.12 0.1227 0.1256 0.23% Amr::grid_places() 11 0.1144 0.1167 0.1186 0.22% AmrMesh::MakeNewGrids() 11 0.1139 0.1162 0.1181 0.22% BndryData::define() 123 0.1153 0.1164 0.1179 0.22% Gravity::GetCrsePhi() 40 0.09837 0.1024 0.1106 0.20% MLMG::computeResWithCrseCorFineCor() 78 0.1031 0.1041 0.1046 0.19% MLCellLinOp::updateSolBC() 99 0.08265 0.09078 0.09492 0.18% Castro::check_for_nan() 60 0.09111 0.09172 0.09251 0.17% MultiFab::contains_nan() 60 0.09093 0.09154 0.09233 0.17% MultiFab::max() 40 0.0118 0.03275 0.09211 0.17% MultiFab::LinComb() 628 0.07079 0.07594 0.08827 0.16% FabArrayBase::getCPC() 8152 0.06922 0.07335 0.08486 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08192 0.08205 0.08231 0.15% Gravity::test_level_grad_phi_curr() 20 0.08066 0.08122 0.0818 0.15% MLMG::mgVcycle_down::4 211 0.03174 0.04268 0.07356 0.14% MLCellLinOp::updateCorBC() 78 0.06308 0.06389 0.0643 0.12% Castro::errorEst() 11 0.05846 0.06115 0.0633 0.12% MLCellLinOp::setLevelBC() 102 0.05077 0.05866 0.06153 0.11% Gravity::test_composite_phi() 1 0.05987 0.05989 0.05992 0.11% MLMG::mgVcycle_up::4 211 0.0249 0.03326 0.05687 0.11% MLMG::buildFineMask() 80 0.04961 0.04976 0.04988 0.09% MLMG::interpCorrection_1 78 0.03139 0.04343 0.04859 0.09% Gravity::test_level_grad_phi_prev() 30 0.0456 0.04612 0.04663 0.09% MultiFab::norm0(mask) 57 0.04621 0.04637 0.0465 0.09% MLMG::MLResNormInf() 97 0.0431 0.04321 0.04336 0.08% FabArrayBase::CPC::define() 2260 0.02785 0.03195 0.04305 0.08% MultiFab::Copy() 100 0.03919 0.03929 0.03935 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03659 0.03779 0.03882 0.07% MLPoisson::prepareForSolve() 81 0.02502 0.02599 0.02845 0.05% MLCellLinOp::prepareForSolve() 81 0.02464 0.02563 0.02812 0.05% MLMG::MLRhsNormInf() 80 0.02797 0.02802 0.02807 0.05% FabArrayBase::getFB() 13093 0.02365 0.02469 0.02763 0.05% Gravity::swapTimeLevels() 30 0.02223 0.02259 0.02331 0.04% Castro::apply_tagging_restrictions() 11 0.02079 0.02181 0.02283 0.04% Castro::finalize_do_advance() 30 0.002511 0.01521 0.02172 0.04% CGSolver::sxay() 588 0 0.004892 0.01957 0.04% Castro::build_fine_mask() 153 0.01811 0.01825 0.0184 0.03% AmrLevel::AmrLevel(dm) 12 0.01512 0.01657 0.01801 0.03% StateData::define() 48 0.01487 0.01631 0.01774 0.03% TagBoxArray::mapPRD 11 0.005813 0.01182 0.01746 0.03% MLLinOp::define() 81 0.01193 0.01527 0.01741 0.03% MLLinOp::defineGrids() 81 0.01164 0.01498 0.01712 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.0142 0.01438 0.01462 0.03% MLMG::compResidual() 1 0.01373 0.01411 0.01436 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003549 0.0142 0.03% Castro::avgDown() 11 0.01355 0.0138 0.01417 0.03% Castro::avgDown(state_indx) 44 0.0135 0.01374 0.01411 0.03% Castro::swap_state_time_levels() 30 0.01321 0.01347 0.01405 0.03% amrex::average_down_w_geom 44 0.01338 0.01363 0.01399 0.03% MultiFab::Dot() 463 0 0.002774 0.0111 0.02% Castro::apply_problem_tags() 11 0.007466 0.00761 0.007766 0.01% Castro::FluxRegFineAdd() 30 0.00715 0.007257 0.007395 0.01% MLLinOp::makeSubCommunicator() 81 0.002555 0.005246 0.007162 0.01% Castro::enforce_consistent_e() 3 0.003497 0.005494 0.006994 0.01% AMRErrorTag::operator() 11 0.004634 0.004974 0.005322 0.01% FabArrayBase::TheFPinfo() 130 0.001799 0.002129 0.002679 0.00% MLLinOp::makeAgglomeratedDMap 81 0.002292 0.002476 0.002616 0.00% Amr::InitAmr() 1 0.002518 0.002544 0.002571 0.00% FabArrayBase::FB::FB() 131 0.0008758 0.001266 0.002421 0.00% FPinfo::FPinfo() 3 0.001274 0.001603 0.002148 0.00% DistributionMapping::KnapSackDoIt() 3 0.001171 0.001495 0.002037 0.00% DistributionMapping::LeastUsedCPUs() 5 0.001266 0.001503 0.001979 0.00% makeSFC 243 0.001534 0.001674 0.001764 0.00% TagBoxArray::collate() 11 0.0008938 0.001368 0.001692 0.00% OwnerMask() 11 0.001451 0.001557 0.001613 0.00% DistributionMapping::Distribute() 245 0.0004822 0.0004941 0.0005106 0.00% Castro::enforce_speed_limit() 254 0.0003986 0.0004078 0.0004205 0.00% AmrMesh-cluster 2 0 8.163e-05 0.0003265 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.157e-05 0.0001527 0.0002389 0.00% ClusterList::intersect() 2 0 5.408e-05 0.0002163 0.00% FabArray::RecvLayoutMask() 21 0.0001931 0.0001965 0.0001994 0.00% Castro::create_source_corrector() 30 8.098e-05 8.53e-05 9.361e-05 0.00% BoxList::parallelComplementIn() 22 7.838e-05 8.099e-05 8.468e-05 0.00% Castro::retry_advance_ctu() 30 4.868e-05 6.195e-05 7.427e-05 0.00% Amr::writeSmallPlotFile() 1 7.195e-05 7.231e-05 7.307e-05 0.00% knapsack() 3 6.694e-05 6.762e-05 6.917e-05 0.00% Amr::initSubcycle() 1 3.499e-05 4.735e-05 5.958e-05 0.00% Castro::gwstrain() 22 3.841e-05 4.137e-05 4.796e-05 0.00% BoxList::complementIn 22 3.817e-05 3.919e-05 4.073e-05 0.00% Gravity::set_mass_offset() 11 2.598e-05 2.913e-05 3.303e-05 0.00% ClusterList::chop() 2 0 4.961e-06 1.984e-05 0.00% knapsack()swap 2 4.862e-06 5.273e-06 6.049e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.03-31-g619630d18031) finalized