MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.02-15-g067830e6c9fe) initialized Starting run at 06:34:53 UTC on 2022-02-28. Successfully read inputs file ... Castro git describe: 22.02-4-g0d942c92d AMReX git describe: 22.02-15-g067830e6c Microphysics git describe: 22.02-10-g1a114f0a reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.01083983 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.011219093 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.031423447 Gravity::fill_multipole_BCs() time = 0.029201841 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.598043675 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034689717 Gravity::solve_for_phi() time = 0.406921437 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -7.250787575e+22 ymom added: -5.666839779e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.137635822 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.480162384 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028177548 Gravity::solve_for_phi() time = 0.34095452 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.156742265 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08308689694 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008619079 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009279569 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108398781 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04528497 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010168371 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01600195961 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008679673 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009254668 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106493877 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045229906 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010164581 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01476213171 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.0285355 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010125623 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.15041451 Castro::reflux() at level 0 : time = 1.017954011 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.957434827 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009893897 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02976021 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.035267167 Gravity::solve_for_phi() time = 0.394940729 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852863e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.134143021 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.474921763 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027794129 Gravity::solve_for_phi() time = 0.340092414 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.15042225 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0844365962 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008327829 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009438651 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107178645 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045046303 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010160773 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01618227372 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008691749 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009274288 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106575885 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044931278 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010155605 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01495312489 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029732447 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010138554 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770255e+28 zmom added: 8.082913464e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.148347825 Castro::reflux() at level 0 : time = 1.013243278 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.324067435 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009855973 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029176761 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034153378 Gravity::solve_for_phi() time = 0.393907942 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939012e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.13318632 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.484831243 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026614009 Gravity::solve_for_phi() time = 0.347827923 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.157377728 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08374586022 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009354576 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009346498 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.11263012 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046408652 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010687599 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01563011862 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008716956 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009459326 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108592473 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045155636 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010222961 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0145469608 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.031978651 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.01015373 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655087e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342329e+27 ymom added: 5.311566494e+28 zmom added: 5.31240218e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.148373505 Castro::reflux() at level 0 : time = 1.019130117 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.242585303 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009907669 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029506251 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033815224 Gravity::solve_for_phi() time = 0.393556342 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700667e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.133268158 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.478868813 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027402092 Gravity::solve_for_phi() time = 0.339352066 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.153987103 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08435630849 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008590305 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009254644 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107058217 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044992229 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010148597 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01618662016 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008725948 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009231636 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107115435 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046390043 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010177658 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01484690998 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029597566 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010113801 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.44439047e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.148655886 Castro::reflux() at level 0 : time = 0.954497474 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.141306951 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009892809 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029139726 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034537288 Gravity::solve_for_phi() time = 0.394936603 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150484e+30 ymom added: 3.399803865e+30 zmom added: 3.399742172e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.136497426 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.475876159 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027601562 Gravity::solve_for_phi() time = 0.340089325 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591232e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.154499412 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08427998756 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008717075 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009269011 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106986845 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044975499 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010147862 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01626826218 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008659295 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009238611 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107267138 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044806892 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010133517 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01487169242 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029517727 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010120689 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277777e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.148329328 Castro::reflux() at level 0 : time = 0.953235126 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.141679926 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009873852 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029502062 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033714765 Gravity::solve_for_phi() time = 0.393396596 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919313e+30 ymom added: 4.094511425e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.13335378 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.479941804 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027829531 Gravity::solve_for_phi() time = 0.339428623 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245024e+27 ymom added: -5.297264731e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.153456731 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08434060624 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008272777 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009229336 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107083013 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044820069 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.010177151 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01624001937 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00841639 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009204671 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106788344 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044908633 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010137832 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01491432901 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029330703 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010150997 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781791e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.148529782 Castro::reflux() at level 0 : time = 0.953422637 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.152205302 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.00986971 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029141437 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033322184 Gravity::solve_for_phi() time = 0.393132452 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151128e+30 ymom added: 4.515687996e+30 zmom added: 4.515608962e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.13326015 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.481084765 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030428467 Gravity::solve_for_phi() time = 0.342466658 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.88175262e+28 zmom added: -2.881735255e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.149381968 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08429853677 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008302316 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009196731 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106925448 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044785936 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010176753 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01631666419 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008639389 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009265198 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107287245 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045052902 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010209635 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01487009475 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029678806 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.010170891 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.149009028 Castro::reflux() at level 0 : time = 0.959377609 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.276582222 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009902338 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029155638 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033466251 Gravity::solve_for_phi() time = 0.393091795 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.89006409e+30 ymom added: 4.889542941e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.133378359 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.478803559 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027033405 Gravity::solve_for_phi() time = 0.386944911 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642725e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.148630614 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08317218207 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008400605 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009201043 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106226425 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045111716 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.01019215 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01632043192 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008681609 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009238197 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106567752 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044869623 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010135385 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01491589254 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029515685 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010140524 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907363e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.148415782 Castro::reflux() at level 0 : time = 0.954359262 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.258528824 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009862915 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02979248 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034491365 Gravity::solve_for_phi() time = 0.393916175 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036353e+30 ymom added: 5.53045164e+30 zmom added: 5.530356588e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.133083055 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.478909544 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031215438 Gravity::solve_for_phi() time = 0.390935904 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170338e+28 zmom added: -5.061201607e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.148542998 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08316175719 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008485652 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009260514 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10659373 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044934216 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010159465 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01631663098 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00885248 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009244439 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106321275 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044989469 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.010151221 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01492791477 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029365759 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.010188092 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.148141259 Castro::reflux() at level 0 : time = 0.953442322 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.260031134 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009899142 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029541132 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032779433 Gravity::solve_for_phi() time = 0.392927665 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167168e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.133447975 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.47859181 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027408595 Gravity::solve_for_phi() time = 0.386942549 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.148584278 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08323336383 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008669934 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009239806 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106508369 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.052323536 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010173528 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01583980077 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00881624 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009221309 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107365222 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.050807479 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010213814 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01456822573 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02963274 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010214724 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.76591487e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.148516072 Castro::reflux() at level 0 : time = 1.013498812 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.331748836 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.55291256 seconds Ending run at 06:35:48 UTC on 2022-02-28. Run time = 54.86716108 Run time without initialization = 52.63356895 Average number of zones advanced per microsecond: 0.051 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.87 ... 54.87 ... 54.87 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.5439 16.7222 16.9392 30.87% MLPoisson::Fsmooth() 11992 4.128 4.248 4.467 8.14% Castro::reset_internal_energy() 257 2.907 2.992 3.121 5.69% MultiFab::AddProduct() 4648 2.627 2.66 2.692 4.91% FabArray::setVal() 9464 2.312 2.349 2.393 4.36% MLPoisson::Fapply() 2422 1.845 1.972 2.158 3.93% MLCellLinOp::applyBC() 14630 1.454 1.538 1.725 3.14% MultiFab::Subtract() 601 1.653 1.673 1.695 3.09% FabArray::ParallelCopy_nowait() 5320 1.357 1.395 1.429 2.60% FabArray::ParallelCopy_finish() 5320 0.5184 1.162 1.418 2.58% Gravity::fill_multipole_BCs() 41 1.083 1.154 1.206 2.20% Castro::enforce_min_density() 254 1.023 1.067 1.146 2.09% Castro::derive() 397 0.923 0.9337 0.941 1.72% MultiFab::sum() 4648 0.8383 0.8484 0.8591 1.57% FluxRegister::Reflux() 180 0.8182 0.8305 0.8427 1.54% FillBoundary_finish() 13093 0.4537 0.6581 0.8251 1.50% MultiFab::Xpay() 2190 0.7377 0.7526 0.7767 1.42% Castro::reflux() 10 0.6912 0.7015 0.7122 1.30% FillBoundary_nowait() 13093 0.6275 0.65 0.6655 1.21% Castro::construct_new_gravity_source() 50 0.6043 0.6084 0.6131 1.12% CellConservativeLinear::interp() 130 0.3797 0.4605 0.5407 0.99% Castro::normalize_species() 254 0.512 0.522 0.5376 0.98% Castro::volWgtSum() 242 0.4933 0.5142 0.5351 0.98% Castro::computeTemp() 257 0.467 0.4754 0.4823 0.88% MultiFab::min() 30 0.007112 0.2438 0.4393 0.80% Castro::estTimeStep() 69 0.2208 0.3306 0.4084 0.74% MLPoisson::FFlux() 1044 0.3914 0.3975 0.4032 0.73% Castro::finalize_advance() 30 0.3461 0.3555 0.3683 0.67% Gravity::get_new_grav_vector() 52 0.3278 0.334 0.3418 0.62% FillPatchSingleLevel 853 0.3281 0.3315 0.3357 0.61% StateData::FillBoundary(geom) 63 0.3232 0.3276 0.332 0.61% MLMG::addInterpCorrection() 1421 0.2705 0.2796 0.2973 0.54% amrex::average_down 1713 0.2713 0.2799 0.2967 0.54% MultiFab::Saxpy() 100 0.2713 0.2748 0.2783 0.51% FillPatchIterator::Initialize 723 0.2511 0.2623 0.2706 0.49% Castro::post_timestep() 30 0.1251 0.1754 0.2325 0.42% Castro::do_advance_ctu() 30 0.214 0.2171 0.22 0.40% MLMG::oneIter() 333 0.2113 0.214 0.2166 0.39% MLCellLinOp::defineAuxData() 81 0.1696 0.1774 0.1941 0.35% Castro::expand_state() 30 0.1894 0.1914 0.1935 0.35% MLCellLinOp::reflux() 116 0.172 0.1746 0.1782 0.32% MLCellLinOp::compGrad() 100 0.1728 0.175 0.1774 0.32% VisMF::Write(FabArray) 4 0.1645 0.1681 0.1768 0.32% MLMG::ResNormInf() 450 0.09152 0.1353 0.1728 0.32% Gravity::get_old_grav_vector() 30 0.163 0.1664 0.1711 0.31% MultiFab::Multiply() 164 0.1455 0.1472 0.1491 0.27% FabArray::mult() 294 0.1441 0.146 0.1479 0.27% Castro::construct_old_gravity_source() 30 0.1361 0.1392 0.1417 0.26% FabArray::setDomainBndry() 853 0.1325 0.1361 0.1407 0.26% Amr::writePlotFile() 2 0.1149 0.1262 0.1358 0.25% Castro::initData() 3 0.05752 0.07275 0.1047 0.19% MultiFab::contains_nan() 60 0.09088 0.09242 0.09381 0.17% BndryData::define() 123 0.08708 0.08864 0.09078 0.17% Castro::construct_old_gravity() 30 0.08582 0.08727 0.08878 0.16% MLMG::prepareForSolve() 80 0.0798 0.08268 0.08681 0.16% MultiFab::LinComb() 628 0.06461 0.06933 0.08124 0.15% Castro::evaluate_source_change() 591 0.07667 0.07829 0.07981 0.15% Gravity::gravity_sync() 10 0.0709 0.07192 0.07319 0.13% Gravity::test_level_grad_phi_curr() 20 0.07087 0.07199 0.073 0.13% Castro::construct_new_gravity() 30 0.05249 0.05776 0.06345 0.12% MLCGSolver::bicgstab 83 0 0.01549 0.06195 0.11% MLCellLinOp::updateSolBC() 99 0.05784 0.05877 0.0601 0.11% Castro::volProductSum() 22 0.04587 0.05 0.05434 0.10% MultiFab::max() 40 0.0125 0.02387 0.05395 0.10% MLCellLinOp::updateCorBC() 78 0.04568 0.04648 0.04771 0.09% MultiFab::norm0(mask) 57 0.046 0.04661 0.04724 0.09% FabArrayBase::CPC::define() 2260 0.02772 0.03296 0.04666 0.09% Gravity::actual_solve_with_mlmg() 81 0.0366 0.04067 0.04627 0.08% Gravity::create_comp_minus_level_grad_phi() 10 0.04452 0.04529 0.04615 0.08% FabArrayBase::getCPC() 8152 0.04109 0.0425 0.04531 0.08% MLCellLinOp::setLevelBC() 102 0.04027 0.04117 0.04251 0.08% Castro::initialize_do_advance() 30 0.03423 0.03765 0.04158 0.08% Gravity::test_level_grad_phi_prev() 30 0.04025 0.0408 0.04138 0.08% MLMG::buildFineMask() 80 0.03873 0.03942 0.04006 0.07% MultiFab::Copy() 100 0.03862 0.03918 0.03981 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03614 0.03722 0.03882 0.07% AmrMesh::MakeNewGrids() 11 0.03613 0.03641 0.03676 0.07% FabArray::FillBoundary() 13093 0.03087 0.03271 0.03596 0.07% Gravity::solve_for_phi() 60 0.0262 0.02944 0.03335 0.06% MLCellLinOp::prepareForSolve() 81 0.02445 0.0268 0.03275 0.06% MLCellLinOp::smooth() 5996 0.02596 0.0274 0.03046 0.06% Castro::post_init() 2 0.0003511 0.01354 0.02849 0.05% FabArrayBase::getFB() 13093 0.02293 0.02461 0.02848 0.05% Castro::initialize_advance() 30 0.02564 0.02615 0.02712 0.05% Castro::init(old) 9 0.02615 0.02637 0.02666 0.05% MLCellLinOp::defineBC() 81 0.02386 0.02456 0.02589 0.05% Gravity::update_max_rhs() 20 0.02356 0.02413 0.02506 0.05% MLMG::interpCorrection_1 78 0.02259 0.02323 0.02442 0.04% Amr::defBaseLevel() 1 0.02095 0.02203 0.02353 0.04% Castro::apply_tagging_restrictions() 11 0.02092 0.02123 0.02153 0.04% FillPatchTwoLevels 394 0.01488 0.01695 0.01934 0.04% Castro::build_fine_mask() 153 0.01826 0.01862 0.01894 0.03% MLMG::solve() 80 0.002762 0.01159 0.01832 0.03% Castro::finalize_do_advance() 30 0.007338 0.01305 0.0182 0.03% StateData::define() 48 0.01473 0.01558 0.01661 0.03% FabArray::ParallelCopy() 5320 0.01432 0.01486 0.01593 0.03% Castro::swap_state_time_levels() 30 0.01323 0.01353 0.01408 0.03% Gravity::actual_multilevel_solve() 10 0.01179 0.01201 0.01227 0.02% StateDataPhysBCFunct::() 853 0.01023 0.01131 0.0121 0.02% MLMG::MLRhsNormInf() 80 0.01169 0.01186 0.01203 0.02% MultiFab::Dot() 463 0 0.002867 0.01147 0.02% Amr::regrid() 10 0.009388 0.009921 0.01128 0.02% Gravity::GetCrsePhi() 40 0.009599 0.009826 0.01002 0.02% MLCellLinOp::apply() 2422 0.005714 0.006814 0.009869 0.02% MLLinOp::makeSubCommunicator() 81 0.002134 0.006204 0.008931 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008277 0.008552 0.008808 0.02% MLCGSolver::ParallelAllReduce 692 0 0.002184 0.008736 0.02% Castro::apply_problem_tags() 11 0.007572 0.007655 0.007732 0.01% MLLinOp::defineGrids() 81 0.006963 0.007109 0.007354 0.01% Castro::enforce_consistent_e() 3 0.003466 0.004564 0.007354 0.01% Castro::FluxRegFineAdd() 30 0.007048 0.00717 0.007315 0.01% MLCellLinOp::correctionResidual() 1660 0.004602 0.005023 0.005971 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004837 0.004992 0.00528 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005088 0.005163 0.005234 0.01% CGSolver::sxay() 588 0 0.001289 0.005157 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004839 0.004917 0.005003 0.01% AMRErrorTag::operator() 11 0.004799 0.004847 0.004893 0.01% MLMG::mgVcycle() 489 0.004076 0.004271 0.004704 0.01% Castro::do_new_sources() 50 0.0008732 0.001876 0.004212 0.01% Gravity::test_composite_phi() 1 0.003728 0.003933 0.004167 0.01% MLMG::actualBottomSolve() 333 0.0003881 0.001267 0.003877 0.01% MLMG:computeResOfCorrection() 1421 0.003357 0.00353 0.003864 0.01% Castro::do_old_sources() 30 0.0004955 0.001245 0.003145 0.01% main() 1 0.002593 0.002763 0.002887 0.01% FillPatchInterp(Fab) 130 0.001709 0.002074 0.002844 0.01% FabArrayBase::FB::FB() 131 0.0008743 0.001326 0.002647 0.00% DistributionMapping::LeastUsedCPUs() 5 8.213e-05 0.001631 0.002483 0.00% MLMG::mgVcycle_down::0 333 0.002217 0.002309 0.002459 0.00% MLMG::mgVcycle_down::1 333 0.002046 0.002157 0.002359 0.00% MLMG::mgVcycle_down::2 333 0.001875 0.001991 0.002209 0.00% Amr::InitAmr() 1 0.002086 0.002091 0.0021 0.00% MLCellLinOp::solutionResidual() 530 0.00191 0.001981 0.002054 0.00% Gravity::solve_phi_with_mlmg() 71 0.001564 0.001713 0.00197 0.00% TagBoxArray::collate() 11 0.0009532 0.001442 0.001868 0.00% MLMG::mgVcycle_up::0 333 0.001538 0.001619 0.00175 0.00% Castro::clean_state() 254 0.001525 0.001622 0.001697 0.00% Castro::subcycle_advance_ctu() 30 0.0001944 0.0005751 0.001688 0.00% MLMG::mgVcycle_up::2 333 0.001315 0.001409 0.001616 0.00% MLMG::mgVcycle_up::1 333 0.001349 0.001427 0.001595 0.00% OwnerMask() 11 0.001462 0.001497 0.001523 0.00% MLMG::MLResNormInf() 97 0.0004801 0.001007 0.001509 0.00% MLMG::mgVcycle_bottom 489 0.001263 0.001335 0.001447 0.00% MLMG::mgVcycle_down::3 211 0.00114 0.001249 0.001447 0.00% MLMG::mgVcycle_down::4 211 0.00109 0.001195 0.001417 0.00% makeSFC 243 0.001111 0.001151 0.001183 0.00% MLMG::mgVcycle_up::4 211 0.0007676 0.0008398 0.001002 0.00% MLMG::mgVcycle_up::3 211 0.0007285 0.0008112 0.0009991 0.00% TagBoxArray::mapPRD 11 0.0008589 0.0008808 0.0009095 0.00% MLMG::computeResidual() 333 0.000846 0.0008691 0.0008947 0.00% Amr::bldFineLevels() 1 0.0007286 0.0007726 0.0008096 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007799 0.0007966 0.0008067 0.00% Amr::coarseTimeStep() 10 0.00066 0.0007074 0.0007533 0.00% MLPoisson::define() 81 0.0006247 0.0006464 0.0006589 0.00% Amr::grid_places() 11 0.0004896 0.000559 0.000624 0.00% Castro::construct_new_source() 250 0.000575 0.0005957 0.0006239 0.00% Amr::timeStep() 30 0.00045 0.0004998 0.0006232 0.00% FabArrayBase::TheFPinfo() 130 0.0005087 0.0005282 0.0005504 0.00% DistributionMapping::Distribute() 245 0.000492 0.0005014 0.0005197 0.00% Castro::enforce_speed_limit() 254 0.0003875 0.0004044 0.000416 0.00% Castro::apply_source_to_state() 100 0.0003325 0.0003601 0.0004018 0.00% MLPoisson::prepareForSolve() 81 0.0003511 0.000364 0.000378 0.00% Castro::computeNewDt() 18 0.0001162 0.0001812 0.0003697 0.00% MLMG::computeMLResidual() 97 0.0002997 0.0003183 0.0003351 0.00% Castro::construct_old_source() 150 0.0002816 0.0003 0.0003133 0.00% MLLinOp::define() 81 0.0002914 0.0002973 0.0003032 0.00% Castro::post_regrid() 22 0.0002371 0.0002622 0.0002977 0.00% AmrLevel::AmrLevel(dm) 12 0.0002512 0.0002673 0.0002874 0.00% MLMG::miniCycle() 156 0.0002698 0.0002792 0.0002867 0.00% MLMG::getGradSolution() 80 0.000262 0.0002696 0.0002757 0.00% ClusterList::intersect() 2 0 6.039e-05 0.0002416 0.00% Castro::advance() 30 0.0002082 0.0002179 0.0002391 0.00% FabArray::RecvLayoutMask() 21 0.0001935 0.0002016 0.0002167 0.00% Gravity::swapTimeLevels() 30 0.0001886 0.0001929 0.0001984 0.00% Castro::check_for_nan() 60 0.0001832 0.0001868 0.0001923 0.00% Castro::errorEst() 11 0.0001207 0.0001265 0.0001365 0.00% Castro::avgDown(state_indx) 44 0.0001121 0.0001197 0.0001276 0.00% FPinfo::FPinfo() 3 0.0001053 0.0001091 0.0001137 0.00% AmrMesh-cluster 2 0 2.582e-05 0.0001033 0.00% amrex::average_down_w_geom 44 8.632e-05 9.128e-05 9.869e-05 0.00% Gravity::solve_for_delta_phi 10 8.561e-05 8.896e-05 9.442e-05 0.00% Amr::FinalizeInit() 1 2.053e-05 3.927e-05 9.175e-05 0.00% Castro::create_source_corrector() 30 8.293e-05 8.596e-05 8.797e-05 0.00% Amr::writeSmallPlotFile() 1 7.031e-05 7.171e-05 7.283e-05 0.00% Castro::retry_advance_ctu() 30 5.083e-05 5.806e-05 6.989e-05 0.00% Castro::avgDown() 11 5.459e-05 5.928e-05 6.728e-05 0.00% knapsack() 3 5.991e-05 6.286e-05 6.592e-05 0.00% Amr::initSubcycle() 1 3.581e-05 4.328e-05 5.559e-05 0.00% BoxList::parallelComplementIn() 22 4.127e-05 4.435e-05 5.145e-05 0.00% Castro::gwstrain() 22 3.652e-05 4.122e-05 4.75e-05 0.00% BoxList::complementIn 22 3.845e-05 3.988e-05 4.174e-05 0.00% Gravity::set_mass_offset() 11 2.78e-05 3.387e-05 4.052e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.131e-05 3.537e-05 3.774e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.817e-05 3.008e-05 3.189e-05 0.00% ClusterList::chop() 2 0 5.516e-06 2.206e-05 0.00% Amr::initialInit() 1 4.333e-06 7.522e-06 1.653e-05 0.00% Amr::InitializeInit() 1 6.465e-06 9.409e-06 1.528e-05 0.00% MLMG::compResidual() 1 1.225e-05 1.287e-05 1.368e-05 0.00% Castro::computeInitialDt() 2 1.114e-05 1.23e-05 1.343e-05 0.00% Amr::init() 1 5.254e-06 6.41e-06 7.668e-06 0.00% knapsack()swap 2 5.084e-06 5.384e-06 5.918e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.87 54.87 54.87 100.00% Amr::coarseTimeStep() 10 52.08 52.08 52.08 94.92% Amr::timeStep() 30 51.99 52 52 94.78% Castro::advance() 30 36.58 36.59 36.59 66.68% Castro::subcycle_advance_ctu() 30 34.8 34.82 34.84 63.50% Castro::do_advance_ctu() 30 34.8 34.82 34.84 63.50% Castro::construct_ctu_hydro_source() 30 16.54 16.72 16.94 30.87% Gravity::actual_solve_with_mlmg() 81 13.53 13.54 13.54 24.68% MLMG::solve() 80 12.8 12.81 12.82 23.37% Castro::post_timestep() 30 12.29 12.29 12.3 22.42% Castro::clean_state() 254 10.38 10.55 10.77 19.63% MLMG::oneIter() 333 10.69 10.7 10.72 19.53% Gravity::solve_phi_with_mlmg() 71 10.15 10.22 10.28 18.74% Castro::reflux() 10 9.726 9.757 9.793 17.85% MLMG::mgVcycle() 489 9.356 9.367 9.381 17.10% Gravity::solve_for_phi() 60 8.463 8.536 8.592 15.66% MLCellLinOp::smooth() 5996 6.313 6.443 6.7 12.21% Castro::computeTemp() 257 6.154 6.282 6.437 11.73% Castro::reset_internal_energy() 257 5.687 5.807 5.959 10.86% Castro::construct_new_gravity() 30 5.166 5.179 5.189 9.46% Gravity::gravity_sync() 10 5.161 5.161 5.161 9.41% Castro::construct_old_gravity() 30 4.784 4.835 4.866 8.87% Castro::evaluate_source_change() 591 4.468 4.523 4.577 8.34% MLPoisson::Fsmooth() 11992 4.128 4.248 4.467 8.14% Gravity::solve_for_delta_phi 10 4.325 4.326 4.327 7.89% MLMG::mgVcycle_down::0 333 3.906 3.964 4.032 7.35% Castro::enforce_min_density() 254 3.766 3.842 3.95 7.20% FillPatchIterator::Initialize 723 3.322 3.344 3.371 6.14% Castro::do_new_sources() 50 3.197 3.256 3.314 6.04% Amr::regrid() 10 3.141 3.163 3.189 5.81% Castro::post_regrid() 22 2.943 2.997 3.033 5.53% MLMG::mgVcycle_up::0 333 2.706 2.909 2.99 5.45% MLCellLinOp::applyBC() 14630 2.791 2.881 2.975 5.42% FabArray::ParallelCopy() 5320 2.022 2.623 2.837 5.17% MLCellLinOp::apply() 2422 2.515 2.616 2.791 5.09% MultiFab::AddProduct() 4648 2.627 2.66 2.692 4.91% Castro::initialize_do_advance() 30 2.491 2.514 2.55 4.65% FabArray::setVal() 9464 2.312 2.349 2.393 4.36% FillPatchSingleLevel 853 2.271 2.29 2.31 4.21% Amr::init() 1 2.231 2.231 2.231 4.07% MLPoisson::Fapply() 2422 1.845 1.972 2.158 3.93% MLCellLinOp::solutionResidual() 530 1.783 1.823 1.861 3.39% MLCellLinOp::correctionResidual() 1660 1.652 1.711 1.832 3.34% MultiFab::Subtract() 601 1.653 1.673 1.695 3.09% Gravity::multilevel_solve_for_new_phi() 10 1.693 1.693 1.693 3.09% Gravity::actual_multilevel_solve() 10 1.684 1.684 1.685 3.07% MLMG:computeResOfCorrection() 1421 1.479 1.55 1.679 3.06% Castro::derive() 397 1.631 1.643 1.653 3.01% Amr::initialInit() 1 1.633 1.633 1.633 2.98% FabArray::FillBoundary() 13093 1.178 1.367 1.531 2.79% Castro::do_old_sources() 30 1.478 1.502 1.526 2.78% FabArray::ParallelCopy_nowait() 5320 1.405 1.446 1.487 2.71% FabArray::ParallelCopy_finish() 5320 0.5184 1.162 1.418 2.58% Castro::initialize_advance() 30 1.349 1.364 1.384 2.52% Amr::FinalizeInit() 1 1.242 1.278 1.349 2.46% Castro::volWgtSum() 242 1.303 1.331 1.348 2.46% Gravity::fill_multipole_BCs() 41 1.121 1.191 1.243 2.27% FillPatchTwoLevels 394 1.152 1.18 1.198 2.18% Castro::expand_state() 30 1.178 1.184 1.191 2.17% Amr::writePlotFile() 2 1.151 1.151 1.151 2.10% FluxRegister::Reflux() 180 1.136 1.138 1.139 2.08% MLMG::addInterpCorrection() 1421 0.3297 0.8762 1.061 1.93% Gravity::get_new_grav_vector() 52 1.003 1.011 1.019 1.86% MLMG::computeResidual() 333 0.9162 0.9429 0.9775 1.78% Castro::post_init() 2 0.9316 0.9435 0.9745 1.78% MLMG::computeResWithCrseSolFineCor() 78 0.9704 0.9714 0.9728 1.77% MultiFab::sum() 4648 0.8383 0.8484 0.8591 1.57% FillBoundary_finish() 13093 0.4537 0.6581 0.8251 1.50% MLMG::mgVcycle_down::1 333 0.7302 0.7579 0.782 1.43% MultiFab::Xpay() 2190 0.7377 0.7526 0.7767 1.42% FillBoundary_nowait() 13093 0.6513 0.6759 0.6902 1.26% MLCellLinOp::reflux() 116 0.6673 0.6775 0.6854 1.25% MLMG::mgVcycle_up::2 333 0.2186 0.5636 0.6806 1.24% MLMG::computeMLResidual() 97 0.6142 0.644 0.6635 1.21% Castro::construct_new_source() 250 0.6049 0.609 0.6137 1.12% Castro::construct_new_gravity_source() 50 0.6043 0.6084 0.6131 1.12% FillPatchInterp(Fab) 130 0.3817 0.4626 0.5424 0.99% Gravity::get_old_grav_vector() 30 0.5316 0.5378 0.5419 0.99% CellConservativeLinear::interp() 130 0.3797 0.4605 0.5407 0.99% MLMG::mgVcycle_up::1 333 0.4697 0.4879 0.5398 0.98% Castro::normalize_species() 254 0.512 0.522 0.5376 0.98% MultiFab::min() 30 0.007112 0.2438 0.4393 0.80% MLPoisson::define() 81 0.3702 0.3816 0.4085 0.74% Castro::estTimeStep() 69 0.2208 0.3306 0.4084 0.74% Castro::finalize_advance() 30 0.3954 0.4009 0.4066 0.74% MLPoisson::FFlux() 1044 0.3914 0.3975 0.4032 0.73% Amr::InitializeInit() 1 0.2838 0.3546 0.3905 0.71% Amr::defBaseLevel() 1 0.2838 0.3546 0.3905 0.71% Castro::initData() 3 0.2561 0.3234 0.3626 0.66% StateDataPhysBCFunct::() 853 0.3335 0.3389 0.3437 0.63% amrex::average_down 1713 0.2953 0.3083 0.3376 0.62% MLMG::prepareForSolve() 80 0.3057 0.3163 0.3361 0.61% StateData::FillBoundary(geom) 63 0.3232 0.3276 0.332 0.61% MLMG::mgVcycle_bottom 489 0.1644 0.2065 0.3318 0.60% MLMG::mgVcycle_down::2 333 0.2567 0.2658 0.2828 0.52% Castro::apply_source_to_state() 100 0.2717 0.2751 0.2786 0.51% MultiFab::Saxpy() 100 0.2713 0.2748 0.2783 0.51% MLCellLinOp::defineAuxData() 81 0.2107 0.2224 0.2492 0.45% MLMG::getGradSolution() 80 0.2197 0.2212 0.2231 0.41% MLCellLinOp::compGrad() 100 0.2194 0.221 0.2228 0.41% MLMG::ResNormInf() 450 0.1222 0.1657 0.2028 0.37% MLMG::mgVcycle_down::3 211 0.03301 0.07546 0.2005 0.37% Castro::computeNewDt() 18 0.13 0.1616 0.1856 0.34% VisMF::Write(FabArray) 4 0.1645 0.1681 0.1768 0.32% MLMG::actualBottomSolve() 333 0.0003881 0.04223 0.1677 0.31% MLMG::miniCycle() 156 0.1639 0.1643 0.1646 0.30% Amr::bldFineLevels() 1 0.1578 0.1597 0.1613 0.29% MLCGSolver::bicgstab 83 0 0.04027 0.1611 0.29% Castro::init(old) 9 0.15 0.1516 0.1537 0.28% MultiFab::Multiply() 164 0.1455 0.1472 0.1491 0.27% FabArray::mult() 294 0.1441 0.146 0.1479 0.27% MLCellLinOp::defineBC() 81 0.1399 0.1425 0.1467 0.27% Castro::construct_old_source() 150 0.1363 0.1395 0.142 0.26% MLMG::mgVcycle_up::3 211 0.02484 0.05451 0.142 0.26% Castro::construct_old_gravity_source() 30 0.1361 0.1392 0.1417 0.26% FabArray::setDomainBndry() 853 0.1325 0.1361 0.1407 0.26% Castro::volProductSum() 22 0.1171 0.1222 0.1273 0.23% Castro::computeInitialDt() 2 0.01532 0.05122 0.122 0.22% BndryData::define() 123 0.1148 0.1168 0.1196 0.22% MLCellLinOp::updateSolBC() 99 0.0837 0.1013 0.1126 0.21% Amr::grid_places() 11 0.1101 0.1106 0.1112 0.20% AmrMesh::MakeNewGrids() 11 0.1095 0.11 0.1106 0.20% MLMG::computeResWithCrseCorFineCor() 78 0.1052 0.1072 0.1086 0.20% Gravity::GetCrsePhi() 40 0.09133 0.09914 0.1049 0.19% Castro::check_for_nan() 60 0.09107 0.09261 0.094 0.17% MultiFab::contains_nan() 60 0.09088 0.09242 0.09381 0.17% FabArrayBase::getCPC() 8152 0.06881 0.07546 0.09197 0.17% Gravity::update_max_rhs() 20 0.0471 0.05844 0.08783 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08127 0.08241 0.08362 0.15% Gravity::test_level_grad_phi_curr() 20 0.08042 0.0817 0.08283 0.15% MultiFab::LinComb() 628 0.06461 0.06933 0.08124 0.15% MLMG::mgVcycle_down::4 211 0.0316 0.04369 0.07756 0.14% MLCellLinOp::setLevelBC() 102 0.05193 0.065 0.06965 0.13% MLCellLinOp::updateCorBC() 78 0.06366 0.0656 0.06661 0.12% Castro::errorEst() 11 0.05892 0.05941 0.05981 0.11% MLMG::mgVcycle_up::4 211 0.02491 0.03406 0.05979 0.11% Gravity::test_composite_phi() 1 0.05963 0.05964 0.05966 0.11% MultiFab::max() 40 0.0125 0.02387 0.05395 0.10% MLMG::buildFineMask() 80 0.0482 0.04895 0.04974 0.09% MultiFab::norm0(mask) 57 0.046 0.04661 0.04724 0.09% Gravity::test_level_grad_phi_prev() 30 0.04578 0.04645 0.04713 0.09% FabArrayBase::CPC::define() 2260 0.02772 0.03296 0.04666 0.09% MLMG::MLResNormInf() 97 0.04316 0.04335 0.04357 0.08% MLMG::interpCorrection_1 78 0.03283 0.03732 0.04086 0.07% MultiFab::Copy() 100 0.03862 0.03918 0.03981 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03614 0.03722 0.03882 0.07% MLPoisson::prepareForSolve() 81 0.0248 0.02716 0.03312 0.06% MLCellLinOp::prepareForSolve() 81 0.02445 0.0268 0.03275 0.06% FabArrayBase::getFB() 13093 0.02381 0.02594 0.03113 0.06% MLMG::MLRhsNormInf() 80 0.02776 0.02814 0.02853 0.05% Gravity::swapTimeLevels() 30 0.02225 0.02266 0.02325 0.04% Castro::apply_tagging_restrictions() 11 0.02092 0.02123 0.02153 0.04% CGSolver::sxay() 588 0 0.005027 0.02011 0.04% Castro::build_fine_mask() 153 0.01826 0.01862 0.01894 0.03% MLLinOp::define() 81 0.01187 0.01605 0.01875 0.03% MLLinOp::defineGrids() 81 0.01158 0.01575 0.01845 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.0143 0.01656 0.01835 0.03% Castro::finalize_do_advance() 30 0.007338 0.01305 0.0182 0.03% AmrLevel::AmrLevel(dm) 12 0.01499 0.01585 0.01687 0.03% StateData::define() 48 0.01473 0.01558 0.01661 0.03% MLCGSolver::ParallelAllReduce 692 0 0.004018 0.01607 0.03% MLMG::compResidual() 1 0.01412 0.01435 0.01498 0.03% Castro::avgDown() 11 0.01421 0.01449 0.01476 0.03% Castro::avgDown(state_indx) 44 0.01415 0.01443 0.01471 0.03% amrex::average_down_w_geom 44 0.01404 0.01431 0.01458 0.03% Castro::swap_state_time_levels() 30 0.01323 0.01353 0.01408 0.03% MultiFab::Dot() 463 0 0.002867 0.01147 0.02% MLLinOp::makeSubCommunicator() 81 0.002134 0.006204 0.008931 0.02% Castro::apply_problem_tags() 11 0.007572 0.007655 0.007732 0.01% Castro::enforce_consistent_e() 3 0.003466 0.004564 0.007354 0.01% Castro::FluxRegFineAdd() 30 0.007048 0.00717 0.007315 0.01% TagBoxArray::mapPRD 11 0.005728 0.006306 0.0071 0.01% AMRErrorTag::operator() 11 0.004799 0.004847 0.004893 0.01% FabArrayBase::TheFPinfo() 130 0.0007603 0.002274 0.003094 0.01% FabArrayBase::FB::FB() 131 0.0008743 0.001326 0.002647 0.00% FPinfo::FPinfo() 3 0.0002452 0.001746 0.002556 0.00% MLLinOp::makeAgglomeratedDMap 81 0.002404 0.00244 0.0025 0.00% DistributionMapping::LeastUsedCPUs() 5 8.213e-05 0.001631 0.002483 0.00% DistributionMapping::KnapSackDoIt() 3 0.0001399 0.001637 0.002446 0.00% Amr::InitAmr() 1 0.002124 0.002134 0.002156 0.00% TagBoxArray::collate() 11 0.0009532 0.001442 0.001868 0.00% makeSFC 243 0.001602 0.001643 0.001694 0.00% OwnerMask() 11 0.001462 0.001497 0.001523 0.00% DistributionMapping::Distribute() 245 0.000492 0.0005014 0.0005197 0.00% Castro::enforce_speed_limit() 254 0.0003875 0.0004044 0.000416 0.00% AmrMesh-cluster 2 0 9.173e-05 0.0003669 0.00% ClusterList::intersect() 2 0 6.039e-05 0.0002416 0.00% FabArray::RecvLayoutMask() 21 0.0001935 0.0002016 0.0002167 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.329e-05 0.0001371 0.0001856 0.00% BoxList::parallelComplementIn() 22 7.98e-05 8.423e-05 9.319e-05 0.00% Castro::create_source_corrector() 30 8.293e-05 8.596e-05 8.797e-05 0.00% Amr::writeSmallPlotFile() 1 7.031e-05 7.171e-05 7.283e-05 0.00% knapsack() 3 6.506e-05 6.824e-05 7.117e-05 0.00% Castro::retry_advance_ctu() 30 5.083e-05 5.806e-05 6.989e-05 0.00% Amr::initSubcycle() 1 3.581e-05 4.328e-05 5.559e-05 0.00% Castro::gwstrain() 22 3.652e-05 4.122e-05 4.75e-05 0.00% BoxList::complementIn 22 3.845e-05 3.988e-05 4.174e-05 0.00% Gravity::set_mass_offset() 11 2.78e-05 3.387e-05 4.052e-05 0.00% ClusterList::chop() 2 0 5.516e-06 2.206e-05 0.00% knapsack()swap 2 5.084e-06 5.384e-06 5.918e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.02-15-g067830e6c9fe) finalized