MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.04-18-ga537fb0516d5) initialized Starting run at 05:40:11 UTC on 2022-04-13. Successfully read inputs file ... Castro git describe: 22.04-2-gb74783602 AMReX git describe: 22.04-18-ga537fb051 Microphysics git describe: 22.04-1-gef526ccd reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.016543896 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.019477637 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.04976569 Gravity::fill_multipole_BCs() time = 0.029023989 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.603469172 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.037507318 Gravity::solve_for_phi() time = 0.412122998 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -7.813209155e+22 ymom added: -5.289050461e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.152025566 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.432444416 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025275551 Gravity::solve_for_phi() time = 0.343972419 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.16639906 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08294367476 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009496664 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009598951 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110328465 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045951127 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010443791 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01558158419 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00839583 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009581079 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107206497 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.050377859 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010689019 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01429834228 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028409957 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010190259 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.152700126 Castro::reflux() at level 0 : time = 1.03173267 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 5.020511023 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009781094 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02961975 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030119343 Gravity::solve_for_phi() time = 0.394275861 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852862e+30 ymom added: 2.372403433e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.141580521 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.43742445 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02643805 Gravity::solve_for_phi() time = 0.340009422 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.153672072 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08448562958 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008630629 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009336349 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106464381 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046299813 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010239989 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01619052779 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008329263 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009431532 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106452389 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044580233 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010351203 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01494256613 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029309261 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010246446 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809893e+28 ymom added: 8.089770254e+28 zmom added: 8.082913463e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.152411093 Castro::reflux() at level 0 : time = 1.027207315 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.323449652 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009920509 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029345474 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027811112 Gravity::solve_for_phi() time = 0.378206686 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939032e+30 ymom added: 2.692725481e+30 zmom added: 2.692687173e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.143487231 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.457946418 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025214244 Gravity::solve_for_phi() time = 0.333301483 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.154026014 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0849568542 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008683893 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.010008131 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109397015 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045112602 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010540859 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01586121272 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008190166 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009328473 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105788615 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043291826 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010263358 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01487223553 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028740943 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010182524 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655087e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342336e+27 ymom added: 5.311566493e+28 zmom added: 5.31240218e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.150916963 Castro::reflux() at level 0 : time = 0.999812766 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.196942472 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009594774 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028369137 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029963291 Gravity::solve_for_phi() time = 0.375613227 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700675e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.135358957 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.430562473 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025044949 Gravity::solve_for_phi() time = 0.325659665 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.123378679e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.149711112 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08633701476 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008351835 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009178983 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105940543 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042804869 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010129307 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01647570105 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008287993 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009155206 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106682952 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043049573 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010061756 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01506677818 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028595112 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.01002617 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.149983485 Castro::reflux() at level 0 : time = 0.93588515 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.068951608 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009800118 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02841113 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031720796 Gravity::solve_for_phi() time = 0.378973291 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150486e+30 ymom added: 3.39980379e+30 zmom added: 3.399742172e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.137705334 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.433111744 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025235221 Gravity::solve_for_phi() time = 0.326915405 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591232e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.150767174 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08581175692 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00824189 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009265488 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106089459 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042928043 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010099179 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01646292729 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008313514 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009331691 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105956952 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043102723 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010071716 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0149801656 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028400468 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010108615 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277776e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.150068077 Castro::reflux() at level 0 : time = 0.936450646 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.090801586 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009780469 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028762104 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029225049 Gravity::solve_for_phi() time = 0.376012969 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.09491932e+30 ymom added: 4.094511425e+30 zmom added: 4.094439154e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.135156075 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.434843779 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024669314 Gravity::solve_for_phi() time = 0.326122162 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245021e+27 ymom added: -5.297264722e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.14994937 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08621139116 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007853937 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009203622 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106188819 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043123514 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.010159835 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01645144837 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00816655 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009161974 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106206154 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043132775 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010375383 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01505240185 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02855872 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010070537 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.149891644 Castro::reflux() at level 0 : time = 0.936718554 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.0910756 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009893319 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028710543 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028482569 Gravity::solve_for_phi() time = 0.37598056 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151121e+30 ymom added: 4.515687996e+30 zmom added: 4.515608962e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.135320014 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.436866531 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025833055 Gravity::solve_for_phi() time = 0.327894065 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.881752619e+28 zmom added: -2.881735257e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.150240117 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08603230814 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008100753 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009267038 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105822573 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042912627 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010159557 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01647732082 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009246552 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009312913 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106203022 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043102053 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010209636 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01498493409 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028230152 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.010049733 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.150730977 Castro::reflux() at level 0 : time = 0.938029972 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.165402349 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009869595 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028648164 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028435986 Gravity::solve_for_phi() time = 0.373917766 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064077e+30 ymom added: 4.889542941e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.135326021 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.428732025 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024596517 Gravity::solve_for_phi() time = 0.372144076 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642725e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.154265007 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08501648848 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008118074 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009288973 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105972728 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042957307 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010283499 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01643362745 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008189905 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009258412 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1064514 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042584592 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010087279 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01511401703 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028568987 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010075287 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907354e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.150592729 Castro::reflux() at level 0 : time = 0.937399251 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.198234463 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009866933 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028726203 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028114615 Gravity::solve_for_phi() time = 0.373230109 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036345e+30 ymom added: 5.530451715e+30 zmom added: 5.530356286e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.135589539 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.434721776 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025583957 Gravity::solve_for_phi() time = 0.372613618 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170339e+28 zmom added: -5.061201607e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.154715 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08481212047 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00828114 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009466985 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105754144 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043251961 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010118012 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01626913276 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00819958 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009226001 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105280524 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044676274 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.010045332 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01495895846 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028316607 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.010303918 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.14959318 Castro::reflux() at level 0 : time = 0.937194603 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.20806955 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009922372 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028662752 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028812374 Gravity::solve_for_phi() time = 0.374216981 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167193e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.135544718 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.429653462 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025146567 Gravity::solve_for_phi() time = 0.370467694 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.154469538 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08508056148 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00807756 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009160023 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106498127 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.050015409 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010051903 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01601444071 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00811047 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009151204 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106026225 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.050712374 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010485431 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01465244602 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029128194 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010152896 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914867e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.15024218 Castro::reflux() at level 0 : time = 1.00045299 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.276552378 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.54791492 seconds Ending run at 05:41:06 UTC on 2022-04-13. Run time = 54.63223961 Run time without initialization = 52.16337844 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.63 ... 54.63 ... 54.63 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.3856 16.4198 16.4883 30.18% MLPoisson::Fsmooth() 11992 4.17 4.249 4.424 8.10% Castro::reset_internal_energy() 257 3.008 3.055 3.11 5.69% MultiFab::AddProduct() 4648 2.634 2.654 2.675 4.90% FabArray::setVal() 9464 2.459 2.472 2.505 4.59% MLPoisson::Fapply() 2422 1.847 1.872 1.913 3.50% MLCellLinOp::applyBC() 14630 1.491 1.557 1.749 3.20% MultiFab::Subtract() 601 1.683 1.69 1.698 3.11% FabArray::ParallelCopy_nowait() 5320 1.378 1.4 1.421 2.60% FabArray::ParallelCopy_finish() 5320 0.5349 1.055 1.334 2.44% Castro::enforce_min_density() 254 1.048 1.088 1.172 2.15% Gravity::fill_multipole_BCs() 41 1.076 1.106 1.126 2.06% Castro::derive() 397 0.9266 0.9298 0.9387 1.72% MultiFab::sum() 4648 0.887 0.893 0.899 1.65% Castro::normalize_species() 254 0.8096 0.8261 0.8547 1.56% FluxRegister::Reflux() 180 0.8126 0.8148 0.8172 1.50% MultiFab::Xpay() 2190 0.73 0.7358 0.7501 1.37% Castro::reflux() 10 0.6935 0.6975 0.7015 1.28% FillBoundary_nowait() 13093 0.6622 0.6739 0.6842 1.25% Castro::construct_new_gravity_source() 50 0.592 0.6009 0.6122 1.12% FillBoundary_finish() 13093 0.4961 0.5446 0.5812 1.06% Castro::volWgtSum() 242 0.5479 0.5598 0.5696 1.04% CellConservativeLinear::interp() 130 0.3663 0.4512 0.5365 0.98% Castro::computeTemp() 257 0.4648 0.4724 0.4806 0.88% Castro::estTimeStep() 69 0.2329 0.3989 0.4794 0.88% MLPoisson::FFlux() 1046 0.3808 0.3822 0.3831 0.70% Castro::finalize_advance() 30 0.3483 0.3545 0.3634 0.67% Gravity::get_new_grav_vector() 52 0.3333 0.3345 0.3355 0.61% FillPatchSingleLevel 853 0.3258 0.3294 0.3312 0.61% StateData::FillBoundary(geom) 63 0.3226 0.3246 0.3287 0.60% MLMG::addInterpCorrection() 1421 0.2687 0.273 0.2856 0.52% amrex::average_down 1713 0.2688 0.2748 0.2831 0.52% MultiFab::Saxpy() 100 0.2755 0.2767 0.2786 0.51% FillPatchIterator::Initialize 723 0.2645 0.2687 0.2728 0.50% Castro::post_timestep() 30 0.06729 0.1117 0.2388 0.44% Castro::do_advance_ctu() 30 0.2181 0.2185 0.2194 0.40% MLMG::oneIter() 333 0.2097 0.21 0.2103 0.38% Castro::expand_state() 30 0.1915 0.192 0.1923 0.35% MLCellLinOp::defineAuxData() 81 0.1754 0.1796 0.1869 0.34% VisMF::Write(FabArray) 4 0.1645 0.1707 0.1845 0.34% MLCellLinOp::reflux() 116 0.1716 0.1752 0.1776 0.33% MLCellLinOp::compGrad() 100 0.1694 0.1702 0.1714 0.31% Gravity::get_old_grav_vector() 30 0.1676 0.169 0.1706 0.31% FabArray::mult() 294 0.1422 0.1436 0.145 0.27% Castro::construct_old_gravity_source() 30 0.1398 0.141 0.143 0.26% MultiFab::Multiply() 164 0.1407 0.1408 0.1411 0.26% Amr::writePlotFile() 2 0.1139 0.1252 0.1354 0.25% FabArray::setDomainBndry() 853 0.1287 0.1306 0.1318 0.24% MultiFab::min() 30 0.007226 0.08248 0.1231 0.23% MultiFab::max() 40 0.01317 0.06262 0.1161 0.21% MLMG::ResNormInf() 450 0.09397 0.09865 0.1013 0.19% MultiFab::contains_nan() 60 0.0937 0.09442 0.09583 0.18% BndryData::define() 123 0.08954 0.09076 0.09206 0.17% Castro::construct_old_gravity() 30 0.08761 0.08839 0.08893 0.16% MLMG::prepareForSolve() 80 0.07966 0.0809 0.08305 0.15% MultiFab::LinComb() 628 0.06341 0.06788 0.07933 0.15% Castro::evaluate_source_change() 591 0.07695 0.07783 0.07921 0.14% Gravity::test_level_grad_phi_curr() 20 0.07153 0.07202 0.07249 0.13% Castro::initData() 3 0.05804 0.06548 0.07228 0.13% Gravity::gravity_sync() 10 0.07123 0.07186 0.07227 0.13% MLCellLinOp::updateSolBC() 99 0.05667 0.05763 0.05826 0.11% Castro::construct_new_gravity() 30 0.0531 0.05464 0.05789 0.11% MLCGSolver::bicgstab 83 0 0.0142 0.0568 0.10% Castro::volProductSum() 22 0.04733 0.05003 0.05243 0.10% MultiFab::norm0(mask) 57 0.04713 0.04774 0.04833 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04588 0.04651 0.04745 0.09% Castro::initialize_do_advance() 30 0.03606 0.04039 0.04614 0.08% MLCellLinOp::updateCorBC() 78 0.04487 0.04558 0.04607 0.08% FabArrayBase::CPC::define() 2260 0.02751 0.03176 0.04294 0.08% Gravity::test_level_grad_phi_prev() 30 0.04145 0.0419 0.04283 0.08% Gravity::actual_solve_with_mlmg() 81 0.03725 0.04084 0.04257 0.08% FabArrayBase::getCPC() 8152 0.04124 0.04164 0.04208 0.08% MLCellLinOp::setLevelBC() 102 0.04065 0.04095 0.04141 0.08% Gravity::solve_for_phi() 60 0.02678 0.03215 0.04096 0.07% AmrMesh::MakeNewGrids() 11 0.03937 0.03991 0.04044 0.07% MultiFab::Copy() 100 0.03948 0.03963 0.03978 0.07% MLMG::buildFineMask() 80 0.03898 0.03907 0.03925 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03577 0.03634 0.03732 0.07% FabArray::FillBoundary() 13093 0.03072 0.03178 0.03434 0.06% Amr::coarseTimeStep() 10 0.001321 0.02546 0.03356 0.06% MLCellLinOp::prepareForSolve() 81 0.02459 0.02557 0.02804 0.05% MLCellLinOp::smooth() 5996 0.02589 0.02632 0.02721 0.05% Castro::init(old) 9 0.02634 0.0264 0.02646 0.05% Castro::initialize_advance() 30 0.02563 0.02599 0.02623 0.05% FabArrayBase::getFB() 13093 0.02217 0.02307 0.02521 0.05% MLCellLinOp::defineBC() 81 0.02409 0.02427 0.02464 0.05% Gravity::update_max_rhs() 20 0.02385 0.02418 0.02444 0.04% Castro::apply_tagging_restrictions() 11 0.02398 0.02412 0.02429 0.04% Amr::defBaseLevel() 1 0.02021 0.02134 0.02345 0.04% MLMG::interpCorrection_1 78 0.02258 0.02265 0.02274 0.04% StateDataPhysBCFunct::() 853 0.01822 0.02042 0.02195 0.04% Castro::finalize_do_advance() 30 0.01402 0.01729 0.01996 0.04% Castro::build_fine_mask() 153 0.01892 0.01899 0.01914 0.04% FillPatchTwoLevels 394 0.01517 0.01632 0.01808 0.03% Castro::post_init() 2 0.0006149 0.009292 0.01717 0.03% StateData::define() 48 0.01434 0.01521 0.01617 0.03% FabArray::ParallelCopy() 5320 0.01421 0.01436 0.01472 0.03% Castro::swap_state_time_levels() 30 0.01298 0.01326 0.01364 0.02% Gravity::actual_multilevel_solve() 10 0.01206 0.01225 0.01251 0.02% MLMG::MLRhsNormInf() 80 0.01211 0.01216 0.01224 0.02% MultiFab::Dot() 463 0 0.002817 0.01127 0.02% Amr::regrid() 10 0.009835 0.01014 0.01096 0.02% Gravity::GetCrsePhi() 40 0.00957 0.009718 0.009887 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008225 0.008466 0.009118 0.02% MLCellLinOp::apply() 2422 0.005687 0.00655 0.009058 0.02% Castro::apply_problem_tags() 11 0.008835 0.008939 0.00903 0.02% MLLinOp::defineGrids() 81 0.007369 0.007857 0.008176 0.01% Castro::FluxRegFineAdd() 30 0.007343 0.007413 0.00756 0.01% MLLinOp::makeSubCommunicator() 81 0.002241 0.005363 0.007315 0.01% MLCGSolver::ParallelAllReduce 692 0 0.0018 0.0072 0.01% Castro::enforce_consistent_e() 3 0.006462 0.006818 0.007159 0.01% MLMG::solve() 80 0.004933 0.005817 0.006881 0.01% MLCellLinOp::correctionResidual() 1660 0.004709 0.005017 0.005875 0.01% AMRErrorTag::operator() 11 0.0052 0.005267 0.005311 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005137 0.005152 0.005166 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004951 0.004981 0.005013 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004893 0.004908 0.004914 0.01% CGSolver::sxay() 588 0 0.001206 0.004824 0.01% main() 1 0.002572 0.004223 0.004811 0.01% MLMG::mgVcycle() 489 0.003914 0.00407 0.004296 0.01% Gravity::test_composite_phi() 1 0.003803 0.004025 0.004268 0.01% Castro::do_new_sources() 50 0.0009053 0.001854 0.003956 0.01% MLMG:computeResOfCorrection() 1421 0.003265 0.003353 0.003448 0.01% MLMG::actualBottomSolve() 333 0.0003902 0.001124 0.003317 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0007176 0.001825 0.00266 0.00% FillPatchInterp(Fab) 130 0.001736 0.001998 0.002637 0.00% FabArrayBase::FB::FB() 131 0.0008568 0.001264 0.002429 0.00% Castro::do_old_sources() 30 0.0005105 0.001054 0.00233 0.00% MLMG::mgVcycle_down::0 333 0.002277 0.002292 0.002298 0.00% MLMG::mgVcycle_down::1 333 0.002072 0.002104 0.00218 0.00% MLMG::MLResNormInf() 97 0.0004479 0.001446 0.002165 0.00% Amr::InitAmr() 1 0.00201 0.002017 0.002027 0.00% MLMG::mgVcycle_down::2 333 0.001905 0.001939 0.002018 0.00% MLCellLinOp::solutionResidual() 530 0.001967 0.001983 0.001997 0.00% TagBoxArray::collate() 11 0.0007885 0.001324 0.001859 0.00% Gravity::solve_phi_with_mlmg() 71 0.00161 0.001699 0.001786 0.00% Castro::clean_state() 254 0.001548 0.001593 0.00166 0.00% OwnerMask() 11 0.001464 0.001553 0.001643 0.00% MLMG::mgVcycle_up::0 333 0.001556 0.001582 0.001601 0.00% Castro::subcycle_advance_ctu() 30 0.0001864 0.0005535 0.001595 0.00% MLMG::mgVcycle_up::2 333 0.00134 0.001381 0.001459 0.00% MLMG::mgVcycle_up::1 333 0.001364 0.00139 0.00145 0.00% MLMG::mgVcycle_bottom 489 0.001271 0.001292 0.001339 0.00% MLMG::mgVcycle_down::3 211 0.001166 0.001212 0.00133 0.00% MLMG::mgVcycle_down::4 211 0.001073 0.001137 0.001266 0.00% makeSFC 243 0.001043 0.001156 0.001221 0.00% TagBoxArray::mapPRD 11 0.0008612 0.0009039 0.0009362 0.00% MLMG::mgVcycle_up::4 211 0.0007562 0.0008067 0.0009136 0.00% Amr::bldFineLevels() 1 0.0007609 0.000802 0.0008931 0.00% MLMG::mgVcycle_up::3 211 0.000725 0.0007601 0.0008509 0.00% MLMG::computeResidual() 333 0.0008122 0.0008198 0.0008262 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007478 0.0007821 0.0008009 0.00% MLPoisson::define() 81 0.0006057 0.0006575 0.0006864 0.00% Amr::grid_places() 11 0.0005406 0.000601 0.0006577 0.00% Castro::construct_new_source() 250 0.0005629 0.0005886 0.0006356 0.00% Amr::timeStep() 30 0.0004769 0.0005067 0.0005814 0.00% FabArrayBase::TheFPinfo() 130 0.0004986 0.0005282 0.0005531 0.00% DistributionMapping::Distribute() 245 0.0004811 0.0004972 0.0005037 0.00% Castro::enforce_speed_limit() 254 0.0003917 0.0004054 0.0004162 0.00% Castro::apply_source_to_state() 100 0.0003556 0.0003634 0.0003732 0.00% MLPoisson::prepareForSolve() 81 0.000338 0.0003534 0.0003643 0.00% Castro::computeNewDt() 18 0.000117 0.0001847 0.0003625 0.00% Castro::construct_old_source() 150 0.0002834 0.000297 0.0003166 0.00% MLMG::computeMLResidual() 97 0.0003058 0.0003091 0.0003127 0.00% AmrLevel::AmrLevel(dm) 12 0.0002581 0.0002772 0.0003117 0.00% MLLinOp::define() 81 0.000281 0.0002973 0.0003103 0.00% MLMG::getGradSolution() 80 0.0002478 0.0002609 0.0002889 0.00% MLMG::miniCycle() 156 0.0002686 0.0002723 0.0002754 0.00% Castro::post_regrid() 22 0.0002248 0.0002379 0.0002556 0.00% Castro::advance() 30 0.0001961 0.0002091 0.0002196 0.00% Gravity::swapTimeLevels() 30 0.0001832 0.0001986 0.0002159 0.00% ClusterList::intersect() 2 0 5.393e-05 0.0002157 0.00% FabArray::RecvLayoutMask() 21 0.0001971 0.0001994 0.0002034 0.00% Castro::check_for_nan() 60 0.0001815 0.0001864 0.000191 0.00% Castro::errorEst() 11 0.0001247 0.0001276 0.0001353 0.00% Castro::avgDown(state_indx) 44 0.0001127 0.0001152 0.0001211 0.00% FPinfo::FPinfo() 3 9.848e-05 0.0001055 0.0001159 0.00% Amr::FinalizeInit() 1 1.779e-05 4.158e-05 0.0001045 0.00% Amr::writeSmallPlotFile() 1 7.156e-05 8.48e-05 0.0001026 0.00% Gravity::solve_for_delta_phi 10 7.911e-05 8.972e-05 9.62e-05 0.00% AmrMesh-cluster 2 0 2.254e-05 9.017e-05 0.00% amrex::average_down_w_geom 44 8.738e-05 8.835e-05 9.006e-05 0.00% Castro::create_source_corrector() 30 7.889e-05 8.339e-05 8.917e-05 0.00% Castro::retry_advance_ctu() 30 5.549e-05 6.475e-05 7.669e-05 0.00% knapsack() 3 5.741e-05 5.984e-05 6.261e-05 0.00% Castro::avgDown() 11 5.771e-05 5.875e-05 6.033e-05 0.00% Gravity::set_mass_offset() 11 2.433e-05 3.324e-05 5.172e-05 0.00% Amr::initSubcycle() 1 3.543e-05 4.299e-05 4.982e-05 0.00% BoxList::complementIn 22 4.016e-05 4.266e-05 4.73e-05 0.00% Castro::gwstrain() 22 3.678e-05 3.958e-05 4.547e-05 0.00% BoxList::parallelComplementIn() 22 3.989e-05 4.109e-05 4.31e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.199e-05 3.406e-05 3.709e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.776e-05 2.894e-05 3.004e-05 0.00% ClusterList::chop() 2 0 6.19e-06 2.476e-05 0.00% MLMG::compResidual() 1 1.159e-05 1.229e-05 1.375e-05 0.00% Castro::computeInitialDt() 2 1.08e-05 1.207e-05 1.311e-05 0.00% Amr::InitializeInit() 1 6.009e-06 7.716e-06 9.364e-06 0.00% Amr::init() 1 5.306e-06 6.484e-06 7.091e-06 0.00% Amr::initialInit() 1 4.304e-06 4.761e-06 5.392e-06 0.00% knapsack()swap 2 4.839e-06 4.972e-06 5.155e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.63 54.63 54.63 100.00% Amr::coarseTimeStep() 10 51.61 51.61 51.61 94.47% Amr::timeStep() 30 51.33 51.38 51.53 94.33% Castro::advance() 30 36.06 36.06 36.06 66.01% Castro::subcycle_advance_ctu() 30 34.24 34.25 34.27 62.73% Castro::do_advance_ctu() 30 34.24 34.25 34.27 62.73% Castro::construct_ctu_hydro_source() 30 16.39 16.42 16.49 30.18% Gravity::actual_solve_with_mlmg() 81 13.22 13.23 13.23 24.22% MLMG::solve() 80 12.5 12.51 12.52 22.91% Castro::post_timestep() 30 12.14 12.19 12.34 22.60% Castro::clean_state() 254 10.91 11.02 11.2 20.49% MLMG::oneIter() 333 10.51 10.52 10.52 19.26% Gravity::solve_phi_with_mlmg() 71 9.966 10 10.03 18.36% Castro::reflux() 10 9.663 9.671 9.681 17.72% MLMG::mgVcycle() 489 9.218 9.225 9.231 16.90% Gravity::solve_for_phi() 60 8.242 8.27 8.291 15.18% MLCellLinOp::smooth() 5996 6.286 6.404 6.716 12.29% Castro::computeTemp() 257 6.335 6.396 6.48 11.86% Castro::reset_internal_energy() 257 5.866 5.924 5.999 10.98% Castro::construct_new_gravity() 30 5.039 5.042 5.045 9.23% Gravity::gravity_sync() 10 5.016 5.016 5.016 9.18% Castro::construct_old_gravity() 30 4.68 4.71 4.733 8.66% Castro::evaluate_source_change() 591 4.579 4.607 4.638 8.49% MLPoisson::Fsmooth() 11992 4.17 4.249 4.424 8.10% Gravity::solve_for_delta_phi 10 4.193 4.193 4.193 7.67% Castro::enforce_min_density() 254 3.847 3.907 4.01 7.34% MLMG::mgVcycle_down::0 333 3.922 3.927 3.933 7.20% Castro::do_new_sources() 50 3.298 3.324 3.351 6.13% FillPatchIterator::Initialize 723 3.278 3.311 3.338 6.11% Amr::regrid() 10 3.202 3.233 3.263 5.97% Castro::post_regrid() 22 3.01 3.066 3.122 5.71% MLCellLinOp::applyBC() 14630 2.748 2.811 2.975 5.45% MLMG::mgVcycle_up::0 333 2.708 2.898 2.964 5.42% FabArray::ParallelCopy() 5320 2.025 2.519 2.795 5.12% MultiFab::AddProduct() 4648 2.634 2.654 2.675 4.90% Castro::initialize_do_advance() 30 2.574 2.587 2.601 4.76% MLCellLinOp::apply() 2422 2.461 2.492 2.565 4.69% FabArray::setVal() 9464 2.459 2.472 2.505 4.59% Amr::init() 1 2.466 2.466 2.466 4.51% FillPatchSingleLevel 853 2.239 2.261 2.304 4.22% MLPoisson::Fapply() 2422 1.847 1.872 1.913 3.50% Amr::initialInit() 1 1.863 1.863 1.863 3.41% MLCellLinOp::solutionResidual() 530 1.727 1.743 1.762 3.22% Gravity::multilevel_solve_for_new_phi() 10 1.74 1.74 1.74 3.18% Gravity::actual_multilevel_solve() 10 1.731 1.732 1.732 3.17% MLCellLinOp::correctionResidual() 1660 1.607 1.639 1.713 3.13% MultiFab::Subtract() 601 1.683 1.69 1.698 3.11% Castro::derive() 397 1.634 1.641 1.651 3.02% Castro::do_old_sources() 30 1.546 1.555 1.574 2.88% MLMG:computeResOfCorrection() 1421 1.467 1.493 1.554 2.84% FabArray::ParallelCopy_nowait() 5320 1.426 1.45 1.475 2.70% Amr::FinalizeInit() 1 1.437 1.449 1.469 2.69% Castro::initialize_advance() 30 1.396 1.411 1.427 2.61% Castro::volWgtSum() 242 1.357 1.369 1.379 2.52% FabArray::ParallelCopy_finish() 5320 0.5349 1.055 1.334 2.44% FabArray::FillBoundary() 13093 1.242 1.275 1.297 2.37% Castro::expand_state() 30 1.158 1.176 1.187 2.17% FillPatchTwoLevels 394 1.157 1.172 1.18 2.16% Gravity::fill_multipole_BCs() 41 1.114 1.143 1.164 2.13% Amr::writePlotFile() 2 1.152 1.152 1.152 2.11% Castro::post_init() 2 1.025 1.075 1.127 2.06% FluxRegister::Reflux() 180 1.123 1.124 1.125 2.06% Gravity::get_new_grav_vector() 52 0.9969 1.002 1.01 1.85% MLMG::addInterpCorrection() 1421 0.3163 0.8318 1.006 1.84% MLMG::computeResWithCrseSolFineCor() 78 0.9355 0.9365 0.9372 1.72% MLMG::computeResidual() 333 0.9 0.9013 0.9024 1.65% MultiFab::sum() 4648 0.887 0.893 0.899 1.65% Castro::normalize_species() 254 0.8096 0.8261 0.8547 1.56% MLMG::mgVcycle_down::1 333 0.6887 0.7138 0.7811 1.43% MultiFab::Xpay() 2190 0.73 0.7358 0.7501 1.37% FillBoundary_nowait() 13093 0.6853 0.6982 0.7118 1.30% MLCellLinOp::reflux() 116 0.6544 0.6567 0.6597 1.21% MLMG::mgVcycle_up::2 333 0.21 0.5348 0.6448 1.18% MLMG::computeMLResidual() 97 0.5922 0.6082 0.6168 1.13% Castro::construct_new_source() 250 0.5927 0.6015 0.6128 1.12% Castro::construct_new_gravity_source() 50 0.592 0.6009 0.6122 1.12% FillBoundary_finish() 13093 0.4961 0.5446 0.5812 1.06% Gravity::get_old_grav_vector() 30 0.5436 0.5463 0.5504 1.01% FillPatchInterp(Fab) 130 0.3689 0.4532 0.5382 0.99% MLMG::mgVcycle_up::1 333 0.4687 0.4859 0.537 0.98% CellConservativeLinear::interp() 130 0.3663 0.4512 0.5365 0.98% Castro::estTimeStep() 69 0.2329 0.3989 0.4794 0.88% Amr::InitializeInit() 1 0.394 0.4133 0.4259 0.78% Amr::defBaseLevel() 1 0.394 0.4133 0.4259 0.78% Castro::finalize_advance() 30 0.3929 0.3956 0.3986 0.73% MLPoisson::define() 81 0.3778 0.3843 0.3949 0.72% Castro::initData() 3 0.3547 0.3776 0.3946 0.72% MLPoisson::FFlux() 1046 0.3808 0.3822 0.3831 0.70% StateDataPhysBCFunct::() 853 0.3434 0.345 0.3469 0.64% MLMG::prepareForSolve() 80 0.314 0.3183 0.3294 0.60% StateData::FillBoundary(geom) 63 0.3226 0.3246 0.3287 0.60% amrex::average_down 1713 0.2931 0.3028 0.3228 0.59% MLMG::mgVcycle_bottom 489 0.162 0.2014 0.3193 0.58% Castro::computeNewDt() 18 0.1326 0.2646 0.3122 0.57% Castro::apply_source_to_state() 100 0.2759 0.2771 0.279 0.51% MultiFab::Saxpy() 100 0.2755 0.2767 0.2786 0.51% MLMG::mgVcycle_down::2 333 0.2472 0.2551 0.2764 0.51% MLCellLinOp::defineAuxData() 81 0.2168 0.2238 0.2391 0.44% Amr::bldFineLevels() 1 0.1844 0.2109 0.2371 0.43% MLMG::getGradSolution() 80 0.2154 0.2161 0.2176 0.40% MLCellLinOp::compGrad() 100 0.2151 0.2158 0.2174 0.40% MLMG::mgVcycle_down::3 211 0.03386 0.07437 0.1943 0.36% VisMF::Write(FabArray) 4 0.1645 0.1707 0.1845 0.34% MLMG::miniCycle() 156 0.1615 0.1618 0.1622 0.30% MLMG::actualBottomSolve() 333 0.0003902 0.03954 0.157 0.29% Castro::init(old) 9 0.1488 0.15 0.1521 0.28% MLCGSolver::bicgstab 83 0 0.03772 0.1509 0.28% Gravity::update_max_rhs() 20 0.04707 0.09688 0.1506 0.28% FabArray::mult() 294 0.1422 0.1436 0.145 0.27% MLCellLinOp::defineBC() 81 0.143 0.1439 0.145 0.27% Castro::construct_old_source() 150 0.1401 0.1413 0.1433 0.26% Castro::construct_old_gravity_source() 30 0.1398 0.141 0.143 0.26% MultiFab::Multiply() 164 0.1407 0.1408 0.1411 0.26% MLMG::mgVcycle_up::3 211 0.02533 0.05372 0.1377 0.25% MLMG::ResNormInf() 450 0.1251 0.1297 0.1327 0.24% FabArray::setDomainBndry() 853 0.1287 0.1306 0.1318 0.24% Amr::grid_places() 11 0.1212 0.1227 0.1246 0.23% AmrMesh::MakeNewGrids() 11 0.1206 0.1221 0.124 0.23% Castro::volProductSum() 22 0.1191 0.1212 0.1233 0.23% MultiFab::min() 30 0.007226 0.08248 0.1231 0.23% BndryData::define() 123 0.1172 0.1184 0.1197 0.22% MultiFab::max() 40 0.01317 0.06262 0.1161 0.21% MLMG::computeResWithCrseCorFineCor() 78 0.1035 0.1039 0.1042 0.19% Gravity::GetCrsePhi() 40 0.08986 0.09421 0.1012 0.19% Castro::check_for_nan() 60 0.09389 0.0946 0.09601 0.18% MultiFab::contains_nan() 60 0.0937 0.09442 0.09583 0.18% MLCellLinOp::updateSolBC() 99 0.0852 0.09078 0.09435 0.17% FabArrayBase::getCPC() 8152 0.06875 0.07339 0.08501 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08306 0.08369 0.08474 0.16% Gravity::test_level_grad_phi_curr() 20 0.08095 0.08154 0.08212 0.15% MultiFab::LinComb() 628 0.06341 0.06788 0.07933 0.15% MLMG::mgVcycle_down::4 211 0.03234 0.04297 0.0733 0.13% Castro::errorEst() 11 0.06568 0.06606 0.06659 0.12% MLCellLinOp::updateCorBC() 78 0.06315 0.06357 0.06411 0.12% MLCellLinOp::setLevelBC() 102 0.0507 0.05884 0.06215 0.11% Gravity::test_composite_phi() 1 0.05891 0.05893 0.05895 0.11% MLMG::mgVcycle_up::4 211 0.02547 0.03346 0.05634 0.10% Castro::computeInitialDt() 2 0.02193 0.0345 0.05381 0.10% MLMG::buildFineMask() 80 0.04868 0.04883 0.04906 0.09% Gravity::test_level_grad_phi_prev() 30 0.04699 0.04751 0.04839 0.09% MultiFab::norm0(mask) 57 0.04713 0.04774 0.04833 0.09% MLMG::MLResNormInf() 97 0.04403 0.04491 0.04551 0.08% FabArrayBase::CPC::define() 2260 0.02751 0.03176 0.04294 0.08% MultiFab::Copy() 100 0.03948 0.03963 0.03978 0.07% MLMG::interpCorrection_1 78 0.03355 0.0352 0.03768 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03577 0.03634 0.03732 0.07% MLMG::MLRhsNormInf() 80 0.02864 0.02881 0.02899 0.05% MLPoisson::prepareForSolve() 81 0.02495 0.02592 0.02838 0.05% MLCellLinOp::prepareForSolve() 81 0.02459 0.02557 0.02804 0.05% FabArrayBase::getFB() 13093 0.02306 0.02433 0.02764 0.05% Castro::apply_tagging_restrictions() 11 0.02398 0.02412 0.02429 0.04% Gravity::swapTimeLevels() 30 0.0233 0.02365 0.02404 0.04% Castro::finalize_do_advance() 30 0.01402 0.01729 0.01996 0.04% CGSolver::sxay() 588 0 0.004889 0.01955 0.04% Castro::build_fine_mask() 153 0.01892 0.01899 0.01914 0.04% MLLinOp::define() 81 0.01217 0.01594 0.01831 0.03% MLLinOp::defineGrids() 81 0.01187 0.01565 0.018 0.03% AmrLevel::AmrLevel(dm) 12 0.0146 0.01549 0.01645 0.03% StateData::define() 48 0.01434 0.01521 0.01617 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01408 0.01456 0.01502 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003595 0.01438 0.03% Castro::avgDown() 11 0.0138 0.01408 0.01422 0.03% Castro::avgDown(state_indx) 44 0.01374 0.01402 0.01416 0.03% amrex::average_down_w_geom 44 0.01363 0.0139 0.01405 0.03% Castro::swap_state_time_levels() 30 0.01298 0.01326 0.01364 0.02% MLMG::compResidual() 1 0.01352 0.01356 0.01359 0.02% MultiFab::Dot() 463 0 0.002817 0.01127 0.02% TagBoxArray::mapPRD 11 0.006034 0.007908 0.009912 0.02% Castro::apply_problem_tags() 11 0.008835 0.008939 0.00903 0.02% Castro::FluxRegFineAdd() 30 0.007343 0.007413 0.00756 0.01% MLLinOp::makeSubCommunicator() 81 0.002241 0.005363 0.007315 0.01% Castro::enforce_consistent_e() 3 0.006462 0.006818 0.007159 0.01% AMRErrorTag::operator() 11 0.0052 0.005267 0.005311 0.01% FabArrayBase::TheFPinfo() 130 0.001331 0.002467 0.003311 0.01% FPinfo::FPinfo() 3 0.0008035 0.001939 0.002778 0.01% DistributionMapping::KnapSackDoIt() 3 0.0007051 0.001834 0.002671 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0007176 0.001825 0.00266 0.00% MLLinOp::makeAgglomeratedDMap 81 0.002263 0.002427 0.002511 0.00% FabArrayBase::FB::FB() 131 0.0008568 0.001264 0.002429 0.00% Amr::InitAmr() 1 0.002051 0.00206 0.002077 0.00% TagBoxArray::collate() 11 0.0007885 0.001324 0.001859 0.00% makeSFC 243 0.001515 0.001645 0.001714 0.00% OwnerMask() 11 0.001464 0.001553 0.001643 0.00% DistributionMapping::Distribute() 245 0.0004811 0.0004972 0.0005037 0.00% Castro::enforce_speed_limit() 254 0.0003917 0.0004054 0.0004162 0.00% AmrMesh-cluster 2 0 8.266e-05 0.0003306 0.00% ClusterList::intersect() 2 0 5.393e-05 0.0002157 0.00% FabArray::RecvLayoutMask() 21 0.0001971 0.0001994 0.0002034 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.235e-05 0.0001285 0.0001563 0.00% Amr::writeSmallPlotFile() 1 7.156e-05 8.48e-05 0.0001026 0.00% Castro::create_source_corrector() 30 7.889e-05 8.339e-05 8.917e-05 0.00% BoxList::parallelComplementIn() 22 8.087e-05 8.375e-05 8.719e-05 0.00% Castro::retry_advance_ctu() 30 5.549e-05 6.475e-05 7.669e-05 0.00% knapsack() 3 6.225e-05 6.481e-05 6.756e-05 0.00% Gravity::set_mass_offset() 11 2.433e-05 3.324e-05 5.172e-05 0.00% Amr::initSubcycle() 1 3.543e-05 4.299e-05 4.982e-05 0.00% BoxList::complementIn 22 4.016e-05 4.266e-05 4.73e-05 0.00% Castro::gwstrain() 22 3.678e-05 3.958e-05 4.547e-05 0.00% ClusterList::chop() 2 0 6.19e-06 2.476e-05 0.00% knapsack()swap 2 4.839e-06 4.972e-06 5.155e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.04-18-ga537fb0516d5) finalized