MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.04-18-ga537fb0516d5) initialized Starting run at 05:42:59 UTC on 2022-04-12. Successfully read inputs file ... Castro git describe: 22.04-2-gb74783602 AMReX git describe: 22.04-18-ga537fb051 Microphysics git describe: 22.04-1-gef526ccd reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.016735517 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.025071399 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.030739823 Gravity::fill_multipole_BCs() time = 0.030133534 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.618010952 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.036421602 Gravity::solve_for_phi() time = 0.420784773 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -6.927091701e+22 ymom added: -5.666839779e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.151372553 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.653266514 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027649009 Gravity::solve_for_phi() time = 0.341139808 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.162509999 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.07710503288 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008491717 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.00982441 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.111887322 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046256355 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010456529 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01562110062 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008276933 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009492758 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.112155278 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045121761 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010712717 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01426688853 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028646465 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010622436 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.158689026 Castro::reflux() at level 0 : time = 1.052278044 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 5.265941097 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.010166203 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.030240836 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032588355 Gravity::solve_for_phi() time = 0.393990554 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.37185287e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.140906031 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.493157346 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027992581 Gravity::solve_for_phi() time = 0.339737255 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.157903251 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08274870723 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008329745 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009502699 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109645229 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04416604 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010443197 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01594085507 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008302119 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009488642 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110291618 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044207055 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.01042937 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01458639762 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.030527725 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010387018 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809893e+28 ymom added: 8.089770255e+28 zmom added: 8.082913463e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.158040795 Castro::reflux() at level 0 : time = 1.042602583 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.418815187 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009987904 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.03120422 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032184894 Gravity::solve_for_phi() time = 0.40045483 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939014e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.148616669 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.496450415 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029686793 Gravity::solve_for_phi() time = 0.348250699 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983741e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.160243816 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08172099632 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009456236 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009765477 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.11116539 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044135289 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010456094 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01560069717 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008886316 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009525933 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110255078 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044206249 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010436772 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01447503714 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029613247 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010385936 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655087e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342337e+27 ymom added: 5.311566493e+28 zmom added: 5.31240218e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.156779411 Castro::reflux() at level 0 : time = 1.040892515 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.397328109 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009966011 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.03073139 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033159071 Gravity::solve_for_phi() time = 0.414461126 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700666e+30 ymom added: 3.059418825e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.145797325 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.511572631 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030511329 Gravity::solve_for_phi() time = 0.345274134 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.158522279 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08130393261 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008356019 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009509888 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107535972 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045681946 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010493094 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01593463129 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.010086355 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009508345 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10740537 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044149551 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010411509 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0145755818 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.030119642 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010433168 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.157711214 Castro::reflux() at level 0 : time = 0.983797245 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.376272401 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009955739 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.030652078 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.035818746 Gravity::solve_for_phi() time = 0.399613634 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150479e+30 ymom added: 3.399803865e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.152370103 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.51929772 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028932907 Gravity::solve_for_phi() time = 0.3462616 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591233e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.16240149 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08100337943 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008313493 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.00955628 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110528771 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044300264 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010460002 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01577716772 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008259663 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009496604 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109190667 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044166956 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.0104536 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0145621989 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.03010944 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010396399 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363474e+28 ymom added: 7.265277776e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.15706517 Castro::reflux() at level 0 : time = 0.982109616 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.344211384 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.010236082 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029420453 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031188751 Gravity::solve_for_phi() time = 0.396111984 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919316e+30 ymom added: 4.094511425e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.141573874 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.523195903 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028078292 Gravity::solve_for_phi() time = 0.34452094 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245024e+27 ymom added: -5.297264713e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.161946486 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08171146657 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008522675 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009722873 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107608934 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044217387 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.010462691 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01602074041 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008526549 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009486916 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107637538 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044152517 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.01042615 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01468322996 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.030365728 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010380713 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.154168042 Castro::reflux() at level 0 : time = 0.973919139 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.29401365 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009926008 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029449219 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032555445 Gravity::solve_for_phi() time = 0.394757364 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.51615112e+30 ymom added: 4.515687996e+30 zmom added: 4.515609038e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.139638323 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.507212183 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028515386 Gravity::solve_for_phi() time = 0.343793431 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.881752619e+28 zmom added: -2.881735255e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.160242979 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08213943496 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008372249 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009662197 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108032481 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044428799 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010427104 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01593437775 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008329366 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009580076 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108898853 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044154583 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010416727 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01466004004 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029395297 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.010411251 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.15607316 Castro::reflux() at level 0 : time = 0.976385377 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.367504491 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.010434406 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029377137 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033259933 Gravity::solve_for_phi() time = 0.395225647 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064094e+30 ymom added: 4.889542979e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.139586918 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.52549043 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028150256 Gravity::solve_for_phi() time = 0.393883492 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642725e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.15983399 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0805201009 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008583443 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009524136 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107747721 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044184239 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010453572 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01605715249 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008336611 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009484859 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107531967 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045900081 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010565866 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01457238505 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.03076317 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010411581 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478815e+29 ymom added: 5.931907372e+27 zmom added: 5.953997699e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.15811856 Castro::reflux() at level 0 : time = 0.986780608 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.446958474 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009974344 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029452407 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.035332126 Gravity::solve_for_phi() time = 0.395495971 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036362e+30 ymom added: 5.53045164e+30 zmom added: 5.530356437e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.142833638 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.515875718 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028801644 Gravity::solve_for_phi() time = 0.393365539 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170338e+28 zmom added: -5.061201609e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.160141749 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08054468018 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008361473 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009493084 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108013708 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044183653 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010454011 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01608822986 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008392834 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009684957 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107768467 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044249531 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.010451538 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01470195767 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029518788 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.010410003 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.15665419 Castro::reflux() at level 0 : time = 0.977897595 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.468124319 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009940409 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.030060085 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032873894 Gravity::solve_for_phi() time = 0.396049241 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167185e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.142211998 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.5053237 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02891819 Gravity::solve_for_phi() time = 0.390838188 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.160809338 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08098916378 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008383604 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009488633 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107414166 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.050082088 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010425966 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01574019626 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008359355 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.00954129 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107871744 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.049973639 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010457067 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01443627834 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029446039 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010404433 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914868e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.158268811 Castro::reflux() at level 0 : time = 1.042515655 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.488104566 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.569529356 seconds Ending run at 05:43:56 UTC on 2022-04-12. Run time = 56.7675261 Run time without initialization = 54.40218913 Average number of zones advanced per microsecond: 0.050 Average number of zones advanced per microsecond per rank: 0.012 TinyProfiler total time across processes [min...avg...max]: 56.77 ... 56.77 ... 56.77 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.8939 17.1511 17.4273 30.70% MLPoisson::Fsmooth() 11992 4.268 4.369 4.59 8.09% Castro::reset_internal_energy() 257 3.079 3.16 3.261 5.74% MultiFab::AddProduct() 4648 2.698 2.719 2.758 4.86% FabArray::setVal() 9464 2.501 2.529 2.589 4.56% MLPoisson::Fapply() 2422 1.898 1.927 2.009 3.54% MLCellLinOp::applyBC() 14630 1.523 1.595 1.805 3.18% MultiFab::Subtract() 601 1.73 1.737 1.751 3.08% FabArray::ParallelCopy_nowait() 5320 1.421 1.452 1.491 2.63% FabArray::ParallelCopy_finish() 5320 0.5456 1.135 1.428 2.51% Gravity::fill_multipole_BCs() 41 1.102 1.178 1.209 2.13% Castro::enforce_min_density() 254 1.074 1.105 1.158 2.04% Castro::derive() 397 0.9531 0.9609 0.9751 1.72% MultiFab::sum() 4648 0.9108 0.915 0.9247 1.63% FluxRegister::Reflux() 180 0.8434 0.8477 0.857 1.51% Castro::normalize_species() 254 0.8136 0.8234 0.8357 1.47% MultiFab::Xpay() 2190 0.7501 0.7588 0.7842 1.38% Castro::reflux() 10 0.7127 0.7153 0.7205 1.27% FillBoundary_nowait() 13093 0.6699 0.6835 0.6997 1.23% FillBoundary_finish() 13093 0.441 0.5976 0.6785 1.20% MultiFab::min() 30 0.007399 0.3225 0.6318 1.11% Castro::construct_new_gravity_source() 50 0.6108 0.6194 0.6297 1.11% Castro::volWgtSum() 242 0.5331 0.552 0.5728 1.01% CellConservativeLinear::interp() 130 0.3761 0.4653 0.5557 0.98% Castro::estTimeStep() 69 0.2345 0.3785 0.5076 0.89% Castro::computeTemp() 257 0.4768 0.4819 0.489 0.86% MLPoisson::FFlux() 1044 0.3934 0.3937 0.3943 0.69% Castro::finalize_advance() 30 0.3566 0.364 0.3723 0.66% Gravity::get_new_grav_vector() 52 0.342 0.3436 0.3466 0.61% FillPatchSingleLevel 853 0.3379 0.3402 0.3454 0.61% StateData::FillBoundary(geom) 63 0.3345 0.3373 0.3405 0.60% MLMG::addInterpCorrection() 1421 0.2755 0.2821 0.2997 0.53% amrex::average_down 1713 0.2767 0.2819 0.2964 0.52% MultiFab::Saxpy() 100 0.2825 0.2849 0.29 0.51% FillPatchIterator::Initialize 723 0.2464 0.269 0.2789 0.49% Castro::do_advance_ctu() 30 0.225 0.2261 0.2288 0.40% MLMG::oneIter() 333 0.2154 0.2175 0.2224 0.39% Castro::post_timestep() 30 0.1504 0.1794 0.2079 0.37% Castro::expand_state() 30 0.1982 0.199 0.2008 0.35% MLCellLinOp::defineAuxData() 81 0.1787 0.1831 0.1922 0.34% MLCellLinOp::reflux() 116 0.1782 0.1817 0.1893 0.33% Gravity::get_old_grav_vector() 30 0.1708 0.1735 0.1816 0.32% MLCellLinOp::compGrad() 100 0.1742 0.1766 0.1814 0.32% VisMF::Write(FabArray) 4 0.1669 0.1697 0.1742 0.31% Castro::construct_old_gravity_source() 30 0.1418 0.1466 0.1554 0.27% FabArray::mult() 294 0.1464 0.1473 0.1492 0.26% MultiFab::Multiply() 164 0.1447 0.1458 0.148 0.26% Amr::writePlotFile() 2 0.1203 0.1316 0.1372 0.24% FabArray::setDomainBndry() 853 0.1348 0.1357 0.1366 0.24% MLMG::ResNormInf() 450 0.09654 0.1194 0.1292 0.23% Castro::initData() 3 0.05879 0.07432 0.1106 0.19% MultiFab::contains_nan() 60 0.09652 0.09752 0.09936 0.18% Castro::construct_old_gravity() 30 0.08972 0.09112 0.0948 0.17% BndryData::define() 123 0.09295 0.0937 0.09464 0.17% MLMG::prepareForSolve() 80 0.08235 0.08381 0.08609 0.15% Castro::evaluate_source_change() 591 0.08022 0.08128 0.08213 0.14% MultiFab::LinComb() 628 0.06537 0.06938 0.08119 0.14% Gravity::test_level_grad_phi_curr() 20 0.07401 0.07438 0.07476 0.13% Gravity::gravity_sync() 10 0.07307 0.07349 0.07424 0.13% Castro::construct_new_gravity() 30 0.05511 0.05937 0.06822 0.12% MLCellLinOp::updateSolBC() 99 0.05942 0.05996 0.0605 0.11% MLCGSolver::bicgstab 83 0 0.01451 0.05802 0.10% Castro::volProductSum() 22 0.04879 0.05085 0.05398 0.10% MultiFab::norm0(mask) 57 0.04837 0.04853 0.04883 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04685 0.04739 0.04862 0.09% MLCellLinOp::updateCorBC() 78 0.0471 0.04745 0.04776 0.08% Gravity::test_level_grad_phi_prev() 30 0.04211 0.04317 0.0458 0.08% FabArrayBase::getCPC() 8152 0.04443 0.0448 0.04569 0.08% Castro::initialize_do_advance() 30 0.03441 0.04062 0.04558 0.08% FabArrayBase::CPC::define() 2260 0.02908 0.03349 0.04547 0.08% Gravity::actual_solve_with_mlmg() 81 0.04079 0.04203 0.04354 0.08% MLCellLinOp::setLevelBC() 102 0.04191 0.04225 0.04288 0.08% MultiFab::max() 40 0.01404 0.02774 0.04198 0.07% MultiFab::Copy() 100 0.04072 0.04087 0.04123 0.07% AmrMesh::MakeNewGrids() 11 0.03624 0.03762 0.041 0.07% MLMG::buildFineMask() 80 0.04028 0.04034 0.04042 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03653 0.03715 0.03822 0.07% Gravity::solve_for_phi() 60 0.02752 0.03057 0.03639 0.06% FabArray::FillBoundary() 13093 0.03256 0.0334 0.03587 0.06% StateDataPhysBCFunct::() 853 0.0209 0.02379 0.02992 0.05% Castro::post_init() 2 0.0003957 0.01297 0.02936 0.05% MLCellLinOp::prepareForSolve() 81 0.02531 0.02634 0.02922 0.05% MLCellLinOp::smooth() 5996 0.02687 0.02759 0.02882 0.05% Castro::initialize_advance() 30 0.02614 0.02677 0.0274 0.05% Castro::init(old) 9 0.0271 0.02715 0.0273 0.05% FabArrayBase::getFB() 13093 0.02383 0.02462 0.02659 0.05% Amr::defBaseLevel() 1 0.02086 0.02426 0.02642 0.05% MLCellLinOp::defineBC() 81 0.02483 0.02505 0.02541 0.04% Gravity::update_max_rhs() 20 0.02465 0.02477 0.02494 0.04% Castro::apply_tagging_restrictions() 11 0.02126 0.02217 0.02449 0.04% MLMG::interpCorrection_1 78 0.02354 0.02356 0.02362 0.04% Castro::finalize_do_advance() 30 0.002484 0.01485 0.02211 0.04% Castro::build_fine_mask() 153 0.01923 0.01954 0.0201 0.04% FillPatchTwoLevels 394 0.01705 0.01782 0.01942 0.03% StateData::define() 48 0.015 0.01684 0.01812 0.03% FabArray::ParallelCopy() 5320 0.01485 0.01515 0.01555 0.03% Castro::swap_state_time_levels() 30 0.01352 0.01373 0.01387 0.02% Amr::coarseTimeStep() 10 0.0008826 0.01035 0.01356 0.02% Gravity::actual_multilevel_solve() 10 0.01241 0.01252 0.01275 0.02% MLMG::MLRhsNormInf() 80 0.01249 0.0125 0.01252 0.02% MultiFab::Dot() 463 0 0.00284 0.01136 0.02% Amr::regrid() 10 0.00993 0.0103 0.01121 0.02% Gravity::GetCrsePhi() 40 0.01001 0.01011 0.01019 0.02% MLCellLinOp::apply() 2422 0.005938 0.006882 0.009463 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.0085 0.008797 0.009276 0.02% Castro::apply_problem_tags() 11 0.008423 0.008547 0.008756 0.02% MLLinOp::defineGrids() 81 0.007832 0.007983 0.008097 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001962 0.007847 0.01% Castro::FluxRegFineAdd() 30 0.007443 0.007502 0.007594 0.01% MLMG::solve() 80 0.002923 0.005776 0.007109 0.01% Castro::enforce_consistent_e() 3 0.00397 0.004823 0.006853 0.01% MLCellLinOp::correctionResidual() 1660 0.004877 0.0052 0.006049 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005308 0.00533 0.005384 0.01% AMRErrorTag::operator() 11 0.004798 0.004943 0.005265 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.00519 0.005218 0.005236 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.005046 0.005059 0.005068 0.01% MLLinOp::makeSubCommunicator() 81 0.002274 0.003699 0.005004 0.01% CGSolver::sxay() 588 0 0.001245 0.00498 0.01% Castro::do_new_sources() 50 0.000914 0.002019 0.004767 0.01% Gravity::test_composite_phi() 1 0.003833 0.004171 0.004669 0.01% main() 1 0.002813 0.004175 0.004661 0.01% MLMG::mgVcycle() 489 0.004236 0.00437 0.004628 0.01% MLMG::actualBottomSolve() 333 0.0004274 0.001283 0.003804 0.01% MLMG:computeResOfCorrection() 1421 0.003452 0.003543 0.003695 0.01% FillPatchInterp(Fab) 130 0.001794 0.002537 0.003527 0.01% Amr::InitAmr() 1 0.002534 0.002547 0.002553 0.00% MLMG::mgVcycle_down::0 333 0.002478 0.002515 0.00253 0.00% FabArrayBase::FB::FB() 131 0.000893 0.001303 0.002526 0.00% Castro::do_old_sources() 30 0.0005034 0.001114 0.002415 0.00% TagBoxArray::collate() 11 0.001603 0.002004 0.002359 0.00% MLMG::mgVcycle_down::1 333 0.002189 0.002243 0.002325 0.00% MLCellLinOp::solutionResidual() 530 0.002121 0.00214 0.002173 0.00% MLMG::mgVcycle_down::2 333 0.001963 0.002044 0.002148 0.00% Gravity::solve_phi_with_mlmg() 71 0.001696 0.001792 0.001908 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0003383 0.001242 0.00183 0.00% Castro::clean_state() 254 0.001741 0.001773 0.001808 0.00% MLMG::mgVcycle_up::0 333 0.001698 0.001702 0.001708 0.00% Castro::subcycle_advance_ctu() 30 0.0001943 0.0005815 0.001698 0.00% OwnerMask() 11 0.0015 0.001571 0.001668 0.00% MLMG::mgVcycle_up::2 333 0.001417 0.001453 0.00154 0.00% MLMG::mgVcycle_up::1 333 0.00139 0.001423 0.001486 0.00% MLMG::MLResNormInf() 97 0.0004394 0.001158 0.001449 0.00% MLMG::mgVcycle_bottom 489 0.001343 0.001363 0.001403 0.00% MLMG::mgVcycle_down::3 211 0.001199 0.001258 0.001381 0.00% MLMG::mgVcycle_down::4 211 0.001135 0.001198 0.001338 0.00% makeSFC 243 0.001128 0.001168 0.001186 0.00% Amr::bldFineLevels() 1 0.0007574 0.0008716 0.001012 0.00% TagBoxArray::mapPRD 11 0.0008863 0.0009302 0.0009732 0.00% MLMG::computeResidual() 333 0.0009462 0.0009561 0.000964 0.00% MLMG::mgVcycle_up::4 211 0.0008011 0.0008513 0.0009639 0.00% MLMG::mgVcycle_up::3 211 0.0007341 0.0007881 0.0008925 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007874 0.000797 0.0008051 0.00% MLPoisson::define() 81 0.0006343 0.0006724 0.0007237 0.00% Amr::grid_places() 11 0.0005719 0.0006132 0.0006615 0.00% Amr::timeStep() 30 0.0004905 0.0005314 0.0006354 0.00% Castro::construct_new_source() 250 0.0005947 0.0006192 0.0006332 0.00% FabArrayBase::TheFPinfo() 130 0.0005335 0.0005498 0.000572 0.00% DistributionMapping::Distribute() 245 0.000513 0.0005189 0.0005246 0.00% Castro::enforce_speed_limit() 254 0.0004253 0.0004305 0.0004371 0.00% Castro::apply_source_to_state() 100 0.0003686 0.0003879 0.0004096 0.00% MLPoisson::prepareForSolve() 81 0.0003404 0.0003711 0.0003885 0.00% Castro::computeNewDt() 18 0.0001322 0.0001959 0.0003711 0.00% Castro::construct_old_source() 150 0.0003065 0.0003281 0.0003525 0.00% MLMG::computeMLResidual() 97 0.000328 0.0003337 0.0003433 0.00% MLLinOp::define() 81 0.0002866 0.0003138 0.0003329 0.00% MLMG::miniCycle() 156 0.0002922 0.0003027 0.0003123 0.00% MLMG::getGradSolution() 80 0.0002821 0.0002881 0.0002987 0.00% AmrLevel::AmrLevel(dm) 12 0.0002743 0.0002824 0.0002872 0.00% Castro::post_regrid() 22 0.0002397 0.0002469 0.0002505 0.00% Castro::advance() 30 0.0002118 0.0002206 0.0002355 0.00% ClusterList::intersect() 2 0 5.825e-05 0.000233 0.00% Gravity::swapTimeLevels() 30 0.0001968 0.0002077 0.000222 0.00% Castro::check_for_nan() 60 0.0001927 0.000197 0.0002061 0.00% FabArray::RecvLayoutMask() 21 0.0002034 0.0002044 0.0002053 0.00% FPinfo::FPinfo() 3 0.0001047 0.0001195 0.0001376 0.00% Castro::errorEst() 11 0.00013 0.0001332 0.0001375 0.00% Castro::avgDown(state_indx) 44 0.0001156 0.0001173 0.0001201 0.00% Amr::FinalizeInit() 1 2.112e-05 4.844e-05 0.0001151 0.00% AmrMesh-cluster 2 0 2.66e-05 0.0001064 0.00% Gravity::solve_for_delta_phi 10 8.285e-05 9.163e-05 9.504e-05 0.00% amrex::average_down_w_geom 44 9.043e-05 9.176e-05 9.474e-05 0.00% Amr::writeSmallPlotFile() 1 7.417e-05 7.859e-05 9.05e-05 0.00% Castro::create_source_corrector() 30 8.434e-05 8.676e-05 8.975e-05 0.00% Castro::retry_advance_ctu() 30 4.808e-05 6.106e-05 7.311e-05 0.00% knapsack() 3 6.168e-05 6.801e-05 7.247e-05 0.00% Castro::avgDown() 11 5.767e-05 5.979e-05 6.277e-05 0.00% Amr::initSubcycle() 1 4.244e-05 5.572e-05 6.111e-05 0.00% Castro::gwstrain() 22 3.902e-05 4.33e-05 4.959e-05 0.00% BoxList::parallelComplementIn() 22 4.063e-05 4.343e-05 4.723e-05 0.00% BoxList::complementIn 22 4.004e-05 4.235e-05 4.546e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.651e-05 4.126e-05 4.443e-05 0.00% Gravity::set_mass_offset() 11 3.03e-05 3.414e-05 4.359e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.936e-05 3.27e-05 3.513e-05 0.00% ClusterList::chop() 2 0 6.241e-06 2.496e-05 0.00% Castro::computeInitialDt() 2 1.195e-05 1.388e-05 1.696e-05 0.00% MLMG::compResidual() 1 1.25e-05 1.352e-05 1.437e-05 0.00% Amr::InitializeInit() 1 6.759e-06 9.319e-06 1.408e-05 0.00% Amr::init() 1 6.823e-06 7.499e-06 8.532e-06 0.00% knapsack()swap 2 4.933e-06 5.699e-06 7.723e-06 0.00% Amr::initialInit() 1 4.026e-06 4.743e-06 5.434e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 56.77 56.77 56.77 100.00% Amr::coarseTimeStep() 10 53.83 53.83 53.83 94.82% Amr::timeStep() 30 53.68 53.7 53.75 94.69% Castro::advance() 30 37.78 37.78 37.78 66.55% Castro::subcycle_advance_ctu() 30 35.9 35.92 35.94 63.30% Castro::do_advance_ctu() 30 35.9 35.92 35.94 63.30% Castro::construct_ctu_hydro_source() 30 16.89 17.15 17.43 30.70% Gravity::actual_solve_with_mlmg() 81 13.65 13.66 13.66 24.07% MLMG::solve() 80 12.91 12.92 12.93 22.77% Castro::post_timestep() 30 12.66 12.68 12.73 22.42% Castro::clean_state() 254 11.15 11.28 11.49 20.23% MLMG::oneIter() 333 10.84 10.85 10.86 19.13% Gravity::solve_phi_with_mlmg() 71 10.26 10.33 10.36 18.25% Castro::reflux() 10 10 10.02 10.06 17.72% MLMG::mgVcycle() 489 9.507 9.515 9.525 16.78% Gravity::solve_for_phi() 60 8.556 8.624 8.651 15.24% MLCellLinOp::smooth() 5996 6.502 6.61 6.906 12.16% Castro::computeTemp() 257 6.476 6.573 6.711 11.82% Castro::reset_internal_energy() 257 5.999 6.091 6.222 10.96% Castro::construct_new_gravity() 30 5.211 5.22 5.234 9.22% Gravity::gravity_sync() 10 5.209 5.209 5.21 9.18% Castro::construct_old_gravity() 30 4.892 4.936 4.961 8.74% Castro::evaluate_source_change() 591 4.691 4.721 4.782 8.42% MLPoisson::Fsmooth() 11992 4.268 4.369 4.59 8.09% Gravity::solve_for_delta_phi 10 4.359 4.359 4.359 7.68% Castro::enforce_min_density() 254 3.949 4.001 4.088 7.20% MLMG::mgVcycle_down::0 333 4.028 4.042 4.075 7.18% FillPatchIterator::Initialize 723 3.406 3.451 3.495 6.16% Castro::do_new_sources() 50 3.392 3.432 3.49 6.15% Amr::regrid() 10 3.305 3.321 3.35 5.90% Castro::post_regrid() 22 3.099 3.121 3.153 5.56% MLMG::mgVcycle_up::0 333 2.795 2.985 3.052 5.38% MLCellLinOp::applyBC() 14630 2.872 2.915 2.995 5.28% FabArray::ParallelCopy() 5320 2.112 2.655 2.937 5.17% MultiFab::AddProduct() 4648 2.698 2.719 2.758 4.86% Castro::initialize_do_advance() 30 2.649 2.668 2.7 4.76% MLCellLinOp::apply() 2422 2.532 2.567 2.663 4.69% FabArray::setVal() 9464 2.501 2.529 2.589 4.56% FillPatchSingleLevel 853 2.295 2.372 2.424 4.27% Amr::init() 1 2.362 2.362 2.362 4.16% MLPoisson::Fapply() 2422 1.898 1.927 2.009 3.54% MLCellLinOp::solutionResidual() 530 1.795 1.8 1.804 3.18% MLCellLinOp::correctionResidual() 1660 1.655 1.685 1.769 3.12% MultiFab::Subtract() 601 1.73 1.737 1.751 3.08% Amr::initialInit() 1 1.744 1.744 1.744 3.07% Castro::derive() 397 1.691 1.697 1.712 3.02% Gravity::multilevel_solve_for_new_phi() 10 1.711 1.712 1.712 3.02% Gravity::actual_multilevel_solve() 10 1.702 1.703 1.703 3.00% Castro::do_old_sources() 30 1.585 1.601 1.636 2.88% MLMG:computeResOfCorrection() 1421 1.508 1.537 1.619 2.85% FabArray::ParallelCopy_nowait() 5320 1.473 1.506 1.55 2.73% Castro::initialize_advance() 30 1.44 1.451 1.474 2.60% FabArray::ParallelCopy_finish() 5320 0.5456 1.135 1.428 2.51% Amr::FinalizeInit() 1 1.295 1.34 1.412 2.49% Castro::volWgtSum() 242 1.367 1.389 1.406 2.48% FabArray::FillBoundary() 13093 1.206 1.34 1.406 2.48% Gravity::fill_multipole_BCs() 41 1.14 1.216 1.247 2.20% Castro::expand_state() 30 1.214 1.225 1.234 2.17% FillPatchTwoLevels 394 1.191 1.21 1.227 2.16% Amr::writePlotFile() 2 1.188 1.188 1.188 2.09% FluxRegister::Reflux() 180 1.176 1.178 1.179 2.08% Gravity::get_new_grav_vector() 52 1.029 1.034 1.037 1.83% MLMG::addInterpCorrection() 1421 0.3318 0.8576 1.035 1.82% Castro::post_init() 2 0.9533 0.9676 0.9818 1.73% MLMG::computeResWithCrseSolFineCor() 78 0.9601 0.9615 0.9631 1.70% MLMG::computeResidual() 333 0.932 0.938 0.9509 1.68% MultiFab::sum() 4648 0.9108 0.915 0.9247 1.63% Castro::normalize_species() 254 0.8136 0.8234 0.8357 1.47% MLMG::mgVcycle_down::1 333 0.7275 0.744 0.789 1.39% MultiFab::Xpay() 2190 0.7501 0.7588 0.7842 1.38% FillBoundary_nowait() 13093 0.6949 0.7094 0.7288 1.28% FillBoundary_finish() 13093 0.441 0.5976 0.6785 1.20% MLCellLinOp::reflux() 116 0.6754 0.6767 0.6782 1.19% MLMG::mgVcycle_up::2 333 0.2174 0.5541 0.6687 1.18% MLMG::computeMLResidual() 97 0.602 0.6233 0.6325 1.11% MultiFab::min() 30 0.007399 0.3225 0.6318 1.11% Castro::construct_new_source() 250 0.6115 0.6201 0.6303 1.11% Castro::construct_new_gravity_source() 50 0.6108 0.6194 0.6297 1.11% Gravity::get_old_grav_vector() 30 0.5447 0.5634 0.5735 1.01% MLMG::mgVcycle_up::1 333 0.4877 0.5059 0.5591 0.98% FillPatchInterp(Fab) 130 0.3796 0.4678 0.5575 0.98% CellConservativeLinear::interp() 130 0.3761 0.4653 0.5557 0.98% Castro::estTimeStep() 69 0.2345 0.3785 0.5076 0.89% Amr::InitializeInit() 1 0.3318 0.4037 0.4493 0.79% Amr::defBaseLevel() 1 0.3318 0.4037 0.4493 0.79% Castro::initData() 3 0.3039 0.3739 0.422 0.74% Castro::finalize_advance() 30 0.3978 0.4062 0.4197 0.74% MLPoisson::define() 81 0.3833 0.3921 0.4087 0.72% MLPoisson::FFlux() 1044 0.3934 0.3937 0.3943 0.69% StateDataPhysBCFunct::() 853 0.3577 0.3611 0.3668 0.65% MLMG::prepareForSolve() 80 0.3223 0.3281 0.343 0.60% StateData::FillBoundary(geom) 63 0.3345 0.3373 0.3405 0.60% amrex::average_down 1713 0.3022 0.3114 0.3377 0.59% MLMG::mgVcycle_bottom 489 0.1654 0.2056 0.3258 0.57% Castro::apply_source_to_state() 100 0.2829 0.2852 0.2904 0.51% MultiFab::Saxpy() 100 0.2825 0.2849 0.29 0.51% MLMG::mgVcycle_down::2 333 0.2598 0.2664 0.285 0.50% MLCellLinOp::defineAuxData() 81 0.2215 0.2286 0.2462 0.43% MLMG::getGradSolution() 80 0.2218 0.2236 0.2286 0.40% MLCellLinOp::compGrad() 100 0.2216 0.2233 0.2283 0.40% Castro::computeNewDt() 18 0.1355 0.1969 0.2188 0.39% Amr::bldFineLevels() 1 0.1894 0.2008 0.2123 0.37% MLMG::mgVcycle_down::3 211 0.03399 0.07597 0.1998 0.35% VisMF::Write(FabArray) 4 0.1669 0.1697 0.1742 0.31% MLMG::miniCycle() 156 0.1649 0.1652 0.1656 0.29% MLMG::ResNormInf() 450 0.1285 0.151 0.1607 0.28% MLMG::actualBottomSolve() 333 0.0004274 0.04037 0.1602 0.28% Castro::init(old) 9 0.1521 0.1538 0.1563 0.28% Castro::construct_old_source() 150 0.1421 0.1469 0.1558 0.27% Castro::construct_old_gravity_source() 30 0.1418 0.1466 0.1554 0.27% MLCGSolver::bicgstab 83 0 0.03839 0.1535 0.27% MLCellLinOp::defineBC() 81 0.1475 0.1484 0.1492 0.26% FabArray::mult() 294 0.1464 0.1473 0.1492 0.26% MultiFab::Multiply() 164 0.1447 0.1458 0.148 0.26% MLMG::mgVcycle_up::3 211 0.02537 0.05472 0.1412 0.25% FabArray::setDomainBndry() 853 0.1348 0.1357 0.1366 0.24% Castro::computeInitialDt() 2 0.01633 0.06187 0.1337 0.24% Amr::grid_places() 11 0.1237 0.1283 0.1326 0.23% AmrMesh::MakeNewGrids() 11 0.123 0.1277 0.132 0.23% Castro::volProductSum() 22 0.1223 0.1247 0.1286 0.23% BndryData::define() 123 0.1212 0.1221 0.1231 0.22% MLMG::computeResWithCrseCorFineCor() 78 0.1071 0.1075 0.1081 0.19% Gravity::GetCrsePhi() 40 0.09265 0.09684 0.1024 0.18% MLCellLinOp::updateSolBC() 99 0.08517 0.09485 0.09977 0.18% Castro::check_for_nan() 60 0.09672 0.09771 0.09955 0.18% MultiFab::contains_nan() 60 0.09652 0.09752 0.09936 0.18% FabArrayBase::getCPC() 8152 0.07358 0.07828 0.09117 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08488 0.08584 0.08833 0.16% Gravity::test_level_grad_phi_curr() 20 0.08366 0.08404 0.08444 0.15% MultiFab::LinComb() 628 0.06537 0.06938 0.08119 0.14% Gravity::update_max_rhs() 20 0.04996 0.06302 0.07708 0.14% MLMG::mgVcycle_down::4 211 0.03247 0.04373 0.07547 0.13% MLCellLinOp::updateCorBC() 78 0.0654 0.06597 0.06675 0.12% Castro::errorEst() 11 0.06104 0.06266 0.06663 0.12% MLCellLinOp::setLevelBC() 102 0.05226 0.06094 0.06413 0.11% Gravity::test_composite_phi() 1 0.06146 0.06149 0.06152 0.11% MLMG::mgVcycle_up::4 211 0.02559 0.03402 0.0579 0.10% Gravity::test_level_grad_phi_prev() 30 0.04772 0.04887 0.05168 0.09% MLMG::buildFineMask() 80 0.05025 0.05032 0.05039 0.09% MultiFab::norm0(mask) 57 0.04837 0.04853 0.04883 0.09% MLMG::MLResNormInf() 97 0.04513 0.04552 0.04568 0.08% FabArrayBase::CPC::define() 2260 0.02908 0.03349 0.04547 0.08% MultiFab::max() 40 0.01404 0.02774 0.04198 0.07% MLMG::interpCorrection_1 78 0.03155 0.03714 0.04186 0.07% MultiFab::Copy() 100 0.04072 0.04087 0.04123 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03653 0.03715 0.03822 0.07% MLPoisson::prepareForSolve() 81 0.02569 0.02671 0.02959 0.05% MLMG::MLRhsNormInf() 80 0.02934 0.02938 0.02944 0.05% MLCellLinOp::prepareForSolve() 81 0.02531 0.02634 0.02922 0.05% FabArrayBase::getFB() 13093 0.02473 0.02592 0.02912 0.05% TagBoxArray::mapPRD 11 0.006643 0.01874 0.02603 0.05% Gravity::swapTimeLevels() 30 0.02327 0.02412 0.0249 0.04% Castro::apply_tagging_restrictions() 11 0.02126 0.02217 0.02449 0.04% Castro::finalize_do_advance() 30 0.002484 0.01485 0.02211 0.04% Castro::build_fine_mask() 153 0.01923 0.01954 0.0201 0.04% CGSolver::sxay() 588 0 0.004915 0.01966 0.03% AmrLevel::AmrLevel(dm) 12 0.01528 0.01712 0.0184 0.03% StateData::define() 48 0.015 0.01684 0.01812 0.03% MLLinOp::define() 81 0.01281 0.01447 0.01592 0.03% MLLinOp::defineGrids() 81 0.01252 0.01416 0.0156 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01493 0.01519 0.0156 0.03% MLMG::compResidual() 1 0.01401 0.01458 0.01527 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003776 0.01511 0.03% Castro::avgDown() 11 0.01429 0.01447 0.01488 0.03% Castro::avgDown(state_indx) 44 0.01424 0.01441 0.01482 0.03% amrex::average_down_w_geom 44 0.01412 0.01429 0.0147 0.03% Castro::swap_state_time_levels() 30 0.01352 0.01373 0.01387 0.02% MultiFab::Dot() 463 0 0.00284 0.01136 0.02% Castro::apply_problem_tags() 11 0.008423 0.008547 0.008756 0.02% Castro::FluxRegFineAdd() 30 0.007443 0.007502 0.007594 0.01% Castro::enforce_consistent_e() 3 0.00397 0.004823 0.006853 0.01% AMRErrorTag::operator() 11 0.004798 0.004943 0.005265 0.01% MLLinOp::makeSubCommunicator() 81 0.002274 0.003699 0.005004 0.01% Amr::InitAmr() 1 0.002577 0.002602 0.002613 0.00% FabArrayBase::TheFPinfo() 130 0.001046 0.001949 0.002583 0.00% FabArrayBase::FB::FB() 131 0.000893 0.001303 0.002526 0.00% MLLinOp::makeAgglomeratedDMap 81 0.002418 0.002474 0.002499 0.00% TagBoxArray::collate() 11 0.001603 0.002004 0.002359 0.00% FPinfo::FPinfo() 3 0.0005003 0.0014 0.002035 0.00% DistributionMapping::KnapSackDoIt() 3 0.0003956 0.00128 0.001897 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0003383 0.001242 0.00183 0.00% makeSFC 243 0.00163 0.001677 0.001698 0.00% OwnerMask() 11 0.0015 0.001571 0.001668 0.00% DistributionMapping::Distribute() 245 0.000513 0.0005189 0.0005246 0.00% Castro::enforce_speed_limit() 254 0.0004253 0.0004305 0.0004371 0.00% AmrMesh-cluster 2 0 9.109e-05 0.0003644 0.00% ClusterList::intersect() 2 0 5.825e-05 0.000233 0.00% FabArray::RecvLayoutMask() 21 0.0002034 0.0002044 0.0002053 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.577e-05 0.0001199 0.0001969 0.00% BoxList::parallelComplementIn() 22 8.111e-05 8.578e-05 9.269e-05 0.00% Amr::writeSmallPlotFile() 1 7.417e-05 7.859e-05 9.05e-05 0.00% Castro::create_source_corrector() 30 8.434e-05 8.676e-05 8.975e-05 0.00% knapsack() 3 6.679e-05 7.371e-05 8.019e-05 0.00% Castro::retry_advance_ctu() 30 4.808e-05 6.106e-05 7.311e-05 0.00% Amr::initSubcycle() 1 4.244e-05 5.572e-05 6.111e-05 0.00% Castro::gwstrain() 22 3.902e-05 4.33e-05 4.959e-05 0.00% BoxList::complementIn 22 4.004e-05 4.235e-05 4.546e-05 0.00% Gravity::set_mass_offset() 11 3.03e-05 3.414e-05 4.359e-05 0.00% ClusterList::chop() 2 0 6.241e-06 2.496e-05 0.00% knapsack()swap 2 4.933e-06 5.699e-06 7.723e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.04-18-ga537fb0516d5) finalized