MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.04-26-g0d136ea53aed) initialized Starting run at 05:40:31 UTC on 2022-04-20. Successfully read inputs file ... Castro git describe: 22.04-12-g78961ce2c AMReX git describe: 22.04-26-g0d136ea53 Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.011131926 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.011183985 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.029787465 Gravity::fill_multipole_BCs() time = 0.02839085 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.594519897 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029810983 Gravity::solve_for_phi() time = 0.402759131 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -6.967553685e+22 ymom added: -5.289050461e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 2.748779069e+11 Castro::do_old_sources() time = 0.149608589 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.463066169 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027380419 Gravity::solve_for_phi() time = 0.347457846 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.157898233 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0827980675 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008625021 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009332489 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.11061348 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046081016 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010191297 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01586645256 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008494934 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009255059 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107913245 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.047128576 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.01026185 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01450911524 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.030302021 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010243219 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.15212691 Castro::reflux() at level 0 : time = 1.031775762 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 5.0090308 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.010457095 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028621576 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.035981159 Gravity::solve_for_phi() time = 0.40472506 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852868e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.139235332 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.459067759 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027187159 Gravity::solve_for_phi() time = 0.329889089 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.151610592 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08420937034 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008135732 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009182179 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107656969 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042711272 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.009964653 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01634431307 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009193209 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009135707 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106956007 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043046383 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.01001667 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01482100653 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028633298 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.009980019 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770255e+28 zmom added: 8.082913464e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.149115468 Castro::reflux() at level 0 : time = 0.992047111 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.286605836 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009779384 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028452979 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030085441 Gravity::solve_for_phi() time = 0.378285976 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939026e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.133115403 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.457494499 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025730266 Gravity::solve_for_phi() time = 0.328438109 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.154490733 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08558369199 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008180199 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009241995 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108146078 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042876091 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010024541 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01626223935 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008101656 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009095411 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107137403 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043069945 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010133285 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01491797851 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028838437 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010043948 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655088e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342339e+27 ymom added: 5.311566494e+28 zmom added: 5.312402179e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.149666834 Castro::reflux() at level 0 : time = 1.002879345 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.165384575 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009833816 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028690525 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028642018 Gravity::solve_for_phi() time = 0.378242269 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700668e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.137636652 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.472562385 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027379538 Gravity::solve_for_phi() time = 0.341990525 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.153370739 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08464185446 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008438667 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009298002 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107809867 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045075083 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010616908 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01609271668 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008273072 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009704099 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.112083165 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043585691 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010367662 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01445857565 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028684708 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010013288 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.44439047e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.149416661 Castro::reflux() at level 0 : time = 0.957382353 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.164840739 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.010318971 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028412633 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032423875 Gravity::solve_for_phi() time = 0.381255596 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.40015049e+30 ymom added: 3.399803865e+30 zmom added: 3.399742021e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.133501231 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.450760471 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025505042 Gravity::solve_for_phi() time = 0.327199223 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591232e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.148425301 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08585492003 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008202771 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009110231 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107082829 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043152178 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010014905 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01640229913 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008106329 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009124297 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106559008 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042710981 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010138354 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01504172446 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.030502926 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010116485 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363474e+28 ymom added: 7.265277776e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.148652791 Castro::reflux() at level 0 : time = 0.937181736 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.101498145 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009856098 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028497215 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029743382 Gravity::solve_for_phi() time = 0.377975535 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.09491932e+30 ymom added: 4.094511425e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.134013851 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.463392442 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025144478 Gravity::solve_for_phi() time = 0.326464708 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245022e+27 ymom added: -5.297264722e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.152318352 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08546102657 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00839979 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009136262 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107259477 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043112565 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.010104484 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01635116999 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008377029 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009250772 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107849825 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042976159 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010034518 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0149134189 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028737432 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010020856 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.150854669 Castro::reflux() at level 0 : time = 0.940332951 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.122300099 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.010408458 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028710432 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030893371 Gravity::solve_for_phi() time = 0.378477742 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151121e+30 ymom added: 4.515687996e+30 zmom added: 4.515609038e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.133313902 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.455426674 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025587415 Gravity::solve_for_phi() time = 0.326898181 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.88175262e+28 zmom added: -2.881735257e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.153765401 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08568960141 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008193105 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009061469 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107887335 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042614349 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010144464 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01640703186 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008253787 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009196524 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107774415 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042990194 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010004547 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01501754929 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028728708 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.010352418 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.149337606 Castro::reflux() at level 0 : time = 0.93484442 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.17214995 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009808109 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028329727 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03022983 Gravity::solve_for_phi() time = 0.376097942 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064111e+30 ymom added: 4.889542979e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.133991501 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.456703278 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025130811 Gravity::solve_for_phi() time = 0.372474724 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.153059928 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08448451151 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008154557 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009198116 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108026786 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042862381 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010042296 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01636988621 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008330047 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009067538 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107010143 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042707527 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010077852 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01507920252 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028615878 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010055779 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907345e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.149262516 Castro::reflux() at level 0 : time = 0.933528623 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.199785383 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.010398257 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028533896 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028926075 Gravity::solve_for_phi() time = 0.375197684 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036349e+30 ymom added: 5.530451715e+30 zmom added: 5.530356286e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.133236457 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.451414328 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025221639 Gravity::solve_for_phi() time = 0.372990003 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170339e+28 zmom added: -5.061201607e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.155627374 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08454804455 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00840492 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009135884 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107729175 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042653833 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.009984933 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01633869463 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008050794 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009074301 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106939514 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043002646 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.01010641 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0149745758 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029279668 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.010085643 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087175e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.148156078 Castro::reflux() at level 0 : time = 0.93530515 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.202701382 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.010414293 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02871062 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028723158 Gravity::solve_for_phi() time = 0.377162545 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167165e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.133657677 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.455605618 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024990321 Gravity::solve_for_phi() time = 0.373092249 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.153730776 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08440373673 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008318352 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009092807 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107597433 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048285999 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010007596 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01606166689 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008074212 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009373201 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107755447 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048337399 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010056955 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01470350084 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028785496 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010097613 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914878e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.149157462 Castro::reflux() at level 0 : time = 0.989594152 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.260393667 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.542521457 seconds Ending run at 05:41:25 UTC on 2022-04-20. Run time = 54.42035952 Run time without initialization = 52.177768 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.42 ... 54.42 ... 54.42 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.5637 16.6452 16.7321 30.75% MLPoisson::Fsmooth() 11992 4.166 4.23 4.4 8.09% Castro::reset_internal_energy() 257 2.902 2.959 3.056 5.62% MultiFab::AddProduct() 4648 2.653 2.666 2.685 4.93% FabArray::setVal() 9464 2.292 2.316 2.327 4.28% MLPoisson::Fapply() 2422 1.904 1.945 2.022 3.72% MLCellLinOp::applyBC() 14630 1.467 1.539 1.715 3.15% MultiFab::Subtract() 601 1.638 1.645 1.655 3.04% FabArray::ParallelCopy_nowait() 5320 1.362 1.385 1.405 2.58% FabArray::ParallelCopy_finish() 5320 0.5561 1.057 1.327 2.44% Castro::enforce_min_density() 254 1.033 1.075 1.16 2.13% Gravity::fill_multipole_BCs() 41 1.059 1.096 1.125 2.07% Castro::derive() 397 0.9187 0.9242 0.9309 1.71% MultiFab::sum() 4648 0.8832 0.8853 0.8892 1.63% FluxRegister::Reflux() 180 0.8279 0.8296 0.8307 1.53% Castro::normalize_species() 254 0.8135 0.8213 0.8298 1.52% MultiFab::Xpay() 2190 0.6934 0.6979 0.7097 1.30% Castro::reflux() 10 0.6825 0.6857 0.6916 1.27% FillBoundary_nowait() 13093 0.6523 0.6669 0.6768 1.24% Castro::construct_new_gravity_source() 50 0.6048 0.6077 0.6107 1.12% FillBoundary_finish() 13093 0.524 0.546 0.5623 1.03% Castro::volWgtSum() 242 0.5371 0.5506 0.5565 1.02% CellConservativeLinear::interp() 130 0.3752 0.465 0.5547 1.02% Castro::estTimeStep() 69 0.2306 0.3916 0.5089 0.94% Castro::computeTemp() 257 0.455 0.4586 0.4617 0.85% MLPoisson::FFlux() 1044 0.3907 0.3918 0.3931 0.72% Castro::finalize_advance() 30 0.3474 0.3518 0.3549 0.65% Gravity::get_new_grav_vector() 52 0.3302 0.3327 0.3347 0.62% FillPatchSingleLevel 853 0.3287 0.3301 0.3335 0.61% StateData::FillBoundary(geom) 63 0.3238 0.3263 0.3293 0.61% amrex::average_down 1713 0.2717 0.2756 0.2855 0.52% MLMG::addInterpCorrection() 1421 0.2674 0.2718 0.2838 0.52% MultiFab::Saxpy() 100 0.277 0.2791 0.281 0.52% FillPatchIterator::Initialize 723 0.2551 0.2674 0.2737 0.50% Castro::do_advance_ctu() 30 0.2144 0.2151 0.2157 0.40% MultiFab::min() 30 0.00692 0.1153 0.2068 0.38% MLMG::oneIter() 333 0.2057 0.206 0.2064 0.38% Castro::expand_state() 30 0.1884 0.1891 0.1908 0.35% MLCellLinOp::defineAuxData() 81 0.1749 0.1785 0.1864 0.34% VisMF::Write(FabArray) 4 0.1605 0.167 0.1778 0.33% MLCellLinOp::reflux() 116 0.1722 0.1724 0.1727 0.32% Castro::post_timestep() 30 0.04945 0.08707 0.1726 0.32% MLCellLinOp::compGrad() 100 0.1684 0.1693 0.1702 0.31% Gravity::get_old_grav_vector() 30 0.1637 0.1647 0.1666 0.31% FabArray::mult() 294 0.1434 0.1448 0.1455 0.27% Castro::construct_old_gravity_source() 30 0.1382 0.1395 0.142 0.26% MultiFab::Multiply() 164 0.1416 0.1417 0.1419 0.26% FabArray::setDomainBndry() 853 0.1255 0.1277 0.1304 0.24% MLMG::ResNormInf() 450 0.0939 0.1168 0.1279 0.24% Amr::writePlotFile() 2 0.1167 0.1218 0.1267 0.23% MultiFab::contains_nan() 60 0.09522 0.09563 0.09619 0.18% BndryData::define() 123 0.08987 0.09081 0.09182 0.17% Castro::construct_old_gravity() 30 0.08552 0.08643 0.08834 0.16% MLMG::prepareForSolve() 80 0.08037 0.08241 0.08472 0.16% MultiFab::LinComb() 628 0.0635 0.06808 0.07993 0.15% Gravity::test_level_grad_phi_curr() 20 0.07212 0.07426 0.07921 0.15% Castro::evaluate_source_change() 591 0.07654 0.07738 0.07796 0.14% Gravity::gravity_sync() 10 0.06965 0.07029 0.07136 0.13% Castro::initData() 3 0.05885 0.06473 0.07043 0.13% Castro::construct_new_gravity() 30 0.05225 0.05449 0.05943 0.11% MLCellLinOp::updateSolBC() 99 0.0577 0.05824 0.05866 0.11% MLCGSolver::bicgstab 83 0 0.01428 0.05712 0.10% Castro::volProductSum() 22 0.0502 0.05246 0.05591 0.10% MultiFab::norm0(mask) 57 0.04699 0.04714 0.04729 0.09% MLCellLinOp::updateCorBC() 78 0.04556 0.04594 0.04632 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04458 0.04516 0.04626 0.09% Gravity::test_level_grad_phi_prev() 30 0.04096 0.04218 0.04507 0.08% Castro::initialize_do_advance() 30 0.03406 0.03903 0.044 0.08% FabArrayBase::CPC::define() 2260 0.02741 0.03177 0.04326 0.08% FabArrayBase::getCPC() 8152 0.04103 0.04154 0.04223 0.08% Gravity::actual_solve_with_mlmg() 81 0.03702 0.03914 0.04175 0.08% MLCellLinOp::setLevelBC() 102 0.04064 0.04114 0.04156 0.08% MultiFab::Copy() 100 0.03901 0.03906 0.03911 0.07% MLMG::buildFineMask() 80 0.03852 0.03871 0.03889 0.07% AmrMesh::MakeNewGrids() 11 0.03502 0.03608 0.03865 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03546 0.0361 0.03716 0.07% MultiFab::max() 40 0.01315 0.02367 0.03447 0.06% Gravity::solve_for_phi() 60 0.02637 0.02881 0.03421 0.06% FabArray::FillBoundary() 13093 0.03062 0.03169 0.03388 0.06% MLCellLinOp::prepareForSolve() 81 0.02477 0.02566 0.02817 0.05% MLCellLinOp::smooth() 5996 0.02523 0.0259 0.02665 0.05% Castro::initialize_advance() 30 0.02551 0.02579 0.02628 0.05% Castro::init(old) 9 0.026 0.02608 0.02617 0.05% FabArrayBase::getFB() 13093 0.022 0.02287 0.0251 0.05% MLCellLinOp::defineBC() 81 0.02397 0.02441 0.02472 0.05% Gravity::update_max_rhs() 20 0.02378 0.02387 0.02395 0.04% Amr::defBaseLevel() 1 0.02066 0.0219 0.02313 0.04% MLMG::interpCorrection_1 78 0.02296 0.02299 0.02301 0.04% Castro::apply_tagging_restrictions() 11 0.02218 0.02227 0.02239 0.04% Castro::finalize_do_advance() 30 0.009073 0.01575 0.02173 0.04% Castro::build_fine_mask() 153 0.018 0.01811 0.0182 0.03% FillPatchTwoLevels 394 0.01522 0.01581 0.01646 0.03% StateData::define() 48 0.01473 0.01538 0.01616 0.03% Castro::post_init() 2 0.0003301 0.007929 0.01548 0.03% FabArray::ParallelCopy() 5320 0.01421 0.01439 0.01465 0.03% Castro::swap_state_time_levels() 30 0.01305 0.01335 0.01384 0.03% MLMG::MLRhsNormInf() 80 0.01207 0.01214 0.01222 0.02% Gravity::actual_multilevel_solve() 10 0.01183 0.01186 0.01188 0.02% StateDataPhysBCFunct::() 853 0.0102 0.0107 0.01131 0.02% MultiFab::Dot() 463 0 0.002803 0.01121 0.02% Amr::regrid() 10 0.009817 0.01024 0.01119 0.02% Gravity::GetCrsePhi() 40 0.009502 0.009736 0.00993 0.02% MLLinOp::makeSubCommunicator() 81 0.004914 0.006808 0.00953 0.02% MLMG::solve() 80 0.00335 0.006682 0.009191 0.02% MLCellLinOp::apply() 2422 0.005524 0.006451 0.00892 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008325 0.008483 0.008584 0.02% Castro::apply_problem_tags() 11 0.008168 0.008199 0.008223 0.02% MLLinOp::defineGrids() 81 0.007365 0.007797 0.008221 0.02% Castro::FluxRegFineAdd() 30 0.007183 0.007333 0.007481 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001833 0.00733 0.01% Castro::enforce_consistent_e() 3 0.003964 0.005276 0.006705 0.01% MLCellLinOp::correctionResidual() 1660 0.004633 0.004979 0.005836 0.01% Castro::do_new_sources() 50 0.0008774 0.002052 0.005184 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005078 0.005089 0.005102 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004918 0.00494 0.004967 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004869 0.00488 0.004892 0.01% AMRErrorTag::operator() 11 0.004672 0.004789 0.004856 0.01% CGSolver::sxay() 588 0 0.001182 0.004728 0.01% FillPatchInterp(Fab) 130 0.001691 0.002465 0.004451 0.01% main() 1 0.002854 0.003949 0.004335 0.01% MLMG::mgVcycle() 489 0.00396 0.004072 0.004302 0.01% Gravity::test_composite_phi() 1 0.00377 0.003852 0.003925 0.01% MLMG:computeResOfCorrection() 1421 0.003259 0.003341 0.003499 0.01% Castro::do_old_sources() 30 0.000498 0.001362 0.003455 0.01% MLMG::actualBottomSolve() 333 0.0003838 0.001124 0.003319 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0002472 0.001692 0.002941 0.01% FabArrayBase::FB::FB() 131 0.0008616 0.001251 0.0024 0.00% MLMG::mgVcycle_down::0 333 0.002198 0.002227 0.002282 0.00% MLMG::mgVcycle_down::1 333 0.002046 0.002079 0.002132 0.00% MLCellLinOp::solutionResidual() 530 0.001933 0.001983 0.002042 0.00% MLMG::mgVcycle_down::2 333 0.00191 0.001947 0.002006 0.00% Castro::subcycle_advance_ctu() 30 0.0001866 0.0006494 0.001993 0.00% Amr::InitAmr() 1 0.001916 0.001927 0.001937 0.00% Gravity::solve_phi_with_mlmg() 71 0.001587 0.001669 0.001799 0.00% TagBoxArray::collate() 11 0.001209 0.001386 0.001729 0.00% OwnerMask() 11 0.00137 0.001502 0.001628 0.00% Castro::clean_state() 254 0.001593 0.001607 0.00162 0.00% MLMG::mgVcycle_up::0 333 0.001525 0.001551 0.001568 0.00% MLMG::mgVcycle_up::2 333 0.001342 0.001382 0.001465 0.00% MLMG::mgVcycle_up::1 333 0.001367 0.001392 0.001424 0.00% MLMG::mgVcycle_bottom 489 0.00128 0.001291 0.001306 0.00% MLMG::mgVcycle_down::3 211 0.001169 0.0012 0.001274 0.00% MLMG::mgVcycle_down::4 211 0.001111 0.00116 0.001266 0.00% makeSFC 243 0.001004 0.001158 0.001241 0.00% Amr::coarseTimeStep() 10 0.0005892 0.0007281 0.001069 0.00% MLMG::MLResNormInf() 97 0.0006049 0.0008047 0.0009995 0.00% MLMG::mgVcycle_up::4 211 0.0007898 0.0008324 0.0009395 0.00% TagBoxArray::mapPRD 11 0.0008104 0.000858 0.0008924 0.00% MLMG::mgVcycle_up::3 211 0.0007563 0.0007968 0.0008742 0.00% MLMG::computeResidual() 333 0.0008199 0.0008267 0.0008397 0.00% Amr::bldFineLevels() 1 0.0007651 0.0008071 0.0008315 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007503 0.0007934 0.0008128 0.00% Amr::timeStep() 30 0.0004562 0.000542 0.0007499 0.00% MLPoisson::define() 81 0.0005917 0.000636 0.0007074 0.00% Castro::construct_new_source() 250 0.0005817 0.0005987 0.000614 0.00% Amr::grid_places() 11 0.000509 0.000551 0.0005932 0.00% FabArrayBase::TheFPinfo() 130 0.0005179 0.0005334 0.0005565 0.00% DistributionMapping::Distribute() 245 0.0004851 0.0004965 0.0005101 0.00% Castro::enforce_speed_limit() 254 0.0003806 0.0004042 0.0004136 0.00% Castro::computeNewDt() 18 0.0001116 0.0001827 0.0003752 0.00% MLPoisson::prepareForSolve() 81 0.0003442 0.0003612 0.0003693 0.00% Castro::apply_source_to_state() 100 0.0003422 0.0003504 0.0003601 0.00% MLMG::computeMLResidual() 97 0.0003011 0.0003073 0.0003175 0.00% MLLinOp::define() 81 0.0002879 0.0002975 0.000314 0.00% Castro::construct_old_source() 150 0.0002756 0.0002866 0.0003007 0.00% MLMG::miniCycle() 156 0.0002718 0.0002777 0.0002818 0.00% AmrLevel::AmrLevel(dm) 12 0.000245 0.000258 0.0002644 0.00% Castro::post_regrid() 22 0.0002246 0.0002465 0.0002619 0.00% MLMG::getGradSolution() 80 0.0002441 0.0002517 0.0002574 0.00% Castro::advance() 30 0.0002006 0.0002123 0.0002315 0.00% ClusterList::intersect() 2 0 5.41e-05 0.0002164 0.00% FabArray::RecvLayoutMask() 21 0.0001955 0.0002012 0.0002151 0.00% Gravity::swapTimeLevels() 30 0.0001851 0.0001892 0.000192 0.00% Castro::check_for_nan() 60 0.000183 0.0001854 0.0001895 0.00% Gravity::solve_for_delta_phi 10 7.771e-05 9.68e-05 0.0001365 0.00% Castro::errorEst() 11 0.0001232 0.000126 0.0001306 0.00% Castro::avgDown(state_indx) 44 0.0001085 0.0001149 0.0001215 0.00% FPinfo::FPinfo() 3 9.717e-05 0.0001054 0.0001131 0.00% Amr::FinalizeInit() 1 1.645e-05 4.077e-05 0.0001049 0.00% amrex::average_down_w_geom 44 8.807e-05 9.084e-05 9.754e-05 0.00% AmrMesh-cluster 2 0 2.283e-05 9.132e-05 0.00% Castro::create_source_corrector() 30 7.808e-05 8.091e-05 8.433e-05 0.00% Amr::writeSmallPlotFile() 1 7.202e-05 7.351e-05 7.508e-05 0.00% Castro::retry_advance_ctu() 30 4.977e-05 6.106e-05 7.293e-05 0.00% knapsack() 3 5.812e-05 6.301e-05 7.279e-05 0.00% Castro::avgDown() 11 5.621e-05 5.737e-05 5.875e-05 0.00% BoxList::parallelComplementIn() 22 3.973e-05 4.786e-05 5.846e-05 0.00% Amr::initSubcycle() 1 3.524e-05 3.966e-05 4.769e-05 0.00% Castro::gwstrain() 22 3.554e-05 3.989e-05 4.696e-05 0.00% BoxList::complementIn 22 3.785e-05 3.942e-05 4.219e-05 0.00% Gravity::set_mass_offset() 11 2.389e-05 2.963e-05 4.217e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.134e-05 3.199e-05 3.378e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.834e-05 2.948e-05 3.273e-05 0.00% ClusterList::chop() 2 0 5.089e-06 2.035e-05 0.00% Castro::computeInitialDt() 2 1e-05 1.186e-05 1.323e-05 0.00% MLMG::compResidual() 1 1.169e-05 1.2e-05 1.212e-05 0.00% Amr::InitializeInit() 1 5.826e-06 6.991e-06 9.391e-06 0.00% Amr::init() 1 5.305e-06 6.272e-06 6.9e-06 0.00% knapsack()swap 2 4.528e-06 5.17e-06 6.246e-06 0.00% Amr::initialInit() 1 3.754e-06 4.119e-06 4.386e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.42 54.42 54.42 100.00% Amr::coarseTimeStep() 10 51.63 51.63 51.63 94.87% Amr::timeStep() 30 51.41 51.45 51.55 94.73% Castro::advance() 30 36.21 36.21 36.21 66.54% Castro::subcycle_advance_ctu() 30 34.43 34.44 34.45 63.30% Castro::do_advance_ctu() 30 34.43 34.44 34.45 63.30% Castro::construct_ctu_hydro_source() 30 16.56 16.65 16.73 30.75% Gravity::actual_solve_with_mlmg() 81 13.21 13.21 13.21 24.28% MLMG::solve() 80 12.5 12.5 12.51 22.98% Castro::post_timestep() 30 12.08 12.11 12.22 22.46% Castro::clean_state() 254 10.69 10.8 10.94 20.11% MLMG::oneIter() 333 10.48 10.48 10.49 19.27% Gravity::solve_phi_with_mlmg() 71 9.919 9.961 9.991 18.36% Castro::reflux() 10 9.627 9.639 9.655 17.74% MLMG::mgVcycle() 489 9.182 9.184 9.188 16.88% Gravity::solve_for_phi() 60 8.24 8.277 8.304 15.26% MLCellLinOp::smooth() 5996 6.215 6.362 6.69 12.29% Castro::computeTemp() 257 6.156 6.229 6.315 11.60% Castro::reset_internal_energy() 257 5.701 5.77 5.857 10.76% Castro::construct_new_gravity() 30 5.03 5.036 5.039 9.26% Gravity::gravity_sync() 10 5.03 5.031 5.031 9.25% Castro::construct_old_gravity() 30 4.682 4.709 4.727 8.69% Castro::evaluate_source_change() 591 4.529 4.547 4.577 8.41% MLPoisson::Fsmooth() 11992 4.166 4.23 4.4 8.09% Gravity::solve_for_delta_phi 10 4.209 4.21 4.21 7.74% MLMG::mgVcycle_down::0 333 3.897 3.91 3.945 7.25% Castro::enforce_min_density() 254 3.794 3.849 3.929 7.22% Castro::do_new_sources() 50 3.273 3.298 3.332 6.12% FillPatchIterator::Initialize 723 3.281 3.303 3.323 6.11% Amr::regrid() 10 3.173 3.188 3.204 5.89% Castro::post_regrid() 22 2.98 3.002 3.024 5.56% MLCellLinOp::applyBC() 14630 2.672 2.786 2.981 5.48% MLMG::mgVcycle_up::0 333 2.678 2.87 2.936 5.39% FabArray::ParallelCopy() 5320 2.03 2.507 2.774 5.10% MultiFab::AddProduct() 4648 2.653 2.666 2.685 4.93% MLCellLinOp::apply() 2422 2.506 2.56 2.616 4.81% Castro::initialize_do_advance() 30 2.55 2.562 2.587 4.75% FabArray::setVal() 9464 2.292 2.316 2.327 4.28% FillPatchSingleLevel 853 2.207 2.242 2.272 4.17% Amr::init() 1 2.24 2.24 2.24 4.12% MLPoisson::Fapply() 2422 1.904 1.945 2.022 3.72% MLCellLinOp::solutionResidual() 530 1.724 1.76 1.814 3.33% MLCellLinOp::correctionResidual() 1660 1.617 1.655 1.714 3.15% Gravity::multilevel_solve_for_new_phi() 10 1.687 1.687 1.687 3.10% Gravity::actual_multilevel_solve() 10 1.678 1.679 1.679 3.08% MultiFab::Subtract() 601 1.638 1.645 1.655 3.04% Amr::initialInit() 1 1.645 1.645 1.646 3.02% Castro::derive() 397 1.618 1.625 1.637 3.01% MLMG:computeResOfCorrection() 1421 1.472 1.506 1.547 2.84% Castro::do_old_sources() 30 1.517 1.529 1.546 2.84% FabArray::ParallelCopy_nowait() 5320 1.41 1.435 1.46 2.68% Castro::initialize_advance() 30 1.374 1.385 1.393 2.56% Castro::volWgtSum() 242 1.342 1.353 1.358 2.49% Amr::FinalizeInit() 1 1.265 1.284 1.33 2.44% FabArray::ParallelCopy_finish() 5320 0.5561 1.057 1.327 2.44% FabArray::FillBoundary() 13093 1.23 1.269 1.284 2.36% FillPatchTwoLevels 394 1.165 1.187 1.205 2.21% Castro::expand_state() 30 1.167 1.175 1.184 2.18% Gravity::fill_multipole_BCs() 41 1.095 1.133 1.161 2.13% Amr::writePlotFile() 2 1.137 1.137 1.138 2.09% FluxRegister::Reflux() 180 1.118 1.122 1.125 2.07% Gravity::get_new_grav_vector() 52 0.9963 1.002 1.006 1.85% MLMG::addInterpCorrection() 1421 0.3143 0.8286 1.002 1.84% Castro::post_init() 2 0.9598 0.9702 0.9815 1.80% MLMG::computeResWithCrseSolFineCor() 78 0.9445 0.9449 0.9454 1.74% MLMG::computeResidual() 333 0.9045 0.9149 0.9401 1.73% MultiFab::sum() 4648 0.8832 0.8853 0.8892 1.63% Castro::normalize_species() 254 0.8135 0.8213 0.8298 1.52% MLMG::mgVcycle_down::1 333 0.67 0.723 0.8039 1.48% MultiFab::Xpay() 2190 0.6934 0.6979 0.7097 1.30% FillBoundary_nowait() 13093 0.6751 0.691 0.7043 1.29% MLCellLinOp::reflux() 116 0.6538 0.6599 0.6625 1.22% MLMG::mgVcycle_up::2 333 0.2084 0.5332 0.6419 1.18% MLMG::computeMLResidual() 97 0.5912 0.6094 0.6207 1.14% Castro::construct_new_source() 250 0.6054 0.6083 0.6112 1.12% Castro::construct_new_gravity_source() 50 0.6048 0.6077 0.6107 1.12% FillBoundary_finish() 13093 0.524 0.546 0.5623 1.03% FillPatchInterp(Fab) 130 0.378 0.4675 0.5564 1.02% CellConservativeLinear::interp() 130 0.3752 0.465 0.5547 1.02% Gravity::get_old_grav_vector() 30 0.5246 0.5323 0.5379 0.99% MLMG::mgVcycle_up::1 333 0.4655 0.4828 0.5336 0.98% Castro::estTimeStep() 69 0.2306 0.3916 0.5089 0.94% MLPoisson::define() 81 0.3775 0.3838 0.3965 0.73% Castro::finalize_advance() 30 0.3831 0.3893 0.3961 0.73% MLPoisson::FFlux() 1044 0.3907 0.3918 0.3931 0.72% Amr::InitializeInit() 1 0.3154 0.3617 0.38 0.70% Amr::defBaseLevel() 1 0.3154 0.3617 0.38 0.70% Castro::initData() 3 0.2848 0.3277 0.3528 0.65% StateDataPhysBCFunct::() 853 0.3351 0.337 0.3395 0.62% StateData::FillBoundary(geom) 63 0.3238 0.3263 0.3293 0.61% amrex::average_down 1713 0.2958 0.304 0.327 0.60% MLMG::prepareForSolve() 80 0.3069 0.3119 0.3234 0.59% MLMG::mgVcycle_bottom 489 0.1617 0.2016 0.3196 0.59% Castro::computeNewDt() 18 0.1335 0.2505 0.2948 0.54% Castro::apply_source_to_state() 100 0.2773 0.2795 0.2813 0.52% MLMG::mgVcycle_down::2 333 0.2441 0.2566 0.2812 0.52% MultiFab::Saxpy() 100 0.277 0.2791 0.281 0.52% MLCellLinOp::defineAuxData() 81 0.2157 0.2221 0.2379 0.44% MLMG::getGradSolution() 80 0.2142 0.2149 0.2165 0.40% MLCellLinOp::compGrad() 100 0.2139 0.2147 0.2163 0.40% MultiFab::min() 30 0.00692 0.1153 0.2068 0.38% MLMG::mgVcycle_down::3 211 0.03332 0.0738 0.1934 0.36% VisMF::Write(FabArray) 4 0.1605 0.167 0.1778 0.33% Amr::bldFineLevels() 1 0.1645 0.1699 0.1748 0.32% MLMG::miniCycle() 156 0.1613 0.162 0.1625 0.30% MLMG::ResNormInf() 450 0.1247 0.1475 0.1585 0.29% MLMG::actualBottomSolve() 333 0.0003838 0.03956 0.1571 0.29% Castro::init(old) 9 0.1501 0.1517 0.1544 0.28% MLCGSolver::bicgstab 83 0 0.03775 0.151 0.28% FabArray::mult() 294 0.1434 0.1448 0.1455 0.27% MLCellLinOp::defineBC() 81 0.1431 0.1437 0.1442 0.27% Castro::construct_old_source() 150 0.1384 0.1398 0.1423 0.26% Castro::construct_old_gravity_source() 30 0.1382 0.1395 0.142 0.26% MultiFab::Multiply() 164 0.1416 0.1417 0.1419 0.26% MLMG::mgVcycle_up::3 211 0.02511 0.05342 0.1369 0.25% FabArray::setDomainBndry() 853 0.1255 0.1277 0.1304 0.24% Castro::volProductSum() 22 0.1214 0.1235 0.1269 0.23% BndryData::define() 123 0.1173 0.1182 0.119 0.22% Amr::grid_places() 11 0.1135 0.1137 0.1137 0.21% AmrMesh::MakeNewGrids() 11 0.1129 0.1131 0.1132 0.21% MLMG::computeResWithCrseCorFineCor() 78 0.1036 0.1042 0.1048 0.19% Gravity::GetCrsePhi() 40 0.09048 0.09582 0.1031 0.19% MLCellLinOp::updateSolBC() 99 0.0881 0.09438 0.09879 0.18% Castro::check_for_nan() 60 0.09541 0.09581 0.09638 0.18% MultiFab::contains_nan() 60 0.09522 0.09563 0.09619 0.18% Gravity::test_level_grad_phi_curr() 20 0.08152 0.08382 0.08886 0.16% FabArrayBase::getCPC() 8152 0.06844 0.07332 0.08548 0.16% Castro::computeInitialDt() 2 0.01856 0.03698 0.08321 0.15% Gravity::create_comp_minus_level_grad_phi() 10 0.08061 0.08119 0.08229 0.15% MultiFab::LinComb() 628 0.0635 0.06808 0.07993 0.15% MLMG::mgVcycle_down::4 211 0.03207 0.04293 0.07367 0.14% Gravity::update_max_rhs() 20 0.04717 0.05762 0.06837 0.13% MLCellLinOp::updateCorBC() 78 0.06314 0.06372 0.06407 0.12% MLCellLinOp::setLevelBC() 102 0.05036 0.0591 0.06218 0.11% Castro::errorEst() 11 0.06073 0.06124 0.06158 0.11% Gravity::test_composite_phi() 1 0.05849 0.05851 0.05854 0.11% MLMG::mgVcycle_up::4 211 0.02519 0.0334 0.05674 0.10% Gravity::test_level_grad_phi_prev() 30 0.04638 0.04774 0.05069 0.09% MLMG::buildFineMask() 80 0.04769 0.04793 0.04814 0.09% MultiFab::norm0(mask) 57 0.04699 0.04714 0.04729 0.09% MLMG::MLResNormInf() 97 0.04365 0.04377 0.04402 0.08% FabArrayBase::CPC::define() 2260 0.02741 0.03177 0.04326 0.08% MultiFab::Copy() 100 0.03901 0.03906 0.03911 0.07% MLMG::interpCorrection_1 78 0.03432 0.03564 0.03755 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03546 0.0361 0.03716 0.07% MultiFab::max() 40 0.01315 0.02367 0.03447 0.06% MLMG::MLRhsNormInf() 80 0.02853 0.0286 0.02869 0.05% MLPoisson::prepareForSolve() 81 0.02513 0.02602 0.02851 0.05% MLCellLinOp::prepareForSolve() 81 0.02477 0.02566 0.02817 0.05% FabArrayBase::getFB() 13093 0.02286 0.02412 0.0275 0.05% Gravity::swapTimeLevels() 30 0.02248 0.0227 0.02298 0.04% Castro::apply_tagging_restrictions() 11 0.02218 0.02227 0.02239 0.04% Castro::finalize_do_advance() 30 0.009073 0.01575 0.02173 0.04% MLLinOp::define() 81 0.0148 0.01734 0.02023 0.04% MLLinOp::defineGrids() 81 0.01451 0.01704 0.01994 0.04% CGSolver::sxay() 588 0 0.004884 0.01954 0.04% Castro::build_fine_mask() 153 0.018 0.01811 0.0182 0.03% AmrLevel::AmrLevel(dm) 12 0.01498 0.01564 0.01643 0.03% StateData::define() 48 0.01473 0.01538 0.01616 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01385 0.01438 0.01516 0.03% Castro::avgDown() 11 0.01415 0.01436 0.0145 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003625 0.0145 0.03% Castro::avgDown(state_indx) 44 0.01409 0.0143 0.01444 0.03% amrex::average_down_w_geom 44 0.01397 0.01418 0.01433 0.03% MLMG::compResidual() 1 0.01383 0.01389 0.01396 0.03% Castro::swap_state_time_levels() 30 0.01305 0.01335 0.01384 0.03% MultiFab::Dot() 463 0 0.002803 0.01121 0.02% MLLinOp::makeSubCommunicator() 81 0.004914 0.006808 0.00953 0.02% TagBoxArray::mapPRD 11 0.005578 0.007989 0.009089 0.02% Castro::apply_problem_tags() 11 0.008168 0.008199 0.008223 0.02% Castro::FluxRegFineAdd() 30 0.007183 0.007333 0.007481 0.01% Castro::enforce_consistent_e() 3 0.003964 0.005276 0.006705 0.01% AMRErrorTag::operator() 11 0.004672 0.004789 0.004856 0.01% FabArrayBase::TheFPinfo() 130 0.0009407 0.002355 0.003634 0.01% FPinfo::FPinfo() 3 0.0003841 0.001822 0.003106 0.01% DistributionMapping::KnapSackDoIt() 3 0.000271 0.001717 0.003003 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0002472 0.001692 0.002941 0.01% MLLinOp::makeAgglomeratedDMap 81 0.002232 0.002439 0.002551 0.00% FabArrayBase::FB::FB() 131 0.0008616 0.001251 0.0024 0.00% Amr::InitAmr() 1 0.001951 0.001967 0.001985 0.00% makeSFC 243 0.001481 0.001646 0.001742 0.00% TagBoxArray::collate() 11 0.001209 0.001386 0.001729 0.00% OwnerMask() 11 0.00137 0.001502 0.001628 0.00% DistributionMapping::Distribute() 245 0.0004851 0.0004965 0.0005101 0.00% Castro::enforce_speed_limit() 254 0.0003806 0.0004042 0.0004136 0.00% AmrMesh-cluster 2 0 8.202e-05 0.0003281 0.00% ClusterList::intersect() 2 0 5.41e-05 0.0002164 0.00% FabArray::RecvLayoutMask() 21 0.0001955 0.0002012 0.0002151 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 7.571e-05 0.0001133 0.000134 0.00% BoxList::parallelComplementIn() 22 7.872e-05 8.728e-05 9.631e-05 0.00% Castro::create_source_corrector() 30 7.808e-05 8.091e-05 8.433e-05 0.00% knapsack() 3 6.265e-05 6.818e-05 7.904e-05 0.00% Amr::writeSmallPlotFile() 1 7.202e-05 7.351e-05 7.508e-05 0.00% Castro::retry_advance_ctu() 30 4.977e-05 6.106e-05 7.293e-05 0.00% Amr::initSubcycle() 1 3.524e-05 3.966e-05 4.769e-05 0.00% Castro::gwstrain() 22 3.554e-05 3.989e-05 4.696e-05 0.00% BoxList::complementIn 22 3.785e-05 3.942e-05 4.219e-05 0.00% Gravity::set_mass_offset() 11 2.389e-05 2.963e-05 4.217e-05 0.00% ClusterList::chop() 2 0 5.089e-06 2.035e-05 0.00% knapsack()swap 2 4.528e-06 5.17e-06 6.246e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.04-26-g0d136ea53aed) finalized