MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.03-17-g7b4d10daf9c4) initialized Starting run at 05:40:09 UTC on 2022-03-21. Successfully read inputs file ... Castro git describe: 22.02-13-ga12efaab3 AMReX git describe: 22.03-17-g7b4d10daf Microphysics git describe: 22.03-8-g75721f58 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.011962359 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.011768433 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.029784537 Gravity::fill_multipole_BCs() time = 0.029903087 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.605070539 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031573444 Gravity::solve_for_phi() time = 0.40374571 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -7.813209155e+22 ymom added: -5.289050461e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.137782537 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.441353401 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025317329 Gravity::solve_for_phi() time = 0.326949773 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.153882512 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08448275728 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008467837 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.00943838 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108710967 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045216095 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010036235 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01612059636 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008224819 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009014337 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107403659 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045278281 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.01006032 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01482435719 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.0276366 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.00992982 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.147607778 Castro::reflux() at level 0 : time = 0.983847293 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.866881837 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009514805 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028872087 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032533022 Gravity::solve_for_phi() time = 0.378545329 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852864e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.129891963 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.44538834 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024917342 Gravity::solve_for_phi() time = 0.324917156 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.147928111 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08651744465 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008476198 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009026054 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106303792 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042857226 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.009949387 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0165116167 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008516386 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009234206 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107309703 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043379659 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.009913001 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01499982777 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028602628 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.009941783 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809891e+28 ymom added: 8.089770255e+28 zmom added: 8.082913463e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.145985846 Castro::reflux() at level 0 : time = 0.98356975 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.153107236 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.00950531 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028372107 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030265257 Gravity::solve_for_phi() time = 0.374744085 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939013e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.130203843 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.430340841 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024151289 Gravity::solve_for_phi() time = 0.322315496 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983741e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.146335234 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08730210042 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008548059 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.008934748 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10677206 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044909922 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010317505 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01627989036 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008287083 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.008931903 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109711406 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043439836 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.009974904 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01458442547 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028851499 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010025242 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655088e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342332e+27 ymom added: 5.311566494e+28 zmom added: 5.312402179e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.147545133 Castro::reflux() at level 0 : time = 0.98987704 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.068533083 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009825435 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028887073 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031960686 Gravity::solve_for_phi() time = 0.376680427 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.05970066e+30 ymom added: 3.059418825e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.13188021 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.439006282 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.043053619 Gravity::solve_for_phi() time = 0.353850264 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.147085838 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08592042587 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008488166 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009011325 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107543729 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043212536 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010102532 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01638699456 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008601767 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009011305 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106636486 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043392903 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010071296 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0150544288 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028721752 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.009926668 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.147305187 Castro::reflux() at level 0 : time = 0.931417731 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.071781206 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009780701 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029288497 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029026146 Gravity::solve_for_phi() time = 0.373424651 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150486e+30 ymom added: 3.399803827e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.130028163 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.444902672 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026269694 Gravity::solve_for_phi() time = 0.365364737 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591233e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.147094415 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08568961872 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008221503 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.00917662 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10696974 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043421132 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.009988567 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01645917405 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008460866 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009654946 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10677292 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042990417 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010178992 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01507291632 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028672497 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.009924779 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363474e+28 ymom added: 7.265277777e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.146812241 Castro::reflux() at level 0 : time = 0.928869359 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.08175106 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009583209 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028504547 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03127447 Gravity::solve_for_phi() time = 0.377030185 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919311e+30 ymom added: 4.094511425e+30 zmom added: 4.094439154e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.131409085 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.437129414 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024746569 Gravity::solve_for_phi() time = 0.365382961 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245023e+27 ymom added: -5.297264713e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.158550834 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08529861505 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00855472 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009149415 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106676949 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043445435 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.01024192 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01643585855 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008546188 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009001156 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107096827 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043363561 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010232 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01505623314 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029148564 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.009911699 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.144948889 Castro::reflux() at level 0 : time = 0.926609693 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.067188122 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009545819 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029106702 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029901883 Gravity::solve_for_phi() time = 0.37636634 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151108e+30 ymom added: 4.515688034e+30 zmom added: 4.515608962e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.130499469 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.443609919 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025651735 Gravity::solve_for_phi() time = 0.325614418 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.881752619e+28 zmom added: -2.881735257e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.146902614 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08661021817 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009202452 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.00937003 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106917861 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045355867 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.009973284 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01602124592 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008452158 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.008960975 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106084919 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043586374 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010062215 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01502968804 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02829231 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.009870569 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.146817834 Castro::reflux() at level 0 : time = 0.928790266 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.101183835 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009668091 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028290781 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029622159 Gravity::solve_for_phi() time = 0.374912066 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064091e+30 ymom added: 4.889542941e+30 zmom added: 4.889455521e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.131682319 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.43164872 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024277916 Gravity::solve_for_phi() time = 0.369459615 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642725e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.149751908 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08570754514 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008309891 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009041378 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105632896 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043414494 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010056828 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01650589611 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008474949 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.008947613 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106205341 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043170486 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010040258 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01512744708 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028690513 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.009956316 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478815e+29 ymom added: 5.931907345e+27 zmom added: 5.953997699e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.145763898 Castro::reflux() at level 0 : time = 0.927424202 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.120913042 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009479192 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028703304 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030065787 Gravity::solve_for_phi() time = 0.374694133 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036361e+30 ymom added: 5.53045164e+30 zmom added: 5.530356588e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.13075318 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.434719803 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024811113 Gravity::solve_for_phi() time = 0.37029914 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170338e+28 zmom added: -5.061201609e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.15123457 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08562096828 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008316708 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.008984141 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106507361 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043504128 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010108698 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01647134087 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.010104957 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.008980914 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107205893 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04360284 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.009895566 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01495498966 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02850925 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.009933131 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.146242647 Castro::reflux() at level 0 : time = 0.927291296 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.127438844 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009529468 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02818538 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030249923 Gravity::solve_for_phi() time = 0.383585816 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167163e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.13491804 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.473654273 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025228791 Gravity::solve_for_phi() time = 0.377962456 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.151608516 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.083867665 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008051524 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009424612 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107418283 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.049566443 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010450331 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01586252286 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008009723 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009435594 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105911101 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.049342375 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010437835 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01467083443 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028639015 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.009933287 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914869e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.145675984 Castro::reflux() at level 0 : time = 0.988485512 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.262304207 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.544452658 seconds Ending run at 05:41:02 UTC on 2022-03-21. Run time = 53.65296029 Run time without initialization = 51.46992117 Average number of zones advanced per microsecond: 0.053 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 53.65 ... 53.65 ... 53.65 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.3977 16.5026 16.5595 30.86% MLPoisson::Fsmooth() 11992 4.149 4.235 4.429 8.26% Castro::reset_internal_energy() 257 2.895 2.931 2.988 5.57% MultiFab::AddProduct() 4648 2.6 2.61 2.624 4.89% FabArray::setVal() 9464 2.303 2.319 2.361 4.40% MLPoisson::Fapply() 2422 1.853 1.876 1.928 3.59% MLCellLinOp::applyBC() 14630 1.469 1.535 1.721 3.21% MultiFab::Subtract() 601 1.663 1.669 1.681 3.13% FabArray::ParallelCopy_nowait() 5320 1.375 1.404 1.429 2.66% FabArray::ParallelCopy_finish() 5320 0.5073 1.023 1.312 2.45% Gravity::fill_multipole_BCs() 41 1.072 1.107 1.127 2.10% Castro::enforce_min_density() 254 1.029 1.06 1.108 2.07% Castro::derive() 397 0.9219 0.9289 0.9334 1.74% MultiFab::sum() 4648 0.8505 0.8541 0.86 1.60% FluxRegister::Reflux() 180 0.8223 0.824 0.826 1.54% MultiFab::Xpay() 2190 0.7124 0.719 0.7362 1.37% Castro::reflux() 10 0.6933 0.6934 0.6936 1.29% FillBoundary_nowait() 13093 0.649 0.6564 0.6671 1.24% Castro::construct_new_gravity_source() 50 0.6016 0.6055 0.6085 1.13% FillBoundary_finish() 13093 0.4455 0.5238 0.5624 1.05% Castro::volWgtSum() 242 0.5174 0.5331 0.5619 1.05% CellConservativeLinear::interp() 130 0.3683 0.4555 0.5432 1.01% Castro::normalize_species() 254 0.5063 0.5153 0.5339 1.00% Castro::computeTemp() 257 0.4659 0.4697 0.4722 0.88% MLPoisson::FFlux() 1044 0.3888 0.3898 0.3906 0.73% Castro::finalize_advance() 30 0.3452 0.3546 0.3637 0.68% Gravity::get_new_grav_vector() 52 0.3292 0.3309 0.3355 0.63% StateData::FillBoundary(geom) 63 0.3246 0.3291 0.3348 0.62% Castro::estTimeStep() 69 0.2253 0.289 0.3313 0.62% FillPatchSingleLevel 853 0.3265 0.3278 0.3292 0.61% MLMG::addInterpCorrection() 1421 0.2683 0.2735 0.2869 0.53% amrex::average_down 1713 0.2693 0.2744 0.2862 0.53% MultiFab::Saxpy() 100 0.2737 0.2739 0.2743 0.51% FillPatchIterator::Initialize 723 0.2629 0.2653 0.2696 0.50% Castro::do_advance_ctu() 30 0.2158 0.2166 0.2174 0.41% MLMG::oneIter() 333 0.2114 0.2125 0.2138 0.40% MultiFab::min() 30 0.007189 0.07827 0.1962 0.37% Castro::expand_state() 30 0.1894 0.1899 0.1902 0.35% MLCellLinOp::defineAuxData() 81 0.1749 0.1813 0.1881 0.35% MLCellLinOp::reflux() 116 0.172 0.1739 0.1767 0.33% VisMF::Write(FabArray) 4 0.1637 0.167 0.1755 0.33% MLCellLinOp::compGrad() 100 0.1706 0.1712 0.172 0.32% Gravity::get_old_grav_vector() 30 0.1643 0.1652 0.1674 0.31% MultiFab::Multiply() 164 0.1459 0.1462 0.1464 0.27% FabArray::mult() 294 0.1372 0.1386 0.1397 0.26% Castro::construct_old_gravity_source() 30 0.1334 0.1339 0.1345 0.25% Amr::writePlotFile() 2 0.1153 0.1261 0.1323 0.25% FabArray::setDomainBndry() 853 0.1245 0.1274 0.1293 0.24% MLMG::ResNormInf() 450 0.1009 0.1114 0.1176 0.22% Castro::post_timestep() 30 0.08501 0.09421 0.1092 0.20% BndryData::define() 123 0.08839 0.08969 0.09151 0.17% MultiFab::contains_nan() 60 0.09114 0.09127 0.09149 0.17% Castro::construct_old_gravity() 30 0.08719 0.08761 0.08846 0.16% MultiFab::LinComb() 628 0.07193 0.07636 0.08777 0.16% MLMG::prepareForSolve() 80 0.07888 0.08149 0.08293 0.15% Castro::evaluate_source_change() 591 0.07706 0.07829 0.08088 0.15% Gravity::test_level_grad_phi_curr() 20 0.07127 0.0719 0.07254 0.14% Gravity::gravity_sync() 10 0.07076 0.07105 0.07135 0.13% Castro::initData() 3 0.0579 0.06175 0.06413 0.12% Castro::construct_new_gravity() 30 0.05246 0.05481 0.05834 0.11% MLCellLinOp::updateSolBC() 99 0.05702 0.05731 0.05771 0.11% MLCGSolver::bicgstab 83 0 0.01431 0.05723 0.11% Castro::volProductSum() 22 0.04849 0.05033 0.0547 0.10% MultiFab::norm0(mask) 57 0.04589 0.04613 0.04644 0.09% MLCellLinOp::updateCorBC() 78 0.04503 0.04538 0.04566 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04505 0.04524 0.04538 0.08% FabArrayBase::CPC::define() 2260 0.02766 0.03218 0.04359 0.08% Gravity::actual_solve_with_mlmg() 81 0.03807 0.04009 0.04288 0.08% FabArrayBase::getCPC() 8152 0.04066 0.04163 0.04258 0.08% Castro::initialize_do_advance() 30 0.03402 0.03929 0.04217 0.08% Gravity::test_level_grad_phi_prev() 30 0.04051 0.04104 0.04155 0.08% MLCellLinOp::setLevelBC() 102 0.04011 0.04066 0.04122 0.08% MLMG::buildFineMask() 80 0.04039 0.04044 0.04054 0.08% MultiFab::Copy() 100 0.03924 0.0394 0.03955 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03655 0.03712 0.03821 0.07% AmrMesh::MakeNewGrids() 11 0.03456 0.03482 0.03537 0.07% Gravity::solve_for_phi() 60 0.02663 0.02981 0.0349 0.07% FabArray::FillBoundary() 13093 0.03112 0.03242 0.0347 0.06% MultiFab::max() 40 0.01284 0.02627 0.03171 0.06% Castro::post_init() 2 0.0003502 0.01717 0.0309 0.06% MLCellLinOp::smooth() 5996 0.0262 0.02763 0.02924 0.05% MLCellLinOp::prepareForSolve() 81 0.02432 0.02543 0.02797 0.05% Castro::initialize_advance() 30 0.02554 0.02628 0.0273 0.05% Castro::init(old) 9 0.02593 0.02605 0.02618 0.05% FabArrayBase::getFB() 13093 0.02268 0.024 0.02571 0.05% MLCellLinOp::defineBC() 81 0.02382 0.02443 0.02513 0.05% Gravity::update_max_rhs() 20 0.02374 0.02402 0.0242 0.05% Amr::defBaseLevel() 1 0.02096 0.0216 0.02339 0.04% MLMG::interpCorrection_1 78 0.02267 0.02278 0.02294 0.04% Castro::apply_tagging_restrictions() 11 0.02091 0.02117 0.02181 0.04% Castro::finalize_do_advance() 30 0.01279 0.01678 0.02139 0.04% FillPatchTwoLevels 394 0.01497 0.0166 0.01886 0.04% Castro::build_fine_mask() 153 0.01815 0.01828 0.01834 0.03% StateData::define() 48 0.01499 0.01542 0.01638 0.03% FabArray::ParallelCopy() 5320 0.01449 0.01488 0.01535 0.03% Castro::swap_state_time_levels() 30 0.01317 0.0136 0.01405 0.03% Gravity::actual_multilevel_solve() 10 0.01201 0.01203 0.01208 0.02% MLMG::MLRhsNormInf() 80 0.01185 0.01194 0.01206 0.02% Amr::regrid() 10 0.009708 0.01027 0.01117 0.02% MultiFab::Dot() 463 0 0.002791 0.01116 0.02% MLLinOp::makeSubCommunicator() 81 0.003079 0.007212 0.01033 0.02% Gravity::GetCrsePhi() 40 0.009438 0.009737 0.009991 0.02% StateDataPhysBCFunct::() 853 0.008085 0.009058 0.009598 0.02% MLCellLinOp::apply() 2422 0.005782 0.006734 0.009177 0.02% MLMG::solve() 80 0.005571 0.007574 0.009087 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008297 0.008475 0.00866 0.02% Castro::FluxRegFineAdd() 30 0.007041 0.007312 0.007767 0.01% Castro::apply_problem_tags() 11 0.007523 0.007584 0.00775 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001838 0.007352 0.01% MLLinOp::defineGrids() 81 0.006899 0.007038 0.00731 0.01% MLCellLinOp::correctionResidual() 1660 0.004616 0.00501 0.005855 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004908 0.004979 0.005133 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005099 0.005111 0.005127 0.01% AMRErrorTag::operator() 11 0.004767 0.004807 0.004908 0.01% Castro::do_new_sources() 50 0.0008349 0.002172 0.004902 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004866 0.004873 0.004893 0.01% CGSolver::sxay() 588 0 0.001208 0.00483 0.01% MLMG::mgVcycle() 489 0.004018 0.004222 0.004448 0.01% main() 1 0.002503 0.003642 0.004031 0.01% Castro::enforce_consistent_e() 3 0.00347 0.003735 0.004008 0.01% Gravity::test_composite_phi() 1 0.003581 0.003813 0.003938 0.01% MLMG:computeResOfCorrection() 1421 0.003298 0.003455 0.003602 0.01% MLMG::actualBottomSolve() 333 0.0003952 0.00119 0.003567 0.01% Castro::do_old_sources() 30 0.0004622 0.001303 0.002841 0.01% MLMG::mgVcycle_down::0 333 0.002288 0.002384 0.002579 0.00% FabArrayBase::FB::FB() 131 0.000844 0.001253 0.002415 0.00% MLMG::mgVcycle_down::1 333 0.002103 0.002185 0.002263 0.00% MLMG::mgVcycle_down::2 333 0.001954 0.002038 0.00215 0.00% MLCellLinOp::solutionResidual() 530 0.001929 0.002003 0.002118 0.00% FillPatchInterp(Fab) 130 0.001691 0.00183 0.001933 0.00% Gravity::solve_phi_with_mlmg() 71 0.001603 0.001734 0.001882 0.00% TagBoxArray::collate() 11 0.0009354 0.001379 0.001807 0.00% Amr::InitAmr() 1 0.001793 0.001799 0.001806 0.00% DistributionMapping::LeastUsedCPUs() 5 0.000637 0.001343 0.001784 0.00% Castro::clean_state() 254 0.001494 0.001591 0.001746 0.00% MLMG::mgVcycle_up::0 333 0.001553 0.00163 0.001709 0.00% Castro::subcycle_advance_ctu() 30 0.0001924 0.0005765 0.001658 0.00% OwnerMask() 11 0.001479 0.001531 0.001584 0.00% MLMG::mgVcycle_up::2 333 0.001367 0.001429 0.001497 0.00% MLMG::mgVcycle_up::1 333 0.001363 0.001422 0.00148 0.00% MLMG::mgVcycle_bottom 489 0.001279 0.001322 0.001381 0.00% MLMG::mgVcycle_down::3 211 0.0012 0.001256 0.001331 0.00% MLMG::mgVcycle_down::4 211 0.001133 0.00121 0.0013 0.00% MLMG::MLResNormInf() 97 0.0005968 0.0009195 0.001161 0.00% makeSFC 243 0.001058 0.001107 0.00115 0.00% MLMG::mgVcycle_up::4 211 0.0007836 0.0008359 0.0009166 0.00% MLMG::mgVcycle_up::3 211 0.0007535 0.0008151 0.0008935 0.00% MLMG::computeResidual() 333 0.0008348 0.000859 0.0008896 0.00% TagBoxArray::mapPRD 11 0.0008432 0.0008675 0.0008863 0.00% Amr::bldFineLevels() 1 0.000816 0.0008446 0.0008747 0.00% Amr::coarseTimeStep() 10 0.000691 0.00076 0.0008584 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007731 0.000791 0.0008288 0.00% Amr::grid_places() 11 0.000567 0.0006039 0.0006865 0.00% MLPoisson::define() 81 0.0006046 0.0006395 0.0006702 0.00% Castro::construct_new_source() 250 0.0005663 0.0005988 0.0006285 0.00% Amr::timeStep() 30 0.0004414 0.0005109 0.0005902 0.00% FabArrayBase::TheFPinfo() 130 0.0004949 0.0005271 0.0005612 0.00% DistributionMapping::Distribute() 245 0.0004823 0.0004913 0.0005047 0.00% Castro::enforce_speed_limit() 254 0.0003802 0.0003983 0.0004121 0.00% Castro::apply_source_to_state() 100 0.0003257 0.0003622 0.0003974 0.00% AmrLevel::AmrLevel(dm) 12 0.0002651 0.0003184 0.0003967 0.00% MLPoisson::prepareForSolve() 81 0.0003405 0.0003558 0.0003716 0.00% Castro::computeNewDt() 18 0.0001114 0.0001918 0.00037 0.00% MLMG::computeMLResidual() 97 0.0003015 0.0003141 0.0003326 0.00% Castro::construct_old_source() 150 0.0002786 0.0002976 0.000317 0.00% MLLinOp::define() 81 0.0002775 0.0002912 0.0003023 0.00% MLMG::miniCycle() 156 0.0002736 0.0002754 0.0002792 0.00% MLMG::getGradSolution() 80 0.0002575 0.000266 0.0002736 0.00% Castro::advance() 30 0.0002096 0.0002329 0.0002709 0.00% Castro::post_regrid() 22 0.0002324 0.0002499 0.00027 0.00% ClusterList::intersect() 2 0 5.686e-05 0.0002274 0.00% FabArray::RecvLayoutMask() 21 0.0001938 0.0002022 0.0002242 0.00% Gravity::swapTimeLevels() 30 0.0001805 0.00019 0.0001972 0.00% Castro::check_for_nan() 60 0.0001777 0.0001829 0.0001893 0.00% Castro::errorEst() 11 0.0001245 0.00013 0.0001404 0.00% Castro::avgDown(state_indx) 44 0.0001106 0.0001148 0.0001206 0.00% FPinfo::FPinfo() 3 9.981e-05 0.0001077 0.0001164 0.00% Amr::FinalizeInit() 1 2.013e-05 4.506e-05 0.000101 0.00% Amr::writeSmallPlotFile() 1 7.274e-05 8.682e-05 9.875e-05 0.00% AmrMesh-cluster 2 0 2.414e-05 9.656e-05 0.00% amrex::average_down_w_geom 44 8.603e-05 8.991e-05 9.603e-05 0.00% Gravity::solve_for_delta_phi 10 8.016e-05 8.581e-05 9.13e-05 0.00% Castro::create_source_corrector() 30 7.967e-05 8.494e-05 9.106e-05 0.00% Castro::retry_advance_ctu() 30 5.869e-05 6.705e-05 8.068e-05 0.00% knapsack() 3 5.902e-05 6.238e-05 6.507e-05 0.00% Castro::avgDown() 11 5.544e-05 5.859e-05 6.381e-05 0.00% BoxList::complementIn 22 3.821e-05 4.373e-05 5.67e-05 0.00% Castro::gwstrain() 22 3.809e-05 4.171e-05 4.898e-05 0.00% BoxList::parallelComplementIn() 22 3.999e-05 4.124e-05 4.355e-05 0.00% Amr::initSubcycle() 1 3.442e-05 3.639e-05 4.113e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.838e-05 3.227e-05 3.898e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.424e-05 3.521e-05 3.696e-05 0.00% Gravity::set_mass_offset() 11 2.712e-05 2.94e-05 3.104e-05 0.00% ClusterList::chop() 2 0 5.212e-06 2.085e-05 0.00% Castro::computeInitialDt() 2 1.136e-05 1.291e-05 1.455e-05 0.00% MLMG::compResidual() 1 1.196e-05 1.259e-05 1.306e-05 0.00% Amr::InitializeInit() 1 5.888e-06 8.34e-06 1.082e-05 0.00% Amr::init() 1 5.706e-06 6.449e-06 6.827e-06 0.00% knapsack()swap 2 4.697e-06 5.124e-06 5.473e-06 0.00% Amr::initialInit() 1 3.814e-06 3.905e-06 3.981e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 53.65 53.65 53.65 100.00% Amr::coarseTimeStep() 10 50.92 50.92 50.92 94.91% Amr::timeStep() 30 50.85 50.85 50.85 94.77% Castro::advance() 30 35.85 35.85 35.85 66.81% Castro::subcycle_advance_ctu() 30 34.09 34.1 34.1 63.56% Castro::do_advance_ctu() 30 34.08 34.09 34.1 63.56% Castro::construct_ctu_hydro_source() 30 16.4 16.5 16.56 30.86% Gravity::actual_solve_with_mlmg() 81 13.14 13.14 13.14 24.50% MLMG::solve() 80 12.42 12.43 12.43 23.17% Castro::post_timestep() 30 11.95 11.95 11.96 22.28% Castro::clean_state() 254 10.36 10.43 10.56 19.69% MLMG::oneIter() 333 10.43 10.43 10.44 19.45% Gravity::solve_phi_with_mlmg() 71 9.921 9.961 9.984 18.61% Castro::reflux() 10 9.49 9.501 9.517 17.74% MLMG::mgVcycle() 489 9.15 9.154 9.158 17.07% Gravity::solve_for_phi() 60 8.274 8.31 8.33 15.52% MLCellLinOp::smooth() 5996 6.246 6.35 6.652 12.40% Castro::computeTemp() 257 6.141 6.184 6.255 11.66% Castro::reset_internal_energy() 257 5.675 5.714 5.783 10.78% Castro::construct_new_gravity() 30 5.089 5.092 5.1 9.51% Gravity::gravity_sync() 10 4.971 4.972 4.972 9.27% Castro::construct_old_gravity() 30 4.637 4.671 4.692 8.74% Castro::evaluate_source_change() 591 4.446 4.465 4.49 8.37% MLPoisson::Fsmooth() 11992 4.149 4.235 4.429 8.26% Gravity::solve_for_delta_phi 10 4.159 4.16 4.16 7.75% MLMG::mgVcycle_down::0 333 3.881 3.891 3.904 7.28% Castro::enforce_min_density() 254 3.769 3.811 3.88 7.23% FillPatchIterator::Initialize 723 3.282 3.289 3.304 6.16% Castro::do_new_sources() 50 3.202 3.229 3.267 6.09% Amr::regrid() 10 3.096 3.106 3.127 5.83% Castro::post_regrid() 22 2.907 2.921 2.946 5.49% MLMG::mgVcycle_up::0 333 2.683 2.868 2.935 5.47% MLCellLinOp::applyBC() 14630 2.686 2.751 2.881 5.37% FabArray::ParallelCopy() 5320 2.008 2.493 2.773 5.17% MultiFab::AddProduct() 4648 2.6 2.61 2.624 4.89% MLCellLinOp::apply() 2422 2.453 2.484 2.563 4.78% Castro::initialize_do_advance() 30 2.473 2.492 2.514 4.68% FabArray::setVal() 9464 2.303 2.319 2.361 4.40% FillPatchSingleLevel 853 2.221 2.24 2.253 4.20% Amr::init() 1 2.181 2.181 2.181 4.06% MLPoisson::Fapply() 2422 1.853 1.876 1.928 3.59% MLCellLinOp::solutionResidual() 530 1.724 1.734 1.745 3.25% MLCellLinOp::correctionResidual() 1660 1.596 1.622 1.696 3.16% MultiFab::Subtract() 601 1.663 1.669 1.681 3.13% Gravity::multilevel_solve_for_new_phi() 10 1.654 1.654 1.654 3.08% Gravity::actual_multilevel_solve() 10 1.645 1.646 1.646 3.07% Castro::derive() 397 1.635 1.638 1.643 3.06% Amr::initialInit() 1 1.575 1.575 1.576 2.94% MLMG:computeResOfCorrection() 1421 1.462 1.484 1.548 2.88% Castro::do_old_sources() 30 1.478 1.488 1.502 2.80% FabArray::ParallelCopy_nowait() 5320 1.425 1.455 1.485 2.77% Castro::initialize_advance() 30 1.346 1.356 1.372 2.56% Castro::volWgtSum() 242 1.331 1.344 1.371 2.56% FabArray::ParallelCopy_finish() 5320 0.5073 1.023 1.312 2.45% Amr::FinalizeInit() 1 1.239 1.263 1.276 2.38% FabArray::FillBoundary() 13093 1.175 1.238 1.274 2.38% FillPatchTwoLevels 394 1.151 1.172 1.19 2.22% Castro::expand_state() 30 1.161 1.167 1.173 2.19% Gravity::fill_multipole_BCs() 41 1.109 1.144 1.164 2.17% Amr::writePlotFile() 2 1.15 1.15 1.15 2.14% FluxRegister::Reflux() 180 1.115 1.115 1.116 2.08% MLMG::addInterpCorrection() 1421 0.3181 0.8307 1.008 1.88% Gravity::get_new_grav_vector() 52 0.9863 0.9903 0.9952 1.85% Castro::post_init() 2 0.9379 0.9519 0.9575 1.78% MLMG::computeResWithCrseSolFineCor() 78 0.9205 0.9211 0.922 1.72% MLMG::computeResidual() 333 0.9021 0.906 0.9135 1.70% MultiFab::sum() 4648 0.8505 0.8541 0.86 1.60% MLMG::mgVcycle_down::1 333 0.6814 0.7064 0.7657 1.43% MultiFab::Xpay() 2190 0.7124 0.719 0.7362 1.37% FillBoundary_nowait() 13093 0.6726 0.6816 0.6953 1.30% MLCellLinOp::reflux() 116 0.6514 0.6516 0.6518 1.21% MLMG::mgVcycle_up::2 333 0.2112 0.539 0.6518 1.21% MLMG::computeMLResidual() 97 0.5777 0.5954 0.6094 1.14% Castro::construct_new_source() 250 0.6022 0.6061 0.609 1.14% Castro::construct_new_gravity_source() 50 0.6016 0.6055 0.6085 1.13% FillBoundary_finish() 13093 0.4455 0.5238 0.5624 1.05% FillPatchInterp(Fab) 130 0.3702 0.4573 0.545 1.02% CellConservativeLinear::interp() 130 0.3683 0.4555 0.5432 1.01% Castro::normalize_species() 254 0.5063 0.5153 0.5339 1.00% MLMG::mgVcycle_up::1 333 0.4666 0.4837 0.5332 0.99% Gravity::get_old_grav_vector() 30 0.5218 0.5264 0.5305 0.99% Castro::finalize_advance() 30 0.3901 0.3955 0.3987 0.74% MLPoisson::define() 81 0.3775 0.3863 0.3959 0.74% MLPoisson::FFlux() 1044 0.3888 0.3898 0.3906 0.73% StateDataPhysBCFunct::() 853 0.3327 0.3382 0.344 0.64% Amr::InitializeInit() 1 0.2997 0.3128 0.337 0.63% Amr::defBaseLevel() 1 0.2997 0.3128 0.337 0.63% StateData::FillBoundary(geom) 63 0.3246 0.3291 0.3348 0.62% Castro::estTimeStep() 69 0.2253 0.289 0.3313 0.62% amrex::average_down 1713 0.2932 0.303 0.3271 0.61% MLMG::prepareForSolve() 80 0.3075 0.3132 0.3237 0.60% MLMG::mgVcycle_bottom 489 0.1608 0.2004 0.3179 0.59% Castro::initData() 3 0.2682 0.28 0.3012 0.56% MLMG::mgVcycle_down::2 333 0.2481 0.2561 0.276 0.51% Castro::apply_source_to_state() 100 0.274 0.2743 0.2747 0.51% MultiFab::Saxpy() 100 0.2737 0.2739 0.2743 0.51% MLCellLinOp::defineAuxData() 81 0.2158 0.2253 0.2398 0.45% MLMG::getGradSolution() 80 0.2157 0.2163 0.2168 0.40% MLCellLinOp::compGrad() 100 0.2154 0.216 0.2165 0.40% MultiFab::min() 30 0.007189 0.07827 0.1962 0.37% MLMG::mgVcycle_down::3 211 0.03319 0.07417 0.194 0.36% Amr::bldFineLevels() 1 0.1622 0.1666 0.1767 0.33% VisMF::Write(FabArray) 4 0.1637 0.167 0.1755 0.33% MLMG::miniCycle() 156 0.1604 0.1608 0.1614 0.30% MLMG::actualBottomSolve() 333 0.0003952 0.0396 0.1572 0.29% Castro::init(old) 9 0.1491 0.1506 0.1528 0.28% MLCGSolver::bicgstab 83 0 0.03772 0.1509 0.28% Castro::computeNewDt() 18 0.1313 0.1421 0.1495 0.28% MLMG::ResNormInf() 450 0.131 0.1415 0.1474 0.27% MultiFab::Multiply() 164 0.1459 0.1462 0.1464 0.27% MLCellLinOp::defineBC() 81 0.1417 0.1435 0.1459 0.27% FabArray::mult() 294 0.1372 0.1386 0.1397 0.26% MLMG::mgVcycle_up::3 211 0.02491 0.05395 0.1384 0.26% Castro::construct_old_source() 150 0.1337 0.1342 0.1348 0.25% Castro::construct_old_gravity_source() 30 0.1334 0.1339 0.1345 0.25% FabArray::setDomainBndry() 853 0.1245 0.1274 0.1293 0.24% Castro::volProductSum() 22 0.1201 0.1221 0.1268 0.24% BndryData::define() 123 0.1165 0.1179 0.1199 0.22% Gravity::GetCrsePhi() 40 0.09823 0.1034 0.1107 0.21% Amr::grid_places() 11 0.11 0.1102 0.1103 0.21% AmrMesh::MakeNewGrids() 11 0.1094 0.1096 0.1097 0.20% MLMG::computeResWithCrseCorFineCor() 78 0.1038 0.1044 0.1047 0.20% MLCellLinOp::updateSolBC() 99 0.08268 0.08944 0.09584 0.18% Castro::check_for_nan() 60 0.09133 0.09145 0.09166 0.17% MultiFab::contains_nan() 60 0.09114 0.09127 0.09149 0.17% MultiFab::LinComb() 628 0.07193 0.07636 0.08777 0.16% FabArrayBase::getCPC() 8152 0.06864 0.07381 0.0859 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08191 0.0821 0.08224 0.15% Gravity::test_level_grad_phi_curr() 20 0.08035 0.08112 0.08186 0.15% MLMG::mgVcycle_down::4 211 0.0318 0.04308 0.07358 0.14% Gravity::update_max_rhs() 20 0.04673 0.06002 0.06561 0.12% MLCellLinOp::updateCorBC() 78 0.06313 0.06362 0.06432 0.12% MLCellLinOp::setLevelBC() 102 0.05177 0.05819 0.0626 0.12% Castro::errorEst() 11 0.05865 0.05936 0.06086 0.11% Gravity::test_composite_phi() 1 0.06072 0.06074 0.06076 0.11% MLMG::mgVcycle_up::4 211 0.02507 0.03368 0.05702 0.11% Castro::computeInitialDt() 2 0.01732 0.0415 0.05449 0.10% MLMG::buildFineMask() 80 0.04971 0.04984 0.04989 0.09% Gravity::test_level_grad_phi_prev() 30 0.04578 0.04642 0.04711 0.09% MultiFab::norm0(mask) 57 0.04589 0.04613 0.04644 0.09% FabArrayBase::CPC::define() 2260 0.02766 0.03218 0.04359 0.08% MLMG::MLResNormInf() 97 0.04304 0.04313 0.04329 0.08% MultiFab::Copy() 100 0.03924 0.0394 0.03955 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03655 0.03712 0.03821 0.07% MLMG::interpCorrection_1 78 0.03031 0.0336 0.03622 0.07% MultiFab::max() 40 0.01284 0.02627 0.03171 0.06% MLPoisson::prepareForSolve() 81 0.02467 0.02579 0.02833 0.05% FabArrayBase::getFB() 13093 0.02352 0.02525 0.02812 0.05% MLMG::MLRhsNormInf() 80 0.02787 0.028 0.02811 0.05% MLCellLinOp::prepareForSolve() 81 0.02432 0.02543 0.02797 0.05% Gravity::swapTimeLevels() 30 0.02177 0.02235 0.02284 0.04% Castro::apply_tagging_restrictions() 11 0.02091 0.02117 0.02181 0.04% Castro::finalize_do_advance() 30 0.01279 0.01678 0.02139 0.04% MLLinOp::define() 81 0.01258 0.01692 0.01986 0.04% CGSolver::sxay() 588 0 0.004911 0.01964 0.04% MLLinOp::defineGrids() 81 0.01231 0.01663 0.01957 0.04% Castro::build_fine_mask() 153 0.01815 0.01828 0.01834 0.03% AmrLevel::AmrLevel(dm) 12 0.01525 0.01574 0.01665 0.03% StateData::define() 48 0.01499 0.01542 0.01638 0.03% MLMG::compResidual() 1 0.01385 0.01468 0.01513 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01431 0.01456 0.01501 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003615 0.01446 0.03% Castro::avgDown() 11 0.01354 0.01386 0.01414 0.03% Castro::avgDown(state_indx) 44 0.01349 0.0138 0.01408 0.03% Castro::swap_state_time_levels() 30 0.01317 0.0136 0.01405 0.03% amrex::average_down_w_geom 44 0.01337 0.01368 0.01396 0.03% MultiFab::Dot() 463 0 0.002791 0.01116 0.02% MLLinOp::makeSubCommunicator() 81 0.003079 0.007212 0.01033 0.02% TagBoxArray::mapPRD 11 0.005509 0.007696 0.008518 0.02% Castro::FluxRegFineAdd() 30 0.007041 0.007312 0.007767 0.01% Castro::apply_problem_tags() 11 0.007523 0.007584 0.00775 0.01% AMRErrorTag::operator() 11 0.004767 0.004807 0.004908 0.01% Castro::enforce_consistent_e() 3 0.00347 0.003735 0.004008 0.01% FabArrayBase::TheFPinfo() 130 0.001338 0.002036 0.002514 0.00% MLLinOp::makeAgglomeratedDMap 81 0.002317 0.002381 0.002474 0.00% FabArrayBase::FB::FB() 131 0.000844 0.001253 0.002415 0.00% FPinfo::FPinfo() 3 0.0008277 0.001509 0.001953 0.00% Amr::InitAmr() 1 0.001828 0.001835 0.001847 0.00% DistributionMapping::KnapSackDoIt() 3 0.0007167 0.001401 0.001837 0.00% TagBoxArray::collate() 11 0.0009354 0.001379 0.001807 0.00% DistributionMapping::LeastUsedCPUs() 5 0.000637 0.001343 0.001784 0.00% makeSFC 243 0.001542 0.00159 0.001645 0.00% OwnerMask() 11 0.001479 0.001531 0.001584 0.00% DistributionMapping::Distribute() 245 0.0004823 0.0004913 0.0005047 0.00% Castro::enforce_speed_limit() 254 0.0003802 0.0003983 0.0004121 0.00% AmrMesh-cluster 2 0 8.621e-05 0.0003449 0.00% ClusterList::intersect() 2 0 5.686e-05 0.0002274 0.00% FabArray::RecvLayoutMask() 21 0.0001938 0.0002022 0.0002242 0.00% Amr::writeSmallPlotFile() 1 7.274e-05 8.682e-05 9.875e-05 0.00% BoxList::parallelComplementIn() 22 7.82e-05 8.497e-05 9.756e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 7.37e-05 8.566e-05 9.231e-05 0.00% Castro::create_source_corrector() 30 7.967e-05 8.494e-05 9.106e-05 0.00% Castro::retry_advance_ctu() 30 5.869e-05 6.705e-05 8.068e-05 0.00% knapsack() 3 6.372e-05 6.75e-05 7.055e-05 0.00% BoxList::complementIn 22 3.821e-05 4.373e-05 5.67e-05 0.00% Castro::gwstrain() 22 3.809e-05 4.171e-05 4.898e-05 0.00% Amr::initSubcycle() 1 3.442e-05 3.639e-05 4.113e-05 0.00% Gravity::set_mass_offset() 11 2.712e-05 2.94e-05 3.104e-05 0.00% ClusterList::chop() 2 0 5.212e-06 2.085e-05 0.00% knapsack()swap 2 4.697e-06 5.124e-06 5.473e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.03-17-g7b4d10daf9c4) finalized