MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.03-33-g9907ac197518) initialized Starting run at 05:39:56 UTC on 2022-03-29. Successfully read inputs file ... Castro git describe: 22.02-19-ga92ac477d AMReX git describe: 22.03-33-g9907ac197 Microphysics git describe: 22.03-13-gf58972c7 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.014084201 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.015951374 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.051130552 Gravity::fill_multipole_BCs() time = 0.028591017 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.594978255 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.036028838 Gravity::solve_for_phi() time = 0.409163986 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -7.975057092e+22 ymom added: -5.289050461e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.144389873 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.441549145 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028068579 Gravity::solve_for_phi() time = 0.344242364 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.159620157 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08334369481 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008699187 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.00949339 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108773296 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045812056 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010254007 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01600060696 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008678124 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009249936 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10888673 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045709432 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010353647 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01454453017 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027708794 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010189619 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.156506598 Castro::reflux() at level 0 : time = 1.02802841 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.988427004 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009884686 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029845789 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03361076 Gravity::solve_for_phi() time = 0.396356155 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852871e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.139651355 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.430575403 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027213084 Gravity::solve_for_phi() time = 0.343898307 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125187e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.154930493 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08508945759 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00865884 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009349827 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107138265 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046959986 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010245815 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01610521879 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008563517 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009264082 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107799773 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045086812 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010203113 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01489250978 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029677626 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010162795 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809893e+28 ymom added: 8.089770254e+28 zmom added: 8.082913463e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.151067501 Castro::reflux() at level 0 : time = 1.015704651 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.29381519 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009609029 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028418367 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033278551 Gravity::solve_for_phi() time = 0.398532569 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939019e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.139173295 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.455159205 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029715857 Gravity::solve_for_phi() time = 0.33614973 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.158564011 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08442392551 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008475753 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009335645 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107571086 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043043831 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010019392 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01629024443 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00968986 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009349359 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10762194 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043071201 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010125563 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01475102883 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028632187 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010036181 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655087e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342341e+27 ymom added: 5.311566494e+28 zmom added: 5.312402179e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.154288913 Castro::reflux() at level 0 : time = 0.995909565 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.244984745 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009856742 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028479895 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033816753 Gravity::solve_for_phi() time = 0.377788167 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700667e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.139158833 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.440496017 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029031227 Gravity::solve_for_phi() time = 0.334274281 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.157023844 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08552678529 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008096607 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009132709 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109123391 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044401021 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010608418 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01615403746 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008297758 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009465012 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106850721 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043104947 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010176448 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01496808059 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029763071 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010208891 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.155427659 Castro::reflux() at level 0 : time = 0.946381982 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.159159771 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009846406 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028794236 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03442249 Gravity::solve_for_phi() time = 0.377779201 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.40015048e+30 ymom added: 3.399803827e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.138762994 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.449170652 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03026246 Gravity::solve_for_phi() time = 0.328845452 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591233e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.153488335 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08566594161 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008300657 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009424855 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107507871 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043216133 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010257178 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01624682339 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008335589 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009180436 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106633313 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042854657 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010078795 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01503581006 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028803248 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010072137 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363474e+28 ymom added: 7.265277777e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.148693424 Castro::reflux() at level 0 : time = 0.929982072 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.13355887 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009820945 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028390449 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.04544884 Gravity::solve_for_phi() time = 0.389079102 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919316e+30 ymom added: 4.094511387e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.137377209 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.436038628 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027257576 Gravity::solve_for_phi() time = 0.324413283 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245018e+27 ymom added: -5.297264722e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.154251464 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08599793145 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008239605 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.00910816 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107105954 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042591772 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.010035963 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01648396961 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008103157 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009234676 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10659083 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042932612 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010086884 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01513151153 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028725499 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010017758 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.151026704 Castro::reflux() at level 0 : time = 0.93925897 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.080880892 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009529295 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028960713 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.035136713 Gravity::solve_for_phi() time = 0.37876727 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151112e+30 ymom added: 4.515688034e+30 zmom added: 4.515608962e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.13526101 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.441139867 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029139243 Gravity::solve_for_phi() time = 0.326390881 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.88175262e+28 zmom added: -2.881735255e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.149675382 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08615449813 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00812829 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009149834 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10768481 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042644408 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010240649 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01641085236 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008297864 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009224105 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106861737 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042926021 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010217086 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01511226087 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028741258 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.010087552 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.153561373 Castro::reflux() at level 0 : time = 0.934699889 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.147947367 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009808414 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028930277 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034834853 Gravity::solve_for_phi() time = 0.377417535 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064106e+30 ymom added: 4.889542979e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.13447461 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.437490041 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033278382 Gravity::solve_for_phi() time = 0.376265491 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642725e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.152425647 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08492045239 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008153422 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009085972 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106244918 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042898112 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010384408 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01647095968 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008282177 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009089069 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107598717 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042943373 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010188 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01506894532 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028695976 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.009959615 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907363e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.154102896 Castro::reflux() at level 0 : time = 0.931736119 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.196629727 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009734663 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028518292 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029727524 Gravity::solve_for_phi() time = 0.372393435 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036367e+30 ymom added: 5.53045164e+30 zmom added: 5.530356588e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.134160064 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.443591901 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027281183 Gravity::solve_for_phi() time = 0.369187466 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.06117034e+28 zmom added: -5.061201611e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.151685087 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08502507363 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008331833 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009126529 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106543719 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042824357 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010234367 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01648703122 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008062987 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009124567 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107114915 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043082679 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.010045038 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01511731933 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028443643 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.010194534 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.153596643 Castro::reflux() at level 0 : time = 0.934963705 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.194462562 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009798191 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028350384 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034196559 Gravity::solve_for_phi() time = 0.387569377 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167177e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.13862068 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.485854032 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029315673 Gravity::solve_for_phi() time = 0.382600765 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.152565515 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08279748247 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008780711 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009538342 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107712461 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.050169295 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010456563 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01578075988 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008665926 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009499526 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107418202 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.050087684 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.01034809 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01452372435 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029428575 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010349188 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914876e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.153666589 Castro::reflux() at level 0 : time = 1.013314282 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.384333843 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.55495332 seconds Ending run at 05:40:51 UTC on 2022-03-29. Run time = 54.77022699 Run time without initialization = 52.28164038 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.77 ... 54.77 ... 54.77 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.3446 16.4966 16.6073 30.32% MLPoisson::Fsmooth() 11992 4.153 4.238 4.421 8.07% Castro::reset_internal_energy() 257 2.932 3.048 3.218 5.88% MultiFab::AddProduct() 4648 2.669 2.786 3.063 5.59% FabArray::setVal() 9464 2.336 2.382 2.411 4.40% MLPoisson::Fapply() 2422 1.857 1.889 1.918 3.50% MLCellLinOp::applyBC() 14630 1.475 1.55 1.721 3.14% MultiFab::Subtract() 601 1.595 1.617 1.634 2.98% FabArray::ParallelCopy_nowait() 5320 1.362 1.389 1.411 2.58% FabArray::ParallelCopy_finish() 5320 0.551 1.061 1.292 2.36% Castro::enforce_min_density() 254 1.045 1.118 1.285 2.35% Gravity::fill_multipole_BCs() 41 1.088 1.147 1.22 2.23% Castro::derive() 397 0.9329 0.9352 0.9367 1.71% MultiFab::sum() 4648 0.8485 0.8617 0.8717 1.59% Castro::normalize_species() 254 0.7857 0.8135 0.8355 1.53% FluxRegister::Reflux() 180 0.8142 0.8161 0.8198 1.50% MultiFab::Xpay() 2190 0.6974 0.7058 0.7172 1.31% FillBoundary_nowait() 13093 0.6438 0.6705 0.6946 1.27% Castro::reflux() 10 0.681 0.6834 0.6869 1.25% FillBoundary_finish() 13093 0.4928 0.5841 0.6838 1.25% Castro::estTimeStep() 69 0.2324 0.4683 0.6777 1.24% Castro::construct_new_gravity_source() 50 0.6025 0.6054 0.6093 1.11% Castro::volWgtSum() 242 0.5252 0.5437 0.5772 1.05% CellConservativeLinear::interp() 130 0.3688 0.4556 0.5427 0.99% Castro::computeTemp() 257 0.4626 0.4711 0.4788 0.87% MLPoisson::FFlux() 1042 0.3853 0.3859 0.3873 0.71% Castro::finalize_advance() 30 0.3511 0.3581 0.3647 0.67% Gravity::get_new_grav_vector() 52 0.3325 0.3348 0.3371 0.62% FillPatchSingleLevel 853 0.319 0.321 0.3244 0.59% StateData::FillBoundary(geom) 63 0.3195 0.3212 0.3222 0.59% amrex::average_down 1713 0.2765 0.2817 0.2927 0.53% MultiFab::min() 30 0.006864 0.133 0.2899 0.53% MLMG::addInterpCorrection() 1421 0.2582 0.2654 0.2767 0.51% MultiFab::Saxpy() 100 0.2708 0.2712 0.2717 0.50% FillPatchIterator::Initialize 723 0.2642 0.2668 0.2703 0.49% Castro::post_timestep() 30 0.08977 0.1539 0.2238 0.41% Castro::do_advance_ctu() 30 0.2194 0.2205 0.222 0.41% MLMG::oneIter() 333 0.2061 0.2075 0.209 0.38% Castro::expand_state() 30 0.1934 0.1943 0.1947 0.36% MLCellLinOp::defineAuxData() 81 0.1725 0.1784 0.1872 0.34% MLCellLinOp::reflux() 116 0.174 0.1764 0.1779 0.32% VisMF::Write(FabArray) 4 0.1595 0.1654 0.1741 0.32% Gravity::get_old_grav_vector() 30 0.1662 0.1679 0.1695 0.31% MLCellLinOp::compGrad() 100 0.1665 0.1676 0.1681 0.31% FabArray::setDomainBndry() 853 0.1258 0.1349 0.1592 0.29% MultiFab::Multiply() 164 0.1424 0.1431 0.1435 0.26% MultiFab::max() 40 0.01237 0.04638 0.1434 0.26% FabArray::mult() 294 0.1376 0.1386 0.1399 0.26% Castro::construct_old_gravity_source() 30 0.1356 0.1374 0.1385 0.25% Amr::writePlotFile() 2 0.1193 0.1268 0.1332 0.24% MLMG::ResNormInf() 450 0.09543 0.101 0.1064 0.19% MultiFab::contains_nan() 60 0.09751 0.09823 0.09872 0.18% BndryData::define() 123 0.08907 0.09003 0.09157 0.17% Castro::construct_old_gravity() 30 0.08764 0.08828 0.0887 0.16% MLMG::prepareForSolve() 80 0.07974 0.08165 0.08309 0.15% MultiFab::LinComb() 628 0.06423 0.06923 0.08149 0.15% Castro::evaluate_source_change() 591 0.0763 0.07738 0.07835 0.14% Gravity::test_level_grad_phi_curr() 20 0.07091 0.07179 0.07233 0.13% Gravity::gravity_sync() 10 0.06988 0.0704 0.0709 0.13% Castro::initData() 3 0.05779 0.06169 0.06988 0.13% MLCellLinOp::updateSolBC() 99 0.05701 0.0579 0.05894 0.11% MLCGSolver::bicgstab 83 0 0.01455 0.05818 0.11% Castro::construct_new_gravity() 30 0.05169 0.0531 0.0556 0.10% Castro::volProductSum() 22 0.04707 0.05104 0.05325 0.10% MultiFab::norm0(mask) 57 0.04673 0.04753 0.04801 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04611 0.04669 0.04744 0.09% MLCellLinOp::updateCorBC() 78 0.04519 0.04583 0.04665 0.09% FabArrayBase::CPC::define() 2260 0.02747 0.03214 0.04375 0.08% Castro::initialize_do_advance() 30 0.03319 0.03668 0.04331 0.08% FabArrayBase::getCPC() 8152 0.04121 0.04197 0.04275 0.08% Gravity::test_level_grad_phi_prev() 30 0.04048 0.041 0.04157 0.08% MLCellLinOp::setLevelBC() 102 0.04 0.04068 0.04134 0.08% Gravity::actual_solve_with_mlmg() 81 0.03677 0.0394 0.04115 0.08% MultiFab::Copy() 100 0.03987 0.0403 0.0408 0.07% MLMG::buildFineMask() 80 0.03824 0.03895 0.03969 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03625 0.03702 0.03832 0.07% AmrMesh::MakeNewGrids() 11 0.03412 0.035 0.03633 0.07% FabArray::FillBoundary() 13093 0.0309 0.03232 0.03518 0.06% Gravity::solve_for_phi() 60 0.02699 0.02855 0.03248 0.06% Castro::post_init() 2 0.0004993 0.01404 0.03134 0.06% MLCellLinOp::smooth() 5996 0.02601 0.02719 0.02915 0.05% MLCellLinOp::prepareForSolve() 81 0.02471 0.02593 0.02859 0.05% Castro::init(old) 9 0.02672 0.02684 0.02695 0.05% Castro::initialize_advance() 30 0.02535 0.02588 0.02619 0.05% FabArrayBase::getFB() 13093 0.02286 0.02399 0.02589 0.05% MLCellLinOp::defineBC() 81 0.02406 0.02443 0.02497 0.05% Gravity::update_max_rhs() 20 0.02438 0.0245 0.0246 0.04% MLMG::interpCorrection_1 78 0.02292 0.02321 0.02354 0.04% Castro::apply_tagging_restrictions() 11 0.02076 0.02137 0.02285 0.04% Castro::do_new_sources() 50 0.0008985 0.006591 0.02276 0.04% Amr::defBaseLevel() 1 0.021 0.02117 0.02162 0.04% Castro::build_fine_mask() 153 0.01818 0.01838 0.01874 0.03% FillPatchTwoLevels 394 0.01507 0.01624 0.0182 0.03% Castro::finalize_do_advance() 30 0.01348 0.01608 0.01756 0.03% StateData::define() 48 0.01478 0.01526 0.01642 0.03% FabArray::ParallelCopy() 5320 0.01402 0.0145 0.01495 0.03% Castro::swap_state_time_levels() 30 0.01314 0.01317 0.01324 0.02% Gravity::actual_multilevel_solve() 10 0.01213 0.01253 0.01293 0.02% MLMG::MLRhsNormInf() 80 0.0121 0.01211 0.01214 0.02% MultiFab::Dot() 463 0 0.002958 0.01183 0.02% Castro::do_old_sources() 30 0.0005132 0.003308 0.01147 0.02% Amr::regrid() 10 0.009876 0.01046 0.01131 0.02% StateDataPhysBCFunct::() 853 0.007758 0.009332 0.01082 0.02% Gravity::GetCrsePhi() 40 0.009576 0.009848 0.01029 0.02% MLLinOp::makeSubCommunicator() 81 0.00264 0.006305 0.009336 0.02% MLCellLinOp::apply() 2422 0.005685 0.006638 0.009291 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008335 0.008447 0.008598 0.02% Castro::apply_problem_tags() 11 0.008166 0.008278 0.008422 0.02% MLMG::solve() 80 0.00484 0.005858 0.007828 0.01% Castro::FluxRegFineAdd() 30 0.007381 0.007482 0.007573 0.01% MLLinOp::defineGrids() 81 0.006735 0.007219 0.007512 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001826 0.007304 0.01% Castro::enforce_consistent_e() 3 0.003369 0.00538 0.006403 0.01% MLCellLinOp::correctionResidual() 1660 0.004647 0.005022 0.005992 0.01% AMRErrorTag::operator() 11 0.004778 0.005158 0.005645 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005148 0.005221 0.005314 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004929 0.004998 0.005073 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004985 0.004997 0.005011 0.01% CGSolver::sxay() 588 0 0.001216 0.004864 0.01% MLMG::mgVcycle() 489 0.003985 0.004131 0.004397 0.01% main() 1 0.002694 0.003884 0.004304 0.01% Gravity::test_composite_phi() 1 0.003807 0.003958 0.004152 0.01% MLMG:computeResOfCorrection() 1421 0.003276 0.003411 0.003561 0.01% MLMG::actualBottomSolve() 333 0.0003922 0.001157 0.003431 0.01% FabArrayBase::FB::FB() 131 0.0008753 0.001285 0.00242 0.00% MLMG::mgVcycle_down::0 333 0.002241 0.002292 0.002336 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0001189 0.001477 0.002281 0.00% MLMG::mgVcycle_down::1 333 0.002037 0.002109 0.002205 0.00% MLMG::mgVcycle_down::2 333 0.001869 0.001947 0.002044 0.00% MLCellLinOp::solutionResidual() 530 0.00194 0.001981 0.002009 0.00% FillPatchInterp(Fab) 130 0.00171 0.001845 0.001985 0.00% Castro::subcycle_advance_ctu() 30 0.0001932 0.0006385 0.00195 0.00% Gravity::solve_phi_with_mlmg() 71 0.001581 0.001663 0.001803 0.00% Amr::InitAmr() 1 0.001729 0.001746 0.00178 0.00% TagBoxArray::collate() 11 0.0006469 0.001309 0.001776 0.00% MLMG::mgVcycle_up::0 333 0.001549 0.001587 0.001643 0.00% Castro::clean_state() 254 0.001555 0.001592 0.001624 0.00% OwnerMask() 11 0.001429 0.001493 0.001546 0.00% MLMG::mgVcycle_up::2 333 0.001353 0.001403 0.001488 0.00% MLMG::mgVcycle_up::1 333 0.001337 0.001381 0.001442 0.00% MLMG::MLResNormInf() 97 0.0004524 0.001137 0.001395 0.00% MLMG::mgVcycle_bottom 489 0.00133 0.001351 0.001375 0.00% MLMG::mgVcycle_down::3 211 0.00114 0.001221 0.00133 0.00% MLMG::mgVcycle_down::4 211 0.001093 0.00117 0.001283 0.00% makeSFC 243 0.001003 0.001146 0.001213 0.00% Amr::coarseTimeStep() 10 0.0005206 0.0006917 0.0009508 0.00% MLMG::mgVcycle_up::4 211 0.0007771 0.0008251 0.0009185 0.00% TagBoxArray::mapPRD 11 0.0008093 0.0008606 0.0009021 0.00% MLMG::mgVcycle_up::3 211 0.0007514 0.0007948 0.0008782 0.00% Amr::bldFineLevels() 1 0.0008139 0.000837 0.0008556 0.00% MLMG::computeResidual() 333 0.0008178 0.0008379 0.0008543 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007348 0.0007841 0.0008224 0.00% Amr::timeStep() 30 0.0004743 0.0005321 0.0006984 0.00% MLPoisson::define() 81 0.0005717 0.0006252 0.0006576 0.00% Castro::construct_new_source() 250 0.0005707 0.0005935 0.0006189 0.00% Amr::grid_places() 11 0.0005305 0.000564 0.0006063 0.00% FabArrayBase::TheFPinfo() 130 0.0005042 0.0005253 0.0005398 0.00% DistributionMapping::Distribute() 245 0.0004952 0.0005013 0.0005091 0.00% Castro::enforce_speed_limit() 254 0.0004185 0.0004268 0.0004363 0.00% MLPoisson::prepareForSolve() 81 0.0003398 0.0003569 0.0003658 0.00% Castro::apply_source_to_state() 100 0.0003442 0.0003507 0.0003604 0.00% Castro::computeNewDt() 18 0.0001211 0.0001871 0.0003586 0.00% MLMG::computeMLResidual() 97 0.0002982 0.0003138 0.000336 0.00% MLLinOp::define() 81 0.0002897 0.0002996 0.0003052 0.00% Castro::construct_old_source() 150 0.0002843 0.0002872 0.0002918 0.00% MLMG::miniCycle() 156 0.0002647 0.0002724 0.0002798 0.00% AmrLevel::AmrLevel(dm) 12 0.0002583 0.0002658 0.0002782 0.00% MLMG::getGradSolution() 80 0.0002543 0.0002647 0.0002745 0.00% Castro::post_regrid() 22 0.0002302 0.0002456 0.0002647 0.00% Castro::advance() 30 0.0002137 0.0002242 0.0002429 0.00% ClusterList::intersect() 2 0 5.779e-05 0.0002311 0.00% FabArray::RecvLayoutMask() 21 0.0001936 0.0001991 0.0002047 0.00% Castro::check_for_nan() 60 0.000186 0.0001932 0.000204 0.00% Gravity::swapTimeLevels() 30 0.0001842 0.000191 0.0001979 0.00% Castro::errorEst() 11 0.000127 0.0001323 0.0001398 0.00% Amr::FinalizeInit() 1 1.894e-05 4.991e-05 0.0001226 0.00% Castro::avgDown(state_indx) 44 0.0001141 0.000117 0.0001202 0.00% FPinfo::FPinfo() 3 0.0001032 0.00011 0.0001183 0.00% amrex::average_down_w_geom 44 8.803e-05 9.07e-05 9.348e-05 0.00% AmrMesh-cluster 2 0 2.226e-05 8.906e-05 0.00% Gravity::solve_for_delta_phi 10 7.447e-05 8.312e-05 8.825e-05 0.00% Castro::create_source_corrector() 30 8.208e-05 8.429e-05 8.69e-05 0.00% Amr::writeSmallPlotFile() 1 7.248e-05 7.308e-05 7.385e-05 0.00% Castro::retry_advance_ctu() 30 5.608e-05 6.038e-05 6.797e-05 0.00% knapsack() 3 5.866e-05 6.263e-05 6.629e-05 0.00% Castro::avgDown() 11 5.694e-05 5.936e-05 6.099e-05 0.00% Amr::initSubcycle() 1 3.642e-05 4.248e-05 5.591e-05 0.00% BoxList::parallelComplementIn() 22 4.13e-05 4.393e-05 4.828e-05 0.00% BoxList::complementIn 22 4.028e-05 4.416e-05 4.592e-05 0.00% Castro::gwstrain() 22 3.72e-05 3.988e-05 4.588e-05 0.00% Gravity::set_mass_offset() 11 2.509e-05 3.212e-05 3.933e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.193e-05 3.452e-05 3.892e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.938e-05 3.138e-05 3.454e-05 0.00% ClusterList::chop() 2 0 4.922e-06 1.969e-05 0.00% Castro::computeInitialDt() 2 1.088e-05 1.328e-05 1.512e-05 0.00% MLMG::compResidual() 1 1.215e-05 1.272e-05 1.348e-05 0.00% Amr::InitializeInit() 1 5.392e-06 7.056e-06 1.047e-05 0.00% Amr::init() 1 5.744e-06 7.033e-06 8.514e-06 0.00% knapsack()swap 2 4.869e-06 5.275e-06 5.935e-06 0.00% Amr::initialInit() 1 3.451e-06 4.587e-06 5.867e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.77 54.77 54.77 100.00% Amr::coarseTimeStep() 10 51.72 51.72 51.72 94.44% Amr::timeStep() 30 51.45 51.5 51.65 94.30% Castro::advance() 30 36.15 36.15 36.15 66.01% Castro::subcycle_advance_ctu() 30 34.33 34.36 34.38 62.78% Castro::do_advance_ctu() 30 34.33 34.36 34.38 62.78% Castro::construct_ctu_hydro_source() 30 16.34 16.5 16.61 30.32% Gravity::actual_solve_with_mlmg() 81 13.23 13.23 13.23 24.16% MLMG::solve() 80 12.51 12.52 12.53 22.87% Castro::post_timestep() 30 12.15 12.19 12.34 22.53% Castro::clean_state() 254 10.67 11.03 11.28 20.59% MLMG::oneIter() 333 10.53 10.53 10.54 19.24% Gravity::solve_phi_with_mlmg() 71 9.986 10.05 10.13 18.49% Castro::reflux() 10 9.593 9.632 9.67 17.66% MLMG::mgVcycle() 489 9.224 9.233 9.245 16.88% Gravity::solve_for_phi() 60 8.231 8.295 8.367 15.28% MLCellLinOp::smooth() 5996 6.288 6.415 6.731 12.29% Castro::computeTemp() 257 6.174 6.383 6.507 11.88% Castro::reset_internal_energy() 257 5.711 5.912 6.037 11.02% Castro::construct_new_gravity() 30 5.007 5.03 5.05 9.22% Gravity::gravity_sync() 10 5.005 5.006 5.007 9.14% Castro::evaluate_source_change() 591 4.53 4.675 4.961 9.06% Castro::construct_old_gravity() 30 4.671 4.714 4.761 8.69% MLPoisson::Fsmooth() 11992 4.153 4.238 4.421 8.07% Gravity::solve_for_delta_phi 10 4.189 4.19 4.19 7.65% Castro::enforce_min_density() 254 3.788 3.934 4.054 7.40% MLMG::mgVcycle_down::0 333 3.912 3.924 3.941 7.19% Castro::do_new_sources() 50 3.275 3.327 3.373 6.16% FillPatchIterator::Initialize 723 3.246 3.279 3.313 6.05% Amr::regrid() 10 3.162 3.247 3.293 6.01% Castro::post_regrid() 22 2.968 3.101 3.165 5.78% MultiFab::AddProduct() 4648 2.669 2.786 3.063 5.59% MLCellLinOp::applyBC() 14630 2.73 2.84 3.005 5.49% MLMG::mgVcycle_up::0 333 2.692 2.889 2.96 5.40% FabArray::ParallelCopy() 5320 2.033 2.515 2.754 5.03% Castro::initialize_do_advance() 30 2.551 2.575 2.599 4.75% MLCellLinOp::apply() 2422 2.488 2.517 2.58 4.71% Amr::init() 1 2.486 2.486 2.486 4.54% FabArray::setVal() 9464 2.336 2.382 2.411 4.40% FillPatchSingleLevel 853 2.195 2.224 2.251 4.11% MLPoisson::Fapply() 2422 1.857 1.889 1.918 3.50% Amr::initialInit() 1 1.891 1.891 1.891 3.45% Gravity::multilevel_solve_for_new_phi() 10 1.761 1.762 1.762 3.22% MLCellLinOp::solutionResidual() 530 1.717 1.74 1.757 3.21% Gravity::actual_multilevel_solve() 10 1.753 1.753 1.753 3.20% MLCellLinOp::correctionResidual() 1660 1.611 1.639 1.709 3.12% Castro::derive() 397 1.642 1.648 1.655 3.02% MultiFab::Subtract() 601 1.595 1.617 1.634 2.98% Amr::FinalizeInit() 1 1.469 1.502 1.591 2.90% Castro::do_old_sources() 30 1.514 1.538 1.558 2.84% MLMG:computeResOfCorrection() 1421 1.463 1.491 1.543 2.82% FabArray::ParallelCopy_nowait() 5320 1.41 1.44 1.467 2.68% Castro::initialize_advance() 30 1.373 1.4 1.424 2.60% Castro::volWgtSum() 242 1.337 1.359 1.394 2.55% FabArray::FillBoundary() 13093 1.238 1.312 1.383 2.52% FabArray::ParallelCopy_finish() 5320 0.551 1.061 1.292 2.36% Gravity::fill_multipole_BCs() 41 1.124 1.184 1.256 2.29% Castro::expand_state() 30 1.152 1.17 1.182 2.16% Castro::post_init() 2 1.042 1.076 1.173 2.14% FillPatchTwoLevels 394 1.147 1.161 1.171 2.14% Amr::writePlotFile() 2 1.15 1.15 1.15 2.10% FluxRegister::Reflux() 180 1.116 1.118 1.119 2.04% MLMG::addInterpCorrection() 1421 0.3079 0.8292 1.01 1.84% Gravity::get_new_grav_vector() 52 0.9866 0.9887 0.9918 1.81% MLMG::computeResWithCrseSolFineCor() 78 0.9394 0.9402 0.9408 1.72% MLMG::computeResidual() 333 0.8968 0.8998 0.9015 1.65% MultiFab::sum() 4648 0.8485 0.8617 0.8717 1.59% Castro::normalize_species() 254 0.7857 0.8135 0.8355 1.53% MLMG::mgVcycle_down::1 333 0.6791 0.7156 0.7941 1.45% FillBoundary_nowait() 13093 0.6676 0.6957 0.7229 1.32% MultiFab::Xpay() 2190 0.6974 0.7058 0.7172 1.31% FillBoundary_finish() 13093 0.4928 0.5841 0.6838 1.25% Castro::estTimeStep() 69 0.2324 0.4683 0.6777 1.24% MLCellLinOp::reflux() 116 0.6547 0.6589 0.6613 1.21% MLMG::mgVcycle_up::2 333 0.2125 0.5418 0.6548 1.20% MLMG::computeMLResidual() 97 0.5912 0.6067 0.6169 1.13% Castro::construct_new_source() 250 0.6031 0.606 0.6099 1.11% Castro::construct_new_gravity_source() 50 0.6025 0.6054 0.6093 1.11% FillPatchInterp(Fab) 130 0.3708 0.4575 0.5444 0.99% CellConservativeLinear::interp() 130 0.3688 0.4556 0.5427 0.99% MLMG::mgVcycle_up::1 333 0.4705 0.4885 0.5382 0.98% Gravity::get_old_grav_vector() 30 0.523 0.5274 0.5318 0.97% Amr::InitializeInit() 1 0.3003 0.389 0.4223 0.77% Amr::defBaseLevel() 1 0.3003 0.389 0.4223 0.77% Castro::finalize_advance() 30 0.3955 0.3978 0.4009 0.73% MLPoisson::define() 81 0.3742 0.3831 0.3946 0.72% Castro::computeNewDt() 18 0.1333 0.3077 0.3925 0.72% Castro::initData() 3 0.2726 0.356 0.3877 0.71% MLPoisson::FFlux() 1042 0.3853 0.3859 0.3873 0.71% amrex::average_down 1713 0.3004 0.3102 0.3339 0.61% StateDataPhysBCFunct::() 853 0.3288 0.3305 0.3317 0.61% MLMG::prepareForSolve() 80 0.3087 0.3156 0.3254 0.59% MLMG::mgVcycle_bottom 489 0.1638 0.2042 0.3244 0.59% StateData::FillBoundary(geom) 63 0.3195 0.3212 0.3222 0.59% MultiFab::min() 30 0.006864 0.133 0.2899 0.53% MLMG::mgVcycle_down::2 333 0.2528 0.2608 0.2832 0.52% Castro::apply_source_to_state() 100 0.2712 0.2716 0.2721 0.50% MultiFab::Saxpy() 100 0.2708 0.2712 0.2717 0.50% MLCellLinOp::defineAuxData() 81 0.2142 0.2228 0.2394 0.44% Amr::bldFineLevels() 1 0.1721 0.2218 0.239 0.44% MLMG::getGradSolution() 80 0.2127 0.2138 0.2143 0.39% MLCellLinOp::compGrad() 100 0.2125 0.2135 0.2141 0.39% MLMG::mgVcycle_down::3 211 0.03327 0.07423 0.1947 0.36% Gravity::update_max_rhs() 20 0.04701 0.08069 0.1775 0.32% VisMF::Write(FabArray) 4 0.1595 0.1654 0.1741 0.32% MLMG::miniCycle() 156 0.1633 0.1637 0.164 0.30% MLMG::actualBottomSolve() 333 0.0003922 0.04038 0.1603 0.29% FabArray::setDomainBndry() 853 0.1258 0.1349 0.1592 0.29% MLCGSolver::bicgstab 83 0 0.03852 0.1541 0.28% Castro::init(old) 9 0.1512 0.1518 0.1528 0.28% MLCellLinOp::defineBC() 81 0.1423 0.1435 0.146 0.27% Castro::computeInitialDt() 2 0.02154 0.0549 0.1436 0.26% MultiFab::Multiply() 164 0.1424 0.1431 0.1435 0.26% MultiFab::max() 40 0.01237 0.04638 0.1434 0.26% FabArray::mult() 294 0.1376 0.1386 0.1399 0.26% Castro::construct_old_source() 150 0.1359 0.1377 0.1388 0.25% Castro::construct_old_gravity_source() 30 0.1356 0.1374 0.1385 0.25% MLMG::mgVcycle_up::3 211 0.02494 0.05381 0.1382 0.25% MLMG::ResNormInf() 450 0.1265 0.132 0.1375 0.25% Castro::volProductSum() 22 0.1189 0.1232 0.1254 0.23% BndryData::define() 123 0.1169 0.1178 0.1198 0.22% Amr::grid_places() 11 0.1148 0.1166 0.1181 0.22% AmrMesh::MakeNewGrids() 11 0.1143 0.116 0.1175 0.21% MLMG::computeResWithCrseCorFineCor() 78 0.1052 0.1055 0.1059 0.19% Gravity::GetCrsePhi() 40 0.09185 0.09731 0.1059 0.19% MLCellLinOp::updateSolBC() 99 0.08846 0.0935 0.1005 0.18% Castro::check_for_nan() 60 0.0977 0.09843 0.09892 0.18% MultiFab::contains_nan() 60 0.09751 0.09823 0.09872 0.18% FabArrayBase::getCPC() 8152 0.06882 0.07411 0.08629 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08142 0.08186 0.08275 0.15% Gravity::test_level_grad_phi_curr() 20 0.07994 0.08104 0.08174 0.15% MultiFab::LinComb() 628 0.06423 0.06923 0.08149 0.15% MLMG::mgVcycle_down::4 211 0.03196 0.04327 0.07455 0.14% MLCellLinOp::updateCorBC() 78 0.06397 0.06443 0.06479 0.12% Castro::errorEst() 11 0.05991 0.06196 0.06448 0.12% MLCellLinOp::setLevelBC() 102 0.05052 0.0593 0.06306 0.12% Gravity::test_composite_phi() 1 0.05895 0.05896 0.05897 0.11% MLMG::mgVcycle_up::4 211 0.02507 0.03366 0.0573 0.10% MLMG::buildFineMask() 80 0.04744 0.04817 0.04873 0.09% MultiFab::norm0(mask) 57 0.04673 0.04753 0.04801 0.09% Gravity::test_level_grad_phi_prev() 30 0.04571 0.04638 0.04701 0.09% MLMG::MLResNormInf() 97 0.04377 0.04423 0.04466 0.08% FabArrayBase::CPC::define() 2260 0.02747 0.03214 0.04375 0.08% MultiFab::Copy() 100 0.03987 0.0403 0.0408 0.07% MLMG::interpCorrection_1 78 0.03245 0.03793 0.04064 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03625 0.03702 0.03832 0.07% MLMG::MLRhsNormInf() 80 0.02842 0.0287 0.02899 0.05% MLPoisson::prepareForSolve() 81 0.02507 0.02629 0.02893 0.05% MLCellLinOp::prepareForSolve() 81 0.02471 0.02593 0.02859 0.05% FabArrayBase::getFB() 13093 0.02374 0.02528 0.02831 0.05% Gravity::swapTimeLevels() 30 0.02239 0.02268 0.02295 0.04% Castro::apply_tagging_restrictions() 11 0.02076 0.02137 0.02285 0.04% CGSolver::sxay() 588 0 0.005015 0.02006 0.04% MLLinOp::define() 81 0.0119 0.01625 0.01939 0.04% MLLinOp::defineGrids() 81 0.0116 0.01595 0.01909 0.03% Castro::build_fine_mask() 153 0.01818 0.01838 0.01874 0.03% Castro::finalize_do_advance() 30 0.01348 0.01608 0.01756 0.03% AmrLevel::AmrLevel(dm) 12 0.01506 0.01552 0.01669 0.03% StateData::define() 48 0.01478 0.01526 0.01642 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01452 0.01478 0.01523 0.03% TagBoxArray::mapPRD 11 0.005918 0.01102 0.01513 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003711 0.01484 0.03% MLMG::compResidual() 1 0.01353 0.01403 0.01474 0.03% Castro::avgDown() 11 0.01412 0.01442 0.0146 0.03% Castro::avgDown(state_indx) 44 0.01407 0.01436 0.01454 0.03% amrex::average_down_w_geom 44 0.01395 0.01424 0.01442 0.03% Castro::swap_state_time_levels() 30 0.01314 0.01317 0.01324 0.02% MultiFab::Dot() 463 0 0.002958 0.01183 0.02% MLLinOp::makeSubCommunicator() 81 0.00264 0.006305 0.009336 0.02% Castro::apply_problem_tags() 11 0.008166 0.008278 0.008422 0.02% Castro::FluxRegFineAdd() 30 0.007381 0.007482 0.007573 0.01% Castro::enforce_consistent_e() 3 0.003369 0.00538 0.006403 0.01% AMRErrorTag::operator() 11 0.004778 0.005158 0.005645 0.01% FabArrayBase::TheFPinfo() 130 0.0007486 0.002146 0.00294 0.01% MLLinOp::makeAgglomeratedDMap 81 0.002225 0.002422 0.002515 0.00% FabArrayBase::FB::FB() 131 0.0008753 0.001285 0.00242 0.00% FPinfo::FPinfo() 3 0.0002444 0.00162 0.002419 0.00% DistributionMapping::KnapSackDoIt() 3 0.0001411 0.00151 0.002304 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0001189 0.001477 0.002281 0.00% Amr::InitAmr() 1 0.001765 0.001789 0.001836 0.00% TagBoxArray::collate() 11 0.0006469 0.001309 0.001776 0.00% makeSFC 243 0.00149 0.001638 0.001704 0.00% OwnerMask() 11 0.001429 0.001493 0.001546 0.00% DistributionMapping::Distribute() 245 0.0004952 0.0005013 0.0005091 0.00% Castro::enforce_speed_limit() 254 0.0004185 0.0004268 0.0004363 0.00% AmrMesh-cluster 2 0 8.497e-05 0.0003399 0.00% ClusterList::intersect() 2 0 5.779e-05 0.0002311 0.00% FabArray::RecvLayoutMask() 21 0.0001936 0.0001991 0.0002047 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 7.612e-05 0.000109 0.000128 0.00% BoxList::parallelComplementIn() 22 8.158e-05 8.809e-05 9.42e-05 0.00% Castro::create_source_corrector() 30 8.208e-05 8.429e-05 8.69e-05 0.00% Amr::writeSmallPlotFile() 1 7.248e-05 7.308e-05 7.385e-05 0.00% knapsack() 3 6.352e-05 6.791e-05 7.149e-05 0.00% Castro::retry_advance_ctu() 30 5.608e-05 6.038e-05 6.797e-05 0.00% Amr::initSubcycle() 1 3.642e-05 4.248e-05 5.591e-05 0.00% BoxList::complementIn 22 4.028e-05 4.416e-05 4.592e-05 0.00% Castro::gwstrain() 22 3.72e-05 3.988e-05 4.588e-05 0.00% Gravity::set_mass_offset() 11 2.509e-05 3.212e-05 3.933e-05 0.00% ClusterList::chop() 2 0 4.922e-06 1.969e-05 0.00% knapsack()swap 2 4.869e-06 5.275e-06 5.935e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.03-33-g9907ac197518) finalized