MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.03-21-g336ca7002b45) initialized Starting run at 05:40:08 UTC on 2022-03-22. Successfully read inputs file ... Castro git describe: 22.02-13-ga12efaab3 AMReX git describe: 22.03-21-g336ca7002 Microphysics git describe: 22.03-8-g75721f58 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.013895266 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.016938347 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.029646664 Gravity::fill_multipole_BCs() time = 0.028052282 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.597795359 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030722979 Gravity::solve_for_phi() time = 0.404527519 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -9.156547032e+22 ymom added: -4.911261142e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 2.748779069e+11 Castro::do_old_sources() time = 0.134230699 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.448538094 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025366031 Gravity::solve_for_phi() time = 0.35054155 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.156252137 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08358929571 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00935616 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009203927 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108987753 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046749353 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010303753 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.015832368 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009954897 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009186611 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108107445 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046465669 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010170912 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01457288028 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027858007 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010067039 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.147518232 Castro::reflux() at level 0 : time = 1.041965135 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.995386291 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009702529 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029281737 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029248699 Gravity::solve_for_phi() time = 0.393974201 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852872e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.133382994 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.431714857 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024829779 Gravity::solve_for_phi() time = 0.341040355 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.149798293 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08566140214 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009192912 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009390594 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106811974 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046882336 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.0100804 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01611738702 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00901856 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009274391 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106780105 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.047043229 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010209586 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01480262385 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02863761 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010057546 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770254e+28 zmom added: 8.082913462e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.147099926 Castro::reflux() at level 0 : time = 1.015888517 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.307468535 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009686656 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028464659 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030537489 Gravity::solve_for_phi() time = 0.394892509 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939016e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.140098564 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.47834891 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028026943 Gravity::solve_for_phi() time = 0.342334618 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.15694055 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08400024227 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009104264 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009324156 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108928149 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044426916 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010282689 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01602459105 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008895485 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009210436 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10734524 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044158255 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010235148 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01456481219 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.030045651 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010188481 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655088e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342337e+27 ymom added: 5.311566494e+28 zmom added: 5.312402179e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.149840507 Castro::reflux() at level 0 : time = 1.019055587 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.251367778 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009771368 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029094577 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033659701 Gravity::solve_for_phi() time = 0.394524611 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700666e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.133440947 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.474796817 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027465585 Gravity::solve_for_phi() time = 0.344797799 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.123378679e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.149931456 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08429216144 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008831325 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009243769 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106351912 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044453146 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010247005 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01630246141 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008781052 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009177487 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107830768 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044440541 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010288868 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01483369365 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029554627 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.009952409 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.25186043e+28 ymom added: -2.445730085e+28 zmom added: -2.44439047e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.145855247 Castro::reflux() at level 0 : time = 0.946915013 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.160324242 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009670377 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02856762 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029283413 Gravity::solve_for_phi() time = 0.379039588 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150497e+30 ymom added: 3.399803752e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.129500351 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.436869321 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028364271 Gravity::solve_for_phi() time = 0.341714106 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591233e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.149677102 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08621853224 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009007916 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.00925682 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108936666 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046078059 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010418535 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01599787316 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009234987 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009276863 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10861196 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045642637 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010296378 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01467713645 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.031368111 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010266133 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363474e+28 ymom added: 7.265277776e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.146630067 Castro::reflux() at level 0 : time = 0.962897169 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.13077777 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009674217 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028537297 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029965239 Gravity::solve_for_phi() time = 0.380062561 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919315e+30 ymom added: 4.094511425e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.131046061 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.444912892 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024398625 Gravity::solve_for_phi() time = 0.32802769 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245018e+27 ymom added: -5.297264722e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.145649141 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08651626373 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008636167 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.00921189 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107219569 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043130688 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.009975948 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01640604461 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008201908 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009016318 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106960646 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04329082 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010026226 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01496306787 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028363834 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.009898764 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781791e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.146590471 Castro::reflux() at level 0 : time = 0.941242529 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.087762116 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009637358 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028769658 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028398591 Gravity::solve_for_phi() time = 0.378788623 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151126e+30 ymom added: 4.515687958e+30 zmom added: 4.515609038e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.131082633 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.430837804 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024552297 Gravity::solve_for_phi() time = 0.328861837 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.881752619e+28 zmom added: -2.881735255e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.145537511 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08691822846 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008474593 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.008983303 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107267084 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043127764 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010244306 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01644945112 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008327144 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.008956504 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106599287 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043348669 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010090276 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01514053578 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029138338 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.009955307 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.145545233 Castro::reflux() at level 0 : time = 0.933463679 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.116107882 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009678279 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028440004 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028477764 Gravity::solve_for_phi() time = 0.378224001 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.89006409e+30 ymom added: 4.889542941e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.131536112 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.432295979 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024385536 Gravity::solve_for_phi() time = 0.375202946 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.145625744 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08556154248 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008604026 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009103123 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10662173 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043196723 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010170139 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01645937505 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008372819 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009162468 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107210611 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043216999 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.009976202 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01507588494 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028480248 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.009972769 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907354e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.14544641 Castro::reflux() at level 0 : time = 0.935086805 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.162113293 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009451373 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028316057 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028551107 Gravity::solve_for_phi() time = 0.378455247 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036357e+30 ymom added: 5.53045164e+30 zmom added: 5.530356437e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.12957193 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.434752013 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024673655 Gravity::solve_for_phi() time = 0.374661161 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170338e+28 zmom added: -5.061201609e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.146148799 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08557889302 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008610856 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009123161 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106497074 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043375499 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010055206 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01648255593 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008490252 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009037658 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10776435 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044809042 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.009972471 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01498119259 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028685995 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.009978817 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.145518385 Castro::reflux() at level 0 : time = 0.933701142 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.158691102 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009690007 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028669866 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034235672 Gravity::solve_for_phi() time = 0.385526741 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167159e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.130266314 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.435860361 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024635005 Gravity::solve_for_phi() time = 0.374323656 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.146126228 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08532150322 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008632104 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009193629 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107080801 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04916823 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010078685 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01603488094 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008480196 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.008969588 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106959664 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048849649 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010321763 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0147346612 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028341893 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010174858 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914869e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.14592412 Castro::reflux() at level 0 : time = 0.991929524 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.235901279 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.546713437 seconds Ending run at 05:41:02 UTC on 2022-03-22. Run time = 54.23255264 Run time without initialization = 52.06856667 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.23 ... 54.23 ... 54.23 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.2873 16.4401 16.5972 30.60% MLPoisson::Fsmooth() 11992 4.195 4.329 4.458 8.22% Castro::reset_internal_energy() 257 2.903 2.932 2.987 5.51% MultiFab::AddProduct() 4648 2.61 2.615 2.622 4.83% FabArray::setVal() 9464 2.316 2.333 2.364 4.36% MLPoisson::Fapply() 2422 1.858 1.877 1.922 3.54% MLCellLinOp::applyBC() 14630 1.479 1.552 1.733 3.20% MultiFab::Subtract() 601 1.67 1.672 1.675 3.09% FabArray::ParallelCopy_nowait() 5320 1.388 1.415 1.444 2.66% FabArray::ParallelCopy_finish() 5320 0.5506 1.069 1.41 2.60% Castro::enforce_min_density() 254 1.04 1.075 1.132 2.09% Gravity::fill_multipole_BCs() 41 1.057 1.094 1.117 2.06% Castro::derive() 397 0.924 0.9273 0.9315 1.72% MultiFab::sum() 4648 0.8543 0.8566 0.8587 1.58% FluxRegister::Reflux() 180 0.8244 0.8275 0.8296 1.53% FillBoundary_finish() 13093 0.4802 0.6248 0.7452 1.37% Castro::reflux() 10 0.6945 0.7082 0.7383 1.36% MultiFab::Xpay() 2190 0.7133 0.7199 0.7362 1.36% FillBoundary_nowait() 13093 0.6673 0.6765 0.6899 1.27% Castro::construct_new_gravity_source() 50 0.5961 0.6053 0.6221 1.15% Castro::volWgtSum() 242 0.5152 0.5598 0.6093 1.12% Castro::normalize_species() 254 0.5071 0.5202 0.5529 1.02% CellConservativeLinear::interp() 130 0.3686 0.4558 0.5425 1.00% Castro::estTimeStep() 69 0.2343 0.4038 0.4949 0.91% Castro::computeTemp() 257 0.4674 0.4688 0.4702 0.87% MLPoisson::FFlux() 1044 0.3911 0.3921 0.3928 0.72% Castro::finalize_advance() 30 0.3515 0.3598 0.3678 0.68% MultiFab::min() 30 0.007223 0.1716 0.3402 0.63% FillPatchSingleLevel 853 0.3256 0.3312 0.3382 0.62% Gravity::get_new_grav_vector() 52 0.3318 0.3328 0.334 0.62% StateData::FillBoundary(geom) 63 0.3263 0.3281 0.3303 0.61% MLMG::addInterpCorrection() 1421 0.2677 0.2729 0.2864 0.53% amrex::average_down 1713 0.2693 0.2733 0.285 0.53% MultiFab::Saxpy() 100 0.2759 0.277 0.2781 0.51% FillPatchIterator::Initialize 723 0.2652 0.2695 0.2766 0.51% Castro::post_timestep() 30 0.1283 0.1682 0.2206 0.41% Castro::do_advance_ctu() 30 0.2168 0.2181 0.2188 0.40% MLMG::oneIter() 333 0.212 0.2128 0.2137 0.39% Castro::expand_state() 30 0.1899 0.1903 0.1911 0.35% MLCellLinOp::defineAuxData() 81 0.1753 0.1799 0.1895 0.35% VisMF::Write(FabArray) 4 0.1628 0.1681 0.1794 0.33% MLCellLinOp::reflux() 116 0.1731 0.1748 0.1779 0.33% MLCellLinOp::compGrad() 100 0.171 0.1714 0.1719 0.32% Gravity::get_old_grav_vector() 30 0.1643 0.1648 0.1655 0.31% MultiFab::Multiply() 164 0.1462 0.1465 0.1467 0.27% FabArray::mult() 294 0.1375 0.1386 0.1397 0.26% Castro::construct_old_gravity_source() 30 0.1335 0.1339 0.1344 0.25% Amr::writePlotFile() 2 0.1135 0.125 0.1343 0.25% FabArray::setDomainBndry() 853 0.1272 0.1305 0.1324 0.24% MLMG::ResNormInf() 450 0.09382 0.09945 0.1057 0.19% MultiFab::contains_nan() 60 0.0909 0.09132 0.09156 0.17% BndryData::define() 123 0.08929 0.08975 0.09078 0.17% MultiFab::LinComb() 628 0.07056 0.07962 0.08917 0.16% Castro::construct_old_gravity() 30 0.08695 0.08754 0.08854 0.16% MLMG::prepareForSolve() 80 0.08034 0.08178 0.08513 0.16% Castro::evaluate_source_change() 591 0.07734 0.07808 0.07875 0.15% Gravity::gravity_sync() 10 0.07132 0.07192 0.07249 0.13% Gravity::test_level_grad_phi_curr() 20 0.07104 0.07167 0.07226 0.13% Castro::initData() 3 0.05758 0.06171 0.07078 0.13% MLCGSolver::bicgstab 83 0 0.01466 0.05865 0.11% MLCellLinOp::updateSolBC() 99 0.05668 0.05768 0.05848 0.11% Castro::volProductSum() 22 0.04719 0.05253 0.05733 0.11% Castro::construct_new_gravity() 30 0.05351 0.0547 0.05594 0.10% MultiFab::norm0(mask) 57 0.04631 0.04647 0.04677 0.09% MLCellLinOp::updateCorBC() 78 0.04489 0.04568 0.0463 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04492 0.04529 0.04549 0.08% Castro::initialize_do_advance() 30 0.03399 0.03774 0.04446 0.08% FabArrayBase::CPC::define() 2260 0.02763 0.03192 0.04338 0.08% FabArrayBase::getCPC() 8152 0.04061 0.04136 0.04235 0.08% MLCellLinOp::setLevelBC() 102 0.04082 0.04123 0.04205 0.08% Gravity::actual_solve_with_mlmg() 81 0.03846 0.04067 0.04199 0.08% Gravity::test_level_grad_phi_prev() 30 0.04051 0.04089 0.04117 0.08% MLMG::buildFineMask() 80 0.04035 0.04045 0.04053 0.07% MultiFab::Copy() 100 0.03941 0.03957 0.03967 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03686 0.03785 0.03941 0.07% Gravity::solve_for_phi() 60 0.02656 0.03034 0.03614 0.07% AmrMesh::MakeNewGrids() 11 0.03441 0.03525 0.03594 0.07% FabArray::FillBoundary() 13093 0.03096 0.03203 0.03484 0.06% MLCellLinOp::smooth() 5996 0.02578 0.02684 0.02855 0.05% MLCellLinOp::prepareForSolve() 81 0.02431 0.02549 0.02818 0.05% Castro::initialize_advance() 30 0.02565 0.02619 0.02669 0.05% Castro::init(old) 9 0.02614 0.02624 0.02631 0.05% FabArrayBase::getFB() 13093 0.02273 0.02356 0.02566 0.05% MLCellLinOp::defineBC() 81 0.02389 0.02424 0.02483 0.05% Gravity::update_max_rhs() 20 0.02396 0.02416 0.02438 0.04% Amr::defBaseLevel() 1 0.02041 0.02115 0.02326 0.04% MLMG::interpCorrection_1 78 0.02272 0.02281 0.02285 0.04% Castro::apply_tagging_restrictions() 11 0.02094 0.02158 0.02273 0.04% Castro::post_init() 2 0.0003422 0.009799 0.02198 0.04% Castro::finalize_do_advance() 30 0.01386 0.01755 0.02122 0.04% Castro::build_fine_mask() 153 0.01835 0.01845 0.01854 0.03% MultiFab::max() 40 0.01288 0.01475 0.01785 0.03% FillPatchTwoLevels 394 0.01527 0.01587 0.01677 0.03% StateData::define() 48 0.01453 0.01502 0.01641 0.03% FabArray::ParallelCopy() 5320 0.01425 0.01453 0.01512 0.03% Castro::swap_state_time_levels() 30 0.01316 0.01348 0.01432 0.03% StateDataPhysBCFunct::() 853 0.007992 0.009703 0.01237 0.02% Gravity::actual_multilevel_solve() 10 0.01198 0.01213 0.01227 0.02% MLMG::MLRhsNormInf() 80 0.01193 0.01197 0.01206 0.02% MultiFab::Dot() 463 0 0.002904 0.01161 0.02% Amr::regrid() 10 0.009748 0.01028 0.01126 0.02% Gravity::GetCrsePhi() 40 0.009656 0.00989 0.01026 0.02% MLCellLinOp::apply() 2422 0.005726 0.00668 0.009303 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.00844 0.0086 0.008767 0.02% MLLinOp::makeSubCommunicator() 81 0.004165 0.005713 0.008098 0.01% Castro::apply_problem_tags() 11 0.007515 0.007633 0.007812 0.01% Castro::FluxRegFineAdd() 30 0.007104 0.007241 0.007418 0.01% MLLinOp::defineGrids() 81 0.006843 0.007076 0.007193 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001797 0.007186 0.01% MLMG::solve() 80 0.003351 0.005647 0.006685 0.01% MLCellLinOp::correctionResidual() 1660 0.004579 0.004984 0.00589 0.01% AMRErrorTag::operator() 11 0.004764 0.004988 0.005414 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005142 0.005168 0.005189 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004969 0.005005 0.005048 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004868 0.004884 0.004903 0.01% CGSolver::sxay() 588 0 0.001207 0.004828 0.01% Castro::do_new_sources() 50 0.0008108 0.001975 0.004619 0.01% MLMG::mgVcycle() 489 0.003905 0.004061 0.004357 0.01% main() 1 0.002524 0.003742 0.004168 0.01% Castro::enforce_consistent_e() 3 0.003505 0.003784 0.004039 0.01% Gravity::test_composite_phi() 1 0.003789 0.003869 0.003963 0.01% FillPatchInterp(Fab) 130 0.001763 0.002323 0.003718 0.01% MLMG:computeResOfCorrection() 1421 0.003311 0.003419 0.003598 0.01% MLMG::actualBottomSolve() 333 0.0003964 0.001175 0.003502 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0004108 0.001898 0.003485 0.01% Castro::do_old_sources() 30 0.0004615 0.001173 0.00267 0.00% FabArrayBase::FB::FB() 131 0.0008703 0.001273 0.00244 0.00% MLMG::mgVcycle_down::0 333 0.002256 0.002281 0.002323 0.00% MLMG::mgVcycle_down::1 333 0.002063 0.002118 0.0022 0.00% MLMG::mgVcycle_down::2 333 0.001906 0.00196 0.00204 0.00% MLCellLinOp::solutionResidual() 530 0.001918 0.001959 0.001983 0.00% Castro::subcycle_advance_ctu() 30 0.0001962 0.0006296 0.001923 0.00% Gravity::solve_phi_with_mlmg() 71 0.001588 0.001675 0.001864 0.00% Amr::InitAmr() 1 0.001768 0.001775 0.00178 0.00% MLMG::mgVcycle_up::0 333 0.001555 0.001588 0.001651 0.00% Castro::clean_state() 254 0.001528 0.001566 0.00162 0.00% OwnerMask() 11 0.001429 0.00153 0.001575 0.00% MLMG::mgVcycle_up::2 333 0.001328 0.001383 0.001504 0.00% MLMG::mgVcycle_up::1 333 0.001337 0.001372 0.001439 0.00% TagBoxArray::collate() 11 0.001211 0.001333 0.001423 0.00% MLMG::mgVcycle_bottom 489 0.001273 0.001295 0.001336 0.00% MLMG::mgVcycle_down::3 211 0.001172 0.00123 0.001316 0.00% MLMG::mgVcycle_down::4 211 0.001111 0.001162 0.001268 0.00% makeSFC 243 0.001059 0.001108 0.001149 0.00% Amr::coarseTimeStep() 10 0.0006362 0.0007778 0.001068 0.00% Amr::bldFineLevels() 1 0.000758 0.0008631 0.0009369 0.00% MLMG::mgVcycle_up::4 211 0.0007685 0.0008059 0.0009076 0.00% MLMG::MLResNormInf() 97 0.0006619 0.0007638 0.0008959 0.00% TagBoxArray::mapPRD 11 0.0008257 0.0008623 0.0008782 0.00% MLMG::mgVcycle_up::3 211 0.0007325 0.0007706 0.0008732 0.00% MLMG::computeResidual() 333 0.0008289 0.0008414 0.0008644 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007611 0.0007823 0.0008056 0.00% Amr::timeStep() 30 0.0004513 0.0005234 0.0006916 0.00% Castro::construct_new_source() 250 0.0005744 0.0006122 0.0006617 0.00% MLPoisson::define() 81 0.0006027 0.0006237 0.0006544 0.00% Amr::grid_places() 11 0.0005089 0.0005647 0.0005919 0.00% FabArrayBase::TheFPinfo() 130 0.000509 0.0005258 0.0005642 0.00% DistributionMapping::Distribute() 245 0.0004807 0.0004949 0.0005122 0.00% Castro::enforce_speed_limit() 254 0.0003837 0.0003951 0.0004131 0.00% Castro::apply_source_to_state() 100 0.0003376 0.0003566 0.0003794 0.00% MLPoisson::prepareForSolve() 81 0.000342 0.0003501 0.0003617 0.00% Castro::computeNewDt() 18 0.0001163 0.0001765 0.0003529 0.00% MLMG::computeMLResidual() 97 0.0003054 0.0003124 0.0003261 0.00% Castro::construct_old_source() 150 0.0002778 0.0002863 0.0002968 0.00% MLLinOp::define() 81 0.0002879 0.000292 0.0002959 0.00% MLMG::miniCycle() 156 0.0002673 0.0002716 0.0002747 0.00% MLMG::getGradSolution() 80 0.0002552 0.00026 0.0002668 0.00% Castro::post_regrid() 22 0.000236 0.000246 0.0002632 0.00% AmrLevel::AmrLevel(dm) 12 0.0002445 0.0002564 0.0002625 0.00% Castro::advance() 30 0.000217 0.0002253 0.0002328 0.00% ClusterList::intersect() 2 0 5.642e-05 0.0002257 0.00% FabArray::RecvLayoutMask() 21 0.0001972 0.0001985 0.0002012 0.00% Gravity::swapTimeLevels() 30 0.0001813 0.0001912 0.0001967 0.00% Castro::check_for_nan() 60 0.0001745 0.0001856 0.0001936 0.00% Castro::errorEst() 11 0.0001232 0.000129 0.0001338 0.00% FPinfo::FPinfo() 3 9.67e-05 0.0001069 0.0001178 0.00% Castro::avgDown(state_indx) 44 0.0001116 0.0001124 0.0001132 0.00% Amr::FinalizeInit() 1 1.855e-05 4.259e-05 0.0001128 0.00% Castro::create_source_corrector() 30 7.867e-05 8.758e-05 0.000107 0.00% AmrMesh-cluster 2 0 2.326e-05 9.306e-05 0.00% amrex::average_down_w_geom 44 8.603e-05 8.908e-05 9.102e-05 0.00% Gravity::solve_for_delta_phi 10 8.069e-05 8.498e-05 8.805e-05 0.00% knapsack() 3 5.757e-05 6.362e-05 8.008e-05 0.00% Amr::writeSmallPlotFile() 1 7.181e-05 7.316e-05 7.504e-05 0.00% Castro::retry_advance_ctu() 30 5.601e-05 6.105e-05 7.161e-05 0.00% Castro::avgDown() 11 5.326e-05 5.736e-05 6.027e-05 0.00% Gravity::set_mass_offset() 11 2.843e-05 3.572e-05 5.132e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.106e-05 3.787e-05 4.807e-05 0.00% Castro::gwstrain() 22 3.685e-05 4.058e-05 4.569e-05 0.00% BoxList::parallelComplementIn() 22 4.025e-05 4.129e-05 4.269e-05 0.00% Amr::initSubcycle() 1 3.44e-05 3.638e-05 4.077e-05 0.00% BoxList::complementIn 22 3.835e-05 3.937e-05 4.032e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.671e-05 2.889e-05 3.238e-05 0.00% Castro::computeInitialDt() 2 1.331e-05 2.459e-05 2.865e-05 0.00% ClusterList::chop() 2 0 4.957e-06 1.983e-05 0.00% MLMG::compResidual() 1 1.196e-05 1.223e-05 1.248e-05 0.00% Amr::InitializeInit() 1 5.125e-06 6.516e-06 9.277e-06 0.00% Amr::init() 1 5.254e-06 6.092e-06 7.056e-06 0.00% knapsack()swap 2 4.692e-06 4.98e-06 5.19e-06 0.00% Amr::initialInit() 1 3.382e-06 3.791e-06 4.246e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.23 54.23 54.23 100.00% Amr::coarseTimeStep() 10 51.52 51.52 51.52 94.99% Amr::timeStep() 30 51.28 51.32 51.44 94.85% Castro::advance() 30 36 36 36 66.39% Castro::subcycle_advance_ctu() 30 34.23 34.24 34.25 63.15% Castro::do_advance_ctu() 30 34.23 34.24 34.25 63.15% Castro::construct_ctu_hydro_source() 30 16.29 16.44 16.6 30.60% Gravity::actual_solve_with_mlmg() 81 13.38 13.38 13.38 24.66% MLMG::solve() 80 12.65 12.66 12.67 23.35% Castro::post_timestep() 30 12.21 12.25 12.37 22.81% MLMG::oneIter() 333 10.66 10.67 10.68 19.70% Castro::clean_state() 254 10.38 10.47 10.57 19.49% Gravity::solve_phi_with_mlmg() 71 10.02 10.06 10.09 18.60% Castro::reflux() 10 9.689 9.702 9.723 17.93% MLMG::mgVcycle() 489 9.362 9.376 9.404 17.34% Gravity::solve_for_phi() 60 8.366 8.404 8.427 15.54% MLCellLinOp::smooth() 5996 6.425 6.548 6.834 12.60% Castro::computeTemp() 257 6.159 6.195 6.262 11.55% Castro::reset_internal_energy() 257 5.69 5.726 5.794 10.68% Gravity::gravity_sync() 10 5.111 5.111 5.112 9.43% Castro::construct_new_gravity() 30 5.107 5.109 5.111 9.42% Castro::construct_old_gravity() 30 4.713 4.749 4.771 8.80% Castro::evaluate_source_change() 591 4.465 4.476 4.493 8.28% MLPoisson::Fsmooth() 11992 4.195 4.329 4.458 8.22% Gravity::solve_for_delta_phi 10 4.285 4.286 4.288 7.91% MLMG::mgVcycle_down::0 333 3.981 3.991 3.999 7.37% Castro::enforce_min_density() 254 3.792 3.83 3.889 7.17% FillPatchIterator::Initialize 723 3.295 3.309 3.324 6.13% Castro::do_new_sources() 50 3.208 3.232 3.261 6.01% Amr::regrid() 10 3.121 3.136 3.145 5.80% MLCellLinOp::applyBC() 14630 2.685 2.887 3.073 5.67% MLMG::mgVcycle_up::0 333 2.76 2.963 3.051 5.63% Castro::post_regrid() 22 2.926 2.941 2.951 5.44% FabArray::ParallelCopy() 5320 2.065 2.548 2.879 5.31% MultiFab::AddProduct() 4648 2.61 2.615 2.622 4.83% MLCellLinOp::apply() 2422 2.459 2.513 2.593 4.78% Castro::initialize_do_advance() 30 2.487 2.501 2.529 4.66% FabArray::setVal() 9464 2.316 2.333 2.364 4.36% FillPatchSingleLevel 853 2.228 2.254 2.291 4.22% Amr::init() 1 2.162 2.162 2.162 3.99% MLPoisson::Fapply() 2422 1.858 1.877 1.922 3.54% MLCellLinOp::solutionResidual() 530 1.733 1.745 1.756 3.24% MLCellLinOp::correctionResidual() 1660 1.597 1.641 1.719 3.17% MultiFab::Subtract() 601 1.67 1.672 1.675 3.09% Gravity::multilevel_solve_for_new_phi() 10 1.66 1.66 1.661 3.06% Gravity::actual_multilevel_solve() 10 1.652 1.652 1.652 3.05% Castro::derive() 397 1.63 1.635 1.642 3.03% MLMG:computeResOfCorrection() 1421 1.465 1.503 1.57 2.89% Amr::initialInit() 1 1.564 1.564 1.564 2.88% Castro::do_old_sources() 30 1.48 1.491 1.507 2.78% FabArray::ParallelCopy_nowait() 5320 1.437 1.465 1.5 2.77% FabArray::FillBoundary() 13093 1.21 1.358 1.467 2.71% Castro::volWgtSum() 242 1.325 1.372 1.424 2.62% FabArray::ParallelCopy_finish() 5320 0.5506 1.069 1.41 2.60% Castro::initialize_advance() 30 1.353 1.361 1.371 2.53% Amr::FinalizeInit() 1 1.234 1.253 1.272 2.35% FillPatchTwoLevels 394 1.161 1.177 1.185 2.19% Castro::expand_state() 30 1.173 1.175 1.178 2.17% Gravity::fill_multipole_BCs() 41 1.094 1.131 1.154 2.13% Amr::writePlotFile() 2 1.145 1.145 1.145 2.11% FluxRegister::Reflux() 180 1.122 1.128 1.135 2.09% MLMG::addInterpCorrection() 1421 0.3178 0.8365 1.014 1.87% Gravity::get_new_grav_vector() 52 0.9981 1.001 1.003 1.85% Castro::post_init() 2 0.9394 0.9412 0.9431 1.74% MLMG::computeResWithCrseSolFineCor() 78 0.9255 0.9259 0.9267 1.71% MLMG::computeResidual() 333 0.8986 0.9111 0.9176 1.69% MultiFab::sum() 4648 0.8543 0.8566 0.8587 1.58% MLMG::mgVcycle_down::1 333 0.683 0.7141 0.782 1.44% FillBoundary_finish() 13093 0.4802 0.6248 0.7452 1.37% MultiFab::Xpay() 2190 0.7133 0.7199 0.7362 1.36% FillBoundary_nowait() 13093 0.6909 0.7014 0.718 1.32% MLCellLinOp::reflux() 116 0.6571 0.6573 0.6577 1.21% MLMG::mgVcycle_up::2 333 0.2134 0.5416 0.6535 1.20% Castro::construct_new_source() 250 0.5967 0.6059 0.6227 1.15% Castro::construct_new_gravity_source() 50 0.5961 0.6053 0.6221 1.15% MLMG::computeMLResidual() 97 0.5816 0.6034 0.6131 1.13% Castro::normalize_species() 254 0.5071 0.5202 0.5529 1.02% FillPatchInterp(Fab) 130 0.3723 0.4581 0.5443 1.00% CellConservativeLinear::interp() 130 0.3686 0.4558 0.5425 1.00% MLMG::mgVcycle_up::1 333 0.4755 0.4934 0.5416 1.00% Gravity::get_old_grav_vector() 30 0.5227 0.5255 0.5271 0.97% Castro::estTimeStep() 69 0.2343 0.4038 0.4949 0.91% Castro::finalize_advance() 30 0.395 0.3983 0.4018 0.74% MLPoisson::define() 81 0.3773 0.3838 0.4006 0.74% MLPoisson::FFlux() 1044 0.3911 0.3921 0.3928 0.72% StateDataPhysBCFunct::() 853 0.3343 0.3378 0.3402 0.63% MultiFab::min() 30 0.007223 0.1716 0.3402 0.63% StateData::FillBoundary(geom) 63 0.3263 0.3281 0.3303 0.61% Amr::InitializeInit() 1 0.2914 0.3108 0.3295 0.61% Amr::defBaseLevel() 1 0.2914 0.3108 0.3295 0.61% MLMG::prepareForSolve() 80 0.3091 0.3143 0.3279 0.60% amrex::average_down 1713 0.2934 0.3018 0.3264 0.60% MLMG::mgVcycle_bottom 489 0.1633 0.2039 0.3243 0.60% Castro::computeNewDt() 18 0.1358 0.2683 0.3227 0.60% Castro::initData() 3 0.2678 0.2863 0.3056 0.56% MLMG::mgVcycle_down::2 333 0.2503 0.2587 0.2822 0.52% Castro::apply_source_to_state() 100 0.2763 0.2773 0.2784 0.51% MultiFab::Saxpy() 100 0.2759 0.277 0.2781 0.51% MLCellLinOp::defineAuxData() 81 0.2164 0.2241 0.2419 0.45% MLMG::getGradSolution() 80 0.2169 0.2174 0.2183 0.40% MLCellLinOp::compGrad() 100 0.2166 0.2172 0.218 0.40% MLMG::mgVcycle_down::3 211 0.03392 0.07491 0.1943 0.36% VisMF::Write(FabArray) 4 0.1628 0.1681 0.1794 0.33% Amr::bldFineLevels() 1 0.1766 0.1779 0.1792 0.33% MLMG::miniCycle() 156 0.1628 0.1632 0.1642 0.30% MLMG::actualBottomSolve() 333 0.0003964 0.04064 0.1613 0.30% MLCGSolver::bicgstab 83 0 0.03876 0.155 0.29% Castro::init(old) 9 0.1495 0.1511 0.1536 0.28% MultiFab::Multiply() 164 0.1462 0.1465 0.1467 0.27% MLCellLinOp::defineBC() 81 0.1427 0.1436 0.1444 0.27% FabArray::mult() 294 0.1375 0.1386 0.1397 0.26% MLMG::mgVcycle_up::3 211 0.02551 0.05403 0.1382 0.25% MLMG::ResNormInf() 450 0.1241 0.1297 0.136 0.25% Castro::construct_old_source() 150 0.1338 0.1342 0.1347 0.25% Castro::construct_old_gravity_source() 30 0.1335 0.1339 0.1344 0.25% FabArray::setDomainBndry() 853 0.1272 0.1305 0.1324 0.24% Castro::volProductSum() 22 0.1193 0.1245 0.1292 0.24% BndryData::define() 123 0.1174 0.1182 0.1193 0.22% Gravity::GetCrsePhi() 40 0.1024 0.1095 0.1191 0.22% Amr::grid_places() 11 0.1144 0.1154 0.1179 0.22% AmrMesh::MakeNewGrids() 11 0.1138 0.1149 0.1174 0.22% MLMG::computeResWithCrseCorFineCor() 78 0.1037 0.1046 0.1051 0.19% MLCellLinOp::updateSolBC() 99 0.08177 0.0907 0.09544 0.18% Castro::check_for_nan() 60 0.0911 0.0915 0.09175 0.17% MultiFab::contains_nan() 60 0.0909 0.09132 0.09156 0.17% MultiFab::LinComb() 628 0.07056 0.07962 0.08917 0.16% FabArrayBase::getCPC() 8152 0.06855 0.07328 0.08573 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.0817 0.08219 0.0825 0.15% Gravity::test_level_grad_phi_curr() 20 0.08013 0.08088 0.08154 0.15% MLMG::mgVcycle_down::4 211 0.0326 0.04364 0.07468 0.14% MLCellLinOp::updateCorBC() 78 0.06332 0.06408 0.0648 0.12% Castro::errorEst() 11 0.05918 0.06089 0.06355 0.12% MLCellLinOp::setLevelBC() 102 0.05157 0.06007 0.06317 0.12% Gravity::test_composite_phi() 1 0.05832 0.05834 0.05835 0.11% MLMG::mgVcycle_up::4 211 0.02559 0.03396 0.05777 0.11% Castro::computeInitialDt() 2 0.01725 0.03597 0.05533 0.10% Gravity::update_max_rhs() 20 0.04682 0.04869 0.05158 0.10% MLMG::buildFineMask() 80 0.04977 0.04988 0.04995 0.09% MultiFab::norm0(mask) 57 0.04631 0.04647 0.04677 0.09% Gravity::test_level_grad_phi_prev() 30 0.04584 0.04629 0.04663 0.09% MLMG::interpCorrection_1 78 0.03108 0.04014 0.0448 0.08% FabArrayBase::CPC::define() 2260 0.02763 0.03192 0.04338 0.08% MLMG::MLResNormInf() 97 0.04306 0.04317 0.04327 0.08% MultiFab::Copy() 100 0.03941 0.03957 0.03967 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03686 0.03785 0.03941 0.07% MLPoisson::prepareForSolve() 81 0.02466 0.02584 0.02853 0.05% MLMG::MLRhsNormInf() 80 0.0281 0.0282 0.02845 0.05% MLCellLinOp::prepareForSolve() 81 0.02431 0.02549 0.02818 0.05% FabArrayBase::getFB() 13093 0.02363 0.02483 0.0281 0.05% Gravity::swapTimeLevels() 30 0.02244 0.02301 0.02351 0.04% Castro::apply_tagging_restrictions() 11 0.02094 0.02158 0.02273 0.04% Castro::finalize_do_advance() 30 0.01386 0.01755 0.02122 0.04% CGSolver::sxay() 588 0 0.005055 0.02022 0.04% Castro::build_fine_mask() 153 0.01835 0.01845 0.01854 0.03% MLLinOp::define() 81 0.01395 0.01546 0.01794 0.03% MultiFab::max() 40 0.01288 0.01475 0.01785 0.03% MLLinOp::defineGrids() 81 0.01366 0.01517 0.01765 0.03% AmrLevel::AmrLevel(dm) 12 0.01477 0.01528 0.01667 0.03% StateData::define() 48 0.01453 0.01502 0.01641 0.03% TagBoxArray::mapPRD 11 0.005993 0.01085 0.01567 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01441 0.01496 0.0155 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003648 0.01459 0.03% Castro::swap_state_time_levels() 30 0.01316 0.01348 0.01432 0.03% MLMG::compResidual() 1 0.01356 0.01387 0.01414 0.03% Castro::avgDown() 11 0.01363 0.01378 0.01404 0.03% Castro::avgDown(state_indx) 44 0.01357 0.01373 0.01398 0.03% amrex::average_down_w_geom 44 0.01345 0.01361 0.01387 0.03% MultiFab::Dot() 463 0 0.002904 0.01161 0.02% MLLinOp::makeSubCommunicator() 81 0.004165 0.005713 0.008098 0.01% Castro::apply_problem_tags() 11 0.007515 0.007633 0.007812 0.01% Castro::FluxRegFineAdd() 30 0.007104 0.007241 0.007418 0.01% AMRErrorTag::operator() 11 0.004764 0.004988 0.005414 0.01% FabArrayBase::TheFPinfo() 130 0.001118 0.002566 0.004153 0.01% Castro::enforce_consistent_e() 3 0.003505 0.003784 0.004039 0.01% FPinfo::FPinfo() 3 0.0005533 0.00204 0.003643 0.01% DistributionMapping::KnapSackDoIt() 3 0.0004566 0.001933 0.003533 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0004108 0.001898 0.003485 0.01% MLLinOp::makeAgglomeratedDMap 81 0.002293 0.002377 0.00244 0.00% FabArrayBase::FB::FB() 131 0.0008703 0.001273 0.00244 0.00% Amr::InitAmr() 1 0.001803 0.001811 0.001821 0.00% makeSFC 243 0.001531 0.001594 0.001635 0.00% OwnerMask() 11 0.001429 0.00153 0.001575 0.00% TagBoxArray::collate() 11 0.001211 0.001333 0.001423 0.00% DistributionMapping::Distribute() 245 0.0004807 0.0004949 0.0005122 0.00% Castro::enforce_speed_limit() 254 0.0003837 0.0003951 0.0004131 0.00% AmrMesh-cluster 2 0 8.464e-05 0.0003386 0.00% ClusterList::intersect() 2 0 5.642e-05 0.0002257 0.00% FabArray::RecvLayoutMask() 21 0.0001972 0.0001985 0.0002012 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.316e-05 0.0001084 0.0001334 0.00% Castro::create_source_corrector() 30 7.867e-05 8.758e-05 0.000107 0.00% knapsack() 3 6.255e-05 6.861e-05 8.527e-05 0.00% BoxList::parallelComplementIn() 22 7.86e-05 8.067e-05 8.226e-05 0.00% Amr::writeSmallPlotFile() 1 7.181e-05 7.316e-05 7.504e-05 0.00% Castro::retry_advance_ctu() 30 5.601e-05 6.105e-05 7.161e-05 0.00% Gravity::set_mass_offset() 11 2.843e-05 3.572e-05 5.132e-05 0.00% Castro::gwstrain() 22 3.685e-05 4.058e-05 4.569e-05 0.00% Amr::initSubcycle() 1 3.44e-05 3.638e-05 4.077e-05 0.00% BoxList::complementIn 22 3.835e-05 3.937e-05 4.032e-05 0.00% ClusterList::chop() 2 0 4.957e-06 1.983e-05 0.00% knapsack()swap 2 4.692e-06 4.98e-06 5.19e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.03-21-g336ca7002b45) finalized