MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.02-10-g76d08651adb9) initialized Starting run at 06:34:55 UTC on 2022-02-16. Successfully read inputs file ... Castro git describe: 22.02-4-g0d942c92d AMReX git describe: 22.02-10-g76d08651a Microphysics git describe: 22.02-2-gf51cc451 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.016568024 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.019278882 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.029996701 Gravity::fill_multipole_BCs() time = 0.029910668 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.606574451 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031930484 Gravity::solve_for_phi() time = 0.409322045 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -6.405132104e+22 ymom added: -4.911261142e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.143929926 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.497045376 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029063443 Gravity::solve_for_phi() time = 0.35828348 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.161032007 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08146733589 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008561716 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009597795 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110039381 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046477594 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010394138 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01576406782 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.010200861 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009434767 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108223814 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048148711 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010405204 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01431304675 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028924739 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010310645 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.149809914 Castro::reflux() at level 0 : time = 1.044774268 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 5.087511811 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.010004987 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.030986392 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033632651 Gravity::solve_for_phi() time = 0.405921475 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852865e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.136261528 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.476919824 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030171949 Gravity::solve_for_phi() time = 0.35120636 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125187e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.152227869 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08331499636 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008609576 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009401005 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108825163 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044444709 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010311951 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01617146369 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.010361734 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009410225 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109101559 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046185637 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010328882 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01462348538 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029535923 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.01023232 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770255e+28 zmom added: 8.082913462e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.152162803 Castro::reflux() at level 0 : time = 1.033955721 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.376309155 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009906653 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029556314 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.035055852 Gravity::solve_for_phi() time = 0.405265521 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939029e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.13534253 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.475791718 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032873295 Gravity::solve_for_phi() time = 0.357591296 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.161819961 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08306890181 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008784682 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009476148 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108453197 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045610428 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010208843 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01602146751 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009181669 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.00924929 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107528171 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043818041 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010202013 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01440602535 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029494157 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010119476 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655087e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342331e+27 ymom added: 5.311566494e+28 zmom added: 5.312402181e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.15536455 Castro::reflux() at level 0 : time = 1.018432645 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.300312758 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.010544685 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.030542934 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034070301 Gravity::solve_for_phi() time = 0.38901256 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.05970067e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.133663754 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.480904047 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029010786 Gravity::solve_for_phi() time = 0.338242704 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.154548416 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0843134441 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008695455 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009419266 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10733909 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043786468 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010225383 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01620843144 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008799965 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.00928808 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107823026 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04436665 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010207835 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01487549076 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.030272938 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010170799 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860432e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.149418526 Castro::reflux() at level 0 : time = 0.956700917 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.182811499 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009862687 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029594515 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.037543242 Gravity::solve_for_phi() time = 0.392309164 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150486e+30 ymom added: 3.399803827e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.136491393 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.476092763 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02915294 Gravity::solve_for_phi() time = 0.337192307 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591232e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.154309248 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08439443722 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008274995 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009234526 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107111803 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043551333 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010289449 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01631755264 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008230649 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009270355 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108168705 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04366829 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010228175 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01484896545 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029847494 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010120245 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363474e+28 ymom added: 7.265277775e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.150398338 Castro::reflux() at level 0 : time = 0.951229633 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.193084437 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009846062 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029835698 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031699987 Gravity::solve_for_phi() time = 0.387676254 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919307e+30 ymom added: 4.094511425e+30 zmom added: 4.094439154e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.135062402 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.498718491 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029102284 Gravity::solve_for_phi() time = 0.33658715 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245024e+27 ymom added: -5.297264713e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.153199635 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0838666762 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008736119 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009208729 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107096076 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043932876 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.010214218 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01633304475 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008724782 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009265893 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106658587 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043835882 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010248572 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01496175305 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.030969568 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010284465 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.150497448 Castro::reflux() at level 0 : time = 0.964093503 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.201877357 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.014374887 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.031055751 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029590348 Gravity::solve_for_phi() time = 0.386293729 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151128e+30 ymom added: 4.515687996e+30 zmom added: 4.515608962e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.136436056 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.482175768 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030673662 Gravity::solve_for_phi() time = 0.337789454 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.88175262e+28 zmom added: -2.881735257e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.154865178 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08422107237 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008724331 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009262442 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106992943 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043697008 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010235695 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01629908418 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008724223 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009229388 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107800979 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043696923 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010230894 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0148515255 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029419274 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.010114971 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.148893434 Castro::reflux() at level 0 : time = 0.947867539 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.267704354 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009850475 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029305676 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034590386 Gravity::solve_for_phi() time = 0.388814724 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064085e+30 ymom added: 4.889542941e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.133093408 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.476457303 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027965492 Gravity::solve_for_phi() time = 0.381781422 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.154427098 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08339218799 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008488657 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009201074 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107022648 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043648601 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010148656 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01635194979 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008777565 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009230346 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106905931 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043597509 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010167173 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01497834176 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029557172 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010114865 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907354e+27 zmom added: 5.953997699e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.14874161 Castro::reflux() at level 0 : time = 0.950004342 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.264600984 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.010357682 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029883433 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030121053 Gravity::solve_for_phi() time = 0.382182912 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036345e+30 ymom added: 5.53045164e+30 zmom added: 5.530356437e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.134292687 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.475633386 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025308896 Gravity::solve_for_phi() time = 0.377081348 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.06117034e+28 zmom added: -5.061201611e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.1545346 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08357004574 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008130305 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009272476 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108136927 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043468772 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010176898 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01627731897 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008178011 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009251248 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107642747 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04514414 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.010239271 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01483858559 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02951678 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.010125487 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.149324779 Castro::reflux() at level 0 : time = 0.947573712 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.259673881 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009835916 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029387783 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02975579 Gravity::solve_for_phi() time = 0.381868574 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167165e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.133091875 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.473684158 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026394545 Gravity::solve_for_phi() time = 0.377995637 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.154946614 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08365877677 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008266325 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009225575 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107930716 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.049347522 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.01023025 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01591414023 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008175293 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009222153 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108072679 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.050997225 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010286569 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01450823191 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029404882 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010108127 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914873e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.14891777 Castro::reflux() at level 0 : time = 1.004302636 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.324048914 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.554688903 seconds Ending run at 06:35:51 UTC on 2022-02-16. Run time = 55.35290393 Run time without initialization = 52.95915741 Average number of zones advanced per microsecond: 0.051 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 55.35 ... 55.35 ... 55.35 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.4862 16.7247 16.9724 30.66% MLPoisson::Fsmooth() 11992 4.197 4.308 4.503 8.14% Castro::reset_internal_energy() 257 2.984 3.081 3.212 5.80% MultiFab::AddProduct() 4648 2.663 2.692 2.721 4.92% FabArray::setVal() 9464 2.373 2.394 2.423 4.38% MLPoisson::Fapply() 2422 1.87 1.902 1.962 3.55% MLCellLinOp::applyBC() 14630 1.472 1.57 1.735 3.13% MultiFab::Subtract() 601 1.684 1.702 1.719 3.10% FabArray::ParallelCopy_nowait() 5320 1.399 1.411 1.436 2.59% FabArray::ParallelCopy_finish() 5320 0.5683 1.107 1.41 2.55% Castro::enforce_min_density() 254 1.04 1.111 1.237 2.23% Gravity::fill_multipole_BCs() 41 1.092 1.15 1.198 2.16% Castro::derive() 397 0.9385 0.946 0.9568 1.73% MultiFab::sum() 4648 0.8488 0.8595 0.8707 1.57% FluxRegister::Reflux() 180 0.8287 0.8393 0.8507 1.54% MultiFab::Xpay() 2190 0.746 0.7589 0.781 1.41% FillBoundary_finish() 13093 0.504 0.6062 0.7587 1.37% Castro::reflux() 10 0.6969 0.7058 0.7141 1.29% FillBoundary_nowait() 13093 0.643 0.6761 0.6955 1.26% Castro::construct_new_gravity_source() 50 0.6072 0.6163 0.6306 1.14% Castro::volWgtSum() 242 0.5409 0.5598 0.5775 1.04% CellConservativeLinear::interp() 130 0.3725 0.4647 0.5516 1.00% Castro::estTimeStep() 69 0.2431 0.4154 0.5416 0.98% MultiFab::min() 30 0.00764 0.2757 0.5363 0.97% Castro::normalize_species() 254 0.514 0.5255 0.5355 0.97% Castro::computeTemp() 257 0.4781 0.4851 0.493 0.89% MLPoisson::FFlux() 1044 0.3969 0.4001 0.403 0.73% Castro::finalize_advance() 30 0.3543 0.3619 0.3675 0.66% FillPatchSingleLevel 853 0.3275 0.3342 0.341 0.62% Gravity::get_new_grav_vector() 52 0.3323 0.337 0.3406 0.62% StateData::FillBoundary(geom) 63 0.3262 0.3299 0.333 0.60% MLMG::addInterpCorrection() 1421 0.275 0.2819 0.2975 0.54% amrex::average_down 1713 0.2738 0.2812 0.294 0.53% MultiFab::Saxpy() 100 0.275 0.2792 0.2837 0.51% FillPatchIterator::Initialize 723 0.2559 0.2706 0.2791 0.50% Castro::do_advance_ctu() 30 0.216 0.2184 0.2209 0.40% MLMG::oneIter() 333 0.2148 0.2164 0.2178 0.39% Castro::expand_state() 30 0.1913 0.1928 0.1943 0.35% MLCellLinOp::defineAuxData() 81 0.174 0.1793 0.1862 0.34% MLCellLinOp::reflux() 116 0.1745 0.1773 0.1797 0.32% MLCellLinOp::compGrad() 100 0.1757 0.178 0.1796 0.32% VisMF::Write(FabArray) 4 0.1663 0.1698 0.1773 0.32% Castro::post_timestep() 30 0.04545 0.1386 0.1758 0.32% Gravity::get_old_grav_vector() 30 0.1661 0.1679 0.1698 0.31% MultiFab::Multiply() 164 0.1468 0.1482 0.1498 0.27% FabArray::mult() 294 0.1454 0.1471 0.1492 0.27% Castro::construct_old_gravity_source() 30 0.1378 0.1414 0.1442 0.26% FabArray::setDomainBndry() 853 0.1347 0.1388 0.1433 0.26% Amr::writePlotFile() 2 0.1156 0.123 0.1311 0.24% MLMG::ResNormInf() 450 0.1005 0.109 0.121 0.22% Castro::initData() 3 0.05975 0.08693 0.1143 0.21% MultiFab::max() 40 0.01352 0.03787 0.1076 0.19% MultiFab::contains_nan() 60 0.09203 0.09349 0.09468 0.17% BndryData::define() 123 0.0883 0.08905 0.09054 0.16% Castro::construct_old_gravity() 30 0.08691 0.08815 0.08956 0.16% MLMG::prepareForSolve() 80 0.08042 0.08329 0.0854 0.15% MultiFab::LinComb() 628 0.06494 0.0698 0.08194 0.15% Castro::evaluate_source_change() 591 0.07908 0.07999 0.08123 0.15% Gravity::gravity_sync() 10 0.07201 0.07283 0.07443 0.13% Gravity::test_level_grad_phi_curr() 20 0.07094 0.07212 0.073 0.13% Castro::construct_new_gravity() 30 0.0537 0.0582 0.0682 0.12% MLCellLinOp::updateSolBC() 99 0.05792 0.05889 0.05977 0.11% MLCGSolver::bicgstab 83 0 0.01425 0.05698 0.10% Castro::volProductSum() 22 0.04621 0.05158 0.05572 0.10% Gravity::actual_solve_with_mlmg() 81 0.03854 0.04303 0.04792 0.09% MultiFab::norm0(mask) 57 0.04656 0.04723 0.04765 0.09% MLCellLinOp::updateCorBC() 78 0.04588 0.04663 0.0473 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04526 0.0458 0.04623 0.08% FabArrayBase::CPC::define() 2260 0.0282 0.0329 0.04494 0.08% FabArrayBase::getCPC() 8152 0.04174 0.04305 0.04397 0.08% Gravity::solve_for_phi() 60 0.02642 0.03381 0.04378 0.08% Castro::initialize_do_advance() 30 0.03431 0.03863 0.04337 0.08% MLCellLinOp::setLevelBC() 102 0.04065 0.04166 0.04209 0.08% Gravity::test_level_grad_phi_prev() 30 0.04077 0.04114 0.04152 0.08% AmrMesh::MakeNewGrids() 11 0.03679 0.03908 0.04108 0.07% MLMG::buildFineMask() 80 0.03949 0.03984 0.04023 0.07% MultiFab::Copy() 100 0.03914 0.03949 0.03996 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03655 0.03798 0.03921 0.07% FabArray::FillBoundary() 13093 0.03118 0.0327 0.0356 0.06% MLCellLinOp::smooth() 5996 0.02615 0.02736 0.02888 0.05% MLCellLinOp::prepareForSolve() 81 0.02479 0.02617 0.02872 0.05% Castro::initialize_advance() 30 0.02599 0.02686 0.02772 0.05% FabArrayBase::getFB() 13093 0.02305 0.02422 0.02687 0.05% Castro::init(old) 9 0.02605 0.02633 0.02653 0.05% Amr::defBaseLevel() 1 0.0208 0.02411 0.02616 0.05% MLCellLinOp::defineBC() 81 0.02423 0.02472 0.02515 0.05% Gravity::update_max_rhs() 20 0.02434 0.02454 0.02489 0.04% Castro::apply_tagging_restrictions() 11 0.02176 0.02343 0.02474 0.04% MLMG::interpCorrection_1 78 0.02292 0.02304 0.02315 0.04% Castro::finalize_do_advance() 30 0.00323 0.01669 0.02244 0.04% Amr::coarseTimeStep() 10 0.0009828 0.0169 0.02225 0.04% Castro::build_fine_mask() 153 0.01857 0.01892 0.01918 0.03% StateData::define() 48 0.01496 0.01697 0.01822 0.03% FillPatchTwoLevels 394 0.01666 0.01697 0.0176 0.03% FabArray::ParallelCopy() 5320 0.01426 0.01469 0.01526 0.03% StateDataPhysBCFunct::() 853 0.009828 0.01167 0.01445 0.03% Castro::swap_state_time_levels() 30 0.01337 0.01364 0.01417 0.03% Castro::post_init() 2 0.000525 0.007691 0.01346 0.02% Gravity::actual_multilevel_solve() 10 0.01209 0.01238 0.01269 0.02% MLMG::MLRhsNormInf() 80 0.01177 0.01207 0.01257 0.02% MultiFab::Dot() 463 0 0.002881 0.01153 0.02% MLMG::solve() 80 0.004488 0.007647 0.01126 0.02% Amr::regrid() 10 0.009845 0.01026 0.01105 0.02% Gravity::GetCrsePhi() 40 0.009624 0.009785 0.009957 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008487 0.008985 0.009504 0.02% MLCellLinOp::apply() 2422 0.00575 0.006812 0.009483 0.02% MLLinOp::makeSubCommunicator() 81 0.002383 0.00574 0.008571 0.02% Castro::apply_problem_tags() 11 0.007844 0.008123 0.008376 0.02% MLCGSolver::ParallelAllReduce 692 0 0.001943 0.007774 0.01% MLLinOp::defineGrids() 81 0.00706 0.007405 0.007593 0.01% Castro::FluxRegFineAdd() 30 0.007178 0.007268 0.007372 0.01% Castro::enforce_consistent_e() 3 0.003437 0.004873 0.006752 0.01% MLCellLinOp::correctionResidual() 1660 0.004755 0.005092 0.005947 0.01% AMRErrorTag::operator() 11 0.004849 0.005162 0.005429 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005106 0.005186 0.005226 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.00493 0.005015 0.005117 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004952 0.005019 0.005104 0.01% CGSolver::sxay() 588 0 0.00125 0.005001 0.01% Castro::do_new_sources() 50 0.000882 0.001972 0.004828 0.01% MLMG::mgVcycle() 489 0.004149 0.00423 0.004393 0.01% Gravity::test_composite_phi() 1 0.003965 0.004115 0.004268 0.01% MLMG:computeResOfCorrection() 1421 0.003381 0.003515 0.003735 0.01% MLMG::actualBottomSolve() 333 0.0003931 0.001162 0.00343 0.01% FillPatchInterp(Fab) 130 0.00174 0.002138 0.002977 0.01% main() 1 0.002823 0.002876 0.002912 0.01% Castro::do_old_sources() 30 0.0005047 0.001128 0.002816 0.01% FabArrayBase::FB::FB() 131 0.0008674 0.001291 0.002507 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0002832 0.001314 0.002433 0.00% MLMG::mgVcycle_down::0 333 0.002256 0.002318 0.002363 0.00% Amr::InitAmr() 1 0.002296 0.002308 0.002315 0.00% MLMG::mgVcycle_down::1 333 0.002069 0.002133 0.002221 0.00% MLMG::mgVcycle_down::2 333 0.001889 0.001962 0.002047 0.00% MLCellLinOp::solutionResidual() 530 0.001974 0.001997 0.002013 0.00% Gravity::solve_phi_with_mlmg() 71 0.001672 0.001741 0.001862 0.00% MLMG::MLResNormInf() 97 0.001054 0.001535 0.001852 0.00% Castro::clean_state() 254 0.001618 0.001692 0.001733 0.00% TagBoxArray::collate() 11 0.00134 0.001538 0.001718 0.00% Castro::subcycle_advance_ctu() 30 0.0002042 0.00058 0.001698 0.00% OwnerMask() 11 0.001463 0.001563 0.001673 0.00% MLMG::mgVcycle_up::0 333 0.001555 0.001609 0.001654 0.00% MLMG::mgVcycle_up::2 333 0.001339 0.001392 0.001491 0.00% MLMG::mgVcycle_up::1 333 0.001351 0.001408 0.001482 0.00% MLMG::mgVcycle_bottom 489 0.001302 0.001325 0.00137 0.00% MLMG::mgVcycle_down::3 211 0.001151 0.001217 0.001322 0.00% makeSFC 243 0.001104 0.001204 0.001299 0.00% MLMG::mgVcycle_down::4 211 0.001089 0.001161 0.001281 0.00% MLMG::mgVcycle_up::4 211 0.0007708 0.0008221 0.0009326 0.00% TagBoxArray::mapPRD 11 0.000829 0.0008921 0.0009234 0.00% Amr::bldFineLevels() 1 0.0007624 0.0008345 0.0009114 0.00% MLMG::mgVcycle_up::3 211 0.0007441 0.0007869 0.0009063 0.00% MLMG::computeResidual() 333 0.0008514 0.0008711 0.0008947 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007852 0.0008105 0.0008277 0.00% MLPoisson::define() 81 0.0006247 0.0006668 0.0006897 0.00% Castro::construct_new_source() 250 0.0006021 0.0006235 0.0006402 0.00% Amr::grid_places() 11 0.0005196 0.0005696 0.0006282 0.00% Amr::timeStep() 30 0.0004779 0.0005212 0.0006115 0.00% FabArrayBase::TheFPinfo() 130 0.0005193 0.0005378 0.0005488 0.00% DistributionMapping::Distribute() 245 0.0004988 0.0005216 0.0005375 0.00% Castro::enforce_speed_limit() 254 0.0004083 0.0004259 0.0004565 0.00% Castro::apply_source_to_state() 100 0.0003573 0.0003913 0.0004555 0.00% Castro::computeNewDt() 18 0.0001257 0.0001984 0.0004069 0.00% MLPoisson::prepareForSolve() 81 0.0003558 0.0003632 0.0003697 0.00% Castro::construct_old_source() 150 0.0003029 0.000314 0.0003346 0.00% MLMG::computeMLResidual() 97 0.0003154 0.0003235 0.0003309 0.00% MLLinOp::define() 81 0.0002942 0.0003045 0.0003273 0.00% Castro::post_regrid() 22 0.0002522 0.0002654 0.000291 0.00% MLMG::getGradSolution() 80 0.000279 0.0002829 0.0002889 0.00% MLMG::miniCycle() 156 0.0002801 0.000282 0.0002841 0.00% AmrLevel::AmrLevel(dm) 12 0.0002559 0.0002607 0.0002707 0.00% Castro::advance() 30 0.0002184 0.0002244 0.0002331 0.00% ClusterList::intersect() 2 0 5.592e-05 0.0002237 0.00% Gravity::swapTimeLevels() 30 0.0001887 0.0002001 0.0002115 0.00% FabArray::RecvLayoutMask() 21 0.0002003 0.0002012 0.0002029 0.00% Castro::check_for_nan() 60 0.0001787 0.0001898 0.0001991 0.00% Castro::errorEst() 11 0.0001255 0.0001292 0.0001316 0.00% Castro::avgDown(state_indx) 44 0.000118 0.00012 0.0001232 0.00% FPinfo::FPinfo() 3 0.0001061 0.0001134 0.00012 0.00% Amr::FinalizeInit() 1 2.15e-05 4.731e-05 0.0001169 0.00% Castro::create_source_corrector() 30 8.474e-05 9.453e-05 0.0001101 0.00% Gravity::solve_for_delta_phi 10 8.504e-05 9.286e-05 9.803e-05 0.00% amrex::average_down_w_geom 44 8.5e-05 9.067e-05 9.547e-05 0.00% AmrMesh-cluster 2 0 2.277e-05 9.108e-05 0.00% Amr::writeSmallPlotFile() 1 7.426e-05 7.695e-05 8.403e-05 0.00% Castro::retry_advance_ctu() 30 4.922e-05 6.341e-05 8.057e-05 0.00% knapsack() 3 6.17e-05 6.399e-05 6.67e-05 0.00% Castro::avgDown() 11 5.607e-05 6.097e-05 6.596e-05 0.00% Castro::gwstrain() 22 3.751e-05 4.474e-05 6.01e-05 0.00% Amr::initSubcycle() 1 3.5e-05 4.871e-05 5.919e-05 0.00% Gravity::set_mass_offset() 11 2.996e-05 3.679e-05 5.249e-05 0.00% BoxList::parallelComplementIn() 22 4.146e-05 4.292e-05 4.408e-05 0.00% BoxList::complementIn 22 3.921e-05 4.017e-05 4.104e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.152e-05 3.376e-05 3.688e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.852e-05 3.055e-05 3.264e-05 0.00% ClusterList::chop() 2 0 5.434e-06 2.174e-05 0.00% Castro::computeInitialDt() 2 1.118e-05 1.271e-05 1.415e-05 0.00% MLMG::compResidual() 1 1.28e-05 1.31e-05 1.332e-05 0.00% Amr::InitializeInit() 1 5.128e-06 7.947e-06 1.171e-05 0.00% Amr::init() 1 6.012e-06 7.024e-06 7.805e-06 0.00% knapsack()swap 2 4.926e-06 5.224e-06 5.715e-06 0.00% Amr::initialInit() 1 3.615e-06 4.593e-06 5.27e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 55.35 55.35 55.35 100.00% Amr::coarseTimeStep() 10 52.4 52.4 52.4 94.67% Amr::timeStep() 30 52.19 52.23 52.32 94.53% Castro::advance() 30 36.71 36.71 36.71 66.31% Castro::subcycle_advance_ctu() 30 34.9 34.91 34.93 63.11% Castro::do_advance_ctu() 30 34.9 34.91 34.93 63.11% Castro::construct_ctu_hydro_source() 30 16.49 16.72 16.97 30.66% Gravity::actual_solve_with_mlmg() 81 13.49 13.49 13.5 24.39% MLMG::solve() 80 12.76 12.76 12.77 23.07% Castro::post_timestep() 30 12.29 12.33 12.42 22.44% Castro::clean_state() 254 10.54 10.75 10.98 19.84% MLMG::oneIter() 333 10.71 10.72 10.72 19.37% Gravity::solve_phi_with_mlmg() 71 10.13 10.2 10.26 18.53% Castro::reflux() 10 9.748 9.779 9.819 17.74% MLMG::mgVcycle() 489 9.378 9.39 9.402 16.99% Gravity::solve_for_phi() 60 8.434 8.494 8.547 15.44% MLCellLinOp::smooth() 5996 6.405 6.518 6.811 12.30% Castro::computeTemp() 257 6.289 6.416 6.551 11.83% Castro::reset_internal_energy() 257 5.81 5.931 6.067 10.96% Castro::construct_new_gravity() 30 5.149 5.165 5.171 9.34% Gravity::gravity_sync() 10 5.145 5.145 5.145 9.29% Castro::construct_old_gravity() 30 4.775 4.821 4.851 8.76% Castro::evaluate_source_change() 591 4.528 4.582 4.635 8.37% MLPoisson::Fsmooth() 11992 4.197 4.308 4.503 8.14% Gravity::solve_for_delta_phi 10 4.308 4.309 4.309 7.79% Castro::enforce_min_density() 254 3.821 3.935 4.062 7.34% MLMG::mgVcycle_down::0 333 3.971 3.987 4.001 7.23% FillPatchIterator::Initialize 723 3.352 3.368 3.394 6.13% Castro::do_new_sources() 50 3.224 3.292 3.366 6.08% Amr::regrid() 10 3.237 3.291 3.333 6.02% Castro::post_regrid() 22 3.028 3.101 3.15 5.69% MLMG::mgVcycle_up::0 333 2.754 2.95 3.023 5.46% MLCellLinOp::applyBC() 14630 2.791 2.886 2.998 5.42% FabArray::ParallelCopy() 5320 2.077 2.585 2.884 5.21% MultiFab::AddProduct() 4648 2.663 2.692 2.721 4.92% MLCellLinOp::apply() 2422 2.506 2.539 2.621 4.73% Castro::initialize_do_advance() 30 2.516 2.534 2.567 4.64% FabArray::setVal() 9464 2.373 2.394 2.423 4.38% Amr::init() 1 2.391 2.391 2.391 4.32% FillPatchSingleLevel 853 2.28 2.295 2.322 4.19% MLPoisson::Fapply() 2422 1.87 1.902 1.962 3.55% MLCellLinOp::solutionResidual() 530 1.779 1.784 1.789 3.23% Amr::initialInit() 1 1.784 1.784 1.784 3.22% MLCellLinOp::correctionResidual() 1660 1.642 1.673 1.752 3.16% MultiFab::Subtract() 601 1.684 1.702 1.719 3.10% Gravity::multilevel_solve_for_new_phi() 10 1.71 1.71 1.71 3.09% Gravity::actual_multilevel_solve() 10 1.701 1.701 1.702 3.07% Castro::derive() 397 1.651 1.664 1.682 3.04% MLMG:computeResOfCorrection() 1421 1.495 1.524 1.595 2.88% Castro::do_old_sources() 30 1.501 1.519 1.544 2.79% FabArray::ParallelCopy_nowait() 5320 1.448 1.463 1.494 2.70% FabArray::FillBoundary() 13093 1.256 1.34 1.457 2.63% Castro::volWgtSum() 242 1.354 1.383 1.412 2.55% FabArray::ParallelCopy_finish() 5320 0.5683 1.107 1.41 2.55% Amr::FinalizeInit() 1 1.331 1.352 1.405 2.54% Castro::initialize_advance() 30 1.378 1.392 1.405 2.54% Gravity::fill_multipole_BCs() 41 1.131 1.188 1.236 2.23% FillPatchTwoLevels 394 1.172 1.199 1.217 2.20% Castro::expand_state() 30 1.189 1.193 1.197 2.16% Amr::writePlotFile() 2 1.162 1.162 1.162 2.10% FluxRegister::Reflux() 180 1.148 1.152 1.155 2.09% Castro::post_init() 2 0.947 0.9713 1.041 1.88% MLMG::addInterpCorrection() 1421 0.3291 0.849 1.031 1.86% Gravity::get_new_grav_vector() 52 1.01 1.016 1.023 1.85% MLMG::computeResWithCrseSolFineCor() 78 0.9548 0.9554 0.9559 1.73% MLMG::computeResidual() 333 0.9237 0.9281 0.9331 1.69% MultiFab::sum() 4648 0.8488 0.8595 0.8707 1.57% MLMG::mgVcycle_down::1 333 0.6971 0.7318 0.7944 1.44% MultiFab::Xpay() 2190 0.746 0.7589 0.781 1.41% FillBoundary_finish() 13093 0.504 0.6062 0.7587 1.37% FillBoundary_nowait() 13093 0.6669 0.7016 0.7199 1.30% MLCellLinOp::reflux() 116 0.6741 0.6758 0.6773 1.22% MLMG::mgVcycle_up::2 333 0.2156 0.5461 0.6618 1.20% MLMG::computeMLResidual() 97 0.6057 0.6226 0.6354 1.15% Castro::construct_new_source() 250 0.6079 0.6169 0.6312 1.14% Castro::construct_new_gravity_source() 50 0.6072 0.6163 0.6306 1.14% FillPatchInterp(Fab) 130 0.3754 0.4668 0.5534 1.00% CellConservativeLinear::interp() 130 0.3725 0.4647 0.5516 1.00% Gravity::get_old_grav_vector() 30 0.5398 0.5425 0.5471 0.99% MLMG::mgVcycle_up::1 333 0.4769 0.496 0.5456 0.99% Castro::estTimeStep() 69 0.2431 0.4154 0.5416 0.98% MultiFab::min() 30 0.00764 0.2757 0.5363 0.97% Castro::normalize_species() 254 0.514 0.5255 0.5355 0.97% Amr::InitializeInit() 1 0.3786 0.4323 0.4526 0.82% Amr::defBaseLevel() 1 0.3786 0.4323 0.4526 0.82% Castro::initData() 3 0.3317 0.3981 0.4308 0.78% Castro::finalize_advance() 30 0.394 0.401 0.4156 0.75% MLPoisson::FFlux() 1044 0.3969 0.4001 0.403 0.73% MLPoisson::define() 81 0.3766 0.3847 0.3961 0.72% StateDataPhysBCFunct::() 853 0.3364 0.3416 0.3474 0.63% amrex::average_down 1713 0.298 0.3101 0.3355 0.61% StateData::FillBoundary(geom) 63 0.3262 0.3299 0.333 0.60% MLMG::prepareForSolve() 80 0.3107 0.3197 0.3316 0.60% MLMG::mgVcycle_bottom 489 0.1639 0.204 0.3235 0.58% Castro::computeNewDt() 18 0.1357 0.2426 0.288 0.52% Castro::apply_source_to_state() 100 0.2753 0.2796 0.2842 0.51% MultiFab::Saxpy() 100 0.275 0.2792 0.2837 0.51% MLMG::mgVcycle_down::2 333 0.2531 0.2621 0.2834 0.51% Amr::bldFineLevels() 1 0.1733 0.2234 0.2407 0.43% MLCellLinOp::defineAuxData() 81 0.2156 0.2245 0.2397 0.43% MLMG::getGradSolution() 80 0.2263 0.2278 0.2293 0.41% MLCellLinOp::compGrad() 100 0.226 0.2275 0.2291 0.41% MLMG::mgVcycle_down::3 211 0.03366 0.07582 0.1975 0.36% VisMF::Write(FabArray) 4 0.1663 0.1698 0.1773 0.32% MLMG::miniCycle() 156 0.1635 0.1637 0.1639 0.30% MLMG::actualBottomSolve() 333 0.0003931 0.04021 0.1596 0.29% Castro::init(old) 9 0.1526 0.1536 0.1549 0.28% MLCGSolver::bicgstab 83 0 0.03835 0.1534 0.28% MLMG::ResNormInf() 450 0.1314 0.1398 0.1514 0.27% MultiFab::Multiply() 164 0.1468 0.1482 0.1498 0.27% FabArray::mult() 294 0.1454 0.1471 0.1492 0.27% MLCellLinOp::defineBC() 81 0.1417 0.1436 0.1457 0.26% Castro::construct_old_source() 150 0.1381 0.1417 0.1445 0.26% Castro::construct_old_gravity_source() 30 0.1378 0.1414 0.1442 0.26% FabArray::setDomainBndry() 853 0.1347 0.1388 0.1433 0.26% Gravity::update_max_rhs() 20 0.04842 0.07299 0.1428 0.26% MLMG::mgVcycle_up::3 211 0.02542 0.05488 0.1399 0.25% Amr::grid_places() 11 0.1275 0.1284 0.1306 0.24% AmrMesh::MakeNewGrids() 11 0.127 0.1278 0.13 0.23% Castro::volProductSum() 22 0.1192 0.1246 0.1296 0.23% BndryData::define() 123 0.1162 0.1176 0.1196 0.22% Gravity::GetCrsePhi() 40 0.09214 0.1004 0.1083 0.20% MultiFab::max() 40 0.01352 0.03787 0.1076 0.19% MLMG::computeResWithCrseCorFineCor() 78 0.1067 0.1071 0.1073 0.19% MLCellLinOp::updateSolBC() 99 0.08744 0.09438 0.1019 0.18% Castro::check_for_nan() 60 0.09221 0.09368 0.09488 0.17% MultiFab::contains_nan() 60 0.09203 0.09349 0.09468 0.17% Castro::computeInitialDt() 2 0.02042 0.04079 0.09446 0.17% FabArrayBase::getCPC() 8152 0.06994 0.07595 0.08876 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08246 0.08338 0.08381 0.15% Gravity::test_level_grad_phi_curr() 20 0.08053 0.08183 0.08284 0.15% MultiFab::LinComb() 628 0.06494 0.0698 0.08194 0.15% MLMG::mgVcycle_down::4 211 0.03239 0.04436 0.07549 0.14% Castro::errorEst() 11 0.06128 0.06436 0.06698 0.12% MLCellLinOp::updateCorBC() 78 0.06506 0.06548 0.066 0.12% MLCellLinOp::setLevelBC() 102 0.05151 0.0597 0.0637 0.12% Gravity::test_composite_phi() 1 0.06128 0.0613 0.06133 0.11% MLMG::mgVcycle_up::4 211 0.02549 0.03446 0.05811 0.10% MLMG::buildFineMask() 80 0.04924 0.04961 0.05029 0.09% MultiFab::norm0(mask) 57 0.04656 0.04723 0.04765 0.09% Gravity::test_level_grad_phi_prev() 30 0.04636 0.04681 0.04725 0.09% FabArrayBase::CPC::define() 2260 0.0282 0.0329 0.04494 0.08% MLMG::MLResNormInf() 97 0.04418 0.0445 0.04491 0.08% MLMG::interpCorrection_1 78 0.03438 0.03993 0.04333 0.08% MultiFab::Copy() 100 0.03914 0.03949 0.03996 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03655 0.03798 0.03921 0.07% FabArrayBase::getFB() 13093 0.02392 0.02551 0.02938 0.05% MLPoisson::prepareForSolve() 81 0.02516 0.02653 0.02907 0.05% MLMG::MLRhsNormInf() 80 0.02799 0.02853 0.02901 0.05% MLCellLinOp::prepareForSolve() 81 0.02479 0.02617 0.02872 0.05% Castro::apply_tagging_restrictions() 11 0.02176 0.02343 0.02474 0.04% Gravity::swapTimeLevels() 30 0.02283 0.02344 0.02396 0.04% Castro::finalize_do_advance() 30 0.00323 0.01669 0.02244 0.04% TagBoxArray::mapPRD 11 0.01136 0.01627 0.02149 0.04% CGSolver::sxay() 588 0 0.004998 0.01999 0.04% Castro::build_fine_mask() 153 0.01857 0.01892 0.01918 0.03% MLLinOp::define() 81 0.01212 0.01598 0.01907 0.03% MLLinOp::defineGrids() 81 0.01182 0.01567 0.01878 0.03% AmrLevel::AmrLevel(dm) 12 0.01522 0.01723 0.01848 0.03% StateData::define() 48 0.01496 0.01697 0.01822 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01429 0.01484 0.01551 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003773 0.01509 0.03% Castro::avgDown() 11 0.01421 0.01449 0.01464 0.03% MLMG::compResidual() 1 0.01399 0.01429 0.01463 0.03% Castro::avgDown(state_indx) 44 0.01415 0.01443 0.01458 0.03% amrex::average_down_w_geom 44 0.01403 0.01431 0.01446 0.03% Castro::swap_state_time_levels() 30 0.01337 0.01364 0.01417 0.03% MultiFab::Dot() 463 0 0.002881 0.01153 0.02% MLLinOp::makeSubCommunicator() 81 0.002383 0.00574 0.008571 0.02% Castro::apply_problem_tags() 11 0.007844 0.008123 0.008376 0.02% Castro::FluxRegFineAdd() 30 0.007178 0.007268 0.007372 0.01% Castro::enforce_consistent_e() 3 0.003437 0.004873 0.006752 0.01% AMRErrorTag::operator() 11 0.004849 0.005162 0.005429 0.01% FabArrayBase::TheFPinfo() 130 0.00093 0.001987 0.003155 0.01% MLLinOp::makeAgglomeratedDMap 81 0.00238 0.002526 0.002654 0.00% FPinfo::FPinfo() 3 0.0004107 0.001449 0.002617 0.00% FabArrayBase::FB::FB() 131 0.0008674 0.001291 0.002507 0.00% DistributionMapping::KnapSackDoIt() 3 0.0003019 0.001336 0.002498 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0002832 0.001314 0.002433 0.00% Amr::InitAmr() 1 0.002338 0.002357 0.002374 0.00% makeSFC 243 0.001594 0.001716 0.001826 0.00% TagBoxArray::collate() 11 0.00134 0.001538 0.001718 0.00% OwnerMask() 11 0.001463 0.001563 0.001673 0.00% DistributionMapping::Distribute() 245 0.0004988 0.0005216 0.0005375 0.00% Castro::enforce_speed_limit() 254 0.0004083 0.0004259 0.0004565 0.00% AmrMesh-cluster 2 0 8.412e-05 0.0003365 0.00% ClusterList::intersect() 2 0 5.592e-05 0.0002237 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.05e-05 0.0001217 0.0002043 0.00% FabArray::RecvLayoutMask() 21 0.0002003 0.0002012 0.0002029 0.00% Castro::create_source_corrector() 30 8.474e-05 9.453e-05 0.0001101 0.00% BoxList::parallelComplementIn() 22 8.066e-05 8.308e-05 8.471e-05 0.00% Amr::writeSmallPlotFile() 1 7.426e-05 7.695e-05 8.403e-05 0.00% Castro::retry_advance_ctu() 30 4.922e-05 6.341e-05 8.057e-05 0.00% knapsack() 3 6.663e-05 6.921e-05 7.241e-05 0.00% Castro::gwstrain() 22 3.751e-05 4.474e-05 6.01e-05 0.00% Amr::initSubcycle() 1 3.5e-05 4.871e-05 5.919e-05 0.00% Gravity::set_mass_offset() 11 2.996e-05 3.679e-05 5.249e-05 0.00% BoxList::complementIn 22 3.921e-05 4.017e-05 4.104e-05 0.00% ClusterList::chop() 2 0 5.434e-06 2.174e-05 0.00% knapsack()swap 2 4.926e-06 5.224e-06 5.715e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.02-10-g76d08651adb9) finalized