MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.02-16-g3199edf61525) initialized Starting run at 06:34:18 UTC on 2022-03-01. Successfully read inputs file ... Castro git describe: 22.02-4-g0d942c92d AMReX git describe: 22.02-16-g3199edf61 Microphysics git describe: 22.02-12-ga47a5a10 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.012315191 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.012202293 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.032423271 Gravity::fill_multipole_BCs() time = 0.0293293 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.595025663 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034613701 Gravity::solve_for_phi() time = 0.405775977 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -6.931137899e+22 ymom added: -4.911261142e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.141288387 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.469742395 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028272742 Gravity::solve_for_phi() time = 0.338132642 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.154155781 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08358830281 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008298368 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.00939513 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107313763 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043948168 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010176278 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01623434287 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009574153 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009201246 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106503609 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043931974 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010227511 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01484961936 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028736851 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010216028 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.149094803 Castro::reflux() at level 0 : time = 1.013948609 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.930381445 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009864376 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02952215 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02970562 Gravity::solve_for_phi() time = 0.378027919 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852874e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.129099907 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.428276913 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024653042 Gravity::solve_for_phi() time = 0.326545497 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.14651724 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08731831213 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009373061 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.008954059 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105698997 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042494501 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.009894864 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01652408405 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009934897 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.008900032 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105743727 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042729551 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.009899273 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01514802031 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028638169 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010031042 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809894e+28 ymom added: 8.089770256e+28 zmom added: 8.082913463e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.14371414 Castro::reflux() at level 0 : time = 0.979892995 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.145668711 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009686198 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028588452 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029600949 Gravity::solve_for_phi() time = 0.377478084 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939027e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.128792841 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.480156621 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02723227 Gravity::solve_for_phi() time = 0.339151724 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.152195105 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08515049443 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00854134 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009227092 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106104191 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045341578 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010136153 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0162782985 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008642979 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.00923253 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106658082 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044976382 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010216695 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0147562898 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029376183 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.00986468 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655087e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342331e+27 ymom added: 5.311566494e+28 zmom added: 5.312402179e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.144700006 Castro::reflux() at level 0 : time = 0.994934591 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.147718263 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.00985428 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028344049 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028645284 Gravity::solve_for_phi() time = 0.37616994 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.05970067e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.129478993 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.428906196 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024666849 Gravity::solve_for_phi() time = 0.345293155 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.149253884 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08666880855 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008376478 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.008955198 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106203217 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044456906 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.0101446 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01636467698 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008167188 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009348381 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109323885 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04499388 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010034146 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01475720258 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028437233 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.009967264 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.44439047e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.14491553 Castro::reflux() at level 0 : time = 0.928077879 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.021807412 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.0096586 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028664561 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028285273 Gravity::solve_for_phi() time = 0.376190957 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150489e+30 ymom added: 3.39980379e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.130309371 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.427493213 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024765969 Gravity::solve_for_phi() time = 0.32680817 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591233e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.144630441 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08732176217 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008288873 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.00892328 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106047945 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042617368 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.009845768 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01662013185 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008243636 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.008925791 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106047186 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044338457 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.009827767 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01513142136 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028803878 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.009834862 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277777e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.147974353 Castro::reflux() at level 0 : time = 0.928523049 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 4.9934181 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009803163 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029293724 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029105194 Gravity::solve_for_phi() time = 0.377242782 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919311e+30 ymom added: 4.094511425e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.129156024 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.436845294 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024827538 Gravity::solve_for_phi() time = 0.32587722 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245021e+27 ymom added: -5.297264713e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.145561179 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0870460524 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008456161 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009046036 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106112781 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042552741 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.009933817 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0165628369 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008460163 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009124635 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106250582 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042552805 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.009941677 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01512118374 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028634875 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.009876285 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.144479599 Castro::reflux() at level 0 : time = 0.926323453 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 4.997962758 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009530445 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028521699 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028502136 Gravity::solve_for_phi() time = 0.376255068 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151121e+30 ymom added: 4.515688034e+30 zmom added: 4.515609113e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.129453273 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.429981389 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024533388 Gravity::solve_for_phi() time = 0.328828428 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.881752621e+28 zmom added: -2.881735257e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.147636542 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08713514084 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008448034 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.008940805 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105996788 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042450554 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.01003731 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0165888326 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008382217 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009086319 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105642103 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042559606 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.009878399 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01517626033 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028361298 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.009833586 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.144093145 Castro::reflux() at level 0 : time = 0.922669732 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.061732462 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009705112 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028504177 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024776064 Gravity::solve_for_phi() time = 0.372790315 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064076e+30 ymom added: 4.889542903e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.130120455 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.428284292 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024588206 Gravity::solve_for_phi() time = 0.372622335 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.144547984 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08600379555 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008009643 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009046778 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105994547 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042944882 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.009950689 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01659970668 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008374916 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.008913081 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105927051 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042552687 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.009914376 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01522652806 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028476835 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.009863886 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907372e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.144928269 Castro::reflux() at level 0 : time = 0.930264666 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.13798634 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009687451 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028738164 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034009653 Gravity::solve_for_phi() time = 0.389987765 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036351e+30 ymom added: 5.53045164e+30 zmom added: 5.530356437e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.132936925 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.471291333 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027663218 Gravity::solve_for_phi() time = 0.383257581 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170339e+28 zmom added: -5.061201609e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.146973721 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08381018597 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008569681 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.008982452 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106063086 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042659305 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.009843416 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01657968538 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008214284 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009015874 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105950053 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042569642 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.009799305 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01523384591 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028645741 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.009807383 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.144925117 Castro::reflux() at level 0 : time = 0.924161928 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.179553088 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009648102 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028433444 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028080756 Gravity::solve_for_phi() time = 0.376408745 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167165e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.130424518 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.426860955 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024460757 Gravity::solve_for_phi() time = 0.371708657 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.146081469 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08610838662 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008376887 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009013384 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106449849 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048386149 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.009838545 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01619028025 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008359026 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009018799 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10617061 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.050095391 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.009815045 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01469521739 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028747904 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.009851851 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914881e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.144584666 Castro::reflux() at level 0 : time = 0.981988343 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.171022989 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.541481112 seconds Ending run at 06:35:12 UTC on 2022-03-01. Run time = 53.60482611 Run time without initialization = 51.33188478 Average number of zones advanced per microsecond: 0.053 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 53.6 ... 53.6 ... 53.6 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.2652 16.4115 16.5467 30.87% MLPoisson::Fsmooth() 11992 4.119 4.191 4.356 8.13% Castro::reset_internal_energy() 257 2.91 2.961 3.037 5.67% MultiFab::AddProduct() 4648 2.622 2.635 2.648 4.94% FabArray::setVal() 9464 2.321 2.336 2.347 4.38% MLPoisson::Fapply() 2422 1.842 1.936 2.012 3.75% MultiFab::Subtract() 601 1.651 1.665 1.676 3.13% MLCellLinOp::applyBC() 14630 1.464 1.518 1.668 3.11% FabArray::ParallelCopy_nowait() 5320 1.35 1.373 1.394 2.60% FabArray::ParallelCopy_finish() 5320 0.521 1.008 1.237 2.31% Castro::enforce_min_density() 254 1.027 1.06 1.133 2.11% Gravity::fill_multipole_BCs() 41 1.061 1.09 1.112 2.07% Castro::derive() 397 0.9149 0.923 0.9283 1.73% MultiFab::sum() 4648 0.8357 0.8401 0.844 1.57% FluxRegister::Reflux() 180 0.8149 0.818 0.8212 1.53% MultiFab::Xpay() 2190 0.7359 0.7436 0.7582 1.41% Castro::reflux() 10 0.6878 0.6925 0.6985 1.30% FillBoundary_nowait() 13093 0.6247 0.6388 0.6495 1.21% FillBoundary_finish() 13093 0.4654 0.5596 0.6116 1.14% Castro::construct_new_gravity_source() 50 0.5968 0.6035 0.6085 1.14% CellConservativeLinear::interp() 130 0.3695 0.4573 0.5467 1.02% Castro::volWgtSum() 242 0.5303 0.5359 0.5457 1.02% Castro::normalize_species() 254 0.5073 0.5129 0.5159 0.96% Castro::computeTemp() 257 0.4686 0.4722 0.4758 0.89% MLPoisson::FFlux() 1044 0.3922 0.3925 0.3927 0.73% Castro::finalize_advance() 30 0.3534 0.3584 0.3623 0.68% Gravity::get_new_grav_vector() 52 0.3248 0.3272 0.3292 0.61% FillPatchSingleLevel 853 0.3237 0.3263 0.3291 0.61% StateData::FillBoundary(geom) 63 0.3213 0.3228 0.3241 0.60% MultiFab::min() 30 0.006898 0.1581 0.3216 0.60% MLMG::addInterpCorrection() 1421 0.2695 0.2749 0.2876 0.54% amrex::average_down 1713 0.2708 0.2752 0.2857 0.53% Castro::estTimeStep() 69 0.2351 0.2602 0.285 0.53% MultiFab::Saxpy() 100 0.2701 0.2715 0.2731 0.51% FillPatchIterator::Initialize 723 0.265 0.2676 0.2694 0.50% Castro::do_advance_ctu() 30 0.213 0.2137 0.2142 0.40% MLMG::oneIter() 333 0.21 0.2111 0.2121 0.40% Castro::expand_state() 30 0.1881 0.1884 0.1889 0.35% MLCellLinOp::defineAuxData() 81 0.1693 0.1728 0.1801 0.34% VisMF::Write(FabArray) 4 0.1597 0.166 0.1768 0.33% MLCellLinOp::compGrad() 100 0.1718 0.1727 0.1736 0.32% MLCellLinOp::reflux() 116 0.1715 0.1724 0.1734 0.32% Gravity::get_old_grav_vector() 30 0.1623 0.1631 0.1635 0.31% FabArray::mult() 294 0.1434 0.1447 0.1458 0.27% MultiFab::Multiply() 164 0.1447 0.1451 0.1455 0.27% MLMG::ResNormInf() 450 0.09198 0.118 0.1413 0.26% Castro::construct_old_gravity_source() 30 0.1362 0.1366 0.1372 0.26% FabArray::setDomainBndry() 853 0.1321 0.1335 0.1364 0.25% Amr::writePlotFile() 2 0.1132 0.124 0.1353 0.25% Castro::post_timestep() 30 0.08024 0.1001 0.1154 0.22% MultiFab::contains_nan() 60 0.09106 0.09163 0.09193 0.17% BndryData::define() 123 0.08579 0.08726 0.08903 0.17% Castro::construct_old_gravity() 30 0.08503 0.08575 0.08739 0.16% MLMG::prepareForSolve() 80 0.07919 0.08035 0.08195 0.15% MultiFab::LinComb() 628 0.06462 0.07205 0.08014 0.15% Castro::evaluate_source_change() 591 0.07565 0.07688 0.07762 0.14% Gravity::test_level_grad_phi_curr() 20 0.07063 0.07123 0.07197 0.13% Gravity::gravity_sync() 10 0.07031 0.07065 0.07082 0.13% Castro::initData() 3 0.05901 0.05957 0.06012 0.11% MLCellLinOp::updateSolBC() 99 0.05684 0.05733 0.0577 0.11% MLCGSolver::bicgstab 83 0 0.01373 0.05491 0.10% Castro::construct_new_gravity() 30 0.05264 0.05305 0.05322 0.10% Castro::volProductSum() 22 0.05009 0.05098 0.05145 0.10% MLCellLinOp::updateCorBC() 78 0.04491 0.04547 0.04606 0.09% MultiFab::norm0(mask) 57 0.04586 0.0459 0.04595 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04438 0.04469 0.04495 0.08% Gravity::actual_solve_with_mlmg() 81 0.03667 0.04089 0.04365 0.08% Castro::initialize_do_advance() 30 0.03309 0.0377 0.04338 0.08% FabArrayBase::CPC::define() 2260 0.02764 0.03192 0.04323 0.08% Gravity::solve_for_phi() 60 0.02615 0.03064 0.04286 0.08% FabArrayBase::getCPC() 8152 0.04093 0.04143 0.042 0.08% MultiFab::max() 40 0.01228 0.02146 0.04175 0.08% Gravity::test_level_grad_phi_prev() 30 0.04008 0.04046 0.04087 0.08% MLCellLinOp::setLevelBC() 102 0.04002 0.04037 0.04072 0.08% MLMG::buildFineMask() 80 0.03881 0.03891 0.03903 0.07% MultiFab::Copy() 100 0.03847 0.03862 0.03882 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03572 0.03641 0.03735 0.07% AmrMesh::MakeNewGrids() 11 0.03548 0.03579 0.03619 0.07% FabArray::FillBoundary() 13093 0.03057 0.03165 0.03407 0.06% Castro::post_init() 2 0.001138 0.01629 0.03107 0.06% MLCellLinOp::smooth() 5996 0.02566 0.02644 0.02807 0.05% MLCellLinOp::prepareForSolve() 81 0.02448 0.02548 0.02797 0.05% Castro::initialize_advance() 30 0.02554 0.02589 0.02631 0.05% Castro::init(old) 9 0.02573 0.02591 0.0261 0.05% FabArrayBase::getFB() 13093 0.02261 0.0235 0.02573 0.05% MLCellLinOp::defineBC() 81 0.02381 0.02401 0.02433 0.05% Gravity::update_max_rhs() 20 0.02351 0.02379 0.02413 0.05% MLMG::interpCorrection_1 78 0.02243 0.02246 0.02249 0.04% Castro::finalize_do_advance() 30 0.01963 0.0205 0.02199 0.04% Castro::apply_tagging_restrictions() 11 0.02094 0.02117 0.02155 0.04% Amr::defBaseLevel() 1 0.0208 0.02092 0.02102 0.04% Castro::build_fine_mask() 153 0.01815 0.01823 0.01832 0.03% FillPatchTwoLevels 394 0.01495 0.01598 0.01669 0.03% StateData::define() 48 0.01468 0.01474 0.01477 0.03% FabArray::ParallelCopy() 5320 0.01403 0.01427 0.0147 0.03% Castro::swap_state_time_levels() 30 0.013 0.0134 0.01391 0.03% Gravity::actual_multilevel_solve() 10 0.0117 0.0118 0.01192 0.02% MLMG::MLRhsNormInf() 80 0.01161 0.01167 0.01173 0.02% MLMG::solve() 80 0.003907 0.00738 0.01119 0.02% MultiFab::Dot() 463 0 0.002698 0.01079 0.02% Amr::regrid() 10 0.009323 0.009782 0.01071 0.02% StateDataPhysBCFunct::() 853 0.008559 0.009349 0.01055 0.02% Gravity::GetCrsePhi() 40 0.009455 0.009637 0.009759 0.02% MLCellLinOp::apply() 2422 0.005614 0.006535 0.009161 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008134 0.008219 0.008348 0.02% Castro::apply_problem_tags() 11 0.007526 0.007565 0.007584 0.01% MLLinOp::defineGrids() 81 0.006851 0.007132 0.007364 0.01% Castro::FluxRegFineAdd() 30 0.00707 0.007182 0.007282 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001814 0.007257 0.01% MLLinOp::makeSubCommunicator() 81 0.004316 0.005384 0.006748 0.01% Castro::enforce_consistent_e() 3 0.003927 0.005618 0.00628 0.01% MLCellLinOp::correctionResidual() 1660 0.00456 0.00488 0.005794 0.01% AMRErrorTag::operator() 11 0.004651 0.005122 0.005319 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005038 0.005063 0.00508 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004862 0.004899 0.004932 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004825 0.00484 0.004856 0.01% CGSolver::sxay() 588 0 0.001175 0.0047 0.01% Castro::do_new_sources() 50 0.0008975 0.001889 0.00462 0.01% MLMG::mgVcycle() 489 0.004081 0.00418 0.004412 0.01% Gravity::test_composite_phi() 1 0.003582 0.003892 0.004213 0.01% MLMG:computeResOfCorrection() 1421 0.003357 0.003425 0.003599 0.01% MLMG::actualBottomSolve() 333 0.0003833 0.00113 0.003351 0.01% main() 1 0.00269 0.002787 0.002882 0.01% Castro::do_old_sources() 30 0.0004994 0.001081 0.002674 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0006856 0.001607 0.002641 0.00% FillPatchInterp(Fab) 130 0.001687 0.001968 0.002568 0.00% FabArrayBase::FB::FB() 131 0.0008648 0.001256 0.002409 0.00% MLMG::mgVcycle_down::0 333 0.002223 0.002247 0.002294 0.00% MLMG::mgVcycle_down::1 333 0.002047 0.002079 0.00214 0.00% MLMG::mgVcycle_down::2 333 0.001849 0.0019 0.001998 0.00% MLCellLinOp::solutionResidual() 530 0.001915 0.001933 0.001967 0.00% Castro::subcycle_advance_ctu() 30 0.0001972 0.0006201 0.001872 0.00% Gravity::solve_phi_with_mlmg() 71 0.001589 0.001685 0.001834 0.00% Amr::InitAmr() 1 0.00177 0.001776 0.00178 0.00% Castro::clean_state() 254 0.001488 0.001543 0.001575 0.00% MLMG::mgVcycle_up::0 333 0.00151 0.001546 0.001572 0.00% OwnerMask() 11 0.0014 0.001476 0.001545 0.00% MLMG::mgVcycle_up::2 333 0.001311 0.001352 0.001453 0.00% MLMG::mgVcycle_up::1 333 0.001327 0.001359 0.00142 0.00% TagBoxArray::collate() 11 0.0009224 0.001179 0.001343 0.00% MLMG::mgVcycle_bottom 489 0.001256 0.001289 0.001316 0.00% MLMG::mgVcycle_down::3 211 0.001128 0.001184 0.001285 0.00% MLMG::mgVcycle_down::4 211 0.001082 0.001131 0.001249 0.00% makeSFC 243 0.001082 0.00116 0.001231 0.00% MLMG::mgVcycle_up::4 211 0.0007638 0.0008011 0.000885 0.00% MLMG::mgVcycle_up::3 211 0.0007217 0.000763 0.0008717 0.00% TagBoxArray::mapPRD 11 0.0008144 0.0008479 0.0008716 0.00% MLMG::computeResidual() 333 0.0008442 0.0008548 0.0008623 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007666 0.0007918 0.0008113 0.00% MLMG::MLResNormInf() 97 0.0005074 0.0007189 0.0008034 0.00% Amr::bldFineLevels() 1 0.0007367 0.0007562 0.000802 0.00% Amr::coarseTimeStep() 10 0.0007109 0.0007483 0.0007992 0.00% MLPoisson::define() 81 0.0005852 0.0006337 0.0006683 0.00% Amr::timeStep() 30 0.00046 0.0005119 0.0006557 0.00% Castro::construct_new_source() 250 0.0005752 0.0005871 0.0006073 0.00% Amr::grid_places() 11 0.0004858 0.0005255 0.0005592 0.00% FabArrayBase::TheFPinfo() 130 0.0005089 0.0005245 0.0005306 0.00% DistributionMapping::Distribute() 245 0.0004895 0.0004967 0.0005048 0.00% Castro::enforce_speed_limit() 254 0.0003734 0.0003914 0.0004118 0.00% MLPoisson::prepareForSolve() 81 0.0003479 0.0003583 0.0003637 0.00% Castro::apply_source_to_state() 100 0.0003464 0.0003525 0.0003596 0.00% Castro::computeNewDt() 18 0.0001214 0.0001858 0.0003591 0.00% MLMG::computeMLResidual() 97 0.0002944 0.0003077 0.0003149 0.00% MLLinOp::define() 81 0.0002755 0.0002917 0.0003059 0.00% Castro::construct_old_source() 150 0.0002865 0.0002947 0.0003026 0.00% MLMG::getGradSolution() 80 0.0002573 0.0002688 0.0002817 0.00% MLMG::miniCycle() 156 0.0002688 0.0002723 0.0002787 0.00% AmrLevel::AmrLevel(dm) 12 0.0002519 0.000258 0.0002652 0.00% Castro::post_regrid() 22 0.0002287 0.000244 0.0002596 0.00% ClusterList::intersect() 2 0 5.495e-05 0.0002198 0.00% Castro::advance() 30 0.0002055 0.0002119 0.0002173 0.00% Castro::check_for_nan() 60 0.0001762 0.0001837 0.0002009 0.00% FabArray::RecvLayoutMask() 21 0.0001913 0.0001929 0.0001944 0.00% Gravity::swapTimeLevels() 30 0.00018 0.0001873 0.0001934 0.00% Castro::errorEst() 11 0.0001172 0.0001204 0.0001229 0.00% FPinfo::FPinfo() 3 0.0001018 0.0001087 0.000122 0.00% Castro::avgDown(state_indx) 44 0.0001072 0.0001126 0.0001156 0.00% Gravity::solve_for_delta_phi 10 7.879e-05 8.813e-05 9.653e-05 0.00% Amr::FinalizeInit() 1 1.823e-05 3.827e-05 9.035e-05 0.00% amrex::average_down_w_geom 44 8.595e-05 8.729e-05 8.852e-05 0.00% AmrMesh-cluster 2 0 2.202e-05 8.808e-05 0.00% Castro::create_source_corrector() 30 7.847e-05 8.047e-05 8.197e-05 0.00% Amr::writeSmallPlotFile() 1 7.024e-05 7.146e-05 7.262e-05 0.00% Castro::retry_advance_ctu() 30 5.595e-05 6.104e-05 7.042e-05 0.00% knapsack() 3 6.047e-05 6.408e-05 6.853e-05 0.00% Castro::avgDown() 11 5.413e-05 5.689e-05 5.877e-05 0.00% Castro::gwstrain() 22 3.547e-05 4.076e-05 4.966e-05 0.00% BoxList::parallelComplementIn() 22 4.006e-05 4.137e-05 4.264e-05 0.00% BoxList::complementIn 22 3.925e-05 3.961e-05 3.988e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.237e-05 3.511e-05 3.83e-05 0.00% Amr::initSubcycle() 1 3.481e-05 3.543e-05 3.66e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.808e-05 3.031e-05 3.271e-05 0.00% Gravity::set_mass_offset() 11 2.591e-05 2.707e-05 2.892e-05 0.00% ClusterList::chop() 2 0 4.749e-06 1.899e-05 0.00% Castro::computeInitialDt() 2 1.204e-05 1.248e-05 1.334e-05 0.00% MLMG::compResidual() 1 1.147e-05 1.181e-05 1.23e-05 0.00% Amr::InitializeInit() 1 5.338e-06 7.018e-06 1e-05 0.00% Amr::init() 1 5.846e-06 6.042e-06 6.143e-06 0.00% knapsack()swap 2 4.759e-06 5.082e-06 5.661e-06 0.00% Amr::initialInit() 1 3.97e-06 4.272e-06 4.732e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 53.6 53.6 53.6 100.00% Amr::coarseTimeStep() 10 50.79 50.79 50.79 94.74% Amr::timeStep() 30 50.71 50.71 50.71 94.60% Castro::advance() 30 35.7 35.7 35.7 66.61% Castro::subcycle_advance_ctu() 30 33.95 33.97 33.98 63.39% Castro::do_advance_ctu() 30 33.95 33.97 33.98 63.39% Castro::construct_ctu_hydro_source() 30 16.27 16.41 16.55 30.87% Gravity::actual_solve_with_mlmg() 81 13.15 13.16 13.16 24.55% MLMG::solve() 80 12.45 12.45 12.46 23.24% Castro::post_timestep() 30 11.97 11.97 11.97 22.33% Castro::clean_state() 254 10.36 10.44 10.54 19.65% MLMG::oneIter() 333 10.42 10.42 10.43 19.45% Gravity::solve_phi_with_mlmg() 71 9.891 9.929 9.948 18.56% Castro::reflux() 10 9.51 9.52 9.531 17.78% MLMG::mgVcycle() 489 9.115 9.119 9.125 17.02% Gravity::solve_for_phi() 60 8.246 8.271 8.286 15.46% MLCellLinOp::smooth() 5996 6.155 6.292 6.624 12.36% Castro::computeTemp() 257 6.17 6.225 6.278 11.71% Castro::reset_internal_energy() 257 5.698 5.753 5.81 10.84% Castro::construct_new_gravity() 30 5.032 5.037 5.04 9.40% Gravity::gravity_sync() 10 5 5 5 9.33% Castro::construct_old_gravity() 30 4.654 4.68 4.692 8.75% Castro::evaluate_source_change() 591 4.453 4.478 4.502 8.40% MLPoisson::Fsmooth() 11992 4.119 4.191 4.356 8.13% Gravity::solve_for_delta_phi 10 4.187 4.187 4.188 7.81% MLMG::mgVcycle_down::0 333 3.854 3.891 3.934 7.34% Castro::enforce_min_density() 254 3.78 3.814 3.867 7.21% FillPatchIterator::Initialize 723 3.246 3.258 3.277 6.11% Castro::do_new_sources() 50 3.18 3.202 3.229 6.02% Amr::regrid() 10 3.117 3.138 3.154 5.88% Castro::post_regrid() 22 2.925 2.951 2.97 5.54% MLCellLinOp::applyBC() 14630 2.603 2.749 2.957 5.52% MLMG::mgVcycle_up::0 333 2.643 2.838 2.905 5.42% FabArray::ParallelCopy() 5320 1.985 2.446 2.679 5.00% MultiFab::AddProduct() 4648 2.622 2.635 2.648 4.94% MLCellLinOp::apply() 2422 2.454 2.545 2.591 4.83% Castro::initialize_do_advance() 30 2.465 2.475 2.491 4.65% FabArray::setVal() 9464 2.321 2.336 2.347 4.38% Amr::init() 1 2.271 2.271 2.271 4.24% FillPatchSingleLevel 853 2.186 2.199 2.21 4.12% MLPoisson::Fapply() 2422 1.842 1.936 2.012 3.75% MLCellLinOp::solutionResidual() 530 1.717 1.771 1.818 3.39% MLCellLinOp::correctionResidual() 1660 1.614 1.666 1.711 3.19% MultiFab::Subtract() 601 1.651 1.665 1.676 3.13% Amr::initialInit() 1 1.675 1.675 1.675 3.13% Gravity::multilevel_solve_for_new_phi() 10 1.661 1.661 1.661 3.10% Gravity::actual_multilevel_solve() 10 1.653 1.653 1.653 3.08% Castro::derive() 397 1.615 1.621 1.627 3.03% MLMG:computeResOfCorrection() 1421 1.459 1.516 1.539 2.87% Castro::do_old_sources() 30 1.468 1.479 1.492 2.78% FabArray::ParallelCopy_nowait() 5320 1.399 1.423 1.449 2.70% Castro::initialize_advance() 30 1.335 1.348 1.359 2.53% Castro::volWgtSum() 242 1.333 1.339 1.35 2.52% FabArray::FillBoundary() 13093 1.17 1.255 1.309 2.44% Amr::FinalizeInit() 1 1.264 1.269 1.273 2.37% FabArray::ParallelCopy_finish() 5320 0.521 1.008 1.237 2.31% FillPatchTwoLevels 394 1.155 1.171 1.184 2.21% Castro::expand_state() 30 1.156 1.161 1.169 2.18% Gravity::fill_multipole_BCs() 41 1.098 1.127 1.148 2.14% Amr::writePlotFile() 2 1.137 1.137 1.137 2.12% FluxRegister::Reflux() 180 1.11 1.111 1.112 2.07% MLMG::addInterpCorrection() 1421 0.3181 0.8248 0.9961 1.86% Gravity::get_new_grav_vector() 52 0.9827 0.9886 0.9931 1.85% Castro::post_init() 2 0.9316 0.9407 0.9621 1.79% MLMG::computeResWithCrseSolFineCor() 78 0.9466 0.9467 0.9469 1.77% MLMG::computeResidual() 333 0.9016 0.9223 0.9442 1.76% MultiFab::sum() 4648 0.8357 0.8401 0.844 1.57% MLMG::mgVcycle_down::1 333 0.671 0.73 0.8296 1.55% MultiFab::Xpay() 2190 0.7359 0.7436 0.7582 1.41% FillBoundary_nowait() 13093 0.6482 0.6636 0.6733 1.26% MLCellLinOp::reflux() 116 0.6553 0.662 0.6688 1.25% MLMG::mgVcycle_up::2 333 0.2068 0.5269 0.6348 1.18% MLMG::computeMLResidual() 97 0.5956 0.6147 0.6252 1.17% FillBoundary_finish() 13093 0.4654 0.5596 0.6116 1.14% Castro::construct_new_source() 250 0.5974 0.6041 0.609 1.14% Castro::construct_new_gravity_source() 50 0.5968 0.6035 0.6085 1.14% FillPatchInterp(Fab) 130 0.3714 0.4592 0.5485 1.02% CellConservativeLinear::interp() 130 0.3695 0.4573 0.5467 1.02% Gravity::get_old_grav_vector() 30 0.522 0.5234 0.5263 0.98% MLMG::mgVcycle_up::1 333 0.4595 0.4761 0.5243 0.98% Castro::normalize_species() 254 0.5073 0.5129 0.5159 0.96% Amr::InitializeInit() 1 0.4023 0.4068 0.4114 0.77% Amr::defBaseLevel() 1 0.4023 0.4068 0.4114 0.77% MLPoisson::FFlux() 1044 0.3922 0.3925 0.3927 0.73% Castro::finalize_advance() 30 0.3882 0.3896 0.3902 0.73% MLPoisson::define() 81 0.3665 0.3724 0.3849 0.72% Castro::initData() 3 0.3617 0.3695 0.3751 0.70% StateDataPhysBCFunct::() 853 0.3313 0.3322 0.3328 0.62% amrex::average_down 1713 0.2945 0.3034 0.327 0.61% StateData::FillBoundary(geom) 63 0.3213 0.3228 0.3241 0.60% MultiFab::min() 30 0.006898 0.1581 0.3216 0.60% MLMG::prepareForSolve() 80 0.3047 0.3096 0.3205 0.60% MLMG::mgVcycle_bottom 489 0.1585 0.197 0.3113 0.58% Castro::estTimeStep() 69 0.2351 0.2602 0.285 0.53% MLMG::mgVcycle_down::2 333 0.2429 0.2555 0.2824 0.53% Castro::apply_source_to_state() 100 0.2705 0.2718 0.2734 0.51% MultiFab::Saxpy() 100 0.2701 0.2715 0.2731 0.51% MLCellLinOp::defineAuxData() 81 0.2101 0.2164 0.2314 0.43% MLMG::getGradSolution() 80 0.2172 0.2176 0.2184 0.41% MLCellLinOp::compGrad() 100 0.2169 0.2174 0.2181 0.41% Amr::bldFineLevels() 1 0.185 0.2029 0.2089 0.39% MLMG::mgVcycle_down::3 211 0.03277 0.0728 0.1916 0.36% VisMF::Write(FabArray) 4 0.1597 0.166 0.1768 0.33% MLMG::ResNormInf() 450 0.1219 0.1479 0.1712 0.32% MLMG::miniCycle() 156 0.158 0.1586 0.159 0.30% MLMG::actualBottomSolve() 333 0.0003833 0.03836 0.1523 0.28% Castro::init(old) 9 0.1487 0.1498 0.1517 0.28% Castro::computeNewDt() 18 0.1307 0.1403 0.1477 0.28% MLCGSolver::bicgstab 83 0 0.03657 0.1463 0.27% FabArray::mult() 294 0.1434 0.1447 0.1458 0.27% MultiFab::Multiply() 164 0.1447 0.1451 0.1455 0.27% MLCellLinOp::defineBC() 81 0.1392 0.1401 0.1419 0.26% Castro::construct_old_source() 150 0.1365 0.1369 0.1375 0.26% Castro::construct_old_gravity_source() 30 0.1362 0.1366 0.1372 0.26% FabArray::setDomainBndry() 853 0.1321 0.1335 0.1364 0.25% MLMG::mgVcycle_up::3 211 0.02471 0.05268 0.1357 0.25% Castro::volProductSum() 22 0.1214 0.122 0.1226 0.23% BndryData::define() 123 0.1137 0.1149 0.1167 0.22% Amr::grid_places() 11 0.1117 0.1119 0.1121 0.21% AmrMesh::MakeNewGrids() 11 0.1111 0.1114 0.1116 0.21% Gravity::GetCrsePhi() 40 0.09545 0.1019 0.1075 0.20% MLMG::computeResWithCrseCorFineCor() 78 0.1033 0.1033 0.1034 0.19% Castro::check_for_nan() 60 0.09126 0.09182 0.0921 0.17% MultiFab::contains_nan() 60 0.09106 0.09163 0.09193 0.17% MLCellLinOp::updateSolBC() 99 0.08122 0.08713 0.09019 0.17% FabArrayBase::getCPC() 8152 0.06857 0.07335 0.08524 0.16% Gravity::test_level_grad_phi_curr() 20 0.08019 0.0809 0.08173 0.15% Gravity::create_comp_minus_level_grad_phi() 10 0.08089 0.08128 0.0816 0.15% MultiFab::LinComb() 628 0.06462 0.07205 0.08014 0.15% Gravity::update_max_rhs() 20 0.04678 0.05551 0.07546 0.14% MLMG::mgVcycle_down::4 211 0.03142 0.04197 0.0723 0.13% MLCellLinOp::updateCorBC() 78 0.06209 0.06279 0.0632 0.12% Castro::errorEst() 11 0.05846 0.06105 0.06222 0.12% MLCellLinOp::setLevelBC() 102 0.04974 0.0578 0.06067 0.11% Gravity::test_composite_phi() 1 0.05943 0.05946 0.05948 0.11% MLMG::mgVcycle_up::4 211 0.02485 0.03283 0.05576 0.10% MLMG::buildFineMask() 80 0.04817 0.04829 0.04842 0.09% Gravity::test_level_grad_phi_prev() 30 0.04564 0.04612 0.04668 0.09% MultiFab::norm0(mask) 57 0.04586 0.0459 0.04595 0.09% FabArrayBase::CPC::define() 2260 0.02764 0.03192 0.04323 0.08% MLMG::MLResNormInf() 97 0.0423 0.04244 0.04259 0.08% MultiFab::max() 40 0.01228 0.02146 0.04175 0.08% MultiFab::Copy() 100 0.03847 0.03862 0.03882 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03572 0.03641 0.03735 0.07% MLMG::interpCorrection_1 78 0.03137 0.03373 0.03569 0.07% Castro::computeInitialDt() 2 0.02005 0.02464 0.02911 0.05% MLPoisson::prepareForSolve() 81 0.02484 0.02584 0.02832 0.05% FabArrayBase::getFB() 13093 0.02347 0.02476 0.02814 0.05% MLCellLinOp::prepareForSolve() 81 0.02448 0.02548 0.02797 0.05% MLMG::MLRhsNormInf() 80 0.02767 0.0277 0.02774 0.05% Gravity::swapTimeLevels() 30 0.02174 0.02249 0.02285 0.04% Castro::finalize_do_advance() 30 0.01963 0.0205 0.02199 0.04% Castro::apply_tagging_restrictions() 11 0.02094 0.02117 0.02155 0.04% CGSolver::sxay() 588 0 0.004691 0.01876 0.04% Castro::build_fine_mask() 153 0.01815 0.01823 0.01832 0.03% MLLinOp::define() 81 0.01379 0.01525 0.01695 0.03% MLLinOp::defineGrids() 81 0.0135 0.01496 0.01665 0.03% AmrLevel::AmrLevel(dm) 12 0.01494 0.015 0.01502 0.03% MLMG::compResidual() 1 0.01415 0.01444 0.01488 0.03% StateData::define() 48 0.01468 0.01474 0.01477 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01416 0.01435 0.0146 0.03% Castro::avgDown() 11 0.01407 0.01419 0.01432 0.03% Castro::avgDown(state_indx) 44 0.01402 0.01414 0.01426 0.03% amrex::average_down_w_geom 44 0.0139 0.01402 0.01415 0.03% MLCGSolver::ParallelAllReduce 692 0 0.00353 0.01412 0.03% Castro::swap_state_time_levels() 30 0.013 0.0134 0.01391 0.03% MultiFab::Dot() 463 0 0.002698 0.01079 0.02% TagBoxArray::mapPRD 11 0.005607 0.006844 0.009332 0.02% Castro::apply_problem_tags() 11 0.007526 0.007565 0.007584 0.01% Castro::FluxRegFineAdd() 30 0.00707 0.007182 0.007282 0.01% MLLinOp::makeSubCommunicator() 81 0.004316 0.005384 0.006748 0.01% Castro::enforce_consistent_e() 3 0.003927 0.005618 0.00628 0.01% AMRErrorTag::operator() 11 0.004651 0.005122 0.005319 0.01% FabArrayBase::TheFPinfo() 130 0.001371 0.002304 0.00336 0.01% FPinfo::FPinfo() 3 0.0008411 0.001779 0.00283 0.01% DistributionMapping::KnapSackDoIt() 3 0.0007393 0.00167 0.002707 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0006856 0.001607 0.002641 0.00% MLLinOp::makeAgglomeratedDMap 81 0.002331 0.00244 0.002538 0.00% FabArrayBase::FB::FB() 131 0.0008648 0.001256 0.002409 0.00% Amr::InitAmr() 1 0.001807 0.001811 0.001815 0.00% makeSFC 243 0.001564 0.001648 0.001726 0.00% OwnerMask() 11 0.0014 0.001476 0.001545 0.00% TagBoxArray::collate() 11 0.0009224 0.001179 0.001343 0.00% DistributionMapping::Distribute() 245 0.0004895 0.0004967 0.0005048 0.00% Castro::enforce_speed_limit() 254 0.0003734 0.0003914 0.0004118 0.00% AmrMesh-cluster 2 0 8.172e-05 0.0003269 0.00% ClusterList::intersect() 2 0 5.495e-05 0.0002198 0.00% FabArray::RecvLayoutMask() 21 0.0001913 0.0001929 0.0001944 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 6.533e-05 7.995e-05 8.752e-05 0.00% Castro::create_source_corrector() 30 7.847e-05 8.047e-05 8.197e-05 0.00% BoxList::parallelComplementIn() 22 7.947e-05 8.098e-05 8.189e-05 0.00% knapsack() 3 6.523e-05 6.916e-05 7.419e-05 0.00% Amr::writeSmallPlotFile() 1 7.024e-05 7.146e-05 7.262e-05 0.00% Castro::retry_advance_ctu() 30 5.595e-05 6.104e-05 7.042e-05 0.00% Castro::gwstrain() 22 3.547e-05 4.076e-05 4.966e-05 0.00% BoxList::complementIn 22 3.925e-05 3.961e-05 3.988e-05 0.00% Amr::initSubcycle() 1 3.481e-05 3.543e-05 3.66e-05 0.00% Gravity::set_mass_offset() 11 2.591e-05 2.707e-05 2.892e-05 0.00% ClusterList::chop() 2 0 4.749e-06 1.899e-05 0.00% knapsack()swap 2 4.759e-06 5.082e-06 5.661e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.02-16-g3199edf61525) finalized