MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.03-10-gfbdfc840de7c) initialized Starting run at 06:34:20 UTC on 2022-03-10. Successfully read inputs file ... Castro git describe: 22.02-4-g0d942c92d AMReX git describe: 22.03-10-gfbdfc840d Microphysics git describe: 22.03-2-ge2419c42 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.011975484 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.012322989 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.029333392 Gravity::fill_multipole_BCs() time = 0.028543112 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.595354095 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032135059 Gravity::solve_for_phi() time = 0.411353478 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -8.671003221e+22 ymom added: -5.289050461e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.136882786 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.445472631 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02631944 Gravity::solve_for_phi() time = 0.356127509 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.153752408 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0834504629 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008606342 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009202537 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10802627 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046379094 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010295393 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01606581241 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008648631 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009151714 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10778486 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046177038 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010354426 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01469022436 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027797488 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010015878 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.147414075 Castro::reflux() at level 0 : time = 1.030381157 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.976290347 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009618017 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02885595 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034128079 Gravity::solve_for_phi() time = 0.412731707 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852869e+30 ymom added: 2.372403433e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.131833819 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.444081199 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025422232 Gravity::solve_for_phi() time = 0.353025241 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.148148112 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0844343508 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008625678 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009335043 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107714748 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.047540821 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010241393 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01601863368 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00854499 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009277509 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108418648 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045875739 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010260695 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01480952687 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029172353 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010219147 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770255e+28 zmom added: 8.082913463e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.147093513 Castro::reflux() at level 0 : time = 1.027211038 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.317543048 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009551253 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029204002 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031454845 Gravity::solve_for_phi() time = 0.409317139 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939034e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.131206106 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.454355589 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028661997 Gravity::solve_for_phi() time = 0.358047297 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.148578327 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08410996749 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.010733409 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009562338 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109261336 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045764751 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010101712 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01578557333 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00855813 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009145631 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107837204 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045608224 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.01003317 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01467165805 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028922718 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010142536 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655087e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342329e+27 ymom added: 5.311566494e+28 zmom added: 5.312402179e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.150860099 Castro::reflux() at level 0 : time = 1.033148467 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.265378273 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009629008 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02891483 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031154359 Gravity::solve_for_phi() time = 0.409139321 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700665e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.131009961 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.438045323 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02587744 Gravity::solve_for_phi() time = 0.357642712 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.155497739 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08443448 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008702349 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009115843 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109341973 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046894181 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010330215 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01596352858 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008685068 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009506737 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109167543 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.046957509 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010478275 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01458953504 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028702418 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010025173 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.25186043e+28 ymom added: -2.445730085e+28 zmom added: -2.44439047e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.150077927 Castro::reflux() at level 0 : time = 0.97123981 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.195278711 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009733604 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029076583 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030827728 Gravity::solve_for_phi() time = 0.410593685 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150479e+30 ymom added: 3.39980379e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.132967393 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.440384585 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025502486 Gravity::solve_for_phi() time = 0.353869503 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591233e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.147066813 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08457145653 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008303973 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009106072 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1077059 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045765669 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010043238 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01618771931 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008541494 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009137029 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107389016 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045521156 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010285024 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0148881823 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02865737 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010228248 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277776e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.147707569 Castro::reflux() at level 0 : time = 0.964512092 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.172125082 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009785549 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028638223 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03164198 Gravity::solve_for_phi() time = 0.412643124 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919322e+30 ymom added: 4.094511425e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.135081404 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.478680395 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025835876 Gravity::solve_for_phi() time = 0.357580672 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245022e+27 ymom added: -5.297264722e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.153861814 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08311469612 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008141132 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009218245 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106442826 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043321785 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.009944623 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01639479236 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008050849 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.008973759 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107416604 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043748411 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010019176 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01499230416 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028735013 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010074331 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.147785339 Castro::reflux() at level 0 : time = 0.948674711 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.176873914 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.01019882 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028585324 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028262949 Gravity::solve_for_phi() time = 0.3839312 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151138e+30 ymom added: 4.515688034e+30 zmom added: 4.515608887e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.130531728 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.452857808 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024540594 Gravity::solve_for_phi() time = 0.333195429 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.88175262e+28 zmom added: -2.881735255e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.150694224 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08577116949 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008110483 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009005635 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106606117 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04318035 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010118375 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01650148363 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007973562 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009239727 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107507188 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043380081 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010100802 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01504018818 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028580792 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.010055712 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.14778503 Castro::reflux() at level 0 : time = 0.937506482 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.13290652 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009470238 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028782338 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031897643 Gravity::solve_for_phi() time = 0.387645497 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064073e+30 ymom added: 4.889542941e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.133053104 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.447553757 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025161999 Gravity::solve_for_phi() time = 0.38098424 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.151037926 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08456021184 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008164446 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009197999 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107539052 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043109675 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010056183 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01644206403 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007987841 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.00898991 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10646324 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043172318 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.009947243 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01511162014 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02843201 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010108529 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478815e+29 ymom added: 5.931907354e+27 zmom added: 5.953997699e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.147653953 Castro::reflux() at level 0 : time = 0.94029463 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.178868007 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009474008 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02885298 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029752668 Gravity::solve_for_phi() time = 0.385756344 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036352e+30 ymom added: 5.530451715e+30 zmom added: 5.530356588e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.131664544 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.445412485 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024653279 Gravity::solve_for_phi() time = 0.379816858 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170339e+28 zmom added: -5.061201609e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.150402612 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08466447882 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008022129 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009030751 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107296989 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043138127 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010014363 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01649007146 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008019352 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.008945477 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10609354 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043203492 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.009989677 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01516229314 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028793131 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.010103676 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087175e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.146148654 Castro::reflux() at level 0 : time = 0.937023663 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.169674118 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009579855 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028779442 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03008459 Gravity::solve_for_phi() time = 0.38535217 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167174e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.130790041 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.441475526 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024875677 Gravity::solve_for_phi() time = 0.380276609 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.151468199 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08473575029 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008142051 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009181804 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106913582 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.049010711 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.009961365 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0161105769 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008172365 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009067485 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107029716 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.049006521 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.009895438 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01480379009 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028668329 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.009899293 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.76591487e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.147573992 Castro::reflux() at level 0 : time = 0.999430672 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.242129084 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.548868658 seconds Ending run at 06:35:15 UTC on 2022-03-10. Run time = 54.55617834 Run time without initialization = 52.38077045 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.55 ... 54.56 ... 54.56 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.3423 16.5212 16.6290 30.48% MLPoisson::Fsmooth() 11992 4.176 4.394 4.899 8.98% Castro::reset_internal_energy() 257 2.896 2.946 3 5.50% MultiFab::AddProduct() 4648 2.695 2.699 2.71 4.97% FabArray::setVal() 9464 2.302 2.326 2.367 4.34% MLPoisson::Fapply() 2422 1.859 1.884 1.923 3.52% MLCellLinOp::applyBC() 14630 1.468 1.561 1.782 3.27% MultiFab::Subtract() 601 1.635 1.643 1.65 3.02% FabArray::ParallelCopy_nowait() 5320 1.382 1.415 1.458 2.67% FabArray::ParallelCopy_finish() 5320 0.5116 1.115 1.333 2.44% Castro::enforce_min_density() 254 1.033 1.077 1.148 2.10% Gravity::fill_multipole_BCs() 41 1.057 1.097 1.134 2.08% FillBoundary_finish() 13093 0.4337 0.8481 1.096 2.01% Castro::derive() 397 0.915 0.9246 0.9329 1.71% MultiFab::sum() 4648 0.8768 0.8797 0.8827 1.62% FluxRegister::Reflux() 180 0.8188 0.8251 0.8288 1.52% FillBoundary_nowait() 13093 0.6444 0.6955 0.7502 1.38% MultiFab::Xpay() 2190 0.7029 0.7123 0.7281 1.33% Castro::reflux() 10 0.6908 0.6968 0.7014 1.29% Castro::volWgtSum() 242 0.5328 0.5969 0.6738 1.23% Castro::construct_new_gravity_source() 50 0.5973 0.6059 0.6168 1.13% CellConservativeLinear::interp() 130 0.3701 0.456 0.5413 0.99% Castro::normalize_species() 254 0.5074 0.5093 0.5111 0.94% Castro::computeTemp() 257 0.4683 0.4706 0.4723 0.87% MLPoisson::FFlux() 1044 0.3851 0.3876 0.3886 0.71% Castro::finalize_advance() 30 0.3504 0.3615 0.3717 0.68% MultiFab::min() 30 0.007272 0.1391 0.3492 0.64% Gravity::get_new_grav_vector() 52 0.3278 0.3309 0.3332 0.61% StateData::FillBoundary(geom) 63 0.3248 0.3291 0.3322 0.61% Castro::estTimeStep() 69 0.2406 0.2821 0.3297 0.60% FillPatchSingleLevel 853 0.3237 0.3266 0.329 0.60% amrex::average_down 1713 0.2756 0.2814 0.2927 0.54% MLMG::addInterpCorrection() 1421 0.2568 0.2634 0.2762 0.51% FillPatchIterator::Initialize 723 0.2475 0.2641 0.2757 0.51% MultiFab::Saxpy() 100 0.2704 0.2716 0.2723 0.50% Castro::do_advance_ctu() 30 0.2157 0.2172 0.2198 0.40% MLMG::oneIter() 333 0.211 0.213 0.2147 0.39% Castro::post_timestep() 30 0.007958 0.1011 0.1959 0.36% MLCellLinOp::defineAuxData() 81 0.1726 0.1794 0.1916 0.35% Castro::expand_state() 30 0.1886 0.1898 0.191 0.35% MLCellLinOp::reflux() 116 0.1726 0.1745 0.1767 0.32% VisMF::Write(FabArray) 4 0.1648 0.1681 0.176 0.32% MLCellLinOp::compGrad() 100 0.1682 0.1687 0.1692 0.31% Gravity::get_old_grav_vector() 30 0.1634 0.1653 0.1661 0.30% FabArray::mult() 294 0.1448 0.1459 0.1467 0.27% MultiFab::Multiply() 164 0.1431 0.1438 0.1444 0.26% FabArray::setDomainBndry() 853 0.1233 0.1302 0.1406 0.26% Amr::writePlotFile() 2 0.1155 0.1271 0.1352 0.25% Castro::construct_old_gravity_source() 30 0.1331 0.1337 0.134 0.25% MLMG::ResNormInf() 450 0.09606 0.1085 0.1182 0.22% MultiFab::contains_nan() 60 0.09271 0.09327 0.09424 0.17% Castro::construct_old_gravity() 30 0.08659 0.08772 0.08912 0.16% BndryData::define() 123 0.08754 0.0884 0.08907 0.16% MLMG::prepareForSolve() 80 0.07879 0.08058 0.08437 0.15% MultiFab::LinComb() 628 0.06477 0.06921 0.08152 0.15% Castro::evaluate_source_change() 591 0.07682 0.07755 0.07845 0.14% Gravity::gravity_sync() 10 0.07095 0.07162 0.07241 0.13% Gravity::test_level_grad_phi_curr() 20 0.07146 0.07197 0.07233 0.13% Castro::construct_new_gravity() 30 0.05305 0.05649 0.06317 0.12% Castro::initData() 3 0.05754 0.05989 0.06317 0.12% MLCGSolver::bicgstab 83 0 0.01477 0.05907 0.11% MLCellLinOp::updateSolBC() 99 0.05717 0.05778 0.05856 0.11% Castro::volProductSum() 22 0.04979 0.0538 0.05804 0.11% MultiFab::norm0(mask) 57 0.04665 0.04706 0.04732 0.09% MLCellLinOp::updateCorBC() 78 0.04515 0.04551 0.04613 0.08% Gravity::create_comp_minus_level_grad_phi() 10 0.0451 0.04542 0.04602 0.08% Gravity::actual_solve_with_mlmg() 81 0.03641 0.0397 0.04451 0.08% Castro::initialize_do_advance() 30 0.03344 0.03887 0.04413 0.08% Gravity::test_level_grad_phi_prev() 30 0.04071 0.0419 0.04412 0.08% FabArrayBase::getCPC() 8152 0.04088 0.0416 0.04316 0.08% FabArrayBase::CPC::define() 2260 0.0278 0.03189 0.04315 0.08% MLCellLinOp::setLevelBC() 102 0.03981 0.04088 0.04267 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03632 0.0384 0.04191 0.08% MLMG::buildFineMask() 80 0.04039 0.04067 0.04088 0.07% MultiFab::max() 40 0.01221 0.01967 0.04036 0.07% MultiFab::Copy() 100 0.03927 0.03949 0.03973 0.07% AmrMesh::MakeNewGrids() 11 0.03449 0.03537 0.03603 0.07% FabArray::FillBoundary() 13093 0.03102 0.03242 0.03567 0.07% Gravity::solve_for_phi() 60 0.02679 0.02851 0.03225 0.06% MLCellLinOp::smooth() 5996 0.02616 0.0276 0.03022 0.06% MLCellLinOp::prepareForSolve() 81 0.02465 0.02595 0.02912 0.05% Castro::initialize_advance() 30 0.02554 0.02674 0.02832 0.05% Castro::init(old) 9 0.0263 0.0265 0.02661 0.05% Castro::post_init() 2 0.0004797 0.0143 0.02634 0.05% FabArrayBase::getFB() 13093 0.02242 0.02337 0.02584 0.05% MLCellLinOp::defineBC() 81 0.02384 0.02421 0.02485 0.05% Gravity::update_max_rhs() 20 0.02404 0.02438 0.02458 0.05% Amr::defBaseLevel() 1 0.02211 0.02304 0.02424 0.04% Castro::finalize_do_advance() 30 0.007725 0.01729 0.02334 0.04% MLMG::interpCorrection_1 78 0.02263 0.02272 0.02282 0.04% Castro::apply_tagging_restrictions() 11 0.02098 0.02143 0.02205 0.04% Castro::build_fine_mask() 153 0.01814 0.01836 0.01854 0.03% StateData::define() 48 0.0163 0.01713 0.0181 0.03% FillPatchTwoLevels 394 0.015 0.01665 0.01792 0.03% FabArray::ParallelCopy() 5320 0.01407 0.01441 0.0151 0.03% Castro::swap_state_time_levels() 30 0.01309 0.01358 0.01409 0.03% MultiFab::Dot() 463 0 0.003207 0.01283 0.02% MLMG::MLRhsNormInf() 80 0.01252 0.01256 0.01262 0.02% Gravity::actual_multilevel_solve() 10 0.01203 0.01209 0.01212 0.02% Amr::regrid() 10 0.009702 0.01038 0.01194 0.02% StateDataPhysBCFunct::() 853 0.007811 0.00905 0.01015 0.02% Gravity::GetCrsePhi() 40 0.009778 0.009875 0.009959 0.02% MLCellLinOp::apply() 2422 0.005726 0.006882 0.009882 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008348 0.008567 0.008761 0.02% Castro::apply_problem_tags() 11 0.007553 0.007663 0.007802 0.01% MLMG::solve() 80 0.003534 0.005927 0.007703 0.01% MLLinOp::defineGrids() 81 0.006785 0.007161 0.007576 0.01% Castro::FluxRegFineAdd() 30 0.007143 0.007278 0.007464 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001855 0.007418 0.01% MLLinOp::makeSubCommunicator() 81 0.002243 0.005506 0.007207 0.01% MLCellLinOp::correctionResidual() 1660 0.004604 0.005073 0.006213 0.01% Castro::do_new_sources() 50 0.0008863 0.002124 0.005523 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005069 0.005128 0.005181 0.01% CGSolver::sxay() 588 0 0.001288 0.005153 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004874 0.004939 0.005028 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004851 0.004901 0.00495 0.01% AMRErrorTag::operator() 11 0.004676 0.004781 0.00489 0.01% main() 1 0.00301 0.0043 0.004787 0.01% MLMG::mgVcycle() 489 0.00405 0.004188 0.00442 0.01% Gravity::test_composite_phi() 1 0.003625 0.003979 0.004373 0.01% Castro::enforce_consistent_e() 3 0.003476 0.003725 0.00397 0.01% MLMG:computeResOfCorrection() 1421 0.003344 0.00345 0.00368 0.01% MLMG::actualBottomSolve() 333 0.0003898 0.001155 0.00343 0.01% DistributionMapping::LeastUsedCPUs() 5 8.012e-05 0.001623 0.003125 0.01% Castro::do_old_sources() 30 0.0004861 0.001224 0.002829 0.01% FillPatchInterp(Fab) 130 0.001711 0.00207 0.002789 0.01% Amr::InitAmr() 1 0.002464 0.002474 0.002481 0.00% FabArrayBase::FB::FB() 131 0.0008449 0.001245 0.002412 0.00% MLMG::mgVcycle_down::0 333 0.002262 0.002283 0.002312 0.00% MLMG::mgVcycle_down::1 333 0.002038 0.002109 0.002228 0.00% MLMG::mgVcycle_down::2 333 0.001866 0.001934 0.002069 0.00% MLCellLinOp::solutionResidual() 530 0.001942 0.001993 0.002048 0.00% Castro::subcycle_advance_ctu() 30 0.0001941 0.0006465 0.001984 0.00% Gravity::solve_phi_with_mlmg() 71 0.001633 0.001701 0.001871 0.00% OwnerMask() 11 0.001467 0.001535 0.00161 0.00% MLMG::mgVcycle_up::0 333 0.00155 0.001568 0.00161 0.00% Castro::clean_state() 254 0.001531 0.00155 0.001585 0.00% TagBoxArray::collate() 11 0.001239 0.001317 0.001487 0.00% MLMG::mgVcycle_up::2 333 0.00131 0.001358 0.001457 0.00% MLMG::mgVcycle_up::1 333 0.001334 0.001373 0.00144 0.00% MLMG::mgVcycle_down::3 211 0.001148 0.001214 0.001356 0.00% MLMG::mgVcycle_bottom 489 0.001248 0.001282 0.001355 0.00% MLMG::mgVcycle_down::4 211 0.001086 0.001161 0.001331 0.00% makeSFC 243 0.0009779 0.001138 0.001232 0.00% TagBoxArray::mapPRD 11 0.0008401 0.000881 0.0009065 0.00% MLMG::mgVcycle_up::4 211 0.0007534 0.0008005 0.0008966 0.00% MLMG::MLResNormInf() 97 0.0005339 0.0007202 0.0008934 0.00% MLMG::mgVcycle_up::3 211 0.0007294 0.000777 0.0008856 0.00% MLMG::computeResidual() 333 0.0008273 0.0008477 0.0008698 0.00% Amr::bldFineLevels() 1 0.0007623 0.0008167 0.0008663 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007323 0.0007885 0.0008246 0.00% Amr::timeStep() 30 0.0004527 0.0005401 0.0007607 0.00% MLPoisson::define() 81 0.000573 0.0006272 0.0006688 0.00% Amr::coarseTimeStep() 10 0.0005471 0.0005853 0.0006399 0.00% Castro::construct_new_source() 250 0.0005846 0.0006104 0.0006264 0.00% Amr::grid_places() 11 0.0004866 0.0005287 0.0005943 0.00% FabArrayBase::TheFPinfo() 130 0.00051 0.0005236 0.000539 0.00% DistributionMapping::Distribute() 245 0.0004953 0.0005014 0.000509 0.00% Castro::enforce_speed_limit() 254 0.0003972 0.0004016 0.0004076 0.00% MLPoisson::prepareForSolve() 81 0.0003414 0.0003595 0.0003836 0.00% Castro::computeNewDt() 18 0.0001195 0.0001878 0.000373 0.00% Castro::apply_source_to_state() 100 0.0003506 0.0003598 0.0003688 0.00% MLMG::computeMLResidual() 97 0.0003051 0.0003139 0.0003231 0.00% MLLinOp::define() 81 0.0002888 0.0002968 0.0003012 0.00% Castro::construct_old_source() 150 0.0002773 0.0002837 0.0002916 0.00% Castro::post_regrid() 22 0.0002361 0.0002507 0.0002885 0.00% MLMG::miniCycle() 156 0.0002662 0.0002711 0.0002768 0.00% MLMG::getGradSolution() 80 0.0002528 0.0002635 0.0002726 0.00% AmrLevel::AmrLevel(dm) 12 0.0002597 0.0002647 0.0002679 0.00% Castro::advance() 30 0.0002032 0.000217 0.0002389 0.00% ClusterList::intersect() 2 0 5.614e-05 0.0002246 0.00% FabArray::RecvLayoutMask() 21 0.000193 0.000195 0.0001982 0.00% Gravity::swapTimeLevels() 30 0.0001848 0.0001915 0.0001954 0.00% Castro::check_for_nan() 60 0.000176 0.0001784 0.0001836 0.00% Castro::errorEst() 11 0.0001202 0.000125 0.0001297 0.00% Castro::avgDown(state_indx) 44 0.0001083 0.0001145 0.0001182 0.00% FPinfo::FPinfo() 3 9.628e-05 0.0001084 0.0001135 0.00% Amr::FinalizeInit() 1 1.948e-05 4.286e-05 0.00011 0.00% AmrMesh-cluster 2 0 2.419e-05 9.677e-05 0.00% amrex::average_down_w_geom 44 8.6e-05 8.856e-05 9.409e-05 0.00% Gravity::solve_for_delta_phi 10 7.617e-05 8.626e-05 9.385e-05 0.00% Castro::create_source_corrector() 30 7.914e-05 8.409e-05 9.149e-05 0.00% Castro::retry_advance_ctu() 30 5.032e-05 6.194e-05 7.466e-05 0.00% Castro::avgDown() 11 5.317e-05 6.098e-05 7.44e-05 0.00% Amr::writeSmallPlotFile() 1 7.118e-05 7.213e-05 7.349e-05 0.00% knapsack() 3 5.737e-05 6.122e-05 6.394e-05 0.00% Amr::initSubcycle() 1 4.083e-05 5.007e-05 5.971e-05 0.00% Castro::gwstrain() 22 3.713e-05 4.086e-05 4.699e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.479e-05 3.996e-05 4.328e-05 0.00% BoxList::parallelComplementIn() 22 3.95e-05 4.174e-05 4.302e-05 0.00% BoxList::complementIn 22 3.928e-05 3.994e-05 4.071e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.651e-05 2.999e-05 3.198e-05 0.00% Gravity::set_mass_offset() 11 2.33e-05 2.8e-05 3.033e-05 0.00% ClusterList::chop() 2 0 5.299e-06 2.12e-05 0.00% Amr::initialInit() 1 3.591e-06 6.869e-06 1.525e-05 0.00% Amr::InitializeInit() 1 6.013e-06 8.946e-06 1.313e-05 0.00% MLMG::compResidual() 1 1.135e-05 1.178e-05 1.256e-05 0.00% Castro::computeInitialDt() 2 1.071e-05 1.136e-05 1.162e-05 0.00% Amr::init() 1 5.731e-06 6.733e-06 7.236e-06 0.00% knapsack()swap 2 4.69e-06 4.895e-06 5.02e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.55 54.56 54.56 100.00% Amr::coarseTimeStep() 10 51.83 51.83 51.83 95.00% Amr::timeStep() 30 51.75 51.75 51.75 94.85% Castro::advance() 30 36.35 36.35 36.35 66.63% Castro::subcycle_advance_ctu() 30 34.57 34.58 34.6 63.43% Castro::do_advance_ctu() 30 34.57 34.58 34.6 63.43% Castro::construct_ctu_hydro_source() 30 16.34 16.52 16.63 30.48% Gravity::actual_solve_with_mlmg() 81 13.74 13.74 13.74 25.19% MLMG::solve() 80 13.01 13.02 13.03 23.89% Castro::post_timestep() 30 12.3 12.3 12.31 22.56% MLMG::oneIter() 333 10.97 10.99 11.03 20.22% Castro::clean_state() 254 10.43 10.54 10.65 19.53% Gravity::solve_phi_with_mlmg() 71 10.28 10.33 10.36 19.00% Castro::reflux() 10 9.748 9.773 9.79 17.94% MLMG::mgVcycle() 489 9.661 9.685 9.741 17.86% Gravity::solve_for_phi() 60 8.611 8.651 8.688 15.93% MLCellLinOp::smooth() 5996 6.646 6.804 7.223 13.24% Castro::computeTemp() 257 6.184 6.244 6.295 11.54% Castro::reset_internal_energy() 257 5.714 5.773 5.826 10.68% Castro::construct_new_gravity() 30 5.222 5.225 5.229 9.58% Gravity::gravity_sync() 10 5.2 5.2 5.2 9.53% Castro::construct_old_gravity() 30 4.858 4.889 4.913 9.01% MLPoisson::Fsmooth() 11992 4.176 4.394 4.899 8.98% Castro::evaluate_source_change() 591 4.568 4.581 4.601 8.43% Gravity::solve_for_delta_phi 10 4.378 4.379 4.38 8.03% MLMG::mgVcycle_down::0 333 4.099 4.113 4.136 7.58% Castro::enforce_min_density() 254 3.811 3.862 3.931 7.21% FillPatchIterator::Initialize 723 3.306 3.317 3.327 6.10% Castro::do_new_sources() 50 3.22 3.261 3.292 6.03% MLCellLinOp::applyBC() 14630 3.013 3.141 3.241 5.94% Amr::regrid() 10 3.141 3.155 3.171 5.81% MLMG::mgVcycle_up::0 333 2.909 3.065 3.122 5.72% Castro::post_regrid() 22 2.957 2.973 2.993 5.49% FabArray::ParallelCopy() 5320 2.041 2.595 2.817 5.16% MultiFab::AddProduct() 4648 2.695 2.699 2.71 4.97% MLCellLinOp::apply() 2422 2.567 2.582 2.591 4.75% Castro::initialize_do_advance() 30 2.49 2.505 2.525 4.63% FabArray::setVal() 9464 2.302 2.326 2.367 4.34% FillPatchSingleLevel 853 2.243 2.269 2.284 4.19% Amr::init() 1 2.172 2.172 2.172 3.98% MLPoisson::Fapply() 2422 1.859 1.884 1.923 3.52% MLCellLinOp::solutionResidual() 530 1.73 1.778 1.799 3.30% FabArray::FillBoundary() 13093 1.248 1.601 1.795 3.29% MLCellLinOp::correctionResidual() 1660 1.656 1.677 1.705 3.13% Gravity::multilevel_solve_for_new_phi() 10 1.677 1.678 1.678 3.08% Gravity::actual_multilevel_solve() 10 1.669 1.669 1.669 3.06% MultiFab::Subtract() 601 1.635 1.643 1.65 3.02% Castro::derive() 397 1.62 1.632 1.642 3.01% Amr::initialInit() 1 1.577 1.577 1.577 2.89% MLMG:computeResOfCorrection() 1421 1.52 1.532 1.554 2.85% FabArray::ParallelCopy_nowait() 5320 1.43 1.465 1.514 2.78% Castro::do_old_sources() 30 1.484 1.494 1.508 2.76% Castro::volWgtSum() 242 1.339 1.408 1.49 2.73% Castro::initialize_advance() 30 1.344 1.364 1.382 2.53% FabArray::ParallelCopy_finish() 5320 0.5116 1.115 1.333 2.44% Amr::FinalizeInit() 1 1.25 1.255 1.264 2.32% Castro::expand_state() 30 1.167 1.18 1.189 2.18% FillPatchTwoLevels 394 1.147 1.17 1.189 2.18% Gravity::fill_multipole_BCs() 41 1.094 1.134 1.171 2.15% Amr::writePlotFile() 2 1.145 1.145 1.145 2.10% FluxRegister::Reflux() 180 1.123 1.125 1.127 2.07% FillBoundary_finish() 13093 0.4337 0.8481 1.096 2.01% MLMG::addInterpCorrection() 1421 0.3083 0.8523 1.041 1.91% Gravity::get_new_grav_vector() 52 0.9942 0.9994 1.005 1.84% Castro::post_init() 2 0.94 0.9468 0.9673 1.77% MLMG::computeResidual() 333 0.9084 0.9328 0.9438 1.73% MLMG::computeResWithCrseSolFineCor() 78 0.9323 0.9327 0.9332 1.71% MultiFab::sum() 4648 0.8768 0.8797 0.8827 1.62% MLMG::mgVcycle_down::1 333 0.7207 0.7433 0.8005 1.47% FillBoundary_nowait() 13093 0.6677 0.7202 0.7785 1.43% MultiFab::Xpay() 2190 0.7029 0.7123 0.7281 1.33% MLMG::mgVcycle_up::2 333 0.2215 0.5637 0.682 1.25% MLCellLinOp::reflux() 116 0.6531 0.6546 0.6565 1.20% MLMG::computeMLResidual() 97 0.5824 0.6108 0.6248 1.15% Castro::construct_new_source() 250 0.5979 0.6065 0.6174 1.13% Castro::construct_new_gravity_source() 50 0.5973 0.6059 0.6168 1.13% MLMG::mgVcycle_up::1 333 0.4913 0.5116 0.5688 1.04% FillPatchInterp(Fab) 130 0.3729 0.458 0.543 1.00% CellConservativeLinear::interp() 130 0.3701 0.456 0.5413 0.99% Gravity::get_old_grav_vector() 30 0.5258 0.5301 0.5343 0.98% Castro::normalize_species() 254 0.5074 0.5093 0.5111 0.94% Castro::finalize_advance() 30 0.3987 0.4047 0.4137 0.76% MLPoisson::define() 81 0.3728 0.3829 0.4033 0.74% MLPoisson::FFlux() 1044 0.3851 0.3876 0.3886 0.71% MultiFab::min() 30 0.007272 0.1391 0.3492 0.64% StateDataPhysBCFunct::() 853 0.3336 0.3382 0.3406 0.62% MLMG::mgVcycle_bottom 489 0.1672 0.2093 0.3349 0.61% amrex::average_down 1713 0.2994 0.3097 0.334 0.61% StateData::FillBoundary(geom) 63 0.3248 0.3291 0.3322 0.61% MLMG::prepareForSolve() 80 0.3062 0.3138 0.33 0.60% Castro::estTimeStep() 69 0.2406 0.2821 0.3297 0.60% Amr::InitializeInit() 1 0.3122 0.3221 0.3264 0.60% Amr::defBaseLevel() 1 0.3122 0.3221 0.3264 0.60% Castro::initData() 3 0.2819 0.2893 0.2941 0.54% MLMG::mgVcycle_down::2 333 0.2575 0.2655 0.2863 0.52% Castro::apply_source_to_state() 100 0.2707 0.272 0.2726 0.50% MultiFab::Saxpy() 100 0.2704 0.2716 0.2723 0.50% MLCellLinOp::defineAuxData() 81 0.214 0.2244 0.2465 0.45% MLMG::getGradSolution() 80 0.2151 0.216 0.217 0.40% MLCellLinOp::compGrad() 100 0.2149 0.2158 0.2167 0.40% MLMG::mgVcycle_down::3 211 0.03291 0.07571 0.2002 0.37% Amr::bldFineLevels() 1 0.1692 0.1774 0.1802 0.33% VisMF::Write(FabArray) 4 0.1648 0.1681 0.176 0.32% Castro::computeNewDt() 18 0.1426 0.1553 0.1727 0.32% MLMG::miniCycle() 156 0.1668 0.1674 0.1688 0.31% MLMG::actualBottomSolve() 333 0.0003898 0.04179 0.166 0.30% MLCGSolver::bicgstab 83 0 0.0399 0.1596 0.29% Castro::init(old) 9 0.151 0.1526 0.1544 0.28% MLMG::ResNormInf() 450 0.1266 0.1391 0.1486 0.27% FabArray::mult() 294 0.1448 0.1459 0.1467 0.27% MLCellLinOp::defineBC() 81 0.1408 0.1424 0.1447 0.27% MultiFab::Multiply() 164 0.1431 0.1438 0.1444 0.26% MLMG::mgVcycle_up::3 211 0.02469 0.05511 0.1433 0.26% FabArray::setDomainBndry() 853 0.1233 0.1302 0.1406 0.26% Castro::construct_old_source() 150 0.1334 0.134 0.1343 0.25% Castro::construct_old_gravity_source() 30 0.1331 0.1337 0.134 0.25% Castro::volProductSum() 22 0.1207 0.1254 0.1303 0.24% BndryData::define() 123 0.1157 0.1171 0.1186 0.22% Amr::grid_places() 11 0.1112 0.1114 0.1115 0.20% AmrMesh::MakeNewGrids() 11 0.1106 0.1108 0.111 0.20% MLCellLinOp::updateSolBC() 99 0.08336 0.098 0.1064 0.20% MLMG::computeResWithCrseCorFineCor() 78 0.1044 0.1054 0.1058 0.19% Gravity::GetCrsePhi() 40 0.09193 0.09638 0.1013 0.19% Castro::check_for_nan() 60 0.09288 0.09345 0.09442 0.17% MultiFab::contains_nan() 60 0.09271 0.09327 0.09424 0.17% FabArrayBase::getCPC() 8152 0.06868 0.0735 0.08631 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08103 0.08143 0.08213 0.15% Gravity::test_level_grad_phi_curr() 20 0.08113 0.08169 0.08213 0.15% MultiFab::LinComb() 628 0.06477 0.06921 0.08152 0.15% MLMG::mgVcycle_down::4 211 0.03153 0.04394 0.07723 0.14% Gravity::update_max_rhs() 20 0.04648 0.05435 0.0752 0.14% MLCellLinOp::setLevelBC() 102 0.05258 0.06292 0.06716 0.12% MLCellLinOp::updateCorBC() 78 0.06405 0.06489 0.06547 0.12% Castro::errorEst() 11 0.05899 0.05997 0.06089 0.11% MLMG::mgVcycle_up::4 211 0.02482 0.03417 0.05933 0.11% Gravity::test_composite_phi() 1 0.05859 0.0586 0.05861 0.11% MLMG::interpCorrection_1 78 0.0296 0.04844 0.05721 0.10% MLMG::buildFineMask() 80 0.05004 0.05044 0.05072 0.09% Gravity::test_level_grad_phi_prev() 30 0.04638 0.04762 0.04982 0.09% MultiFab::norm0(mask) 57 0.04665 0.04706 0.04732 0.09% MLMG::MLResNormInf() 97 0.04371 0.04393 0.04418 0.08% FabArrayBase::CPC::define() 2260 0.0278 0.03189 0.04315 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03632 0.0384 0.04191 0.08% MultiFab::max() 40 0.01221 0.01967 0.04036 0.07% MultiFab::Copy() 100 0.03927 0.03949 0.03973 0.07% Castro::computeInitialDt() 2 0.0167 0.02108 0.03099 0.06% MLPoisson::prepareForSolve() 81 0.02502 0.0263 0.02946 0.05% MLMG::MLRhsNormInf() 80 0.02883 0.02902 0.02925 0.05% MLCellLinOp::prepareForSolve() 81 0.02465 0.02595 0.02912 0.05% FabArrayBase::getFB() 13093 0.02328 0.02461 0.02825 0.05% Castro::finalize_do_advance() 30 0.007725 0.01729 0.02334 0.04% Gravity::swapTimeLevels() 30 0.02166 0.02241 0.02295 0.04% Castro::apply_tagging_restrictions() 11 0.02098 0.02143 0.02205 0.04% CGSolver::sxay() 588 0 0.005327 0.02131 0.04% Castro::build_fine_mask() 153 0.01814 0.01836 0.01854 0.03% AmrLevel::AmrLevel(dm) 12 0.01656 0.0174 0.01836 0.03% StateData::define() 48 0.0163 0.01713 0.0181 0.03% MLLinOp::define() 81 0.01152 0.01538 0.01716 0.03% MLLinOp::defineGrids() 81 0.01122 0.01508 0.01686 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.0141 0.0149 0.01588 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003895 0.01558 0.03% MLMG::compResidual() 1 0.01365 0.01431 0.01467 0.03% Castro::avgDown() 11 0.01393 0.01408 0.01431 0.03% Castro::avgDown(state_indx) 44 0.01388 0.01402 0.01425 0.03% amrex::average_down_w_geom 44 0.01376 0.0139 0.01414 0.03% Castro::swap_state_time_levels() 30 0.01309 0.01358 0.01409 0.03% MultiFab::Dot() 463 0 0.003207 0.01283 0.02% TagBoxArray::mapPRD 11 0.006425 0.007698 0.009077 0.02% Castro::apply_problem_tags() 11 0.007553 0.007663 0.007802 0.01% Castro::FluxRegFineAdd() 30 0.007143 0.007278 0.007464 0.01% MLLinOp::makeSubCommunicator() 81 0.002243 0.005506 0.007207 0.01% AMRErrorTag::operator() 11 0.004676 0.004781 0.00489 0.01% Castro::enforce_consistent_e() 3 0.003476 0.003725 0.00397 0.01% FabArrayBase::TheFPinfo() 130 0.0007393 0.002264 0.003822 0.01% FPinfo::FPinfo() 3 0.0002293 0.00174 0.003304 0.01% DistributionMapping::KnapSackDoIt() 3 0.000133 0.001631 0.003191 0.01% DistributionMapping::LeastUsedCPUs() 5 8.012e-05 0.001623 0.003125 0.01% MLLinOp::makeAgglomeratedDMap 81 0.002195 0.002418 0.002557 0.00% Amr::InitAmr() 1 0.002505 0.002524 0.002541 0.00% FabArrayBase::FB::FB() 131 0.0008449 0.001245 0.002412 0.00% makeSFC 243 0.001463 0.00163 0.001732 0.00% OwnerMask() 11 0.001467 0.001535 0.00161 0.00% TagBoxArray::collate() 11 0.001239 0.001317 0.001487 0.00% DistributionMapping::Distribute() 245 0.0004953 0.0005014 0.000509 0.00% Castro::enforce_speed_limit() 254 0.0003972 0.0004016 0.0004076 0.00% AmrMesh-cluster 2 0 8.563e-05 0.0003425 0.00% ClusterList::intersect() 2 0 5.614e-05 0.0002246 0.00% FabArray::RecvLayoutMask() 21 0.000193 0.000195 0.0001982 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.077e-05 0.0001372 0.0001932 0.00% Castro::create_source_corrector() 30 7.914e-05 8.409e-05 9.149e-05 0.00% BoxList::parallelComplementIn() 22 7.938e-05 8.168e-05 8.287e-05 0.00% Castro::retry_advance_ctu() 30 5.032e-05 6.194e-05 7.466e-05 0.00% Amr::writeSmallPlotFile() 1 7.118e-05 7.213e-05 7.349e-05 0.00% knapsack() 3 6.232e-05 6.611e-05 6.886e-05 0.00% Amr::initSubcycle() 1 4.083e-05 5.007e-05 5.971e-05 0.00% Castro::gwstrain() 22 3.713e-05 4.086e-05 4.699e-05 0.00% BoxList::complementIn 22 3.928e-05 3.994e-05 4.071e-05 0.00% Gravity::set_mass_offset() 11 2.33e-05 2.8e-05 3.033e-05 0.00% ClusterList::chop() 2 0 5.299e-06 2.12e-05 0.00% knapsack()swap 2 4.69e-06 4.895e-06 5.02e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.03-10-gfbdfc840de7c) finalized