MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.01-39-g874ccc6f3f8d) initialized Starting run at 06:34:21 UTC on 2022-01-27. Successfully read inputs file ... Castro git describe: 21.12-27-g958e0cc7a AMReX git describe: 22.01-39-g874ccc6f3 Microphysics git describe: 22.01-20-g1a290c72 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.010943352 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.01146869 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.033636343 Gravity::fill_multipole_BCs() time = 0.029844765 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.629898445 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.035064463 Gravity::solve_for_phi() time = 0.415292001 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -7.250787575e+22 ymom added: -5.289050461e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 2.748779069e+11 Castro::do_old_sources() time = 0.150005566 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.493859181 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031340279 Gravity::solve_for_phi() time = 0.360789666 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.165191017 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0811142498 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008242194 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009906049 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109754396 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04509989 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010908015 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01566027505 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00802752 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009655576 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10971116 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044950553 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010655159 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01446390003 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028793296 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010531935 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.159423075 Castro::reflux() at level 0 : time = 1.065931201 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 5.10949168 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009959513 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.031374108 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.040020631 Gravity::solve_for_phi() time = 0.396228822 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852866e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.142616094 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.496275177 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032089855 Gravity::solve_for_phi() time = 0.344779066 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125187e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.158831925 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08309765772 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008372653 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009549608 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108083316 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043621315 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010332618 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01618690718 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008039427 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009382129 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10705099 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043666787 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010395477 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01479501311 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028467741 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.009908357 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770254e+28 zmom added: 8.082913462e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.151823327 Castro::reflux() at level 0 : time = 1.005400473 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.347343859 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009573719 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028553849 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029550172 Gravity::solve_for_phi() time = 0.384316899 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939017e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.13826416 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.460577403 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033170912 Gravity::solve_for_phi() time = 0.345580907 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.161623042 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08469050574 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00860091 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009440415 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107794841 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045411406 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010257646 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01605513937 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008630108 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009536118 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10772336 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043826928 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010743692 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01472473007 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02950892 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010348562 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655088e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342337e+27 ymom added: 5.311566493e+28 zmom added: 5.312402181e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.152345043 Castro::reflux() at level 0 : time = 1.021523221 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.216220842 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009945632 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029217048 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.040030766 Gravity::solve_for_phi() time = 0.398140834 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700672e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.141271641 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.53428794 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.051874964 Gravity::solve_for_phi() time = 0.377401042 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.157601471 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08141519905 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008207161 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009353626 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108151472 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044612809 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.01029479 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01611602366 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007775001 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009156121 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106982424 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044586991 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.01033552 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01496869077 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028603029 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010185105 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.152279977 Castro::reflux() at level 0 : time = 0.948563066 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.264517194 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009791532 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029161119 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029677502 Gravity::solve_for_phi() time = 0.383657868 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150478e+30 ymom added: 3.39980379e+30 zmom added: 3.399742248e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.136816334 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.458279336 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027635337 Gravity::solve_for_phi() time = 0.33480357 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591233e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.155306507 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08537588966 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008658404 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009974682 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109771633 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045260478 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010994063 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01587632393 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008527419 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009297313 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107956201 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043604403 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010364257 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01486052965 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029411981 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.009994266 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277776e+28 zmom added: 7.267043465e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.153089777 Castro::reflux() at level 0 : time = 0.951612487 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.135628386 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009709971 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028376126 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030258634 Gravity::solve_for_phi() time = 0.383006921 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919313e+30 ymom added: 4.094511425e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.137408936 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.453176283 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02851868 Gravity::solve_for_phi() time = 0.336419058 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245025e+27 ymom added: -5.297264713e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.152822992 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08556304228 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008077909 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009332319 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106967011 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043393499 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.01009385 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01633671794 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00803901 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009097373 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10712026 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043316327 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.01036067 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01506886931 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028522568 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010115921 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781791e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.152997488 Castro::reflux() at level 0 : time = 0.95131682 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.122005538 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009587806 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028771793 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029728897 Gravity::solve_for_phi() time = 0.38432027 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151126e+30 ymom added: 4.515687958e+30 zmom added: 4.515608962e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.136894626 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.464545211 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02951795 Gravity::solve_for_phi() time = 0.337840447 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.881752621e+28 zmom added: -2.881735255e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.153041347 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08518041829 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007992799 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009556602 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107512736 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04310933 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010424711 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01629803776 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008111565 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009378068 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10791954 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042874434 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010526651 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01490753556 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028457633 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.010293975 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.153750331 Castro::reflux() at level 0 : time = 0.948721857 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.20131626 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009750285 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028445062 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.039078855 Gravity::solve_for_phi() time = 0.397215019 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064078e+30 ymom added: 4.889542979e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.142632003 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.460803114 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029587998 Gravity::solve_for_phi() time = 0.383878462 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642725e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.15291364 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08344013204 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007985117 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009111059 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107476509 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044479751 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010399686 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01631498916 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007923985 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009405378 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106953893 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043339878 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010327448 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0150384064 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028531236 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010146385 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907345e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.153171148 Castro::reflux() at level 0 : time = 0.947892608 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.282050782 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.00979948 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028497916 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034782442 Gravity::solve_for_phi() time = 0.388526159 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036368e+30 ymom added: 5.530451715e+30 zmom added: 5.530356437e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.136549266 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.454891256 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031049776 Gravity::solve_for_phi() time = 0.384239263 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.06117034e+28 zmom added: -5.061201611e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.152962423 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08413634862 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00782476 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009377294 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107153465 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043363069 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010249772 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01641499302 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008005538 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009371736 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106837871 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043100035 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.010225454 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01507308316 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028373374 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.010400911 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.153080014 Castro::reflux() at level 0 : time = 0.949949379 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.253904776 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009658704 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028464503 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034626393 Gravity::solve_for_phi() time = 0.3896805 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167199e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.138470006 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.458170875 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030120923 Gravity::solve_for_phi() time = 0.384247299 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.152907282 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08393453674 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00802576 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009181729 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107437888 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.049131797 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010198601 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01592432339 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008317514 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009580491 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107025398 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04870714 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010016709 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01478246945 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028509139 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010184096 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914874e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.153263042 Castro::reflux() at level 0 : time = 1.005985789 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.315568959 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.54560833 seconds Ending run at 06:35:16 UTC on 2022-01-27. Run time = 54.97621656 Run time without initialization = 52.73243231 Average number of zones advanced per microsecond: 0.051 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.97 ... 54.98 ... 54.98 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.7041 16.8011 16.8939 30.73% MLPoisson::Fsmooth() 11992 4.192 4.266 4.406 8.01% MultiFab::AddProduct() 4648 2.622 2.788 3.252 5.92% Castro::reset_internal_energy() 257 2.92 3.022 3.245 5.90% FabArray::setVal() 9416 2.316 2.325 2.337 4.25% MLPoisson::Fapply() 2422 1.903 1.982 2.174 3.96% MLCellLinOp::applyBC() 14630 1.466 1.527 1.663 3.03% MultiFab::Subtract() 601 1.62 1.63 1.642 2.99% FabArray::ParallelCopy_nowait() 5320 1.377 1.396 1.405 2.55% Castro::enforce_min_density() 254 1.041 1.145 1.404 2.55% FabArray::ParallelCopy_finish() 5320 0.5774 1.08 1.273 2.31% Gravity::fill_multipole_BCs() 41 1.064 1.146 1.236 2.25% Castro::derive() 397 0.9314 0.9338 0.9363 1.70% MultiFab::sum() 4648 0.891 0.8949 0.9031 1.64% FluxRegister::Reflux() 180 0.8272 0.8326 0.8362 1.52% MultiFab::Xpay() 2190 0.7219 0.7296 0.7409 1.35% FillBoundary_finish() 13093 0.4996 0.6394 0.7319 1.33% Castro::reflux() 10 0.6927 0.6963 0.7006 1.27% FillBoundary_nowait() 13093 0.6405 0.6538 0.6706 1.22% Castro::construct_new_gravity_source() 50 0.6039 0.6107 0.6191 1.13% Castro::volWgtSum() 242 0.5366 0.5556 0.5672 1.03% CellConservativeLinear::interp() 130 0.3778 0.4681 0.5587 1.02% Castro::estTimeStep() 69 0.2264 0.4003 0.5423 0.99% Castro::normalize_species() 254 0.5088 0.513 0.5176 0.94% Castro::computeTemp() 257 0.4654 0.4689 0.472 0.86% MLPoisson::FFlux() 1044 0.3895 0.392 0.3936 0.72% Castro::finalize_advance() 30 0.3549 0.3575 0.3596 0.65% Gravity::get_new_grav_vector() 52 0.3313 0.3325 0.3339 0.61% FillPatchSingleLevel 853 0.3206 0.3242 0.3289 0.60% StateData::FillBoundary(geom) 63 0.3205 0.3242 0.3263 0.59% MultiFab::Saxpy() 100 0.2828 0.2842 0.286 0.52% amrex::average_down 1713 0.2664 0.2711 0.2807 0.51% MLMG::addInterpCorrection() 1421 0.2574 0.2627 0.2744 0.50% FillPatchIterator::Initialize 723 0.2504 0.2655 0.2738 0.50% Castro::do_advance_ctu() 30 0.2148 0.2165 0.2185 0.40% MLMG::oneIter() 333 0.2118 0.2129 0.2141 0.39% Castro::post_timestep() 30 0.01922 0.1379 0.2074 0.38% MultiFab::min() 30 0.007262 0.09767 0.2033 0.37% Castro::expand_state() 30 0.19 0.1911 0.1924 0.35% MLCellLinOp::defineAuxData() 81 0.175 0.1778 0.186 0.34% MLCellLinOp::reflux() 116 0.1733 0.1752 0.1782 0.32% MLMG::ResNormInf() 450 0.09096 0.148 0.1758 0.32% VisMF::Write(FabArray) 4 0.1632 0.1676 0.1757 0.32% MLCellLinOp::compGrad() 100 0.1708 0.172 0.173 0.31% Gravity::get_old_grav_vector() 30 0.1643 0.1657 0.167 0.30% Amr::writePlotFile() 2 0.1431 0.1517 0.156 0.28% MultiFab::Multiply() 164 0.1473 0.1478 0.1483 0.27% FabArray::mult() 294 0.1435 0.1443 0.145 0.26% Castro::construct_old_gravity_source() 30 0.1347 0.1357 0.1367 0.25% FabArray::setDomainBndry() 853 0.1307 0.1329 0.1347 0.25% MultiFab::contains_nan() 60 0.0984 0.09918 0.1002 0.18% BndryData::define() 123 0.08799 0.08936 0.09034 0.16% Castro::construct_old_gravity() 30 0.08707 0.08719 0.08728 0.16% MLMG::prepareForSolve() 80 0.0811 0.08192 0.08229 0.15% MultiFab::LinComb() 628 0.06486 0.06891 0.07963 0.14% Castro::evaluate_source_change() 591 0.07646 0.07714 0.07783 0.14% Gravity::test_level_grad_phi_curr() 20 0.07212 0.07286 0.07444 0.14% Gravity::gravity_sync() 10 0.071 0.07143 0.0721 0.13% Castro::initData() 3 0.05857 0.06187 0.06784 0.12% MLCellLinOp::updateSolBC() 99 0.05765 0.05813 0.05854 0.11% Castro::construct_new_gravity() 30 0.0531 0.05473 0.05802 0.11% MLCGSolver::bicgstab 83 0 0.01419 0.05676 0.10% Castro::volProductSum() 22 0.04838 0.04951 0.0519 0.09% Castro::do_new_sources() 50 0.000816 0.01299 0.04836 0.09% MultiFab::norm0(mask) 57 0.04602 0.04621 0.04649 0.08% MLCellLinOp::updateCorBC() 78 0.04554 0.04591 0.04615 0.08% Gravity::create_comp_minus_level_grad_phi() 10 0.04515 0.04541 0.04564 0.08% Castro::initialize_do_advance() 30 0.03582 0.03863 0.04417 0.08% FabArrayBase::CPC::define() 2260 0.02775 0.03195 0.04318 0.08% Gravity::actual_solve_with_mlmg() 81 0.03706 0.04013 0.0418 0.08% FabArrayBase::getCPC() 8152 0.041 0.04135 0.04171 0.08% Gravity::test_level_grad_phi_prev() 30 0.04125 0.04137 0.04157 0.08% MLCellLinOp::setLevelBC() 102 0.04074 0.04109 0.04144 0.08% MultiFab::Copy() 100 0.03903 0.0393 0.03962 0.07% MLMG::buildFineMask() 80 0.0388 0.03919 0.03962 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03612 0.03676 0.03772 0.07% Gravity::solve_for_phi() 60 0.02671 0.02998 0.03742 0.07% AmrMesh::MakeNewGrids() 11 0.0352 0.03578 0.03639 0.07% Castro::post_init() 2 0.0003742 0.01453 0.03486 0.06% FabArray::FillBoundary() 13093 0.03126 0.03202 0.03426 0.06% Amr::defBaseLevel() 1 0.02412 0.02761 0.03061 0.06% MLCellLinOp::smooth() 5996 0.02567 0.02707 0.02835 0.05% Castro::do_old_sources() 30 0.0004798 0.007515 0.02809 0.05% MLCellLinOp::prepareForSolve() 81 0.02472 0.02564 0.02797 0.05% Castro::init(old) 9 0.02618 0.02629 0.02642 0.05% Castro::initialize_advance() 30 0.02533 0.02601 0.02642 0.05% MultiFab::max() 40 0.01393 0.01934 0.02563 0.05% FabArrayBase::getFB() 13093 0.02254 0.02334 0.02525 0.05% MLCellLinOp::defineBC() 81 0.02424 0.02437 0.02474 0.05% Gravity::update_max_rhs() 20 0.02392 0.02419 0.02447 0.04% MLMG::interpCorrection_1 78 0.02298 0.02311 0.02321 0.04% FillPatchTwoLevels 394 0.01632 0.01837 0.02134 0.04% Castro::apply_tagging_restrictions() 11 0.02086 0.02098 0.02117 0.04% Castro::finalize_do_advance() 30 0.008883 0.01499 0.02013 0.04% Castro::build_fine_mask() 153 0.01825 0.01841 0.01851 0.03% StateData::define() 48 0.01477 0.01639 0.01773 0.03% Amr::regrid() 10 0.01488 0.01564 0.01685 0.03% FabArray::ParallelCopy() 5320 0.01407 0.01431 0.01472 0.03% MLMG::solve() 80 0.004464 0.01131 0.01456 0.03% Castro::swap_state_time_levels() 30 0.01327 0.01339 0.0136 0.02% MLMG::MLRhsNormInf() 80 0.01226 0.01237 0.01253 0.02% Gravity::actual_multilevel_solve() 10 0.01188 0.01205 0.01227 0.02% MultiFab::Dot() 463 0 0.002788 0.01115 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008278 0.008802 0.009967 0.02% StateDataPhysBCFunct::() 853 0.007123 0.008967 0.009964 0.02% Gravity::GetCrsePhi() 40 0.009725 0.009811 0.009905 0.02% MLCellLinOp::apply() 2422 0.005648 0.00665 0.009219 0.02% Castro::FluxRegFineAdd() 30 0.007455 0.007578 0.007675 0.01% MLLinOp::makeSubCommunicator() 81 0.003275 0.006345 0.007652 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001905 0.007619 0.01% Castro::apply_problem_tags() 11 0.007542 0.00757 0.007612 0.01% MLLinOp::defineGrids() 81 0.006834 0.007052 0.007403 0.01% Castro::enforce_consistent_e() 3 0.003437 0.004975 0.00626 0.01% MLCellLinOp::correctionResidual() 1660 0.004612 0.004974 0.005805 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005085 0.005113 0.005147 0.01% AMRErrorTag::operator() 11 0.004909 0.005002 0.005064 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004941 0.004981 0.005035 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004875 0.004906 0.004933 0.01% CGSolver::sxay() 588 0 0.001225 0.004899 0.01% MLMG::mgVcycle() 489 0.004103 0.004172 0.004369 0.01% main() 1 0.002603 0.00344 0.004302 0.01% Gravity::test_composite_phi() 1 0.003844 0.004002 0.004101 0.01% MLMG:computeResOfCorrection() 1421 0.003323 0.003373 0.003468 0.01% MLMG::actualBottomSolve() 333 0.0003942 0.00114 0.00336 0.01% FillPatchInterp(Fab) 130 0.001718 0.002057 0.002777 0.01% Amr::InitAmr() 1 0.002467 0.002482 0.00249 0.00% FabArrayBase::FB::FB() 131 0.0008509 0.001241 0.002373 0.00% MLMG::mgVcycle_down::0 333 0.002253 0.002275 0.002291 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0003627 0.00148 0.002212 0.00% MLMG::mgVcycle_down::1 333 0.002058 0.002106 0.002144 0.00% Castro::subcycle_advance_ctu() 30 0.0001898 0.0006794 0.002132 0.00% MLMG::mgVcycle_down::2 333 0.001901 0.00196 0.001994 0.00% MLCellLinOp::solutionResidual() 530 0.001935 0.001959 0.001975 0.00% Gravity::solve_phi_with_mlmg() 71 0.001583 0.001685 0.00191 0.00% Castro::clean_state() 254 0.001551 0.001566 0.001583 0.00% MLMG::mgVcycle_up::0 333 0.001549 0.001566 0.001578 0.00% OwnerMask() 11 0.001401 0.001473 0.001529 0.00% TagBoxArray::collate() 11 0.0007932 0.001224 0.001518 0.00% MLMG::mgVcycle_up::2 333 0.00134 0.001382 0.001443 0.00% Amr::bldFineLevels() 1 0.001284 0.001337 0.001422 0.00% MLMG::mgVcycle_up::1 333 0.001339 0.001382 0.001414 0.00% MLMG::mgVcycle_bottom 489 0.001266 0.001293 0.001332 0.00% MLMG::mgVcycle_down::3 211 0.001198 0.001226 0.001282 0.00% MLMG::mgVcycle_down::4 211 0.001131 0.001169 0.001262 0.00% makeSFC 243 0.001083 0.001132 0.001205 0.00% Amr::coarseTimeStep() 10 0.0005919 0.000697 0.0009618 0.00% MLMG::mgVcycle_up::4 211 0.0007773 0.0008147 0.0009194 0.00% TagBoxArray::mapPRD 11 0.0008215 0.0008507 0.0008681 0.00% MLMG::mgVcycle_up::3 211 0.0007458 0.0007781 0.0008602 0.00% MLMG::computeResidual() 333 0.0008122 0.0008236 0.0008307 0.00% MLMG::MLResNormInf() 97 0.0006781 0.0007407 0.000812 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007573 0.0007749 0.0007975 0.00% Amr::timeStep() 30 0.0004441 0.0005428 0.0007814 0.00% MLPoisson::define() 81 0.0006217 0.0006383 0.0006657 0.00% Amr::grid_places() 11 0.0004819 0.0005159 0.0006132 0.00% Castro::construct_new_source() 250 0.0005675 0.0005788 0.0006027 0.00% FabArrayBase::TheFPinfo() 130 0.000516 0.0005281 0.0005494 0.00% DistributionMapping::Distribute() 245 0.0004768 0.000483 0.0004871 0.00% Castro::enforce_speed_limit() 254 0.0003735 0.0003817 0.0003961 0.00% MLPoisson::prepareForSolve() 81 0.0003446 0.0003593 0.0003737 0.00% Castro::apply_source_to_state() 100 0.0003292 0.0003469 0.0003649 0.00% Castro::computeNewDt() 18 0.0001168 0.0002078 0.0003603 0.00% MLMG::computeMLResidual() 97 0.0003002 0.0003052 0.0003095 0.00% MLLinOp::define() 81 0.0002897 0.0002968 0.0003058 0.00% Castro::construct_old_source() 150 0.000285 0.0002913 0.0002994 0.00% AmrLevel::AmrLevel(dm) 12 0.0002548 0.000264 0.0002818 0.00% MLMG::miniCycle() 156 0.0002667 0.0002703 0.0002787 0.00% MLMG::getGradSolution() 80 0.0002523 0.000257 0.0002651 0.00% Castro::post_regrid() 22 0.0002298 0.0002406 0.0002575 0.00% Castro::advance() 30 0.0002081 0.0002177 0.0002376 0.00% ClusterList::intersect() 2 0 5.756e-05 0.0002302 0.00% FabArray::RecvLayoutMask() 21 0.0001913 0.0001938 0.0001958 0.00% Castro::check_for_nan() 60 0.0001842 0.0001868 0.0001922 0.00% Gravity::swapTimeLevels() 30 0.0001766 0.0001844 0.000191 0.00% Castro::errorEst() 11 0.0001215 0.0001231 0.0001266 0.00% Castro::avgDown(state_indx) 44 0.000112 0.0001155 0.0001177 0.00% Amr::FinalizeInit() 1 2.046e-05 4.786e-05 0.0001155 0.00% FPinfo::FPinfo() 3 0.0001049 0.0001095 0.0001153 0.00% AmrMesh-cluster 2 0 2.495e-05 9.981e-05 0.00% amrex::average_down_w_geom 44 8.542e-05 8.847e-05 9.139e-05 0.00% Gravity::solve_for_delta_phi 10 8.303e-05 8.575e-05 9.137e-05 0.00% Castro::create_source_corrector() 30 8.153e-05 8.497e-05 8.772e-05 0.00% Amr::writeSmallPlotFile() 1 7.109e-05 7.264e-05 7.46e-05 0.00% knapsack() 3 6.053e-05 6.472e-05 7.227e-05 0.00% Castro::retry_advance_ctu() 30 4.83e-05 5.752e-05 6.42e-05 0.00% Amr::initSubcycle() 1 3.595e-05 5.085e-05 6.405e-05 0.00% Castro::avgDown() 11 5.55e-05 5.944e-05 6.157e-05 0.00% Gravity::set_mass_offset() 11 2.294e-05 3.605e-05 5.384e-05 0.00% Castro::gwstrain() 22 3.77e-05 4.142e-05 4.7e-05 0.00% BoxList::parallelComplementIn() 22 4.061e-05 4.169e-05 4.322e-05 0.00% BoxList::complementIn 22 3.892e-05 3.995e-05 4.156e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.164e-05 3.575e-05 3.761e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.83e-05 3.102e-05 3.431e-05 0.00% ClusterList::chop() 2 0 5.655e-06 2.262e-05 0.00% MLMG::compResidual() 1 1.207e-05 1.257e-05 1.307e-05 0.00% Amr::InitializeInit() 1 5.734e-06 7.983e-06 1.223e-05 0.00% Castro::computeInitialDt() 2 1.08e-05 1.131e-05 1.181e-05 0.00% Amr::init() 1 6.148e-06 6.675e-06 7.134e-06 0.00% knapsack()swap 2 5.136e-06 5.424e-06 5.599e-06 0.00% Amr::initialInit() 1 4.477e-06 4.867e-06 5.496e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.97 54.98 54.98 100.00% Amr::coarseTimeStep() 10 52.18 52.18 52.18 94.92% Amr::timeStep() 30 52 52.03 52.11 94.78% Castro::advance() 30 36.59 36.59 36.59 66.56% Castro::subcycle_advance_ctu() 30 34.78 34.81 34.85 63.39% Castro::do_advance_ctu() 30 34.78 34.81 34.85 63.39% Castro::construct_ctu_hydro_source() 30 16.7 16.8 16.89 30.73% Gravity::actual_solve_with_mlmg() 81 13.42 13.42 13.43 24.42% MLMG::solve() 80 12.7 12.71 12.71 23.13% Castro::post_timestep() 30 12.24 12.27 12.35 22.47% Castro::clean_state() 254 10.41 10.76 11.07 20.14% MLMG::oneIter() 333 10.61 10.62 10.63 19.33% Gravity::solve_phi_with_mlmg() 71 10.06 10.14 10.24 18.63% Castro::reflux() 10 9.661 9.731 9.797 17.82% MLMG::mgVcycle() 489 9.276 9.287 9.298 16.91% Gravity::solve_for_phi() 60 8.377 8.46 8.556 15.56% MLCellLinOp::smooth() 5996 6.265 6.447 6.771 12.32% Castro::computeTemp() 257 6.189 6.358 6.523 11.86% Castro::reset_internal_energy() 257 5.719 5.889 6.051 11.01% Castro::construct_new_gravity() 30 5.114 5.151 5.193 9.45% Castro::evaluate_source_change() 591 4.516 4.689 5.169 9.40% Gravity::gravity_sync() 10 5.107 5.108 5.108 9.29% Castro::construct_old_gravity() 30 4.724 4.772 4.826 8.78% MLPoisson::Fsmooth() 11992 4.192 4.266 4.406 8.01% Gravity::solve_for_delta_phi 10 4.29 4.29 4.29 7.80% Castro::enforce_min_density() 254 3.808 3.976 4.152 7.55% MLMG::mgVcycle_down::0 333 3.912 3.949 4.035 7.34% FillPatchIterator::Initialize 723 3.269 3.343 3.406 6.20% Castro::do_new_sources() 50 3.217 3.319 3.403 6.19% MultiFab::AddProduct() 4648 2.622 2.788 3.252 5.92% Amr::regrid() 10 3.128 3.186 3.236 5.89% MLCellLinOp::applyBC() 14630 2.669 2.856 3.093 5.63% Castro::post_regrid() 22 2.934 2.998 3.054 5.55% MLMG::mgVcycle_up::0 333 2.674 2.874 2.944 5.36% MLCellLinOp::apply() 2422 2.533 2.615 2.767 5.03% FabArray::ParallelCopy() 5320 2.052 2.54 2.738 4.98% Castro::initialize_do_advance() 30 2.521 2.545 2.564 4.66% FabArray::setVal() 9416 2.316 2.325 2.337 4.25% FillPatchSingleLevel 853 2.222 2.271 2.316 4.21% Amr::init() 1 2.241 2.241 2.241 4.08% MLPoisson::Fapply() 2422 1.903 1.982 2.174 3.96% MLCellLinOp::solutionResidual() 530 1.738 1.795 1.908 3.47% MLCellLinOp::correctionResidual() 1660 1.656 1.704 1.755 3.19% Gravity::multilevel_solve_for_new_phi() 10 1.687 1.687 1.687 3.07% Gravity::actual_multilevel_solve() 10 1.677 1.678 1.678 3.05% Castro::derive() 397 1.636 1.639 1.643 2.99% MultiFab::Subtract() 601 1.62 1.63 1.642 2.99% MLMG:computeResOfCorrection() 1421 1.488 1.538 1.612 2.93% Amr::initialInit() 1 1.61 1.611 1.611 2.93% Castro::do_old_sources() 30 1.492 1.543 1.588 2.89% FabArray::ParallelCopy_nowait() 5320 1.425 1.446 1.459 2.65% FabArray::FillBoundary() 13093 1.206 1.35 1.446 2.63% Castro::initialize_advance() 30 1.356 1.386 1.417 2.58% Castro::volWgtSum() 242 1.35 1.369 1.383 2.52% Gravity::fill_multipole_BCs() 41 1.102 1.183 1.273 2.32% FabArray::ParallelCopy_finish() 5320 0.5774 1.08 1.273 2.31% Amr::FinalizeInit() 1 1.243 1.245 1.246 2.27% Castro::expand_state() 30 1.168 1.194 1.222 2.22% FillPatchTwoLevels 394 1.17 1.192 1.208 2.20% Amr::writePlotFile() 2 1.176 1.176 1.176 2.14% FluxRegister::Reflux() 180 1.128 1.129 1.131 2.06% Gravity::get_new_grav_vector() 52 0.9987 0.9993 0.9998 1.82% MLMG::addInterpCorrection() 1421 0.3051 0.8168 0.9929 1.81% MLMG::computeResidual() 333 0.9164 0.9354 0.9897 1.80% MLMG::computeResWithCrseSolFineCor() 78 0.9702 0.9706 0.9709 1.77% Castro::post_init() 2 0.9545 0.9605 0.9666 1.76% MultiFab::sum() 4648 0.891 0.8949 0.9031 1.64% MLMG::mgVcycle_down::1 333 0.6773 0.7735 0.8757 1.59% MultiFab::Xpay() 2190 0.7219 0.7296 0.7409 1.35% FillBoundary_finish() 13093 0.4996 0.6394 0.7319 1.33% FillBoundary_nowait() 13093 0.6641 0.6784 0.6942 1.26% MLCellLinOp::reflux() 116 0.655 0.6709 0.6778 1.23% MLMG::mgVcycle_up::2 333 0.2121 0.5371 0.6486 1.18% MLMG::computeMLResidual() 97 0.6063 0.6249 0.6376 1.16% Castro::construct_new_source() 250 0.6045 0.6113 0.6197 1.13% Castro::construct_new_gravity_source() 50 0.6039 0.6107 0.6191 1.13% FillPatchInterp(Fab) 130 0.3806 0.4702 0.5604 1.02% CellConservativeLinear::interp() 130 0.3778 0.4681 0.5587 1.02% Castro::estTimeStep() 69 0.2264 0.4003 0.5423 0.99% Gravity::get_old_grav_vector() 30 0.5282 0.5312 0.5354 0.97% MLMG::mgVcycle_up::1 333 0.4632 0.4807 0.5279 0.96% Castro::normalize_species() 254 0.5088 0.513 0.5176 0.94% Castro::finalize_advance() 30 0.3896 0.3947 0.4007 0.73% MLPoisson::FFlux() 1044 0.3895 0.392 0.3936 0.72% MLPoisson::define() 81 0.3756 0.3806 0.3922 0.71% Amr::InitializeInit() 1 0.3641 0.3658 0.3677 0.67% Amr::defBaseLevel() 1 0.3641 0.3658 0.3677 0.67% Castro::computeNewDt() 18 0.1311 0.2617 0.3453 0.63% Castro::initData() 3 0.3242 0.3314 0.3381 0.62% StateDataPhysBCFunct::() 853 0.3304 0.3332 0.3352 0.61% StateData::FillBoundary(geom) 63 0.3205 0.3242 0.3263 0.59% amrex::average_down 1713 0.2905 0.3002 0.3246 0.59% MLMG::prepareForSolve() 80 0.3092 0.313 0.3212 0.58% MLMG::mgVcycle_bottom 489 0.1611 0.2012 0.3187 0.58% MLMG::mgVcycle_down::2 333 0.2463 0.2639 0.291 0.53% Castro::apply_source_to_state() 100 0.2831 0.2846 0.2863 0.52% MultiFab::Saxpy() 100 0.2828 0.2842 0.286 0.52% MLCellLinOp::defineAuxData() 81 0.2158 0.2212 0.2372 0.43% MLMG::getGradSolution() 80 0.2161 0.217 0.218 0.40% MLCellLinOp::compGrad() 100 0.2158 0.2167 0.2178 0.40% MLMG::ResNormInf() 450 0.121 0.1781 0.2058 0.37% MultiFab::min() 30 0.007262 0.09767 0.2033 0.37% MLMG::mgVcycle_down::3 211 0.0334 0.07367 0.1926 0.35% VisMF::Write(FabArray) 4 0.1632 0.1676 0.1757 0.32% Amr::bldFineLevels() 1 0.1631 0.1644 0.1661 0.30% MLMG::miniCycle() 156 0.1607 0.1617 0.1624 0.30% MLMG::actualBottomSolve() 333 0.0003942 0.03949 0.1568 0.29% Castro::init(old) 9 0.152 0.1533 0.1548 0.28% MLCGSolver::bicgstab 83 0 0.03766 0.1507 0.27% MultiFab::Multiply() 164 0.1473 0.1478 0.1483 0.27% FabArray::mult() 294 0.1435 0.1443 0.145 0.26% MLCellLinOp::defineBC() 81 0.1417 0.1426 0.1434 0.26% Castro::construct_old_source() 150 0.135 0.136 0.137 0.25% Castro::construct_old_gravity_source() 30 0.1347 0.1357 0.1367 0.25% MLMG::mgVcycle_up::3 211 0.02506 0.05316 0.1361 0.25% FabArray::setDomainBndry() 853 0.1307 0.1329 0.1347 0.25% Castro::volProductSum() 22 0.1204 0.1216 0.1239 0.23% BndryData::define() 123 0.1157 0.117 0.118 0.21% Amr::grid_places() 11 0.1096 0.11 0.1103 0.20% AmrMesh::MakeNewGrids() 11 0.109 0.1095 0.1099 0.20% MLMG::computeResWithCrseCorFineCor() 78 0.1041 0.1049 0.1057 0.19% Gravity::GetCrsePhi() 40 0.09066 0.09555 0.1008 0.18% Castro::check_for_nan() 60 0.09858 0.09937 0.1004 0.18% MultiFab::contains_nan() 60 0.0984 0.09918 0.1002 0.18% MLCellLinOp::updateSolBC() 99 0.087 0.09203 0.09498 0.17% FabArrayBase::getCPC() 8152 0.06875 0.0733 0.08489 0.15% Gravity::test_level_grad_phi_curr() 20 0.08173 0.0824 0.08388 0.15% Gravity::create_comp_minus_level_grad_phi() 10 0.08111 0.08152 0.0819 0.15% MultiFab::LinComb() 628 0.06486 0.06891 0.07963 0.14% MLMG::mgVcycle_down::4 211 0.0321 0.04282 0.07309 0.13% MLCellLinOp::updateCorBC() 78 0.06303 0.06365 0.06428 0.12% MLCellLinOp::setLevelBC() 102 0.05088 0.05889 0.06197 0.11% Gravity::test_composite_phi() 1 0.06114 0.06117 0.0612 0.11% Castro::errorEst() 11 0.05902 0.05943 0.06002 0.11% Gravity::update_max_rhs() 20 0.04843 0.05367 0.05975 0.11% MLMG::mgVcycle_up::4 211 0.02511 0.03374 0.0582 0.11% MLMG::buildFineMask() 80 0.04791 0.04834 0.04875 0.09% Gravity::test_level_grad_phi_prev() 30 0.04672 0.04697 0.04721 0.09% MultiFab::norm0(mask) 57 0.04602 0.04621 0.04649 0.08% MLMG::MLResNormInf() 97 0.04322 0.04339 0.04363 0.08% FabArrayBase::CPC::define() 2260 0.02775 0.03195 0.04318 0.08% MultiFab::Copy() 100 0.03903 0.0393 0.03962 0.07% MLMG::interpCorrection_1 78 0.03289 0.03623 0.03955 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03612 0.03676 0.03772 0.07% MLMG::MLRhsNormInf() 80 0.02827 0.02846 0.02868 0.05% MLPoisson::prepareForSolve() 81 0.02508 0.026 0.02831 0.05% MLCellLinOp::prepareForSolve() 81 0.02472 0.02564 0.02797 0.05% FabArrayBase::getFB() 13093 0.02339 0.02458 0.02762 0.05% MultiFab::max() 40 0.01393 0.01934 0.02563 0.05% Gravity::swapTimeLevels() 30 0.02267 0.02292 0.02316 0.04% Castro::apply_tagging_restrictions() 11 0.02086 0.02098 0.02117 0.04% Castro::computeInitialDt() 2 0.01661 0.01835 0.02015 0.04% Castro::finalize_do_advance() 30 0.008883 0.01499 0.02013 0.04% CGSolver::sxay() 588 0 0.00485 0.0194 0.04% Castro::build_fine_mask() 153 0.01825 0.01841 0.01851 0.03% AmrLevel::AmrLevel(dm) 12 0.01506 0.01666 0.01798 0.03% MLLinOp::define() 81 0.01272 0.01607 0.01783 0.03% StateData::define() 48 0.01477 0.01639 0.01773 0.03% MLLinOp::defineGrids() 81 0.01243 0.01578 0.01754 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01541 0.01559 0.01571 0.03% MLMG::compResidual() 1 0.01458 0.01487 0.01531 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003686 0.01474 0.03% Castro::avgDown() 11 0.01404 0.01417 0.01444 0.03% Castro::avgDown(state_indx) 44 0.01398 0.01411 0.01438 0.03% amrex::average_down_w_geom 44 0.01386 0.014 0.01427 0.03% Castro::swap_state_time_levels() 30 0.01327 0.01339 0.0136 0.02% MultiFab::Dot() 463 0 0.002788 0.01115 0.02% Castro::FluxRegFineAdd() 30 0.007455 0.007578 0.007675 0.01% MLLinOp::makeSubCommunicator() 81 0.003275 0.006345 0.007652 0.01% Castro::apply_problem_tags() 11 0.007542 0.00757 0.007612 0.01% TagBoxArray::mapPRD 11 0.005753 0.006615 0.007483 0.01% Castro::enforce_consistent_e() 3 0.003437 0.004975 0.00626 0.01% AMRErrorTag::operator() 11 0.004909 0.005002 0.005064 0.01% FabArrayBase::TheFPinfo() 130 0.0009498 0.002124 0.00291 0.01% Amr::InitAmr() 1 0.002503 0.002533 0.002551 0.00% MLLinOp::makeAgglomeratedDMap 81 0.002316 0.002381 0.002481 0.00% FPinfo::FPinfo() 3 0.0004247 0.001595 0.002388 0.00% FabArrayBase::FB::FB() 131 0.0008509 0.001241 0.002373 0.00% DistributionMapping::KnapSackDoIt() 3 0.0003173 0.001486 0.002277 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0003627 0.00148 0.002212 0.00% makeSFC 243 0.001559 0.001606 0.001684 0.00% OwnerMask() 11 0.001401 0.001473 0.001529 0.00% TagBoxArray::collate() 11 0.0007932 0.001224 0.001518 0.00% DistributionMapping::Distribute() 245 0.0004768 0.000483 0.0004871 0.00% Castro::enforce_speed_limit() 254 0.0003735 0.0003817 0.0003961 0.00% AmrMesh-cluster 2 0 8.817e-05 0.0003527 0.00% ClusterList::intersect() 2 0 5.756e-05 0.0002302 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 6.878e-05 0.0001406 0.0002209 0.00% FabArray::RecvLayoutMask() 21 0.0001913 0.0001938 0.0001958 0.00% Castro::create_source_corrector() 30 8.153e-05 8.497e-05 8.772e-05 0.00% BoxList::parallelComplementIn() 22 8.001e-05 8.165e-05 8.342e-05 0.00% knapsack() 3 6.567e-05 7.014e-05 7.785e-05 0.00% Amr::writeSmallPlotFile() 1 7.109e-05 7.264e-05 7.46e-05 0.00% Castro::retry_advance_ctu() 30 4.83e-05 5.752e-05 6.42e-05 0.00% Amr::initSubcycle() 1 3.595e-05 5.085e-05 6.405e-05 0.00% Gravity::set_mass_offset() 11 2.294e-05 3.605e-05 5.384e-05 0.00% Castro::gwstrain() 22 3.77e-05 4.142e-05 4.7e-05 0.00% BoxList::complementIn 22 3.892e-05 3.995e-05 4.156e-05 0.00% ClusterList::chop() 2 0 5.655e-06 2.262e-05 0.00% knapsack()swap 2 5.136e-06 5.424e-06 5.599e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.01-39-g874ccc6f3f8d) finalized